Nov 28 15:34:42 user nova-compute[75176]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=75176) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 28 15:34:42 user nova-compute[75176]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=75176) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 28 15:34:42 user nova-compute[75176]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=75176) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 28 15:34:42 user nova-compute[75176]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Nov 28 15:34:42 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:34:42 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.020s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:34:42 user nova-compute[75176]: INFO nova.virt.driver [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] Loading compute driver 'libvirt.LibvirtDriver'
Nov 28 15:34:42 user nova-compute[75176]: INFO nova.compute.provider_config [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Nov 28 15:34:42 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] Acquiring lock "singleton_lock" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:34:42 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] Acquired lock "singleton_lock" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:34:42 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] Releasing lock "singleton_lock" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:34:42 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] Full set of CONF: {{(pid=75176) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Nov 28 15:34:42 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] ******************************************************************************** {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Nov 28 15:34:42 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] Configuration options gathered from: {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Nov 28 15:34:42 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Nov 28 15:34:42 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Nov 28 15:34:42 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] ================================================================================ {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Nov 28 15:34:42 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] allow_resize_to_same_host      = True {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 15:34:42 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] arq_binding_timeout            = 300 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 15:34:42 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] backdoor_port                  = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 15:34:42 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] backdoor_socket                = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 15:34:42 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] block_device_allocate_retries  = 300 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 15:34:42 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] block_device_allocate_retries_interval = 5 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 15:34:42 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] cert                           = self.pem {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 15:34:42 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 15:34:42 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] compute_monitors               = [] {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 15:34:42 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] config_dir                     = [] {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 15:34:42 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] config_drive_format            = iso9660 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 15:34:42 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 15:34:42 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] config_source                  = [] {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 15:34:42 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] console_host                   = user {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 15:34:42 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] control_exchange               = nova {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 15:34:42 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] cpu_allocation_ratio           = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 15:34:42 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] daemon                         = False {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 15:34:42 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] debug                          = True {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 15:34:42 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] default_access_ip_network_name = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 15:34:42 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] default_availability_zone      = nova {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 15:34:42 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] default_ephemeral_format       = ext4 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 15:34:42 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] default_green_pool_size        = 1000 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 15:34:42 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 15:34:42 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] default_schedule_zone          = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 15:34:42 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] disk_allocation_ratio          = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 15:34:42 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] enable_new_services            = True {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 15:34:42 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] enabled_apis                   = ['osapi_compute'] {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 15:34:42 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] enabled_ssl_apis               = [] {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 15:34:42 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] flat_injected                  = False {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 15:34:42 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] force_config_drive             = False {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 15:34:42 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] force_raw_images               = True {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 15:34:42 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] graceful_shutdown_timeout      = 5 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 15:34:42 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] heal_instance_info_cache_interval = 60 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 15:34:42 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] host                           = user {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 15:34:42 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 15:34:42 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 15:34:42 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 15:34:42 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 15:34:42 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] instance_build_timeout         = 0 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 15:34:42 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] instance_delete_interval       = 300 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 15:34:42 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] instance_format                = [instance: %(uuid)s]  {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 15:34:42 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] instance_name_template         = instance-%08x {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 15:34:42 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] instance_usage_audit           = False {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 15:34:42 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] instance_usage_audit_period    = month {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 15:34:42 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 15:34:42 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 15:34:42 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] internal_service_availability_zone = internal {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 15:34:42 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] key                            = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 15:34:42 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] live_migration_retry_count     = 30 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 15:34:42 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] log_config_append              = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 15:34:42 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 15:34:42 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] log_dir                        = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 15:34:42 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] log_file                       = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 15:34:42 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] log_options                    = True {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 15:34:42 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] log_rotate_interval            = 1 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 15:34:42 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] log_rotate_interval_type       = days {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 15:34:42 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] log_rotation_type              = none {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 15:34:42 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 15:34:42 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 15:34:42 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 15:34:42 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 15:34:42 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 15:34:42 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] long_rpc_timeout               = 1800 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] max_concurrent_builds          = 10 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] max_concurrent_live_migrations = 1 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] max_concurrent_snapshots       = 5 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] max_local_block_devices        = 3 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] max_logfile_count              = 30 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] max_logfile_size_mb            = 200 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] maximum_instance_delete_attempts = 5 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] metadata_listen                = 0.0.0.0 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] metadata_listen_port           = 8775 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] metadata_workers               = 3 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] migrate_max_retries            = -1 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] mkisofs_cmd                    = genisoimage {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] my_ip                          = 10.0.0.210 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] network_allocate_retries       = 0 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] osapi_compute_listen_port      = 8774 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] osapi_compute_unique_server_name_scope =  {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] osapi_compute_workers          = 3 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] password_length                = 12 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] periodic_enable                = True {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] periodic_fuzzy_delay           = 60 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] pointer_model                  = ps2mouse {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] preallocate_images             = none {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] publish_errors                 = False {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] pybasedir                      = /opt/stack/nova {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] ram_allocation_ratio           = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] rate_limit_burst               = 0 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] rate_limit_except_level        = CRITICAL {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] rate_limit_interval            = 0 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] reboot_timeout                 = 0 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] reclaim_instance_interval      = 0 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] record                         = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] reimage_timeout_per_gb         = 60 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] report_interval                = 120 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] rescue_timeout                 = 0 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] reserved_host_cpus             = 0 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] reserved_host_disk_mb          = 0 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] reserved_host_memory_mb        = 512 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] reserved_huge_pages            = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] resize_confirm_window          = 0 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] resize_fs_using_block_device   = False {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] resume_guests_state_on_host_boot = False {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] rpc_response_timeout           = 60 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] run_external_periodic_tasks    = True {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] running_deleted_instance_action = reap {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] running_deleted_instance_poll_interval = 1800 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] running_deleted_instance_timeout = 0 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] scheduler_instance_sync_interval = 120 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] service_down_time              = 720 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] servicegroup_driver            = db {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] shelved_offload_time           = 0 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] shelved_poll_interval          = 3600 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] shutdown_timeout               = 0 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] source_is_ipv6                 = False {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] ssl_only                       = False {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] state_path                     = /opt/stack/data/nova {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] sync_power_state_interval      = 600 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] sync_power_state_pool_size     = 1000 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] syslog_log_facility            = LOG_USER {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] tempdir                        = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] timeout_nbd                    = 10 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] transport_url                  = **** {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] update_resources_interval      = 0 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] use_cow_images                 = True {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] use_eventlog                   = False {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] use_journal                    = False {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] use_json                       = False {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] use_rootwrap_daemon            = False {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] use_stderr                     = False {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] use_syslog                     = False {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] vcpu_pin_set                   = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] vif_plugging_is_fatal          = False {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] vif_plugging_timeout           = 0 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] virt_mkfs                      = [] {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] volume_usage_poll_interval     = 0 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] watch_log_file                 = False {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] web                            = /usr/share/spice-html5 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] oslo_concurrency.disable_process_locking = False {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] api.auth_strategy              = keystone {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] api.compute_link_prefix        = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] api.dhcp_domain                = novalocal {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] api.enable_instance_password   = True {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] api.glance_link_prefix         = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] api.instance_list_per_project_cells = False {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] api.list_records_by_skipping_down_cells = True {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] api.local_metadata_per_cell    = False {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] api.max_limit                  = 1000 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] api.metadata_cache_expiration  = 15 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] api.neutron_default_tenant_id  = default {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] api.use_forwarded_for          = False {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] api.use_neutron_default_nets   = False {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] api.vendordata_dynamic_targets = [] {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] api.vendordata_jsonfile_path   = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] cache.backend                  = dogpile.cache.memcached {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] cache.backend_argument         = **** {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] cache.config_prefix            = cache.oslo {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] cache.dead_timeout             = 60.0 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] cache.debug_cache_backend      = False {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] cache.enable_retry_client      = False {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] cache.enable_socket_keepalive  = False {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] cache.enabled                  = True {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] cache.expiration_time          = 600 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] cache.hashclient_retry_attempts = 2 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] cache.memcache_dead_retry      = 300 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] cache.memcache_password        =  {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] cache.memcache_pool_maxsize    = 10 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] cache.memcache_sasl_enabled    = False {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] cache.memcache_username        =  {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] cache.proxies                  = [] {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] cache.retry_attempts           = 2 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] cache.retry_delay              = 0.0 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] cache.socket_keepalive_count   = 1 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] cache.socket_keepalive_idle    = 1 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] cache.socket_keepalive_interval = 1 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] cache.tls_allowed_ciphers      = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] cache.tls_cafile               = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] cache.tls_certfile             = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] cache.tls_enabled              = False {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] cache.tls_keyfile              = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] cinder.auth_section            = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] cinder.auth_type               = password {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] cinder.cafile                  = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] cinder.certfile                = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] cinder.collect_timing          = False {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] cinder.cross_az_attach         = True {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] cinder.debug                   = False {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] cinder.endpoint_template       = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] cinder.http_retries            = 3 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] cinder.insecure                = False {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] cinder.keyfile                 = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] cinder.os_region_name          = RegionOne {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] cinder.split_loggers           = False {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] cinder.timeout                 = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] compute.cpu_dedicated_set      = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] compute.cpu_shared_set         = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] compute.image_type_exclude_list = [] {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] compute.max_concurrent_disk_ops = 0 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] compute.max_disk_devices_to_attach = -1 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] compute.resource_provider_association_refresh = 300 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] compute.shutdown_retry_interval = 10 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] conductor.workers              = 3 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] console.allowed_origins        = [] {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] console.ssl_ciphers            = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] console.ssl_minimum_version    = default {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] consoleauth.token_ttl          = 600 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] cyborg.cafile                  = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] cyborg.certfile                = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] cyborg.collect_timing          = False {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] cyborg.connect_retries         = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] cyborg.connect_retry_delay     = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] cyborg.endpoint_override       = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] cyborg.insecure                = False {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] cyborg.keyfile                 = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] cyborg.max_version             = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] cyborg.min_version             = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] cyborg.region_name             = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] cyborg.service_name            = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] cyborg.service_type            = accelerator {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] cyborg.split_loggers           = False {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] cyborg.status_code_retries     = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] cyborg.status_code_retry_delay = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] cyborg.timeout                 = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] cyborg.version                 = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] database.backend               = sqlalchemy {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] database.connection            = **** {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] database.connection_debug      = 0 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] database.connection_parameters =  {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] database.connection_recycle_time = 3600 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] database.connection_trace      = False {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] database.db_inc_retry_interval = True {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] database.db_max_retries        = 20 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] database.db_max_retry_interval = 10 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] database.db_retry_interval     = 1 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] database.max_overflow          = 50 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] database.max_pool_size         = 5 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] database.max_retries           = 10 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] database.mysql_wsrep_sync_wait = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] database.pool_timeout          = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] database.retry_interval        = 10 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] database.slave_connection      = **** {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] database.sqlite_synchronous    = True {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] api_database.backend           = sqlalchemy {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] api_database.connection        = **** {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] api_database.connection_debug  = 0 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] api_database.connection_parameters =  {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] api_database.connection_recycle_time = 3600 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] api_database.connection_trace  = False {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] api_database.db_inc_retry_interval = True {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] api_database.db_max_retries    = 20 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] api_database.db_max_retry_interval = 10 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] api_database.db_retry_interval = 1 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] api_database.max_overflow      = 50 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] api_database.max_pool_size     = 5 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] api_database.max_retries       = 10 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] api_database.pool_timeout      = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] api_database.retry_interval    = 10 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] api_database.slave_connection  = **** {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] api_database.sqlite_synchronous = True {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] devices.enabled_mdev_types     = [] {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] ephemeral_storage_encryption.enabled = False {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] glance.api_servers             = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] glance.cafile                  = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] glance.certfile                = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] glance.collect_timing          = False {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] glance.connect_retries         = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] glance.connect_retry_delay     = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] glance.debug                   = False {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] glance.default_trusted_certificate_ids = [] {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] glance.enable_certificate_validation = False {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] glance.enable_rbd_download     = False {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] glance.endpoint_override       = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] glance.insecure                = False {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] glance.keyfile                 = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] glance.max_version             = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] glance.min_version             = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] glance.num_retries             = 3 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] glance.rbd_ceph_conf           =  {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] glance.rbd_connect_timeout     = 5 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] glance.rbd_pool                =  {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] glance.rbd_user                =  {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] glance.region_name             = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] glance.service_name            = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] glance.service_type            = image {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] glance.split_loggers           = False {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] glance.status_code_retries     = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] glance.status_code_retry_delay = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] glance.timeout                 = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] glance.verify_glance_signatures = False {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] glance.version                 = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] guestfs.debug                  = False {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] hyperv.config_drive_cdrom      = False {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] hyperv.config_drive_inject_password = False {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] hyperv.enable_instance_metrics_collection = False {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] hyperv.enable_remotefx         = False {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] hyperv.instances_path_share    =  {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] hyperv.iscsi_initiator_list    = [] {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] hyperv.limit_cpu_features      = False {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] hyperv.power_state_check_timeframe = 60 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] hyperv.use_multipath_io        = False {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] hyperv.volume_attach_retry_count = 10 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] hyperv.vswitch_name            = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] mks.enabled                    = False {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] image_cache.manager_interval   = 2400 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] image_cache.precache_concurrency = 1 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] image_cache.remove_unused_base_images = True {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] image_cache.subdirectory_name  = _base {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] ironic.api_max_retries         = 60 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] ironic.api_retry_interval      = 2 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] ironic.auth_section            = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] ironic.auth_type               = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] ironic.cafile                  = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] ironic.certfile                = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] ironic.collect_timing          = False {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] ironic.conductor_group         = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] ironic.connect_retries         = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] ironic.connect_retry_delay     = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] ironic.endpoint_override       = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] ironic.insecure                = False {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] ironic.keyfile                 = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] ironic.max_version             = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] ironic.min_version             = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] ironic.peer_list               = [] {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] ironic.region_name             = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] ironic.serial_console_state_timeout = 10 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] ironic.service_name            = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] ironic.service_type            = baremetal {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] ironic.split_loggers           = False {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] ironic.status_code_retries     = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] ironic.status_code_retry_delay = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] ironic.timeout                 = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] ironic.version                 = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] key_manager.fixed_key          = **** {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] barbican.barbican_api_version  = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] barbican.barbican_endpoint     = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] barbican.barbican_endpoint_type = public {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] barbican.barbican_region_name  = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] barbican.cafile                = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] barbican.certfile              = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] barbican.collect_timing        = False {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] barbican.insecure              = False {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] barbican.keyfile               = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] barbican.number_of_retries     = 60 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] barbican.retry_delay           = 1 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] barbican.send_service_user_token = False {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] barbican.split_loggers         = False {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] barbican.timeout               = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] barbican.verify_ssl            = True {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] barbican.verify_ssl_path       = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] barbican_service_user.auth_section = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] barbican_service_user.auth_type = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] barbican_service_user.cafile   = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] barbican_service_user.certfile = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] barbican_service_user.collect_timing = False {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] barbican_service_user.insecure = False {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] barbican_service_user.keyfile  = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] barbican_service_user.split_loggers = False {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] barbican_service_user.timeout  = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] vault.approle_role_id          = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] vault.approle_secret_id        = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] vault.cafile                   = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] vault.certfile                 = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] vault.collect_timing           = False {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] vault.insecure                 = False {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] vault.keyfile                  = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] vault.kv_mountpoint            = secret {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] vault.kv_path                  = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] vault.kv_version               = 2 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] vault.namespace                = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] vault.root_token_id            = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] vault.split_loggers            = False {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] vault.ssl_ca_crt_file          = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] vault.timeout                  = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] vault.use_ssl                  = False {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] keystone.auth_section          = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] keystone.auth_type             = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] keystone.cafile                = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] keystone.certfile              = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] keystone.collect_timing        = False {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] keystone.connect_retries       = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] keystone.connect_retry_delay   = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] keystone.endpoint_override     = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] keystone.insecure              = False {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] keystone.keyfile               = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] keystone.max_version           = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] keystone.min_version           = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] keystone.region_name           = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] keystone.service_name          = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] keystone.service_type          = identity {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] keystone.split_loggers         = False {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] keystone.status_code_retries   = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] keystone.status_code_retry_delay = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] keystone.timeout               = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] keystone.version               = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] libvirt.connection_uri         =  {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] libvirt.cpu_mode               = custom {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: WARNING oslo_config.cfg [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] libvirt.cpu_power_governor_high = performance {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] libvirt.cpu_power_governor_low = powersave {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] libvirt.cpu_power_management   = False {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] libvirt.device_detach_attempts = 8 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] libvirt.device_detach_timeout  = 20 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] libvirt.disk_cachemodes        = [] {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] libvirt.disk_prefix            = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] libvirt.enabled_perf_events    = [] {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] libvirt.file_backed_memory     = 0 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] libvirt.gid_maps               = [] {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] libvirt.hw_disk_discard        = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] libvirt.hw_machine_type        = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] libvirt.images_rbd_glance_store_name =  {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] libvirt.images_rbd_pool        = rbd {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] libvirt.images_type            = default {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] libvirt.images_volume_group    = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] libvirt.inject_key             = False {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] libvirt.inject_partition       = -2 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] libvirt.inject_password        = False {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] libvirt.iscsi_iface            = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] libvirt.iser_use_multipath     = False {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] libvirt.live_migration_bandwidth = 0 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] libvirt.live_migration_downtime = 500 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] libvirt.live_migration_inbound_addr = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] libvirt.live_migration_permit_post_copy = False {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] libvirt.live_migration_scheme  = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] libvirt.live_migration_timeout_action = abort {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] libvirt.live_migration_tunnelled = False {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: WARNING oslo_config.cfg [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Nov 28 15:34:43 user nova-compute[75176]: live_migration_uri is deprecated for removal in favor of two other options that
Nov 28 15:34:43 user nova-compute[75176]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Nov 28 15:34:43 user nova-compute[75176]: and ``live_migration_inbound_addr`` respectively.
Nov 28 15:34:43 user nova-compute[75176]: ).  Its value may be silently ignored in the future.
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] libvirt.live_migration_with_native_tls = False {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] libvirt.max_queues             = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] libvirt.nfs_mount_options      = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] libvirt.num_memory_encrypted_guests = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] libvirt.num_pcie_ports         = 0 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] libvirt.pmem_namespaces        = [] {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] libvirt.quobyte_client_cfg     = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] libvirt.rbd_secret_uuid        = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] libvirt.rbd_user               = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] libvirt.remote_filesystem_transport = ssh {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] libvirt.rescue_image_id        = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] libvirt.rescue_kernel_id       = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] libvirt.rescue_ramdisk_id      = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] libvirt.rx_queue_size          = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] libvirt.smbfs_mount_options    =  {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] libvirt.snapshot_compression   = False {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] libvirt.snapshot_image_format  = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] libvirt.sparse_logical_volumes = False {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] libvirt.swtpm_enabled          = False {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] libvirt.swtpm_group            = tss {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] libvirt.swtpm_user             = tss {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] libvirt.sysinfo_serial         = unique {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] libvirt.tb_cache_size          = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] libvirt.tx_queue_size          = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] libvirt.uid_maps               = [] {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] libvirt.use_virtio_for_bridges = True {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] libvirt.virt_type              = kvm {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] libvirt.volume_clear           = zero {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] libvirt.volume_clear_size      = 0 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] libvirt.volume_use_multipath   = False {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] libvirt.vzstorage_cache_path   = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] libvirt.vzstorage_mount_user   = stack {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] neutron.auth_section           = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] neutron.auth_type              = password {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] neutron.cafile                 = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] neutron.certfile               = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] neutron.collect_timing         = False {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] neutron.connect_retries        = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] neutron.connect_retry_delay    = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] neutron.default_floating_pool  = public {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] neutron.endpoint_override      = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] neutron.extension_sync_interval = 600 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] neutron.http_retries           = 3 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] neutron.insecure               = False {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] neutron.keyfile                = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] neutron.max_version            = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] neutron.min_version            = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] neutron.ovs_bridge             = br-int {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] neutron.physnets               = [] {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] neutron.region_name            = RegionOne {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] neutron.service_metadata_proxy = True {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] neutron.service_name           = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] neutron.service_type           = network {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] neutron.split_loggers          = False {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] neutron.status_code_retries    = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] neutron.status_code_retry_delay = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] neutron.timeout                = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] neutron.version                = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] notifications.bdms_in_notifications = False {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] notifications.default_level    = INFO {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] notifications.notification_format = unversioned {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] notifications.notify_on_state_change = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] pci.alias                      = [] {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] pci.device_spec                = [] {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] pci.report_in_placement        = False {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] placement.auth_section         = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] placement.auth_type            = password {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] placement.cafile               = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] placement.certfile             = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] placement.collect_timing       = False {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] placement.connect_retries      = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] placement.connect_retry_delay  = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] placement.default_domain_id    = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] placement.default_domain_name  = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] placement.domain_id            = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] placement.domain_name          = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] placement.endpoint_override    = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] placement.insecure             = False {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] placement.keyfile              = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] placement.max_version          = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] placement.min_version          = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] placement.password             = **** {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] placement.project_domain_id    = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] placement.project_domain_name  = Default {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] placement.project_id           = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] placement.project_name         = service {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] placement.region_name          = RegionOne {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] placement.service_name         = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] placement.service_type         = placement {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] placement.split_loggers        = False {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] placement.status_code_retries  = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] placement.status_code_retry_delay = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] placement.system_scope         = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] placement.timeout              = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] placement.trust_id             = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] placement.user_domain_id       = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] placement.user_domain_name     = Default {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] placement.user_id              = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] placement.username             = placement {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] placement.version              = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] quota.cores                    = 20 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] quota.count_usage_from_placement = False {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] quota.injected_file_content_bytes = 10240 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] quota.injected_file_path_length = 255 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] quota.injected_files           = 5 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] quota.instances                = 10 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] quota.key_pairs                = 100 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] quota.metadata_items           = 128 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] quota.ram                      = 51200 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] quota.recheck_quota            = True {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] quota.server_group_members     = 10 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] quota.server_groups            = 10 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] rdp.enabled                    = False {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] scheduler.image_metadata_prefilter = False {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] scheduler.max_attempts         = 3 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] scheduler.max_placement_results = 1000 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] scheduler.query_placement_for_image_type_support = False {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] scheduler.workers              = 3 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] filter_scheduler.host_subset_size = 1 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] filter_scheduler.isolated_hosts = [] {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] filter_scheduler.isolated_images = [] {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] filter_scheduler.pci_in_placement = False {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] filter_scheduler.track_instance_changes = False {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] metrics.required               = True {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] metrics.weight_multiplier      = 1.0 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] metrics.weight_setting         = [] {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] serial_console.enabled         = False {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] serial_console.port_range      = 10000:20000 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] serial_console.serialproxy_port = 6083 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] service_user.auth_section      = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] service_user.auth_type         = password {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] service_user.cafile            = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] service_user.certfile          = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] service_user.collect_timing    = False {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] service_user.insecure          = False {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] service_user.keyfile           = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] service_user.send_service_user_token = True {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] service_user.split_loggers     = False {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] service_user.timeout           = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] spice.agent_enabled            = True {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] spice.enabled                  = False {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] spice.html5proxy_port          = 6082 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] spice.image_compression        = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] spice.jpeg_compression         = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] spice.playback_compression     = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] spice.server_listen            = 127.0.0.1 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] spice.streaming_mode           = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] spice.zlib_compression         = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] upgrade_levels.baseapi         = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] upgrade_levels.compute         = auto {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] upgrade_levels.conductor       = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] upgrade_levels.scheduler       = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] vendordata_dynamic_auth.auth_section = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] vendordata_dynamic_auth.auth_type = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] vendordata_dynamic_auth.cafile = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] vendordata_dynamic_auth.certfile = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] vendordata_dynamic_auth.insecure = False {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] vendordata_dynamic_auth.keyfile = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] vendordata_dynamic_auth.timeout = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] vmware.api_retry_count         = 10 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] vmware.ca_file                 = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] vmware.cache_prefix            = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] vmware.cluster_name            = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] vmware.connection_pool_size    = 10 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] vmware.console_delay_seconds   = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] vmware.datastore_regex         = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] vmware.host_ip                 = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] vmware.host_password           = **** {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] vmware.host_port               = 443 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] vmware.host_username           = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] vmware.insecure                = False {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] vmware.integration_bridge      = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] vmware.maximum_objects         = 100 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] vmware.pbm_default_policy      = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] vmware.pbm_enabled             = False {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] vmware.pbm_wsdl_location       = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] vmware.serial_port_proxy_uri   = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] vmware.serial_port_service_uri = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] vmware.task_poll_interval      = 0.5 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] vmware.use_linked_clone        = True {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] vmware.vnc_keymap              = en-us {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] vmware.vnc_port                = 5900 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] vmware.vnc_port_total          = 10000 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] vnc.auth_schemes               = ['none'] {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] vnc.enabled                    = True {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] vnc.novncproxy_port            = 6080 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] vnc.server_listen              = 0.0.0.0 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] vnc.vencrypt_ca_certs          = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] vnc.vencrypt_client_cert       = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] vnc.vencrypt_client_key        = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] workarounds.disable_rootwrap   = False {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] workarounds.enable_numa_live_migration = False {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] workarounds.libvirt_disable_apic = False {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] wsgi.client_socket_timeout     = 900 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] wsgi.default_pool_size         = 1000 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] wsgi.keep_alive                = True {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] wsgi.max_header_line           = 16384 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] wsgi.ssl_ca_file               = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] wsgi.ssl_cert_file             = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] wsgi.ssl_key_file              = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] wsgi.tcp_keepidle              = 600 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] zvm.ca_file                    = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] zvm.cloud_connector_url        = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] zvm.reachable_timeout          = 300 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] oslo_policy.enforce_new_defaults = True {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] oslo_policy.enforce_scope      = True {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] oslo_policy.policy_default_rule = default {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] oslo_policy.policy_file        = policy.yaml {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] profiler.connection_string     = messaging:// {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] profiler.enabled               = False {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] profiler.es_doc_type           = notification {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] profiler.es_scroll_size        = 10000 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] profiler.es_scroll_time        = 2m {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] profiler.filter_error_trace    = False {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] profiler.hmac_keys             = **** {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] profiler.sentinel_service_name = mymaster {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] profiler.socket_timeout        = 0.1 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] profiler.trace_requests        = False {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] profiler.trace_sqlalchemy      = False {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] profiler_jaeger.process_tags   = {} {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] profiler_jaeger.service_name_prefix = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] profiler_otlp.service_name_prefix = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] remote_debug.host              = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] remote_debug.port              = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] oslo_messaging_rabbit.ssl      = False {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] oslo_messaging_notifications.retry = -1 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] oslo_limit.auth_section        = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] oslo_limit.auth_type           = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] oslo_limit.cafile              = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] oslo_limit.certfile            = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] oslo_limit.collect_timing      = False {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] oslo_limit.connect_retries     = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] oslo_limit.connect_retry_delay = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] oslo_limit.endpoint_id         = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] oslo_limit.endpoint_override   = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] oslo_limit.insecure            = False {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] oslo_limit.keyfile             = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] oslo_limit.max_version         = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] oslo_limit.min_version         = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] oslo_limit.region_name         = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] oslo_limit.service_name        = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] oslo_limit.service_type        = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] oslo_limit.split_loggers       = False {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] oslo_limit.status_code_retries = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] oslo_limit.status_code_retry_delay = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] oslo_limit.timeout             = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] oslo_limit.valid_interfaces    = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] oslo_limit.version             = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] oslo_reports.file_event_handler = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] oslo_reports.log_dir           = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] vif_plug_ovs_privileged.group  = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] vif_plug_ovs_privileged.user   = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] os_vif_linux_bridge.flat_interface = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] os_vif_ovs.default_qos_type    = linux-noop {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] os_vif_ovs.isolate_vif         = False {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] os_vif_ovs.per_port_bridge     = False {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] os_brick.lock_path             = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] privsep_osbrick.capabilities   = [21] {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] privsep_osbrick.group          = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] privsep_osbrick.helper_command = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] privsep_osbrick.user           = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] nova_sys_admin.group           = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] nova_sys_admin.helper_command  = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] nova_sys_admin.user            = None {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG oslo_service.service [None req-5e394008-b7ba-4067-85af-c0007216ae92 None None] ******************************************************************************** {{(pid=75176) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Nov 28 15:34:43 user nova-compute[75176]: INFO nova.service [-] Starting compute node (version 0.0.0)
Nov 28 15:34:43 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-c92bf948-4292-4af3-b72b-057b444bff2c None None] Connecting to libvirt: qemu:///system {{(pid=75176) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:508}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-c92bf948-4292-4af3-b72b-057b444bff2c None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7f464d89e410> {{(pid=75176) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:514}}
Nov 28 15:34:43 user nova-compute[75176]: libvirt:  error : internal error: could not initialize domain event timer
Nov 28 15:34:43 user nova-compute[75176]: WARNING nova.virt.libvirt.host [None req-c92bf948-4292-4af3-b72b-057b444bff2c None None] URI qemu:///system does not support events: internal error: could not initialize domain event timer: libvirt.libvirtError: internal error: could not initialize domain event timer
Nov 28 15:34:43 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-c92bf948-4292-4af3-b72b-057b444bff2c None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7f464d89e410> {{(pid=75176) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:535}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-c92bf948-4292-4af3-b72b-057b444bff2c None None] Starting native event thread {{(pid=75176) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:494}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-c92bf948-4292-4af3-b72b-057b444bff2c None None] Starting green dispatch thread {{(pid=75176) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:500}}
Nov 28 15:34:43 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-c92bf948-4292-4af3-b72b-057b444bff2c None None] Starting connection event dispatch thread {{(pid=75176) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:503}}
Nov 28 15:34:43 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-c92bf948-4292-4af3-b72b-057b444bff2c None None] Connection event '1' reason 'None'
Nov 28 15:34:43 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-c92bf948-4292-4af3-b72b-057b444bff2c None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 28 15:34:43 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.mount [None req-c92bf948-4292-4af3-b72b-057b444bff2c None None] Initialising _HostMountState generation 0 {{(pid=75176) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Nov 28 15:34:50 user nova-compute[75176]: INFO nova.virt.libvirt.host [None req-c92bf948-4292-4af3-b72b-057b444bff2c None None] Libvirt host capabilities <capabilities>
Nov 28 15:34:50 user nova-compute[75176]:   <host>
Nov 28 15:34:50 user nova-compute[75176]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Nov 28 15:34:50 user nova-compute[75176]:     <cpu>
Nov 28 15:34:50 user nova-compute[75176]:       <arch>x86_64</arch>
Nov 28 15:34:50 user nova-compute[75176]:       <model>IvyBridge-IBRS</model>
Nov 28 15:34:50 user nova-compute[75176]:       <vendor>Intel</vendor>
Nov 28 15:34:50 user nova-compute[75176]:       <microcode version='1070'/>
Nov 28 15:34:50 user nova-compute[75176]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Nov 28 15:34:50 user nova-compute[75176]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Nov 28 15:34:50 user nova-compute[75176]:       <feature name='ss'/>
Nov 28 15:34:50 user nova-compute[75176]:       <feature name='vmx'/>
Nov 28 15:34:50 user nova-compute[75176]:       <feature name='pcid'/>
Nov 28 15:34:50 user nova-compute[75176]:       <feature name='osxsave'/>
Nov 28 15:34:50 user nova-compute[75176]:       <feature name='hypervisor'/>
Nov 28 15:34:50 user nova-compute[75176]:       <feature name='arat'/>
Nov 28 15:34:50 user nova-compute[75176]:       <feature name='tsc_adjust'/>
Nov 28 15:34:50 user nova-compute[75176]:       <feature name='md-clear'/>
Nov 28 15:34:50 user nova-compute[75176]:       <feature name='stibp'/>
Nov 28 15:34:50 user nova-compute[75176]:       <feature name='arch-capabilities'/>
Nov 28 15:34:50 user nova-compute[75176]:       <feature name='ssbd'/>
Nov 28 15:34:50 user nova-compute[75176]:       <feature name='invtsc'/>
Nov 28 15:34:50 user nova-compute[75176]:       <feature name='rsba'/>
Nov 28 15:34:50 user nova-compute[75176]:       <feature name='skip-l1dfl-vmentry'/>
Nov 28 15:34:50 user nova-compute[75176]:       <pages unit='KiB' size='4'/>
Nov 28 15:34:50 user nova-compute[75176]:       <pages unit='KiB' size='2048'/>
Nov 28 15:34:50 user nova-compute[75176]:     </cpu>
Nov 28 15:34:50 user nova-compute[75176]:     <power_management>
Nov 28 15:34:50 user nova-compute[75176]:       <suspend_mem/>
Nov 28 15:34:50 user nova-compute[75176]:       <suspend_disk/>
Nov 28 15:34:50 user nova-compute[75176]:       <suspend_hybrid/>
Nov 28 15:34:50 user nova-compute[75176]:     </power_management>
Nov 28 15:34:50 user nova-compute[75176]:     <iommu support='no'/>
Nov 28 15:34:50 user nova-compute[75176]:     <migration_features>
Nov 28 15:34:50 user nova-compute[75176]:       <live/>
Nov 28 15:34:50 user nova-compute[75176]:       <uri_transports>
Nov 28 15:34:50 user nova-compute[75176]:         <uri_transport>tcp</uri_transport>
Nov 28 15:34:50 user nova-compute[75176]:         <uri_transport>rdma</uri_transport>
Nov 28 15:34:50 user nova-compute[75176]:       </uri_transports>
Nov 28 15:34:50 user nova-compute[75176]:     </migration_features>
Nov 28 15:34:50 user nova-compute[75176]:     <topology>
Nov 28 15:34:50 user nova-compute[75176]:       <cells num='2'>
Nov 28 15:34:50 user nova-compute[75176]:         <cell id='0'>
Nov 28 15:34:50 user nova-compute[75176]:           <memory unit='KiB'>8189224</memory>
Nov 28 15:34:50 user nova-compute[75176]:           <pages unit='KiB' size='4'>2047306</pages>
Nov 28 15:34:50 user nova-compute[75176]:           <pages unit='KiB' size='2048'>0</pages>
Nov 28 15:34:50 user nova-compute[75176]:           <distances>
Nov 28 15:34:50 user nova-compute[75176]:             <sibling id='0' value='10'/>
Nov 28 15:34:50 user nova-compute[75176]:             <sibling id='1' value='20'/>
Nov 28 15:34:50 user nova-compute[75176]:           </distances>
Nov 28 15:34:50 user nova-compute[75176]:           <cpus num='6'>
Nov 28 15:34:50 user nova-compute[75176]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Nov 28 15:34:50 user nova-compute[75176]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Nov 28 15:34:50 user nova-compute[75176]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Nov 28 15:34:50 user nova-compute[75176]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Nov 28 15:34:50 user nova-compute[75176]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Nov 28 15:34:50 user nova-compute[75176]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Nov 28 15:34:50 user nova-compute[75176]:           </cpus>
Nov 28 15:34:50 user nova-compute[75176]:         </cell>
Nov 28 15:34:50 user nova-compute[75176]:         <cell id='1'>
Nov 28 15:34:50 user nova-compute[75176]:           <memory unit='KiB'>8206460</memory>
Nov 28 15:34:50 user nova-compute[75176]:           <pages unit='KiB' size='4'>2051615</pages>
Nov 28 15:34:50 user nova-compute[75176]:           <pages unit='KiB' size='2048'>0</pages>
Nov 28 15:34:50 user nova-compute[75176]:           <distances>
Nov 28 15:34:50 user nova-compute[75176]:             <sibling id='0' value='20'/>
Nov 28 15:34:50 user nova-compute[75176]:             <sibling id='1' value='10'/>
Nov 28 15:34:50 user nova-compute[75176]:           </distances>
Nov 28 15:34:50 user nova-compute[75176]:           <cpus num='6'>
Nov 28 15:34:50 user nova-compute[75176]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Nov 28 15:34:50 user nova-compute[75176]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Nov 28 15:34:50 user nova-compute[75176]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Nov 28 15:34:50 user nova-compute[75176]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Nov 28 15:34:50 user nova-compute[75176]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Nov 28 15:34:50 user nova-compute[75176]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Nov 28 15:34:50 user nova-compute[75176]:           </cpus>
Nov 28 15:34:50 user nova-compute[75176]:         </cell>
Nov 28 15:34:50 user nova-compute[75176]:       </cells>
Nov 28 15:34:50 user nova-compute[75176]:     </topology>
Nov 28 15:34:50 user nova-compute[75176]:     <cache>
Nov 28 15:34:50 user nova-compute[75176]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Nov 28 15:34:50 user nova-compute[75176]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Nov 28 15:34:50 user nova-compute[75176]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Nov 28 15:34:50 user nova-compute[75176]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Nov 28 15:34:50 user nova-compute[75176]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Nov 28 15:34:50 user nova-compute[75176]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Nov 28 15:34:50 user nova-compute[75176]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Nov 28 15:34:50 user nova-compute[75176]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Nov 28 15:34:50 user nova-compute[75176]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Nov 28 15:34:50 user nova-compute[75176]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Nov 28 15:34:50 user nova-compute[75176]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Nov 28 15:34:50 user nova-compute[75176]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Nov 28 15:34:50 user nova-compute[75176]:     </cache>
Nov 28 15:34:50 user nova-compute[75176]:     <secmodel>
Nov 28 15:34:50 user nova-compute[75176]:       <model>apparmor</model>
Nov 28 15:34:50 user nova-compute[75176]:       <doi>0</doi>
Nov 28 15:34:50 user nova-compute[75176]:     </secmodel>
Nov 28 15:34:50 user nova-compute[75176]:     <secmodel>
Nov 28 15:34:50 user nova-compute[75176]:       <model>dac</model>
Nov 28 15:34:50 user nova-compute[75176]:       <doi>0</doi>
Nov 28 15:34:50 user nova-compute[75176]:       <baselabel type='kvm'>+64055:+108</baselabel>
Nov 28 15:34:50 user nova-compute[75176]:       <baselabel type='qemu'>+64055:+108</baselabel>
Nov 28 15:34:50 user nova-compute[75176]:     </secmodel>
Nov 28 15:34:50 user nova-compute[75176]:   </host>
Nov 28 15:34:50 user nova-compute[75176]:   <guest>
Nov 28 15:34:50 user nova-compute[75176]:     <os_type>hvm</os_type>
Nov 28 15:34:50 user nova-compute[75176]:     <arch name='alpha'>
Nov 28 15:34:50 user nova-compute[75176]:       <wordsize>64</wordsize>
Nov 28 15:34:50 user nova-compute[75176]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='4'>clipper</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <domain type='qemu'/>
Nov 28 15:34:50 user nova-compute[75176]:     </arch>
Nov 28 15:34:50 user nova-compute[75176]:     <features>
Nov 28 15:34:50 user nova-compute[75176]:       <cpuselection/>
Nov 28 15:34:50 user nova-compute[75176]:       <deviceboot/>
Nov 28 15:34:50 user nova-compute[75176]:       <disksnapshot default='on' toggle='no'/>
Nov 28 15:34:50 user nova-compute[75176]:     </features>
Nov 28 15:34:50 user nova-compute[75176]:   </guest>
Nov 28 15:34:50 user nova-compute[75176]:   <guest>
Nov 28 15:34:50 user nova-compute[75176]:     <os_type>hvm</os_type>
Nov 28 15:34:50 user nova-compute[75176]:     <arch name='armv6l'>
Nov 28 15:34:50 user nova-compute[75176]:       <wordsize>32</wordsize>
Nov 28 15:34:50 user nova-compute[75176]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>integratorcp</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>borzoi</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>spitz</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='2'>nuri</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='2'>musca-b1</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>versatileab</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>kzm</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='2'>musca-a</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='2'>smdkc210</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>sx1</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>z2</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>tosa</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='4'>sabrelite</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>realview-eb</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>n810</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>n800</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>versatilepb</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>terrier</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>mainstone</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='4'>midway</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>musicpal</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>microbit</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>cubieboard</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>verdex</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>netduino2</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='4'>raspi2b</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>cheetah</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='4'>highbank</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>akita</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>connex</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>collie</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>raspi0</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <domain type='qemu'/>
Nov 28 15:34:50 user nova-compute[75176]:     </arch>
Nov 28 15:34:50 user nova-compute[75176]:     <features>
Nov 28 15:34:50 user nova-compute[75176]:       <cpuselection/>
Nov 28 15:34:50 user nova-compute[75176]:       <deviceboot/>
Nov 28 15:34:50 user nova-compute[75176]:       <disksnapshot default='on' toggle='no'/>
Nov 28 15:34:50 user nova-compute[75176]:     </features>
Nov 28 15:34:50 user nova-compute[75176]:   </guest>
Nov 28 15:34:50 user nova-compute[75176]:   <guest>
Nov 28 15:34:50 user nova-compute[75176]:     <os_type>hvm</os_type>
Nov 28 15:34:50 user nova-compute[75176]:     <arch name='armv7l'>
Nov 28 15:34:50 user nova-compute[75176]:       <wordsize>32</wordsize>
Nov 28 15:34:50 user nova-compute[75176]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>integratorcp</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>borzoi</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>spitz</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='2'>nuri</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='2'>musca-b1</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>versatileab</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>kzm</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='2'>musca-a</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='2'>smdkc210</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>sx1</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>z2</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>tosa</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='4'>sabrelite</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>realview-eb</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>n810</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>n800</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>versatilepb</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>terrier</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>mainstone</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='4'>midway</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>musicpal</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>microbit</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>cubieboard</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>verdex</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>netduino2</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='4'>raspi2b</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>cheetah</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='4'>highbank</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>akita</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>connex</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>collie</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>raspi0</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <domain type='qemu'/>
Nov 28 15:34:50 user nova-compute[75176]:     </arch>
Nov 28 15:34:50 user nova-compute[75176]:     <features>
Nov 28 15:34:50 user nova-compute[75176]:       <cpuselection/>
Nov 28 15:34:50 user nova-compute[75176]:       <deviceboot/>
Nov 28 15:34:50 user nova-compute[75176]:       <disksnapshot default='on' toggle='no'/>
Nov 28 15:34:50 user nova-compute[75176]:     </features>
Nov 28 15:34:50 user nova-compute[75176]:   </guest>
Nov 28 15:34:50 user nova-compute[75176]:   <guest>
Nov 28 15:34:50 user nova-compute[75176]:     <os_type>hvm</os_type>
Nov 28 15:34:50 user nova-compute[75176]:     <arch name='aarch64'>
Nov 28 15:34:50 user nova-compute[75176]:       <wordsize>64</wordsize>
Nov 28 15:34:50 user nova-compute[75176]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>integratorcp</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>borzoi</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>spitz</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='2'>nuri</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='2'>musca-b1</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>versatileab</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>kzm</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='2'>musca-a</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='2'>smdkc210</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>sx1</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>z2</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>tosa</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='4'>sabrelite</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>realview-eb</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='512'>sbsa-ref</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>n810</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>n800</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>versatilepb</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>terrier</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>mainstone</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='4'>midway</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>musicpal</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>microbit</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='4'>raspi3ap</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>cubieboard</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>verdex</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>netduino2</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='4'>raspi3b</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='4'>raspi2b</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>cheetah</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='4'>highbank</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>akita</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>connex</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>collie</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>raspi0</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <domain type='qemu'/>
Nov 28 15:34:50 user nova-compute[75176]:     </arch>
Nov 28 15:34:50 user nova-compute[75176]:     <features>
Nov 28 15:34:50 user nova-compute[75176]:       <acpi default='on' toggle='yes'/>
Nov 28 15:34:50 user nova-compute[75176]:       <cpuselection/>
Nov 28 15:34:50 user nova-compute[75176]:       <deviceboot/>
Nov 28 15:34:50 user nova-compute[75176]:       <disksnapshot default='on' toggle='no'/>
Nov 28 15:34:50 user nova-compute[75176]:     </features>
Nov 28 15:34:50 user nova-compute[75176]:   </guest>
Nov 28 15:34:50 user nova-compute[75176]:   <guest>
Nov 28 15:34:50 user nova-compute[75176]:     <os_type>hvm</os_type>
Nov 28 15:34:50 user nova-compute[75176]:     <arch name='cris'>
Nov 28 15:34:50 user nova-compute[75176]:       <wordsize>32</wordsize>
Nov 28 15:34:50 user nova-compute[75176]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>axis-dev88</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <domain type='qemu'/>
Nov 28 15:34:50 user nova-compute[75176]:     </arch>
Nov 28 15:34:50 user nova-compute[75176]:     <features>
Nov 28 15:34:50 user nova-compute[75176]:       <cpuselection/>
Nov 28 15:34:50 user nova-compute[75176]:       <deviceboot/>
Nov 28 15:34:50 user nova-compute[75176]:       <disksnapshot default='on' toggle='no'/>
Nov 28 15:34:50 user nova-compute[75176]:     </features>
Nov 28 15:34:50 user nova-compute[75176]:   </guest>
Nov 28 15:34:50 user nova-compute[75176]:   <guest>
Nov 28 15:34:50 user nova-compute[75176]:     <os_type>hvm</os_type>
Nov 28 15:34:50 user nova-compute[75176]:     <arch name='i686'>
Nov 28 15:34:50 user nova-compute[75176]:       <wordsize>32</wordsize>
Nov 28 15:34:50 user nova-compute[75176]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>x-remote</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>isapc</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='288'>microvm</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <domain type='qemu'/>
Nov 28 15:34:50 user nova-compute[75176]:       <domain type='kvm'/>
Nov 28 15:34:50 user nova-compute[75176]:     </arch>
Nov 28 15:34:50 user nova-compute[75176]:     <features>
Nov 28 15:34:50 user nova-compute[75176]:       <pae/>
Nov 28 15:34:50 user nova-compute[75176]:       <nonpae/>
Nov 28 15:34:50 user nova-compute[75176]:       <acpi default='on' toggle='yes'/>
Nov 28 15:34:50 user nova-compute[75176]:       <apic default='on' toggle='no'/>
Nov 28 15:34:50 user nova-compute[75176]:       <cpuselection/>
Nov 28 15:34:50 user nova-compute[75176]:       <deviceboot/>
Nov 28 15:34:50 user nova-compute[75176]:       <disksnapshot default='on' toggle='no'/>
Nov 28 15:34:50 user nova-compute[75176]:     </features>
Nov 28 15:34:50 user nova-compute[75176]:   </guest>
Nov 28 15:34:50 user nova-compute[75176]:   <guest>
Nov 28 15:34:50 user nova-compute[75176]:     <os_type>hvm</os_type>
Nov 28 15:34:50 user nova-compute[75176]:     <arch name='m68k'>
Nov 28 15:34:50 user nova-compute[75176]:       <wordsize>32</wordsize>
Nov 28 15:34:50 user nova-compute[75176]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>mcf5208evb</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>an5206</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>virt-6.0</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>q800</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>virt-6.2</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>next-cube</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>virt-6.1</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <domain type='qemu'/>
Nov 28 15:34:50 user nova-compute[75176]:     </arch>
Nov 28 15:34:50 user nova-compute[75176]:     <features>
Nov 28 15:34:50 user nova-compute[75176]:       <cpuselection/>
Nov 28 15:34:50 user nova-compute[75176]:       <deviceboot/>
Nov 28 15:34:50 user nova-compute[75176]:       <disksnapshot default='on' toggle='no'/>
Nov 28 15:34:50 user nova-compute[75176]:     </features>
Nov 28 15:34:50 user nova-compute[75176]:   </guest>
Nov 28 15:34:50 user nova-compute[75176]:   <guest>
Nov 28 15:34:50 user nova-compute[75176]:     <os_type>hvm</os_type>
Nov 28 15:34:50 user nova-compute[75176]:     <arch name='microblaze'>
Nov 28 15:34:50 user nova-compute[75176]:       <wordsize>32</wordsize>
Nov 28 15:34:50 user nova-compute[75176]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <domain type='qemu'/>
Nov 28 15:34:50 user nova-compute[75176]:     </arch>
Nov 28 15:34:50 user nova-compute[75176]:     <features>
Nov 28 15:34:50 user nova-compute[75176]:       <cpuselection/>
Nov 28 15:34:50 user nova-compute[75176]:       <deviceboot/>
Nov 28 15:34:50 user nova-compute[75176]:       <disksnapshot default='on' toggle='no'/>
Nov 28 15:34:50 user nova-compute[75176]:     </features>
Nov 28 15:34:50 user nova-compute[75176]:   </guest>
Nov 28 15:34:50 user nova-compute[75176]:   <guest>
Nov 28 15:34:50 user nova-compute[75176]:     <os_type>hvm</os_type>
Nov 28 15:34:50 user nova-compute[75176]:     <arch name='microblazeel'>
Nov 28 15:34:50 user nova-compute[75176]:       <wordsize>32</wordsize>
Nov 28 15:34:50 user nova-compute[75176]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <domain type='qemu'/>
Nov 28 15:34:50 user nova-compute[75176]:     </arch>
Nov 28 15:34:50 user nova-compute[75176]:     <features>
Nov 28 15:34:50 user nova-compute[75176]:       <cpuselection/>
Nov 28 15:34:50 user nova-compute[75176]:       <deviceboot/>
Nov 28 15:34:50 user nova-compute[75176]:       <disksnapshot default='on' toggle='no'/>
Nov 28 15:34:50 user nova-compute[75176]:     </features>
Nov 28 15:34:50 user nova-compute[75176]:   </guest>
Nov 28 15:34:50 user nova-compute[75176]:   <guest>
Nov 28 15:34:50 user nova-compute[75176]:     <os_type>hvm</os_type>
Nov 28 15:34:50 user nova-compute[75176]:     <arch name='mips'>
Nov 28 15:34:50 user nova-compute[75176]:       <wordsize>32</wordsize>
Nov 28 15:34:50 user nova-compute[75176]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='16'>malta</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>mipssim</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <domain type='qemu'/>
Nov 28 15:34:50 user nova-compute[75176]:     </arch>
Nov 28 15:34:50 user nova-compute[75176]:     <features>
Nov 28 15:34:50 user nova-compute[75176]:       <cpuselection/>
Nov 28 15:34:50 user nova-compute[75176]:       <deviceboot/>
Nov 28 15:34:50 user nova-compute[75176]:       <disksnapshot default='on' toggle='no'/>
Nov 28 15:34:50 user nova-compute[75176]:     </features>
Nov 28 15:34:50 user nova-compute[75176]:   </guest>
Nov 28 15:34:50 user nova-compute[75176]:   <guest>
Nov 28 15:34:50 user nova-compute[75176]:     <os_type>hvm</os_type>
Nov 28 15:34:50 user nova-compute[75176]:     <arch name='mipsel'>
Nov 28 15:34:50 user nova-compute[75176]:       <wordsize>32</wordsize>
Nov 28 15:34:50 user nova-compute[75176]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='16'>malta</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>mipssim</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <domain type='qemu'/>
Nov 28 15:34:50 user nova-compute[75176]:     </arch>
Nov 28 15:34:50 user nova-compute[75176]:     <features>
Nov 28 15:34:50 user nova-compute[75176]:       <cpuselection/>
Nov 28 15:34:50 user nova-compute[75176]:       <deviceboot/>
Nov 28 15:34:50 user nova-compute[75176]:       <disksnapshot default='on' toggle='no'/>
Nov 28 15:34:50 user nova-compute[75176]:     </features>
Nov 28 15:34:50 user nova-compute[75176]:   </guest>
Nov 28 15:34:50 user nova-compute[75176]:   <guest>
Nov 28 15:34:50 user nova-compute[75176]:     <os_type>hvm</os_type>
Nov 28 15:34:50 user nova-compute[75176]:     <arch name='mips64'>
Nov 28 15:34:50 user nova-compute[75176]:       <wordsize>64</wordsize>
Nov 28 15:34:50 user nova-compute[75176]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='16'>malta</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>mipssim</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>pica61</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>magnum</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <domain type='qemu'/>
Nov 28 15:34:50 user nova-compute[75176]:     </arch>
Nov 28 15:34:50 user nova-compute[75176]:     <features>
Nov 28 15:34:50 user nova-compute[75176]:       <cpuselection/>
Nov 28 15:34:50 user nova-compute[75176]:       <deviceboot/>
Nov 28 15:34:50 user nova-compute[75176]:       <disksnapshot default='on' toggle='no'/>
Nov 28 15:34:50 user nova-compute[75176]:     </features>
Nov 28 15:34:50 user nova-compute[75176]:   </guest>
Nov 28 15:34:50 user nova-compute[75176]:   <guest>
Nov 28 15:34:50 user nova-compute[75176]:     <os_type>hvm</os_type>
Nov 28 15:34:50 user nova-compute[75176]:     <arch name='mips64el'>
Nov 28 15:34:50 user nova-compute[75176]:       <wordsize>64</wordsize>
Nov 28 15:34:50 user nova-compute[75176]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='16'>malta</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='16'>loongson3-virt</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>mipssim</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>pica61</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>magnum</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='16'>boston</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>fuloong2e</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <domain type='qemu'/>
Nov 28 15:34:50 user nova-compute[75176]:     </arch>
Nov 28 15:34:50 user nova-compute[75176]:     <features>
Nov 28 15:34:50 user nova-compute[75176]:       <cpuselection/>
Nov 28 15:34:50 user nova-compute[75176]:       <deviceboot/>
Nov 28 15:34:50 user nova-compute[75176]:       <disksnapshot default='on' toggle='no'/>
Nov 28 15:34:50 user nova-compute[75176]:     </features>
Nov 28 15:34:50 user nova-compute[75176]:   </guest>
Nov 28 15:34:50 user nova-compute[75176]:   <guest>
Nov 28 15:34:50 user nova-compute[75176]:     <os_type>hvm</os_type>
Nov 28 15:34:50 user nova-compute[75176]:     <arch name='ppc'>
Nov 28 15:34:50 user nova-compute[75176]:       <wordsize>32</wordsize>
Nov 28 15:34:50 user nova-compute[75176]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>g3beige</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>mac99</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='32'>ppce500</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>pegasos2</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>sam460ex</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>bamboo</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>40p</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>ref405ep</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>taihu</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <domain type='qemu'/>
Nov 28 15:34:50 user nova-compute[75176]:     </arch>
Nov 28 15:34:50 user nova-compute[75176]:     <features>
Nov 28 15:34:50 user nova-compute[75176]:       <cpuselection/>
Nov 28 15:34:50 user nova-compute[75176]:       <deviceboot/>
Nov 28 15:34:50 user nova-compute[75176]:       <disksnapshot default='on' toggle='no'/>
Nov 28 15:34:50 user nova-compute[75176]:     </features>
Nov 28 15:34:50 user nova-compute[75176]:   </guest>
Nov 28 15:34:50 user nova-compute[75176]:   <guest>
Nov 28 15:34:50 user nova-compute[75176]:     <os_type>hvm</os_type>
Nov 28 15:34:50 user nova-compute[75176]:     <arch name='ppc64'>
Nov 28 15:34:50 user nova-compute[75176]:       <wordsize>64</wordsize>
Nov 28 15:34:50 user nova-compute[75176]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='2048'>powernv9</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>taihu</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='2048'>powernv10</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='32'>ppce500</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>40p</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>pegasos2</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>bamboo</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>g3beige</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>mac99</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>sam460ex</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>ref405ep</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='2048'>powernv8</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <domain type='qemu'/>
Nov 28 15:34:50 user nova-compute[75176]:     </arch>
Nov 28 15:34:50 user nova-compute[75176]:     <features>
Nov 28 15:34:50 user nova-compute[75176]:       <cpuselection/>
Nov 28 15:34:50 user nova-compute[75176]:       <deviceboot/>
Nov 28 15:34:50 user nova-compute[75176]:       <disksnapshot default='on' toggle='no'/>
Nov 28 15:34:50 user nova-compute[75176]:     </features>
Nov 28 15:34:50 user nova-compute[75176]:   </guest>
Nov 28 15:34:50 user nova-compute[75176]:   <guest>
Nov 28 15:34:50 user nova-compute[75176]:     <os_type>hvm</os_type>
Nov 28 15:34:50 user nova-compute[75176]:     <arch name='ppc64le'>
Nov 28 15:34:50 user nova-compute[75176]:       <wordsize>64</wordsize>
Nov 28 15:34:50 user nova-compute[75176]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='2048'>powernv9</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>taihu</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='2048'>powernv10</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='32'>ppce500</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>40p</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>pegasos2</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>bamboo</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>g3beige</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>mac99</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>sam460ex</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>ref405ep</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='2048'>powernv8</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <domain type='qemu'/>
Nov 28 15:34:50 user nova-compute[75176]:     </arch>
Nov 28 15:34:50 user nova-compute[75176]:     <features>
Nov 28 15:34:50 user nova-compute[75176]:       <cpuselection/>
Nov 28 15:34:50 user nova-compute[75176]:       <deviceboot/>
Nov 28 15:34:50 user nova-compute[75176]:       <disksnapshot default='on' toggle='no'/>
Nov 28 15:34:50 user nova-compute[75176]:     </features>
Nov 28 15:34:50 user nova-compute[75176]:   </guest>
Nov 28 15:34:50 user nova-compute[75176]:   <guest>
Nov 28 15:34:50 user nova-compute[75176]:     <os_type>hvm</os_type>
Nov 28 15:34:50 user nova-compute[75176]:     <arch name='riscv32'>
Nov 28 15:34:50 user nova-compute[75176]:       <wordsize>32</wordsize>
Nov 28 15:34:50 user nova-compute[75176]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='8'>spike</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>opentitan</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='5'>sifive_u</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>sifive_e</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='8'>virt</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <domain type='qemu'/>
Nov 28 15:34:50 user nova-compute[75176]:     </arch>
Nov 28 15:34:50 user nova-compute[75176]:     <features>
Nov 28 15:34:50 user nova-compute[75176]:       <cpuselection/>
Nov 28 15:34:50 user nova-compute[75176]:       <deviceboot/>
Nov 28 15:34:50 user nova-compute[75176]:       <disksnapshot default='on' toggle='no'/>
Nov 28 15:34:50 user nova-compute[75176]:     </features>
Nov 28 15:34:50 user nova-compute[75176]:   </guest>
Nov 28 15:34:50 user nova-compute[75176]:   <guest>
Nov 28 15:34:50 user nova-compute[75176]:     <os_type>hvm</os_type>
Nov 28 15:34:50 user nova-compute[75176]:     <arch name='riscv64'>
Nov 28 15:34:50 user nova-compute[75176]:       <wordsize>64</wordsize>
Nov 28 15:34:50 user nova-compute[75176]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='8'>spike</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='5'>sifive_u</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>shakti_c</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>sifive_e</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='8'>virt</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <domain type='qemu'/>
Nov 28 15:34:50 user nova-compute[75176]:     </arch>
Nov 28 15:34:50 user nova-compute[75176]:     <features>
Nov 28 15:34:50 user nova-compute[75176]:       <cpuselection/>
Nov 28 15:34:50 user nova-compute[75176]:       <deviceboot/>
Nov 28 15:34:50 user nova-compute[75176]:       <disksnapshot default='on' toggle='no'/>
Nov 28 15:34:50 user nova-compute[75176]:     </features>
Nov 28 15:34:50 user nova-compute[75176]:   </guest>
Nov 28 15:34:50 user nova-compute[75176]:   <guest>
Nov 28 15:34:50 user nova-compute[75176]:     <os_type>hvm</os_type>
Nov 28 15:34:50 user nova-compute[75176]:     <arch name='s390x'>
Nov 28 15:34:50 user nova-compute[75176]:       <wordsize>64</wordsize>
Nov 28 15:34:50 user nova-compute[75176]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <domain type='qemu'/>
Nov 28 15:34:50 user nova-compute[75176]:     </arch>
Nov 28 15:34:50 user nova-compute[75176]:     <features>
Nov 28 15:34:50 user nova-compute[75176]:       <cpuselection/>
Nov 28 15:34:50 user nova-compute[75176]:       <deviceboot/>
Nov 28 15:34:50 user nova-compute[75176]:       <disksnapshot default='on' toggle='no'/>
Nov 28 15:34:50 user nova-compute[75176]:     </features>
Nov 28 15:34:50 user nova-compute[75176]:   </guest>
Nov 28 15:34:50 user nova-compute[75176]:   <guest>
Nov 28 15:34:50 user nova-compute[75176]:     <os_type>hvm</os_type>
Nov 28 15:34:50 user nova-compute[75176]:     <arch name='sh4'>
Nov 28 15:34:50 user nova-compute[75176]:       <wordsize>32</wordsize>
Nov 28 15:34:50 user nova-compute[75176]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>shix</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>r2d</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <domain type='qemu'/>
Nov 28 15:34:50 user nova-compute[75176]:     </arch>
Nov 28 15:34:50 user nova-compute[75176]:     <features>
Nov 28 15:34:50 user nova-compute[75176]:       <cpuselection/>
Nov 28 15:34:50 user nova-compute[75176]:       <deviceboot/>
Nov 28 15:34:50 user nova-compute[75176]:       <disksnapshot default='on' toggle='no'/>
Nov 28 15:34:50 user nova-compute[75176]:     </features>
Nov 28 15:34:50 user nova-compute[75176]:   </guest>
Nov 28 15:34:50 user nova-compute[75176]:   <guest>
Nov 28 15:34:50 user nova-compute[75176]:     <os_type>hvm</os_type>
Nov 28 15:34:50 user nova-compute[75176]:     <arch name='sh4eb'>
Nov 28 15:34:50 user nova-compute[75176]:       <wordsize>64</wordsize>
Nov 28 15:34:50 user nova-compute[75176]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>shix</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>r2d</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <domain type='qemu'/>
Nov 28 15:34:50 user nova-compute[75176]:     </arch>
Nov 28 15:34:50 user nova-compute[75176]:     <features>
Nov 28 15:34:50 user nova-compute[75176]:       <cpuselection/>
Nov 28 15:34:50 user nova-compute[75176]:       <deviceboot/>
Nov 28 15:34:50 user nova-compute[75176]:       <disksnapshot default='on' toggle='no'/>
Nov 28 15:34:50 user nova-compute[75176]:     </features>
Nov 28 15:34:50 user nova-compute[75176]:   </guest>
Nov 28 15:34:50 user nova-compute[75176]:   <guest>
Nov 28 15:34:50 user nova-compute[75176]:     <os_type>hvm</os_type>
Nov 28 15:34:50 user nova-compute[75176]:     <arch name='sparc'>
Nov 28 15:34:50 user nova-compute[75176]:       <wordsize>32</wordsize>
Nov 28 15:34:50 user nova-compute[75176]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>SS-5</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='4'>SS-20</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>LX</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>SPARCClassic</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>leon3_generic</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>SPARCbook</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>SS-4</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='4'>SS-600MP</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='4'>SS-10</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>Voyager</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <domain type='qemu'/>
Nov 28 15:34:50 user nova-compute[75176]:     </arch>
Nov 28 15:34:50 user nova-compute[75176]:     <features>
Nov 28 15:34:50 user nova-compute[75176]:       <cpuselection/>
Nov 28 15:34:50 user nova-compute[75176]:       <deviceboot/>
Nov 28 15:34:50 user nova-compute[75176]:       <disksnapshot default='on' toggle='no'/>
Nov 28 15:34:50 user nova-compute[75176]:     </features>
Nov 28 15:34:50 user nova-compute[75176]:   </guest>
Nov 28 15:34:50 user nova-compute[75176]:   <guest>
Nov 28 15:34:50 user nova-compute[75176]:     <os_type>hvm</os_type>
Nov 28 15:34:50 user nova-compute[75176]:     <arch name='sparc64'>
Nov 28 15:34:50 user nova-compute[75176]:       <wordsize>64</wordsize>
Nov 28 15:34:50 user nova-compute[75176]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>sun4u</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>niagara</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>sun4v</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <domain type='qemu'/>
Nov 28 15:34:50 user nova-compute[75176]:     </arch>
Nov 28 15:34:50 user nova-compute[75176]:     <features>
Nov 28 15:34:50 user nova-compute[75176]:       <cpuselection/>
Nov 28 15:34:50 user nova-compute[75176]:       <deviceboot/>
Nov 28 15:34:50 user nova-compute[75176]:       <disksnapshot default='on' toggle='no'/>
Nov 28 15:34:50 user nova-compute[75176]:     </features>
Nov 28 15:34:50 user nova-compute[75176]:   </guest>
Nov 28 15:34:50 user nova-compute[75176]:   <guest>
Nov 28 15:34:50 user nova-compute[75176]:     <os_type>hvm</os_type>
Nov 28 15:34:50 user nova-compute[75176]:     <arch name='x86_64'>
Nov 28 15:34:50 user nova-compute[75176]:       <wordsize>64</wordsize>
Nov 28 15:34:50 user nova-compute[75176]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>x-remote</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='1'>isapc</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='288'>microvm</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <domain type='qemu'/>
Nov 28 15:34:50 user nova-compute[75176]:       <domain type='kvm'/>
Nov 28 15:34:50 user nova-compute[75176]:     </arch>
Nov 28 15:34:50 user nova-compute[75176]:     <features>
Nov 28 15:34:50 user nova-compute[75176]:       <acpi default='on' toggle='yes'/>
Nov 28 15:34:50 user nova-compute[75176]:       <apic default='on' toggle='no'/>
Nov 28 15:34:50 user nova-compute[75176]:       <cpuselection/>
Nov 28 15:34:50 user nova-compute[75176]:       <deviceboot/>
Nov 28 15:34:50 user nova-compute[75176]:       <disksnapshot default='on' toggle='no'/>
Nov 28 15:34:50 user nova-compute[75176]:     </features>
Nov 28 15:34:50 user nova-compute[75176]:   </guest>
Nov 28 15:34:50 user nova-compute[75176]:   <guest>
Nov 28 15:34:50 user nova-compute[75176]:     <os_type>hvm</os_type>
Nov 28 15:34:50 user nova-compute[75176]:     <arch name='xtensa'>
Nov 28 15:34:50 user nova-compute[75176]:       <wordsize>32</wordsize>
Nov 28 15:34:50 user nova-compute[75176]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='4'>sim</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='32'>kc705</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='32'>ml605</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='32'>virt</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='32'>lx200</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='32'>lx60</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <domain type='qemu'/>
Nov 28 15:34:50 user nova-compute[75176]:     </arch>
Nov 28 15:34:50 user nova-compute[75176]:     <features>
Nov 28 15:34:50 user nova-compute[75176]:       <cpuselection/>
Nov 28 15:34:50 user nova-compute[75176]:       <deviceboot/>
Nov 28 15:34:50 user nova-compute[75176]:       <disksnapshot default='on' toggle='no'/>
Nov 28 15:34:50 user nova-compute[75176]:     </features>
Nov 28 15:34:50 user nova-compute[75176]:   </guest>
Nov 28 15:34:50 user nova-compute[75176]:   <guest>
Nov 28 15:34:50 user nova-compute[75176]:     <os_type>hvm</os_type>
Nov 28 15:34:50 user nova-compute[75176]:     <arch name='xtensaeb'>
Nov 28 15:34:50 user nova-compute[75176]:       <wordsize>32</wordsize>
Nov 28 15:34:50 user nova-compute[75176]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='4'>sim</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='32'>kc705</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='32'>ml605</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='32'>virt</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='32'>lx200</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='32'>lx60</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 28 15:34:50 user nova-compute[75176]:       <domain type='qemu'/>
Nov 28 15:34:50 user nova-compute[75176]:     </arch>
Nov 28 15:34:50 user nova-compute[75176]:     <features>
Nov 28 15:34:50 user nova-compute[75176]:       <cpuselection/>
Nov 28 15:34:50 user nova-compute[75176]:       <deviceboot/>
Nov 28 15:34:50 user nova-compute[75176]:       <disksnapshot default='on' toggle='no'/>
Nov 28 15:34:50 user nova-compute[75176]:     </features>
Nov 28 15:34:50 user nova-compute[75176]:   </guest>
Nov 28 15:34:50 user nova-compute[75176]: </capabilities>
Nov 28 15:34:50 user nova-compute[75176]: 
Nov 28 15:34:50 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-c92bf948-4292-4af3-b72b-057b444bff2c None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=75176) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 15:34:50 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-c92bf948-4292-4af3-b72b-057b444bff2c None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=75176) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 15:34:50 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-c92bf948-4292-4af3-b72b-057b444bff2c None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=75176) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 15:34:50 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-c92bf948-4292-4af3-b72b-057b444bff2c None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75176) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 15:34:50 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-c92bf948-4292-4af3-b72b-057b444bff2c None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75176) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 15:34:50 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-c92bf948-4292-4af3-b72b-057b444bff2c None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=75176) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 15:34:50 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-c92bf948-4292-4af3-b72b-057b444bff2c None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75176) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 15:34:50 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-c92bf948-4292-4af3-b72b-057b444bff2c None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=75176) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 15:34:50 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-c92bf948-4292-4af3-b72b-057b444bff2c None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=75176) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 15:34:50 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-c92bf948-4292-4af3-b72b-057b444bff2c None None] Getting domain capabilities for cris via machine types: {None} {{(pid=75176) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 15:34:50 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-c92bf948-4292-4af3-b72b-057b444bff2c None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=75176) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 15:34:50 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-c92bf948-4292-4af3-b72b-057b444bff2c None None] Getting domain capabilities for i686 via machine types: {'pc', 'q35', 'ubuntu', 'ubuntu-q35'} {{(pid=75176) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 15:34:50 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-c92bf948-4292-4af3-b72b-057b444bff2c None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Nov 28 15:34:50 user nova-compute[75176]: <domainCapabilities>
Nov 28 15:34:50 user nova-compute[75176]:   <path>/usr/bin/qemu-system-i386</path>
Nov 28 15:34:50 user nova-compute[75176]:   <domain>kvm</domain>
Nov 28 15:34:50 user nova-compute[75176]:   <machine>pc-i440fx-6.2</machine>
Nov 28 15:34:50 user nova-compute[75176]:   <arch>i686</arch>
Nov 28 15:34:50 user nova-compute[75176]:   <vcpu max='255'/>
Nov 28 15:34:50 user nova-compute[75176]:   <iothreads supported='yes'/>
Nov 28 15:34:50 user nova-compute[75176]:   <os supported='yes'>
Nov 28 15:34:50 user nova-compute[75176]:     <enum name='firmware'/>
Nov 28 15:34:50 user nova-compute[75176]:     <loader supported='yes'>
Nov 28 15:34:50 user nova-compute[75176]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 28 15:34:50 user nova-compute[75176]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 28 15:34:50 user nova-compute[75176]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 28 15:34:50 user nova-compute[75176]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 28 15:34:50 user nova-compute[75176]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 28 15:34:50 user nova-compute[75176]:       <enum name='type'>
Nov 28 15:34:50 user nova-compute[75176]:         <value>rom</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>pflash</value>
Nov 28 15:34:50 user nova-compute[75176]:       </enum>
Nov 28 15:34:50 user nova-compute[75176]:       <enum name='readonly'>
Nov 28 15:34:50 user nova-compute[75176]:         <value>yes</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>no</value>
Nov 28 15:34:50 user nova-compute[75176]:       </enum>
Nov 28 15:34:50 user nova-compute[75176]:       <enum name='secure'>
Nov 28 15:34:50 user nova-compute[75176]:         <value>no</value>
Nov 28 15:34:50 user nova-compute[75176]:       </enum>
Nov 28 15:34:50 user nova-compute[75176]:     </loader>
Nov 28 15:34:50 user nova-compute[75176]:   </os>
Nov 28 15:34:50 user nova-compute[75176]:   <cpu>
Nov 28 15:34:50 user nova-compute[75176]:     <mode name='host-passthrough' supported='yes'>
Nov 28 15:34:50 user nova-compute[75176]:       <enum name='hostPassthroughMigratable'>
Nov 28 15:34:50 user nova-compute[75176]:         <value>off</value>
Nov 28 15:34:50 user nova-compute[75176]:       </enum>
Nov 28 15:34:50 user nova-compute[75176]:     </mode>
Nov 28 15:34:50 user nova-compute[75176]:     <mode name='maximum' supported='yes'>
Nov 28 15:34:50 user nova-compute[75176]:       <enum name='maximumMigratable'>
Nov 28 15:34:50 user nova-compute[75176]:         <value>on</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>off</value>
Nov 28 15:34:50 user nova-compute[75176]:       </enum>
Nov 28 15:34:50 user nova-compute[75176]:     </mode>
Nov 28 15:34:50 user nova-compute[75176]:     <mode name='host-model' supported='yes'>
Nov 28 15:34:50 user nova-compute[75176]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 28 15:34:50 user nova-compute[75176]:       <vendor>Intel</vendor>
Nov 28 15:34:50 user nova-compute[75176]:       <feature policy='require' name='ss'/>
Nov 28 15:34:50 user nova-compute[75176]:       <feature policy='require' name='vmx'/>
Nov 28 15:34:50 user nova-compute[75176]:       <feature policy='require' name='pcid'/>
Nov 28 15:34:50 user nova-compute[75176]:       <feature policy='require' name='hypervisor'/>
Nov 28 15:34:50 user nova-compute[75176]:       <feature policy='require' name='arat'/>
Nov 28 15:34:50 user nova-compute[75176]:       <feature policy='require' name='tsc_adjust'/>
Nov 28 15:34:50 user nova-compute[75176]:       <feature policy='require' name='umip'/>
Nov 28 15:34:50 user nova-compute[75176]:       <feature policy='require' name='md-clear'/>
Nov 28 15:34:50 user nova-compute[75176]:       <feature policy='require' name='stibp'/>
Nov 28 15:34:50 user nova-compute[75176]:       <feature policy='require' name='arch-capabilities'/>
Nov 28 15:34:50 user nova-compute[75176]:       <feature policy='require' name='ssbd'/>
Nov 28 15:34:50 user nova-compute[75176]:       <feature policy='require' name='ibpb'/>
Nov 28 15:34:50 user nova-compute[75176]:       <feature policy='require' name='ibrs'/>
Nov 28 15:34:50 user nova-compute[75176]:       <feature policy='require' name='amd-stibp'/>
Nov 28 15:34:50 user nova-compute[75176]:       <feature policy='require' name='amd-ssbd'/>
Nov 28 15:34:50 user nova-compute[75176]:       <feature policy='disable' name='erms'/>
Nov 28 15:34:50 user nova-compute[75176]:       <feature policy='disable' name='xsaveopt'/>
Nov 28 15:34:50 user nova-compute[75176]:       <feature policy='disable' name='lm'/>
Nov 28 15:34:50 user nova-compute[75176]:     </mode>
Nov 28 15:34:50 user nova-compute[75176]:     <mode name='custom' supported='yes'>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>qemu64</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='yes'>qemu32</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>phenom</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='yes'>pentium3</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='yes'>pentium2</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='yes'>pentium</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>n270</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>kvm64</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='yes'>kvm32</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='yes'>coreduo</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>core2duo</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>athlon</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Westmere-IBRS</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Westmere</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Snowridge</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Skylake-Server</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Skylake-Client</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>SandyBridge</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Penryn</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Opteron_G5</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Opteron_G4</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Opteron_G3</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Opteron_G2</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Opteron_G1</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Nehalem-IBRS</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Nehalem</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>IvyBridge</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Icelake-Server</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Haswell-noTSX</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Haswell-IBRS</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Haswell</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>EPYC-Rome</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>EPYC-Milan</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>EPYC-IBPB</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>EPYC</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Dhyana</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Cooperlake</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Conroe</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Cascadelake-Server</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Broadwell-noTSX</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Broadwell-IBRS</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Broadwell</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='yes'>486</model>
Nov 28 15:34:50 user nova-compute[75176]:     </mode>
Nov 28 15:34:50 user nova-compute[75176]:   </cpu>
Nov 28 15:34:50 user nova-compute[75176]:   <memoryBacking supported='yes'>
Nov 28 15:34:50 user nova-compute[75176]:     <enum name='sourceType'>
Nov 28 15:34:50 user nova-compute[75176]:       <value>file</value>
Nov 28 15:34:50 user nova-compute[75176]:       <value>anonymous</value>
Nov 28 15:34:50 user nova-compute[75176]:       <value>memfd</value>
Nov 28 15:34:50 user nova-compute[75176]:     </enum>
Nov 28 15:34:50 user nova-compute[75176]:   </memoryBacking>
Nov 28 15:34:50 user nova-compute[75176]:   <devices>
Nov 28 15:34:50 user nova-compute[75176]:     <disk supported='yes'>
Nov 28 15:34:50 user nova-compute[75176]:       <enum name='diskDevice'>
Nov 28 15:34:50 user nova-compute[75176]:         <value>disk</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>cdrom</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>floppy</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>lun</value>
Nov 28 15:34:50 user nova-compute[75176]:       </enum>
Nov 28 15:34:50 user nova-compute[75176]:       <enum name='bus'>
Nov 28 15:34:50 user nova-compute[75176]:         <value>ide</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>fdc</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>scsi</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>virtio</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>usb</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>sata</value>
Nov 28 15:34:50 user nova-compute[75176]:       </enum>
Nov 28 15:34:50 user nova-compute[75176]:       <enum name='model'>
Nov 28 15:34:50 user nova-compute[75176]:         <value>virtio</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>virtio-transitional</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>virtio-non-transitional</value>
Nov 28 15:34:50 user nova-compute[75176]:       </enum>
Nov 28 15:34:50 user nova-compute[75176]:     </disk>
Nov 28 15:34:50 user nova-compute[75176]:     <graphics supported='yes'>
Nov 28 15:34:50 user nova-compute[75176]:       <enum name='type'>
Nov 28 15:34:50 user nova-compute[75176]:         <value>sdl</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>vnc</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>spice</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>egl-headless</value>
Nov 28 15:34:50 user nova-compute[75176]:       </enum>
Nov 28 15:34:50 user nova-compute[75176]:     </graphics>
Nov 28 15:34:50 user nova-compute[75176]:     <video supported='yes'>
Nov 28 15:34:50 user nova-compute[75176]:       <enum name='modelType'>
Nov 28 15:34:50 user nova-compute[75176]:         <value>vga</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>cirrus</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>vmvga</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>qxl</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>virtio</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>none</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>bochs</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>ramfb</value>
Nov 28 15:34:50 user nova-compute[75176]:       </enum>
Nov 28 15:34:50 user nova-compute[75176]:     </video>
Nov 28 15:34:50 user nova-compute[75176]:     <hostdev supported='yes'>
Nov 28 15:34:50 user nova-compute[75176]:       <enum name='mode'>
Nov 28 15:34:50 user nova-compute[75176]:         <value>subsystem</value>
Nov 28 15:34:50 user nova-compute[75176]:       </enum>
Nov 28 15:34:50 user nova-compute[75176]:       <enum name='startupPolicy'>
Nov 28 15:34:50 user nova-compute[75176]:         <value>default</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>mandatory</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>requisite</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>optional</value>
Nov 28 15:34:50 user nova-compute[75176]:       </enum>
Nov 28 15:34:50 user nova-compute[75176]:       <enum name='subsysType'>
Nov 28 15:34:50 user nova-compute[75176]:         <value>usb</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>pci</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>scsi</value>
Nov 28 15:34:50 user nova-compute[75176]:       </enum>
Nov 28 15:34:50 user nova-compute[75176]:       <enum name='capsType'/>
Nov 28 15:34:50 user nova-compute[75176]:       <enum name='pciBackend'/>
Nov 28 15:34:50 user nova-compute[75176]:     </hostdev>
Nov 28 15:34:50 user nova-compute[75176]:     <rng supported='yes'>
Nov 28 15:34:50 user nova-compute[75176]:       <enum name='model'>
Nov 28 15:34:50 user nova-compute[75176]:         <value>virtio</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>virtio-transitional</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>virtio-non-transitional</value>
Nov 28 15:34:50 user nova-compute[75176]:       </enum>
Nov 28 15:34:50 user nova-compute[75176]:       <enum name='backendModel'>
Nov 28 15:34:50 user nova-compute[75176]:         <value>random</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>egd</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>builtin</value>
Nov 28 15:34:50 user nova-compute[75176]:       </enum>
Nov 28 15:34:50 user nova-compute[75176]:     </rng>
Nov 28 15:34:50 user nova-compute[75176]:     <filesystem supported='yes'>
Nov 28 15:34:50 user nova-compute[75176]:       <enum name='driverType'>
Nov 28 15:34:50 user nova-compute[75176]:         <value>path</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>handle</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>virtiofs</value>
Nov 28 15:34:50 user nova-compute[75176]:       </enum>
Nov 28 15:34:50 user nova-compute[75176]:     </filesystem>
Nov 28 15:34:50 user nova-compute[75176]:     <tpm supported='yes'>
Nov 28 15:34:50 user nova-compute[75176]:       <enum name='model'>
Nov 28 15:34:50 user nova-compute[75176]:         <value>tpm-tis</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>tpm-crb</value>
Nov 28 15:34:50 user nova-compute[75176]:       </enum>
Nov 28 15:34:50 user nova-compute[75176]:       <enum name='backendModel'>
Nov 28 15:34:50 user nova-compute[75176]:         <value>passthrough</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>emulator</value>
Nov 28 15:34:50 user nova-compute[75176]:       </enum>
Nov 28 15:34:50 user nova-compute[75176]:     </tpm>
Nov 28 15:34:50 user nova-compute[75176]:   </devices>
Nov 28 15:34:50 user nova-compute[75176]:   <features>
Nov 28 15:34:50 user nova-compute[75176]:     <gic supported='no'/>
Nov 28 15:34:50 user nova-compute[75176]:     <vmcoreinfo supported='yes'/>
Nov 28 15:34:50 user nova-compute[75176]:     <genid supported='yes'/>
Nov 28 15:34:50 user nova-compute[75176]:     <backingStoreInput supported='yes'/>
Nov 28 15:34:50 user nova-compute[75176]:     <backup supported='yes'/>
Nov 28 15:34:50 user nova-compute[75176]:     <sev supported='no'/>
Nov 28 15:34:50 user nova-compute[75176]:   </features>
Nov 28 15:34:50 user nova-compute[75176]: </domainCapabilities>
Nov 28 15:34:50 user nova-compute[75176]:  {{(pid=75176) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 28 15:34:50 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-c92bf948-4292-4af3-b72b-057b444bff2c None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Nov 28 15:34:50 user nova-compute[75176]: <domainCapabilities>
Nov 28 15:34:50 user nova-compute[75176]:   <path>/usr/bin/qemu-system-i386</path>
Nov 28 15:34:50 user nova-compute[75176]:   <domain>kvm</domain>
Nov 28 15:34:50 user nova-compute[75176]:   <machine>pc-q35-6.2</machine>
Nov 28 15:34:50 user nova-compute[75176]:   <arch>i686</arch>
Nov 28 15:34:50 user nova-compute[75176]:   <vcpu max='288'/>
Nov 28 15:34:50 user nova-compute[75176]:   <iothreads supported='yes'/>
Nov 28 15:34:50 user nova-compute[75176]:   <os supported='yes'>
Nov 28 15:34:50 user nova-compute[75176]:     <enum name='firmware'/>
Nov 28 15:34:50 user nova-compute[75176]:     <loader supported='yes'>
Nov 28 15:34:50 user nova-compute[75176]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 28 15:34:50 user nova-compute[75176]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 28 15:34:50 user nova-compute[75176]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 28 15:34:50 user nova-compute[75176]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 28 15:34:50 user nova-compute[75176]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 28 15:34:50 user nova-compute[75176]:       <enum name='type'>
Nov 28 15:34:50 user nova-compute[75176]:         <value>rom</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>pflash</value>
Nov 28 15:34:50 user nova-compute[75176]:       </enum>
Nov 28 15:34:50 user nova-compute[75176]:       <enum name='readonly'>
Nov 28 15:34:50 user nova-compute[75176]:         <value>yes</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>no</value>
Nov 28 15:34:50 user nova-compute[75176]:       </enum>
Nov 28 15:34:50 user nova-compute[75176]:       <enum name='secure'>
Nov 28 15:34:50 user nova-compute[75176]:         <value>no</value>
Nov 28 15:34:50 user nova-compute[75176]:       </enum>
Nov 28 15:34:50 user nova-compute[75176]:     </loader>
Nov 28 15:34:50 user nova-compute[75176]:   </os>
Nov 28 15:34:50 user nova-compute[75176]:   <cpu>
Nov 28 15:34:50 user nova-compute[75176]:     <mode name='host-passthrough' supported='yes'>
Nov 28 15:34:50 user nova-compute[75176]:       <enum name='hostPassthroughMigratable'>
Nov 28 15:34:50 user nova-compute[75176]:         <value>off</value>
Nov 28 15:34:50 user nova-compute[75176]:       </enum>
Nov 28 15:34:50 user nova-compute[75176]:     </mode>
Nov 28 15:34:50 user nova-compute[75176]:     <mode name='maximum' supported='yes'>
Nov 28 15:34:50 user nova-compute[75176]:       <enum name='maximumMigratable'>
Nov 28 15:34:50 user nova-compute[75176]:         <value>on</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>off</value>
Nov 28 15:34:50 user nova-compute[75176]:       </enum>
Nov 28 15:34:50 user nova-compute[75176]:     </mode>
Nov 28 15:34:50 user nova-compute[75176]:     <mode name='host-model' supported='yes'>
Nov 28 15:34:50 user nova-compute[75176]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 28 15:34:50 user nova-compute[75176]:       <vendor>Intel</vendor>
Nov 28 15:34:50 user nova-compute[75176]:       <feature policy='require' name='ss'/>
Nov 28 15:34:50 user nova-compute[75176]:       <feature policy='require' name='vmx'/>
Nov 28 15:34:50 user nova-compute[75176]:       <feature policy='require' name='pcid'/>
Nov 28 15:34:50 user nova-compute[75176]:       <feature policy='require' name='hypervisor'/>
Nov 28 15:34:50 user nova-compute[75176]:       <feature policy='require' name='arat'/>
Nov 28 15:34:50 user nova-compute[75176]:       <feature policy='require' name='tsc_adjust'/>
Nov 28 15:34:50 user nova-compute[75176]:       <feature policy='require' name='umip'/>
Nov 28 15:34:50 user nova-compute[75176]:       <feature policy='require' name='md-clear'/>
Nov 28 15:34:50 user nova-compute[75176]:       <feature policy='require' name='stibp'/>
Nov 28 15:34:50 user nova-compute[75176]:       <feature policy='require' name='arch-capabilities'/>
Nov 28 15:34:50 user nova-compute[75176]:       <feature policy='require' name='ssbd'/>
Nov 28 15:34:50 user nova-compute[75176]:       <feature policy='require' name='ibpb'/>
Nov 28 15:34:50 user nova-compute[75176]:       <feature policy='require' name='ibrs'/>
Nov 28 15:34:50 user nova-compute[75176]:       <feature policy='require' name='amd-stibp'/>
Nov 28 15:34:50 user nova-compute[75176]:       <feature policy='require' name='amd-ssbd'/>
Nov 28 15:34:50 user nova-compute[75176]:       <feature policy='disable' name='erms'/>
Nov 28 15:34:50 user nova-compute[75176]:       <feature policy='disable' name='xsaveopt'/>
Nov 28 15:34:50 user nova-compute[75176]:       <feature policy='disable' name='lm'/>
Nov 28 15:34:50 user nova-compute[75176]:     </mode>
Nov 28 15:34:50 user nova-compute[75176]:     <mode name='custom' supported='yes'>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>qemu64</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='yes'>qemu32</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>phenom</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='yes'>pentium3</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='yes'>pentium2</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='yes'>pentium</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>n270</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>kvm64</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='yes'>kvm32</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='yes'>coreduo</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>core2duo</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>athlon</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Westmere-IBRS</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Westmere</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Snowridge</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Skylake-Server</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Skylake-Client</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>SandyBridge</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Penryn</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Opteron_G5</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Opteron_G4</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Opteron_G3</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Opteron_G2</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Opteron_G1</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Nehalem-IBRS</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Nehalem</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>IvyBridge</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Icelake-Server</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Haswell-noTSX</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Haswell-IBRS</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Haswell</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>EPYC-Rome</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>EPYC-Milan</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>EPYC-IBPB</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>EPYC</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Dhyana</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Cooperlake</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Conroe</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Cascadelake-Server</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Broadwell-noTSX</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Broadwell-IBRS</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Broadwell</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='yes'>486</model>
Nov 28 15:34:50 user nova-compute[75176]:     </mode>
Nov 28 15:34:50 user nova-compute[75176]:   </cpu>
Nov 28 15:34:50 user nova-compute[75176]:   <memoryBacking supported='yes'>
Nov 28 15:34:50 user nova-compute[75176]:     <enum name='sourceType'>
Nov 28 15:34:50 user nova-compute[75176]:       <value>file</value>
Nov 28 15:34:50 user nova-compute[75176]:       <value>anonymous</value>
Nov 28 15:34:50 user nova-compute[75176]:       <value>memfd</value>
Nov 28 15:34:50 user nova-compute[75176]:     </enum>
Nov 28 15:34:50 user nova-compute[75176]:   </memoryBacking>
Nov 28 15:34:50 user nova-compute[75176]:   <devices>
Nov 28 15:34:50 user nova-compute[75176]:     <disk supported='yes'>
Nov 28 15:34:50 user nova-compute[75176]:       <enum name='diskDevice'>
Nov 28 15:34:50 user nova-compute[75176]:         <value>disk</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>cdrom</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>floppy</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>lun</value>
Nov 28 15:34:50 user nova-compute[75176]:       </enum>
Nov 28 15:34:50 user nova-compute[75176]:       <enum name='bus'>
Nov 28 15:34:50 user nova-compute[75176]:         <value>fdc</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>scsi</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>virtio</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>usb</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>sata</value>
Nov 28 15:34:50 user nova-compute[75176]:       </enum>
Nov 28 15:34:50 user nova-compute[75176]:       <enum name='model'>
Nov 28 15:34:50 user nova-compute[75176]:         <value>virtio</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>virtio-transitional</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>virtio-non-transitional</value>
Nov 28 15:34:50 user nova-compute[75176]:       </enum>
Nov 28 15:34:50 user nova-compute[75176]:     </disk>
Nov 28 15:34:50 user nova-compute[75176]:     <graphics supported='yes'>
Nov 28 15:34:50 user nova-compute[75176]:       <enum name='type'>
Nov 28 15:34:50 user nova-compute[75176]:         <value>sdl</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>vnc</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>spice</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>egl-headless</value>
Nov 28 15:34:50 user nova-compute[75176]:       </enum>
Nov 28 15:34:50 user nova-compute[75176]:     </graphics>
Nov 28 15:34:50 user nova-compute[75176]:     <video supported='yes'>
Nov 28 15:34:50 user nova-compute[75176]:       <enum name='modelType'>
Nov 28 15:34:50 user nova-compute[75176]:         <value>vga</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>cirrus</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>vmvga</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>qxl</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>virtio</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>none</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>bochs</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>ramfb</value>
Nov 28 15:34:50 user nova-compute[75176]:       </enum>
Nov 28 15:34:50 user nova-compute[75176]:     </video>
Nov 28 15:34:50 user nova-compute[75176]:     <hostdev supported='yes'>
Nov 28 15:34:50 user nova-compute[75176]:       <enum name='mode'>
Nov 28 15:34:50 user nova-compute[75176]:         <value>subsystem</value>
Nov 28 15:34:50 user nova-compute[75176]:       </enum>
Nov 28 15:34:50 user nova-compute[75176]:       <enum name='startupPolicy'>
Nov 28 15:34:50 user nova-compute[75176]:         <value>default</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>mandatory</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>requisite</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>optional</value>
Nov 28 15:34:50 user nova-compute[75176]:       </enum>
Nov 28 15:34:50 user nova-compute[75176]:       <enum name='subsysType'>
Nov 28 15:34:50 user nova-compute[75176]:         <value>usb</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>pci</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>scsi</value>
Nov 28 15:34:50 user nova-compute[75176]:       </enum>
Nov 28 15:34:50 user nova-compute[75176]:       <enum name='capsType'/>
Nov 28 15:34:50 user nova-compute[75176]:       <enum name='pciBackend'/>
Nov 28 15:34:50 user nova-compute[75176]:     </hostdev>
Nov 28 15:34:50 user nova-compute[75176]:     <rng supported='yes'>
Nov 28 15:34:50 user nova-compute[75176]:       <enum name='model'>
Nov 28 15:34:50 user nova-compute[75176]:         <value>virtio</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>virtio-transitional</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>virtio-non-transitional</value>
Nov 28 15:34:50 user nova-compute[75176]:       </enum>
Nov 28 15:34:50 user nova-compute[75176]:       <enum name='backendModel'>
Nov 28 15:34:50 user nova-compute[75176]:         <value>random</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>egd</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>builtin</value>
Nov 28 15:34:50 user nova-compute[75176]:       </enum>
Nov 28 15:34:50 user nova-compute[75176]:     </rng>
Nov 28 15:34:50 user nova-compute[75176]:     <filesystem supported='yes'>
Nov 28 15:34:50 user nova-compute[75176]:       <enum name='driverType'>
Nov 28 15:34:50 user nova-compute[75176]:         <value>path</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>handle</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>virtiofs</value>
Nov 28 15:34:50 user nova-compute[75176]:       </enum>
Nov 28 15:34:50 user nova-compute[75176]:     </filesystem>
Nov 28 15:34:50 user nova-compute[75176]:     <tpm supported='yes'>
Nov 28 15:34:50 user nova-compute[75176]:       <enum name='model'>
Nov 28 15:34:50 user nova-compute[75176]:         <value>tpm-tis</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>tpm-crb</value>
Nov 28 15:34:50 user nova-compute[75176]:       </enum>
Nov 28 15:34:50 user nova-compute[75176]:       <enum name='backendModel'>
Nov 28 15:34:50 user nova-compute[75176]:         <value>passthrough</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>emulator</value>
Nov 28 15:34:50 user nova-compute[75176]:       </enum>
Nov 28 15:34:50 user nova-compute[75176]:     </tpm>
Nov 28 15:34:50 user nova-compute[75176]:   </devices>
Nov 28 15:34:50 user nova-compute[75176]:   <features>
Nov 28 15:34:50 user nova-compute[75176]:     <gic supported='no'/>
Nov 28 15:34:50 user nova-compute[75176]:     <vmcoreinfo supported='yes'/>
Nov 28 15:34:50 user nova-compute[75176]:     <genid supported='yes'/>
Nov 28 15:34:50 user nova-compute[75176]:     <backingStoreInput supported='yes'/>
Nov 28 15:34:50 user nova-compute[75176]:     <backup supported='yes'/>
Nov 28 15:34:50 user nova-compute[75176]:     <sev supported='no'/>
Nov 28 15:34:50 user nova-compute[75176]:   </features>
Nov 28 15:34:50 user nova-compute[75176]: </domainCapabilities>
Nov 28 15:34:50 user nova-compute[75176]:  {{(pid=75176) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 28 15:34:50 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-c92bf948-4292-4af3-b72b-057b444bff2c None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Nov 28 15:34:50 user nova-compute[75176]: <domainCapabilities>
Nov 28 15:34:50 user nova-compute[75176]:   <path>/usr/bin/qemu-system-i386</path>
Nov 28 15:34:50 user nova-compute[75176]:   <domain>kvm</domain>
Nov 28 15:34:50 user nova-compute[75176]:   <machine>pc-i440fx-jammy</machine>
Nov 28 15:34:50 user nova-compute[75176]:   <arch>i686</arch>
Nov 28 15:34:50 user nova-compute[75176]:   <vcpu max='255'/>
Nov 28 15:34:50 user nova-compute[75176]:   <iothreads supported='yes'/>
Nov 28 15:34:50 user nova-compute[75176]:   <os supported='yes'>
Nov 28 15:34:50 user nova-compute[75176]:     <enum name='firmware'/>
Nov 28 15:34:50 user nova-compute[75176]:     <loader supported='yes'>
Nov 28 15:34:50 user nova-compute[75176]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 28 15:34:50 user nova-compute[75176]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 28 15:34:50 user nova-compute[75176]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 28 15:34:50 user nova-compute[75176]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 28 15:34:50 user nova-compute[75176]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 28 15:34:50 user nova-compute[75176]:       <enum name='type'>
Nov 28 15:34:50 user nova-compute[75176]:         <value>rom</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>pflash</value>
Nov 28 15:34:50 user nova-compute[75176]:       </enum>
Nov 28 15:34:50 user nova-compute[75176]:       <enum name='readonly'>
Nov 28 15:34:50 user nova-compute[75176]:         <value>yes</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>no</value>
Nov 28 15:34:50 user nova-compute[75176]:       </enum>
Nov 28 15:34:50 user nova-compute[75176]:       <enum name='secure'>
Nov 28 15:34:50 user nova-compute[75176]:         <value>no</value>
Nov 28 15:34:50 user nova-compute[75176]:       </enum>
Nov 28 15:34:50 user nova-compute[75176]:     </loader>
Nov 28 15:34:50 user nova-compute[75176]:   </os>
Nov 28 15:34:50 user nova-compute[75176]:   <cpu>
Nov 28 15:34:50 user nova-compute[75176]:     <mode name='host-passthrough' supported='yes'>
Nov 28 15:34:50 user nova-compute[75176]:       <enum name='hostPassthroughMigratable'>
Nov 28 15:34:50 user nova-compute[75176]:         <value>off</value>
Nov 28 15:34:50 user nova-compute[75176]:       </enum>
Nov 28 15:34:50 user nova-compute[75176]:     </mode>
Nov 28 15:34:50 user nova-compute[75176]:     <mode name='maximum' supported='yes'>
Nov 28 15:34:50 user nova-compute[75176]:       <enum name='maximumMigratable'>
Nov 28 15:34:50 user nova-compute[75176]:         <value>on</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>off</value>
Nov 28 15:34:50 user nova-compute[75176]:       </enum>
Nov 28 15:34:50 user nova-compute[75176]:     </mode>
Nov 28 15:34:50 user nova-compute[75176]:     <mode name='host-model' supported='yes'>
Nov 28 15:34:50 user nova-compute[75176]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 28 15:34:50 user nova-compute[75176]:       <vendor>Intel</vendor>
Nov 28 15:34:50 user nova-compute[75176]:       <feature policy='require' name='ss'/>
Nov 28 15:34:50 user nova-compute[75176]:       <feature policy='require' name='vmx'/>
Nov 28 15:34:50 user nova-compute[75176]:       <feature policy='require' name='pcid'/>
Nov 28 15:34:50 user nova-compute[75176]:       <feature policy='require' name='hypervisor'/>
Nov 28 15:34:50 user nova-compute[75176]:       <feature policy='require' name='arat'/>
Nov 28 15:34:50 user nova-compute[75176]:       <feature policy='require' name='tsc_adjust'/>
Nov 28 15:34:50 user nova-compute[75176]:       <feature policy='require' name='umip'/>
Nov 28 15:34:50 user nova-compute[75176]:       <feature policy='require' name='md-clear'/>
Nov 28 15:34:50 user nova-compute[75176]:       <feature policy='require' name='stibp'/>
Nov 28 15:34:50 user nova-compute[75176]:       <feature policy='require' name='arch-capabilities'/>
Nov 28 15:34:50 user nova-compute[75176]:       <feature policy='require' name='ssbd'/>
Nov 28 15:34:50 user nova-compute[75176]:       <feature policy='require' name='ibpb'/>
Nov 28 15:34:50 user nova-compute[75176]:       <feature policy='require' name='ibrs'/>
Nov 28 15:34:50 user nova-compute[75176]:       <feature policy='require' name='amd-stibp'/>
Nov 28 15:34:50 user nova-compute[75176]:       <feature policy='require' name='amd-ssbd'/>
Nov 28 15:34:50 user nova-compute[75176]:       <feature policy='disable' name='erms'/>
Nov 28 15:34:50 user nova-compute[75176]:       <feature policy='disable' name='xsaveopt'/>
Nov 28 15:34:50 user nova-compute[75176]:       <feature policy='disable' name='lm'/>
Nov 28 15:34:50 user nova-compute[75176]:     </mode>
Nov 28 15:34:50 user nova-compute[75176]:     <mode name='custom' supported='yes'>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>qemu64</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='yes'>qemu32</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>phenom</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='yes'>pentium3</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='yes'>pentium2</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='yes'>pentium</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>n270</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>kvm64</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='yes'>kvm32</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='yes'>coreduo</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>core2duo</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>athlon</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Westmere-IBRS</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Westmere</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Snowridge</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Skylake-Server</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Skylake-Client</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>SandyBridge</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Penryn</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Opteron_G5</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Opteron_G4</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Opteron_G3</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Opteron_G2</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Opteron_G1</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Nehalem-IBRS</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Nehalem</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>IvyBridge</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Icelake-Server</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Haswell-noTSX</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Haswell-IBRS</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Haswell</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>EPYC-Rome</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>EPYC-Milan</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>EPYC-IBPB</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>EPYC</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Dhyana</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Cooperlake</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Conroe</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Cascadelake-Server</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Broadwell-noTSX</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Broadwell-IBRS</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Broadwell</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='yes'>486</model>
Nov 28 15:34:50 user nova-compute[75176]:     </mode>
Nov 28 15:34:50 user nova-compute[75176]:   </cpu>
Nov 28 15:34:50 user nova-compute[75176]:   <memoryBacking supported='yes'>
Nov 28 15:34:50 user nova-compute[75176]:     <enum name='sourceType'>
Nov 28 15:34:50 user nova-compute[75176]:       <value>file</value>
Nov 28 15:34:50 user nova-compute[75176]:       <value>anonymous</value>
Nov 28 15:34:50 user nova-compute[75176]:       <value>memfd</value>
Nov 28 15:34:50 user nova-compute[75176]:     </enum>
Nov 28 15:34:50 user nova-compute[75176]:   </memoryBacking>
Nov 28 15:34:50 user nova-compute[75176]:   <devices>
Nov 28 15:34:50 user nova-compute[75176]:     <disk supported='yes'>
Nov 28 15:34:50 user nova-compute[75176]:       <enum name='diskDevice'>
Nov 28 15:34:50 user nova-compute[75176]:         <value>disk</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>cdrom</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>floppy</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>lun</value>
Nov 28 15:34:50 user nova-compute[75176]:       </enum>
Nov 28 15:34:50 user nova-compute[75176]:       <enum name='bus'>
Nov 28 15:34:50 user nova-compute[75176]:         <value>ide</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>fdc</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>scsi</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>virtio</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>usb</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>sata</value>
Nov 28 15:34:50 user nova-compute[75176]:       </enum>
Nov 28 15:34:50 user nova-compute[75176]:       <enum name='model'>
Nov 28 15:34:50 user nova-compute[75176]:         <value>virtio</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>virtio-transitional</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>virtio-non-transitional</value>
Nov 28 15:34:50 user nova-compute[75176]:       </enum>
Nov 28 15:34:50 user nova-compute[75176]:     </disk>
Nov 28 15:34:50 user nova-compute[75176]:     <graphics supported='yes'>
Nov 28 15:34:50 user nova-compute[75176]:       <enum name='type'>
Nov 28 15:34:50 user nova-compute[75176]:         <value>sdl</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>vnc</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>spice</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>egl-headless</value>
Nov 28 15:34:50 user nova-compute[75176]:       </enum>
Nov 28 15:34:50 user nova-compute[75176]:     </graphics>
Nov 28 15:34:50 user nova-compute[75176]:     <video supported='yes'>
Nov 28 15:34:50 user nova-compute[75176]:       <enum name='modelType'>
Nov 28 15:34:50 user nova-compute[75176]:         <value>vga</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>cirrus</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>vmvga</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>qxl</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>virtio</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>none</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>bochs</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>ramfb</value>
Nov 28 15:34:50 user nova-compute[75176]:       </enum>
Nov 28 15:34:50 user nova-compute[75176]:     </video>
Nov 28 15:34:50 user nova-compute[75176]:     <hostdev supported='yes'>
Nov 28 15:34:50 user nova-compute[75176]:       <enum name='mode'>
Nov 28 15:34:50 user nova-compute[75176]:         <value>subsystem</value>
Nov 28 15:34:50 user nova-compute[75176]:       </enum>
Nov 28 15:34:50 user nova-compute[75176]:       <enum name='startupPolicy'>
Nov 28 15:34:50 user nova-compute[75176]:         <value>default</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>mandatory</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>requisite</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>optional</value>
Nov 28 15:34:50 user nova-compute[75176]:       </enum>
Nov 28 15:34:50 user nova-compute[75176]:       <enum name='subsysType'>
Nov 28 15:34:50 user nova-compute[75176]:         <value>usb</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>pci</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>scsi</value>
Nov 28 15:34:50 user nova-compute[75176]:       </enum>
Nov 28 15:34:50 user nova-compute[75176]:       <enum name='capsType'/>
Nov 28 15:34:50 user nova-compute[75176]:       <enum name='pciBackend'/>
Nov 28 15:34:50 user nova-compute[75176]:     </hostdev>
Nov 28 15:34:50 user nova-compute[75176]:     <rng supported='yes'>
Nov 28 15:34:50 user nova-compute[75176]:       <enum name='model'>
Nov 28 15:34:50 user nova-compute[75176]:         <value>virtio</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>virtio-transitional</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>virtio-non-transitional</value>
Nov 28 15:34:50 user nova-compute[75176]:       </enum>
Nov 28 15:34:50 user nova-compute[75176]:       <enum name='backendModel'>
Nov 28 15:34:50 user nova-compute[75176]:         <value>random</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>egd</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>builtin</value>
Nov 28 15:34:50 user nova-compute[75176]:       </enum>
Nov 28 15:34:50 user nova-compute[75176]:     </rng>
Nov 28 15:34:50 user nova-compute[75176]:     <filesystem supported='yes'>
Nov 28 15:34:50 user nova-compute[75176]:       <enum name='driverType'>
Nov 28 15:34:50 user nova-compute[75176]:         <value>path</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>handle</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>virtiofs</value>
Nov 28 15:34:50 user nova-compute[75176]:       </enum>
Nov 28 15:34:50 user nova-compute[75176]:     </filesystem>
Nov 28 15:34:50 user nova-compute[75176]:     <tpm supported='yes'>
Nov 28 15:34:50 user nova-compute[75176]:       <enum name='model'>
Nov 28 15:34:50 user nova-compute[75176]:         <value>tpm-tis</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>tpm-crb</value>
Nov 28 15:34:50 user nova-compute[75176]:       </enum>
Nov 28 15:34:50 user nova-compute[75176]:       <enum name='backendModel'>
Nov 28 15:34:50 user nova-compute[75176]:         <value>passthrough</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>emulator</value>
Nov 28 15:34:50 user nova-compute[75176]:       </enum>
Nov 28 15:34:50 user nova-compute[75176]:     </tpm>
Nov 28 15:34:50 user nova-compute[75176]:   </devices>
Nov 28 15:34:50 user nova-compute[75176]:   <features>
Nov 28 15:34:50 user nova-compute[75176]:     <gic supported='no'/>
Nov 28 15:34:50 user nova-compute[75176]:     <vmcoreinfo supported='yes'/>
Nov 28 15:34:50 user nova-compute[75176]:     <genid supported='yes'/>
Nov 28 15:34:50 user nova-compute[75176]:     <backingStoreInput supported='yes'/>
Nov 28 15:34:50 user nova-compute[75176]:     <backup supported='yes'/>
Nov 28 15:34:50 user nova-compute[75176]:     <sev supported='no'/>
Nov 28 15:34:50 user nova-compute[75176]:   </features>
Nov 28 15:34:50 user nova-compute[75176]: </domainCapabilities>
Nov 28 15:34:50 user nova-compute[75176]:  {{(pid=75176) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 28 15:34:50 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-c92bf948-4292-4af3-b72b-057b444bff2c None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Nov 28 15:34:50 user nova-compute[75176]: <domainCapabilities>
Nov 28 15:34:50 user nova-compute[75176]:   <path>/usr/bin/qemu-system-i386</path>
Nov 28 15:34:50 user nova-compute[75176]:   <domain>kvm</domain>
Nov 28 15:34:50 user nova-compute[75176]:   <machine>pc-q35-jammy</machine>
Nov 28 15:34:50 user nova-compute[75176]:   <arch>i686</arch>
Nov 28 15:34:50 user nova-compute[75176]:   <vcpu max='288'/>
Nov 28 15:34:50 user nova-compute[75176]:   <iothreads supported='yes'/>
Nov 28 15:34:50 user nova-compute[75176]:   <os supported='yes'>
Nov 28 15:34:50 user nova-compute[75176]:     <enum name='firmware'/>
Nov 28 15:34:50 user nova-compute[75176]:     <loader supported='yes'>
Nov 28 15:34:50 user nova-compute[75176]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 28 15:34:50 user nova-compute[75176]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 28 15:34:50 user nova-compute[75176]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 28 15:34:50 user nova-compute[75176]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 28 15:34:50 user nova-compute[75176]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 28 15:34:50 user nova-compute[75176]:       <enum name='type'>
Nov 28 15:34:50 user nova-compute[75176]:         <value>rom</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>pflash</value>
Nov 28 15:34:50 user nova-compute[75176]:       </enum>
Nov 28 15:34:50 user nova-compute[75176]:       <enum name='readonly'>
Nov 28 15:34:50 user nova-compute[75176]:         <value>yes</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>no</value>
Nov 28 15:34:50 user nova-compute[75176]:       </enum>
Nov 28 15:34:50 user nova-compute[75176]:       <enum name='secure'>
Nov 28 15:34:50 user nova-compute[75176]:         <value>no</value>
Nov 28 15:34:50 user nova-compute[75176]:       </enum>
Nov 28 15:34:50 user nova-compute[75176]:     </loader>
Nov 28 15:34:50 user nova-compute[75176]:   </os>
Nov 28 15:34:50 user nova-compute[75176]:   <cpu>
Nov 28 15:34:50 user nova-compute[75176]:     <mode name='host-passthrough' supported='yes'>
Nov 28 15:34:50 user nova-compute[75176]:       <enum name='hostPassthroughMigratable'>
Nov 28 15:34:50 user nova-compute[75176]:         <value>off</value>
Nov 28 15:34:50 user nova-compute[75176]:       </enum>
Nov 28 15:34:50 user nova-compute[75176]:     </mode>
Nov 28 15:34:50 user nova-compute[75176]:     <mode name='maximum' supported='yes'>
Nov 28 15:34:50 user nova-compute[75176]:       <enum name='maximumMigratable'>
Nov 28 15:34:50 user nova-compute[75176]:         <value>on</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>off</value>
Nov 28 15:34:50 user nova-compute[75176]:       </enum>
Nov 28 15:34:50 user nova-compute[75176]:     </mode>
Nov 28 15:34:50 user nova-compute[75176]:     <mode name='host-model' supported='yes'>
Nov 28 15:34:50 user nova-compute[75176]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 28 15:34:50 user nova-compute[75176]:       <vendor>Intel</vendor>
Nov 28 15:34:50 user nova-compute[75176]:       <feature policy='require' name='ss'/>
Nov 28 15:34:50 user nova-compute[75176]:       <feature policy='require' name='vmx'/>
Nov 28 15:34:50 user nova-compute[75176]:       <feature policy='require' name='pcid'/>
Nov 28 15:34:50 user nova-compute[75176]:       <feature policy='require' name='hypervisor'/>
Nov 28 15:34:50 user nova-compute[75176]:       <feature policy='require' name='arat'/>
Nov 28 15:34:50 user nova-compute[75176]:       <feature policy='require' name='tsc_adjust'/>
Nov 28 15:34:50 user nova-compute[75176]:       <feature policy='require' name='umip'/>
Nov 28 15:34:50 user nova-compute[75176]:       <feature policy='require' name='md-clear'/>
Nov 28 15:34:50 user nova-compute[75176]:       <feature policy='require' name='stibp'/>
Nov 28 15:34:50 user nova-compute[75176]:       <feature policy='require' name='arch-capabilities'/>
Nov 28 15:34:50 user nova-compute[75176]:       <feature policy='require' name='ssbd'/>
Nov 28 15:34:50 user nova-compute[75176]:       <feature policy='require' name='ibpb'/>
Nov 28 15:34:50 user nova-compute[75176]:       <feature policy='require' name='ibrs'/>
Nov 28 15:34:50 user nova-compute[75176]:       <feature policy='require' name='amd-stibp'/>
Nov 28 15:34:50 user nova-compute[75176]:       <feature policy='require' name='amd-ssbd'/>
Nov 28 15:34:50 user nova-compute[75176]:       <feature policy='disable' name='erms'/>
Nov 28 15:34:50 user nova-compute[75176]:       <feature policy='disable' name='xsaveopt'/>
Nov 28 15:34:50 user nova-compute[75176]:       <feature policy='disable' name='lm'/>
Nov 28 15:34:50 user nova-compute[75176]:     </mode>
Nov 28 15:34:50 user nova-compute[75176]:     <mode name='custom' supported='yes'>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>qemu64</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='yes'>qemu32</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>phenom</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='yes'>pentium3</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='yes'>pentium2</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='yes'>pentium</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>n270</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>kvm64</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='yes'>kvm32</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='yes'>coreduo</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>core2duo</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>athlon</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Westmere-IBRS</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Westmere</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Snowridge</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Skylake-Server</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Skylake-Client</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>SandyBridge</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Penryn</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Opteron_G5</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Opteron_G4</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Opteron_G3</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Opteron_G2</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Opteron_G1</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Nehalem-IBRS</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Nehalem</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>IvyBridge</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Icelake-Server</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Haswell-noTSX</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Haswell-IBRS</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Haswell</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>EPYC-Rome</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>EPYC-Milan</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>EPYC-IBPB</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>EPYC</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Dhyana</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Cooperlake</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Conroe</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Cascadelake-Server</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Broadwell-noTSX</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Broadwell-IBRS</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Broadwell</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='yes'>486</model>
Nov 28 15:34:50 user nova-compute[75176]:     </mode>
Nov 28 15:34:50 user nova-compute[75176]:   </cpu>
Nov 28 15:34:50 user nova-compute[75176]:   <memoryBacking supported='yes'>
Nov 28 15:34:50 user nova-compute[75176]:     <enum name='sourceType'>
Nov 28 15:34:50 user nova-compute[75176]:       <value>file</value>
Nov 28 15:34:50 user nova-compute[75176]:       <value>anonymous</value>
Nov 28 15:34:50 user nova-compute[75176]:       <value>memfd</value>
Nov 28 15:34:50 user nova-compute[75176]:     </enum>
Nov 28 15:34:50 user nova-compute[75176]:   </memoryBacking>
Nov 28 15:34:50 user nova-compute[75176]:   <devices>
Nov 28 15:34:50 user nova-compute[75176]:     <disk supported='yes'>
Nov 28 15:34:50 user nova-compute[75176]:       <enum name='diskDevice'>
Nov 28 15:34:50 user nova-compute[75176]:         <value>disk</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>cdrom</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>floppy</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>lun</value>
Nov 28 15:34:50 user nova-compute[75176]:       </enum>
Nov 28 15:34:50 user nova-compute[75176]:       <enum name='bus'>
Nov 28 15:34:50 user nova-compute[75176]:         <value>fdc</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>scsi</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>virtio</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>usb</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>sata</value>
Nov 28 15:34:50 user nova-compute[75176]:       </enum>
Nov 28 15:34:50 user nova-compute[75176]:       <enum name='model'>
Nov 28 15:34:50 user nova-compute[75176]:         <value>virtio</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>virtio-transitional</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>virtio-non-transitional</value>
Nov 28 15:34:50 user nova-compute[75176]:       </enum>
Nov 28 15:34:50 user nova-compute[75176]:     </disk>
Nov 28 15:34:50 user nova-compute[75176]:     <graphics supported='yes'>
Nov 28 15:34:50 user nova-compute[75176]:       <enum name='type'>
Nov 28 15:34:50 user nova-compute[75176]:         <value>sdl</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>vnc</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>spice</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>egl-headless</value>
Nov 28 15:34:50 user nova-compute[75176]:       </enum>
Nov 28 15:34:50 user nova-compute[75176]:     </graphics>
Nov 28 15:34:50 user nova-compute[75176]:     <video supported='yes'>
Nov 28 15:34:50 user nova-compute[75176]:       <enum name='modelType'>
Nov 28 15:34:50 user nova-compute[75176]:         <value>vga</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>cirrus</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>vmvga</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>qxl</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>virtio</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>none</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>bochs</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>ramfb</value>
Nov 28 15:34:50 user nova-compute[75176]:       </enum>
Nov 28 15:34:50 user nova-compute[75176]:     </video>
Nov 28 15:34:50 user nova-compute[75176]:     <hostdev supported='yes'>
Nov 28 15:34:50 user nova-compute[75176]:       <enum name='mode'>
Nov 28 15:34:50 user nova-compute[75176]:         <value>subsystem</value>
Nov 28 15:34:50 user nova-compute[75176]:       </enum>
Nov 28 15:34:50 user nova-compute[75176]:       <enum name='startupPolicy'>
Nov 28 15:34:50 user nova-compute[75176]:         <value>default</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>mandatory</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>requisite</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>optional</value>
Nov 28 15:34:50 user nova-compute[75176]:       </enum>
Nov 28 15:34:50 user nova-compute[75176]:       <enum name='subsysType'>
Nov 28 15:34:50 user nova-compute[75176]:         <value>usb</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>pci</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>scsi</value>
Nov 28 15:34:50 user nova-compute[75176]:       </enum>
Nov 28 15:34:50 user nova-compute[75176]:       <enum name='capsType'/>
Nov 28 15:34:50 user nova-compute[75176]:       <enum name='pciBackend'/>
Nov 28 15:34:50 user nova-compute[75176]:     </hostdev>
Nov 28 15:34:50 user nova-compute[75176]:     <rng supported='yes'>
Nov 28 15:34:50 user nova-compute[75176]:       <enum name='model'>
Nov 28 15:34:50 user nova-compute[75176]:         <value>virtio</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>virtio-transitional</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>virtio-non-transitional</value>
Nov 28 15:34:50 user nova-compute[75176]:       </enum>
Nov 28 15:34:50 user nova-compute[75176]:       <enum name='backendModel'>
Nov 28 15:34:50 user nova-compute[75176]:         <value>random</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>egd</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>builtin</value>
Nov 28 15:34:50 user nova-compute[75176]:       </enum>
Nov 28 15:34:50 user nova-compute[75176]:     </rng>
Nov 28 15:34:50 user nova-compute[75176]:     <filesystem supported='yes'>
Nov 28 15:34:50 user nova-compute[75176]:       <enum name='driverType'>
Nov 28 15:34:50 user nova-compute[75176]:         <value>path</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>handle</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>virtiofs</value>
Nov 28 15:34:50 user nova-compute[75176]:       </enum>
Nov 28 15:34:50 user nova-compute[75176]:     </filesystem>
Nov 28 15:34:50 user nova-compute[75176]:     <tpm supported='yes'>
Nov 28 15:34:50 user nova-compute[75176]:       <enum name='model'>
Nov 28 15:34:50 user nova-compute[75176]:         <value>tpm-tis</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>tpm-crb</value>
Nov 28 15:34:50 user nova-compute[75176]:       </enum>
Nov 28 15:34:50 user nova-compute[75176]:       <enum name='backendModel'>
Nov 28 15:34:50 user nova-compute[75176]:         <value>passthrough</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>emulator</value>
Nov 28 15:34:50 user nova-compute[75176]:       </enum>
Nov 28 15:34:50 user nova-compute[75176]:     </tpm>
Nov 28 15:34:50 user nova-compute[75176]:   </devices>
Nov 28 15:34:50 user nova-compute[75176]:   <features>
Nov 28 15:34:50 user nova-compute[75176]:     <gic supported='no'/>
Nov 28 15:34:50 user nova-compute[75176]:     <vmcoreinfo supported='yes'/>
Nov 28 15:34:50 user nova-compute[75176]:     <genid supported='yes'/>
Nov 28 15:34:50 user nova-compute[75176]:     <backingStoreInput supported='yes'/>
Nov 28 15:34:50 user nova-compute[75176]:     <backup supported='yes'/>
Nov 28 15:34:50 user nova-compute[75176]:     <sev supported='no'/>
Nov 28 15:34:50 user nova-compute[75176]:   </features>
Nov 28 15:34:50 user nova-compute[75176]: </domainCapabilities>
Nov 28 15:34:50 user nova-compute[75176]:  {{(pid=75176) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 28 15:34:50 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-c92bf948-4292-4af3-b72b-057b444bff2c None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=75176) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 15:34:50 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-c92bf948-4292-4af3-b72b-057b444bff2c None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=75176) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 15:34:50 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-c92bf948-4292-4af3-b72b-057b444bff2c None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=75176) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 15:34:50 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-c92bf948-4292-4af3-b72b-057b444bff2c None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=75176) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 15:34:50 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-c92bf948-4292-4af3-b72b-057b444bff2c None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=75176) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 15:34:50 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-c92bf948-4292-4af3-b72b-057b444bff2c None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=75176) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 15:34:50 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-c92bf948-4292-4af3-b72b-057b444bff2c None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=75176) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 15:34:50 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-c92bf948-4292-4af3-b72b-057b444bff2c None None] Getting domain capabilities for mips via machine types: {None} {{(pid=75176) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 15:34:50 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-c92bf948-4292-4af3-b72b-057b444bff2c None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=75176) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 15:34:50 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-c92bf948-4292-4af3-b72b-057b444bff2c None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=75176) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 15:34:50 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-c92bf948-4292-4af3-b72b-057b444bff2c None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=75176) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 15:34:50 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-c92bf948-4292-4af3-b72b-057b444bff2c None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=75176) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 15:34:50 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-c92bf948-4292-4af3-b72b-057b444bff2c None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=75176) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 15:34:50 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-c92bf948-4292-4af3-b72b-057b444bff2c None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=75176) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 15:34:50 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-c92bf948-4292-4af3-b72b-057b444bff2c None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=75176) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 15:34:50 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-c92bf948-4292-4af3-b72b-057b444bff2c None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=75176) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 15:34:50 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-c92bf948-4292-4af3-b72b-057b444bff2c None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=75176) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 15:34:50 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-c92bf948-4292-4af3-b72b-057b444bff2c None None] Getting domain capabilities for ppc64 via machine types: {'powernv', 'pseries', None} {{(pid=75176) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 15:34:50 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-c92bf948-4292-4af3-b72b-057b444bff2c None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75176) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 15:34:50 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-c92bf948-4292-4af3-b72b-057b444bff2c None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75176) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 15:34:50 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-c92bf948-4292-4af3-b72b-057b444bff2c None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75176) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 15:34:50 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-c92bf948-4292-4af3-b72b-057b444bff2c None None] Getting domain capabilities for ppc64le via machine types: {'powernv', 'pseries'} {{(pid=75176) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 15:34:50 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-c92bf948-4292-4af3-b72b-057b444bff2c None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=75176) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 15:34:50 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-c92bf948-4292-4af3-b72b-057b444bff2c None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=75176) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 15:34:50 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-c92bf948-4292-4af3-b72b-057b444bff2c None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=75176) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 15:34:50 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-c92bf948-4292-4af3-b72b-057b444bff2c None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=75176) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 15:34:50 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-c92bf948-4292-4af3-b72b-057b444bff2c None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=75176) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 15:34:50 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-c92bf948-4292-4af3-b72b-057b444bff2c None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=75176) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 15:34:50 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-c92bf948-4292-4af3-b72b-057b444bff2c None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=75176) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 15:34:50 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-c92bf948-4292-4af3-b72b-057b444bff2c None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=75176) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 15:34:50 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-c92bf948-4292-4af3-b72b-057b444bff2c None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=75176) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 15:34:50 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-c92bf948-4292-4af3-b72b-057b444bff2c None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=75176) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 15:34:50 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-c92bf948-4292-4af3-b72b-057b444bff2c None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=75176) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 15:34:50 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-c92bf948-4292-4af3-b72b-057b444bff2c None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=75176) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 15:34:50 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-c92bf948-4292-4af3-b72b-057b444bff2c None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=75176) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 15:34:50 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-c92bf948-4292-4af3-b72b-057b444bff2c None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=75176) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 15:34:50 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-c92bf948-4292-4af3-b72b-057b444bff2c None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=75176) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 15:34:50 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-c92bf948-4292-4af3-b72b-057b444bff2c None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=75176) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 15:34:50 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-c92bf948-4292-4af3-b72b-057b444bff2c None None] Getting domain capabilities for x86_64 via machine types: {'pc', 'q35', 'ubuntu', 'ubuntu-q35'} {{(pid=75176) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 15:34:50 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-c92bf948-4292-4af3-b72b-057b444bff2c None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Nov 28 15:34:50 user nova-compute[75176]: <domainCapabilities>
Nov 28 15:34:50 user nova-compute[75176]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 28 15:34:50 user nova-compute[75176]:   <domain>kvm</domain>
Nov 28 15:34:50 user nova-compute[75176]:   <machine>pc-i440fx-6.2</machine>
Nov 28 15:34:50 user nova-compute[75176]:   <arch>x86_64</arch>
Nov 28 15:34:50 user nova-compute[75176]:   <vcpu max='255'/>
Nov 28 15:34:50 user nova-compute[75176]:   <iothreads supported='yes'/>
Nov 28 15:34:50 user nova-compute[75176]:   <os supported='yes'>
Nov 28 15:34:50 user nova-compute[75176]:     <enum name='firmware'>
Nov 28 15:34:50 user nova-compute[75176]:       <value>efi</value>
Nov 28 15:34:50 user nova-compute[75176]:     </enum>
Nov 28 15:34:50 user nova-compute[75176]:     <loader supported='yes'>
Nov 28 15:34:50 user nova-compute[75176]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 28 15:34:50 user nova-compute[75176]:       <enum name='type'>
Nov 28 15:34:50 user nova-compute[75176]:         <value>rom</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>pflash</value>
Nov 28 15:34:50 user nova-compute[75176]:       </enum>
Nov 28 15:34:50 user nova-compute[75176]:       <enum name='readonly'>
Nov 28 15:34:50 user nova-compute[75176]:         <value>yes</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>no</value>
Nov 28 15:34:50 user nova-compute[75176]:       </enum>
Nov 28 15:34:50 user nova-compute[75176]:       <enum name='secure'>
Nov 28 15:34:50 user nova-compute[75176]:         <value>no</value>
Nov 28 15:34:50 user nova-compute[75176]:       </enum>
Nov 28 15:34:50 user nova-compute[75176]:     </loader>
Nov 28 15:34:50 user nova-compute[75176]:   </os>
Nov 28 15:34:50 user nova-compute[75176]:   <cpu>
Nov 28 15:34:50 user nova-compute[75176]:     <mode name='host-passthrough' supported='yes'>
Nov 28 15:34:50 user nova-compute[75176]:       <enum name='hostPassthroughMigratable'>
Nov 28 15:34:50 user nova-compute[75176]:         <value>on</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>off</value>
Nov 28 15:34:50 user nova-compute[75176]:       </enum>
Nov 28 15:34:50 user nova-compute[75176]:     </mode>
Nov 28 15:34:50 user nova-compute[75176]:     <mode name='maximum' supported='yes'>
Nov 28 15:34:50 user nova-compute[75176]:       <enum name='maximumMigratable'>
Nov 28 15:34:50 user nova-compute[75176]:         <value>on</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>off</value>
Nov 28 15:34:50 user nova-compute[75176]:       </enum>
Nov 28 15:34:50 user nova-compute[75176]:     </mode>
Nov 28 15:34:50 user nova-compute[75176]:     <mode name='host-model' supported='yes'>
Nov 28 15:34:50 user nova-compute[75176]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 28 15:34:50 user nova-compute[75176]:       <vendor>Intel</vendor>
Nov 28 15:34:50 user nova-compute[75176]:       <feature policy='require' name='ss'/>
Nov 28 15:34:50 user nova-compute[75176]:       <feature policy='require' name='vmx'/>
Nov 28 15:34:50 user nova-compute[75176]:       <feature policy='require' name='pcid'/>
Nov 28 15:34:50 user nova-compute[75176]:       <feature policy='require' name='hypervisor'/>
Nov 28 15:34:50 user nova-compute[75176]:       <feature policy='require' name='arat'/>
Nov 28 15:34:50 user nova-compute[75176]:       <feature policy='require' name='tsc_adjust'/>
Nov 28 15:34:50 user nova-compute[75176]:       <feature policy='require' name='umip'/>
Nov 28 15:34:50 user nova-compute[75176]:       <feature policy='require' name='md-clear'/>
Nov 28 15:34:50 user nova-compute[75176]:       <feature policy='require' name='stibp'/>
Nov 28 15:34:50 user nova-compute[75176]:       <feature policy='require' name='arch-capabilities'/>
Nov 28 15:34:50 user nova-compute[75176]:       <feature policy='require' name='ssbd'/>
Nov 28 15:34:50 user nova-compute[75176]:       <feature policy='require' name='invtsc'/>
Nov 28 15:34:50 user nova-compute[75176]:       <feature policy='require' name='ibpb'/>
Nov 28 15:34:50 user nova-compute[75176]:       <feature policy='require' name='ibrs'/>
Nov 28 15:34:50 user nova-compute[75176]:       <feature policy='require' name='amd-stibp'/>
Nov 28 15:34:50 user nova-compute[75176]:       <feature policy='require' name='amd-ssbd'/>
Nov 28 15:34:50 user nova-compute[75176]:       <feature policy='require' name='rsba'/>
Nov 28 15:34:50 user nova-compute[75176]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 28 15:34:50 user nova-compute[75176]:       <feature policy='require' name='pschange-mc-no'/>
Nov 28 15:34:50 user nova-compute[75176]:       <feature policy='disable' name='erms'/>
Nov 28 15:34:50 user nova-compute[75176]:       <feature policy='disable' name='xsaveopt'/>
Nov 28 15:34:50 user nova-compute[75176]:     </mode>
Nov 28 15:34:50 user nova-compute[75176]:     <mode name='custom' supported='yes'>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>qemu64</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='yes'>qemu32</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>phenom</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='yes'>pentium3</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='yes'>pentium2</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='yes'>pentium</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>n270</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='yes'>kvm64</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='yes'>kvm32</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='yes'>coreduo</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='yes'>core2duo</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>athlon</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='yes'>Westmere-IBRS</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='yes'>Westmere</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Snowridge</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Skylake-Server</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Skylake-Client</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>SandyBridge</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='yes'>Penryn</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Opteron_G5</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Opteron_G4</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Opteron_G3</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Opteron_G2</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='yes'>Opteron_G1</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='yes'>Nehalem</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>IvyBridge</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Icelake-Server</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Haswell-noTSX</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Haswell-IBRS</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Haswell</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>EPYC-Rome</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>EPYC-Milan</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>EPYC-IBPB</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>EPYC</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Dhyana</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Cooperlake</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='yes'>Conroe</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Cascadelake-Server</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Broadwell-noTSX</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Broadwell-IBRS</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Broadwell</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='yes'>486</model>
Nov 28 15:34:50 user nova-compute[75176]:     </mode>
Nov 28 15:34:50 user nova-compute[75176]:   </cpu>
Nov 28 15:34:50 user nova-compute[75176]:   <memoryBacking supported='yes'>
Nov 28 15:34:50 user nova-compute[75176]:     <enum name='sourceType'>
Nov 28 15:34:50 user nova-compute[75176]:       <value>file</value>
Nov 28 15:34:50 user nova-compute[75176]:       <value>anonymous</value>
Nov 28 15:34:50 user nova-compute[75176]:       <value>memfd</value>
Nov 28 15:34:50 user nova-compute[75176]:     </enum>
Nov 28 15:34:50 user nova-compute[75176]:   </memoryBacking>
Nov 28 15:34:50 user nova-compute[75176]:   <devices>
Nov 28 15:34:50 user nova-compute[75176]:     <disk supported='yes'>
Nov 28 15:34:50 user nova-compute[75176]:       <enum name='diskDevice'>
Nov 28 15:34:50 user nova-compute[75176]:         <value>disk</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>cdrom</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>floppy</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>lun</value>
Nov 28 15:34:50 user nova-compute[75176]:       </enum>
Nov 28 15:34:50 user nova-compute[75176]:       <enum name='bus'>
Nov 28 15:34:50 user nova-compute[75176]:         <value>ide</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>fdc</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>scsi</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>virtio</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>usb</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>sata</value>
Nov 28 15:34:50 user nova-compute[75176]:       </enum>
Nov 28 15:34:50 user nova-compute[75176]:       <enum name='model'>
Nov 28 15:34:50 user nova-compute[75176]:         <value>virtio</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>virtio-transitional</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>virtio-non-transitional</value>
Nov 28 15:34:50 user nova-compute[75176]:       </enum>
Nov 28 15:34:50 user nova-compute[75176]:     </disk>
Nov 28 15:34:50 user nova-compute[75176]:     <graphics supported='yes'>
Nov 28 15:34:50 user nova-compute[75176]:       <enum name='type'>
Nov 28 15:34:50 user nova-compute[75176]:         <value>sdl</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>vnc</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>spice</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>egl-headless</value>
Nov 28 15:34:50 user nova-compute[75176]:       </enum>
Nov 28 15:34:50 user nova-compute[75176]:     </graphics>
Nov 28 15:34:50 user nova-compute[75176]:     <video supported='yes'>
Nov 28 15:34:50 user nova-compute[75176]:       <enum name='modelType'>
Nov 28 15:34:50 user nova-compute[75176]:         <value>vga</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>cirrus</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>vmvga</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>qxl</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>virtio</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>none</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>bochs</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>ramfb</value>
Nov 28 15:34:50 user nova-compute[75176]:       </enum>
Nov 28 15:34:50 user nova-compute[75176]:     </video>
Nov 28 15:34:50 user nova-compute[75176]:     <hostdev supported='yes'>
Nov 28 15:34:50 user nova-compute[75176]:       <enum name='mode'>
Nov 28 15:34:50 user nova-compute[75176]:         <value>subsystem</value>
Nov 28 15:34:50 user nova-compute[75176]:       </enum>
Nov 28 15:34:50 user nova-compute[75176]:       <enum name='startupPolicy'>
Nov 28 15:34:50 user nova-compute[75176]:         <value>default</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>mandatory</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>requisite</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>optional</value>
Nov 28 15:34:50 user nova-compute[75176]:       </enum>
Nov 28 15:34:50 user nova-compute[75176]:       <enum name='subsysType'>
Nov 28 15:34:50 user nova-compute[75176]:         <value>usb</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>pci</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>scsi</value>
Nov 28 15:34:50 user nova-compute[75176]:       </enum>
Nov 28 15:34:50 user nova-compute[75176]:       <enum name='capsType'/>
Nov 28 15:34:50 user nova-compute[75176]:       <enum name='pciBackend'/>
Nov 28 15:34:50 user nova-compute[75176]:     </hostdev>
Nov 28 15:34:50 user nova-compute[75176]:     <rng supported='yes'>
Nov 28 15:34:50 user nova-compute[75176]:       <enum name='model'>
Nov 28 15:34:50 user nova-compute[75176]:         <value>virtio</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>virtio-transitional</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>virtio-non-transitional</value>
Nov 28 15:34:50 user nova-compute[75176]:       </enum>
Nov 28 15:34:50 user nova-compute[75176]:       <enum name='backendModel'>
Nov 28 15:34:50 user nova-compute[75176]:         <value>random</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>egd</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>builtin</value>
Nov 28 15:34:50 user nova-compute[75176]:       </enum>
Nov 28 15:34:50 user nova-compute[75176]:     </rng>
Nov 28 15:34:50 user nova-compute[75176]:     <filesystem supported='yes'>
Nov 28 15:34:50 user nova-compute[75176]:       <enum name='driverType'>
Nov 28 15:34:50 user nova-compute[75176]:         <value>path</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>handle</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>virtiofs</value>
Nov 28 15:34:50 user nova-compute[75176]:       </enum>
Nov 28 15:34:50 user nova-compute[75176]:     </filesystem>
Nov 28 15:34:50 user nova-compute[75176]:     <tpm supported='yes'>
Nov 28 15:34:50 user nova-compute[75176]:       <enum name='model'>
Nov 28 15:34:50 user nova-compute[75176]:         <value>tpm-tis</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>tpm-crb</value>
Nov 28 15:34:50 user nova-compute[75176]:       </enum>
Nov 28 15:34:50 user nova-compute[75176]:       <enum name='backendModel'>
Nov 28 15:34:50 user nova-compute[75176]:         <value>passthrough</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>emulator</value>
Nov 28 15:34:50 user nova-compute[75176]:       </enum>
Nov 28 15:34:50 user nova-compute[75176]:     </tpm>
Nov 28 15:34:50 user nova-compute[75176]:   </devices>
Nov 28 15:34:50 user nova-compute[75176]:   <features>
Nov 28 15:34:50 user nova-compute[75176]:     <gic supported='no'/>
Nov 28 15:34:50 user nova-compute[75176]:     <vmcoreinfo supported='yes'/>
Nov 28 15:34:50 user nova-compute[75176]:     <genid supported='yes'/>
Nov 28 15:34:50 user nova-compute[75176]:     <backingStoreInput supported='yes'/>
Nov 28 15:34:50 user nova-compute[75176]:     <backup supported='yes'/>
Nov 28 15:34:50 user nova-compute[75176]:     <sev supported='no'/>
Nov 28 15:34:50 user nova-compute[75176]:   </features>
Nov 28 15:34:50 user nova-compute[75176]: </domainCapabilities>
Nov 28 15:34:50 user nova-compute[75176]:  {{(pid=75176) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 28 15:34:50 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-c92bf948-4292-4af3-b72b-057b444bff2c None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Nov 28 15:34:50 user nova-compute[75176]: <domainCapabilities>
Nov 28 15:34:50 user nova-compute[75176]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 28 15:34:50 user nova-compute[75176]:   <domain>kvm</domain>
Nov 28 15:34:50 user nova-compute[75176]:   <machine>pc-q35-6.2</machine>
Nov 28 15:34:50 user nova-compute[75176]:   <arch>x86_64</arch>
Nov 28 15:34:50 user nova-compute[75176]:   <vcpu max='288'/>
Nov 28 15:34:50 user nova-compute[75176]:   <iothreads supported='yes'/>
Nov 28 15:34:50 user nova-compute[75176]:   <os supported='yes'>
Nov 28 15:34:50 user nova-compute[75176]:     <enum name='firmware'>
Nov 28 15:34:50 user nova-compute[75176]:       <value>efi</value>
Nov 28 15:34:50 user nova-compute[75176]:     </enum>
Nov 28 15:34:50 user nova-compute[75176]:     <loader supported='yes'>
Nov 28 15:34:50 user nova-compute[75176]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 28 15:34:50 user nova-compute[75176]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 28 15:34:50 user nova-compute[75176]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 28 15:34:50 user nova-compute[75176]:       <enum name='type'>
Nov 28 15:34:50 user nova-compute[75176]:         <value>rom</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>pflash</value>
Nov 28 15:34:50 user nova-compute[75176]:       </enum>
Nov 28 15:34:50 user nova-compute[75176]:       <enum name='readonly'>
Nov 28 15:34:50 user nova-compute[75176]:         <value>yes</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>no</value>
Nov 28 15:34:50 user nova-compute[75176]:       </enum>
Nov 28 15:34:50 user nova-compute[75176]:       <enum name='secure'>
Nov 28 15:34:50 user nova-compute[75176]:         <value>yes</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>no</value>
Nov 28 15:34:50 user nova-compute[75176]:       </enum>
Nov 28 15:34:50 user nova-compute[75176]:     </loader>
Nov 28 15:34:50 user nova-compute[75176]:   </os>
Nov 28 15:34:50 user nova-compute[75176]:   <cpu>
Nov 28 15:34:50 user nova-compute[75176]:     <mode name='host-passthrough' supported='yes'>
Nov 28 15:34:50 user nova-compute[75176]:       <enum name='hostPassthroughMigratable'>
Nov 28 15:34:50 user nova-compute[75176]:         <value>on</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>off</value>
Nov 28 15:34:50 user nova-compute[75176]:       </enum>
Nov 28 15:34:50 user nova-compute[75176]:     </mode>
Nov 28 15:34:50 user nova-compute[75176]:     <mode name='maximum' supported='yes'>
Nov 28 15:34:50 user nova-compute[75176]:       <enum name='maximumMigratable'>
Nov 28 15:34:50 user nova-compute[75176]:         <value>on</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>off</value>
Nov 28 15:34:50 user nova-compute[75176]:       </enum>
Nov 28 15:34:50 user nova-compute[75176]:     </mode>
Nov 28 15:34:50 user nova-compute[75176]:     <mode name='host-model' supported='yes'>
Nov 28 15:34:50 user nova-compute[75176]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 28 15:34:50 user nova-compute[75176]:       <vendor>Intel</vendor>
Nov 28 15:34:50 user nova-compute[75176]:       <feature policy='require' name='ss'/>
Nov 28 15:34:50 user nova-compute[75176]:       <feature policy='require' name='vmx'/>
Nov 28 15:34:50 user nova-compute[75176]:       <feature policy='require' name='pcid'/>
Nov 28 15:34:50 user nova-compute[75176]:       <feature policy='require' name='hypervisor'/>
Nov 28 15:34:50 user nova-compute[75176]:       <feature policy='require' name='arat'/>
Nov 28 15:34:50 user nova-compute[75176]:       <feature policy='require' name='tsc_adjust'/>
Nov 28 15:34:50 user nova-compute[75176]:       <feature policy='require' name='umip'/>
Nov 28 15:34:50 user nova-compute[75176]:       <feature policy='require' name='md-clear'/>
Nov 28 15:34:50 user nova-compute[75176]:       <feature policy='require' name='stibp'/>
Nov 28 15:34:50 user nova-compute[75176]:       <feature policy='require' name='arch-capabilities'/>
Nov 28 15:34:50 user nova-compute[75176]:       <feature policy='require' name='ssbd'/>
Nov 28 15:34:50 user nova-compute[75176]:       <feature policy='require' name='invtsc'/>
Nov 28 15:34:50 user nova-compute[75176]:       <feature policy='require' name='ibpb'/>
Nov 28 15:34:50 user nova-compute[75176]:       <feature policy='require' name='ibrs'/>
Nov 28 15:34:50 user nova-compute[75176]:       <feature policy='require' name='amd-stibp'/>
Nov 28 15:34:50 user nova-compute[75176]:       <feature policy='require' name='amd-ssbd'/>
Nov 28 15:34:50 user nova-compute[75176]:       <feature policy='require' name='rsba'/>
Nov 28 15:34:50 user nova-compute[75176]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 28 15:34:50 user nova-compute[75176]:       <feature policy='require' name='pschange-mc-no'/>
Nov 28 15:34:50 user nova-compute[75176]:       <feature policy='disable' name='erms'/>
Nov 28 15:34:50 user nova-compute[75176]:       <feature policy='disable' name='xsaveopt'/>
Nov 28 15:34:50 user nova-compute[75176]:     </mode>
Nov 28 15:34:50 user nova-compute[75176]:     <mode name='custom' supported='yes'>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>qemu64</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='yes'>qemu32</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>phenom</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='yes'>pentium3</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='yes'>pentium2</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='yes'>pentium</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>n270</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='yes'>kvm64</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='yes'>kvm32</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='yes'>coreduo</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='yes'>core2duo</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>athlon</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='yes'>Westmere-IBRS</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='yes'>Westmere</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Snowridge</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Skylake-Server</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Skylake-Client</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>SandyBridge</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='yes'>Penryn</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Opteron_G5</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Opteron_G4</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Opteron_G3</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Opteron_G2</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='yes'>Opteron_G1</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='yes'>Nehalem</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>IvyBridge</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Icelake-Server</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Haswell-noTSX</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Haswell-IBRS</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Haswell</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>EPYC-Rome</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>EPYC-Milan</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>EPYC-IBPB</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>EPYC</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Dhyana</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Cooperlake</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='yes'>Conroe</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Cascadelake-Server</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Broadwell-noTSX</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Broadwell-IBRS</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Broadwell</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='yes'>486</model>
Nov 28 15:34:50 user nova-compute[75176]:     </mode>
Nov 28 15:34:50 user nova-compute[75176]:   </cpu>
Nov 28 15:34:50 user nova-compute[75176]:   <memoryBacking supported='yes'>
Nov 28 15:34:50 user nova-compute[75176]:     <enum name='sourceType'>
Nov 28 15:34:50 user nova-compute[75176]:       <value>file</value>
Nov 28 15:34:50 user nova-compute[75176]:       <value>anonymous</value>
Nov 28 15:34:50 user nova-compute[75176]:       <value>memfd</value>
Nov 28 15:34:50 user nova-compute[75176]:     </enum>
Nov 28 15:34:50 user nova-compute[75176]:   </memoryBacking>
Nov 28 15:34:50 user nova-compute[75176]:   <devices>
Nov 28 15:34:50 user nova-compute[75176]:     <disk supported='yes'>
Nov 28 15:34:50 user nova-compute[75176]:       <enum name='diskDevice'>
Nov 28 15:34:50 user nova-compute[75176]:         <value>disk</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>cdrom</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>floppy</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>lun</value>
Nov 28 15:34:50 user nova-compute[75176]:       </enum>
Nov 28 15:34:50 user nova-compute[75176]:       <enum name='bus'>
Nov 28 15:34:50 user nova-compute[75176]:         <value>fdc</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>scsi</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>virtio</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>usb</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>sata</value>
Nov 28 15:34:50 user nova-compute[75176]:       </enum>
Nov 28 15:34:50 user nova-compute[75176]:       <enum name='model'>
Nov 28 15:34:50 user nova-compute[75176]:         <value>virtio</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>virtio-transitional</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>virtio-non-transitional</value>
Nov 28 15:34:50 user nova-compute[75176]:       </enum>
Nov 28 15:34:50 user nova-compute[75176]:     </disk>
Nov 28 15:34:50 user nova-compute[75176]:     <graphics supported='yes'>
Nov 28 15:34:50 user nova-compute[75176]:       <enum name='type'>
Nov 28 15:34:50 user nova-compute[75176]:         <value>sdl</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>vnc</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>spice</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>egl-headless</value>
Nov 28 15:34:50 user nova-compute[75176]:       </enum>
Nov 28 15:34:50 user nova-compute[75176]:     </graphics>
Nov 28 15:34:50 user nova-compute[75176]:     <video supported='yes'>
Nov 28 15:34:50 user nova-compute[75176]:       <enum name='modelType'>
Nov 28 15:34:50 user nova-compute[75176]:         <value>vga</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>cirrus</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>vmvga</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>qxl</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>virtio</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>none</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>bochs</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>ramfb</value>
Nov 28 15:34:50 user nova-compute[75176]:       </enum>
Nov 28 15:34:50 user nova-compute[75176]:     </video>
Nov 28 15:34:50 user nova-compute[75176]:     <hostdev supported='yes'>
Nov 28 15:34:50 user nova-compute[75176]:       <enum name='mode'>
Nov 28 15:34:50 user nova-compute[75176]:         <value>subsystem</value>
Nov 28 15:34:50 user nova-compute[75176]:       </enum>
Nov 28 15:34:50 user nova-compute[75176]:       <enum name='startupPolicy'>
Nov 28 15:34:50 user nova-compute[75176]:         <value>default</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>mandatory</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>requisite</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>optional</value>
Nov 28 15:34:50 user nova-compute[75176]:       </enum>
Nov 28 15:34:50 user nova-compute[75176]:       <enum name='subsysType'>
Nov 28 15:34:50 user nova-compute[75176]:         <value>usb</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>pci</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>scsi</value>
Nov 28 15:34:50 user nova-compute[75176]:       </enum>
Nov 28 15:34:50 user nova-compute[75176]:       <enum name='capsType'/>
Nov 28 15:34:50 user nova-compute[75176]:       <enum name='pciBackend'/>
Nov 28 15:34:50 user nova-compute[75176]:     </hostdev>
Nov 28 15:34:50 user nova-compute[75176]:     <rng supported='yes'>
Nov 28 15:34:50 user nova-compute[75176]:       <enum name='model'>
Nov 28 15:34:50 user nova-compute[75176]:         <value>virtio</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>virtio-transitional</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>virtio-non-transitional</value>
Nov 28 15:34:50 user nova-compute[75176]:       </enum>
Nov 28 15:34:50 user nova-compute[75176]:       <enum name='backendModel'>
Nov 28 15:34:50 user nova-compute[75176]:         <value>random</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>egd</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>builtin</value>
Nov 28 15:34:50 user nova-compute[75176]:       </enum>
Nov 28 15:34:50 user nova-compute[75176]:     </rng>
Nov 28 15:34:50 user nova-compute[75176]:     <filesystem supported='yes'>
Nov 28 15:34:50 user nova-compute[75176]:       <enum name='driverType'>
Nov 28 15:34:50 user nova-compute[75176]:         <value>path</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>handle</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>virtiofs</value>
Nov 28 15:34:50 user nova-compute[75176]:       </enum>
Nov 28 15:34:50 user nova-compute[75176]:     </filesystem>
Nov 28 15:34:50 user nova-compute[75176]:     <tpm supported='yes'>
Nov 28 15:34:50 user nova-compute[75176]:       <enum name='model'>
Nov 28 15:34:50 user nova-compute[75176]:         <value>tpm-tis</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>tpm-crb</value>
Nov 28 15:34:50 user nova-compute[75176]:       </enum>
Nov 28 15:34:50 user nova-compute[75176]:       <enum name='backendModel'>
Nov 28 15:34:50 user nova-compute[75176]:         <value>passthrough</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>emulator</value>
Nov 28 15:34:50 user nova-compute[75176]:       </enum>
Nov 28 15:34:50 user nova-compute[75176]:     </tpm>
Nov 28 15:34:50 user nova-compute[75176]:   </devices>
Nov 28 15:34:50 user nova-compute[75176]:   <features>
Nov 28 15:34:50 user nova-compute[75176]:     <gic supported='no'/>
Nov 28 15:34:50 user nova-compute[75176]:     <vmcoreinfo supported='yes'/>
Nov 28 15:34:50 user nova-compute[75176]:     <genid supported='yes'/>
Nov 28 15:34:50 user nova-compute[75176]:     <backingStoreInput supported='yes'/>
Nov 28 15:34:50 user nova-compute[75176]:     <backup supported='yes'/>
Nov 28 15:34:50 user nova-compute[75176]:     <sev supported='no'/>
Nov 28 15:34:50 user nova-compute[75176]:   </features>
Nov 28 15:34:50 user nova-compute[75176]: </domainCapabilities>
Nov 28 15:34:50 user nova-compute[75176]:  {{(pid=75176) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 28 15:34:50 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-c92bf948-4292-4af3-b72b-057b444bff2c None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Nov 28 15:34:50 user nova-compute[75176]: <domainCapabilities>
Nov 28 15:34:50 user nova-compute[75176]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 28 15:34:50 user nova-compute[75176]:   <domain>kvm</domain>
Nov 28 15:34:50 user nova-compute[75176]:   <machine>pc-i440fx-jammy</machine>
Nov 28 15:34:50 user nova-compute[75176]:   <arch>x86_64</arch>
Nov 28 15:34:50 user nova-compute[75176]:   <vcpu max='255'/>
Nov 28 15:34:50 user nova-compute[75176]:   <iothreads supported='yes'/>
Nov 28 15:34:50 user nova-compute[75176]:   <os supported='yes'>
Nov 28 15:34:50 user nova-compute[75176]:     <enum name='firmware'>
Nov 28 15:34:50 user nova-compute[75176]:       <value>efi</value>
Nov 28 15:34:50 user nova-compute[75176]:     </enum>
Nov 28 15:34:50 user nova-compute[75176]:     <loader supported='yes'>
Nov 28 15:34:50 user nova-compute[75176]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 28 15:34:50 user nova-compute[75176]:       <enum name='type'>
Nov 28 15:34:50 user nova-compute[75176]:         <value>rom</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>pflash</value>
Nov 28 15:34:50 user nova-compute[75176]:       </enum>
Nov 28 15:34:50 user nova-compute[75176]:       <enum name='readonly'>
Nov 28 15:34:50 user nova-compute[75176]:         <value>yes</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>no</value>
Nov 28 15:34:50 user nova-compute[75176]:       </enum>
Nov 28 15:34:50 user nova-compute[75176]:       <enum name='secure'>
Nov 28 15:34:50 user nova-compute[75176]:         <value>no</value>
Nov 28 15:34:50 user nova-compute[75176]:       </enum>
Nov 28 15:34:50 user nova-compute[75176]:     </loader>
Nov 28 15:34:50 user nova-compute[75176]:   </os>
Nov 28 15:34:50 user nova-compute[75176]:   <cpu>
Nov 28 15:34:50 user nova-compute[75176]:     <mode name='host-passthrough' supported='yes'>
Nov 28 15:34:50 user nova-compute[75176]:       <enum name='hostPassthroughMigratable'>
Nov 28 15:34:50 user nova-compute[75176]:         <value>on</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>off</value>
Nov 28 15:34:50 user nova-compute[75176]:       </enum>
Nov 28 15:34:50 user nova-compute[75176]:     </mode>
Nov 28 15:34:50 user nova-compute[75176]:     <mode name='maximum' supported='yes'>
Nov 28 15:34:50 user nova-compute[75176]:       <enum name='maximumMigratable'>
Nov 28 15:34:50 user nova-compute[75176]:         <value>on</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>off</value>
Nov 28 15:34:50 user nova-compute[75176]:       </enum>
Nov 28 15:34:50 user nova-compute[75176]:     </mode>
Nov 28 15:34:50 user nova-compute[75176]:     <mode name='host-model' supported='yes'>
Nov 28 15:34:50 user nova-compute[75176]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 28 15:34:50 user nova-compute[75176]:       <vendor>Intel</vendor>
Nov 28 15:34:50 user nova-compute[75176]:       <feature policy='require' name='ss'/>
Nov 28 15:34:50 user nova-compute[75176]:       <feature policy='require' name='vmx'/>
Nov 28 15:34:50 user nova-compute[75176]:       <feature policy='require' name='pcid'/>
Nov 28 15:34:50 user nova-compute[75176]:       <feature policy='require' name='hypervisor'/>
Nov 28 15:34:50 user nova-compute[75176]:       <feature policy='require' name='arat'/>
Nov 28 15:34:50 user nova-compute[75176]:       <feature policy='require' name='tsc_adjust'/>
Nov 28 15:34:50 user nova-compute[75176]:       <feature policy='require' name='umip'/>
Nov 28 15:34:50 user nova-compute[75176]:       <feature policy='require' name='md-clear'/>
Nov 28 15:34:50 user nova-compute[75176]:       <feature policy='require' name='stibp'/>
Nov 28 15:34:50 user nova-compute[75176]:       <feature policy='require' name='arch-capabilities'/>
Nov 28 15:34:50 user nova-compute[75176]:       <feature policy='require' name='ssbd'/>
Nov 28 15:34:50 user nova-compute[75176]:       <feature policy='require' name='invtsc'/>
Nov 28 15:34:50 user nova-compute[75176]:       <feature policy='require' name='ibpb'/>
Nov 28 15:34:50 user nova-compute[75176]:       <feature policy='require' name='ibrs'/>
Nov 28 15:34:50 user nova-compute[75176]:       <feature policy='require' name='amd-stibp'/>
Nov 28 15:34:50 user nova-compute[75176]:       <feature policy='require' name='amd-ssbd'/>
Nov 28 15:34:50 user nova-compute[75176]:       <feature policy='require' name='rsba'/>
Nov 28 15:34:50 user nova-compute[75176]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 28 15:34:50 user nova-compute[75176]:       <feature policy='require' name='pschange-mc-no'/>
Nov 28 15:34:50 user nova-compute[75176]:       <feature policy='disable' name='erms'/>
Nov 28 15:34:50 user nova-compute[75176]:       <feature policy='disable' name='xsaveopt'/>
Nov 28 15:34:50 user nova-compute[75176]:     </mode>
Nov 28 15:34:50 user nova-compute[75176]:     <mode name='custom' supported='yes'>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>qemu64</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='yes'>qemu32</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>phenom</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='yes'>pentium3</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='yes'>pentium2</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='yes'>pentium</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>n270</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='yes'>kvm64</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='yes'>kvm32</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='yes'>coreduo</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='yes'>core2duo</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>athlon</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='yes'>Westmere-IBRS</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='yes'>Westmere</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Snowridge</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Skylake-Server</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Skylake-Client</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>SandyBridge</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='yes'>Penryn</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Opteron_G5</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Opteron_G4</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Opteron_G3</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Opteron_G2</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='yes'>Opteron_G1</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='yes'>Nehalem</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>IvyBridge</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Icelake-Server</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Haswell-noTSX</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Haswell-IBRS</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Haswell</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>EPYC-Rome</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>EPYC-Milan</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>EPYC-IBPB</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>EPYC</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Dhyana</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Cooperlake</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='yes'>Conroe</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Cascadelake-Server</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Broadwell-noTSX</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Broadwell-IBRS</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='no'>Broadwell</model>
Nov 28 15:34:50 user nova-compute[75176]:       <model usable='yes'>486</model>
Nov 28 15:34:50 user nova-compute[75176]:     </mode>
Nov 28 15:34:50 user nova-compute[75176]:   </cpu>
Nov 28 15:34:50 user nova-compute[75176]:   <memoryBacking supported='yes'>
Nov 28 15:34:50 user nova-compute[75176]:     <enum name='sourceType'>
Nov 28 15:34:50 user nova-compute[75176]:       <value>file</value>
Nov 28 15:34:50 user nova-compute[75176]:       <value>anonymous</value>
Nov 28 15:34:50 user nova-compute[75176]:       <value>memfd</value>
Nov 28 15:34:50 user nova-compute[75176]:     </enum>
Nov 28 15:34:50 user nova-compute[75176]:   </memoryBacking>
Nov 28 15:34:50 user nova-compute[75176]:   <devices>
Nov 28 15:34:50 user nova-compute[75176]:     <disk supported='yes'>
Nov 28 15:34:50 user nova-compute[75176]:       <enum name='diskDevice'>
Nov 28 15:34:50 user nova-compute[75176]:         <value>disk</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>cdrom</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>floppy</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>lun</value>
Nov 28 15:34:50 user nova-compute[75176]:       </enum>
Nov 28 15:34:50 user nova-compute[75176]:       <enum name='bus'>
Nov 28 15:34:50 user nova-compute[75176]:         <value>ide</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>fdc</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>scsi</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>virtio</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>usb</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>sata</value>
Nov 28 15:34:50 user nova-compute[75176]:       </enum>
Nov 28 15:34:50 user nova-compute[75176]:       <enum name='model'>
Nov 28 15:34:50 user nova-compute[75176]:         <value>virtio</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>virtio-transitional</value>
Nov 28 15:34:50 user nova-compute[75176]:         <value>virtio-non-transitional</value>
Nov 28 15:34:50 user nova-compute[75176]:       </enum>
Nov 28 15:34:50 user nova-compute[75176]:     </disk>
Nov 28 15:34:50 user nova-compute[75176]:     <graphics supported='yes'>
Nov 28 15:34:50 user nova-compute[75176]:       <enum name='type'>
Nov 28 15:34:50 user nova-compute[75176]:         <value>sdl</value>
Nov 28 15:34:51 user nova-compute[75176]:         <value>vnc</value>
Nov 28 15:34:51 user nova-compute[75176]:         <value>spice</value>
Nov 28 15:34:51 user nova-compute[75176]:         <value>egl-headless</value>
Nov 28 15:34:51 user nova-compute[75176]:       </enum>
Nov 28 15:34:51 user nova-compute[75176]:     </graphics>
Nov 28 15:34:51 user nova-compute[75176]:     <video supported='yes'>
Nov 28 15:34:51 user nova-compute[75176]:       <enum name='modelType'>
Nov 28 15:34:51 user nova-compute[75176]:         <value>vga</value>
Nov 28 15:34:51 user nova-compute[75176]:         <value>cirrus</value>
Nov 28 15:34:51 user nova-compute[75176]:         <value>vmvga</value>
Nov 28 15:34:51 user nova-compute[75176]:         <value>qxl</value>
Nov 28 15:34:51 user nova-compute[75176]:         <value>virtio</value>
Nov 28 15:34:51 user nova-compute[75176]:         <value>none</value>
Nov 28 15:34:51 user nova-compute[75176]:         <value>bochs</value>
Nov 28 15:34:51 user nova-compute[75176]:         <value>ramfb</value>
Nov 28 15:34:51 user nova-compute[75176]:       </enum>
Nov 28 15:34:51 user nova-compute[75176]:     </video>
Nov 28 15:34:51 user nova-compute[75176]:     <hostdev supported='yes'>
Nov 28 15:34:51 user nova-compute[75176]:       <enum name='mode'>
Nov 28 15:34:51 user nova-compute[75176]:         <value>subsystem</value>
Nov 28 15:34:51 user nova-compute[75176]:       </enum>
Nov 28 15:34:51 user nova-compute[75176]:       <enum name='startupPolicy'>
Nov 28 15:34:51 user nova-compute[75176]:         <value>default</value>
Nov 28 15:34:51 user nova-compute[75176]:         <value>mandatory</value>
Nov 28 15:34:51 user nova-compute[75176]:         <value>requisite</value>
Nov 28 15:34:51 user nova-compute[75176]:         <value>optional</value>
Nov 28 15:34:51 user nova-compute[75176]:       </enum>
Nov 28 15:34:51 user nova-compute[75176]:       <enum name='subsysType'>
Nov 28 15:34:51 user nova-compute[75176]:         <value>usb</value>
Nov 28 15:34:51 user nova-compute[75176]:         <value>pci</value>
Nov 28 15:34:51 user nova-compute[75176]:         <value>scsi</value>
Nov 28 15:34:51 user nova-compute[75176]:       </enum>
Nov 28 15:34:51 user nova-compute[75176]:       <enum name='capsType'/>
Nov 28 15:34:51 user nova-compute[75176]:       <enum name='pciBackend'/>
Nov 28 15:34:51 user nova-compute[75176]:     </hostdev>
Nov 28 15:34:51 user nova-compute[75176]:     <rng supported='yes'>
Nov 28 15:34:51 user nova-compute[75176]:       <enum name='model'>
Nov 28 15:34:51 user nova-compute[75176]:         <value>virtio</value>
Nov 28 15:34:51 user nova-compute[75176]:         <value>virtio-transitional</value>
Nov 28 15:34:51 user nova-compute[75176]:         <value>virtio-non-transitional</value>
Nov 28 15:34:51 user nova-compute[75176]:       </enum>
Nov 28 15:34:51 user nova-compute[75176]:       <enum name='backendModel'>
Nov 28 15:34:51 user nova-compute[75176]:         <value>random</value>
Nov 28 15:34:51 user nova-compute[75176]:         <value>egd</value>
Nov 28 15:34:51 user nova-compute[75176]:         <value>builtin</value>
Nov 28 15:34:51 user nova-compute[75176]:       </enum>
Nov 28 15:34:51 user nova-compute[75176]:     </rng>
Nov 28 15:34:51 user nova-compute[75176]:     <filesystem supported='yes'>
Nov 28 15:34:51 user nova-compute[75176]:       <enum name='driverType'>
Nov 28 15:34:51 user nova-compute[75176]:         <value>path</value>
Nov 28 15:34:51 user nova-compute[75176]:         <value>handle</value>
Nov 28 15:34:51 user nova-compute[75176]:         <value>virtiofs</value>
Nov 28 15:34:51 user nova-compute[75176]:       </enum>
Nov 28 15:34:51 user nova-compute[75176]:     </filesystem>
Nov 28 15:34:51 user nova-compute[75176]:     <tpm supported='yes'>
Nov 28 15:34:51 user nova-compute[75176]:       <enum name='model'>
Nov 28 15:34:51 user nova-compute[75176]:         <value>tpm-tis</value>
Nov 28 15:34:51 user nova-compute[75176]:         <value>tpm-crb</value>
Nov 28 15:34:51 user nova-compute[75176]:       </enum>
Nov 28 15:34:51 user nova-compute[75176]:       <enum name='backendModel'>
Nov 28 15:34:51 user nova-compute[75176]:         <value>passthrough</value>
Nov 28 15:34:51 user nova-compute[75176]:         <value>emulator</value>
Nov 28 15:34:51 user nova-compute[75176]:       </enum>
Nov 28 15:34:51 user nova-compute[75176]:     </tpm>
Nov 28 15:34:51 user nova-compute[75176]:   </devices>
Nov 28 15:34:51 user nova-compute[75176]:   <features>
Nov 28 15:34:51 user nova-compute[75176]:     <gic supported='no'/>
Nov 28 15:34:51 user nova-compute[75176]:     <vmcoreinfo supported='yes'/>
Nov 28 15:34:51 user nova-compute[75176]:     <genid supported='yes'/>
Nov 28 15:34:51 user nova-compute[75176]:     <backingStoreInput supported='yes'/>
Nov 28 15:34:51 user nova-compute[75176]:     <backup supported='yes'/>
Nov 28 15:34:51 user nova-compute[75176]:     <sev supported='no'/>
Nov 28 15:34:51 user nova-compute[75176]:   </features>
Nov 28 15:34:51 user nova-compute[75176]: </domainCapabilities>
Nov 28 15:34:51 user nova-compute[75176]:  {{(pid=75176) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 28 15:34:51 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-c92bf948-4292-4af3-b72b-057b444bff2c None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Nov 28 15:34:51 user nova-compute[75176]: <domainCapabilities>
Nov 28 15:34:51 user nova-compute[75176]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 28 15:34:51 user nova-compute[75176]:   <domain>kvm</domain>
Nov 28 15:34:51 user nova-compute[75176]:   <machine>pc-q35-jammy</machine>
Nov 28 15:34:51 user nova-compute[75176]:   <arch>x86_64</arch>
Nov 28 15:34:51 user nova-compute[75176]:   <vcpu max='288'/>
Nov 28 15:34:51 user nova-compute[75176]:   <iothreads supported='yes'/>
Nov 28 15:34:51 user nova-compute[75176]:   <os supported='yes'>
Nov 28 15:34:51 user nova-compute[75176]:     <enum name='firmware'>
Nov 28 15:34:51 user nova-compute[75176]:       <value>efi</value>
Nov 28 15:34:51 user nova-compute[75176]:     </enum>
Nov 28 15:34:51 user nova-compute[75176]:     <loader supported='yes'>
Nov 28 15:34:51 user nova-compute[75176]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 28 15:34:51 user nova-compute[75176]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 28 15:34:51 user nova-compute[75176]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 28 15:34:51 user nova-compute[75176]:       <enum name='type'>
Nov 28 15:34:51 user nova-compute[75176]:         <value>rom</value>
Nov 28 15:34:51 user nova-compute[75176]:         <value>pflash</value>
Nov 28 15:34:51 user nova-compute[75176]:       </enum>
Nov 28 15:34:51 user nova-compute[75176]:       <enum name='readonly'>
Nov 28 15:34:51 user nova-compute[75176]:         <value>yes</value>
Nov 28 15:34:51 user nova-compute[75176]:         <value>no</value>
Nov 28 15:34:51 user nova-compute[75176]:       </enum>
Nov 28 15:34:51 user nova-compute[75176]:       <enum name='secure'>
Nov 28 15:34:51 user nova-compute[75176]:         <value>yes</value>
Nov 28 15:34:51 user nova-compute[75176]:         <value>no</value>
Nov 28 15:34:51 user nova-compute[75176]:       </enum>
Nov 28 15:34:51 user nova-compute[75176]:     </loader>
Nov 28 15:34:51 user nova-compute[75176]:   </os>
Nov 28 15:34:51 user nova-compute[75176]:   <cpu>
Nov 28 15:34:51 user nova-compute[75176]:     <mode name='host-passthrough' supported='yes'>
Nov 28 15:34:51 user nova-compute[75176]:       <enum name='hostPassthroughMigratable'>
Nov 28 15:34:51 user nova-compute[75176]:         <value>on</value>
Nov 28 15:34:51 user nova-compute[75176]:         <value>off</value>
Nov 28 15:34:51 user nova-compute[75176]:       </enum>
Nov 28 15:34:51 user nova-compute[75176]:     </mode>
Nov 28 15:34:51 user nova-compute[75176]:     <mode name='maximum' supported='yes'>
Nov 28 15:34:51 user nova-compute[75176]:       <enum name='maximumMigratable'>
Nov 28 15:34:51 user nova-compute[75176]:         <value>on</value>
Nov 28 15:34:51 user nova-compute[75176]:         <value>off</value>
Nov 28 15:34:51 user nova-compute[75176]:       </enum>
Nov 28 15:34:51 user nova-compute[75176]:     </mode>
Nov 28 15:34:51 user nova-compute[75176]:     <mode name='host-model' supported='yes'>
Nov 28 15:34:51 user nova-compute[75176]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 28 15:34:51 user nova-compute[75176]:       <vendor>Intel</vendor>
Nov 28 15:34:51 user nova-compute[75176]:       <feature policy='require' name='ss'/>
Nov 28 15:34:51 user nova-compute[75176]:       <feature policy='require' name='vmx'/>
Nov 28 15:34:51 user nova-compute[75176]:       <feature policy='require' name='pcid'/>
Nov 28 15:34:51 user nova-compute[75176]:       <feature policy='require' name='hypervisor'/>
Nov 28 15:34:51 user nova-compute[75176]:       <feature policy='require' name='arat'/>
Nov 28 15:34:51 user nova-compute[75176]:       <feature policy='require' name='tsc_adjust'/>
Nov 28 15:34:51 user nova-compute[75176]:       <feature policy='require' name='umip'/>
Nov 28 15:34:51 user nova-compute[75176]:       <feature policy='require' name='md-clear'/>
Nov 28 15:34:51 user nova-compute[75176]:       <feature policy='require' name='stibp'/>
Nov 28 15:34:51 user nova-compute[75176]:       <feature policy='require' name='arch-capabilities'/>
Nov 28 15:34:51 user nova-compute[75176]:       <feature policy='require' name='ssbd'/>
Nov 28 15:34:51 user nova-compute[75176]:       <feature policy='require' name='invtsc'/>
Nov 28 15:34:51 user nova-compute[75176]:       <feature policy='require' name='ibpb'/>
Nov 28 15:34:51 user nova-compute[75176]:       <feature policy='require' name='ibrs'/>
Nov 28 15:34:51 user nova-compute[75176]:       <feature policy='require' name='amd-stibp'/>
Nov 28 15:34:51 user nova-compute[75176]:       <feature policy='require' name='amd-ssbd'/>
Nov 28 15:34:51 user nova-compute[75176]:       <feature policy='require' name='rsba'/>
Nov 28 15:34:51 user nova-compute[75176]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 28 15:34:51 user nova-compute[75176]:       <feature policy='require' name='pschange-mc-no'/>
Nov 28 15:34:51 user nova-compute[75176]:       <feature policy='disable' name='erms'/>
Nov 28 15:34:51 user nova-compute[75176]:       <feature policy='disable' name='xsaveopt'/>
Nov 28 15:34:51 user nova-compute[75176]:     </mode>
Nov 28 15:34:51 user nova-compute[75176]:     <mode name='custom' supported='yes'>
Nov 28 15:34:51 user nova-compute[75176]:       <model usable='no'>qemu64</model>
Nov 28 15:34:51 user nova-compute[75176]:       <model usable='yes'>qemu32</model>
Nov 28 15:34:51 user nova-compute[75176]:       <model usable='no'>phenom</model>
Nov 28 15:34:51 user nova-compute[75176]:       <model usable='yes'>pentium3</model>
Nov 28 15:34:51 user nova-compute[75176]:       <model usable='yes'>pentium2</model>
Nov 28 15:34:51 user nova-compute[75176]:       <model usable='yes'>pentium</model>
Nov 28 15:34:51 user nova-compute[75176]:       <model usable='no'>n270</model>
Nov 28 15:34:51 user nova-compute[75176]:       <model usable='yes'>kvm64</model>
Nov 28 15:34:51 user nova-compute[75176]:       <model usable='yes'>kvm32</model>
Nov 28 15:34:51 user nova-compute[75176]:       <model usable='yes'>coreduo</model>
Nov 28 15:34:51 user nova-compute[75176]:       <model usable='yes'>core2duo</model>
Nov 28 15:34:51 user nova-compute[75176]:       <model usable='no'>athlon</model>
Nov 28 15:34:51 user nova-compute[75176]:       <model usable='yes'>Westmere-IBRS</model>
Nov 28 15:34:51 user nova-compute[75176]:       <model usable='yes'>Westmere</model>
Nov 28 15:34:51 user nova-compute[75176]:       <model usable='no'>Snowridge</model>
Nov 28 15:34:51 user nova-compute[75176]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 28 15:34:51 user nova-compute[75176]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 28 15:34:51 user nova-compute[75176]:       <model usable='no'>Skylake-Server</model>
Nov 28 15:34:51 user nova-compute[75176]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 28 15:34:51 user nova-compute[75176]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 28 15:34:51 user nova-compute[75176]:       <model usable='no'>Skylake-Client</model>
Nov 28 15:34:51 user nova-compute[75176]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 28 15:34:51 user nova-compute[75176]:       <model usable='no'>SandyBridge</model>
Nov 28 15:34:51 user nova-compute[75176]:       <model usable='yes'>Penryn</model>
Nov 28 15:34:51 user nova-compute[75176]:       <model usable='no'>Opteron_G5</model>
Nov 28 15:34:51 user nova-compute[75176]:       <model usable='no'>Opteron_G4</model>
Nov 28 15:34:51 user nova-compute[75176]:       <model usable='no'>Opteron_G3</model>
Nov 28 15:34:51 user nova-compute[75176]:       <model usable='no'>Opteron_G2</model>
Nov 28 15:34:51 user nova-compute[75176]:       <model usable='yes'>Opteron_G1</model>
Nov 28 15:34:51 user nova-compute[75176]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 28 15:34:51 user nova-compute[75176]:       <model usable='yes'>Nehalem</model>
Nov 28 15:34:51 user nova-compute[75176]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 28 15:34:51 user nova-compute[75176]:       <model usable='no'>IvyBridge</model>
Nov 28 15:34:51 user nova-compute[75176]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 28 15:34:51 user nova-compute[75176]:       <model usable='no'>Icelake-Server</model>
Nov 28 15:34:51 user nova-compute[75176]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 28 15:34:51 user nova-compute[75176]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 28 15:34:51 user nova-compute[75176]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 28 15:34:51 user nova-compute[75176]:       <model usable='no'>Haswell-noTSX</model>
Nov 28 15:34:51 user nova-compute[75176]:       <model usable='no'>Haswell-IBRS</model>
Nov 28 15:34:51 user nova-compute[75176]:       <model usable='no'>Haswell</model>
Nov 28 15:34:51 user nova-compute[75176]:       <model usable='no'>EPYC-Rome</model>
Nov 28 15:34:51 user nova-compute[75176]:       <model usable='no'>EPYC-Milan</model>
Nov 28 15:34:51 user nova-compute[75176]:       <model usable='no'>EPYC-IBPB</model>
Nov 28 15:34:51 user nova-compute[75176]:       <model usable='no'>EPYC</model>
Nov 28 15:34:51 user nova-compute[75176]:       <model usable='no'>Dhyana</model>
Nov 28 15:34:51 user nova-compute[75176]:       <model usable='no'>Cooperlake</model>
Nov 28 15:34:51 user nova-compute[75176]:       <model usable='yes'>Conroe</model>
Nov 28 15:34:51 user nova-compute[75176]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 28 15:34:51 user nova-compute[75176]:       <model usable='no'>Cascadelake-Server</model>
Nov 28 15:34:51 user nova-compute[75176]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 28 15:34:51 user nova-compute[75176]:       <model usable='no'>Broadwell-noTSX</model>
Nov 28 15:34:51 user nova-compute[75176]:       <model usable='no'>Broadwell-IBRS</model>
Nov 28 15:34:51 user nova-compute[75176]:       <model usable='no'>Broadwell</model>
Nov 28 15:34:51 user nova-compute[75176]:       <model usable='yes'>486</model>
Nov 28 15:34:51 user nova-compute[75176]:     </mode>
Nov 28 15:34:51 user nova-compute[75176]:   </cpu>
Nov 28 15:34:51 user nova-compute[75176]:   <memoryBacking supported='yes'>
Nov 28 15:34:51 user nova-compute[75176]:     <enum name='sourceType'>
Nov 28 15:34:51 user nova-compute[75176]:       <value>file</value>
Nov 28 15:34:51 user nova-compute[75176]:       <value>anonymous</value>
Nov 28 15:34:51 user nova-compute[75176]:       <value>memfd</value>
Nov 28 15:34:51 user nova-compute[75176]:     </enum>
Nov 28 15:34:51 user nova-compute[75176]:   </memoryBacking>
Nov 28 15:34:51 user nova-compute[75176]:   <devices>
Nov 28 15:34:51 user nova-compute[75176]:     <disk supported='yes'>
Nov 28 15:34:51 user nova-compute[75176]:       <enum name='diskDevice'>
Nov 28 15:34:51 user nova-compute[75176]:         <value>disk</value>
Nov 28 15:34:51 user nova-compute[75176]:         <value>cdrom</value>
Nov 28 15:34:51 user nova-compute[75176]:         <value>floppy</value>
Nov 28 15:34:51 user nova-compute[75176]:         <value>lun</value>
Nov 28 15:34:51 user nova-compute[75176]:       </enum>
Nov 28 15:34:51 user nova-compute[75176]:       <enum name='bus'>
Nov 28 15:34:51 user nova-compute[75176]:         <value>fdc</value>
Nov 28 15:34:51 user nova-compute[75176]:         <value>scsi</value>
Nov 28 15:34:51 user nova-compute[75176]:         <value>virtio</value>
Nov 28 15:34:51 user nova-compute[75176]:         <value>usb</value>
Nov 28 15:34:51 user nova-compute[75176]:         <value>sata</value>
Nov 28 15:34:51 user nova-compute[75176]:       </enum>
Nov 28 15:34:51 user nova-compute[75176]:       <enum name='model'>
Nov 28 15:34:51 user nova-compute[75176]:         <value>virtio</value>
Nov 28 15:34:51 user nova-compute[75176]:         <value>virtio-transitional</value>
Nov 28 15:34:51 user nova-compute[75176]:         <value>virtio-non-transitional</value>
Nov 28 15:34:51 user nova-compute[75176]:       </enum>
Nov 28 15:34:51 user nova-compute[75176]:     </disk>
Nov 28 15:34:51 user nova-compute[75176]:     <graphics supported='yes'>
Nov 28 15:34:51 user nova-compute[75176]:       <enum name='type'>
Nov 28 15:34:51 user nova-compute[75176]:         <value>sdl</value>
Nov 28 15:34:51 user nova-compute[75176]:         <value>vnc</value>
Nov 28 15:34:51 user nova-compute[75176]:         <value>spice</value>
Nov 28 15:34:51 user nova-compute[75176]:         <value>egl-headless</value>
Nov 28 15:34:51 user nova-compute[75176]:       </enum>
Nov 28 15:34:51 user nova-compute[75176]:     </graphics>
Nov 28 15:34:51 user nova-compute[75176]:     <video supported='yes'>
Nov 28 15:34:51 user nova-compute[75176]:       <enum name='modelType'>
Nov 28 15:34:51 user nova-compute[75176]:         <value>vga</value>
Nov 28 15:34:51 user nova-compute[75176]:         <value>cirrus</value>
Nov 28 15:34:51 user nova-compute[75176]:         <value>vmvga</value>
Nov 28 15:34:51 user nova-compute[75176]:         <value>qxl</value>
Nov 28 15:34:51 user nova-compute[75176]:         <value>virtio</value>
Nov 28 15:34:51 user nova-compute[75176]:         <value>none</value>
Nov 28 15:34:51 user nova-compute[75176]:         <value>bochs</value>
Nov 28 15:34:51 user nova-compute[75176]:         <value>ramfb</value>
Nov 28 15:34:51 user nova-compute[75176]:       </enum>
Nov 28 15:34:51 user nova-compute[75176]:     </video>
Nov 28 15:34:51 user nova-compute[75176]:     <hostdev supported='yes'>
Nov 28 15:34:51 user nova-compute[75176]:       <enum name='mode'>
Nov 28 15:34:51 user nova-compute[75176]:         <value>subsystem</value>
Nov 28 15:34:51 user nova-compute[75176]:       </enum>
Nov 28 15:34:51 user nova-compute[75176]:       <enum name='startupPolicy'>
Nov 28 15:34:51 user nova-compute[75176]:         <value>default</value>
Nov 28 15:34:51 user nova-compute[75176]:         <value>mandatory</value>
Nov 28 15:34:51 user nova-compute[75176]:         <value>requisite</value>
Nov 28 15:34:51 user nova-compute[75176]:         <value>optional</value>
Nov 28 15:34:51 user nova-compute[75176]:       </enum>
Nov 28 15:34:51 user nova-compute[75176]:       <enum name='subsysType'>
Nov 28 15:34:51 user nova-compute[75176]:         <value>usb</value>
Nov 28 15:34:51 user nova-compute[75176]:         <value>pci</value>
Nov 28 15:34:51 user nova-compute[75176]:         <value>scsi</value>
Nov 28 15:34:51 user nova-compute[75176]:       </enum>
Nov 28 15:34:51 user nova-compute[75176]:       <enum name='capsType'/>
Nov 28 15:34:51 user nova-compute[75176]:       <enum name='pciBackend'/>
Nov 28 15:34:51 user nova-compute[75176]:     </hostdev>
Nov 28 15:34:51 user nova-compute[75176]:     <rng supported='yes'>
Nov 28 15:34:51 user nova-compute[75176]:       <enum name='model'>
Nov 28 15:34:51 user nova-compute[75176]:         <value>virtio</value>
Nov 28 15:34:51 user nova-compute[75176]:         <value>virtio-transitional</value>
Nov 28 15:34:51 user nova-compute[75176]:         <value>virtio-non-transitional</value>
Nov 28 15:34:51 user nova-compute[75176]:       </enum>
Nov 28 15:34:51 user nova-compute[75176]:       <enum name='backendModel'>
Nov 28 15:34:51 user nova-compute[75176]:         <value>random</value>
Nov 28 15:34:51 user nova-compute[75176]:         <value>egd</value>
Nov 28 15:34:51 user nova-compute[75176]:         <value>builtin</value>
Nov 28 15:34:51 user nova-compute[75176]:       </enum>
Nov 28 15:34:51 user nova-compute[75176]:     </rng>
Nov 28 15:34:51 user nova-compute[75176]:     <filesystem supported='yes'>
Nov 28 15:34:51 user nova-compute[75176]:       <enum name='driverType'>
Nov 28 15:34:51 user nova-compute[75176]:         <value>path</value>
Nov 28 15:34:51 user nova-compute[75176]:         <value>handle</value>
Nov 28 15:34:51 user nova-compute[75176]:         <value>virtiofs</value>
Nov 28 15:34:51 user nova-compute[75176]:       </enum>
Nov 28 15:34:51 user nova-compute[75176]:     </filesystem>
Nov 28 15:34:51 user nova-compute[75176]:     <tpm supported='yes'>
Nov 28 15:34:51 user nova-compute[75176]:       <enum name='model'>
Nov 28 15:34:51 user nova-compute[75176]:         <value>tpm-tis</value>
Nov 28 15:34:51 user nova-compute[75176]:         <value>tpm-crb</value>
Nov 28 15:34:51 user nova-compute[75176]:       </enum>
Nov 28 15:34:51 user nova-compute[75176]:       <enum name='backendModel'>
Nov 28 15:34:51 user nova-compute[75176]:         <value>passthrough</value>
Nov 28 15:34:51 user nova-compute[75176]:         <value>emulator</value>
Nov 28 15:34:51 user nova-compute[75176]:       </enum>
Nov 28 15:34:51 user nova-compute[75176]:     </tpm>
Nov 28 15:34:51 user nova-compute[75176]:   </devices>
Nov 28 15:34:51 user nova-compute[75176]:   <features>
Nov 28 15:34:51 user nova-compute[75176]:     <gic supported='no'/>
Nov 28 15:34:51 user nova-compute[75176]:     <vmcoreinfo supported='yes'/>
Nov 28 15:34:51 user nova-compute[75176]:     <genid supported='yes'/>
Nov 28 15:34:51 user nova-compute[75176]:     <backingStoreInput supported='yes'/>
Nov 28 15:34:51 user nova-compute[75176]:     <backup supported='yes'/>
Nov 28 15:34:51 user nova-compute[75176]:     <sev supported='no'/>
Nov 28 15:34:51 user nova-compute[75176]:   </features>
Nov 28 15:34:51 user nova-compute[75176]: </domainCapabilities>
Nov 28 15:34:51 user nova-compute[75176]:  {{(pid=75176) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 28 15:34:51 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-c92bf948-4292-4af3-b72b-057b444bff2c None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=75176) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 15:34:51 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-c92bf948-4292-4af3-b72b-057b444bff2c None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=75176) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 15:34:51 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-c92bf948-4292-4af3-b72b-057b444bff2c None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=75176) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 15:34:51 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-c92bf948-4292-4af3-b72b-057b444bff2c None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=75176) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 15:34:51 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-c92bf948-4292-4af3-b72b-057b444bff2c None None] Checking secure boot support for host arch (x86_64) {{(pid=75176) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1781}}
Nov 28 15:34:51 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-c92bf948-4292-4af3-b72b-057b444bff2c None None] Checking secure boot support for host arch (x86_64) {{(pid=75176) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1781}}
Nov 28 15:34:51 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-c92bf948-4292-4af3-b72b-057b444bff2c None None] Checking secure boot support for host arch (x86_64) {{(pid=75176) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1781}}
Nov 28 15:34:51 user nova-compute[75176]: INFO nova.virt.libvirt.host [None req-c92bf948-4292-4af3-b72b-057b444bff2c None None] Secure Boot support detected
Nov 28 15:34:51 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-c92bf948-4292-4af3-b72b-057b444bff2c None None] cpu compare xml: <cpu match="exact">
Nov 28 15:34:51 user nova-compute[75176]:   <model>Nehalem</model>
Nov 28 15:34:51 user nova-compute[75176]: </cpu>
Nov 28 15:34:51 user nova-compute[75176]:  {{(pid=75176) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10020}}
Nov 28 15:34:51 user nova-compute[75176]: INFO nova.virt.node [None req-c92bf948-4292-4af3-b72b-057b444bff2c None None] Generated node identity b37848d8-f401-4155-a029-b0ffa09ff85b
Nov 28 15:34:51 user nova-compute[75176]: INFO nova.virt.node [None req-c92bf948-4292-4af3-b72b-057b444bff2c None None] Wrote node identity b37848d8-f401-4155-a029-b0ffa09ff85b to /opt/stack/data/nova/compute_id
Nov 28 15:34:51 user nova-compute[75176]: WARNING nova.compute.manager [None req-c92bf948-4292-4af3-b72b-057b444bff2c None None] Compute nodes ['b37848d8-f401-4155-a029-b0ffa09ff85b'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Nov 28 15:34:51 user nova-compute[75176]: INFO nova.compute.manager [None req-c92bf948-4292-4af3-b72b-057b444bff2c None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Nov 28 15:34:51 user nova-compute[75176]: WARNING nova.compute.manager [None req-c92bf948-4292-4af3-b72b-057b444bff2c None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 28 15:34:51 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-c92bf948-4292-4af3-b72b-057b444bff2c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:34:51 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-c92bf948-4292-4af3-b72b-057b444bff2c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:34:51 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-c92bf948-4292-4af3-b72b-057b444bff2c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:34:51 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-c92bf948-4292-4af3-b72b-057b444bff2c None None] Auditing locally available compute resources for user (node: user) {{(pid=75176) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 15:34:51 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-c92bf948-4292-4af3-b72b-057b444bff2c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 15:34:51 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-c92bf948-4292-4af3-b72b-057b444bff2c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 15:34:51 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-c92bf948-4292-4af3-b72b-057b444bff2c None None] Hypervisor/Node resource view: name=user free_ram=11057MB free_disk=26.176292419433594GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75176) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 15:34:51 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-c92bf948-4292-4af3-b72b-057b444bff2c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:34:51 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-c92bf948-4292-4af3-b72b-057b444bff2c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:34:51 user nova-compute[75176]: WARNING nova.compute.resource_tracker [None req-c92bf948-4292-4af3-b72b-057b444bff2c None None] No compute node record for user:b37848d8-f401-4155-a029-b0ffa09ff85b: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host b37848d8-f401-4155-a029-b0ffa09ff85b could not be found.
Nov 28 15:34:51 user nova-compute[75176]: INFO nova.compute.resource_tracker [None req-c92bf948-4292-4af3-b72b-057b444bff2c None None] Compute node record created for user:user with uuid: b37848d8-f401-4155-a029-b0ffa09ff85b
Nov 28 15:34:51 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-c92bf948-4292-4af3-b72b-057b444bff2c None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75176) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 15:34:51 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-c92bf948-4292-4af3-b72b-057b444bff2c None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75176) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 15:34:51 user nova-compute[75176]: INFO nova.scheduler.client.report [None req-c92bf948-4292-4af3-b72b-057b444bff2c None None] [req-1be7d721-7a0e-4d47-9357-d14e2bacab2e] Created resource provider record via placement API for resource provider with UUID b37848d8-f401-4155-a029-b0ffa09ff85b and name user.
Nov 28 15:34:51 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-c92bf948-4292-4af3-b72b-057b444bff2c None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=75176) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1797}}
Nov 28 15:34:51 user nova-compute[75176]: INFO nova.virt.libvirt.host [None req-c92bf948-4292-4af3-b72b-057b444bff2c None None] kernel doesn't support AMD SEV
Nov 28 15:34:51 user nova-compute[75176]: DEBUG nova.compute.provider_tree [None req-c92bf948-4292-4af3-b72b-057b444bff2c None None] Updating inventory in ProviderTree for provider b37848d8-f401-4155-a029-b0ffa09ff85b with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=75176) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 28 15:34:51 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-c92bf948-4292-4af3-b72b-057b444bff2c None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75176) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 15:34:51 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-c92bf948-4292-4af3-b72b-057b444bff2c None None] Libvirt baseline CPU <cpu>
Nov 28 15:34:51 user nova-compute[75176]:   <arch>x86_64</arch>
Nov 28 15:34:51 user nova-compute[75176]:   <model>Nehalem</model>
Nov 28 15:34:51 user nova-compute[75176]:   <vendor>Intel</vendor>
Nov 28 15:34:51 user nova-compute[75176]:   <topology sockets="6" cores="1" threads="1"/>
Nov 28 15:34:51 user nova-compute[75176]: </cpu>
Nov 28 15:34:51 user nova-compute[75176]:  {{(pid=75176) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12510}}
Nov 28 15:34:51 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-c92bf948-4292-4af3-b72b-057b444bff2c None None] Updated inventory for provider b37848d8-f401-4155-a029-b0ffa09ff85b with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=75176) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Nov 28 15:34:51 user nova-compute[75176]: DEBUG nova.compute.provider_tree [None req-c92bf948-4292-4af3-b72b-057b444bff2c None None] Updating resource provider b37848d8-f401-4155-a029-b0ffa09ff85b generation from 0 to 1 during operation: update_inventory {{(pid=75176) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 28 15:34:51 user nova-compute[75176]: DEBUG nova.compute.provider_tree [None req-c92bf948-4292-4af3-b72b-057b444bff2c None None] Updating inventory in ProviderTree for provider b37848d8-f401-4155-a029-b0ffa09ff85b with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75176) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 28 15:34:52 user nova-compute[75176]: DEBUG nova.compute.provider_tree [None req-c92bf948-4292-4af3-b72b-057b444bff2c None None] Updating resource provider b37848d8-f401-4155-a029-b0ffa09ff85b generation from 1 to 2 during operation: update_traits {{(pid=75176) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 28 15:34:52 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-c92bf948-4292-4af3-b72b-057b444bff2c None None] Compute_service record updated for user:user {{(pid=75176) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 15:34:52 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-c92bf948-4292-4af3-b72b-057b444bff2c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.636s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:34:52 user nova-compute[75176]: DEBUG nova.service [None req-c92bf948-4292-4af3-b72b-057b444bff2c None None] Creating RPC server for service compute {{(pid=75176) start /opt/stack/nova/nova/service.py:182}}
Nov 28 15:34:52 user nova-compute[75176]: DEBUG nova.service [None req-c92bf948-4292-4af3-b72b-057b444bff2c None None] Join ServiceGroup membership for this service compute {{(pid=75176) start /opt/stack/nova/nova/service.py:199}}
Nov 28 15:34:52 user nova-compute[75176]: DEBUG nova.servicegroup.drivers.db [None req-c92bf948-4292-4af3-b72b-057b444bff2c None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=75176) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Nov 28 15:35:10 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:35:10 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:35:42 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:35:42 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:35:42 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Starting heal instance info cache {{(pid=75176) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 15:35:42 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Rebuilding the list of instances to heal {{(pid=75176) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 15:35:42 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Didn't find any instances for network info cache update. {{(pid=75176) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 28 15:35:42 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:35:42 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:35:42 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:35:42 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:35:42 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:35:42 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:35:42 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75176) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 15:35:42 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:35:42 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:35:42 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:35:42 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:35:42 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Auditing locally available compute resources for user (node: user) {{(pid=75176) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 15:35:43 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 15:35:43 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 15:35:43 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Hypervisor/Node resource view: name=user free_ram=10495MB free_disk=26.08004379272461GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75176) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 15:35:43 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:35:43 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:35:43 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75176) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 15:35:43 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75176) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 15:35:43 user nova-compute[75176]: DEBUG nova.compute.provider_tree [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Inventory has not changed in ProviderTree for provider: b37848d8-f401-4155-a029-b0ffa09ff85b {{(pid=75176) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 15:35:43 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Inventory has not changed for provider b37848d8-f401-4155-a029-b0ffa09ff85b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75176) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 15:35:43 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Compute_service record updated for user:user {{(pid=75176) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 15:35:43 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.143s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:36:43 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:36:43 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:36:43 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:36:43 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:36:43 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:36:43 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:36:43 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75176) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 15:36:43 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:36:43 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:36:43 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:36:43 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:36:43 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Auditing locally available compute resources for user (node: user) {{(pid=75176) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 15:36:43 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 15:36:43 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 15:36:43 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Hypervisor/Node resource view: name=user free_ram=10408MB free_disk=26.145103454589844GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75176) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 15:36:43 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:36:43 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:36:44 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75176) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 15:36:44 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75176) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 15:36:44 user nova-compute[75176]: DEBUG nova.compute.provider_tree [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Inventory has not changed in ProviderTree for provider: b37848d8-f401-4155-a029-b0ffa09ff85b {{(pid=75176) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 15:36:44 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Inventory has not changed for provider b37848d8-f401-4155-a029-b0ffa09ff85b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75176) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 15:36:44 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Compute_service record updated for user:user {{(pid=75176) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 15:36:44 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.101s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:36:45 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:36:45 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Starting heal instance info cache {{(pid=75176) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 15:36:45 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Rebuilding the list of instances to heal {{(pid=75176) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 15:36:45 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Didn't find any instances for network info cache update. {{(pid=75176) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 28 15:36:45 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:36:45 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:37:43 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:37:43 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:37:43 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:37:43 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:37:43 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:37:43 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75176) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 15:37:43 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:37:43 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:37:43 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:37:43 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:37:43 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Auditing locally available compute resources for user (node: user) {{(pid=75176) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 15:37:44 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 15:37:44 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 15:37:44 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Hypervisor/Node resource view: name=user free_ram=10424MB free_disk=25.89914321899414GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75176) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 15:37:44 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:37:44 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:37:44 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75176) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 15:37:44 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75176) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 15:37:44 user nova-compute[75176]: DEBUG nova.compute.provider_tree [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Inventory has not changed in ProviderTree for provider: b37848d8-f401-4155-a029-b0ffa09ff85b {{(pid=75176) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 15:37:44 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Inventory has not changed for provider b37848d8-f401-4155-a029-b0ffa09ff85b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75176) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 15:37:44 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Compute_service record updated for user:user {{(pid=75176) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 15:37:44 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.141s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:37:45 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:37:46 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:37:46 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Starting heal instance info cache {{(pid=75176) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 15:37:46 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Rebuilding the list of instances to heal {{(pid=75176) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 15:37:46 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Didn't find any instances for network info cache update. {{(pid=75176) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 28 15:37:46 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:38:43 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:38:43 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:38:43 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:38:44 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:38:44 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:38:44 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:38:44 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:38:44 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Auditing locally available compute resources for user (node: user) {{(pid=75176) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 15:38:44 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 15:38:44 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 15:38:44 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Hypervisor/Node resource view: name=user free_ram=9703MB free_disk=25.92633056640625GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75176) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 15:38:44 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:38:44 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:38:45 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75176) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 15:38:45 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75176) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 15:38:45 user nova-compute[75176]: DEBUG nova.compute.provider_tree [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Inventory has not changed in ProviderTree for provider: b37848d8-f401-4155-a029-b0ffa09ff85b {{(pid=75176) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 15:38:45 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Inventory has not changed for provider b37848d8-f401-4155-a029-b0ffa09ff85b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75176) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 15:38:45 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Compute_service record updated for user:user {{(pid=75176) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 15:38:45 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.169s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:38:46 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:38:46 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:38:46 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:38:46 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:38:46 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75176) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 15:38:46 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:38:46 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Starting heal instance info cache {{(pid=75176) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 15:38:46 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Rebuilding the list of instances to heal {{(pid=75176) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 15:38:46 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Didn't find any instances for network info cache update. {{(pid=75176) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 28 15:38:46 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:38:54 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-c6a4c2f0-2e37-40a9-8ae6-6700c2a6bc5b tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] Acquiring lock "f81dc25c-3549-4e25-b27c-a75a50d9a448" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:38:54 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-c6a4c2f0-2e37-40a9-8ae6-6700c2a6bc5b tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] Lock "f81dc25c-3549-4e25-b27c-a75a50d9a448" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:38:54 user nova-compute[75176]: DEBUG nova.compute.manager [None req-c6a4c2f0-2e37-40a9-8ae6-6700c2a6bc5b tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] [instance: f81dc25c-3549-4e25-b27c-a75a50d9a448] Starting instance... {{(pid=75176) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 15:38:55 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-c6a4c2f0-2e37-40a9-8ae6-6700c2a6bc5b tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:38:55 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-c6a4c2f0-2e37-40a9-8ae6-6700c2a6bc5b tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:38:55 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-c6a4c2f0-2e37-40a9-8ae6-6700c2a6bc5b tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75176) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 15:38:55 user nova-compute[75176]: INFO nova.compute.claims [None req-c6a4c2f0-2e37-40a9-8ae6-6700c2a6bc5b tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] [instance: f81dc25c-3549-4e25-b27c-a75a50d9a448] Claim successful on node user
Nov 28 15:38:55 user nova-compute[75176]: DEBUG nova.compute.provider_tree [None req-c6a4c2f0-2e37-40a9-8ae6-6700c2a6bc5b tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] Inventory has not changed in ProviderTree for provider: b37848d8-f401-4155-a029-b0ffa09ff85b {{(pid=75176) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 15:38:55 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-c6a4c2f0-2e37-40a9-8ae6-6700c2a6bc5b tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] Inventory has not changed for provider b37848d8-f401-4155-a029-b0ffa09ff85b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75176) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 15:38:55 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-c6a4c2f0-2e37-40a9-8ae6-6700c2a6bc5b tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.301s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:38:55 user nova-compute[75176]: DEBUG nova.compute.manager [None req-c6a4c2f0-2e37-40a9-8ae6-6700c2a6bc5b tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] [instance: f81dc25c-3549-4e25-b27c-a75a50d9a448] Start building networks asynchronously for instance. {{(pid=75176) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 15:38:55 user nova-compute[75176]: DEBUG nova.compute.manager [None req-c6a4c2f0-2e37-40a9-8ae6-6700c2a6bc5b tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] [instance: f81dc25c-3549-4e25-b27c-a75a50d9a448] Allocating IP information in the background. {{(pid=75176) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 15:38:55 user nova-compute[75176]: DEBUG nova.network.neutron [None req-c6a4c2f0-2e37-40a9-8ae6-6700c2a6bc5b tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] [instance: f81dc25c-3549-4e25-b27c-a75a50d9a448] allocate_for_instance() {{(pid=75176) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 15:38:55 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-c6a4c2f0-2e37-40a9-8ae6-6700c2a6bc5b tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] [instance: f81dc25c-3549-4e25-b27c-a75a50d9a448] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 15:38:55 user nova-compute[75176]: DEBUG nova.compute.manager [None req-c6a4c2f0-2e37-40a9-8ae6-6700c2a6bc5b tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] [instance: f81dc25c-3549-4e25-b27c-a75a50d9a448] Start building block device mappings for instance. {{(pid=75176) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 15:38:56 user nova-compute[75176]: DEBUG nova.compute.manager [None req-c6a4c2f0-2e37-40a9-8ae6-6700c2a6bc5b tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] [instance: f81dc25c-3549-4e25-b27c-a75a50d9a448] Start spawning the instance on the hypervisor. {{(pid=75176) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 15:38:56 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-c6a4c2f0-2e37-40a9-8ae6-6700c2a6bc5b tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] [instance: f81dc25c-3549-4e25-b27c-a75a50d9a448] Creating instance directory {{(pid=75176) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 15:38:56 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-c6a4c2f0-2e37-40a9-8ae6-6700c2a6bc5b tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] [instance: f81dc25c-3549-4e25-b27c-a75a50d9a448] Creating image(s)
Nov 28 15:38:56 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-c6a4c2f0-2e37-40a9-8ae6-6700c2a6bc5b tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] Acquiring lock "/opt/stack/data/nova/instances/f81dc25c-3549-4e25-b27c-a75a50d9a448/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:38:56 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-c6a4c2f0-2e37-40a9-8ae6-6700c2a6bc5b tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] Lock "/opt/stack/data/nova/instances/f81dc25c-3549-4e25-b27c-a75a50d9a448/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:38:56 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-c6a4c2f0-2e37-40a9-8ae6-6700c2a6bc5b tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] Lock "/opt/stack/data/nova/instances/f81dc25c-3549-4e25-b27c-a75a50d9a448/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:38:56 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-c6a4c2f0-2e37-40a9-8ae6-6700c2a6bc5b tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] Acquiring lock "5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:38:56 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-c6a4c2f0-2e37-40a9-8ae6-6700c2a6bc5b tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] Lock "5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:38:56 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-c6a4c2f0-2e37-40a9-8ae6-6700c2a6bc5b tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2.part --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:38:56 user nova-compute[75176]: DEBUG nova.policy [None req-c6a4c2f0-2e37-40a9-8ae6-6700c2a6bc5b tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bb8e82f7d5d54c2394e87bb268ce9434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81856f8d465d408bbb6b0fbfe4dd2fa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75176) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 15:38:57 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-c6a4c2f0-2e37-40a9-8ae6-6700c2a6bc5b tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2.part --force-share --output=json" returned: 0 in 0.196s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:38:57 user nova-compute[75176]: DEBUG nova.virt.images [None req-c6a4c2f0-2e37-40a9-8ae6-6700c2a6bc5b tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] 1f41819e-c93f-4dc7-b253-37a27bbbbc74 was qcow2, converting to raw {{(pid=75176) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 28 15:38:57 user nova-compute[75176]: DEBUG nova.privsep.utils [None req-c6a4c2f0-2e37-40a9-8ae6-6700c2a6bc5b tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75176) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 28 15:38:57 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-c6a4c2f0-2e37-40a9-8ae6-6700c2a6bc5b tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2.part /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2.converted {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:38:57 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-c6a4c2f0-2e37-40a9-8ae6-6700c2a6bc5b tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2.part /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2.converted" returned: 0 in 0.158s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:38:57 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-c6a4c2f0-2e37-40a9-8ae6-6700c2a6bc5b tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2.converted --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:38:57 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-c6a4c2f0-2e37-40a9-8ae6-6700c2a6bc5b tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2.converted --force-share --output=json" returned: 0 in 0.175s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:38:57 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-c6a4c2f0-2e37-40a9-8ae6-6700c2a6bc5b tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] Lock "5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.339s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:38:57 user nova-compute[75176]: INFO oslo.privsep.daemon [None req-c6a4c2f0-2e37-40a9-8ae6-6700c2a6bc5b tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpn_p68y3z/privsep.sock']
Nov 28 15:38:57 user sudo[84423]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpn_p68y3z/privsep.sock
Nov 28 15:38:57 user sudo[84423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 28 15:38:58 user sudo[84423]: pam_unix(sudo:session): session closed for user root
Nov 28 15:38:58 user nova-compute[75176]: INFO oslo.privsep.daemon [None req-c6a4c2f0-2e37-40a9-8ae6-6700c2a6bc5b tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] Spawned new privsep daemon via rootwrap
Nov 28 15:38:58 user nova-compute[75176]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 28 15:38:58 user nova-compute[75176]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 28 15:38:58 user nova-compute[75176]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Nov 28 15:38:58 user nova-compute[75176]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84430
Nov 28 15:38:58 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-c6a4c2f0-2e37-40a9-8ae6-6700c2a6bc5b tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:38:59 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-c6a4c2f0-2e37-40a9-8ae6-6700c2a6bc5b tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json" returned: 0 in 0.164s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:38:59 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-c6a4c2f0-2e37-40a9-8ae6-6700c2a6bc5b tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] Acquiring lock "5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:38:59 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-c6a4c2f0-2e37-40a9-8ae6-6700c2a6bc5b tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] Lock "5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:38:59 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-c6a4c2f0-2e37-40a9-8ae6-6700c2a6bc5b tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:38:59 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-c6a4c2f0-2e37-40a9-8ae6-6700c2a6bc5b tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json" returned: 0 in 0.170s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:38:59 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-c6a4c2f0-2e37-40a9-8ae6-6700c2a6bc5b tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2,backing_fmt=raw /opt/stack/data/nova/instances/f81dc25c-3549-4e25-b27c-a75a50d9a448/disk 1073741824 {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:38:59 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-c6a4c2f0-2e37-40a9-8ae6-6700c2a6bc5b tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2,backing_fmt=raw /opt/stack/data/nova/instances/f81dc25c-3549-4e25-b27c-a75a50d9a448/disk 1073741824" returned: 0 in 0.041s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:38:59 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-c6a4c2f0-2e37-40a9-8ae6-6700c2a6bc5b tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] Lock "5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.216s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:38:59 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-c6a4c2f0-2e37-40a9-8ae6-6700c2a6bc5b tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:38:59 user nova-compute[75176]: DEBUG nova.network.neutron [None req-c6a4c2f0-2e37-40a9-8ae6-6700c2a6bc5b tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] [instance: f81dc25c-3549-4e25-b27c-a75a50d9a448] Successfully created port: 1e629a40-5a9f-4891-8148-7a2c925d8ad6 {{(pid=75176) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 15:38:59 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-c6a4c2f0-2e37-40a9-8ae6-6700c2a6bc5b tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json" returned: 0 in 0.165s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:38:59 user nova-compute[75176]: DEBUG nova.virt.disk.api [None req-c6a4c2f0-2e37-40a9-8ae6-6700c2a6bc5b tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f81dc25c-3549-4e25-b27c-a75a50d9a448/disk. size=1073741824 {{(pid=75176) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 15:38:59 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-c6a4c2f0-2e37-40a9-8ae6-6700c2a6bc5b tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f81dc25c-3549-4e25-b27c-a75a50d9a448/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:38:59 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-c6a4c2f0-2e37-40a9-8ae6-6700c2a6bc5b tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f81dc25c-3549-4e25-b27c-a75a50d9a448/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:38:59 user nova-compute[75176]: DEBUG nova.virt.disk.api [None req-c6a4c2f0-2e37-40a9-8ae6-6700c2a6bc5b tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] Cannot resize image /opt/stack/data/nova/instances/f81dc25c-3549-4e25-b27c-a75a50d9a448/disk to a smaller size. {{(pid=75176) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 15:38:59 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-c6a4c2f0-2e37-40a9-8ae6-6700c2a6bc5b tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] [instance: f81dc25c-3549-4e25-b27c-a75a50d9a448] Created local disks {{(pid=75176) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 15:38:59 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-c6a4c2f0-2e37-40a9-8ae6-6700c2a6bc5b tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] [instance: f81dc25c-3549-4e25-b27c-a75a50d9a448] Ensure instance console log exists: /opt/stack/data/nova/instances/f81dc25c-3549-4e25-b27c-a75a50d9a448/console.log {{(pid=75176) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 15:38:59 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-c6a4c2f0-2e37-40a9-8ae6-6700c2a6bc5b tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:38:59 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-c6a4c2f0-2e37-40a9-8ae6-6700c2a6bc5b tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:38:59 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-c6a4c2f0-2e37-40a9-8ae6-6700c2a6bc5b tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:39:00 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-89d2a15f-e9da-4425-a768-aa428f0b8c54 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] Acquiring lock "6ab0619f-72e5-4975-ade8-53d7c0784d89" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:39:00 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-89d2a15f-e9da-4425-a768-aa428f0b8c54 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] Lock "6ab0619f-72e5-4975-ade8-53d7c0784d89" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:39:00 user nova-compute[75176]: DEBUG nova.compute.manager [None req-89d2a15f-e9da-4425-a768-aa428f0b8c54 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] [instance: 6ab0619f-72e5-4975-ade8-53d7c0784d89] Starting instance... {{(pid=75176) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 15:39:00 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-89d2a15f-e9da-4425-a768-aa428f0b8c54 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:39:00 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-89d2a15f-e9da-4425-a768-aa428f0b8c54 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:39:00 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-89d2a15f-e9da-4425-a768-aa428f0b8c54 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75176) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 15:39:00 user nova-compute[75176]: INFO nova.compute.claims [None req-89d2a15f-e9da-4425-a768-aa428f0b8c54 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] [instance: 6ab0619f-72e5-4975-ade8-53d7c0784d89] Claim successful on node user
Nov 28 15:39:00 user nova-compute[75176]: DEBUG nova.compute.provider_tree [None req-89d2a15f-e9da-4425-a768-aa428f0b8c54 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] Inventory has not changed in ProviderTree for provider: b37848d8-f401-4155-a029-b0ffa09ff85b {{(pid=75176) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 15:39:00 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-89d2a15f-e9da-4425-a768-aa428f0b8c54 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] Inventory has not changed for provider b37848d8-f401-4155-a029-b0ffa09ff85b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75176) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 15:39:00 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-89d2a15f-e9da-4425-a768-aa428f0b8c54 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.267s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:39:00 user nova-compute[75176]: DEBUG nova.compute.manager [None req-89d2a15f-e9da-4425-a768-aa428f0b8c54 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] [instance: 6ab0619f-72e5-4975-ade8-53d7c0784d89] Start building networks asynchronously for instance. {{(pid=75176) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 15:39:00 user nova-compute[75176]: DEBUG nova.compute.manager [None req-89d2a15f-e9da-4425-a768-aa428f0b8c54 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] [instance: 6ab0619f-72e5-4975-ade8-53d7c0784d89] Allocating IP information in the background. {{(pid=75176) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 15:39:00 user nova-compute[75176]: DEBUG nova.network.neutron [None req-89d2a15f-e9da-4425-a768-aa428f0b8c54 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] [instance: 6ab0619f-72e5-4975-ade8-53d7c0784d89] allocate_for_instance() {{(pid=75176) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 15:39:00 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-89d2a15f-e9da-4425-a768-aa428f0b8c54 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] [instance: 6ab0619f-72e5-4975-ade8-53d7c0784d89] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 15:39:00 user nova-compute[75176]: DEBUG nova.compute.manager [None req-89d2a15f-e9da-4425-a768-aa428f0b8c54 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] [instance: 6ab0619f-72e5-4975-ade8-53d7c0784d89] Start building block device mappings for instance. {{(pid=75176) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 15:39:00 user nova-compute[75176]: DEBUG nova.policy [None req-89d2a15f-e9da-4425-a768-aa428f0b8c54 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fe7af9ff921c4fcba937dd6b3f93318d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa05294c527426383c66fe58b31c825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75176) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 15:39:00 user nova-compute[75176]: DEBUG nova.compute.manager [None req-89d2a15f-e9da-4425-a768-aa428f0b8c54 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] [instance: 6ab0619f-72e5-4975-ade8-53d7c0784d89] Start spawning the instance on the hypervisor. {{(pid=75176) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 15:39:00 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-89d2a15f-e9da-4425-a768-aa428f0b8c54 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] [instance: 6ab0619f-72e5-4975-ade8-53d7c0784d89] Creating instance directory {{(pid=75176) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 15:39:00 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-89d2a15f-e9da-4425-a768-aa428f0b8c54 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] [instance: 6ab0619f-72e5-4975-ade8-53d7c0784d89] Creating image(s)
Nov 28 15:39:00 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-89d2a15f-e9da-4425-a768-aa428f0b8c54 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] Acquiring lock "/opt/stack/data/nova/instances/6ab0619f-72e5-4975-ade8-53d7c0784d89/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:39:00 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-89d2a15f-e9da-4425-a768-aa428f0b8c54 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] Lock "/opt/stack/data/nova/instances/6ab0619f-72e5-4975-ade8-53d7c0784d89/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:39:00 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-89d2a15f-e9da-4425-a768-aa428f0b8c54 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] Lock "/opt/stack/data/nova/instances/6ab0619f-72e5-4975-ade8-53d7c0784d89/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:39:00 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-89d2a15f-e9da-4425-a768-aa428f0b8c54 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:39:00 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-89d2a15f-e9da-4425-a768-aa428f0b8c54 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json" returned: 0 in 0.177s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:39:00 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-89d2a15f-e9da-4425-a768-aa428f0b8c54 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] Acquiring lock "5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:39:00 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-89d2a15f-e9da-4425-a768-aa428f0b8c54 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] Lock "5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:39:00 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-89d2a15f-e9da-4425-a768-aa428f0b8c54 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:39:01 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-89d2a15f-e9da-4425-a768-aa428f0b8c54 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json" returned: 0 in 0.177s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:39:01 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-89d2a15f-e9da-4425-a768-aa428f0b8c54 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2,backing_fmt=raw /opt/stack/data/nova/instances/6ab0619f-72e5-4975-ade8-53d7c0784d89/disk 1073741824 {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:39:01 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-89d2a15f-e9da-4425-a768-aa428f0b8c54 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2,backing_fmt=raw /opt/stack/data/nova/instances/6ab0619f-72e5-4975-ade8-53d7c0784d89/disk 1073741824" returned: 0 in 0.044s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:39:01 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-89d2a15f-e9da-4425-a768-aa428f0b8c54 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] Lock "5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.225s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:39:01 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-89d2a15f-e9da-4425-a768-aa428f0b8c54 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:39:01 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-89d2a15f-e9da-4425-a768-aa428f0b8c54 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json" returned: 0 in 0.205s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:39:01 user nova-compute[75176]: DEBUG nova.virt.disk.api [None req-89d2a15f-e9da-4425-a768-aa428f0b8c54 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6ab0619f-72e5-4975-ade8-53d7c0784d89/disk. size=1073741824 {{(pid=75176) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 15:39:01 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-89d2a15f-e9da-4425-a768-aa428f0b8c54 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ab0619f-72e5-4975-ade8-53d7c0784d89/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:39:01 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-89d2a15f-e9da-4425-a768-aa428f0b8c54 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ab0619f-72e5-4975-ade8-53d7c0784d89/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:39:01 user nova-compute[75176]: DEBUG nova.virt.disk.api [None req-89d2a15f-e9da-4425-a768-aa428f0b8c54 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] Cannot resize image /opt/stack/data/nova/instances/6ab0619f-72e5-4975-ade8-53d7c0784d89/disk to a smaller size. {{(pid=75176) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 15:39:01 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-89d2a15f-e9da-4425-a768-aa428f0b8c54 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] [instance: 6ab0619f-72e5-4975-ade8-53d7c0784d89] Created local disks {{(pid=75176) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 15:39:01 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-89d2a15f-e9da-4425-a768-aa428f0b8c54 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] [instance: 6ab0619f-72e5-4975-ade8-53d7c0784d89] Ensure instance console log exists: /opt/stack/data/nova/instances/6ab0619f-72e5-4975-ade8-53d7c0784d89/console.log {{(pid=75176) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 15:39:01 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-89d2a15f-e9da-4425-a768-aa428f0b8c54 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:39:01 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-89d2a15f-e9da-4425-a768-aa428f0b8c54 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:39:01 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-89d2a15f-e9da-4425-a768-aa428f0b8c54 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:39:02 user nova-compute[75176]: DEBUG nova.network.neutron [None req-89d2a15f-e9da-4425-a768-aa428f0b8c54 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] [instance: 6ab0619f-72e5-4975-ade8-53d7c0784d89] Successfully created port: 63e3a2a2-51d4-4899-806d-c3222f643878 {{(pid=75176) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 15:39:02 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-799d598a-9d25-4065-b2b4-8ca63b9f0ac1 tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Acquiring lock "aa223c49-d254-4727-8a01-873026847b37" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:39:02 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-799d598a-9d25-4065-b2b4-8ca63b9f0ac1 tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Lock "aa223c49-d254-4727-8a01-873026847b37" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:39:02 user nova-compute[75176]: DEBUG nova.compute.manager [None req-799d598a-9d25-4065-b2b4-8ca63b9f0ac1 tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] [instance: aa223c49-d254-4727-8a01-873026847b37] Starting instance... {{(pid=75176) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 15:39:02 user nova-compute[75176]: DEBUG nova.network.neutron [None req-89d2a15f-e9da-4425-a768-aa428f0b8c54 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] [instance: 6ab0619f-72e5-4975-ade8-53d7c0784d89] Successfully updated port: 63e3a2a2-51d4-4899-806d-c3222f643878 {{(pid=75176) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 15:39:02 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-89d2a15f-e9da-4425-a768-aa428f0b8c54 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] Acquiring lock "refresh_cache-6ab0619f-72e5-4975-ade8-53d7c0784d89" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:39:02 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-89d2a15f-e9da-4425-a768-aa428f0b8c54 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] Acquired lock "refresh_cache-6ab0619f-72e5-4975-ade8-53d7c0784d89" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:39:02 user nova-compute[75176]: DEBUG nova.network.neutron [None req-89d2a15f-e9da-4425-a768-aa428f0b8c54 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] [instance: 6ab0619f-72e5-4975-ade8-53d7c0784d89] Building network info cache for instance {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 15:39:03 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-799d598a-9d25-4065-b2b4-8ca63b9f0ac1 tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:39:03 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-799d598a-9d25-4065-b2b4-8ca63b9f0ac1 tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:39:03 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-799d598a-9d25-4065-b2b4-8ca63b9f0ac1 tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75176) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 15:39:03 user nova-compute[75176]: INFO nova.compute.claims [None req-799d598a-9d25-4065-b2b4-8ca63b9f0ac1 tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] [instance: aa223c49-d254-4727-8a01-873026847b37] Claim successful on node user
Nov 28 15:39:03 user nova-compute[75176]: DEBUG nova.network.neutron [None req-89d2a15f-e9da-4425-a768-aa428f0b8c54 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] [instance: 6ab0619f-72e5-4975-ade8-53d7c0784d89] Instance cache missing network info. {{(pid=75176) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 15:39:03 user nova-compute[75176]: DEBUG nova.compute.provider_tree [None req-799d598a-9d25-4065-b2b4-8ca63b9f0ac1 tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Inventory has not changed in ProviderTree for provider: b37848d8-f401-4155-a029-b0ffa09ff85b {{(pid=75176) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 15:39:03 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-799d598a-9d25-4065-b2b4-8ca63b9f0ac1 tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Inventory has not changed for provider b37848d8-f401-4155-a029-b0ffa09ff85b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75176) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 15:39:03 user nova-compute[75176]: DEBUG nova.compute.manager [req-e08666c6-5304-4abf-9efd-3057f0ea28ed req-886bb0f0-6eed-465d-a520-0349be8c9e24 service nova] [instance: 6ab0619f-72e5-4975-ade8-53d7c0784d89] Received event network-changed-63e3a2a2-51d4-4899-806d-c3222f643878 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:39:03 user nova-compute[75176]: DEBUG nova.compute.manager [req-e08666c6-5304-4abf-9efd-3057f0ea28ed req-886bb0f0-6eed-465d-a520-0349be8c9e24 service nova] [instance: 6ab0619f-72e5-4975-ade8-53d7c0784d89] Refreshing instance network info cache due to event network-changed-63e3a2a2-51d4-4899-806d-c3222f643878. {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 15:39:03 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-e08666c6-5304-4abf-9efd-3057f0ea28ed req-886bb0f0-6eed-465d-a520-0349be8c9e24 service nova] Acquiring lock "refresh_cache-6ab0619f-72e5-4975-ade8-53d7c0784d89" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:39:03 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-799d598a-9d25-4065-b2b4-8ca63b9f0ac1 tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.331s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:39:03 user nova-compute[75176]: DEBUG nova.compute.manager [None req-799d598a-9d25-4065-b2b4-8ca63b9f0ac1 tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] [instance: aa223c49-d254-4727-8a01-873026847b37] Start building networks asynchronously for instance. {{(pid=75176) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 15:39:03 user nova-compute[75176]: DEBUG nova.network.neutron [None req-89d2a15f-e9da-4425-a768-aa428f0b8c54 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] [instance: 6ab0619f-72e5-4975-ade8-53d7c0784d89] Updating instance_info_cache with network_info: [{"id": "63e3a2a2-51d4-4899-806d-c3222f643878", "address": "fa:16:3e:4d:46:79", "network": {"id": "84bcb9a8-0292-4eed-a9eb-2a883619389c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1655598964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fa05294c527426383c66fe58b31c825", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63e3a2a2-51", "ovs_interfaceid": "63e3a2a2-51d4-4899-806d-c3222f643878", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:39:03 user nova-compute[75176]: DEBUG nova.compute.manager [None req-799d598a-9d25-4065-b2b4-8ca63b9f0ac1 tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] [instance: aa223c49-d254-4727-8a01-873026847b37] Allocating IP information in the background. {{(pid=75176) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 15:39:03 user nova-compute[75176]: DEBUG nova.network.neutron [None req-799d598a-9d25-4065-b2b4-8ca63b9f0ac1 tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] [instance: aa223c49-d254-4727-8a01-873026847b37] allocate_for_instance() {{(pid=75176) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 15:39:03 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-89d2a15f-e9da-4425-a768-aa428f0b8c54 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] Releasing lock "refresh_cache-6ab0619f-72e5-4975-ade8-53d7c0784d89" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:39:03 user nova-compute[75176]: DEBUG nova.compute.manager [None req-89d2a15f-e9da-4425-a768-aa428f0b8c54 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] [instance: 6ab0619f-72e5-4975-ade8-53d7c0784d89] Instance network_info: |[{"id": "63e3a2a2-51d4-4899-806d-c3222f643878", "address": "fa:16:3e:4d:46:79", "network": {"id": "84bcb9a8-0292-4eed-a9eb-2a883619389c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1655598964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fa05294c527426383c66fe58b31c825", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63e3a2a2-51", "ovs_interfaceid": "63e3a2a2-51d4-4899-806d-c3222f643878", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75176) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 15:39:03 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-e08666c6-5304-4abf-9efd-3057f0ea28ed req-886bb0f0-6eed-465d-a520-0349be8c9e24 service nova] Acquired lock "refresh_cache-6ab0619f-72e5-4975-ade8-53d7c0784d89" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:39:03 user nova-compute[75176]: DEBUG nova.network.neutron [req-e08666c6-5304-4abf-9efd-3057f0ea28ed req-886bb0f0-6eed-465d-a520-0349be8c9e24 service nova] [instance: 6ab0619f-72e5-4975-ade8-53d7c0784d89] Refreshing network info cache for port 63e3a2a2-51d4-4899-806d-c3222f643878 {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 15:39:03 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-89d2a15f-e9da-4425-a768-aa428f0b8c54 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] [instance: 6ab0619f-72e5-4975-ade8-53d7c0784d89] Start _get_guest_xml network_info=[{"id": "63e3a2a2-51d4-4899-806d-c3222f643878", "address": "fa:16:3e:4d:46:79", "network": {"id": "84bcb9a8-0292-4eed-a9eb-2a883619389c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1655598964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fa05294c527426383c66fe58b31c825", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63e3a2a2-51", "ovs_interfaceid": "63e3a2a2-51d4-4899-806d-c3222f643878", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T15:35:12Z,direct_url=<?>,disk_format='qcow2',id=1f41819e-c93f-4dc7-b253-37a27bbbbc74,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1b91c5d0672c4224a48df2e1f92688e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T15:35:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'size': 0, 'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'image_id': '1f41819e-c93f-4dc7-b253-37a27bbbbc74'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75176) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 15:39:03 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-799d598a-9d25-4065-b2b4-8ca63b9f0ac1 tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] [instance: aa223c49-d254-4727-8a01-873026847b37] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 15:39:03 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-89d2a15f-e9da-4425-a768-aa428f0b8c54 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 15:39:03 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-89d2a15f-e9da-4425-a768-aa428f0b8c54 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 15:39:03 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-89d2a15f-e9da-4425-a768-aa428f0b8c54 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75176) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 15:39:03 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-89d2a15f-e9da-4425-a768-aa428f0b8c54 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] CPU controller missing on host. {{(pid=75176) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 15:39:03 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-89d2a15f-e9da-4425-a768-aa428f0b8c54 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75176) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 15:39:03 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-89d2a15f-e9da-4425-a768-aa428f0b8c54 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] CPU controller found on host. {{(pid=75176) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 15:39:03 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-89d2a15f-e9da-4425-a768-aa428f0b8c54 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75176) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 15:39:03 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-89d2a15f-e9da-4425-a768-aa428f0b8c54 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T15:35:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T15:35:12Z,direct_url=<?>,disk_format='qcow2',id=1f41819e-c93f-4dc7-b253-37a27bbbbc74,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1b91c5d0672c4224a48df2e1f92688e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T15:35:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 15:39:03 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-89d2a15f-e9da-4425-a768-aa428f0b8c54 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] Flavor limits 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 15:39:03 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-89d2a15f-e9da-4425-a768-aa428f0b8c54 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] Image limits 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 15:39:03 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-89d2a15f-e9da-4425-a768-aa428f0b8c54 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] Flavor pref 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 15:39:03 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-89d2a15f-e9da-4425-a768-aa428f0b8c54 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] Image pref 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 15:39:03 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-89d2a15f-e9da-4425-a768-aa428f0b8c54 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 15:39:03 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-89d2a15f-e9da-4425-a768-aa428f0b8c54 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 15:39:03 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-89d2a15f-e9da-4425-a768-aa428f0b8c54 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75176) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 15:39:03 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-89d2a15f-e9da-4425-a768-aa428f0b8c54 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] Got 1 possible topologies {{(pid=75176) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 15:39:03 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-89d2a15f-e9da-4425-a768-aa428f0b8c54 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 15:39:03 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-89d2a15f-e9da-4425-a768-aa428f0b8c54 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 15:39:03 user nova-compute[75176]: DEBUG nova.privsep.utils [None req-89d2a15f-e9da-4425-a768-aa428f0b8c54 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75176) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 28 15:39:03 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-89d2a15f-e9da-4425-a768-aa428f0b8c54 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T15:38:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1718830929',display_name='tempest-ServerStableDeviceRescueTest-server-1718830929',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1718830929',id=2,image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHSzZ12RXOTrDwh+h18L3phcCN5TGehVmYtmaLi1jyqDEQuZz0snJimoDD3Zw/Z6Ti+jmxi9CB36LPtnz2rNWaG62e3brw+uWVt5sHC24uB4mJRin9Q2z7NtWEfLWyBqdQ==',key_name='tempest-keypair-2016976293',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8fa05294c527426383c66fe58b31c825',ramdisk_id='',reservation_id='r-qn2vcowb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1490134813',owner_user_name='tempest-ServerStableDeviceRescueTest-1490134813-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T15:39:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fe7af9ff921c4fcba937dd6b3f93318d',uuid=6ab0619f-72e5-4975-ade8-53d7c0784d89,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "63e3a2a2-51d4-4899-806d-c3222f643878", "address": "fa:16:3e:4d:46:79", "network": {"id": "84bcb9a8-0292-4eed-a9eb-2a883619389c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1655598964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fa05294c527426383c66fe58b31c825", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63e3a2a2-51", "ovs_interfaceid": "63e3a2a2-51d4-4899-806d-c3222f643878", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75176) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 15:39:03 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-89d2a15f-e9da-4425-a768-aa428f0b8c54 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] Converting VIF {"id": "63e3a2a2-51d4-4899-806d-c3222f643878", "address": "fa:16:3e:4d:46:79", "network": {"id": "84bcb9a8-0292-4eed-a9eb-2a883619389c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1655598964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fa05294c527426383c66fe58b31c825", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63e3a2a2-51", "ovs_interfaceid": "63e3a2a2-51d4-4899-806d-c3222f643878", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:39:03 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-89d2a15f-e9da-4425-a768-aa428f0b8c54 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:46:79,bridge_name='br-int',has_traffic_filtering=True,id=63e3a2a2-51d4-4899-806d-c3222f643878,network=Network(84bcb9a8-0292-4eed-a9eb-2a883619389c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63e3a2a2-51') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:39:03 user nova-compute[75176]: DEBUG nova.objects.instance [None req-89d2a15f-e9da-4425-a768-aa428f0b8c54 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] Lazy-loading 'pci_devices' on Instance uuid 6ab0619f-72e5-4975-ade8-53d7c0784d89 {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:39:03 user nova-compute[75176]: DEBUG nova.network.neutron [None req-c6a4c2f0-2e37-40a9-8ae6-6700c2a6bc5b tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] [instance: f81dc25c-3549-4e25-b27c-a75a50d9a448] Successfully updated port: 1e629a40-5a9f-4891-8148-7a2c925d8ad6 {{(pid=75176) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 15:39:03 user nova-compute[75176]: DEBUG nova.compute.manager [None req-799d598a-9d25-4065-b2b4-8ca63b9f0ac1 tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] [instance: aa223c49-d254-4727-8a01-873026847b37] Start building block device mappings for instance. {{(pid=75176) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 15:39:03 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-89d2a15f-e9da-4425-a768-aa428f0b8c54 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] [instance: 6ab0619f-72e5-4975-ade8-53d7c0784d89] End _get_guest_xml xml=<domain type="kvm">
Nov 28 15:39:03 user nova-compute[75176]:   <uuid>6ab0619f-72e5-4975-ade8-53d7c0784d89</uuid>
Nov 28 15:39:03 user nova-compute[75176]:   <name>instance-00000002</name>
Nov 28 15:39:03 user nova-compute[75176]:   <memory>524288</memory>
Nov 28 15:39:03 user nova-compute[75176]:   <vcpu>1</vcpu>
Nov 28 15:39:03 user nova-compute[75176]:   <metadata>
Nov 28 15:39:03 user nova-compute[75176]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 15:39:03 user nova-compute[75176]:       <nova:package version="0.0.0"/>
Nov 28 15:39:03 user nova-compute[75176]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1718830929</nova:name>
Nov 28 15:39:03 user nova-compute[75176]:       <nova:creationTime>2023-11-28 15:39:03</nova:creationTime>
Nov 28 15:39:03 user nova-compute[75176]:       <nova:flavor name="m1.tiny">
Nov 28 15:39:03 user nova-compute[75176]:         <nova:memory>512</nova:memory>
Nov 28 15:39:03 user nova-compute[75176]:         <nova:disk>1</nova:disk>
Nov 28 15:39:03 user nova-compute[75176]:         <nova:swap>0</nova:swap>
Nov 28 15:39:03 user nova-compute[75176]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 15:39:03 user nova-compute[75176]:         <nova:vcpus>1</nova:vcpus>
Nov 28 15:39:03 user nova-compute[75176]:       </nova:flavor>
Nov 28 15:39:03 user nova-compute[75176]:       <nova:owner>
Nov 28 15:39:03 user nova-compute[75176]:         <nova:user uuid="fe7af9ff921c4fcba937dd6b3f93318d">tempest-ServerStableDeviceRescueTest-1490134813-project-member</nova:user>
Nov 28 15:39:03 user nova-compute[75176]:         <nova:project uuid="8fa05294c527426383c66fe58b31c825">tempest-ServerStableDeviceRescueTest-1490134813</nova:project>
Nov 28 15:39:03 user nova-compute[75176]:       </nova:owner>
Nov 28 15:39:03 user nova-compute[75176]:       <nova:root type="image" uuid="1f41819e-c93f-4dc7-b253-37a27bbbbc74"/>
Nov 28 15:39:03 user nova-compute[75176]:       <nova:ports>
Nov 28 15:39:03 user nova-compute[75176]:         <nova:port uuid="63e3a2a2-51d4-4899-806d-c3222f643878">
Nov 28 15:39:03 user nova-compute[75176]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 28 15:39:03 user nova-compute[75176]:         </nova:port>
Nov 28 15:39:03 user nova-compute[75176]:       </nova:ports>
Nov 28 15:39:03 user nova-compute[75176]:     </nova:instance>
Nov 28 15:39:03 user nova-compute[75176]:   </metadata>
Nov 28 15:39:03 user nova-compute[75176]:   <sysinfo type="smbios">
Nov 28 15:39:03 user nova-compute[75176]:     <system>
Nov 28 15:39:03 user nova-compute[75176]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 15:39:03 user nova-compute[75176]:       <entry name="product">OpenStack Nova</entry>
Nov 28 15:39:03 user nova-compute[75176]:       <entry name="version">0.0.0</entry>
Nov 28 15:39:03 user nova-compute[75176]:       <entry name="serial">6ab0619f-72e5-4975-ade8-53d7c0784d89</entry>
Nov 28 15:39:03 user nova-compute[75176]:       <entry name="uuid">6ab0619f-72e5-4975-ade8-53d7c0784d89</entry>
Nov 28 15:39:03 user nova-compute[75176]:       <entry name="family">Virtual Machine</entry>
Nov 28 15:39:03 user nova-compute[75176]:     </system>
Nov 28 15:39:03 user nova-compute[75176]:   </sysinfo>
Nov 28 15:39:03 user nova-compute[75176]:   <os>
Nov 28 15:39:03 user nova-compute[75176]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 15:39:03 user nova-compute[75176]:     <boot dev="hd"/>
Nov 28 15:39:03 user nova-compute[75176]:     <smbios mode="sysinfo"/>
Nov 28 15:39:03 user nova-compute[75176]:   </os>
Nov 28 15:39:03 user nova-compute[75176]:   <features>
Nov 28 15:39:03 user nova-compute[75176]:     <acpi/>
Nov 28 15:39:03 user nova-compute[75176]:     <apic/>
Nov 28 15:39:03 user nova-compute[75176]:     <vmcoreinfo/>
Nov 28 15:39:03 user nova-compute[75176]:   </features>
Nov 28 15:39:03 user nova-compute[75176]:   <clock offset="utc">
Nov 28 15:39:03 user nova-compute[75176]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 15:39:03 user nova-compute[75176]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 15:39:03 user nova-compute[75176]:     <timer name="hpet" present="no"/>
Nov 28 15:39:03 user nova-compute[75176]:   </clock>
Nov 28 15:39:03 user nova-compute[75176]:   <cpu mode="custom" match="exact">
Nov 28 15:39:03 user nova-compute[75176]:     <model>Nehalem</model>
Nov 28 15:39:03 user nova-compute[75176]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 15:39:03 user nova-compute[75176]:   </cpu>
Nov 28 15:39:03 user nova-compute[75176]:   <devices>
Nov 28 15:39:03 user nova-compute[75176]:     <disk type="file" device="disk">
Nov 28 15:39:03 user nova-compute[75176]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 15:39:03 user nova-compute[75176]:       <source file="/opt/stack/data/nova/instances/6ab0619f-72e5-4975-ade8-53d7c0784d89/disk"/>
Nov 28 15:39:03 user nova-compute[75176]:       <target dev="vda" bus="virtio"/>
Nov 28 15:39:03 user nova-compute[75176]:     </disk>
Nov 28 15:39:03 user nova-compute[75176]:     <interface type="ethernet">
Nov 28 15:39:03 user nova-compute[75176]:       <mac address="fa:16:3e:4d:46:79"/>
Nov 28 15:39:03 user nova-compute[75176]:       <model type="virtio"/>
Nov 28 15:39:03 user nova-compute[75176]:       <mtu size="1442"/>
Nov 28 15:39:03 user nova-compute[75176]:       <target dev="tap63e3a2a2-51"/>
Nov 28 15:39:03 user nova-compute[75176]:     </interface>
Nov 28 15:39:03 user nova-compute[75176]:     <serial type="pty">
Nov 28 15:39:03 user nova-compute[75176]:       <log file="/opt/stack/data/nova/instances/6ab0619f-72e5-4975-ade8-53d7c0784d89/console.log" append="off"/>
Nov 28 15:39:03 user nova-compute[75176]:     </serial>
Nov 28 15:39:03 user nova-compute[75176]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 15:39:03 user nova-compute[75176]:     <video>
Nov 28 15:39:03 user nova-compute[75176]:       <model type="virtio"/>
Nov 28 15:39:03 user nova-compute[75176]:     </video>
Nov 28 15:39:03 user nova-compute[75176]:     <rng model="virtio">
Nov 28 15:39:03 user nova-compute[75176]:       <backend model="random">/dev/urandom</backend>
Nov 28 15:39:03 user nova-compute[75176]:     </rng>
Nov 28 15:39:03 user nova-compute[75176]:     <controller type="usb" index="0" model="none"/>
Nov 28 15:39:03 user nova-compute[75176]:     <memballoon model="virtio">
Nov 28 15:39:03 user nova-compute[75176]:       <stats period="10"/>
Nov 28 15:39:03 user nova-compute[75176]:     </memballoon>
Nov 28 15:39:03 user nova-compute[75176]:   </devices>
Nov 28 15:39:03 user nova-compute[75176]: </domain>
Nov 28 15:39:03 user nova-compute[75176]:  {{(pid=75176) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 15:39:03 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-89d2a15f-e9da-4425-a768-aa428f0b8c54 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T15:38:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1718830929',display_name='tempest-ServerStableDeviceRescueTest-server-1718830929',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1718830929',id=2,image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHSzZ12RXOTrDwh+h18L3phcCN5TGehVmYtmaLi1jyqDEQuZz0snJimoDD3Zw/Z6Ti+jmxi9CB36LPtnz2rNWaG62e3brw+uWVt5sHC24uB4mJRin9Q2z7NtWEfLWyBqdQ==',key_name='tempest-keypair-2016976293',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8fa05294c527426383c66fe58b31c825',ramdisk_id='',reservation_id='r-qn2vcowb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1490134813',owner_user_name='tempest-ServerStableDeviceRescueTest-1490134813-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T15:39:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fe7af9ff921c4fcba937dd6b3f93318d',uuid=6ab0619f-72e5-4975-ade8-53d7c0784d89,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "63e3a2a2-51d4-4899-806d-c3222f643878", "address": "fa:16:3e:4d:46:79", "network": {"id": "84bcb9a8-0292-4eed-a9eb-2a883619389c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1655598964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fa05294c527426383c66fe58b31c825", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63e3a2a2-51", "ovs_interfaceid": "63e3a2a2-51d4-4899-806d-c3222f643878", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 15:39:03 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-89d2a15f-e9da-4425-a768-aa428f0b8c54 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] Converting VIF {"id": "63e3a2a2-51d4-4899-806d-c3222f643878", "address": "fa:16:3e:4d:46:79", "network": {"id": "84bcb9a8-0292-4eed-a9eb-2a883619389c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1655598964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fa05294c527426383c66fe58b31c825", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63e3a2a2-51", "ovs_interfaceid": "63e3a2a2-51d4-4899-806d-c3222f643878", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:39:03 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-89d2a15f-e9da-4425-a768-aa428f0b8c54 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:46:79,bridge_name='br-int',has_traffic_filtering=True,id=63e3a2a2-51d4-4899-806d-c3222f643878,network=Network(84bcb9a8-0292-4eed-a9eb-2a883619389c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63e3a2a2-51') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:39:03 user nova-compute[75176]: DEBUG os_vif [None req-89d2a15f-e9da-4425-a768-aa428f0b8c54 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:46:79,bridge_name='br-int',has_traffic_filtering=True,id=63e3a2a2-51d4-4899-806d-c3222f643878,network=Network(84bcb9a8-0292-4eed-a9eb-2a883619389c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63e3a2a2-51') {{(pid=75176) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 15:39:03 user nova-compute[75176]: DEBUG nova.policy [None req-799d598a-9d25-4065-b2b4-8ca63b9f0ac1 tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '16ea4be4bcb34749b2f444c4694543b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c2fe6bf5e4f4bb3b5d50901bfac0b38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75176) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 15:39:03 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl [None req-89d2a15f-e9da-4425-a768-aa428f0b8c54 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] Created schema index Interface.name {{(pid=75176) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 28 15:39:03 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl [None req-89d2a15f-e9da-4425-a768-aa428f0b8c54 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] Created schema index Port.name {{(pid=75176) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 28 15:39:03 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl [None req-89d2a15f-e9da-4425-a768-aa428f0b8c54 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] Created schema index Bridge.name {{(pid=75176) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 28 15:39:03 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-89d2a15f-e9da-4425-a768-aa428f0b8c54 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=75176) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 15:39:03 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-89d2a15f-e9da-4425-a768-aa428f0b8c54 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] [POLLOUT] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:39:03 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-89d2a15f-e9da-4425-a768-aa428f0b8c54 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75176) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 15:39:03 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-89d2a15f-e9da-4425-a768-aa428f0b8c54 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:39:03 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-89d2a15f-e9da-4425-a768-aa428f0b8c54 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:39:03 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-89d2a15f-e9da-4425-a768-aa428f0b8c54 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:39:03 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-c6a4c2f0-2e37-40a9-8ae6-6700c2a6bc5b tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] Acquiring lock "refresh_cache-f81dc25c-3549-4e25-b27c-a75a50d9a448" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:39:03 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-c6a4c2f0-2e37-40a9-8ae6-6700c2a6bc5b tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] Acquired lock "refresh_cache-f81dc25c-3549-4e25-b27c-a75a50d9a448" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:39:03 user nova-compute[75176]: DEBUG nova.network.neutron [None req-c6a4c2f0-2e37-40a9-8ae6-6700c2a6bc5b tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] [instance: f81dc25c-3549-4e25-b27c-a75a50d9a448] Building network info cache for instance {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 15:39:03 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:39:03 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:39:03 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 15:39:03 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:39:03 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e386405e-1dc7-5731-8ab2-ab0a1259a8be', '_type': 'linux-noop'}}, row=False) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:39:03 user nova-compute[75176]: DEBUG nova.compute.manager [req-288da3b0-ceb8-4992-b37e-6ac7477cbd77 req-f2e66229-b42c-4dd7-81de-5308aa9e7617 service nova] [instance: f81dc25c-3549-4e25-b27c-a75a50d9a448] Received event network-changed-1e629a40-5a9f-4891-8148-7a2c925d8ad6 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:39:03 user nova-compute[75176]: DEBUG nova.compute.manager [req-288da3b0-ceb8-4992-b37e-6ac7477cbd77 req-f2e66229-b42c-4dd7-81de-5308aa9e7617 service nova] [instance: f81dc25c-3549-4e25-b27c-a75a50d9a448] Refreshing instance network info cache due to event network-changed-1e629a40-5a9f-4891-8148-7a2c925d8ad6. {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 15:39:03 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-288da3b0-ceb8-4992-b37e-6ac7477cbd77 req-f2e66229-b42c-4dd7-81de-5308aa9e7617 service nova] Acquiring lock "refresh_cache-f81dc25c-3549-4e25-b27c-a75a50d9a448" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:39:03 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:39:03 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:39:03 user nova-compute[75176]: INFO oslo.privsep.daemon [None req-89d2a15f-e9da-4425-a768-aa428f0b8c54 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmp_3_9ff_9/privsep.sock']
Nov 28 15:39:03 user nova-compute[75176]: DEBUG nova.compute.manager [None req-799d598a-9d25-4065-b2b4-8ca63b9f0ac1 tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] [instance: aa223c49-d254-4727-8a01-873026847b37] Start spawning the instance on the hypervisor. {{(pid=75176) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 15:39:03 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-799d598a-9d25-4065-b2b4-8ca63b9f0ac1 tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] [instance: aa223c49-d254-4727-8a01-873026847b37] Creating instance directory {{(pid=75176) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 15:39:03 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-799d598a-9d25-4065-b2b4-8ca63b9f0ac1 tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] [instance: aa223c49-d254-4727-8a01-873026847b37] Creating image(s)
Nov 28 15:39:03 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-799d598a-9d25-4065-b2b4-8ca63b9f0ac1 tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Acquiring lock "/opt/stack/data/nova/instances/aa223c49-d254-4727-8a01-873026847b37/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:39:03 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-799d598a-9d25-4065-b2b4-8ca63b9f0ac1 tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Lock "/opt/stack/data/nova/instances/aa223c49-d254-4727-8a01-873026847b37/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:39:03 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-799d598a-9d25-4065-b2b4-8ca63b9f0ac1 tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Lock "/opt/stack/data/nova/instances/aa223c49-d254-4727-8a01-873026847b37/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:39:03 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-799d598a-9d25-4065-b2b4-8ca63b9f0ac1 tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:39:04 user sudo[84506]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmp_3_9ff_9/privsep.sock
Nov 28 15:39:04 user sudo[84506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 28 15:39:04 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-799d598a-9d25-4065-b2b4-8ca63b9f0ac1 tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json" returned: 0 in 0.195s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:39:04 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-799d598a-9d25-4065-b2b4-8ca63b9f0ac1 tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Acquiring lock "5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:39:04 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-799d598a-9d25-4065-b2b4-8ca63b9f0ac1 tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Lock "5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:39:04 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-799d598a-9d25-4065-b2b4-8ca63b9f0ac1 tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:39:04 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-377db1ae-fa70-4b36-8805-999b6c30f077 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Acquiring lock "2e8507b7-fccf-4196-b589-bf2b74f165ec" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:39:04 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-377db1ae-fa70-4b36-8805-999b6c30f077 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Lock "2e8507b7-fccf-4196-b589-bf2b74f165ec" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:39:04 user nova-compute[75176]: DEBUG nova.compute.manager [None req-377db1ae-fa70-4b36-8805-999b6c30f077 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] [instance: 2e8507b7-fccf-4196-b589-bf2b74f165ec] Starting instance... {{(pid=75176) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 15:39:04 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:39:04 user nova-compute[75176]: DEBUG nova.network.neutron [None req-c6a4c2f0-2e37-40a9-8ae6-6700c2a6bc5b tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] [instance: f81dc25c-3549-4e25-b27c-a75a50d9a448] Instance cache missing network info. {{(pid=75176) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 15:39:04 user nova-compute[75176]: DEBUG nova.network.neutron [req-e08666c6-5304-4abf-9efd-3057f0ea28ed req-886bb0f0-6eed-465d-a520-0349be8c9e24 service nova] [instance: 6ab0619f-72e5-4975-ade8-53d7c0784d89] Updated VIF entry in instance network info cache for port 63e3a2a2-51d4-4899-806d-c3222f643878. {{(pid=75176) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 15:39:04 user nova-compute[75176]: DEBUG nova.network.neutron [req-e08666c6-5304-4abf-9efd-3057f0ea28ed req-886bb0f0-6eed-465d-a520-0349be8c9e24 service nova] [instance: 6ab0619f-72e5-4975-ade8-53d7c0784d89] Updating instance_info_cache with network_info: [{"id": "63e3a2a2-51d4-4899-806d-c3222f643878", "address": "fa:16:3e:4d:46:79", "network": {"id": "84bcb9a8-0292-4eed-a9eb-2a883619389c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1655598964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fa05294c527426383c66fe58b31c825", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63e3a2a2-51", "ovs_interfaceid": "63e3a2a2-51d4-4899-806d-c3222f643878", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:39:04 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-799d598a-9d25-4065-b2b4-8ca63b9f0ac1 tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json" returned: 0 in 0.199s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:39:04 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-799d598a-9d25-4065-b2b4-8ca63b9f0ac1 tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2,backing_fmt=raw /opt/stack/data/nova/instances/aa223c49-d254-4727-8a01-873026847b37/disk 1073741824 {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:39:04 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-e08666c6-5304-4abf-9efd-3057f0ea28ed req-886bb0f0-6eed-465d-a520-0349be8c9e24 service nova] Releasing lock "refresh_cache-6ab0619f-72e5-4975-ade8-53d7c0784d89" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:39:04 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-799d598a-9d25-4065-b2b4-8ca63b9f0ac1 tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2,backing_fmt=raw /opt/stack/data/nova/instances/aa223c49-d254-4727-8a01-873026847b37/disk 1073741824" returned: 0 in 0.074s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:39:04 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-799d598a-9d25-4065-b2b4-8ca63b9f0ac1 tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Lock "5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.276s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:39:04 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-799d598a-9d25-4065-b2b4-8ca63b9f0ac1 tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:39:04 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-377db1ae-fa70-4b36-8805-999b6c30f077 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:39:04 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-377db1ae-fa70-4b36-8805-999b6c30f077 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:39:04 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-377db1ae-fa70-4b36-8805-999b6c30f077 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75176) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 15:39:04 user nova-compute[75176]: INFO nova.compute.claims [None req-377db1ae-fa70-4b36-8805-999b6c30f077 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] [instance: 2e8507b7-fccf-4196-b589-bf2b74f165ec] Claim successful on node user
Nov 28 15:39:04 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-799d598a-9d25-4065-b2b4-8ca63b9f0ac1 tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json" returned: 0 in 0.218s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:39:04 user nova-compute[75176]: DEBUG nova.virt.disk.api [None req-799d598a-9d25-4065-b2b4-8ca63b9f0ac1 tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Checking if we can resize image /opt/stack/data/nova/instances/aa223c49-d254-4727-8a01-873026847b37/disk. size=1073741824 {{(pid=75176) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 15:39:04 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-799d598a-9d25-4065-b2b4-8ca63b9f0ac1 tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa223c49-d254-4727-8a01-873026847b37/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:39:04 user nova-compute[75176]: DEBUG nova.network.neutron [None req-799d598a-9d25-4065-b2b4-8ca63b9f0ac1 tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] [instance: aa223c49-d254-4727-8a01-873026847b37] Successfully created port: 6514aeb6-8ea4-4a27-a54b-32f650c87957 {{(pid=75176) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 15:39:04 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-799d598a-9d25-4065-b2b4-8ca63b9f0ac1 tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa223c49-d254-4727-8a01-873026847b37/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:39:04 user nova-compute[75176]: DEBUG nova.virt.disk.api [None req-799d598a-9d25-4065-b2b4-8ca63b9f0ac1 tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Cannot resize image /opt/stack/data/nova/instances/aa223c49-d254-4727-8a01-873026847b37/disk to a smaller size. {{(pid=75176) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 15:39:04 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-799d598a-9d25-4065-b2b4-8ca63b9f0ac1 tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] [instance: aa223c49-d254-4727-8a01-873026847b37] Created local disks {{(pid=75176) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 15:39:04 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-799d598a-9d25-4065-b2b4-8ca63b9f0ac1 tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] [instance: aa223c49-d254-4727-8a01-873026847b37] Ensure instance console log exists: /opt/stack/data/nova/instances/aa223c49-d254-4727-8a01-873026847b37/console.log {{(pid=75176) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 15:39:04 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-799d598a-9d25-4065-b2b4-8ca63b9f0ac1 tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:39:04 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-799d598a-9d25-4065-b2b4-8ca63b9f0ac1 tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:39:04 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-799d598a-9d25-4065-b2b4-8ca63b9f0ac1 tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:39:04 user nova-compute[75176]: DEBUG nova.compute.provider_tree [None req-377db1ae-fa70-4b36-8805-999b6c30f077 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Inventory has not changed in ProviderTree for provider: b37848d8-f401-4155-a029-b0ffa09ff85b {{(pid=75176) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 15:39:04 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-377db1ae-fa70-4b36-8805-999b6c30f077 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Inventory has not changed for provider b37848d8-f401-4155-a029-b0ffa09ff85b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75176) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 15:39:04 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-377db1ae-fa70-4b36-8805-999b6c30f077 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.457s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:39:04 user nova-compute[75176]: DEBUG nova.compute.manager [None req-377db1ae-fa70-4b36-8805-999b6c30f077 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] [instance: 2e8507b7-fccf-4196-b589-bf2b74f165ec] Start building networks asynchronously for instance. {{(pid=75176) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 15:39:05 user nova-compute[75176]: DEBUG nova.compute.manager [None req-377db1ae-fa70-4b36-8805-999b6c30f077 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] [instance: 2e8507b7-fccf-4196-b589-bf2b74f165ec] Allocating IP information in the background. {{(pid=75176) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 15:39:05 user nova-compute[75176]: DEBUG nova.network.neutron [None req-377db1ae-fa70-4b36-8805-999b6c30f077 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] [instance: 2e8507b7-fccf-4196-b589-bf2b74f165ec] allocate_for_instance() {{(pid=75176) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 15:39:05 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-377db1ae-fa70-4b36-8805-999b6c30f077 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] [instance: 2e8507b7-fccf-4196-b589-bf2b74f165ec] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 15:39:05 user nova-compute[75176]: DEBUG nova.compute.manager [None req-377db1ae-fa70-4b36-8805-999b6c30f077 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] [instance: 2e8507b7-fccf-4196-b589-bf2b74f165ec] Start building block device mappings for instance. {{(pid=75176) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 15:39:05 user nova-compute[75176]: DEBUG nova.compute.manager [None req-377db1ae-fa70-4b36-8805-999b6c30f077 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] [instance: 2e8507b7-fccf-4196-b589-bf2b74f165ec] Start spawning the instance on the hypervisor. {{(pid=75176) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 15:39:05 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-377db1ae-fa70-4b36-8805-999b6c30f077 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] [instance: 2e8507b7-fccf-4196-b589-bf2b74f165ec] Creating instance directory {{(pid=75176) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 15:39:05 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-377db1ae-fa70-4b36-8805-999b6c30f077 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] [instance: 2e8507b7-fccf-4196-b589-bf2b74f165ec] Creating image(s)
Nov 28 15:39:05 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-377db1ae-fa70-4b36-8805-999b6c30f077 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Acquiring lock "/opt/stack/data/nova/instances/2e8507b7-fccf-4196-b589-bf2b74f165ec/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:39:05 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-377db1ae-fa70-4b36-8805-999b6c30f077 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Lock "/opt/stack/data/nova/instances/2e8507b7-fccf-4196-b589-bf2b74f165ec/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:39:05 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-377db1ae-fa70-4b36-8805-999b6c30f077 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Lock "/opt/stack/data/nova/instances/2e8507b7-fccf-4196-b589-bf2b74f165ec/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:39:05 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-377db1ae-fa70-4b36-8805-999b6c30f077 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:39:05 user sudo[84506]: pam_unix(sudo:session): session closed for user root
Nov 28 15:39:05 user nova-compute[75176]: INFO oslo.privsep.daemon [None req-89d2a15f-e9da-4425-a768-aa428f0b8c54 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] Spawned new privsep daemon via rootwrap
Nov 28 15:39:05 user nova-compute[75176]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 28 15:39:05 user nova-compute[75176]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 28 15:39:05 user nova-compute[75176]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Nov 28 15:39:05 user nova-compute[75176]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84526
Nov 28 15:39:05 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-377db1ae-fa70-4b36-8805-999b6c30f077 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json" returned: 0 in 0.185s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:39:05 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-377db1ae-fa70-4b36-8805-999b6c30f077 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Acquiring lock "5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:39:05 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-377db1ae-fa70-4b36-8805-999b6c30f077 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Lock "5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:39:05 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-377db1ae-fa70-4b36-8805-999b6c30f077 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:39:05 user nova-compute[75176]: DEBUG nova.network.neutron [None req-c6a4c2f0-2e37-40a9-8ae6-6700c2a6bc5b tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] [instance: f81dc25c-3549-4e25-b27c-a75a50d9a448] Updating instance_info_cache with network_info: [{"id": "1e629a40-5a9f-4891-8148-7a2c925d8ad6", "address": "fa:16:3e:3f:fc:84", "network": {"id": "6e9a90b3-cbe8-4d24-a96b-78e5a8a588f0", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-468656063-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81856f8d465d408bbb6b0fbfe4dd2fa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e629a40-5a", "ovs_interfaceid": "1e629a40-5a9f-4891-8148-7a2c925d8ad6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:39:05 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-c6a4c2f0-2e37-40a9-8ae6-6700c2a6bc5b tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] Releasing lock "refresh_cache-f81dc25c-3549-4e25-b27c-a75a50d9a448" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:39:05 user nova-compute[75176]: DEBUG nova.compute.manager [None req-c6a4c2f0-2e37-40a9-8ae6-6700c2a6bc5b tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] [instance: f81dc25c-3549-4e25-b27c-a75a50d9a448] Instance network_info: |[{"id": "1e629a40-5a9f-4891-8148-7a2c925d8ad6", "address": "fa:16:3e:3f:fc:84", "network": {"id": "6e9a90b3-cbe8-4d24-a96b-78e5a8a588f0", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-468656063-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81856f8d465d408bbb6b0fbfe4dd2fa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e629a40-5a", "ovs_interfaceid": "1e629a40-5a9f-4891-8148-7a2c925d8ad6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75176) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 15:39:05 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-288da3b0-ceb8-4992-b37e-6ac7477cbd77 req-f2e66229-b42c-4dd7-81de-5308aa9e7617 service nova] Acquired lock "refresh_cache-f81dc25c-3549-4e25-b27c-a75a50d9a448" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:39:05 user nova-compute[75176]: DEBUG nova.network.neutron [req-288da3b0-ceb8-4992-b37e-6ac7477cbd77 req-f2e66229-b42c-4dd7-81de-5308aa9e7617 service nova] [instance: f81dc25c-3549-4e25-b27c-a75a50d9a448] Refreshing network info cache for port 1e629a40-5a9f-4891-8148-7a2c925d8ad6 {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 15:39:05 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-c6a4c2f0-2e37-40a9-8ae6-6700c2a6bc5b tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] [instance: f81dc25c-3549-4e25-b27c-a75a50d9a448] Start _get_guest_xml network_info=[{"id": "1e629a40-5a9f-4891-8148-7a2c925d8ad6", "address": "fa:16:3e:3f:fc:84", "network": {"id": "6e9a90b3-cbe8-4d24-a96b-78e5a8a588f0", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-468656063-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81856f8d465d408bbb6b0fbfe4dd2fa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e629a40-5a", "ovs_interfaceid": "1e629a40-5a9f-4891-8148-7a2c925d8ad6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T15:35:12Z,direct_url=<?>,disk_format='qcow2',id=1f41819e-c93f-4dc7-b253-37a27bbbbc74,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1b91c5d0672c4224a48df2e1f92688e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T15:35:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'size': 0, 'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'image_id': '1f41819e-c93f-4dc7-b253-37a27bbbbc74'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75176) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 15:39:05 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-c6a4c2f0-2e37-40a9-8ae6-6700c2a6bc5b tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 15:39:05 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-c6a4c2f0-2e37-40a9-8ae6-6700c2a6bc5b tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 15:39:05 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-c6a4c2f0-2e37-40a9-8ae6-6700c2a6bc5b tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75176) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 15:39:05 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-c6a4c2f0-2e37-40a9-8ae6-6700c2a6bc5b tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] CPU controller missing on host. {{(pid=75176) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 15:39:05 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-c6a4c2f0-2e37-40a9-8ae6-6700c2a6bc5b tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75176) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 15:39:05 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-c6a4c2f0-2e37-40a9-8ae6-6700c2a6bc5b tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] CPU controller found on host. {{(pid=75176) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 15:39:05 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-c6a4c2f0-2e37-40a9-8ae6-6700c2a6bc5b tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75176) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 15:39:05 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-c6a4c2f0-2e37-40a9-8ae6-6700c2a6bc5b tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T15:35:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T15:35:12Z,direct_url=<?>,disk_format='qcow2',id=1f41819e-c93f-4dc7-b253-37a27bbbbc74,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1b91c5d0672c4224a48df2e1f92688e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T15:35:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 15:39:05 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-c6a4c2f0-2e37-40a9-8ae6-6700c2a6bc5b tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] Flavor limits 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 15:39:05 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-c6a4c2f0-2e37-40a9-8ae6-6700c2a6bc5b tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] Image limits 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 15:39:05 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-c6a4c2f0-2e37-40a9-8ae6-6700c2a6bc5b tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] Flavor pref 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 15:39:05 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-c6a4c2f0-2e37-40a9-8ae6-6700c2a6bc5b tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] Image pref 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 15:39:05 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-c6a4c2f0-2e37-40a9-8ae6-6700c2a6bc5b tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 15:39:05 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-c6a4c2f0-2e37-40a9-8ae6-6700c2a6bc5b tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 15:39:05 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-c6a4c2f0-2e37-40a9-8ae6-6700c2a6bc5b tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75176) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 15:39:05 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-c6a4c2f0-2e37-40a9-8ae6-6700c2a6bc5b tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] Got 1 possible topologies {{(pid=75176) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 15:39:05 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-c6a4c2f0-2e37-40a9-8ae6-6700c2a6bc5b tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 15:39:05 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-c6a4c2f0-2e37-40a9-8ae6-6700c2a6bc5b tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 15:39:05 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-c6a4c2f0-2e37-40a9-8ae6-6700c2a6bc5b tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T15:38:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1200169567',display_name='tempest-DeleteServersTestJSON-server-1200169567',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1200169567',id=1,image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='81856f8d465d408bbb6b0fbfe4dd2fa4',ramdisk_id='',reservation_id='r-2mqgb6gs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-982919505',owner_user_name='tempest-DeleteServersTestJSON-982919505-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T15:38:56Z,user_data=None,user_id='bb8e82f7d5d54c2394e87bb268ce9434',uuid=f81dc25c-3549-4e25-b27c-a75a50d9a448,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1e629a40-5a9f-4891-8148-7a2c925d8ad6", "address": "fa:16:3e:3f:fc:84", "network": {"id": "6e9a90b3-cbe8-4d24-a96b-78e5a8a588f0", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-468656063-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81856f8d465d408bbb6b0fbfe4dd2fa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e629a40-5a", "ovs_interfaceid": "1e629a40-5a9f-4891-8148-7a2c925d8ad6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75176) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 15:39:05 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-c6a4c2f0-2e37-40a9-8ae6-6700c2a6bc5b tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] Converting VIF {"id": "1e629a40-5a9f-4891-8148-7a2c925d8ad6", "address": "fa:16:3e:3f:fc:84", "network": {"id": "6e9a90b3-cbe8-4d24-a96b-78e5a8a588f0", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-468656063-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81856f8d465d408bbb6b0fbfe4dd2fa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e629a40-5a", "ovs_interfaceid": "1e629a40-5a9f-4891-8148-7a2c925d8ad6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:39:05 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-c6a4c2f0-2e37-40a9-8ae6-6700c2a6bc5b tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:fc:84,bridge_name='br-int',has_traffic_filtering=True,id=1e629a40-5a9f-4891-8148-7a2c925d8ad6,network=Network(6e9a90b3-cbe8-4d24-a96b-78e5a8a588f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e629a40-5a') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:39:05 user nova-compute[75176]: DEBUG nova.objects.instance [None req-c6a4c2f0-2e37-40a9-8ae6-6700c2a6bc5b tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] Lazy-loading 'pci_devices' on Instance uuid f81dc25c-3549-4e25-b27c-a75a50d9a448 {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:39:05 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-c6a4c2f0-2e37-40a9-8ae6-6700c2a6bc5b tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] [instance: f81dc25c-3549-4e25-b27c-a75a50d9a448] End _get_guest_xml xml=<domain type="kvm">
Nov 28 15:39:05 user nova-compute[75176]:   <uuid>f81dc25c-3549-4e25-b27c-a75a50d9a448</uuid>
Nov 28 15:39:05 user nova-compute[75176]:   <name>instance-00000001</name>
Nov 28 15:39:05 user nova-compute[75176]:   <memory>524288</memory>
Nov 28 15:39:05 user nova-compute[75176]:   <vcpu>1</vcpu>
Nov 28 15:39:05 user nova-compute[75176]:   <metadata>
Nov 28 15:39:05 user nova-compute[75176]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 15:39:05 user nova-compute[75176]:       <nova:package version="0.0.0"/>
Nov 28 15:39:05 user nova-compute[75176]:       <nova:name>tempest-DeleteServersTestJSON-server-1200169567</nova:name>
Nov 28 15:39:05 user nova-compute[75176]:       <nova:creationTime>2023-11-28 15:39:05</nova:creationTime>
Nov 28 15:39:05 user nova-compute[75176]:       <nova:flavor name="m1.tiny">
Nov 28 15:39:05 user nova-compute[75176]:         <nova:memory>512</nova:memory>
Nov 28 15:39:05 user nova-compute[75176]:         <nova:disk>1</nova:disk>
Nov 28 15:39:05 user nova-compute[75176]:         <nova:swap>0</nova:swap>
Nov 28 15:39:05 user nova-compute[75176]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 15:39:05 user nova-compute[75176]:         <nova:vcpus>1</nova:vcpus>
Nov 28 15:39:05 user nova-compute[75176]:       </nova:flavor>
Nov 28 15:39:05 user nova-compute[75176]:       <nova:owner>
Nov 28 15:39:05 user nova-compute[75176]:         <nova:user uuid="bb8e82f7d5d54c2394e87bb268ce9434">tempest-DeleteServersTestJSON-982919505-project-member</nova:user>
Nov 28 15:39:05 user nova-compute[75176]:         <nova:project uuid="81856f8d465d408bbb6b0fbfe4dd2fa4">tempest-DeleteServersTestJSON-982919505</nova:project>
Nov 28 15:39:05 user nova-compute[75176]:       </nova:owner>
Nov 28 15:39:05 user nova-compute[75176]:       <nova:root type="image" uuid="1f41819e-c93f-4dc7-b253-37a27bbbbc74"/>
Nov 28 15:39:05 user nova-compute[75176]:       <nova:ports>
Nov 28 15:39:05 user nova-compute[75176]:         <nova:port uuid="1e629a40-5a9f-4891-8148-7a2c925d8ad6">
Nov 28 15:39:05 user nova-compute[75176]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 28 15:39:05 user nova-compute[75176]:         </nova:port>
Nov 28 15:39:05 user nova-compute[75176]:       </nova:ports>
Nov 28 15:39:05 user nova-compute[75176]:     </nova:instance>
Nov 28 15:39:05 user nova-compute[75176]:   </metadata>
Nov 28 15:39:05 user nova-compute[75176]:   <sysinfo type="smbios">
Nov 28 15:39:05 user nova-compute[75176]:     <system>
Nov 28 15:39:05 user nova-compute[75176]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 15:39:05 user nova-compute[75176]:       <entry name="product">OpenStack Nova</entry>
Nov 28 15:39:05 user nova-compute[75176]:       <entry name="version">0.0.0</entry>
Nov 28 15:39:05 user nova-compute[75176]:       <entry name="serial">f81dc25c-3549-4e25-b27c-a75a50d9a448</entry>
Nov 28 15:39:05 user nova-compute[75176]:       <entry name="uuid">f81dc25c-3549-4e25-b27c-a75a50d9a448</entry>
Nov 28 15:39:05 user nova-compute[75176]:       <entry name="family">Virtual Machine</entry>
Nov 28 15:39:05 user nova-compute[75176]:     </system>
Nov 28 15:39:05 user nova-compute[75176]:   </sysinfo>
Nov 28 15:39:05 user nova-compute[75176]:   <os>
Nov 28 15:39:05 user nova-compute[75176]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 15:39:05 user nova-compute[75176]:     <boot dev="hd"/>
Nov 28 15:39:05 user nova-compute[75176]:     <smbios mode="sysinfo"/>
Nov 28 15:39:05 user nova-compute[75176]:   </os>
Nov 28 15:39:05 user nova-compute[75176]:   <features>
Nov 28 15:39:05 user nova-compute[75176]:     <acpi/>
Nov 28 15:39:05 user nova-compute[75176]:     <apic/>
Nov 28 15:39:05 user nova-compute[75176]:     <vmcoreinfo/>
Nov 28 15:39:05 user nova-compute[75176]:   </features>
Nov 28 15:39:05 user nova-compute[75176]:   <clock offset="utc">
Nov 28 15:39:05 user nova-compute[75176]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 15:39:05 user nova-compute[75176]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 15:39:05 user nova-compute[75176]:     <timer name="hpet" present="no"/>
Nov 28 15:39:05 user nova-compute[75176]:   </clock>
Nov 28 15:39:05 user nova-compute[75176]:   <cpu mode="custom" match="exact">
Nov 28 15:39:05 user nova-compute[75176]:     <model>Nehalem</model>
Nov 28 15:39:05 user nova-compute[75176]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 15:39:05 user nova-compute[75176]:   </cpu>
Nov 28 15:39:05 user nova-compute[75176]:   <devices>
Nov 28 15:39:05 user nova-compute[75176]:     <disk type="file" device="disk">
Nov 28 15:39:05 user nova-compute[75176]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 15:39:05 user nova-compute[75176]:       <source file="/opt/stack/data/nova/instances/f81dc25c-3549-4e25-b27c-a75a50d9a448/disk"/>
Nov 28 15:39:05 user nova-compute[75176]:       <target dev="vda" bus="virtio"/>
Nov 28 15:39:05 user nova-compute[75176]:     </disk>
Nov 28 15:39:05 user nova-compute[75176]:     <interface type="ethernet">
Nov 28 15:39:05 user nova-compute[75176]:       <mac address="fa:16:3e:3f:fc:84"/>
Nov 28 15:39:05 user nova-compute[75176]:       <model type="virtio"/>
Nov 28 15:39:05 user nova-compute[75176]:       <mtu size="1442"/>
Nov 28 15:39:05 user nova-compute[75176]:       <target dev="tap1e629a40-5a"/>
Nov 28 15:39:05 user nova-compute[75176]:     </interface>
Nov 28 15:39:05 user nova-compute[75176]:     <serial type="pty">
Nov 28 15:39:05 user nova-compute[75176]:       <log file="/opt/stack/data/nova/instances/f81dc25c-3549-4e25-b27c-a75a50d9a448/console.log" append="off"/>
Nov 28 15:39:05 user nova-compute[75176]:     </serial>
Nov 28 15:39:05 user nova-compute[75176]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 15:39:05 user nova-compute[75176]:     <video>
Nov 28 15:39:05 user nova-compute[75176]:       <model type="virtio"/>
Nov 28 15:39:05 user nova-compute[75176]:     </video>
Nov 28 15:39:05 user nova-compute[75176]:     <rng model="virtio">
Nov 28 15:39:05 user nova-compute[75176]:       <backend model="random">/dev/urandom</backend>
Nov 28 15:39:05 user nova-compute[75176]:     </rng>
Nov 28 15:39:05 user nova-compute[75176]:     <controller type="usb" index="0" model="none"/>
Nov 28 15:39:05 user nova-compute[75176]:     <memballoon model="virtio">
Nov 28 15:39:05 user nova-compute[75176]:       <stats period="10"/>
Nov 28 15:39:05 user nova-compute[75176]:     </memballoon>
Nov 28 15:39:05 user nova-compute[75176]:   </devices>
Nov 28 15:39:05 user nova-compute[75176]: </domain>
Nov 28 15:39:05 user nova-compute[75176]:  {{(pid=75176) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 15:39:05 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-c6a4c2f0-2e37-40a9-8ae6-6700c2a6bc5b tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T15:38:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1200169567',display_name='tempest-DeleteServersTestJSON-server-1200169567',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1200169567',id=1,image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='81856f8d465d408bbb6b0fbfe4dd2fa4',ramdisk_id='',reservation_id='r-2mqgb6gs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-982919505',owner_user_name='tempest-DeleteServersTestJSON-982919505-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T15:38:56Z,user_data=None,user_id='bb8e82f7d5d54c2394e87bb268ce9434',uuid=f81dc25c-3549-4e25-b27c-a75a50d9a448,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1e629a40-5a9f-4891-8148-7a2c925d8ad6", "address": "fa:16:3e:3f:fc:84", "network": {"id": "6e9a90b3-cbe8-4d24-a96b-78e5a8a588f0", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-468656063-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81856f8d465d408bbb6b0fbfe4dd2fa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e629a40-5a", "ovs_interfaceid": "1e629a40-5a9f-4891-8148-7a2c925d8ad6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 15:39:05 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-c6a4c2f0-2e37-40a9-8ae6-6700c2a6bc5b tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] Converting VIF {"id": "1e629a40-5a9f-4891-8148-7a2c925d8ad6", "address": "fa:16:3e:3f:fc:84", "network": {"id": "6e9a90b3-cbe8-4d24-a96b-78e5a8a588f0", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-468656063-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81856f8d465d408bbb6b0fbfe4dd2fa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e629a40-5a", "ovs_interfaceid": "1e629a40-5a9f-4891-8148-7a2c925d8ad6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:39:05 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-c6a4c2f0-2e37-40a9-8ae6-6700c2a6bc5b tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:fc:84,bridge_name='br-int',has_traffic_filtering=True,id=1e629a40-5a9f-4891-8148-7a2c925d8ad6,network=Network(6e9a90b3-cbe8-4d24-a96b-78e5a8a588f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e629a40-5a') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:39:05 user nova-compute[75176]: DEBUG os_vif [None req-c6a4c2f0-2e37-40a9-8ae6-6700c2a6bc5b tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:fc:84,bridge_name='br-int',has_traffic_filtering=True,id=1e629a40-5a9f-4891-8148-7a2c925d8ad6,network=Network(6e9a90b3-cbe8-4d24-a96b-78e5a8a588f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e629a40-5a') {{(pid=75176) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 15:39:05 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:39:05 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:39:05 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 15:39:05 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:39:05 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b7fcffc4-f1b4-5b2b-adb4-8830738eb077', '_type': 'linux-noop'}}, row=False) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:39:05 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:39:05 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:39:05 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-377db1ae-fa70-4b36-8805-999b6c30f077 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json" returned: 0 in 0.161s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:39:05 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-377db1ae-fa70-4b36-8805-999b6c30f077 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2,backing_fmt=raw /opt/stack/data/nova/instances/2e8507b7-fccf-4196-b589-bf2b74f165ec/disk 1073741824 {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:39:05 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-377db1ae-fa70-4b36-8805-999b6c30f077 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2,backing_fmt=raw /opt/stack/data/nova/instances/2e8507b7-fccf-4196-b589-bf2b74f165ec/disk 1073741824" returned: 0 in 0.046s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:39:05 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-377db1ae-fa70-4b36-8805-999b6c30f077 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Lock "5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.213s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:39:05 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-377db1ae-fa70-4b36-8805-999b6c30f077 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:39:05 user nova-compute[75176]: DEBUG nova.policy [None req-377db1ae-fa70-4b36-8805-999b6c30f077 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd028b79a105b485dbb0178c9da162640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3704b38a2bd44cb78c28d3f6d86d9e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75176) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 15:39:05 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-377db1ae-fa70-4b36-8805-999b6c30f077 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json" returned: 0 in 0.151s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:39:05 user nova-compute[75176]: DEBUG nova.virt.disk.api [None req-377db1ae-fa70-4b36-8805-999b6c30f077 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2e8507b7-fccf-4196-b589-bf2b74f165ec/disk. size=1073741824 {{(pid=75176) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 15:39:05 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-377db1ae-fa70-4b36-8805-999b6c30f077 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e8507b7-fccf-4196-b589-bf2b74f165ec/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:39:06 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:39:06 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap63e3a2a2-51, may_exist=True, interface_attrs={}) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:39:06 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap63e3a2a2-51, col_values=(('qos', UUID('912c8e69-876c-454c-9c72-9831d7ded501')),), if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:39:06 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap63e3a2a2-51, col_values=(('external_ids', {'iface-id': '63e3a2a2-51d4-4899-806d-c3222f643878', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4d:46:79', 'vm-uuid': '6ab0619f-72e5-4975-ade8-53d7c0784d89'}),), if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:39:06 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:39:06 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:39:06 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:39:06 user nova-compute[75176]: INFO os_vif [None req-89d2a15f-e9da-4425-a768-aa428f0b8c54 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:46:79,bridge_name='br-int',has_traffic_filtering=True,id=63e3a2a2-51d4-4899-806d-c3222f643878,network=Network(84bcb9a8-0292-4eed-a9eb-2a883619389c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63e3a2a2-51')
Nov 28 15:39:06 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:39:06 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1e629a40-5a, may_exist=True, interface_attrs={}) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:39:06 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1e629a40-5a, col_values=(('qos', UUID('e04fe7cf-8fc6-4b21-858b-4705efe4540f')),), if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:39:06 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1e629a40-5a, col_values=(('external_ids', {'iface-id': '1e629a40-5a9f-4891-8148-7a2c925d8ad6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3f:fc:84', 'vm-uuid': 'f81dc25c-3549-4e25-b27c-a75a50d9a448'}),), if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:39:06 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:39:06 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:39:06 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:39:06 user nova-compute[75176]: INFO os_vif [None req-c6a4c2f0-2e37-40a9-8ae6-6700c2a6bc5b tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:fc:84,bridge_name='br-int',has_traffic_filtering=True,id=1e629a40-5a9f-4891-8148-7a2c925d8ad6,network=Network(6e9a90b3-cbe8-4d24-a96b-78e5a8a588f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e629a40-5a')
Nov 28 15:39:06 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-377db1ae-fa70-4b36-8805-999b6c30f077 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e8507b7-fccf-4196-b589-bf2b74f165ec/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:39:06 user nova-compute[75176]: DEBUG nova.virt.disk.api [None req-377db1ae-fa70-4b36-8805-999b6c30f077 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Cannot resize image /opt/stack/data/nova/instances/2e8507b7-fccf-4196-b589-bf2b74f165ec/disk to a smaller size. {{(pid=75176) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 15:39:06 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-377db1ae-fa70-4b36-8805-999b6c30f077 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] [instance: 2e8507b7-fccf-4196-b589-bf2b74f165ec] Created local disks {{(pid=75176) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 15:39:06 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-377db1ae-fa70-4b36-8805-999b6c30f077 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] [instance: 2e8507b7-fccf-4196-b589-bf2b74f165ec] Ensure instance console log exists: /opt/stack/data/nova/instances/2e8507b7-fccf-4196-b589-bf2b74f165ec/console.log {{(pid=75176) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 15:39:06 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-377db1ae-fa70-4b36-8805-999b6c30f077 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:39:06 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-377db1ae-fa70-4b36-8805-999b6c30f077 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:39:06 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-377db1ae-fa70-4b36-8805-999b6c30f077 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:39:06 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-89d2a15f-e9da-4425-a768-aa428f0b8c54 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] No BDM found with device name vda, not building metadata. {{(pid=75176) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 15:39:06 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-89d2a15f-e9da-4425-a768-aa428f0b8c54 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] No VIF found with MAC fa:16:3e:4d:46:79, not building metadata {{(pid=75176) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 15:39:06 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-c6a4c2f0-2e37-40a9-8ae6-6700c2a6bc5b tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] No BDM found with device name vda, not building metadata. {{(pid=75176) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 15:39:06 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-c6a4c2f0-2e37-40a9-8ae6-6700c2a6bc5b tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] No VIF found with MAC fa:16:3e:3f:fc:84, not building metadata {{(pid=75176) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 15:39:06 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:39:06 user nova-compute[75176]: DEBUG nova.network.neutron [None req-799d598a-9d25-4065-b2b4-8ca63b9f0ac1 tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] [instance: aa223c49-d254-4727-8a01-873026847b37] Successfully updated port: 6514aeb6-8ea4-4a27-a54b-32f650c87957 {{(pid=75176) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 15:39:06 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-799d598a-9d25-4065-b2b4-8ca63b9f0ac1 tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Acquiring lock "refresh_cache-aa223c49-d254-4727-8a01-873026847b37" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:39:06 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-799d598a-9d25-4065-b2b4-8ca63b9f0ac1 tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Acquired lock "refresh_cache-aa223c49-d254-4727-8a01-873026847b37" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:39:06 user nova-compute[75176]: DEBUG nova.network.neutron [None req-799d598a-9d25-4065-b2b4-8ca63b9f0ac1 tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] [instance: aa223c49-d254-4727-8a01-873026847b37] Building network info cache for instance {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 15:39:07 user nova-compute[75176]: DEBUG nova.compute.manager [req-9dceac4c-b844-4eaf-a132-03f70722cc6b req-78c1dfe0-5786-4726-909d-08b6f924cb4a service nova] [instance: aa223c49-d254-4727-8a01-873026847b37] Received event network-changed-6514aeb6-8ea4-4a27-a54b-32f650c87957 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:39:07 user nova-compute[75176]: DEBUG nova.compute.manager [req-9dceac4c-b844-4eaf-a132-03f70722cc6b req-78c1dfe0-5786-4726-909d-08b6f924cb4a service nova] [instance: aa223c49-d254-4727-8a01-873026847b37] Refreshing instance network info cache due to event network-changed-6514aeb6-8ea4-4a27-a54b-32f650c87957. {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 15:39:07 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-9dceac4c-b844-4eaf-a132-03f70722cc6b req-78c1dfe0-5786-4726-909d-08b6f924cb4a service nova] Acquiring lock "refresh_cache-aa223c49-d254-4727-8a01-873026847b37" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:39:07 user nova-compute[75176]: DEBUG nova.network.neutron [None req-799d598a-9d25-4065-b2b4-8ca63b9f0ac1 tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] [instance: aa223c49-d254-4727-8a01-873026847b37] Instance cache missing network info. {{(pid=75176) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 15:39:07 user nova-compute[75176]: DEBUG nova.network.neutron [req-288da3b0-ceb8-4992-b37e-6ac7477cbd77 req-f2e66229-b42c-4dd7-81de-5308aa9e7617 service nova] [instance: f81dc25c-3549-4e25-b27c-a75a50d9a448] Updated VIF entry in instance network info cache for port 1e629a40-5a9f-4891-8148-7a2c925d8ad6. {{(pid=75176) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 15:39:07 user nova-compute[75176]: DEBUG nova.network.neutron [req-288da3b0-ceb8-4992-b37e-6ac7477cbd77 req-f2e66229-b42c-4dd7-81de-5308aa9e7617 service nova] [instance: f81dc25c-3549-4e25-b27c-a75a50d9a448] Updating instance_info_cache with network_info: [{"id": "1e629a40-5a9f-4891-8148-7a2c925d8ad6", "address": "fa:16:3e:3f:fc:84", "network": {"id": "6e9a90b3-cbe8-4d24-a96b-78e5a8a588f0", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-468656063-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81856f8d465d408bbb6b0fbfe4dd2fa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e629a40-5a", "ovs_interfaceid": "1e629a40-5a9f-4891-8148-7a2c925d8ad6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:39:07 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:39:07 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-288da3b0-ceb8-4992-b37e-6ac7477cbd77 req-f2e66229-b42c-4dd7-81de-5308aa9e7617 service nova] Releasing lock "refresh_cache-f81dc25c-3549-4e25-b27c-a75a50d9a448" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:39:07 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:39:07 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:39:07 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:39:08 user nova-compute[75176]: DEBUG nova.network.neutron [None req-799d598a-9d25-4065-b2b4-8ca63b9f0ac1 tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] [instance: aa223c49-d254-4727-8a01-873026847b37] Updating instance_info_cache with network_info: [{"id": "6514aeb6-8ea4-4a27-a54b-32f650c87957", "address": "fa:16:3e:ea:a6:1b", "network": {"id": "51708ad4-dae1-47fc-bd26-aca8c478ca04", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-279988751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c2fe6bf5e4f4bb3b5d50901bfac0b38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6514aeb6-8e", "ovs_interfaceid": "6514aeb6-8ea4-4a27-a54b-32f650c87957", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:39:08 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-799d598a-9d25-4065-b2b4-8ca63b9f0ac1 tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Releasing lock "refresh_cache-aa223c49-d254-4727-8a01-873026847b37" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:39:08 user nova-compute[75176]: DEBUG nova.compute.manager [None req-799d598a-9d25-4065-b2b4-8ca63b9f0ac1 tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] [instance: aa223c49-d254-4727-8a01-873026847b37] Instance network_info: |[{"id": "6514aeb6-8ea4-4a27-a54b-32f650c87957", "address": "fa:16:3e:ea:a6:1b", "network": {"id": "51708ad4-dae1-47fc-bd26-aca8c478ca04", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-279988751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c2fe6bf5e4f4bb3b5d50901bfac0b38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6514aeb6-8e", "ovs_interfaceid": "6514aeb6-8ea4-4a27-a54b-32f650c87957", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75176) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 15:39:08 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-9dceac4c-b844-4eaf-a132-03f70722cc6b req-78c1dfe0-5786-4726-909d-08b6f924cb4a service nova] Acquired lock "refresh_cache-aa223c49-d254-4727-8a01-873026847b37" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:39:08 user nova-compute[75176]: DEBUG nova.network.neutron [req-9dceac4c-b844-4eaf-a132-03f70722cc6b req-78c1dfe0-5786-4726-909d-08b6f924cb4a service nova] [instance: aa223c49-d254-4727-8a01-873026847b37] Refreshing network info cache for port 6514aeb6-8ea4-4a27-a54b-32f650c87957 {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 15:39:08 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-799d598a-9d25-4065-b2b4-8ca63b9f0ac1 tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] [instance: aa223c49-d254-4727-8a01-873026847b37] Start _get_guest_xml network_info=[{"id": "6514aeb6-8ea4-4a27-a54b-32f650c87957", "address": "fa:16:3e:ea:a6:1b", "network": {"id": "51708ad4-dae1-47fc-bd26-aca8c478ca04", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-279988751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c2fe6bf5e4f4bb3b5d50901bfac0b38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6514aeb6-8e", "ovs_interfaceid": "6514aeb6-8ea4-4a27-a54b-32f650c87957", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T15:35:12Z,direct_url=<?>,disk_format='qcow2',id=1f41819e-c93f-4dc7-b253-37a27bbbbc74,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1b91c5d0672c4224a48df2e1f92688e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T15:35:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'size': 0, 'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'image_id': '1f41819e-c93f-4dc7-b253-37a27bbbbc74'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75176) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 15:39:08 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-799d598a-9d25-4065-b2b4-8ca63b9f0ac1 tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 15:39:08 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-799d598a-9d25-4065-b2b4-8ca63b9f0ac1 tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 15:39:08 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-799d598a-9d25-4065-b2b4-8ca63b9f0ac1 tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75176) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 15:39:08 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-799d598a-9d25-4065-b2b4-8ca63b9f0ac1 tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] CPU controller missing on host. {{(pid=75176) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 15:39:08 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-799d598a-9d25-4065-b2b4-8ca63b9f0ac1 tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75176) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 15:39:08 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-799d598a-9d25-4065-b2b4-8ca63b9f0ac1 tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] CPU controller found on host. {{(pid=75176) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 15:39:08 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-799d598a-9d25-4065-b2b4-8ca63b9f0ac1 tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75176) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 15:39:08 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-799d598a-9d25-4065-b2b4-8ca63b9f0ac1 tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T15:35:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T15:35:12Z,direct_url=<?>,disk_format='qcow2',id=1f41819e-c93f-4dc7-b253-37a27bbbbc74,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1b91c5d0672c4224a48df2e1f92688e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T15:35:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 15:39:08 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-799d598a-9d25-4065-b2b4-8ca63b9f0ac1 tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Flavor limits 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 15:39:08 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-799d598a-9d25-4065-b2b4-8ca63b9f0ac1 tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Image limits 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 15:39:08 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-799d598a-9d25-4065-b2b4-8ca63b9f0ac1 tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Flavor pref 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 15:39:08 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-799d598a-9d25-4065-b2b4-8ca63b9f0ac1 tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Image pref 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 15:39:08 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-799d598a-9d25-4065-b2b4-8ca63b9f0ac1 tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 15:39:08 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-799d598a-9d25-4065-b2b4-8ca63b9f0ac1 tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 15:39:08 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-799d598a-9d25-4065-b2b4-8ca63b9f0ac1 tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75176) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 15:39:08 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-799d598a-9d25-4065-b2b4-8ca63b9f0ac1 tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Got 1 possible topologies {{(pid=75176) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 15:39:08 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-799d598a-9d25-4065-b2b4-8ca63b9f0ac1 tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 15:39:08 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-799d598a-9d25-4065-b2b4-8ca63b9f0ac1 tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 15:39:08 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-799d598a-9d25-4065-b2b4-8ca63b9f0ac1 tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T15:39:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-595327070',display_name='tempest-ServerActionsTestOtherB-server-595327070',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-595327070',id=3,image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG46aaldZ31/SMomPHuTDQH3UTedHGSV4iG8fWtpOqqr4Cywzy71R0Ov1C6XRnOo4sYKyOfCcRfklnh+MSVYzyKoTfjcvtFT0nSQtOBIOaQ8vVTuyCcNwyJ0nmpmqFlJng==',key_name='tempest-keypair-1738862822',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4c2fe6bf5e4f4bb3b5d50901bfac0b38',ramdisk_id='',reservation_id='r-k1by7x80',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-935995346',owner_user_name='tempest-ServerActionsTestOtherB-935995346-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T15:39:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='16ea4be4bcb34749b2f444c4694543b1',uuid=aa223c49-d254-4727-8a01-873026847b37,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6514aeb6-8ea4-4a27-a54b-32f650c87957", "address": "fa:16:3e:ea:a6:1b", "network": {"id": "51708ad4-dae1-47fc-bd26-aca8c478ca04", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-279988751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c2fe6bf5e4f4bb3b5d50901bfac0b38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6514aeb6-8e", "ovs_interfaceid": "6514aeb6-8ea4-4a27-a54b-32f650c87957", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75176) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 15:39:08 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-799d598a-9d25-4065-b2b4-8ca63b9f0ac1 tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Converting VIF {"id": "6514aeb6-8ea4-4a27-a54b-32f650c87957", "address": "fa:16:3e:ea:a6:1b", "network": {"id": "51708ad4-dae1-47fc-bd26-aca8c478ca04", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-279988751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c2fe6bf5e4f4bb3b5d50901bfac0b38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6514aeb6-8e", "ovs_interfaceid": "6514aeb6-8ea4-4a27-a54b-32f650c87957", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:39:08 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-799d598a-9d25-4065-b2b4-8ca63b9f0ac1 tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:a6:1b,bridge_name='br-int',has_traffic_filtering=True,id=6514aeb6-8ea4-4a27-a54b-32f650c87957,network=Network(51708ad4-dae1-47fc-bd26-aca8c478ca04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6514aeb6-8e') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:39:08 user nova-compute[75176]: DEBUG nova.objects.instance [None req-799d598a-9d25-4065-b2b4-8ca63b9f0ac1 tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Lazy-loading 'pci_devices' on Instance uuid aa223c49-d254-4727-8a01-873026847b37 {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:39:08 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-799d598a-9d25-4065-b2b4-8ca63b9f0ac1 tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] [instance: aa223c49-d254-4727-8a01-873026847b37] End _get_guest_xml xml=<domain type="kvm">
Nov 28 15:39:08 user nova-compute[75176]:   <uuid>aa223c49-d254-4727-8a01-873026847b37</uuid>
Nov 28 15:39:08 user nova-compute[75176]:   <name>instance-00000003</name>
Nov 28 15:39:08 user nova-compute[75176]:   <memory>524288</memory>
Nov 28 15:39:08 user nova-compute[75176]:   <vcpu>1</vcpu>
Nov 28 15:39:08 user nova-compute[75176]:   <metadata>
Nov 28 15:39:08 user nova-compute[75176]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 15:39:08 user nova-compute[75176]:       <nova:package version="0.0.0"/>
Nov 28 15:39:08 user nova-compute[75176]:       <nova:name>tempest-ServerActionsTestOtherB-server-595327070</nova:name>
Nov 28 15:39:08 user nova-compute[75176]:       <nova:creationTime>2023-11-28 15:39:08</nova:creationTime>
Nov 28 15:39:08 user nova-compute[75176]:       <nova:flavor name="m1.tiny">
Nov 28 15:39:08 user nova-compute[75176]:         <nova:memory>512</nova:memory>
Nov 28 15:39:08 user nova-compute[75176]:         <nova:disk>1</nova:disk>
Nov 28 15:39:08 user nova-compute[75176]:         <nova:swap>0</nova:swap>
Nov 28 15:39:08 user nova-compute[75176]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 15:39:08 user nova-compute[75176]:         <nova:vcpus>1</nova:vcpus>
Nov 28 15:39:08 user nova-compute[75176]:       </nova:flavor>
Nov 28 15:39:08 user nova-compute[75176]:       <nova:owner>
Nov 28 15:39:08 user nova-compute[75176]:         <nova:user uuid="16ea4be4bcb34749b2f444c4694543b1">tempest-ServerActionsTestOtherB-935995346-project-member</nova:user>
Nov 28 15:39:08 user nova-compute[75176]:         <nova:project uuid="4c2fe6bf5e4f4bb3b5d50901bfac0b38">tempest-ServerActionsTestOtherB-935995346</nova:project>
Nov 28 15:39:08 user nova-compute[75176]:       </nova:owner>
Nov 28 15:39:08 user nova-compute[75176]:       <nova:root type="image" uuid="1f41819e-c93f-4dc7-b253-37a27bbbbc74"/>
Nov 28 15:39:08 user nova-compute[75176]:       <nova:ports>
Nov 28 15:39:08 user nova-compute[75176]:         <nova:port uuid="6514aeb6-8ea4-4a27-a54b-32f650c87957">
Nov 28 15:39:08 user nova-compute[75176]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 28 15:39:08 user nova-compute[75176]:         </nova:port>
Nov 28 15:39:08 user nova-compute[75176]:       </nova:ports>
Nov 28 15:39:08 user nova-compute[75176]:     </nova:instance>
Nov 28 15:39:08 user nova-compute[75176]:   </metadata>
Nov 28 15:39:08 user nova-compute[75176]:   <sysinfo type="smbios">
Nov 28 15:39:08 user nova-compute[75176]:     <system>
Nov 28 15:39:08 user nova-compute[75176]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 15:39:08 user nova-compute[75176]:       <entry name="product">OpenStack Nova</entry>
Nov 28 15:39:08 user nova-compute[75176]:       <entry name="version">0.0.0</entry>
Nov 28 15:39:08 user nova-compute[75176]:       <entry name="serial">aa223c49-d254-4727-8a01-873026847b37</entry>
Nov 28 15:39:08 user nova-compute[75176]:       <entry name="uuid">aa223c49-d254-4727-8a01-873026847b37</entry>
Nov 28 15:39:08 user nova-compute[75176]:       <entry name="family">Virtual Machine</entry>
Nov 28 15:39:08 user nova-compute[75176]:     </system>
Nov 28 15:39:08 user nova-compute[75176]:   </sysinfo>
Nov 28 15:39:08 user nova-compute[75176]:   <os>
Nov 28 15:39:08 user nova-compute[75176]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 15:39:08 user nova-compute[75176]:     <boot dev="hd"/>
Nov 28 15:39:08 user nova-compute[75176]:     <smbios mode="sysinfo"/>
Nov 28 15:39:08 user nova-compute[75176]:   </os>
Nov 28 15:39:08 user nova-compute[75176]:   <features>
Nov 28 15:39:08 user nova-compute[75176]:     <acpi/>
Nov 28 15:39:08 user nova-compute[75176]:     <apic/>
Nov 28 15:39:08 user nova-compute[75176]:     <vmcoreinfo/>
Nov 28 15:39:08 user nova-compute[75176]:   </features>
Nov 28 15:39:08 user nova-compute[75176]:   <clock offset="utc">
Nov 28 15:39:08 user nova-compute[75176]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 15:39:08 user nova-compute[75176]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 15:39:08 user nova-compute[75176]:     <timer name="hpet" present="no"/>
Nov 28 15:39:08 user nova-compute[75176]:   </clock>
Nov 28 15:39:08 user nova-compute[75176]:   <cpu mode="custom" match="exact">
Nov 28 15:39:08 user nova-compute[75176]:     <model>Nehalem</model>
Nov 28 15:39:08 user nova-compute[75176]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 15:39:08 user nova-compute[75176]:   </cpu>
Nov 28 15:39:08 user nova-compute[75176]:   <devices>
Nov 28 15:39:08 user nova-compute[75176]:     <disk type="file" device="disk">
Nov 28 15:39:08 user nova-compute[75176]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 15:39:08 user nova-compute[75176]:       <source file="/opt/stack/data/nova/instances/aa223c49-d254-4727-8a01-873026847b37/disk"/>
Nov 28 15:39:08 user nova-compute[75176]:       <target dev="vda" bus="virtio"/>
Nov 28 15:39:08 user nova-compute[75176]:     </disk>
Nov 28 15:39:08 user nova-compute[75176]:     <interface type="ethernet">
Nov 28 15:39:08 user nova-compute[75176]:       <mac address="fa:16:3e:ea:a6:1b"/>
Nov 28 15:39:08 user nova-compute[75176]:       <model type="virtio"/>
Nov 28 15:39:08 user nova-compute[75176]:       <mtu size="1442"/>
Nov 28 15:39:08 user nova-compute[75176]:       <target dev="tap6514aeb6-8e"/>
Nov 28 15:39:08 user nova-compute[75176]:     </interface>
Nov 28 15:39:08 user nova-compute[75176]:     <serial type="pty">
Nov 28 15:39:08 user nova-compute[75176]:       <log file="/opt/stack/data/nova/instances/aa223c49-d254-4727-8a01-873026847b37/console.log" append="off"/>
Nov 28 15:39:08 user nova-compute[75176]:     </serial>
Nov 28 15:39:08 user nova-compute[75176]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 15:39:08 user nova-compute[75176]:     <video>
Nov 28 15:39:08 user nova-compute[75176]:       <model type="virtio"/>
Nov 28 15:39:08 user nova-compute[75176]:     </video>
Nov 28 15:39:08 user nova-compute[75176]:     <rng model="virtio">
Nov 28 15:39:08 user nova-compute[75176]:       <backend model="random">/dev/urandom</backend>
Nov 28 15:39:08 user nova-compute[75176]:     </rng>
Nov 28 15:39:08 user nova-compute[75176]:     <controller type="usb" index="0" model="none"/>
Nov 28 15:39:08 user nova-compute[75176]:     <memballoon model="virtio">
Nov 28 15:39:08 user nova-compute[75176]:       <stats period="10"/>
Nov 28 15:39:08 user nova-compute[75176]:     </memballoon>
Nov 28 15:39:08 user nova-compute[75176]:   </devices>
Nov 28 15:39:08 user nova-compute[75176]: </domain>
Nov 28 15:39:08 user nova-compute[75176]:  {{(pid=75176) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 15:39:08 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-799d598a-9d25-4065-b2b4-8ca63b9f0ac1 tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T15:39:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-595327070',display_name='tempest-ServerActionsTestOtherB-server-595327070',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-595327070',id=3,image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG46aaldZ31/SMomPHuTDQH3UTedHGSV4iG8fWtpOqqr4Cywzy71R0Ov1C6XRnOo4sYKyOfCcRfklnh+MSVYzyKoTfjcvtFT0nSQtOBIOaQ8vVTuyCcNwyJ0nmpmqFlJng==',key_name='tempest-keypair-1738862822',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4c2fe6bf5e4f4bb3b5d50901bfac0b38',ramdisk_id='',reservation_id='r-k1by7x80',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-935995346',owner_user_name='tempest-ServerActionsTestOtherB-935995346-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T15:39:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='16ea4be4bcb34749b2f444c4694543b1',uuid=aa223c49-d254-4727-8a01-873026847b37,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6514aeb6-8ea4-4a27-a54b-32f650c87957", "address": "fa:16:3e:ea:a6:1b", "network": {"id": "51708ad4-dae1-47fc-bd26-aca8c478ca04", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-279988751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c2fe6bf5e4f4bb3b5d50901bfac0b38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6514aeb6-8e", "ovs_interfaceid": "6514aeb6-8ea4-4a27-a54b-32f650c87957", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 15:39:08 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-799d598a-9d25-4065-b2b4-8ca63b9f0ac1 tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Converting VIF {"id": "6514aeb6-8ea4-4a27-a54b-32f650c87957", "address": "fa:16:3e:ea:a6:1b", "network": {"id": "51708ad4-dae1-47fc-bd26-aca8c478ca04", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-279988751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c2fe6bf5e4f4bb3b5d50901bfac0b38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6514aeb6-8e", "ovs_interfaceid": "6514aeb6-8ea4-4a27-a54b-32f650c87957", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:39:08 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-799d598a-9d25-4065-b2b4-8ca63b9f0ac1 tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:a6:1b,bridge_name='br-int',has_traffic_filtering=True,id=6514aeb6-8ea4-4a27-a54b-32f650c87957,network=Network(51708ad4-dae1-47fc-bd26-aca8c478ca04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6514aeb6-8e') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:39:08 user nova-compute[75176]: DEBUG os_vif [None req-799d598a-9d25-4065-b2b4-8ca63b9f0ac1 tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:a6:1b,bridge_name='br-int',has_traffic_filtering=True,id=6514aeb6-8ea4-4a27-a54b-32f650c87957,network=Network(51708ad4-dae1-47fc-bd26-aca8c478ca04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6514aeb6-8e') {{(pid=75176) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 15:39:08 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:39:08 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:39:08 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 15:39:08 user nova-compute[75176]: DEBUG nova.network.neutron [None req-377db1ae-fa70-4b36-8805-999b6c30f077 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] [instance: 2e8507b7-fccf-4196-b589-bf2b74f165ec] Successfully created port: 3dc67fc3-7fcf-4655-8dbd-22febf2be39e {{(pid=75176) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 15:39:08 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:39:08 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ac9d5460-d148-5be4-9596-97c3f04e5e69', '_type': 'linux-noop'}}, row=False) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:39:08 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:39:08 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:39:08 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:39:08 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6514aeb6-8e, may_exist=True, interface_attrs={}) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:39:08 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6514aeb6-8e, col_values=(('qos', UUID('d7cebcaa-9798-4100-a6bc-2812d59948ba')),), if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:39:08 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6514aeb6-8e, col_values=(('external_ids', {'iface-id': '6514aeb6-8ea4-4a27-a54b-32f650c87957', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ea:a6:1b', 'vm-uuid': 'aa223c49-d254-4727-8a01-873026847b37'}),), if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:39:08 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:39:08 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:39:08 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:39:08 user nova-compute[75176]: INFO os_vif [None req-799d598a-9d25-4065-b2b4-8ca63b9f0ac1 tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:a6:1b,bridge_name='br-int',has_traffic_filtering=True,id=6514aeb6-8ea4-4a27-a54b-32f650c87957,network=Network(51708ad4-dae1-47fc-bd26-aca8c478ca04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6514aeb6-8e')
Nov 28 15:39:08 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-799d598a-9d25-4065-b2b4-8ca63b9f0ac1 tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] No BDM found with device name vda, not building metadata. {{(pid=75176) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 15:39:08 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-799d598a-9d25-4065-b2b4-8ca63b9f0ac1 tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] No VIF found with MAC fa:16:3e:ea:a6:1b, not building metadata {{(pid=75176) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 15:39:08 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:39:08 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:39:08 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:39:08 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:39:09 user nova-compute[75176]: DEBUG nova.network.neutron [req-9dceac4c-b844-4eaf-a132-03f70722cc6b req-78c1dfe0-5786-4726-909d-08b6f924cb4a service nova] [instance: aa223c49-d254-4727-8a01-873026847b37] Updated VIF entry in instance network info cache for port 6514aeb6-8ea4-4a27-a54b-32f650c87957. {{(pid=75176) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 15:39:09 user nova-compute[75176]: DEBUG nova.network.neutron [req-9dceac4c-b844-4eaf-a132-03f70722cc6b req-78c1dfe0-5786-4726-909d-08b6f924cb4a service nova] [instance: aa223c49-d254-4727-8a01-873026847b37] Updating instance_info_cache with network_info: [{"id": "6514aeb6-8ea4-4a27-a54b-32f650c87957", "address": "fa:16:3e:ea:a6:1b", "network": {"id": "51708ad4-dae1-47fc-bd26-aca8c478ca04", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-279988751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c2fe6bf5e4f4bb3b5d50901bfac0b38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6514aeb6-8e", "ovs_interfaceid": "6514aeb6-8ea4-4a27-a54b-32f650c87957", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:39:09 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-9dceac4c-b844-4eaf-a132-03f70722cc6b req-78c1dfe0-5786-4726-909d-08b6f924cb4a service nova] Releasing lock "refresh_cache-aa223c49-d254-4727-8a01-873026847b37" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:39:09 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:39:09 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:39:09 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:39:09 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:39:10 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:39:10 user nova-compute[75176]: DEBUG nova.network.neutron [None req-377db1ae-fa70-4b36-8805-999b6c30f077 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] [instance: 2e8507b7-fccf-4196-b589-bf2b74f165ec] Successfully updated port: 3dc67fc3-7fcf-4655-8dbd-22febf2be39e {{(pid=75176) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 15:39:10 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-377db1ae-fa70-4b36-8805-999b6c30f077 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Acquiring lock "refresh_cache-2e8507b7-fccf-4196-b589-bf2b74f165ec" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:39:10 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-377db1ae-fa70-4b36-8805-999b6c30f077 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Acquired lock "refresh_cache-2e8507b7-fccf-4196-b589-bf2b74f165ec" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:39:10 user nova-compute[75176]: DEBUG nova.network.neutron [None req-377db1ae-fa70-4b36-8805-999b6c30f077 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] [instance: 2e8507b7-fccf-4196-b589-bf2b74f165ec] Building network info cache for instance {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 15:39:10 user nova-compute[75176]: DEBUG nova.compute.manager [req-cfb8a6b9-24b2-4ae1-990c-47ad18f0fe96 req-9e464fd1-1c10-49c4-a803-9a144ddc9316 service nova] [instance: 2e8507b7-fccf-4196-b589-bf2b74f165ec] Received event network-changed-3dc67fc3-7fcf-4655-8dbd-22febf2be39e {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:39:10 user nova-compute[75176]: DEBUG nova.compute.manager [req-cfb8a6b9-24b2-4ae1-990c-47ad18f0fe96 req-9e464fd1-1c10-49c4-a803-9a144ddc9316 service nova] [instance: 2e8507b7-fccf-4196-b589-bf2b74f165ec] Refreshing instance network info cache due to event network-changed-3dc67fc3-7fcf-4655-8dbd-22febf2be39e. {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 15:39:10 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-cfb8a6b9-24b2-4ae1-990c-47ad18f0fe96 req-9e464fd1-1c10-49c4-a803-9a144ddc9316 service nova] Acquiring lock "refresh_cache-2e8507b7-fccf-4196-b589-bf2b74f165ec" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:39:10 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:39:10 user nova-compute[75176]: DEBUG nova.network.neutron [None req-377db1ae-fa70-4b36-8805-999b6c30f077 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] [instance: 2e8507b7-fccf-4196-b589-bf2b74f165ec] Instance cache missing network info. {{(pid=75176) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 15:39:10 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:39:10 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:39:10 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:39:11 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:39:11 user nova-compute[75176]: DEBUG nova.network.neutron [None req-377db1ae-fa70-4b36-8805-999b6c30f077 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] [instance: 2e8507b7-fccf-4196-b589-bf2b74f165ec] Updating instance_info_cache with network_info: [{"id": "3dc67fc3-7fcf-4655-8dbd-22febf2be39e", "address": "fa:16:3e:04:68:53", "network": {"id": "8b63f2d3-0683-4832-abc5-e4c796cf12ab", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-877608435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3704b38a2bd44cb78c28d3f6d86d9e60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dc67fc3-7f", "ovs_interfaceid": "3dc67fc3-7fcf-4655-8dbd-22febf2be39e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:39:11 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-377db1ae-fa70-4b36-8805-999b6c30f077 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Releasing lock "refresh_cache-2e8507b7-fccf-4196-b589-bf2b74f165ec" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:39:11 user nova-compute[75176]: DEBUG nova.compute.manager [None req-377db1ae-fa70-4b36-8805-999b6c30f077 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] [instance: 2e8507b7-fccf-4196-b589-bf2b74f165ec] Instance network_info: |[{"id": "3dc67fc3-7fcf-4655-8dbd-22febf2be39e", "address": "fa:16:3e:04:68:53", "network": {"id": "8b63f2d3-0683-4832-abc5-e4c796cf12ab", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-877608435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3704b38a2bd44cb78c28d3f6d86d9e60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dc67fc3-7f", "ovs_interfaceid": "3dc67fc3-7fcf-4655-8dbd-22febf2be39e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75176) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 15:39:11 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-cfb8a6b9-24b2-4ae1-990c-47ad18f0fe96 req-9e464fd1-1c10-49c4-a803-9a144ddc9316 service nova] Acquired lock "refresh_cache-2e8507b7-fccf-4196-b589-bf2b74f165ec" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:39:11 user nova-compute[75176]: DEBUG nova.network.neutron [req-cfb8a6b9-24b2-4ae1-990c-47ad18f0fe96 req-9e464fd1-1c10-49c4-a803-9a144ddc9316 service nova] [instance: 2e8507b7-fccf-4196-b589-bf2b74f165ec] Refreshing network info cache for port 3dc67fc3-7fcf-4655-8dbd-22febf2be39e {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 15:39:11 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-377db1ae-fa70-4b36-8805-999b6c30f077 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] [instance: 2e8507b7-fccf-4196-b589-bf2b74f165ec] Start _get_guest_xml network_info=[{"id": "3dc67fc3-7fcf-4655-8dbd-22febf2be39e", "address": "fa:16:3e:04:68:53", "network": {"id": "8b63f2d3-0683-4832-abc5-e4c796cf12ab", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-877608435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3704b38a2bd44cb78c28d3f6d86d9e60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dc67fc3-7f", "ovs_interfaceid": "3dc67fc3-7fcf-4655-8dbd-22febf2be39e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T15:35:12Z,direct_url=<?>,disk_format='qcow2',id=1f41819e-c93f-4dc7-b253-37a27bbbbc74,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1b91c5d0672c4224a48df2e1f92688e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T15:35:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'size': 0, 'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'image_id': '1f41819e-c93f-4dc7-b253-37a27bbbbc74'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75176) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 15:39:11 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-377db1ae-fa70-4b36-8805-999b6c30f077 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 15:39:11 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-377db1ae-fa70-4b36-8805-999b6c30f077 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 15:39:11 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-377db1ae-fa70-4b36-8805-999b6c30f077 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75176) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 15:39:11 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-377db1ae-fa70-4b36-8805-999b6c30f077 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] CPU controller missing on host. {{(pid=75176) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 15:39:11 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-377db1ae-fa70-4b36-8805-999b6c30f077 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75176) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 15:39:11 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-377db1ae-fa70-4b36-8805-999b6c30f077 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] CPU controller found on host. {{(pid=75176) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 15:39:11 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-377db1ae-fa70-4b36-8805-999b6c30f077 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75176) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 15:39:11 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-377db1ae-fa70-4b36-8805-999b6c30f077 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T15:35:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T15:35:12Z,direct_url=<?>,disk_format='qcow2',id=1f41819e-c93f-4dc7-b253-37a27bbbbc74,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1b91c5d0672c4224a48df2e1f92688e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T15:35:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 15:39:11 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-377db1ae-fa70-4b36-8805-999b6c30f077 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Flavor limits 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 15:39:11 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-377db1ae-fa70-4b36-8805-999b6c30f077 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Image limits 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 15:39:11 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-377db1ae-fa70-4b36-8805-999b6c30f077 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Flavor pref 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 15:39:11 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-377db1ae-fa70-4b36-8805-999b6c30f077 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Image pref 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 15:39:11 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-377db1ae-fa70-4b36-8805-999b6c30f077 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 15:39:11 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-377db1ae-fa70-4b36-8805-999b6c30f077 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 15:39:11 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-377db1ae-fa70-4b36-8805-999b6c30f077 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75176) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 15:39:11 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-377db1ae-fa70-4b36-8805-999b6c30f077 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Got 1 possible topologies {{(pid=75176) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 15:39:11 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-377db1ae-fa70-4b36-8805-999b6c30f077 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 15:39:11 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-377db1ae-fa70-4b36-8805-999b6c30f077 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 15:39:12 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-377db1ae-fa70-4b36-8805-999b6c30f077 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T15:39:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-486965920',display_name='tempest-ServerActionsTestOtherA-server-486965920',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-486965920',id=4,image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOMWl0O1/eKbWND/zyjGraAKxeAyZ2R2+QgHiQ80zmzsi5uDkOgtIp8e2HjbFwlKUWmHgZppW6LnrIueD7TS7l/EkNAyCl7Y/pD0TSC3H7ZDLxYbZaFDAxH/uT7EnME+ig==',key_name='tempest-keypair-740685341',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3704b38a2bd44cb78c28d3f6d86d9e60',ramdisk_id='',reservation_id='r-adka2uzv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-680502445',owner_user_name='tempest-ServerActionsTestOtherA-680502445-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T15:39:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d028b79a105b485dbb0178c9da162640',uuid=2e8507b7-fccf-4196-b589-bf2b74f165ec,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3dc67fc3-7fcf-4655-8dbd-22febf2be39e", "address": "fa:16:3e:04:68:53", "network": {"id": "8b63f2d3-0683-4832-abc5-e4c796cf12ab", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-877608435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3704b38a2bd44cb78c28d3f6d86d9e60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dc67fc3-7f", "ovs_interfaceid": "3dc67fc3-7fcf-4655-8dbd-22febf2be39e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75176) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 15:39:12 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-377db1ae-fa70-4b36-8805-999b6c30f077 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Converting VIF {"id": "3dc67fc3-7fcf-4655-8dbd-22febf2be39e", "address": "fa:16:3e:04:68:53", "network": {"id": "8b63f2d3-0683-4832-abc5-e4c796cf12ab", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-877608435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3704b38a2bd44cb78c28d3f6d86d9e60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dc67fc3-7f", "ovs_interfaceid": "3dc67fc3-7fcf-4655-8dbd-22febf2be39e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:39:12 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-377db1ae-fa70-4b36-8805-999b6c30f077 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:68:53,bridge_name='br-int',has_traffic_filtering=True,id=3dc67fc3-7fcf-4655-8dbd-22febf2be39e,network=Network(8b63f2d3-0683-4832-abc5-e4c796cf12ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3dc67fc3-7f') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:39:12 user nova-compute[75176]: DEBUG nova.objects.instance [None req-377db1ae-fa70-4b36-8805-999b6c30f077 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Lazy-loading 'pci_devices' on Instance uuid 2e8507b7-fccf-4196-b589-bf2b74f165ec {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:39:12 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-377db1ae-fa70-4b36-8805-999b6c30f077 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] [instance: 2e8507b7-fccf-4196-b589-bf2b74f165ec] End _get_guest_xml xml=<domain type="kvm">
Nov 28 15:39:12 user nova-compute[75176]:   <uuid>2e8507b7-fccf-4196-b589-bf2b74f165ec</uuid>
Nov 28 15:39:12 user nova-compute[75176]:   <name>instance-00000004</name>
Nov 28 15:39:12 user nova-compute[75176]:   <memory>524288</memory>
Nov 28 15:39:12 user nova-compute[75176]:   <vcpu>1</vcpu>
Nov 28 15:39:12 user nova-compute[75176]:   <metadata>
Nov 28 15:39:12 user nova-compute[75176]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 15:39:12 user nova-compute[75176]:       <nova:package version="0.0.0"/>
Nov 28 15:39:12 user nova-compute[75176]:       <nova:name>tempest-ServerActionsTestOtherA-server-486965920</nova:name>
Nov 28 15:39:12 user nova-compute[75176]:       <nova:creationTime>2023-11-28 15:39:11</nova:creationTime>
Nov 28 15:39:12 user nova-compute[75176]:       <nova:flavor name="m1.tiny">
Nov 28 15:39:12 user nova-compute[75176]:         <nova:memory>512</nova:memory>
Nov 28 15:39:12 user nova-compute[75176]:         <nova:disk>1</nova:disk>
Nov 28 15:39:12 user nova-compute[75176]:         <nova:swap>0</nova:swap>
Nov 28 15:39:12 user nova-compute[75176]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 15:39:12 user nova-compute[75176]:         <nova:vcpus>1</nova:vcpus>
Nov 28 15:39:12 user nova-compute[75176]:       </nova:flavor>
Nov 28 15:39:12 user nova-compute[75176]:       <nova:owner>
Nov 28 15:39:12 user nova-compute[75176]:         <nova:user uuid="d028b79a105b485dbb0178c9da162640">tempest-ServerActionsTestOtherA-680502445-project-member</nova:user>
Nov 28 15:39:12 user nova-compute[75176]:         <nova:project uuid="3704b38a2bd44cb78c28d3f6d86d9e60">tempest-ServerActionsTestOtherA-680502445</nova:project>
Nov 28 15:39:12 user nova-compute[75176]:       </nova:owner>
Nov 28 15:39:12 user nova-compute[75176]:       <nova:root type="image" uuid="1f41819e-c93f-4dc7-b253-37a27bbbbc74"/>
Nov 28 15:39:12 user nova-compute[75176]:       <nova:ports>
Nov 28 15:39:12 user nova-compute[75176]:         <nova:port uuid="3dc67fc3-7fcf-4655-8dbd-22febf2be39e">
Nov 28 15:39:12 user nova-compute[75176]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 28 15:39:12 user nova-compute[75176]:         </nova:port>
Nov 28 15:39:12 user nova-compute[75176]:       </nova:ports>
Nov 28 15:39:12 user nova-compute[75176]:     </nova:instance>
Nov 28 15:39:12 user nova-compute[75176]:   </metadata>
Nov 28 15:39:12 user nova-compute[75176]:   <sysinfo type="smbios">
Nov 28 15:39:12 user nova-compute[75176]:     <system>
Nov 28 15:39:12 user nova-compute[75176]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 15:39:12 user nova-compute[75176]:       <entry name="product">OpenStack Nova</entry>
Nov 28 15:39:12 user nova-compute[75176]:       <entry name="version">0.0.0</entry>
Nov 28 15:39:12 user nova-compute[75176]:       <entry name="serial">2e8507b7-fccf-4196-b589-bf2b74f165ec</entry>
Nov 28 15:39:12 user nova-compute[75176]:       <entry name="uuid">2e8507b7-fccf-4196-b589-bf2b74f165ec</entry>
Nov 28 15:39:12 user nova-compute[75176]:       <entry name="family">Virtual Machine</entry>
Nov 28 15:39:12 user nova-compute[75176]:     </system>
Nov 28 15:39:12 user nova-compute[75176]:   </sysinfo>
Nov 28 15:39:12 user nova-compute[75176]:   <os>
Nov 28 15:39:12 user nova-compute[75176]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 15:39:12 user nova-compute[75176]:     <boot dev="hd"/>
Nov 28 15:39:12 user nova-compute[75176]:     <smbios mode="sysinfo"/>
Nov 28 15:39:12 user nova-compute[75176]:   </os>
Nov 28 15:39:12 user nova-compute[75176]:   <features>
Nov 28 15:39:12 user nova-compute[75176]:     <acpi/>
Nov 28 15:39:12 user nova-compute[75176]:     <apic/>
Nov 28 15:39:12 user nova-compute[75176]:     <vmcoreinfo/>
Nov 28 15:39:12 user nova-compute[75176]:   </features>
Nov 28 15:39:12 user nova-compute[75176]:   <clock offset="utc">
Nov 28 15:39:12 user nova-compute[75176]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 15:39:12 user nova-compute[75176]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 15:39:12 user nova-compute[75176]:     <timer name="hpet" present="no"/>
Nov 28 15:39:12 user nova-compute[75176]:   </clock>
Nov 28 15:39:12 user nova-compute[75176]:   <cpu mode="custom" match="exact">
Nov 28 15:39:12 user nova-compute[75176]:     <model>Nehalem</model>
Nov 28 15:39:12 user nova-compute[75176]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 15:39:12 user nova-compute[75176]:   </cpu>
Nov 28 15:39:12 user nova-compute[75176]:   <devices>
Nov 28 15:39:12 user nova-compute[75176]:     <disk type="file" device="disk">
Nov 28 15:39:12 user nova-compute[75176]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 15:39:12 user nova-compute[75176]:       <source file="/opt/stack/data/nova/instances/2e8507b7-fccf-4196-b589-bf2b74f165ec/disk"/>
Nov 28 15:39:12 user nova-compute[75176]:       <target dev="vda" bus="virtio"/>
Nov 28 15:39:12 user nova-compute[75176]:     </disk>
Nov 28 15:39:12 user nova-compute[75176]:     <interface type="ethernet">
Nov 28 15:39:12 user nova-compute[75176]:       <mac address="fa:16:3e:04:68:53"/>
Nov 28 15:39:12 user nova-compute[75176]:       <model type="virtio"/>
Nov 28 15:39:12 user nova-compute[75176]:       <mtu size="1442"/>
Nov 28 15:39:12 user nova-compute[75176]:       <target dev="tap3dc67fc3-7f"/>
Nov 28 15:39:12 user nova-compute[75176]:     </interface>
Nov 28 15:39:12 user nova-compute[75176]:     <serial type="pty">
Nov 28 15:39:12 user nova-compute[75176]:       <log file="/opt/stack/data/nova/instances/2e8507b7-fccf-4196-b589-bf2b74f165ec/console.log" append="off"/>
Nov 28 15:39:12 user nova-compute[75176]:     </serial>
Nov 28 15:39:12 user nova-compute[75176]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 15:39:12 user nova-compute[75176]:     <video>
Nov 28 15:39:12 user nova-compute[75176]:       <model type="virtio"/>
Nov 28 15:39:12 user nova-compute[75176]:     </video>
Nov 28 15:39:12 user nova-compute[75176]:     <rng model="virtio">
Nov 28 15:39:12 user nova-compute[75176]:       <backend model="random">/dev/urandom</backend>
Nov 28 15:39:12 user nova-compute[75176]:     </rng>
Nov 28 15:39:12 user nova-compute[75176]:     <controller type="usb" index="0" model="none"/>
Nov 28 15:39:12 user nova-compute[75176]:     <memballoon model="virtio">
Nov 28 15:39:12 user nova-compute[75176]:       <stats period="10"/>
Nov 28 15:39:12 user nova-compute[75176]:     </memballoon>
Nov 28 15:39:12 user nova-compute[75176]:   </devices>
Nov 28 15:39:12 user nova-compute[75176]: </domain>
Nov 28 15:39:12 user nova-compute[75176]:  {{(pid=75176) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 15:39:12 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-377db1ae-fa70-4b36-8805-999b6c30f077 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T15:39:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-486965920',display_name='tempest-ServerActionsTestOtherA-server-486965920',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-486965920',id=4,image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOMWl0O1/eKbWND/zyjGraAKxeAyZ2R2+QgHiQ80zmzsi5uDkOgtIp8e2HjbFwlKUWmHgZppW6LnrIueD7TS7l/EkNAyCl7Y/pD0TSC3H7ZDLxYbZaFDAxH/uT7EnME+ig==',key_name='tempest-keypair-740685341',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3704b38a2bd44cb78c28d3f6d86d9e60',ramdisk_id='',reservation_id='r-adka2uzv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-680502445',owner_user_name='tempest-ServerActionsTestOtherA-680502445-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T15:39:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d028b79a105b485dbb0178c9da162640',uuid=2e8507b7-fccf-4196-b589-bf2b74f165ec,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3dc67fc3-7fcf-4655-8dbd-22febf2be39e", "address": "fa:16:3e:04:68:53", "network": {"id": "8b63f2d3-0683-4832-abc5-e4c796cf12ab", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-877608435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3704b38a2bd44cb78c28d3f6d86d9e60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dc67fc3-7f", "ovs_interfaceid": "3dc67fc3-7fcf-4655-8dbd-22febf2be39e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 15:39:12 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-377db1ae-fa70-4b36-8805-999b6c30f077 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Converting VIF {"id": "3dc67fc3-7fcf-4655-8dbd-22febf2be39e", "address": "fa:16:3e:04:68:53", "network": {"id": "8b63f2d3-0683-4832-abc5-e4c796cf12ab", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-877608435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3704b38a2bd44cb78c28d3f6d86d9e60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dc67fc3-7f", "ovs_interfaceid": "3dc67fc3-7fcf-4655-8dbd-22febf2be39e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:39:12 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-377db1ae-fa70-4b36-8805-999b6c30f077 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:68:53,bridge_name='br-int',has_traffic_filtering=True,id=3dc67fc3-7fcf-4655-8dbd-22febf2be39e,network=Network(8b63f2d3-0683-4832-abc5-e4c796cf12ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3dc67fc3-7f') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:39:12 user nova-compute[75176]: DEBUG os_vif [None req-377db1ae-fa70-4b36-8805-999b6c30f077 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:68:53,bridge_name='br-int',has_traffic_filtering=True,id=3dc67fc3-7fcf-4655-8dbd-22febf2be39e,network=Network(8b63f2d3-0683-4832-abc5-e4c796cf12ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3dc67fc3-7f') {{(pid=75176) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 15:39:12 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:39:12 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:39:12 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 15:39:12 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:39:12 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '874bc320-c667-51ce-aeb4-ee1defd651c3', '_type': 'linux-noop'}}, row=False) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:39:12 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:39:12 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:39:12 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:39:12 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3dc67fc3-7f, may_exist=True, interface_attrs={}) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:39:12 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3dc67fc3-7f, col_values=(('qos', UUID('6d208a54-923d-449e-b0dd-4c2c84fdfcd6')),), if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:39:12 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3dc67fc3-7f, col_values=(('external_ids', {'iface-id': '3dc67fc3-7fcf-4655-8dbd-22febf2be39e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:04:68:53', 'vm-uuid': '2e8507b7-fccf-4196-b589-bf2b74f165ec'}),), if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:39:12 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:39:12 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:39:12 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:39:12 user nova-compute[75176]: INFO os_vif [None req-377db1ae-fa70-4b36-8805-999b6c30f077 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:68:53,bridge_name='br-int',has_traffic_filtering=True,id=3dc67fc3-7fcf-4655-8dbd-22febf2be39e,network=Network(8b63f2d3-0683-4832-abc5-e4c796cf12ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3dc67fc3-7f')
Nov 28 15:39:12 user nova-compute[75176]: DEBUG nova.compute.manager [None req-89d2a15f-e9da-4425-a768-aa428f0b8c54 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] [instance: 6ab0619f-72e5-4975-ade8-53d7c0784d89] Instance event wait completed in 0 seconds for  {{(pid=75176) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 15:39:12 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-89d2a15f-e9da-4425-a768-aa428f0b8c54 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] [instance: 6ab0619f-72e5-4975-ade8-53d7c0784d89] Guest created on hypervisor {{(pid=75176) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 15:39:12 user nova-compute[75176]: INFO nova.virt.libvirt.driver [-] [instance: 6ab0619f-72e5-4975-ade8-53d7c0784d89] Instance spawned successfully.
Nov 28 15:39:12 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-89d2a15f-e9da-4425-a768-aa428f0b8c54 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] [instance: 6ab0619f-72e5-4975-ade8-53d7c0784d89] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 15:39:12 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-377db1ae-fa70-4b36-8805-999b6c30f077 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] No BDM found with device name vda, not building metadata. {{(pid=75176) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 15:39:12 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-377db1ae-fa70-4b36-8805-999b6c30f077 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] No VIF found with MAC fa:16:3e:04:68:53, not building metadata {{(pid=75176) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 15:39:12 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-89d2a15f-e9da-4425-a768-aa428f0b8c54 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] [instance: 6ab0619f-72e5-4975-ade8-53d7c0784d89] Found default for hw_cdrom_bus of ide {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:39:12 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-89d2a15f-e9da-4425-a768-aa428f0b8c54 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] [instance: 6ab0619f-72e5-4975-ade8-53d7c0784d89] Found default for hw_disk_bus of virtio {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:39:12 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-89d2a15f-e9da-4425-a768-aa428f0b8c54 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] [instance: 6ab0619f-72e5-4975-ade8-53d7c0784d89] Found default for hw_input_bus of None {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:39:12 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-89d2a15f-e9da-4425-a768-aa428f0b8c54 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] [instance: 6ab0619f-72e5-4975-ade8-53d7c0784d89] Found default for hw_pointer_model of None {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:39:12 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-89d2a15f-e9da-4425-a768-aa428f0b8c54 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] [instance: 6ab0619f-72e5-4975-ade8-53d7c0784d89] Found default for hw_video_model of virtio {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:39:12 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-89d2a15f-e9da-4425-a768-aa428f0b8c54 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] [instance: 6ab0619f-72e5-4975-ade8-53d7c0784d89] Found default for hw_vif_model of virtio {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:39:12 user nova-compute[75176]: INFO nova.compute.manager [None req-89d2a15f-e9da-4425-a768-aa428f0b8c54 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] [instance: 6ab0619f-72e5-4975-ade8-53d7c0784d89] Took 11.60 seconds to spawn the instance on the hypervisor.
Nov 28 15:39:12 user nova-compute[75176]: DEBUG nova.compute.manager [None req-89d2a15f-e9da-4425-a768-aa428f0b8c54 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] [instance: 6ab0619f-72e5-4975-ade8-53d7c0784d89] Checking state {{(pid=75176) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 15:39:12 user nova-compute[75176]: INFO nova.compute.manager [None req-89d2a15f-e9da-4425-a768-aa428f0b8c54 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] [instance: 6ab0619f-72e5-4975-ade8-53d7c0784d89] Took 12.39 seconds to build instance.
Nov 28 15:39:12 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-89d2a15f-e9da-4425-a768-aa428f0b8c54 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] Lock "6ab0619f-72e5-4975-ade8-53d7c0784d89" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.531s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:39:12 user nova-compute[75176]: DEBUG nova.network.neutron [req-cfb8a6b9-24b2-4ae1-990c-47ad18f0fe96 req-9e464fd1-1c10-49c4-a803-9a144ddc9316 service nova] [instance: 2e8507b7-fccf-4196-b589-bf2b74f165ec] Updated VIF entry in instance network info cache for port 3dc67fc3-7fcf-4655-8dbd-22febf2be39e. {{(pid=75176) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 15:39:12 user nova-compute[75176]: DEBUG nova.network.neutron [req-cfb8a6b9-24b2-4ae1-990c-47ad18f0fe96 req-9e464fd1-1c10-49c4-a803-9a144ddc9316 service nova] [instance: 2e8507b7-fccf-4196-b589-bf2b74f165ec] Updating instance_info_cache with network_info: [{"id": "3dc67fc3-7fcf-4655-8dbd-22febf2be39e", "address": "fa:16:3e:04:68:53", "network": {"id": "8b63f2d3-0683-4832-abc5-e4c796cf12ab", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-877608435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3704b38a2bd44cb78c28d3f6d86d9e60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dc67fc3-7f", "ovs_interfaceid": "3dc67fc3-7fcf-4655-8dbd-22febf2be39e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:39:12 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-cfb8a6b9-24b2-4ae1-990c-47ad18f0fe96 req-9e464fd1-1c10-49c4-a803-9a144ddc9316 service nova] Releasing lock "refresh_cache-2e8507b7-fccf-4196-b589-bf2b74f165ec" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:39:12 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:39:12 user nova-compute[75176]: DEBUG nova.compute.manager [None req-c6a4c2f0-2e37-40a9-8ae6-6700c2a6bc5b tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] [instance: f81dc25c-3549-4e25-b27c-a75a50d9a448] Instance event wait completed in 0 seconds for  {{(pid=75176) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 15:39:12 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-c6a4c2f0-2e37-40a9-8ae6-6700c2a6bc5b tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] [instance: f81dc25c-3549-4e25-b27c-a75a50d9a448] Guest created on hypervisor {{(pid=75176) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 15:39:13 user nova-compute[75176]: INFO nova.virt.libvirt.driver [-] [instance: f81dc25c-3549-4e25-b27c-a75a50d9a448] Instance spawned successfully.
Nov 28 15:39:13 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-c6a4c2f0-2e37-40a9-8ae6-6700c2a6bc5b tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] [instance: f81dc25c-3549-4e25-b27c-a75a50d9a448] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 15:39:13 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-c6a4c2f0-2e37-40a9-8ae6-6700c2a6bc5b tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] [instance: f81dc25c-3549-4e25-b27c-a75a50d9a448] Found default for hw_cdrom_bus of ide {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:39:13 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-c6a4c2f0-2e37-40a9-8ae6-6700c2a6bc5b tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] [instance: f81dc25c-3549-4e25-b27c-a75a50d9a448] Found default for hw_disk_bus of virtio {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:39:13 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-c6a4c2f0-2e37-40a9-8ae6-6700c2a6bc5b tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] [instance: f81dc25c-3549-4e25-b27c-a75a50d9a448] Found default for hw_input_bus of None {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:39:13 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-c6a4c2f0-2e37-40a9-8ae6-6700c2a6bc5b tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] [instance: f81dc25c-3549-4e25-b27c-a75a50d9a448] Found default for hw_pointer_model of None {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:39:13 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-c6a4c2f0-2e37-40a9-8ae6-6700c2a6bc5b tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] [instance: f81dc25c-3549-4e25-b27c-a75a50d9a448] Found default for hw_video_model of virtio {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:39:13 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-c6a4c2f0-2e37-40a9-8ae6-6700c2a6bc5b tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] [instance: f81dc25c-3549-4e25-b27c-a75a50d9a448] Found default for hw_vif_model of virtio {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:39:13 user nova-compute[75176]: INFO nova.compute.manager [None req-c6a4c2f0-2e37-40a9-8ae6-6700c2a6bc5b tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] [instance: f81dc25c-3549-4e25-b27c-a75a50d9a448] Took 17.10 seconds to spawn the instance on the hypervisor.
Nov 28 15:39:13 user nova-compute[75176]: DEBUG nova.compute.manager [None req-c6a4c2f0-2e37-40a9-8ae6-6700c2a6bc5b tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] [instance: f81dc25c-3549-4e25-b27c-a75a50d9a448] Checking state {{(pid=75176) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 15:39:13 user nova-compute[75176]: DEBUG nova.compute.manager [None req-799d598a-9d25-4065-b2b4-8ca63b9f0ac1 tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] [instance: aa223c49-d254-4727-8a01-873026847b37] Instance event wait completed in 0 seconds for  {{(pid=75176) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 15:39:13 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-799d598a-9d25-4065-b2b4-8ca63b9f0ac1 tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] [instance: aa223c49-d254-4727-8a01-873026847b37] Guest created on hypervisor {{(pid=75176) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 15:39:13 user nova-compute[75176]: INFO nova.virt.libvirt.driver [-] [instance: aa223c49-d254-4727-8a01-873026847b37] Instance spawned successfully.
Nov 28 15:39:13 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-799d598a-9d25-4065-b2b4-8ca63b9f0ac1 tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] [instance: aa223c49-d254-4727-8a01-873026847b37] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 15:39:13 user nova-compute[75176]: INFO nova.compute.manager [None req-c6a4c2f0-2e37-40a9-8ae6-6700c2a6bc5b tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] [instance: f81dc25c-3549-4e25-b27c-a75a50d9a448] Took 17.99 seconds to build instance.
Nov 28 15:39:13 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-799d598a-9d25-4065-b2b4-8ca63b9f0ac1 tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] [instance: aa223c49-d254-4727-8a01-873026847b37] Found default for hw_cdrom_bus of ide {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:39:13 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-799d598a-9d25-4065-b2b4-8ca63b9f0ac1 tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] [instance: aa223c49-d254-4727-8a01-873026847b37] Found default for hw_disk_bus of virtio {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:39:13 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-799d598a-9d25-4065-b2b4-8ca63b9f0ac1 tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] [instance: aa223c49-d254-4727-8a01-873026847b37] Found default for hw_input_bus of None {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:39:13 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-799d598a-9d25-4065-b2b4-8ca63b9f0ac1 tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] [instance: aa223c49-d254-4727-8a01-873026847b37] Found default for hw_pointer_model of None {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:39:13 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-799d598a-9d25-4065-b2b4-8ca63b9f0ac1 tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] [instance: aa223c49-d254-4727-8a01-873026847b37] Found default for hw_video_model of virtio {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:39:13 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-799d598a-9d25-4065-b2b4-8ca63b9f0ac1 tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] [instance: aa223c49-d254-4727-8a01-873026847b37] Found default for hw_vif_model of virtio {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:39:13 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-c6a4c2f0-2e37-40a9-8ae6-6700c2a6bc5b tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] Lock "f81dc25c-3549-4e25-b27c-a75a50d9a448" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.526s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:39:13 user nova-compute[75176]: INFO nova.compute.manager [None req-799d598a-9d25-4065-b2b4-8ca63b9f0ac1 tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] [instance: aa223c49-d254-4727-8a01-873026847b37] Took 9.51 seconds to spawn the instance on the hypervisor.
Nov 28 15:39:13 user nova-compute[75176]: DEBUG nova.compute.manager [None req-799d598a-9d25-4065-b2b4-8ca63b9f0ac1 tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] [instance: aa223c49-d254-4727-8a01-873026847b37] Checking state {{(pid=75176) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 15:39:13 user nova-compute[75176]: INFO nova.compute.manager [None req-799d598a-9d25-4065-b2b4-8ca63b9f0ac1 tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] [instance: aa223c49-d254-4727-8a01-873026847b37] Took 10.60 seconds to build instance.
Nov 28 15:39:13 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-799d598a-9d25-4065-b2b4-8ca63b9f0ac1 tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Lock "aa223c49-d254-4727-8a01-873026847b37" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.755s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:39:13 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:39:13 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:39:13 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:39:14 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:39:14 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:39:14 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:39:15 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:39:16 user nova-compute[75176]: DEBUG nova.compute.manager [None req-377db1ae-fa70-4b36-8805-999b6c30f077 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] [instance: 2e8507b7-fccf-4196-b589-bf2b74f165ec] Instance event wait completed in 0 seconds for  {{(pid=75176) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 15:39:16 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-377db1ae-fa70-4b36-8805-999b6c30f077 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] [instance: 2e8507b7-fccf-4196-b589-bf2b74f165ec] Guest created on hypervisor {{(pid=75176) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 15:39:16 user nova-compute[75176]: INFO nova.virt.libvirt.driver [-] [instance: 2e8507b7-fccf-4196-b589-bf2b74f165ec] Instance spawned successfully.
Nov 28 15:39:16 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-377db1ae-fa70-4b36-8805-999b6c30f077 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] [instance: 2e8507b7-fccf-4196-b589-bf2b74f165ec] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 15:39:16 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-377db1ae-fa70-4b36-8805-999b6c30f077 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] [instance: 2e8507b7-fccf-4196-b589-bf2b74f165ec] Found default for hw_cdrom_bus of ide {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:39:16 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-377db1ae-fa70-4b36-8805-999b6c30f077 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] [instance: 2e8507b7-fccf-4196-b589-bf2b74f165ec] Found default for hw_disk_bus of virtio {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:39:16 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-377db1ae-fa70-4b36-8805-999b6c30f077 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] [instance: 2e8507b7-fccf-4196-b589-bf2b74f165ec] Found default for hw_input_bus of None {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:39:16 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-377db1ae-fa70-4b36-8805-999b6c30f077 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] [instance: 2e8507b7-fccf-4196-b589-bf2b74f165ec] Found default for hw_pointer_model of None {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:39:16 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-377db1ae-fa70-4b36-8805-999b6c30f077 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] [instance: 2e8507b7-fccf-4196-b589-bf2b74f165ec] Found default for hw_video_model of virtio {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:39:16 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-377db1ae-fa70-4b36-8805-999b6c30f077 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] [instance: 2e8507b7-fccf-4196-b589-bf2b74f165ec] Found default for hw_vif_model of virtio {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:39:17 user nova-compute[75176]: INFO nova.compute.manager [None req-377db1ae-fa70-4b36-8805-999b6c30f077 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] [instance: 2e8507b7-fccf-4196-b589-bf2b74f165ec] Took 11.67 seconds to spawn the instance on the hypervisor.
Nov 28 15:39:17 user nova-compute[75176]: DEBUG nova.compute.manager [None req-377db1ae-fa70-4b36-8805-999b6c30f077 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] [instance: 2e8507b7-fccf-4196-b589-bf2b74f165ec] Checking state {{(pid=75176) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 15:39:17 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:39:17 user nova-compute[75176]: INFO nova.compute.manager [None req-377db1ae-fa70-4b36-8805-999b6c30f077 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] [instance: 2e8507b7-fccf-4196-b589-bf2b74f165ec] Took 12.72 seconds to build instance.
Nov 28 15:39:17 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-377db1ae-fa70-4b36-8805-999b6c30f077 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Lock "2e8507b7-fccf-4196-b589-bf2b74f165ec" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.937s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:39:17 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:39:17 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:39:17 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:39:18 user nova-compute[75176]: DEBUG nova.compute.manager [req-ab40ab8a-ae3e-4e42-872d-e96c9f9d71ae req-620970f0-e75c-4667-838d-cbc31390c333 service nova] [instance: aa223c49-d254-4727-8a01-873026847b37] Received event network-vif-plugged-6514aeb6-8ea4-4a27-a54b-32f650c87957 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:39:18 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-ab40ab8a-ae3e-4e42-872d-e96c9f9d71ae req-620970f0-e75c-4667-838d-cbc31390c333 service nova] Acquiring lock "aa223c49-d254-4727-8a01-873026847b37-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:39:18 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-ab40ab8a-ae3e-4e42-872d-e96c9f9d71ae req-620970f0-e75c-4667-838d-cbc31390c333 service nova] Lock "aa223c49-d254-4727-8a01-873026847b37-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:39:18 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-ab40ab8a-ae3e-4e42-872d-e96c9f9d71ae req-620970f0-e75c-4667-838d-cbc31390c333 service nova] Lock "aa223c49-d254-4727-8a01-873026847b37-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:39:18 user nova-compute[75176]: DEBUG nova.compute.manager [req-ab40ab8a-ae3e-4e42-872d-e96c9f9d71ae req-620970f0-e75c-4667-838d-cbc31390c333 service nova] [instance: aa223c49-d254-4727-8a01-873026847b37] No waiting events found dispatching network-vif-plugged-6514aeb6-8ea4-4a27-a54b-32f650c87957 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:39:18 user nova-compute[75176]: WARNING nova.compute.manager [req-ab40ab8a-ae3e-4e42-872d-e96c9f9d71ae req-620970f0-e75c-4667-838d-cbc31390c333 service nova] [instance: aa223c49-d254-4727-8a01-873026847b37] Received unexpected event network-vif-plugged-6514aeb6-8ea4-4a27-a54b-32f650c87957 for instance with vm_state active and task_state None.
Nov 28 15:39:18 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:39:18 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:39:19 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:39:20 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:39:20 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:39:20 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:39:20 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-46cbc4c0-639f-45f1-8c8c-04c0126dfa6b tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] Acquiring lock "5b18c889-7694-4edf-8cf2-b9032e60289e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:39:20 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-46cbc4c0-639f-45f1-8c8c-04c0126dfa6b tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] Lock "5b18c889-7694-4edf-8cf2-b9032e60289e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:39:20 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:39:20 user nova-compute[75176]: DEBUG nova.compute.manager [None req-46cbc4c0-639f-45f1-8c8c-04c0126dfa6b tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] [instance: 5b18c889-7694-4edf-8cf2-b9032e60289e] Starting instance... {{(pid=75176) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 15:39:20 user nova-compute[75176]: DEBUG nova.compute.manager [req-adbdd33a-f178-4dc3-9337-98b068746c21 req-cc143502-4799-478d-889f-be3bb8def1ed service nova] [instance: aa223c49-d254-4727-8a01-873026847b37] Received event network-vif-plugged-6514aeb6-8ea4-4a27-a54b-32f650c87957 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:39:20 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-adbdd33a-f178-4dc3-9337-98b068746c21 req-cc143502-4799-478d-889f-be3bb8def1ed service nova] Acquiring lock "aa223c49-d254-4727-8a01-873026847b37-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:39:20 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-adbdd33a-f178-4dc3-9337-98b068746c21 req-cc143502-4799-478d-889f-be3bb8def1ed service nova] Lock "aa223c49-d254-4727-8a01-873026847b37-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:39:20 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-adbdd33a-f178-4dc3-9337-98b068746c21 req-cc143502-4799-478d-889f-be3bb8def1ed service nova] Lock "aa223c49-d254-4727-8a01-873026847b37-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:39:20 user nova-compute[75176]: DEBUG nova.compute.manager [req-adbdd33a-f178-4dc3-9337-98b068746c21 req-cc143502-4799-478d-889f-be3bb8def1ed service nova] [instance: aa223c49-d254-4727-8a01-873026847b37] No waiting events found dispatching network-vif-plugged-6514aeb6-8ea4-4a27-a54b-32f650c87957 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:39:20 user nova-compute[75176]: WARNING nova.compute.manager [req-adbdd33a-f178-4dc3-9337-98b068746c21 req-cc143502-4799-478d-889f-be3bb8def1ed service nova] [instance: aa223c49-d254-4727-8a01-873026847b37] Received unexpected event network-vif-plugged-6514aeb6-8ea4-4a27-a54b-32f650c87957 for instance with vm_state active and task_state None.
Nov 28 15:39:20 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-46cbc4c0-639f-45f1-8c8c-04c0126dfa6b tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:39:20 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-46cbc4c0-639f-45f1-8c8c-04c0126dfa6b tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:39:20 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-46cbc4c0-639f-45f1-8c8c-04c0126dfa6b tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75176) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 15:39:20 user nova-compute[75176]: INFO nova.compute.claims [None req-46cbc4c0-639f-45f1-8c8c-04c0126dfa6b tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] [instance: 5b18c889-7694-4edf-8cf2-b9032e60289e] Claim successful on node user
Nov 28 15:39:21 user nova-compute[75176]: DEBUG nova.compute.provider_tree [None req-46cbc4c0-639f-45f1-8c8c-04c0126dfa6b tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] Inventory has not changed in ProviderTree for provider: b37848d8-f401-4155-a029-b0ffa09ff85b {{(pid=75176) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 15:39:21 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-46cbc4c0-639f-45f1-8c8c-04c0126dfa6b tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] Inventory has not changed for provider b37848d8-f401-4155-a029-b0ffa09ff85b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75176) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 15:39:21 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-46cbc4c0-639f-45f1-8c8c-04c0126dfa6b tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.685s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:39:21 user nova-compute[75176]: DEBUG nova.compute.manager [None req-46cbc4c0-639f-45f1-8c8c-04c0126dfa6b tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] [instance: 5b18c889-7694-4edf-8cf2-b9032e60289e] Start building networks asynchronously for instance. {{(pid=75176) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 15:39:21 user nova-compute[75176]: DEBUG nova.compute.manager [None req-46cbc4c0-639f-45f1-8c8c-04c0126dfa6b tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] [instance: 5b18c889-7694-4edf-8cf2-b9032e60289e] Allocating IP information in the background. {{(pid=75176) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 15:39:21 user nova-compute[75176]: DEBUG nova.network.neutron [None req-46cbc4c0-639f-45f1-8c8c-04c0126dfa6b tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] [instance: 5b18c889-7694-4edf-8cf2-b9032e60289e] allocate_for_instance() {{(pid=75176) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 15:39:21 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-46cbc4c0-639f-45f1-8c8c-04c0126dfa6b tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] [instance: 5b18c889-7694-4edf-8cf2-b9032e60289e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 15:39:21 user nova-compute[75176]: DEBUG nova.compute.manager [None req-46cbc4c0-639f-45f1-8c8c-04c0126dfa6b tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] [instance: 5b18c889-7694-4edf-8cf2-b9032e60289e] Start building block device mappings for instance. {{(pid=75176) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 15:39:21 user nova-compute[75176]: DEBUG nova.policy [None req-46cbc4c0-639f-45f1-8c8c-04c0126dfa6b tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b339a055aaf24d25946cc16369bddc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0518c3ca77e4ecebb6ea8fbf6e60219', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75176) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 15:39:21 user nova-compute[75176]: DEBUG nova.compute.manager [None req-46cbc4c0-639f-45f1-8c8c-04c0126dfa6b tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] [instance: 5b18c889-7694-4edf-8cf2-b9032e60289e] Start spawning the instance on the hypervisor. {{(pid=75176) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 15:39:21 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-46cbc4c0-639f-45f1-8c8c-04c0126dfa6b tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] [instance: 5b18c889-7694-4edf-8cf2-b9032e60289e] Creating instance directory {{(pid=75176) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 15:39:21 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-46cbc4c0-639f-45f1-8c8c-04c0126dfa6b tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] [instance: 5b18c889-7694-4edf-8cf2-b9032e60289e] Creating image(s)
Nov 28 15:39:21 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-46cbc4c0-639f-45f1-8c8c-04c0126dfa6b tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] Acquiring lock "/opt/stack/data/nova/instances/5b18c889-7694-4edf-8cf2-b9032e60289e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:39:21 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-46cbc4c0-639f-45f1-8c8c-04c0126dfa6b tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] Lock "/opt/stack/data/nova/instances/5b18c889-7694-4edf-8cf2-b9032e60289e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:39:21 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-46cbc4c0-639f-45f1-8c8c-04c0126dfa6b tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] Lock "/opt/stack/data/nova/instances/5b18c889-7694-4edf-8cf2-b9032e60289e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:39:21 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-46cbc4c0-639f-45f1-8c8c-04c0126dfa6b tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:39:21 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-46cbc4c0-639f-45f1-8c8c-04c0126dfa6b tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json" returned: 0 in 0.268s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:39:21 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-46cbc4c0-639f-45f1-8c8c-04c0126dfa6b tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] Acquiring lock "5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:39:21 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-46cbc4c0-639f-45f1-8c8c-04c0126dfa6b tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] Lock "5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.004s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:39:21 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-46cbc4c0-639f-45f1-8c8c-04c0126dfa6b tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:39:22 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-46cbc4c0-639f-45f1-8c8c-04c0126dfa6b tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json" returned: 0 in 0.246s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:39:22 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-46cbc4c0-639f-45f1-8c8c-04c0126dfa6b tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2,backing_fmt=raw /opt/stack/data/nova/instances/5b18c889-7694-4edf-8cf2-b9032e60289e/disk 1073741824 {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:39:22 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:39:22 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-46cbc4c0-639f-45f1-8c8c-04c0126dfa6b tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2,backing_fmt=raw /opt/stack/data/nova/instances/5b18c889-7694-4edf-8cf2-b9032e60289e/disk 1073741824" returned: 0 in 0.106s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:39:22 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-46cbc4c0-639f-45f1-8c8c-04c0126dfa6b tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] Lock "5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.360s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:39:22 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-46cbc4c0-639f-45f1-8c8c-04c0126dfa6b tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:39:22 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-46cbc4c0-639f-45f1-8c8c-04c0126dfa6b tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json" returned: 0 in 0.241s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:39:22 user nova-compute[75176]: DEBUG nova.virt.disk.api [None req-46cbc4c0-639f-45f1-8c8c-04c0126dfa6b tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5b18c889-7694-4edf-8cf2-b9032e60289e/disk. size=1073741824 {{(pid=75176) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 15:39:22 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-46cbc4c0-639f-45f1-8c8c-04c0126dfa6b tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b18c889-7694-4edf-8cf2-b9032e60289e/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:39:22 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-46cbc4c0-639f-45f1-8c8c-04c0126dfa6b tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b18c889-7694-4edf-8cf2-b9032e60289e/disk --force-share --output=json" returned: 0 in 0.334s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:39:22 user nova-compute[75176]: DEBUG nova.virt.disk.api [None req-46cbc4c0-639f-45f1-8c8c-04c0126dfa6b tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] Cannot resize image /opt/stack/data/nova/instances/5b18c889-7694-4edf-8cf2-b9032e60289e/disk to a smaller size. {{(pid=75176) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 15:39:22 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-46cbc4c0-639f-45f1-8c8c-04c0126dfa6b tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] [instance: 5b18c889-7694-4edf-8cf2-b9032e60289e] Created local disks {{(pid=75176) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 15:39:22 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-46cbc4c0-639f-45f1-8c8c-04c0126dfa6b tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] [instance: 5b18c889-7694-4edf-8cf2-b9032e60289e] Ensure instance console log exists: /opt/stack/data/nova/instances/5b18c889-7694-4edf-8cf2-b9032e60289e/console.log {{(pid=75176) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 15:39:22 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-46cbc4c0-639f-45f1-8c8c-04c0126dfa6b tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:39:22 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-46cbc4c0-639f-45f1-8c8c-04c0126dfa6b tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.005s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:39:22 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-46cbc4c0-639f-45f1-8c8c-04c0126dfa6b tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:39:22 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:39:24 user nova-compute[75176]: DEBUG nova.network.neutron [None req-46cbc4c0-639f-45f1-8c8c-04c0126dfa6b tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] [instance: 5b18c889-7694-4edf-8cf2-b9032e60289e] Successfully created port: 59bc046b-fdaa-432c-97b8-67a208dd399b {{(pid=75176) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 15:39:26 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-08041308-9867-45e8-8e9b-4b47f2e82d58 tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] Acquiring lock "e2e25e19-c832-4945-9257-64e6103feb0c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:39:26 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-08041308-9867-45e8-8e9b-4b47f2e82d58 tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] Lock "e2e25e19-c832-4945-9257-64e6103feb0c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:39:26 user nova-compute[75176]: DEBUG nova.compute.manager [None req-08041308-9867-45e8-8e9b-4b47f2e82d58 tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] [instance: e2e25e19-c832-4945-9257-64e6103feb0c] Starting instance... {{(pid=75176) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 15:39:26 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-90378837-8250-492a-a41c-184d80ae6776 tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] Acquiring lock "4ed0eb85-e975-446c-8da7-148a4bb36958" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:39:26 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-90378837-8250-492a-a41c-184d80ae6776 tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] Lock "4ed0eb85-e975-446c-8da7-148a4bb36958" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:39:26 user nova-compute[75176]: DEBUG nova.compute.manager [None req-90378837-8250-492a-a41c-184d80ae6776 tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] [instance: 4ed0eb85-e975-446c-8da7-148a4bb36958] Starting instance... {{(pid=75176) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 15:39:26 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-08041308-9867-45e8-8e9b-4b47f2e82d58 tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:39:26 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-08041308-9867-45e8-8e9b-4b47f2e82d58 tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:39:26 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-08041308-9867-45e8-8e9b-4b47f2e82d58 tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75176) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 15:39:26 user nova-compute[75176]: INFO nova.compute.claims [None req-08041308-9867-45e8-8e9b-4b47f2e82d58 tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] [instance: e2e25e19-c832-4945-9257-64e6103feb0c] Claim successful on node user
Nov 28 15:39:26 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-90378837-8250-492a-a41c-184d80ae6776 tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:39:26 user nova-compute[75176]: DEBUG nova.compute.manager [req-bc6d7648-bd52-48c5-8a29-5da5ffd0f46a req-e808d860-108a-4211-9995-42315b549f9c service nova] [instance: 6ab0619f-72e5-4975-ade8-53d7c0784d89] Received event network-vif-plugged-63e3a2a2-51d4-4899-806d-c3222f643878 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:39:26 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-bc6d7648-bd52-48c5-8a29-5da5ffd0f46a req-e808d860-108a-4211-9995-42315b549f9c service nova] Acquiring lock "6ab0619f-72e5-4975-ade8-53d7c0784d89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:39:26 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-bc6d7648-bd52-48c5-8a29-5da5ffd0f46a req-e808d860-108a-4211-9995-42315b549f9c service nova] Lock "6ab0619f-72e5-4975-ade8-53d7c0784d89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:39:26 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-bc6d7648-bd52-48c5-8a29-5da5ffd0f46a req-e808d860-108a-4211-9995-42315b549f9c service nova] Lock "6ab0619f-72e5-4975-ade8-53d7c0784d89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:39:26 user nova-compute[75176]: DEBUG nova.compute.manager [req-bc6d7648-bd52-48c5-8a29-5da5ffd0f46a req-e808d860-108a-4211-9995-42315b549f9c service nova] [instance: 6ab0619f-72e5-4975-ade8-53d7c0784d89] No waiting events found dispatching network-vif-plugged-63e3a2a2-51d4-4899-806d-c3222f643878 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:39:26 user nova-compute[75176]: WARNING nova.compute.manager [req-bc6d7648-bd52-48c5-8a29-5da5ffd0f46a req-e808d860-108a-4211-9995-42315b549f9c service nova] [instance: 6ab0619f-72e5-4975-ade8-53d7c0784d89] Received unexpected event network-vif-plugged-63e3a2a2-51d4-4899-806d-c3222f643878 for instance with vm_state active and task_state None.
Nov 28 15:39:26 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:39:26 user nova-compute[75176]: DEBUG nova.network.neutron [None req-46cbc4c0-639f-45f1-8c8c-04c0126dfa6b tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] [instance: 5b18c889-7694-4edf-8cf2-b9032e60289e] Successfully updated port: 59bc046b-fdaa-432c-97b8-67a208dd399b {{(pid=75176) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 15:39:26 user nova-compute[75176]: DEBUG nova.compute.provider_tree [None req-08041308-9867-45e8-8e9b-4b47f2e82d58 tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] Inventory has not changed in ProviderTree for provider: b37848d8-f401-4155-a029-b0ffa09ff85b {{(pid=75176) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 15:39:26 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-46cbc4c0-639f-45f1-8c8c-04c0126dfa6b tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] Acquiring lock "refresh_cache-5b18c889-7694-4edf-8cf2-b9032e60289e" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:39:26 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-46cbc4c0-639f-45f1-8c8c-04c0126dfa6b tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] Acquired lock "refresh_cache-5b18c889-7694-4edf-8cf2-b9032e60289e" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:39:26 user nova-compute[75176]: DEBUG nova.network.neutron [None req-46cbc4c0-639f-45f1-8c8c-04c0126dfa6b tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] [instance: 5b18c889-7694-4edf-8cf2-b9032e60289e] Building network info cache for instance {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 15:39:27 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-08041308-9867-45e8-8e9b-4b47f2e82d58 tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] Inventory has not changed for provider b37848d8-f401-4155-a029-b0ffa09ff85b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75176) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 15:39:27 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-08041308-9867-45e8-8e9b-4b47f2e82d58 tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.632s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:39:27 user nova-compute[75176]: DEBUG nova.compute.manager [None req-08041308-9867-45e8-8e9b-4b47f2e82d58 tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] [instance: e2e25e19-c832-4945-9257-64e6103feb0c] Start building networks asynchronously for instance. {{(pid=75176) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 15:39:27 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-90378837-8250-492a-a41c-184d80ae6776 tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.520s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:39:27 user nova-compute[75176]: DEBUG nova.compute.manager [req-cea7056f-eed3-4b70-b157-1cb6491cb505 req-0ff0e732-443b-4a66-9f99-226cbba81770 service nova] [instance: 5b18c889-7694-4edf-8cf2-b9032e60289e] Received event network-changed-59bc046b-fdaa-432c-97b8-67a208dd399b {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:39:27 user nova-compute[75176]: DEBUG nova.compute.manager [req-cea7056f-eed3-4b70-b157-1cb6491cb505 req-0ff0e732-443b-4a66-9f99-226cbba81770 service nova] [instance: 5b18c889-7694-4edf-8cf2-b9032e60289e] Refreshing instance network info cache due to event network-changed-59bc046b-fdaa-432c-97b8-67a208dd399b. {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 15:39:27 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-cea7056f-eed3-4b70-b157-1cb6491cb505 req-0ff0e732-443b-4a66-9f99-226cbba81770 service nova] Acquiring lock "refresh_cache-5b18c889-7694-4edf-8cf2-b9032e60289e" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:39:27 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-90378837-8250-492a-a41c-184d80ae6776 tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75176) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 15:39:27 user nova-compute[75176]: INFO nova.compute.claims [None req-90378837-8250-492a-a41c-184d80ae6776 tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] [instance: 4ed0eb85-e975-446c-8da7-148a4bb36958] Claim successful on node user
Nov 28 15:39:27 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:39:27 user nova-compute[75176]: DEBUG nova.network.neutron [None req-46cbc4c0-639f-45f1-8c8c-04c0126dfa6b tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] [instance: 5b18c889-7694-4edf-8cf2-b9032e60289e] Instance cache missing network info. {{(pid=75176) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 15:39:27 user nova-compute[75176]: DEBUG nova.compute.manager [None req-08041308-9867-45e8-8e9b-4b47f2e82d58 tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] [instance: e2e25e19-c832-4945-9257-64e6103feb0c] Allocating IP information in the background. {{(pid=75176) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 15:39:27 user nova-compute[75176]: DEBUG nova.network.neutron [None req-08041308-9867-45e8-8e9b-4b47f2e82d58 tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] [instance: e2e25e19-c832-4945-9257-64e6103feb0c] allocate_for_instance() {{(pid=75176) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 15:39:27 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-08041308-9867-45e8-8e9b-4b47f2e82d58 tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] [instance: e2e25e19-c832-4945-9257-64e6103feb0c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 15:39:27 user nova-compute[75176]: DEBUG nova.compute.manager [None req-08041308-9867-45e8-8e9b-4b47f2e82d58 tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] [instance: e2e25e19-c832-4945-9257-64e6103feb0c] Start building block device mappings for instance. {{(pid=75176) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 15:39:27 user nova-compute[75176]: DEBUG nova.compute.manager [None req-08041308-9867-45e8-8e9b-4b47f2e82d58 tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] [instance: e2e25e19-c832-4945-9257-64e6103feb0c] Start spawning the instance on the hypervisor. {{(pid=75176) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 15:39:27 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-08041308-9867-45e8-8e9b-4b47f2e82d58 tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] [instance: e2e25e19-c832-4945-9257-64e6103feb0c] Creating instance directory {{(pid=75176) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 15:39:27 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-08041308-9867-45e8-8e9b-4b47f2e82d58 tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] [instance: e2e25e19-c832-4945-9257-64e6103feb0c] Creating image(s)
Nov 28 15:39:27 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-08041308-9867-45e8-8e9b-4b47f2e82d58 tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] Acquiring lock "/opt/stack/data/nova/instances/e2e25e19-c832-4945-9257-64e6103feb0c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:39:27 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-08041308-9867-45e8-8e9b-4b47f2e82d58 tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] Lock "/opt/stack/data/nova/instances/e2e25e19-c832-4945-9257-64e6103feb0c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:39:27 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-08041308-9867-45e8-8e9b-4b47f2e82d58 tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] Lock "/opt/stack/data/nova/instances/e2e25e19-c832-4945-9257-64e6103feb0c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.011s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:39:27 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-08041308-9867-45e8-8e9b-4b47f2e82d58 tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:39:27 user nova-compute[75176]: DEBUG nova.policy [None req-08041308-9867-45e8-8e9b-4b47f2e82d58 tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5b8c4eae6ef14fa2b416c67f86e85971', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca8d4f7f4934dbdbd6ba92f51fba4b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75176) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 15:39:27 user nova-compute[75176]: DEBUG nova.compute.provider_tree [None req-90378837-8250-492a-a41c-184d80ae6776 tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] Inventory has not changed in ProviderTree for provider: b37848d8-f401-4155-a029-b0ffa09ff85b {{(pid=75176) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 15:39:27 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-90378837-8250-492a-a41c-184d80ae6776 tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] Inventory has not changed for provider b37848d8-f401-4155-a029-b0ffa09ff85b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75176) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 15:39:27 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-08041308-9867-45e8-8e9b-4b47f2e82d58 tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json" returned: 0 in 0.290s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:39:27 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-08041308-9867-45e8-8e9b-4b47f2e82d58 tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] Acquiring lock "5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:39:27 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-08041308-9867-45e8-8e9b-4b47f2e82d58 tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] Lock "5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.005s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:39:27 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-08041308-9867-45e8-8e9b-4b47f2e82d58 tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:39:27 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-90378837-8250-492a-a41c-184d80ae6776 tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.694s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:39:27 user nova-compute[75176]: DEBUG nova.compute.manager [None req-90378837-8250-492a-a41c-184d80ae6776 tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] [instance: 4ed0eb85-e975-446c-8da7-148a4bb36958] Start building networks asynchronously for instance. {{(pid=75176) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 15:39:27 user nova-compute[75176]: DEBUG nova.network.neutron [None req-46cbc4c0-639f-45f1-8c8c-04c0126dfa6b tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] [instance: 5b18c889-7694-4edf-8cf2-b9032e60289e] Updating instance_info_cache with network_info: [{"id": "59bc046b-fdaa-432c-97b8-67a208dd399b", "address": "fa:16:3e:e5:e8:01", "network": {"id": "1c357ee9-ff80-4a4b-9fd5-f2f348b36acc", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1869945166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0518c3ca77e4ecebb6ea8fbf6e60219", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59bc046b-fd", "ovs_interfaceid": "59bc046b-fdaa-432c-97b8-67a208dd399b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:39:27 user nova-compute[75176]: DEBUG nova.compute.manager [None req-90378837-8250-492a-a41c-184d80ae6776 tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] [instance: 4ed0eb85-e975-446c-8da7-148a4bb36958] Allocating IP information in the background. {{(pid=75176) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 15:39:27 user nova-compute[75176]: DEBUG nova.network.neutron [None req-90378837-8250-492a-a41c-184d80ae6776 tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] [instance: 4ed0eb85-e975-446c-8da7-148a4bb36958] allocate_for_instance() {{(pid=75176) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 15:39:27 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-90378837-8250-492a-a41c-184d80ae6776 tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] [instance: 4ed0eb85-e975-446c-8da7-148a4bb36958] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Nov 28 15:39:27 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-46cbc4c0-639f-45f1-8c8c-04c0126dfa6b tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] Releasing lock "refresh_cache-5b18c889-7694-4edf-8cf2-b9032e60289e" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:39:27 user nova-compute[75176]: DEBUG nova.compute.manager [None req-46cbc4c0-639f-45f1-8c8c-04c0126dfa6b tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] [instance: 5b18c889-7694-4edf-8cf2-b9032e60289e] Instance network_info: |[{"id": "59bc046b-fdaa-432c-97b8-67a208dd399b", "address": "fa:16:3e:e5:e8:01", "network": {"id": "1c357ee9-ff80-4a4b-9fd5-f2f348b36acc", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1869945166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0518c3ca77e4ecebb6ea8fbf6e60219", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59bc046b-fd", "ovs_interfaceid": "59bc046b-fdaa-432c-97b8-67a208dd399b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75176) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 15:39:27 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-cea7056f-eed3-4b70-b157-1cb6491cb505 req-0ff0e732-443b-4a66-9f99-226cbba81770 service nova] Acquired lock "refresh_cache-5b18c889-7694-4edf-8cf2-b9032e60289e" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:39:27 user nova-compute[75176]: DEBUG nova.network.neutron [req-cea7056f-eed3-4b70-b157-1cb6491cb505 req-0ff0e732-443b-4a66-9f99-226cbba81770 service nova] [instance: 5b18c889-7694-4edf-8cf2-b9032e60289e] Refreshing network info cache for port 59bc046b-fdaa-432c-97b8-67a208dd399b {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 15:39:27 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-46cbc4c0-639f-45f1-8c8c-04c0126dfa6b tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] [instance: 5b18c889-7694-4edf-8cf2-b9032e60289e] Start _get_guest_xml network_info=[{"id": "59bc046b-fdaa-432c-97b8-67a208dd399b", "address": "fa:16:3e:e5:e8:01", "network": {"id": "1c357ee9-ff80-4a4b-9fd5-f2f348b36acc", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1869945166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0518c3ca77e4ecebb6ea8fbf6e60219", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59bc046b-fd", "ovs_interfaceid": "59bc046b-fdaa-432c-97b8-67a208dd399b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T15:35:12Z,direct_url=<?>,disk_format='qcow2',id=1f41819e-c93f-4dc7-b253-37a27bbbbc74,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1b91c5d0672c4224a48df2e1f92688e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T15:35:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'size': 0, 'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'image_id': '1f41819e-c93f-4dc7-b253-37a27bbbbc74'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75176) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 15:39:27 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:39:27 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-08041308-9867-45e8-8e9b-4b47f2e82d58 tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json" returned: 0 in 0.203s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:39:27 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-08041308-9867-45e8-8e9b-4b47f2e82d58 tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2,backing_fmt=raw /opt/stack/data/nova/instances/e2e25e19-c832-4945-9257-64e6103feb0c/disk 1073741824 {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:39:27 user nova-compute[75176]: DEBUG nova.compute.manager [None req-90378837-8250-492a-a41c-184d80ae6776 tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] [instance: 4ed0eb85-e975-446c-8da7-148a4bb36958] Start building block device mappings for instance. {{(pid=75176) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 15:39:27 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-08041308-9867-45e8-8e9b-4b47f2e82d58 tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2,backing_fmt=raw /opt/stack/data/nova/instances/e2e25e19-c832-4945-9257-64e6103feb0c/disk 1073741824" returned: 0 in 0.073s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:39:28 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-08041308-9867-45e8-8e9b-4b47f2e82d58 tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] Lock "5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.291s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:39:28 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-08041308-9867-45e8-8e9b-4b47f2e82d58 tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:39:28 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-46cbc4c0-639f-45f1-8c8c-04c0126dfa6b tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 15:39:28 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-46cbc4c0-639f-45f1-8c8c-04c0126dfa6b tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 15:39:28 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-46cbc4c0-639f-45f1-8c8c-04c0126dfa6b tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75176) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 15:39:28 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-46cbc4c0-639f-45f1-8c8c-04c0126dfa6b tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] CPU controller missing on host. {{(pid=75176) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 15:39:28 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-46cbc4c0-639f-45f1-8c8c-04c0126dfa6b tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75176) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 15:39:28 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-46cbc4c0-639f-45f1-8c8c-04c0126dfa6b tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] CPU controller found on host. {{(pid=75176) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 15:39:28 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-46cbc4c0-639f-45f1-8c8c-04c0126dfa6b tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75176) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 15:39:28 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-46cbc4c0-639f-45f1-8c8c-04c0126dfa6b tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T15:35:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T15:35:12Z,direct_url=<?>,disk_format='qcow2',id=1f41819e-c93f-4dc7-b253-37a27bbbbc74,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1b91c5d0672c4224a48df2e1f92688e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T15:35:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 15:39:28 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-46cbc4c0-639f-45f1-8c8c-04c0126dfa6b tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] Flavor limits 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 15:39:28 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-46cbc4c0-639f-45f1-8c8c-04c0126dfa6b tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] Image limits 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 15:39:28 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-46cbc4c0-639f-45f1-8c8c-04c0126dfa6b tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] Flavor pref 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 15:39:28 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-46cbc4c0-639f-45f1-8c8c-04c0126dfa6b tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] Image pref 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 15:39:28 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-46cbc4c0-639f-45f1-8c8c-04c0126dfa6b tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 15:39:28 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-46cbc4c0-639f-45f1-8c8c-04c0126dfa6b tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 15:39:28 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-46cbc4c0-639f-45f1-8c8c-04c0126dfa6b tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75176) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 15:39:28 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-46cbc4c0-639f-45f1-8c8c-04c0126dfa6b tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] Got 1 possible topologies {{(pid=75176) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 15:39:28 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-46cbc4c0-639f-45f1-8c8c-04c0126dfa6b tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 15:39:28 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-46cbc4c0-639f-45f1-8c8c-04c0126dfa6b tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 15:39:28 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-46cbc4c0-639f-45f1-8c8c-04c0126dfa6b tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T15:39:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-2015797286',display_name='tempest-VolumesAdminNegativeTest-server-2015797286',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-2015797286',id=5,image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOvlvdx2rwcOZt7MZwoXcbKUeFdZ3U5p4MG2H2cUXYwmWIRtskZVrUKpwCBkkVdVAP/wON/TgO+zoxwLCK4zd98ZDPVUy0lGCfZjd7+hfeGGIDCzfBDCoWEUl1VpKZVBIQ==',key_name='tempest-keypair-1593476277',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c0518c3ca77e4ecebb6ea8fbf6e60219',ramdisk_id='',reservation_id='r-ibby1f0s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1622644648',owner_user_name='tempest-VolumesAdminNegativeTest-1622644648-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T15:39:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b339a055aaf24d25946cc16369bddc2f',uuid=5b18c889-7694-4edf-8cf2-b9032e60289e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "59bc046b-fdaa-432c-97b8-67a208dd399b", "address": "fa:16:3e:e5:e8:01", "network": {"id": "1c357ee9-ff80-4a4b-9fd5-f2f348b36acc", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1869945166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0518c3ca77e4ecebb6ea8fbf6e60219", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59bc046b-fd", "ovs_interfaceid": "59bc046b-fdaa-432c-97b8-67a208dd399b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75176) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 15:39:28 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-46cbc4c0-639f-45f1-8c8c-04c0126dfa6b tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] Converting VIF {"id": "59bc046b-fdaa-432c-97b8-67a208dd399b", "address": "fa:16:3e:e5:e8:01", "network": {"id": "1c357ee9-ff80-4a4b-9fd5-f2f348b36acc", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1869945166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0518c3ca77e4ecebb6ea8fbf6e60219", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59bc046b-fd", "ovs_interfaceid": "59bc046b-fdaa-432c-97b8-67a208dd399b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:39:28 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-46cbc4c0-639f-45f1-8c8c-04c0126dfa6b tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:e8:01,bridge_name='br-int',has_traffic_filtering=True,id=59bc046b-fdaa-432c-97b8-67a208dd399b,network=Network(1c357ee9-ff80-4a4b-9fd5-f2f348b36acc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59bc046b-fd') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:39:28 user nova-compute[75176]: DEBUG nova.objects.instance [None req-46cbc4c0-639f-45f1-8c8c-04c0126dfa6b tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] Lazy-loading 'pci_devices' on Instance uuid 5b18c889-7694-4edf-8cf2-b9032e60289e {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:39:28 user nova-compute[75176]: DEBUG nova.compute.manager [None req-90378837-8250-492a-a41c-184d80ae6776 tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] [instance: 4ed0eb85-e975-446c-8da7-148a4bb36958] Start spawning the instance on the hypervisor. {{(pid=75176) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 15:39:28 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-90378837-8250-492a-a41c-184d80ae6776 tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] [instance: 4ed0eb85-e975-446c-8da7-148a4bb36958] Creating instance directory {{(pid=75176) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 15:39:28 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-90378837-8250-492a-a41c-184d80ae6776 tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] [instance: 4ed0eb85-e975-446c-8da7-148a4bb36958] Creating image(s)
Nov 28 15:39:28 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-90378837-8250-492a-a41c-184d80ae6776 tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] Acquiring lock "/opt/stack/data/nova/instances/4ed0eb85-e975-446c-8da7-148a4bb36958/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:39:28 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-90378837-8250-492a-a41c-184d80ae6776 tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] Lock "/opt/stack/data/nova/instances/4ed0eb85-e975-446c-8da7-148a4bb36958/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:39:28 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-90378837-8250-492a-a41c-184d80ae6776 tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] Lock "/opt/stack/data/nova/instances/4ed0eb85-e975-446c-8da7-148a4bb36958/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:39:28 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-90378837-8250-492a-a41c-184d80ae6776 tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] Acquiring lock "f146e8f0887767cab5db3c3bbf1c8593b766c4dd" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:39:28 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-90378837-8250-492a-a41c-184d80ae6776 tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] Lock "f146e8f0887767cab5db3c3bbf1c8593b766c4dd" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:39:28 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-46cbc4c0-639f-45f1-8c8c-04c0126dfa6b tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] [instance: 5b18c889-7694-4edf-8cf2-b9032e60289e] End _get_guest_xml xml=<domain type="kvm">
Nov 28 15:39:28 user nova-compute[75176]:   <uuid>5b18c889-7694-4edf-8cf2-b9032e60289e</uuid>
Nov 28 15:39:28 user nova-compute[75176]:   <name>instance-00000005</name>
Nov 28 15:39:28 user nova-compute[75176]:   <memory>524288</memory>
Nov 28 15:39:28 user nova-compute[75176]:   <vcpu>1</vcpu>
Nov 28 15:39:28 user nova-compute[75176]:   <metadata>
Nov 28 15:39:28 user nova-compute[75176]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 15:39:28 user nova-compute[75176]:       <nova:package version="0.0.0"/>
Nov 28 15:39:28 user nova-compute[75176]:       <nova:name>tempest-VolumesAdminNegativeTest-server-2015797286</nova:name>
Nov 28 15:39:28 user nova-compute[75176]:       <nova:creationTime>2023-11-28 15:39:28</nova:creationTime>
Nov 28 15:39:28 user nova-compute[75176]:       <nova:flavor name="m1.tiny">
Nov 28 15:39:28 user nova-compute[75176]:         <nova:memory>512</nova:memory>
Nov 28 15:39:28 user nova-compute[75176]:         <nova:disk>1</nova:disk>
Nov 28 15:39:28 user nova-compute[75176]:         <nova:swap>0</nova:swap>
Nov 28 15:39:28 user nova-compute[75176]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 15:39:28 user nova-compute[75176]:         <nova:vcpus>1</nova:vcpus>
Nov 28 15:39:28 user nova-compute[75176]:       </nova:flavor>
Nov 28 15:39:28 user nova-compute[75176]:       <nova:owner>
Nov 28 15:39:28 user nova-compute[75176]:         <nova:user uuid="b339a055aaf24d25946cc16369bddc2f">tempest-VolumesAdminNegativeTest-1622644648-project-member</nova:user>
Nov 28 15:39:28 user nova-compute[75176]:         <nova:project uuid="c0518c3ca77e4ecebb6ea8fbf6e60219">tempest-VolumesAdminNegativeTest-1622644648</nova:project>
Nov 28 15:39:28 user nova-compute[75176]:       </nova:owner>
Nov 28 15:39:28 user nova-compute[75176]:       <nova:root type="image" uuid="1f41819e-c93f-4dc7-b253-37a27bbbbc74"/>
Nov 28 15:39:28 user nova-compute[75176]:       <nova:ports>
Nov 28 15:39:28 user nova-compute[75176]:         <nova:port uuid="59bc046b-fdaa-432c-97b8-67a208dd399b">
Nov 28 15:39:28 user nova-compute[75176]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 28 15:39:28 user nova-compute[75176]:         </nova:port>
Nov 28 15:39:28 user nova-compute[75176]:       </nova:ports>
Nov 28 15:39:28 user nova-compute[75176]:     </nova:instance>
Nov 28 15:39:28 user nova-compute[75176]:   </metadata>
Nov 28 15:39:28 user nova-compute[75176]:   <sysinfo type="smbios">
Nov 28 15:39:28 user nova-compute[75176]:     <system>
Nov 28 15:39:28 user nova-compute[75176]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 15:39:28 user nova-compute[75176]:       <entry name="product">OpenStack Nova</entry>
Nov 28 15:39:28 user nova-compute[75176]:       <entry name="version">0.0.0</entry>
Nov 28 15:39:28 user nova-compute[75176]:       <entry name="serial">5b18c889-7694-4edf-8cf2-b9032e60289e</entry>
Nov 28 15:39:28 user nova-compute[75176]:       <entry name="uuid">5b18c889-7694-4edf-8cf2-b9032e60289e</entry>
Nov 28 15:39:28 user nova-compute[75176]:       <entry name="family">Virtual Machine</entry>
Nov 28 15:39:28 user nova-compute[75176]:     </system>
Nov 28 15:39:28 user nova-compute[75176]:   </sysinfo>
Nov 28 15:39:28 user nova-compute[75176]:   <os>
Nov 28 15:39:28 user nova-compute[75176]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 15:39:28 user nova-compute[75176]:     <boot dev="hd"/>
Nov 28 15:39:28 user nova-compute[75176]:     <smbios mode="sysinfo"/>
Nov 28 15:39:28 user nova-compute[75176]:   </os>
Nov 28 15:39:28 user nova-compute[75176]:   <features>
Nov 28 15:39:28 user nova-compute[75176]:     <acpi/>
Nov 28 15:39:28 user nova-compute[75176]:     <apic/>
Nov 28 15:39:28 user nova-compute[75176]:     <vmcoreinfo/>
Nov 28 15:39:28 user nova-compute[75176]:   </features>
Nov 28 15:39:28 user nova-compute[75176]:   <clock offset="utc">
Nov 28 15:39:28 user nova-compute[75176]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 15:39:28 user nova-compute[75176]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 15:39:28 user nova-compute[75176]:     <timer name="hpet" present="no"/>
Nov 28 15:39:28 user nova-compute[75176]:   </clock>
Nov 28 15:39:28 user nova-compute[75176]:   <cpu mode="custom" match="exact">
Nov 28 15:39:28 user nova-compute[75176]:     <model>Nehalem</model>
Nov 28 15:39:28 user nova-compute[75176]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 15:39:28 user nova-compute[75176]:   </cpu>
Nov 28 15:39:28 user nova-compute[75176]:   <devices>
Nov 28 15:39:28 user nova-compute[75176]:     <disk type="file" device="disk">
Nov 28 15:39:28 user nova-compute[75176]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 15:39:28 user nova-compute[75176]:       <source file="/opt/stack/data/nova/instances/5b18c889-7694-4edf-8cf2-b9032e60289e/disk"/>
Nov 28 15:39:28 user nova-compute[75176]:       <target dev="vda" bus="virtio"/>
Nov 28 15:39:28 user nova-compute[75176]:     </disk>
Nov 28 15:39:28 user nova-compute[75176]:     <interface type="ethernet">
Nov 28 15:39:28 user nova-compute[75176]:       <mac address="fa:16:3e:e5:e8:01"/>
Nov 28 15:39:28 user nova-compute[75176]:       <model type="virtio"/>
Nov 28 15:39:28 user nova-compute[75176]:       <mtu size="1442"/>
Nov 28 15:39:28 user nova-compute[75176]:       <target dev="tap59bc046b-fd"/>
Nov 28 15:39:28 user nova-compute[75176]:     </interface>
Nov 28 15:39:28 user nova-compute[75176]:     <serial type="pty">
Nov 28 15:39:28 user nova-compute[75176]:       <log file="/opt/stack/data/nova/instances/5b18c889-7694-4edf-8cf2-b9032e60289e/console.log" append="off"/>
Nov 28 15:39:28 user nova-compute[75176]:     </serial>
Nov 28 15:39:28 user nova-compute[75176]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 15:39:28 user nova-compute[75176]:     <video>
Nov 28 15:39:28 user nova-compute[75176]:       <model type="virtio"/>
Nov 28 15:39:28 user nova-compute[75176]:     </video>
Nov 28 15:39:28 user nova-compute[75176]:     <rng model="virtio">
Nov 28 15:39:28 user nova-compute[75176]:       <backend model="random">/dev/urandom</backend>
Nov 28 15:39:28 user nova-compute[75176]:     </rng>
Nov 28 15:39:28 user nova-compute[75176]:     <controller type="usb" index="0" model="none"/>
Nov 28 15:39:28 user nova-compute[75176]:     <memballoon model="virtio">
Nov 28 15:39:28 user nova-compute[75176]:       <stats period="10"/>
Nov 28 15:39:28 user nova-compute[75176]:     </memballoon>
Nov 28 15:39:28 user nova-compute[75176]:   </devices>
Nov 28 15:39:28 user nova-compute[75176]: </domain>
Nov 28 15:39:28 user nova-compute[75176]:  {{(pid=75176) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 15:39:28 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-46cbc4c0-639f-45f1-8c8c-04c0126dfa6b tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T15:39:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-2015797286',display_name='tempest-VolumesAdminNegativeTest-server-2015797286',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-2015797286',id=5,image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOvlvdx2rwcOZt7MZwoXcbKUeFdZ3U5p4MG2H2cUXYwmWIRtskZVrUKpwCBkkVdVAP/wON/TgO+zoxwLCK4zd98ZDPVUy0lGCfZjd7+hfeGGIDCzfBDCoWEUl1VpKZVBIQ==',key_name='tempest-keypair-1593476277',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c0518c3ca77e4ecebb6ea8fbf6e60219',ramdisk_id='',reservation_id='r-ibby1f0s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1622644648',owner_user_name='tempest-VolumesAdminNegativeTest-1622644648-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T15:39:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b339a055aaf24d25946cc16369bddc2f',uuid=5b18c889-7694-4edf-8cf2-b9032e60289e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "59bc046b-fdaa-432c-97b8-67a208dd399b", "address": "fa:16:3e:e5:e8:01", "network": {"id": "1c357ee9-ff80-4a4b-9fd5-f2f348b36acc", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1869945166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0518c3ca77e4ecebb6ea8fbf6e60219", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59bc046b-fd", "ovs_interfaceid": "59bc046b-fdaa-432c-97b8-67a208dd399b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 15:39:28 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-46cbc4c0-639f-45f1-8c8c-04c0126dfa6b tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] Converting VIF {"id": "59bc046b-fdaa-432c-97b8-67a208dd399b", "address": "fa:16:3e:e5:e8:01", "network": {"id": "1c357ee9-ff80-4a4b-9fd5-f2f348b36acc", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1869945166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0518c3ca77e4ecebb6ea8fbf6e60219", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59bc046b-fd", "ovs_interfaceid": "59bc046b-fdaa-432c-97b8-67a208dd399b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:39:28 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-46cbc4c0-639f-45f1-8c8c-04c0126dfa6b tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:e8:01,bridge_name='br-int',has_traffic_filtering=True,id=59bc046b-fdaa-432c-97b8-67a208dd399b,network=Network(1c357ee9-ff80-4a4b-9fd5-f2f348b36acc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59bc046b-fd') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:39:28 user nova-compute[75176]: DEBUG os_vif [None req-46cbc4c0-639f-45f1-8c8c-04c0126dfa6b tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:e8:01,bridge_name='br-int',has_traffic_filtering=True,id=59bc046b-fdaa-432c-97b8-67a208dd399b,network=Network(1c357ee9-ff80-4a4b-9fd5-f2f348b36acc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59bc046b-fd') {{(pid=75176) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 15:39:28 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:39:28 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:39:28 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 15:39:28 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-08041308-9867-45e8-8e9b-4b47f2e82d58 tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json" returned: 0 in 0.219s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:39:28 user nova-compute[75176]: DEBUG nova.virt.disk.api [None req-08041308-9867-45e8-8e9b-4b47f2e82d58 tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e2e25e19-c832-4945-9257-64e6103feb0c/disk. size=1073741824 {{(pid=75176) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 15:39:28 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-08041308-9867-45e8-8e9b-4b47f2e82d58 tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2e25e19-c832-4945-9257-64e6103feb0c/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:39:28 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:39:28 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '90f92894-8eac-5058-994d-a223310a0a81', '_type': 'linux-noop'}}, row=False) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:39:28 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:39:28 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:39:28 user nova-compute[75176]: DEBUG nova.policy [None req-90378837-8250-492a-a41c-184d80ae6776 tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '84613ff663a942df897c3510ef40888f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed2357254f24be99031f60700f97988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75176) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 15:39:28 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:39:28 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap59bc046b-fd, may_exist=True, interface_attrs={}) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:39:28 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap59bc046b-fd, col_values=(('qos', UUID('15eb7097-a145-4d15-8b3e-cac0edc090a9')),), if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:39:28 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap59bc046b-fd, col_values=(('external_ids', {'iface-id': '59bc046b-fdaa-432c-97b8-67a208dd399b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e5:e8:01', 'vm-uuid': '5b18c889-7694-4edf-8cf2-b9032e60289e'}),), if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:39:28 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:39:28 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-90378837-8250-492a-a41c-184d80ae6776 tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f146e8f0887767cab5db3c3bbf1c8593b766c4dd.part --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:39:28 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:39:28 user nova-compute[75176]: INFO os_vif [None req-46cbc4c0-639f-45f1-8c8c-04c0126dfa6b tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:e8:01,bridge_name='br-int',has_traffic_filtering=True,id=59bc046b-fdaa-432c-97b8-67a208dd399b,network=Network(1c357ee9-ff80-4a4b-9fd5-f2f348b36acc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59bc046b-fd')
Nov 28 15:39:28 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-08041308-9867-45e8-8e9b-4b47f2e82d58 tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2e25e19-c832-4945-9257-64e6103feb0c/disk --force-share --output=json" returned: 0 in 0.506s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:39:28 user nova-compute[75176]: DEBUG nova.virt.disk.api [None req-08041308-9867-45e8-8e9b-4b47f2e82d58 tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] Cannot resize image /opt/stack/data/nova/instances/e2e25e19-c832-4945-9257-64e6103feb0c/disk to a smaller size. {{(pid=75176) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 15:39:28 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-08041308-9867-45e8-8e9b-4b47f2e82d58 tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] [instance: e2e25e19-c832-4945-9257-64e6103feb0c] Created local disks {{(pid=75176) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 15:39:28 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-08041308-9867-45e8-8e9b-4b47f2e82d58 tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] [instance: e2e25e19-c832-4945-9257-64e6103feb0c] Ensure instance console log exists: /opt/stack/data/nova/instances/e2e25e19-c832-4945-9257-64e6103feb0c/console.log {{(pid=75176) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 15:39:28 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-08041308-9867-45e8-8e9b-4b47f2e82d58 tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:39:28 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-08041308-9867-45e8-8e9b-4b47f2e82d58 tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:39:28 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-08041308-9867-45e8-8e9b-4b47f2e82d58 tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:39:28 user nova-compute[75176]: DEBUG nova.compute.manager [req-c367f066-b93a-4721-82a7-70e6d9feb382 req-a8e176b3-ee64-49c4-b429-6f390e6b0f3c service nova] [instance: 6ab0619f-72e5-4975-ade8-53d7c0784d89] Received event network-vif-plugged-63e3a2a2-51d4-4899-806d-c3222f643878 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:39:28 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-c367f066-b93a-4721-82a7-70e6d9feb382 req-a8e176b3-ee64-49c4-b429-6f390e6b0f3c service nova] Acquiring lock "6ab0619f-72e5-4975-ade8-53d7c0784d89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:39:28 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-c367f066-b93a-4721-82a7-70e6d9feb382 req-a8e176b3-ee64-49c4-b429-6f390e6b0f3c service nova] Lock "6ab0619f-72e5-4975-ade8-53d7c0784d89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:39:28 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-c367f066-b93a-4721-82a7-70e6d9feb382 req-a8e176b3-ee64-49c4-b429-6f390e6b0f3c service nova] Lock "6ab0619f-72e5-4975-ade8-53d7c0784d89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:39:28 user nova-compute[75176]: DEBUG nova.compute.manager [req-c367f066-b93a-4721-82a7-70e6d9feb382 req-a8e176b3-ee64-49c4-b429-6f390e6b0f3c service nova] [instance: 6ab0619f-72e5-4975-ade8-53d7c0784d89] No waiting events found dispatching network-vif-plugged-63e3a2a2-51d4-4899-806d-c3222f643878 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:39:28 user nova-compute[75176]: WARNING nova.compute.manager [req-c367f066-b93a-4721-82a7-70e6d9feb382 req-a8e176b3-ee64-49c4-b429-6f390e6b0f3c service nova] [instance: 6ab0619f-72e5-4975-ade8-53d7c0784d89] Received unexpected event network-vif-plugged-63e3a2a2-51d4-4899-806d-c3222f643878 for instance with vm_state active and task_state None.
Nov 28 15:39:28 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-46cbc4c0-639f-45f1-8c8c-04c0126dfa6b tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] No BDM found with device name vda, not building metadata. {{(pid=75176) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 15:39:28 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-46cbc4c0-639f-45f1-8c8c-04c0126dfa6b tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] No VIF found with MAC fa:16:3e:e5:e8:01, not building metadata {{(pid=75176) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 15:39:28 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-90378837-8250-492a-a41c-184d80ae6776 tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f146e8f0887767cab5db3c3bbf1c8593b766c4dd.part --force-share --output=json" returned: 0 in 0.253s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:39:28 user nova-compute[75176]: DEBUG nova.virt.images [None req-90378837-8250-492a-a41c-184d80ae6776 tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] 1cea193d-2f53-4621-897c-2c6c5842cffc was qcow2, converting to raw {{(pid=75176) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 28 15:39:28 user nova-compute[75176]: DEBUG nova.privsep.utils [None req-90378837-8250-492a-a41c-184d80ae6776 tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75176) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 28 15:39:28 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-90378837-8250-492a-a41c-184d80ae6776 tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f146e8f0887767cab5db3c3bbf1c8593b766c4dd.part /opt/stack/data/nova/instances/_base/f146e8f0887767cab5db3c3bbf1c8593b766c4dd.converted {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:39:28 user nova-compute[75176]: DEBUG nova.network.neutron [req-cea7056f-eed3-4b70-b157-1cb6491cb505 req-0ff0e732-443b-4a66-9f99-226cbba81770 service nova] [instance: 5b18c889-7694-4edf-8cf2-b9032e60289e] Updated VIF entry in instance network info cache for port 59bc046b-fdaa-432c-97b8-67a208dd399b. {{(pid=75176) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 15:39:28 user nova-compute[75176]: DEBUG nova.network.neutron [req-cea7056f-eed3-4b70-b157-1cb6491cb505 req-0ff0e732-443b-4a66-9f99-226cbba81770 service nova] [instance: 5b18c889-7694-4edf-8cf2-b9032e60289e] Updating instance_info_cache with network_info: [{"id": "59bc046b-fdaa-432c-97b8-67a208dd399b", "address": "fa:16:3e:e5:e8:01", "network": {"id": "1c357ee9-ff80-4a4b-9fd5-f2f348b36acc", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1869945166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0518c3ca77e4ecebb6ea8fbf6e60219", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59bc046b-fd", "ovs_interfaceid": "59bc046b-fdaa-432c-97b8-67a208dd399b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:39:29 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-cea7056f-eed3-4b70-b157-1cb6491cb505 req-0ff0e732-443b-4a66-9f99-226cbba81770 service nova] Releasing lock "refresh_cache-5b18c889-7694-4edf-8cf2-b9032e60289e" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:39:29 user nova-compute[75176]: DEBUG nova.network.neutron [None req-08041308-9867-45e8-8e9b-4b47f2e82d58 tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] [instance: e2e25e19-c832-4945-9257-64e6103feb0c] Successfully created port: 05efa912-30d1-4474-a2eb-7d88fa0813e7 {{(pid=75176) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 15:39:29 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-90378837-8250-492a-a41c-184d80ae6776 tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f146e8f0887767cab5db3c3bbf1c8593b766c4dd.part /opt/stack/data/nova/instances/_base/f146e8f0887767cab5db3c3bbf1c8593b766c4dd.converted" returned: 0 in 0.446s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:39:29 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-90378837-8250-492a-a41c-184d80ae6776 tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f146e8f0887767cab5db3c3bbf1c8593b766c4dd.converted --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:39:29 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-90378837-8250-492a-a41c-184d80ae6776 tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f146e8f0887767cab5db3c3bbf1c8593b766c4dd.converted --force-share --output=json" returned: 0 in 0.245s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:39:29 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-90378837-8250-492a-a41c-184d80ae6776 tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] Lock "f146e8f0887767cab5db3c3bbf1c8593b766c4dd" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.433s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:39:29 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-90378837-8250-492a-a41c-184d80ae6776 tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f146e8f0887767cab5db3c3bbf1c8593b766c4dd --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:39:29 user nova-compute[75176]: DEBUG nova.network.neutron [None req-90378837-8250-492a-a41c-184d80ae6776 tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] [instance: 4ed0eb85-e975-446c-8da7-148a4bb36958] Successfully created port: 9996a5ef-0801-4136-bd1d-fd5372d97e9d {{(pid=75176) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 15:39:29 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-90378837-8250-492a-a41c-184d80ae6776 tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f146e8f0887767cab5db3c3bbf1c8593b766c4dd --force-share --output=json" returned: 0 in 0.252s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:39:29 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-90378837-8250-492a-a41c-184d80ae6776 tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] Acquiring lock "f146e8f0887767cab5db3c3bbf1c8593b766c4dd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:39:29 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-90378837-8250-492a-a41c-184d80ae6776 tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] Lock "f146e8f0887767cab5db3c3bbf1c8593b766c4dd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:39:29 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-90378837-8250-492a-a41c-184d80ae6776 tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f146e8f0887767cab5db3c3bbf1c8593b766c4dd --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:39:30 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-90378837-8250-492a-a41c-184d80ae6776 tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f146e8f0887767cab5db3c3bbf1c8593b766c4dd --force-share --output=json" returned: 0 in 0.270s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:39:30 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-90378837-8250-492a-a41c-184d80ae6776 tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f146e8f0887767cab5db3c3bbf1c8593b766c4dd,backing_fmt=raw /opt/stack/data/nova/instances/4ed0eb85-e975-446c-8da7-148a4bb36958/disk 1073741824 {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:39:30 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-90378837-8250-492a-a41c-184d80ae6776 tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f146e8f0887767cab5db3c3bbf1c8593b766c4dd,backing_fmt=raw /opt/stack/data/nova/instances/4ed0eb85-e975-446c-8da7-148a4bb36958/disk 1073741824" returned: 0 in 0.166s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:39:30 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-90378837-8250-492a-a41c-184d80ae6776 tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] Lock "f146e8f0887767cab5db3c3bbf1c8593b766c4dd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.449s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:39:30 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-90378837-8250-492a-a41c-184d80ae6776 tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f146e8f0887767cab5db3c3bbf1c8593b766c4dd --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:39:30 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:39:30 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:39:30 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-90378837-8250-492a-a41c-184d80ae6776 tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f146e8f0887767cab5db3c3bbf1c8593b766c4dd --force-share --output=json" returned: 0 in 0.329s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:39:30 user nova-compute[75176]: DEBUG nova.virt.disk.api [None req-90378837-8250-492a-a41c-184d80ae6776 tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4ed0eb85-e975-446c-8da7-148a4bb36958/disk. size=1073741824 {{(pid=75176) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 15:39:30 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-90378837-8250-492a-a41c-184d80ae6776 tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ed0eb85-e975-446c-8da7-148a4bb36958/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:39:31 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-90378837-8250-492a-a41c-184d80ae6776 tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ed0eb85-e975-446c-8da7-148a4bb36958/disk --force-share --output=json" returned: 0 in 0.336s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:39:31 user nova-compute[75176]: DEBUG nova.virt.disk.api [None req-90378837-8250-492a-a41c-184d80ae6776 tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] Cannot resize image /opt/stack/data/nova/instances/4ed0eb85-e975-446c-8da7-148a4bb36958/disk to a smaller size. {{(pid=75176) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 15:39:31 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-90378837-8250-492a-a41c-184d80ae6776 tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] [instance: 4ed0eb85-e975-446c-8da7-148a4bb36958] Created local disks {{(pid=75176) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 15:39:31 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-90378837-8250-492a-a41c-184d80ae6776 tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] [instance: 4ed0eb85-e975-446c-8da7-148a4bb36958] Ensure instance console log exists: /opt/stack/data/nova/instances/4ed0eb85-e975-446c-8da7-148a4bb36958/console.log {{(pid=75176) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 15:39:31 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-90378837-8250-492a-a41c-184d80ae6776 tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:39:31 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-90378837-8250-492a-a41c-184d80ae6776 tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:39:31 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-90378837-8250-492a-a41c-184d80ae6776 tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:39:31 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:39:32 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:39:32 user nova-compute[75176]: DEBUG nova.network.neutron [None req-08041308-9867-45e8-8e9b-4b47f2e82d58 tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] [instance: e2e25e19-c832-4945-9257-64e6103feb0c] Successfully updated port: 05efa912-30d1-4474-a2eb-7d88fa0813e7 {{(pid=75176) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 15:39:32 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-08041308-9867-45e8-8e9b-4b47f2e82d58 tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] Acquiring lock "refresh_cache-e2e25e19-c832-4945-9257-64e6103feb0c" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:39:32 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-08041308-9867-45e8-8e9b-4b47f2e82d58 tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] Acquired lock "refresh_cache-e2e25e19-c832-4945-9257-64e6103feb0c" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:39:32 user nova-compute[75176]: DEBUG nova.network.neutron [None req-08041308-9867-45e8-8e9b-4b47f2e82d58 tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] [instance: e2e25e19-c832-4945-9257-64e6103feb0c] Building network info cache for instance {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 15:39:32 user nova-compute[75176]: DEBUG nova.compute.manager [req-66e5bc8c-1c13-44e5-90af-9d77c15e5f7a req-0b0e7eb3-c16d-4c8a-8b37-60c469836c71 service nova] [instance: e2e25e19-c832-4945-9257-64e6103feb0c] Received event network-changed-05efa912-30d1-4474-a2eb-7d88fa0813e7 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:39:32 user nova-compute[75176]: DEBUG nova.compute.manager [req-66e5bc8c-1c13-44e5-90af-9d77c15e5f7a req-0b0e7eb3-c16d-4c8a-8b37-60c469836c71 service nova] [instance: e2e25e19-c832-4945-9257-64e6103feb0c] Refreshing instance network info cache due to event network-changed-05efa912-30d1-4474-a2eb-7d88fa0813e7. {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 15:39:32 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-66e5bc8c-1c13-44e5-90af-9d77c15e5f7a req-0b0e7eb3-c16d-4c8a-8b37-60c469836c71 service nova] Acquiring lock "refresh_cache-e2e25e19-c832-4945-9257-64e6103feb0c" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:39:32 user nova-compute[75176]: DEBUG nova.network.neutron [None req-08041308-9867-45e8-8e9b-4b47f2e82d58 tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] [instance: e2e25e19-c832-4945-9257-64e6103feb0c] Instance cache missing network info. {{(pid=75176) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 15:39:32 user nova-compute[75176]: DEBUG nova.network.neutron [None req-90378837-8250-492a-a41c-184d80ae6776 tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] [instance: 4ed0eb85-e975-446c-8da7-148a4bb36958] Successfully updated port: 9996a5ef-0801-4136-bd1d-fd5372d97e9d {{(pid=75176) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 15:39:32 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-90378837-8250-492a-a41c-184d80ae6776 tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] Acquiring lock "refresh_cache-4ed0eb85-e975-446c-8da7-148a4bb36958" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:39:32 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-90378837-8250-492a-a41c-184d80ae6776 tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] Acquired lock "refresh_cache-4ed0eb85-e975-446c-8da7-148a4bb36958" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:39:32 user nova-compute[75176]: DEBUG nova.network.neutron [None req-90378837-8250-492a-a41c-184d80ae6776 tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] [instance: 4ed0eb85-e975-446c-8da7-148a4bb36958] Building network info cache for instance {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 15:39:32 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:39:33 user nova-compute[75176]: DEBUG nova.network.neutron [None req-90378837-8250-492a-a41c-184d80ae6776 tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] [instance: 4ed0eb85-e975-446c-8da7-148a4bb36958] Instance cache missing network info. {{(pid=75176) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 15:39:33 user nova-compute[75176]: DEBUG nova.network.neutron [None req-08041308-9867-45e8-8e9b-4b47f2e82d58 tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] [instance: e2e25e19-c832-4945-9257-64e6103feb0c] Updating instance_info_cache with network_info: [{"id": "05efa912-30d1-4474-a2eb-7d88fa0813e7", "address": "fa:16:3e:b8:ab:c4", "network": {"id": "8bf6c19c-1190-430d-8e20-bc6439072a45", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-211502152-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ca8d4f7f4934dbdbd6ba92f51fba4b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05efa912-30", "ovs_interfaceid": "05efa912-30d1-4474-a2eb-7d88fa0813e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:39:33 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-08041308-9867-45e8-8e9b-4b47f2e82d58 tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] Releasing lock "refresh_cache-e2e25e19-c832-4945-9257-64e6103feb0c" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:39:33 user nova-compute[75176]: DEBUG nova.compute.manager [None req-08041308-9867-45e8-8e9b-4b47f2e82d58 tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] [instance: e2e25e19-c832-4945-9257-64e6103feb0c] Instance network_info: |[{"id": "05efa912-30d1-4474-a2eb-7d88fa0813e7", "address": "fa:16:3e:b8:ab:c4", "network": {"id": "8bf6c19c-1190-430d-8e20-bc6439072a45", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-211502152-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ca8d4f7f4934dbdbd6ba92f51fba4b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05efa912-30", "ovs_interfaceid": "05efa912-30d1-4474-a2eb-7d88fa0813e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75176) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 15:39:33 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-66e5bc8c-1c13-44e5-90af-9d77c15e5f7a req-0b0e7eb3-c16d-4c8a-8b37-60c469836c71 service nova] Acquired lock "refresh_cache-e2e25e19-c832-4945-9257-64e6103feb0c" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:39:33 user nova-compute[75176]: DEBUG nova.network.neutron [req-66e5bc8c-1c13-44e5-90af-9d77c15e5f7a req-0b0e7eb3-c16d-4c8a-8b37-60c469836c71 service nova] [instance: e2e25e19-c832-4945-9257-64e6103feb0c] Refreshing network info cache for port 05efa912-30d1-4474-a2eb-7d88fa0813e7 {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 15:39:33 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-08041308-9867-45e8-8e9b-4b47f2e82d58 tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] [instance: e2e25e19-c832-4945-9257-64e6103feb0c] Start _get_guest_xml network_info=[{"id": "05efa912-30d1-4474-a2eb-7d88fa0813e7", "address": "fa:16:3e:b8:ab:c4", "network": {"id": "8bf6c19c-1190-430d-8e20-bc6439072a45", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-211502152-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ca8d4f7f4934dbdbd6ba92f51fba4b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05efa912-30", "ovs_interfaceid": "05efa912-30d1-4474-a2eb-7d88fa0813e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T15:35:12Z,direct_url=<?>,disk_format='qcow2',id=1f41819e-c93f-4dc7-b253-37a27bbbbc74,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1b91c5d0672c4224a48df2e1f92688e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T15:35:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'size': 0, 'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'image_id': '1f41819e-c93f-4dc7-b253-37a27bbbbc74'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75176) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 15:39:33 user nova-compute[75176]: DEBUG nova.compute.manager [req-95dd394e-427b-4633-8c8c-e347bb1dfb70 req-c5e5aa11-d7b3-48f1-b873-1328ba230b9f service nova] [instance: 2e8507b7-fccf-4196-b589-bf2b74f165ec] Received event network-vif-plugged-3dc67fc3-7fcf-4655-8dbd-22febf2be39e {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:39:33 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-95dd394e-427b-4633-8c8c-e347bb1dfb70 req-c5e5aa11-d7b3-48f1-b873-1328ba230b9f service nova] Acquiring lock "2e8507b7-fccf-4196-b589-bf2b74f165ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:39:33 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-95dd394e-427b-4633-8c8c-e347bb1dfb70 req-c5e5aa11-d7b3-48f1-b873-1328ba230b9f service nova] Lock "2e8507b7-fccf-4196-b589-bf2b74f165ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:39:33 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-95dd394e-427b-4633-8c8c-e347bb1dfb70 req-c5e5aa11-d7b3-48f1-b873-1328ba230b9f service nova] Lock "2e8507b7-fccf-4196-b589-bf2b74f165ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:39:33 user nova-compute[75176]: DEBUG nova.compute.manager [req-95dd394e-427b-4633-8c8c-e347bb1dfb70 req-c5e5aa11-d7b3-48f1-b873-1328ba230b9f service nova] [instance: 2e8507b7-fccf-4196-b589-bf2b74f165ec] No waiting events found dispatching network-vif-plugged-3dc67fc3-7fcf-4655-8dbd-22febf2be39e {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:39:33 user nova-compute[75176]: WARNING nova.compute.manager [req-95dd394e-427b-4633-8c8c-e347bb1dfb70 req-c5e5aa11-d7b3-48f1-b873-1328ba230b9f service nova] [instance: 2e8507b7-fccf-4196-b589-bf2b74f165ec] Received unexpected event network-vif-plugged-3dc67fc3-7fcf-4655-8dbd-22febf2be39e for instance with vm_state active and task_state None.
Nov 28 15:39:33 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-08041308-9867-45e8-8e9b-4b47f2e82d58 tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 15:39:33 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-08041308-9867-45e8-8e9b-4b47f2e82d58 tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 15:39:33 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-08041308-9867-45e8-8e9b-4b47f2e82d58 tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75176) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 15:39:33 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-08041308-9867-45e8-8e9b-4b47f2e82d58 tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] CPU controller missing on host. {{(pid=75176) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 15:39:33 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-08041308-9867-45e8-8e9b-4b47f2e82d58 tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75176) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 15:39:33 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-08041308-9867-45e8-8e9b-4b47f2e82d58 tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] CPU controller found on host. {{(pid=75176) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 15:39:33 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-08041308-9867-45e8-8e9b-4b47f2e82d58 tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75176) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 15:39:33 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-08041308-9867-45e8-8e9b-4b47f2e82d58 tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T15:35:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T15:35:12Z,direct_url=<?>,disk_format='qcow2',id=1f41819e-c93f-4dc7-b253-37a27bbbbc74,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1b91c5d0672c4224a48df2e1f92688e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T15:35:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 15:39:33 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-08041308-9867-45e8-8e9b-4b47f2e82d58 tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] Flavor limits 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 15:39:33 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-08041308-9867-45e8-8e9b-4b47f2e82d58 tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] Image limits 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 15:39:33 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-08041308-9867-45e8-8e9b-4b47f2e82d58 tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] Flavor pref 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 15:39:33 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-08041308-9867-45e8-8e9b-4b47f2e82d58 tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] Image pref 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 15:39:33 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-08041308-9867-45e8-8e9b-4b47f2e82d58 tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 15:39:33 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-08041308-9867-45e8-8e9b-4b47f2e82d58 tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 15:39:33 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-08041308-9867-45e8-8e9b-4b47f2e82d58 tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75176) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 15:39:33 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-08041308-9867-45e8-8e9b-4b47f2e82d58 tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] Got 1 possible topologies {{(pid=75176) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 15:39:33 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-08041308-9867-45e8-8e9b-4b47f2e82d58 tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 15:39:33 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-08041308-9867-45e8-8e9b-4b47f2e82d58 tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 15:39:33 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-08041308-9867-45e8-8e9b-4b47f2e82d58 tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T15:39:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1735788857',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1735788857',id=6,image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLYd6lLWkEZSf+41ikXMqtG28NM8Q+hVwVe3wmXerHL+M0XqnrZ3u3KddSHLIIe0vvFogrQWiaY5StKzsHvoccjRJn8doyVKS0uym1H0FtgpShdYQ4yF2e0Gu6ZxuZcJSg==',key_name='tempest-keypair-1836481900',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2ca8d4f7f4934dbdbd6ba92f51fba4b6',ramdisk_id='',reservation_id='r-62ikbebi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-231716548',owner_user_name='tempest-TaggedAttachmentsTest-231716548-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T15:39:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5b8c4eae6ef14fa2b416c67f86e85971',uuid=e2e25e19-c832-4945-9257-64e6103feb0c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "05efa912-30d1-4474-a2eb-7d88fa0813e7", "address": "fa:16:3e:b8:ab:c4", "network": {"id": "8bf6c19c-1190-430d-8e20-bc6439072a45", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-211502152-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ca8d4f7f4934dbdbd6ba92f51fba4b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05efa912-30", "ovs_interfaceid": "05efa912-30d1-4474-a2eb-7d88fa0813e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75176) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 15:39:33 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-08041308-9867-45e8-8e9b-4b47f2e82d58 tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] Converting VIF {"id": "05efa912-30d1-4474-a2eb-7d88fa0813e7", "address": "fa:16:3e:b8:ab:c4", "network": {"id": "8bf6c19c-1190-430d-8e20-bc6439072a45", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-211502152-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ca8d4f7f4934dbdbd6ba92f51fba4b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05efa912-30", "ovs_interfaceid": "05efa912-30d1-4474-a2eb-7d88fa0813e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:39:33 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-08041308-9867-45e8-8e9b-4b47f2e82d58 tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:ab:c4,bridge_name='br-int',has_traffic_filtering=True,id=05efa912-30d1-4474-a2eb-7d88fa0813e7,network=Network(8bf6c19c-1190-430d-8e20-bc6439072a45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05efa912-30') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:39:33 user nova-compute[75176]: DEBUG nova.objects.instance [None req-08041308-9867-45e8-8e9b-4b47f2e82d58 tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] Lazy-loading 'pci_devices' on Instance uuid e2e25e19-c832-4945-9257-64e6103feb0c {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:39:33 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:39:33 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-08041308-9867-45e8-8e9b-4b47f2e82d58 tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] [instance: e2e25e19-c832-4945-9257-64e6103feb0c] End _get_guest_xml xml=<domain type="kvm">
Nov 28 15:39:33 user nova-compute[75176]:   <uuid>e2e25e19-c832-4945-9257-64e6103feb0c</uuid>
Nov 28 15:39:33 user nova-compute[75176]:   <name>instance-00000006</name>
Nov 28 15:39:33 user nova-compute[75176]:   <memory>524288</memory>
Nov 28 15:39:33 user nova-compute[75176]:   <vcpu>1</vcpu>
Nov 28 15:39:33 user nova-compute[75176]:   <metadata>
Nov 28 15:39:33 user nova-compute[75176]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 15:39:33 user nova-compute[75176]:       <nova:package version="0.0.0"/>
Nov 28 15:39:33 user nova-compute[75176]:       <nova:name>tempest-device-tagging-server-1735788857</nova:name>
Nov 28 15:39:33 user nova-compute[75176]:       <nova:creationTime>2023-11-28 15:39:33</nova:creationTime>
Nov 28 15:39:33 user nova-compute[75176]:       <nova:flavor name="m1.tiny">
Nov 28 15:39:33 user nova-compute[75176]:         <nova:memory>512</nova:memory>
Nov 28 15:39:33 user nova-compute[75176]:         <nova:disk>1</nova:disk>
Nov 28 15:39:33 user nova-compute[75176]:         <nova:swap>0</nova:swap>
Nov 28 15:39:33 user nova-compute[75176]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 15:39:33 user nova-compute[75176]:         <nova:vcpus>1</nova:vcpus>
Nov 28 15:39:33 user nova-compute[75176]:       </nova:flavor>
Nov 28 15:39:33 user nova-compute[75176]:       <nova:owner>
Nov 28 15:39:33 user nova-compute[75176]:         <nova:user uuid="5b8c4eae6ef14fa2b416c67f86e85971">tempest-TaggedAttachmentsTest-231716548-project-member</nova:user>
Nov 28 15:39:33 user nova-compute[75176]:         <nova:project uuid="2ca8d4f7f4934dbdbd6ba92f51fba4b6">tempest-TaggedAttachmentsTest-231716548</nova:project>
Nov 28 15:39:33 user nova-compute[75176]:       </nova:owner>
Nov 28 15:39:33 user nova-compute[75176]:       <nova:root type="image" uuid="1f41819e-c93f-4dc7-b253-37a27bbbbc74"/>
Nov 28 15:39:33 user nova-compute[75176]:       <nova:ports>
Nov 28 15:39:33 user nova-compute[75176]:         <nova:port uuid="05efa912-30d1-4474-a2eb-7d88fa0813e7">
Nov 28 15:39:33 user nova-compute[75176]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 28 15:39:33 user nova-compute[75176]:         </nova:port>
Nov 28 15:39:33 user nova-compute[75176]:       </nova:ports>
Nov 28 15:39:33 user nova-compute[75176]:     </nova:instance>
Nov 28 15:39:33 user nova-compute[75176]:   </metadata>
Nov 28 15:39:33 user nova-compute[75176]:   <sysinfo type="smbios">
Nov 28 15:39:33 user nova-compute[75176]:     <system>
Nov 28 15:39:33 user nova-compute[75176]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 15:39:33 user nova-compute[75176]:       <entry name="product">OpenStack Nova</entry>
Nov 28 15:39:33 user nova-compute[75176]:       <entry name="version">0.0.0</entry>
Nov 28 15:39:33 user nova-compute[75176]:       <entry name="serial">e2e25e19-c832-4945-9257-64e6103feb0c</entry>
Nov 28 15:39:33 user nova-compute[75176]:       <entry name="uuid">e2e25e19-c832-4945-9257-64e6103feb0c</entry>
Nov 28 15:39:33 user nova-compute[75176]:       <entry name="family">Virtual Machine</entry>
Nov 28 15:39:33 user nova-compute[75176]:     </system>
Nov 28 15:39:33 user nova-compute[75176]:   </sysinfo>
Nov 28 15:39:33 user nova-compute[75176]:   <os>
Nov 28 15:39:33 user nova-compute[75176]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 15:39:33 user nova-compute[75176]:     <boot dev="hd"/>
Nov 28 15:39:33 user nova-compute[75176]:     <smbios mode="sysinfo"/>
Nov 28 15:39:33 user nova-compute[75176]:   </os>
Nov 28 15:39:33 user nova-compute[75176]:   <features>
Nov 28 15:39:33 user nova-compute[75176]:     <acpi/>
Nov 28 15:39:33 user nova-compute[75176]:     <apic/>
Nov 28 15:39:33 user nova-compute[75176]:     <vmcoreinfo/>
Nov 28 15:39:33 user nova-compute[75176]:   </features>
Nov 28 15:39:33 user nova-compute[75176]:   <clock offset="utc">
Nov 28 15:39:33 user nova-compute[75176]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 15:39:33 user nova-compute[75176]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 15:39:33 user nova-compute[75176]:     <timer name="hpet" present="no"/>
Nov 28 15:39:33 user nova-compute[75176]:   </clock>
Nov 28 15:39:33 user nova-compute[75176]:   <cpu mode="custom" match="exact">
Nov 28 15:39:33 user nova-compute[75176]:     <model>Nehalem</model>
Nov 28 15:39:33 user nova-compute[75176]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 15:39:33 user nova-compute[75176]:   </cpu>
Nov 28 15:39:33 user nova-compute[75176]:   <devices>
Nov 28 15:39:33 user nova-compute[75176]:     <disk type="file" device="disk">
Nov 28 15:39:33 user nova-compute[75176]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 15:39:33 user nova-compute[75176]:       <source file="/opt/stack/data/nova/instances/e2e25e19-c832-4945-9257-64e6103feb0c/disk"/>
Nov 28 15:39:33 user nova-compute[75176]:       <target dev="vda" bus="virtio"/>
Nov 28 15:39:33 user nova-compute[75176]:     </disk>
Nov 28 15:39:33 user nova-compute[75176]:     <disk type="file" device="cdrom">
Nov 28 15:39:33 user nova-compute[75176]:       <driver name="qemu" type="raw" cache="none"/>
Nov 28 15:39:33 user nova-compute[75176]:       <source file="/opt/stack/data/nova/instances/e2e25e19-c832-4945-9257-64e6103feb0c/disk.config"/>
Nov 28 15:39:33 user nova-compute[75176]:       <target dev="hda" bus="ide"/>
Nov 28 15:39:33 user nova-compute[75176]:     </disk>
Nov 28 15:39:33 user nova-compute[75176]:     <interface type="ethernet">
Nov 28 15:39:33 user nova-compute[75176]:       <mac address="fa:16:3e:b8:ab:c4"/>
Nov 28 15:39:33 user nova-compute[75176]:       <model type="virtio"/>
Nov 28 15:39:33 user nova-compute[75176]:       <mtu size="1442"/>
Nov 28 15:39:33 user nova-compute[75176]:       <target dev="tap05efa912-30"/>
Nov 28 15:39:33 user nova-compute[75176]:     </interface>
Nov 28 15:39:33 user nova-compute[75176]:     <serial type="pty">
Nov 28 15:39:33 user nova-compute[75176]:       <log file="/opt/stack/data/nova/instances/e2e25e19-c832-4945-9257-64e6103feb0c/console.log" append="off"/>
Nov 28 15:39:33 user nova-compute[75176]:     </serial>
Nov 28 15:39:33 user nova-compute[75176]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 15:39:33 user nova-compute[75176]:     <video>
Nov 28 15:39:33 user nova-compute[75176]:       <model type="virtio"/>
Nov 28 15:39:33 user nova-compute[75176]:     </video>
Nov 28 15:39:33 user nova-compute[75176]:     <rng model="virtio">
Nov 28 15:39:33 user nova-compute[75176]:       <backend model="random">/dev/urandom</backend>
Nov 28 15:39:33 user nova-compute[75176]:     </rng>
Nov 28 15:39:33 user nova-compute[75176]:     <controller type="usb" index="0" model="none"/>
Nov 28 15:39:33 user nova-compute[75176]:     <memballoon model="virtio">
Nov 28 15:39:33 user nova-compute[75176]:       <stats period="10"/>
Nov 28 15:39:33 user nova-compute[75176]:     </memballoon>
Nov 28 15:39:33 user nova-compute[75176]:   </devices>
Nov 28 15:39:33 user nova-compute[75176]: </domain>
Nov 28 15:39:33 user nova-compute[75176]:  {{(pid=75176) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 15:39:33 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-08041308-9867-45e8-8e9b-4b47f2e82d58 tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T15:39:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1735788857',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1735788857',id=6,image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLYd6lLWkEZSf+41ikXMqtG28NM8Q+hVwVe3wmXerHL+M0XqnrZ3u3KddSHLIIe0vvFogrQWiaY5StKzsHvoccjRJn8doyVKS0uym1H0FtgpShdYQ4yF2e0Gu6ZxuZcJSg==',key_name='tempest-keypair-1836481900',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2ca8d4f7f4934dbdbd6ba92f51fba4b6',ramdisk_id='',reservation_id='r-62ikbebi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-231716548',owner_user_name='tempest-TaggedAttachmentsTest-231716548-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T15:39:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5b8c4eae6ef14fa2b416c67f86e85971',uuid=e2e25e19-c832-4945-9257-64e6103feb0c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "05efa912-30d1-4474-a2eb-7d88fa0813e7", "address": "fa:16:3e:b8:ab:c4", "network": {"id": "8bf6c19c-1190-430d-8e20-bc6439072a45", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-211502152-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ca8d4f7f4934dbdbd6ba92f51fba4b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05efa912-30", "ovs_interfaceid": "05efa912-30d1-4474-a2eb-7d88fa0813e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 15:39:33 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-08041308-9867-45e8-8e9b-4b47f2e82d58 tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] Converting VIF {"id": "05efa912-30d1-4474-a2eb-7d88fa0813e7", "address": "fa:16:3e:b8:ab:c4", "network": {"id": "8bf6c19c-1190-430d-8e20-bc6439072a45", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-211502152-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ca8d4f7f4934dbdbd6ba92f51fba4b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05efa912-30", "ovs_interfaceid": "05efa912-30d1-4474-a2eb-7d88fa0813e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:39:33 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-08041308-9867-45e8-8e9b-4b47f2e82d58 tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:ab:c4,bridge_name='br-int',has_traffic_filtering=True,id=05efa912-30d1-4474-a2eb-7d88fa0813e7,network=Network(8bf6c19c-1190-430d-8e20-bc6439072a45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05efa912-30') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:39:33 user nova-compute[75176]: DEBUG os_vif [None req-08041308-9867-45e8-8e9b-4b47f2e82d58 tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:ab:c4,bridge_name='br-int',has_traffic_filtering=True,id=05efa912-30d1-4474-a2eb-7d88fa0813e7,network=Network(8bf6c19c-1190-430d-8e20-bc6439072a45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05efa912-30') {{(pid=75176) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 15:39:33 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:39:33 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:39:33 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 15:39:33 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:39:33 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '82d5b1eb-0ab8-53b4-b203-97bb3cef3d48', '_type': 'linux-noop'}}, row=False) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:39:33 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:39:33 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:39:33 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:39:33 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap05efa912-30, may_exist=True, interface_attrs={}) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:39:33 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap05efa912-30, col_values=(('qos', UUID('ac4da4f3-536e-477c-9231-9efef87e95c9')),), if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:39:33 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap05efa912-30, col_values=(('external_ids', {'iface-id': '05efa912-30d1-4474-a2eb-7d88fa0813e7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b8:ab:c4', 'vm-uuid': 'e2e25e19-c832-4945-9257-64e6103feb0c'}),), if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:39:33 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:39:33 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:39:33 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:39:33 user nova-compute[75176]: INFO os_vif [None req-08041308-9867-45e8-8e9b-4b47f2e82d58 tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:ab:c4,bridge_name='br-int',has_traffic_filtering=True,id=05efa912-30d1-4474-a2eb-7d88fa0813e7,network=Network(8bf6c19c-1190-430d-8e20-bc6439072a45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05efa912-30')
Nov 28 15:39:33 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-08041308-9867-45e8-8e9b-4b47f2e82d58 tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] No BDM found with device name vda, not building metadata. {{(pid=75176) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 15:39:33 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-08041308-9867-45e8-8e9b-4b47f2e82d58 tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] No BDM found with device name hda, not building metadata. {{(pid=75176) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 15:39:33 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-08041308-9867-45e8-8e9b-4b47f2e82d58 tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] No VIF found with MAC fa:16:3e:b8:ab:c4, not building metadata {{(pid=75176) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 15:39:33 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-08041308-9867-45e8-8e9b-4b47f2e82d58 tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] [instance: e2e25e19-c832-4945-9257-64e6103feb0c] Using config drive
Nov 28 15:39:33 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-08041308-9867-45e8-8e9b-4b47f2e82d58 tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] [instance: e2e25e19-c832-4945-9257-64e6103feb0c] Creating config drive at /opt/stack/data/nova/instances/e2e25e19-c832-4945-9257-64e6103feb0c/disk.config
Nov 28 15:39:33 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-08041308-9867-45e8-8e9b-4b47f2e82d58 tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/e2e25e19-c832-4945-9257-64e6103feb0c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp16sqdf92 {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:39:33 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-08041308-9867-45e8-8e9b-4b47f2e82d58 tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/e2e25e19-c832-4945-9257-64e6103feb0c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp16sqdf92" returned: 0 in 0.068s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:39:34 user nova-compute[75176]: DEBUG nova.compute.manager [None req-46cbc4c0-639f-45f1-8c8c-04c0126dfa6b tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] [instance: 5b18c889-7694-4edf-8cf2-b9032e60289e] Instance event wait completed in 0 seconds for  {{(pid=75176) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 15:39:34 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-46cbc4c0-639f-45f1-8c8c-04c0126dfa6b tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] [instance: 5b18c889-7694-4edf-8cf2-b9032e60289e] Guest created on hypervisor {{(pid=75176) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 15:39:34 user nova-compute[75176]: INFO nova.virt.libvirt.driver [-] [instance: 5b18c889-7694-4edf-8cf2-b9032e60289e] Instance spawned successfully.
Nov 28 15:39:34 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-46cbc4c0-639f-45f1-8c8c-04c0126dfa6b tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] [instance: 5b18c889-7694-4edf-8cf2-b9032e60289e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 15:39:34 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-46cbc4c0-639f-45f1-8c8c-04c0126dfa6b tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] [instance: 5b18c889-7694-4edf-8cf2-b9032e60289e] Found default for hw_cdrom_bus of ide {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:39:34 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-46cbc4c0-639f-45f1-8c8c-04c0126dfa6b tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] [instance: 5b18c889-7694-4edf-8cf2-b9032e60289e] Found default for hw_disk_bus of virtio {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:39:34 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-46cbc4c0-639f-45f1-8c8c-04c0126dfa6b tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] [instance: 5b18c889-7694-4edf-8cf2-b9032e60289e] Found default for hw_input_bus of None {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:39:34 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-46cbc4c0-639f-45f1-8c8c-04c0126dfa6b tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] [instance: 5b18c889-7694-4edf-8cf2-b9032e60289e] Found default for hw_pointer_model of None {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:39:34 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-46cbc4c0-639f-45f1-8c8c-04c0126dfa6b tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] [instance: 5b18c889-7694-4edf-8cf2-b9032e60289e] Found default for hw_video_model of virtio {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:39:34 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-46cbc4c0-639f-45f1-8c8c-04c0126dfa6b tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] [instance: 5b18c889-7694-4edf-8cf2-b9032e60289e] Found default for hw_vif_model of virtio {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:39:34 user nova-compute[75176]: INFO nova.compute.manager [None req-46cbc4c0-639f-45f1-8c8c-04c0126dfa6b tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] [instance: 5b18c889-7694-4edf-8cf2-b9032e60289e] Took 12.74 seconds to spawn the instance on the hypervisor.
Nov 28 15:39:34 user nova-compute[75176]: DEBUG nova.compute.manager [None req-46cbc4c0-639f-45f1-8c8c-04c0126dfa6b tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] [instance: 5b18c889-7694-4edf-8cf2-b9032e60289e] Checking state {{(pid=75176) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 15:39:34 user nova-compute[75176]: DEBUG nova.network.neutron [None req-90378837-8250-492a-a41c-184d80ae6776 tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] [instance: 4ed0eb85-e975-446c-8da7-148a4bb36958] Updating instance_info_cache with network_info: [{"id": "9996a5ef-0801-4136-bd1d-fd5372d97e9d", "address": "fa:16:3e:e6:32:e5", "network": {"id": "66701df7-e5c6-4815-936c-2cfec02c127d", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-506481626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eed2357254f24be99031f60700f97988", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9996a5ef-08", "ovs_interfaceid": "9996a5ef-0801-4136-bd1d-fd5372d97e9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:39:34 user nova-compute[75176]: INFO nova.compute.manager [None req-46cbc4c0-639f-45f1-8c8c-04c0126dfa6b tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] [instance: 5b18c889-7694-4edf-8cf2-b9032e60289e] Took 14.00 seconds to build instance.
Nov 28 15:39:34 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-90378837-8250-492a-a41c-184d80ae6776 tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] Releasing lock "refresh_cache-4ed0eb85-e975-446c-8da7-148a4bb36958" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:39:34 user nova-compute[75176]: DEBUG nova.compute.manager [None req-90378837-8250-492a-a41c-184d80ae6776 tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] [instance: 4ed0eb85-e975-446c-8da7-148a4bb36958] Instance network_info: |[{"id": "9996a5ef-0801-4136-bd1d-fd5372d97e9d", "address": "fa:16:3e:e6:32:e5", "network": {"id": "66701df7-e5c6-4815-936c-2cfec02c127d", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-506481626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eed2357254f24be99031f60700f97988", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9996a5ef-08", "ovs_interfaceid": "9996a5ef-0801-4136-bd1d-fd5372d97e9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75176) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 15:39:34 user nova-compute[75176]: DEBUG nova.compute.manager [req-8fccb457-7dc7-4d09-9736-55e0aa61dd1b req-0f3402b6-5f4a-49ea-909d-af891e50c4a3 service nova] [instance: 4ed0eb85-e975-446c-8da7-148a4bb36958] Received event network-changed-9996a5ef-0801-4136-bd1d-fd5372d97e9d {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:39:34 user nova-compute[75176]: DEBUG nova.compute.manager [req-8fccb457-7dc7-4d09-9736-55e0aa61dd1b req-0f3402b6-5f4a-49ea-909d-af891e50c4a3 service nova] [instance: 4ed0eb85-e975-446c-8da7-148a4bb36958] Refreshing instance network info cache due to event network-changed-9996a5ef-0801-4136-bd1d-fd5372d97e9d. {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 15:39:34 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-8fccb457-7dc7-4d09-9736-55e0aa61dd1b req-0f3402b6-5f4a-49ea-909d-af891e50c4a3 service nova] Acquiring lock "refresh_cache-4ed0eb85-e975-446c-8da7-148a4bb36958" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:39:34 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-8fccb457-7dc7-4d09-9736-55e0aa61dd1b req-0f3402b6-5f4a-49ea-909d-af891e50c4a3 service nova] Acquired lock "refresh_cache-4ed0eb85-e975-446c-8da7-148a4bb36958" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:39:34 user nova-compute[75176]: DEBUG nova.network.neutron [req-8fccb457-7dc7-4d09-9736-55e0aa61dd1b req-0f3402b6-5f4a-49ea-909d-af891e50c4a3 service nova] [instance: 4ed0eb85-e975-446c-8da7-148a4bb36958] Refreshing network info cache for port 9996a5ef-0801-4136-bd1d-fd5372d97e9d {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 15:39:34 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-90378837-8250-492a-a41c-184d80ae6776 tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] [instance: 4ed0eb85-e975-446c-8da7-148a4bb36958] Start _get_guest_xml network_info=[{"id": "9996a5ef-0801-4136-bd1d-fd5372d97e9d", "address": "fa:16:3e:e6:32:e5", "network": {"id": "66701df7-e5c6-4815-936c-2cfec02c127d", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-506481626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eed2357254f24be99031f60700f97988", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9996a5ef-08", "ovs_interfaceid": "9996a5ef-0801-4136-bd1d-fd5372d97e9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T15:39:16Z,direct_url=<?>,disk_format='qcow2',id=1cea193d-2f53-4621-897c-2c6c5842cffc,min_disk=0,min_ram=0,name='',owner='d749e70442f04c7cb464f257a28945b2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T15:39:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'guest_format': None, 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'scsi', 'encryption_secret_uuid': None, 'size': 0, 'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/sda', 'image_id': '1cea193d-2f53-4621-897c-2c6c5842cffc'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75176) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 15:39:34 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-90378837-8250-492a-a41c-184d80ae6776 tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 15:39:34 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-90378837-8250-492a-a41c-184d80ae6776 tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 15:39:34 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-46cbc4c0-639f-45f1-8c8c-04c0126dfa6b tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] Lock "5b18c889-7694-4edf-8cf2-b9032e60289e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.501s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:39:34 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-90378837-8250-492a-a41c-184d80ae6776 tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75176) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 15:39:34 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-90378837-8250-492a-a41c-184d80ae6776 tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] CPU controller missing on host. {{(pid=75176) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 15:39:34 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-90378837-8250-492a-a41c-184d80ae6776 tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75176) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 15:39:34 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-90378837-8250-492a-a41c-184d80ae6776 tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] CPU controller found on host. {{(pid=75176) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 15:39:34 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-90378837-8250-492a-a41c-184d80ae6776 tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75176) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 15:39:34 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-90378837-8250-492a-a41c-184d80ae6776 tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T15:35:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T15:39:16Z,direct_url=<?>,disk_format='qcow2',id=1cea193d-2f53-4621-897c-2c6c5842cffc,min_disk=0,min_ram=0,name='',owner='d749e70442f04c7cb464f257a28945b2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T15:39:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 15:39:34 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-90378837-8250-492a-a41c-184d80ae6776 tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] Flavor limits 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 15:39:34 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-90378837-8250-492a-a41c-184d80ae6776 tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] Image limits 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 15:39:34 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-90378837-8250-492a-a41c-184d80ae6776 tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] Flavor pref 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 15:39:34 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-90378837-8250-492a-a41c-184d80ae6776 tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] Image pref 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 15:39:34 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-90378837-8250-492a-a41c-184d80ae6776 tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 15:39:34 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-90378837-8250-492a-a41c-184d80ae6776 tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 15:39:34 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-90378837-8250-492a-a41c-184d80ae6776 tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75176) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 15:39:34 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-90378837-8250-492a-a41c-184d80ae6776 tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] Got 1 possible topologies {{(pid=75176) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 15:39:34 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-90378837-8250-492a-a41c-184d80ae6776 tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 15:39:34 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-90378837-8250-492a-a41c-184d80ae6776 tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 15:39:34 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-90378837-8250-492a-a41c-184d80ae6776 tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T15:39:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-874981218',display_name='tempest-AttachSCSIVolumeTestJSON-server-874981218',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-874981218',id=7,image_ref='1cea193d-2f53-4621-897c-2c6c5842cffc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMlpzYK0RzAIepUVAKA1KXFqeWlbFbPMAArTFQcS8aZKYNK26AHQKFwet0utXsLcCzs80Go+Q9P3YIwr4NJPcCbUuV2p2fH5QEd+FHBnazt8wR3j3ZeaqEfIag6TbuaTjQ==',key_name='tempest-keypair-2004663028',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eed2357254f24be99031f60700f97988',ramdisk_id='',reservation_id='r-j0df32nq',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1cea193d-2f53-4621-897c-2c6c5842cffc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-729958549',owner_user_name='tempest-AttachSCSIVolumeTestJSON-729958549-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T15:39:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='84613ff663a942df897c3510ef40888f',uuid=4ed0eb85-e975-446c-8da7-148a4bb36958,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9996a5ef-0801-4136-bd1d-fd5372d97e9d", "address": "fa:16:3e:e6:32:e5", "network": {"id": "66701df7-e5c6-4815-936c-2cfec02c127d", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-506481626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eed2357254f24be99031f60700f97988", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9996a5ef-08", "ovs_interfaceid": "9996a5ef-0801-4136-bd1d-fd5372d97e9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75176) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 15:39:34 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-90378837-8250-492a-a41c-184d80ae6776 tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] Converting VIF {"id": "9996a5ef-0801-4136-bd1d-fd5372d97e9d", "address": "fa:16:3e:e6:32:e5", "network": {"id": "66701df7-e5c6-4815-936c-2cfec02c127d", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-506481626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eed2357254f24be99031f60700f97988", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9996a5ef-08", "ovs_interfaceid": "9996a5ef-0801-4136-bd1d-fd5372d97e9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:39:34 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-90378837-8250-492a-a41c-184d80ae6776 tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:32:e5,bridge_name='br-int',has_traffic_filtering=True,id=9996a5ef-0801-4136-bd1d-fd5372d97e9d,network=Network(66701df7-e5c6-4815-936c-2cfec02c127d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9996a5ef-08') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:39:34 user nova-compute[75176]: DEBUG nova.objects.instance [None req-90378837-8250-492a-a41c-184d80ae6776 tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] Lazy-loading 'pci_devices' on Instance uuid 4ed0eb85-e975-446c-8da7-148a4bb36958 {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:39:34 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-90378837-8250-492a-a41c-184d80ae6776 tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] [instance: 4ed0eb85-e975-446c-8da7-148a4bb36958] End _get_guest_xml xml=<domain type="kvm">
Nov 28 15:39:34 user nova-compute[75176]:   <uuid>4ed0eb85-e975-446c-8da7-148a4bb36958</uuid>
Nov 28 15:39:34 user nova-compute[75176]:   <name>instance-00000007</name>
Nov 28 15:39:34 user nova-compute[75176]:   <memory>524288</memory>
Nov 28 15:39:34 user nova-compute[75176]:   <vcpu>1</vcpu>
Nov 28 15:39:34 user nova-compute[75176]:   <metadata>
Nov 28 15:39:34 user nova-compute[75176]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 15:39:34 user nova-compute[75176]:       <nova:package version="0.0.0"/>
Nov 28 15:39:34 user nova-compute[75176]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-874981218</nova:name>
Nov 28 15:39:34 user nova-compute[75176]:       <nova:creationTime>2023-11-28 15:39:34</nova:creationTime>
Nov 28 15:39:34 user nova-compute[75176]:       <nova:flavor name="m1.tiny">
Nov 28 15:39:34 user nova-compute[75176]:         <nova:memory>512</nova:memory>
Nov 28 15:39:34 user nova-compute[75176]:         <nova:disk>1</nova:disk>
Nov 28 15:39:34 user nova-compute[75176]:         <nova:swap>0</nova:swap>
Nov 28 15:39:34 user nova-compute[75176]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 15:39:34 user nova-compute[75176]:         <nova:vcpus>1</nova:vcpus>
Nov 28 15:39:34 user nova-compute[75176]:       </nova:flavor>
Nov 28 15:39:34 user nova-compute[75176]:       <nova:owner>
Nov 28 15:39:34 user nova-compute[75176]:         <nova:user uuid="84613ff663a942df897c3510ef40888f">tempest-AttachSCSIVolumeTestJSON-729958549-project-member</nova:user>
Nov 28 15:39:34 user nova-compute[75176]:         <nova:project uuid="eed2357254f24be99031f60700f97988">tempest-AttachSCSIVolumeTestJSON-729958549</nova:project>
Nov 28 15:39:34 user nova-compute[75176]:       </nova:owner>
Nov 28 15:39:34 user nova-compute[75176]:       <nova:root type="image" uuid="1cea193d-2f53-4621-897c-2c6c5842cffc"/>
Nov 28 15:39:34 user nova-compute[75176]:       <nova:ports>
Nov 28 15:39:34 user nova-compute[75176]:         <nova:port uuid="9996a5ef-0801-4136-bd1d-fd5372d97e9d">
Nov 28 15:39:34 user nova-compute[75176]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 28 15:39:34 user nova-compute[75176]:         </nova:port>
Nov 28 15:39:34 user nova-compute[75176]:       </nova:ports>
Nov 28 15:39:34 user nova-compute[75176]:     </nova:instance>
Nov 28 15:39:34 user nova-compute[75176]:   </metadata>
Nov 28 15:39:34 user nova-compute[75176]:   <sysinfo type="smbios">
Nov 28 15:39:34 user nova-compute[75176]:     <system>
Nov 28 15:39:34 user nova-compute[75176]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 15:39:34 user nova-compute[75176]:       <entry name="product">OpenStack Nova</entry>
Nov 28 15:39:34 user nova-compute[75176]:       <entry name="version">0.0.0</entry>
Nov 28 15:39:34 user nova-compute[75176]:       <entry name="serial">4ed0eb85-e975-446c-8da7-148a4bb36958</entry>
Nov 28 15:39:34 user nova-compute[75176]:       <entry name="uuid">4ed0eb85-e975-446c-8da7-148a4bb36958</entry>
Nov 28 15:39:34 user nova-compute[75176]:       <entry name="family">Virtual Machine</entry>
Nov 28 15:39:34 user nova-compute[75176]:     </system>
Nov 28 15:39:34 user nova-compute[75176]:   </sysinfo>
Nov 28 15:39:34 user nova-compute[75176]:   <os>
Nov 28 15:39:34 user nova-compute[75176]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 15:39:34 user nova-compute[75176]:     <boot dev="hd"/>
Nov 28 15:39:34 user nova-compute[75176]:     <smbios mode="sysinfo"/>
Nov 28 15:39:34 user nova-compute[75176]:   </os>
Nov 28 15:39:34 user nova-compute[75176]:   <features>
Nov 28 15:39:34 user nova-compute[75176]:     <acpi/>
Nov 28 15:39:34 user nova-compute[75176]:     <apic/>
Nov 28 15:39:34 user nova-compute[75176]:     <vmcoreinfo/>
Nov 28 15:39:34 user nova-compute[75176]:   </features>
Nov 28 15:39:34 user nova-compute[75176]:   <clock offset="utc">
Nov 28 15:39:34 user nova-compute[75176]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 15:39:34 user nova-compute[75176]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 15:39:34 user nova-compute[75176]:     <timer name="hpet" present="no"/>
Nov 28 15:39:34 user nova-compute[75176]:   </clock>
Nov 28 15:39:34 user nova-compute[75176]:   <cpu mode="custom" match="exact">
Nov 28 15:39:34 user nova-compute[75176]:     <model>Nehalem</model>
Nov 28 15:39:34 user nova-compute[75176]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 15:39:34 user nova-compute[75176]:   </cpu>
Nov 28 15:39:34 user nova-compute[75176]:   <devices>
Nov 28 15:39:34 user nova-compute[75176]:     <disk type="file" device="disk">
Nov 28 15:39:34 user nova-compute[75176]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 15:39:34 user nova-compute[75176]:       <source file="/opt/stack/data/nova/instances/4ed0eb85-e975-446c-8da7-148a4bb36958/disk"/>
Nov 28 15:39:34 user nova-compute[75176]:       <target dev="sda" bus="scsi"/>
Nov 28 15:39:34 user nova-compute[75176]:       <address type="drive" controller="0" unit="0"/>
Nov 28 15:39:34 user nova-compute[75176]:     </disk>
Nov 28 15:39:34 user nova-compute[75176]:     <disk type="file" device="cdrom">
Nov 28 15:39:34 user nova-compute[75176]:       <driver name="qemu" type="raw" cache="none"/>
Nov 28 15:39:34 user nova-compute[75176]:       <source file="/opt/stack/data/nova/instances/4ed0eb85-e975-446c-8da7-148a4bb36958/disk.config"/>
Nov 28 15:39:34 user nova-compute[75176]:       <target dev="sdb" bus="scsi"/>
Nov 28 15:39:34 user nova-compute[75176]:       <address type="drive" controller="0" unit="1"/>
Nov 28 15:39:34 user nova-compute[75176]:     </disk>
Nov 28 15:39:34 user nova-compute[75176]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Nov 28 15:39:34 user nova-compute[75176]:     <interface type="ethernet">
Nov 28 15:39:34 user nova-compute[75176]:       <mac address="fa:16:3e:e6:32:e5"/>
Nov 28 15:39:34 user nova-compute[75176]:       <model type="virtio"/>
Nov 28 15:39:34 user nova-compute[75176]:       <mtu size="1442"/>
Nov 28 15:39:34 user nova-compute[75176]:       <target dev="tap9996a5ef-08"/>
Nov 28 15:39:34 user nova-compute[75176]:     </interface>
Nov 28 15:39:34 user nova-compute[75176]:     <serial type="pty">
Nov 28 15:39:34 user nova-compute[75176]:       <log file="/opt/stack/data/nova/instances/4ed0eb85-e975-446c-8da7-148a4bb36958/console.log" append="off"/>
Nov 28 15:39:34 user nova-compute[75176]:     </serial>
Nov 28 15:39:34 user nova-compute[75176]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 15:39:34 user nova-compute[75176]:     <video>
Nov 28 15:39:34 user nova-compute[75176]:       <model type="virtio"/>
Nov 28 15:39:34 user nova-compute[75176]:     </video>
Nov 28 15:39:34 user nova-compute[75176]:     <rng model="virtio">
Nov 28 15:39:34 user nova-compute[75176]:       <backend model="random">/dev/urandom</backend>
Nov 28 15:39:34 user nova-compute[75176]:     </rng>
Nov 28 15:39:34 user nova-compute[75176]:     <controller type="usb" index="0" model="none"/>
Nov 28 15:39:34 user nova-compute[75176]:     <memballoon model="virtio">
Nov 28 15:39:34 user nova-compute[75176]:       <stats period="10"/>
Nov 28 15:39:34 user nova-compute[75176]:     </memballoon>
Nov 28 15:39:34 user nova-compute[75176]:   </devices>
Nov 28 15:39:34 user nova-compute[75176]: </domain>
Nov 28 15:39:34 user nova-compute[75176]:  {{(pid=75176) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 15:39:34 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-90378837-8250-492a-a41c-184d80ae6776 tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T15:39:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-874981218',display_name='tempest-AttachSCSIVolumeTestJSON-server-874981218',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-874981218',id=7,image_ref='1cea193d-2f53-4621-897c-2c6c5842cffc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMlpzYK0RzAIepUVAKA1KXFqeWlbFbPMAArTFQcS8aZKYNK26AHQKFwet0utXsLcCzs80Go+Q9P3YIwr4NJPcCbUuV2p2fH5QEd+FHBnazt8wR3j3ZeaqEfIag6TbuaTjQ==',key_name='tempest-keypair-2004663028',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eed2357254f24be99031f60700f97988',ramdisk_id='',reservation_id='r-j0df32nq',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1cea193d-2f53-4621-897c-2c6c5842cffc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-729958549',owner_user_name='tempest-AttachSCSIVolumeTestJSON-729958549-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T15:39:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='84613ff663a942df897c3510ef40888f',uuid=4ed0eb85-e975-446c-8da7-148a4bb36958,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9996a5ef-0801-4136-bd1d-fd5372d97e9d", "address": "fa:16:3e:e6:32:e5", "network": {"id": "66701df7-e5c6-4815-936c-2cfec02c127d", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-506481626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eed2357254f24be99031f60700f97988", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9996a5ef-08", "ovs_interfaceid": "9996a5ef-0801-4136-bd1d-fd5372d97e9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 15:39:34 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-90378837-8250-492a-a41c-184d80ae6776 tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] Converting VIF {"id": "9996a5ef-0801-4136-bd1d-fd5372d97e9d", "address": "fa:16:3e:e6:32:e5", "network": {"id": "66701df7-e5c6-4815-936c-2cfec02c127d", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-506481626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eed2357254f24be99031f60700f97988", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9996a5ef-08", "ovs_interfaceid": "9996a5ef-0801-4136-bd1d-fd5372d97e9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:39:34 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-90378837-8250-492a-a41c-184d80ae6776 tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:32:e5,bridge_name='br-int',has_traffic_filtering=True,id=9996a5ef-0801-4136-bd1d-fd5372d97e9d,network=Network(66701df7-e5c6-4815-936c-2cfec02c127d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9996a5ef-08') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:39:34 user nova-compute[75176]: DEBUG os_vif [None req-90378837-8250-492a-a41c-184d80ae6776 tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:32:e5,bridge_name='br-int',has_traffic_filtering=True,id=9996a5ef-0801-4136-bd1d-fd5372d97e9d,network=Network(66701df7-e5c6-4815-936c-2cfec02c127d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9996a5ef-08') {{(pid=75176) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 15:39:34 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:39:34 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:39:34 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 15:39:34 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:39:34 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b08a4e31-fab4-5413-8ac7-1564e0ec2ba4', '_type': 'linux-noop'}}, row=False) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:39:34 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:39:34 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:39:34 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:39:34 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:39:34 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9996a5ef-08, may_exist=True, interface_attrs={}) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:39:34 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9996a5ef-08, col_values=(('qos', UUID('c3e84c24-d6e1-4e70-adf4-a1cd6646a5ea')),), if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:39:34 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9996a5ef-08, col_values=(('external_ids', {'iface-id': '9996a5ef-0801-4136-bd1d-fd5372d97e9d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e6:32:e5', 'vm-uuid': '4ed0eb85-e975-446c-8da7-148a4bb36958'}),), if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:39:34 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:39:34 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:39:34 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:39:34 user nova-compute[75176]: INFO os_vif [None req-90378837-8250-492a-a41c-184d80ae6776 tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:32:e5,bridge_name='br-int',has_traffic_filtering=True,id=9996a5ef-0801-4136-bd1d-fd5372d97e9d,network=Network(66701df7-e5c6-4815-936c-2cfec02c127d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9996a5ef-08')
Nov 28 15:39:35 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-90378837-8250-492a-a41c-184d80ae6776 tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] No BDM found with device name sda, not building metadata. {{(pid=75176) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 15:39:35 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-90378837-8250-492a-a41c-184d80ae6776 tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] No BDM found with device name sdb, not building metadata. {{(pid=75176) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 15:39:35 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-90378837-8250-492a-a41c-184d80ae6776 tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] No VIF found with MAC fa:16:3e:e6:32:e5, not building metadata {{(pid=75176) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 15:39:35 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-90378837-8250-492a-a41c-184d80ae6776 tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] [instance: 4ed0eb85-e975-446c-8da7-148a4bb36958] Using config drive
Nov 28 15:39:35 user nova-compute[75176]: DEBUG nova.compute.manager [req-e3e3ecfe-95a4-4c06-aaa8-489417f8f647 req-fa7e1086-ab7d-4adc-b7e8-3b9d804328da service nova] [instance: 2e8507b7-fccf-4196-b589-bf2b74f165ec] Received event network-vif-plugged-3dc67fc3-7fcf-4655-8dbd-22febf2be39e {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:39:35 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-e3e3ecfe-95a4-4c06-aaa8-489417f8f647 req-fa7e1086-ab7d-4adc-b7e8-3b9d804328da service nova] Acquiring lock "2e8507b7-fccf-4196-b589-bf2b74f165ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:39:35 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-e3e3ecfe-95a4-4c06-aaa8-489417f8f647 req-fa7e1086-ab7d-4adc-b7e8-3b9d804328da service nova] Lock "2e8507b7-fccf-4196-b589-bf2b74f165ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:39:35 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-e3e3ecfe-95a4-4c06-aaa8-489417f8f647 req-fa7e1086-ab7d-4adc-b7e8-3b9d804328da service nova] Lock "2e8507b7-fccf-4196-b589-bf2b74f165ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:39:35 user nova-compute[75176]: DEBUG nova.compute.manager [req-e3e3ecfe-95a4-4c06-aaa8-489417f8f647 req-fa7e1086-ab7d-4adc-b7e8-3b9d804328da service nova] [instance: 2e8507b7-fccf-4196-b589-bf2b74f165ec] No waiting events found dispatching network-vif-plugged-3dc67fc3-7fcf-4655-8dbd-22febf2be39e {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:39:35 user nova-compute[75176]: WARNING nova.compute.manager [req-e3e3ecfe-95a4-4c06-aaa8-489417f8f647 req-fa7e1086-ab7d-4adc-b7e8-3b9d804328da service nova] [instance: 2e8507b7-fccf-4196-b589-bf2b74f165ec] Received unexpected event network-vif-plugged-3dc67fc3-7fcf-4655-8dbd-22febf2be39e for instance with vm_state active and task_state None.
Nov 28 15:39:35 user nova-compute[75176]: DEBUG nova.network.neutron [req-66e5bc8c-1c13-44e5-90af-9d77c15e5f7a req-0b0e7eb3-c16d-4c8a-8b37-60c469836c71 service nova] [instance: e2e25e19-c832-4945-9257-64e6103feb0c] Updated VIF entry in instance network info cache for port 05efa912-30d1-4474-a2eb-7d88fa0813e7. {{(pid=75176) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 15:39:35 user nova-compute[75176]: DEBUG nova.network.neutron [req-66e5bc8c-1c13-44e5-90af-9d77c15e5f7a req-0b0e7eb3-c16d-4c8a-8b37-60c469836c71 service nova] [instance: e2e25e19-c832-4945-9257-64e6103feb0c] Updating instance_info_cache with network_info: [{"id": "05efa912-30d1-4474-a2eb-7d88fa0813e7", "address": "fa:16:3e:b8:ab:c4", "network": {"id": "8bf6c19c-1190-430d-8e20-bc6439072a45", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-211502152-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ca8d4f7f4934dbdbd6ba92f51fba4b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05efa912-30", "ovs_interfaceid": "05efa912-30d1-4474-a2eb-7d88fa0813e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:39:35 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-66e5bc8c-1c13-44e5-90af-9d77c15e5f7a req-0b0e7eb3-c16d-4c8a-8b37-60c469836c71 service nova] Releasing lock "refresh_cache-e2e25e19-c832-4945-9257-64e6103feb0c" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:39:35 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-90378837-8250-492a-a41c-184d80ae6776 tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] [instance: 4ed0eb85-e975-446c-8da7-148a4bb36958] Creating config drive at /opt/stack/data/nova/instances/4ed0eb85-e975-446c-8da7-148a4bb36958/disk.config
Nov 28 15:39:35 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-90378837-8250-492a-a41c-184d80ae6776 tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/4ed0eb85-e975-446c-8da7-148a4bb36958/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpbbh9lr03 {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:39:35 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-90378837-8250-492a-a41c-184d80ae6776 tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/4ed0eb85-e975-446c-8da7-148a4bb36958/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpbbh9lr03" returned: 0 in 0.073s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:39:35 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-49fd2865-6e0d-48a7-9d4d-bc4748d147ce tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] Acquiring lock "916b82eb-97e8-411c-a8ea-8c27d101b48e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:39:35 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-49fd2865-6e0d-48a7-9d4d-bc4748d147ce tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] Lock "916b82eb-97e8-411c-a8ea-8c27d101b48e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:39:35 user nova-compute[75176]: DEBUG nova.compute.manager [None req-49fd2865-6e0d-48a7-9d4d-bc4748d147ce tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] [instance: 916b82eb-97e8-411c-a8ea-8c27d101b48e] Starting instance... {{(pid=75176) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 15:39:35 user nova-compute[75176]: DEBUG nova.network.neutron [req-8fccb457-7dc7-4d09-9736-55e0aa61dd1b req-0f3402b6-5f4a-49ea-909d-af891e50c4a3 service nova] [instance: 4ed0eb85-e975-446c-8da7-148a4bb36958] Updated VIF entry in instance network info cache for port 9996a5ef-0801-4136-bd1d-fd5372d97e9d. {{(pid=75176) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 15:39:35 user nova-compute[75176]: DEBUG nova.network.neutron [req-8fccb457-7dc7-4d09-9736-55e0aa61dd1b req-0f3402b6-5f4a-49ea-909d-af891e50c4a3 service nova] [instance: 4ed0eb85-e975-446c-8da7-148a4bb36958] Updating instance_info_cache with network_info: [{"id": "9996a5ef-0801-4136-bd1d-fd5372d97e9d", "address": "fa:16:3e:e6:32:e5", "network": {"id": "66701df7-e5c6-4815-936c-2cfec02c127d", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-506481626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eed2357254f24be99031f60700f97988", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9996a5ef-08", "ovs_interfaceid": "9996a5ef-0801-4136-bd1d-fd5372d97e9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:39:35 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-8fccb457-7dc7-4d09-9736-55e0aa61dd1b req-0f3402b6-5f4a-49ea-909d-af891e50c4a3 service nova] Releasing lock "refresh_cache-4ed0eb85-e975-446c-8da7-148a4bb36958" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:39:35 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-49fd2865-6e0d-48a7-9d4d-bc4748d147ce tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:39:35 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-49fd2865-6e0d-48a7-9d4d-bc4748d147ce tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:39:35 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-49fd2865-6e0d-48a7-9d4d-bc4748d147ce tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75176) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 15:39:35 user nova-compute[75176]: INFO nova.compute.claims [None req-49fd2865-6e0d-48a7-9d4d-bc4748d147ce tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] [instance: 916b82eb-97e8-411c-a8ea-8c27d101b48e] Claim successful on node user
Nov 28 15:39:35 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:39:35 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:39:35 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:39:35 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:39:36 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-8c02b519-950f-4589-b8a9-dfd5dba161ca tempest-VolumesAssistedSnapshotsTest-1417905593 tempest-VolumesAssistedSnapshotsTest-1417905593-project-member] Acquiring lock "1d99de1a-8a82-447a-8a18-02e4efd3b3f0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:39:36 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-8c02b519-950f-4589-b8a9-dfd5dba161ca tempest-VolumesAssistedSnapshotsTest-1417905593 tempest-VolumesAssistedSnapshotsTest-1417905593-project-member] Lock "1d99de1a-8a82-447a-8a18-02e4efd3b3f0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:39:36 user nova-compute[75176]: DEBUG nova.compute.manager [None req-8c02b519-950f-4589-b8a9-dfd5dba161ca tempest-VolumesAssistedSnapshotsTest-1417905593 tempest-VolumesAssistedSnapshotsTest-1417905593-project-member] [instance: 1d99de1a-8a82-447a-8a18-02e4efd3b3f0] Starting instance... {{(pid=75176) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 15:39:36 user nova-compute[75176]: DEBUG nova.compute.provider_tree [None req-49fd2865-6e0d-48a7-9d4d-bc4748d147ce tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] Inventory has not changed in ProviderTree for provider: b37848d8-f401-4155-a029-b0ffa09ff85b {{(pid=75176) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 15:39:36 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-8c02b519-950f-4589-b8a9-dfd5dba161ca tempest-VolumesAssistedSnapshotsTest-1417905593 tempest-VolumesAssistedSnapshotsTest-1417905593-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:39:36 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-49fd2865-6e0d-48a7-9d4d-bc4748d147ce tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] Inventory has not changed for provider b37848d8-f401-4155-a029-b0ffa09ff85b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75176) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 15:39:36 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-49fd2865-6e0d-48a7-9d4d-bc4748d147ce tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.597s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:39:36 user nova-compute[75176]: DEBUG nova.compute.manager [None req-49fd2865-6e0d-48a7-9d4d-bc4748d147ce tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] [instance: 916b82eb-97e8-411c-a8ea-8c27d101b48e] Start building networks asynchronously for instance. {{(pid=75176) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 15:39:36 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-8c02b519-950f-4589-b8a9-dfd5dba161ca tempest-VolumesAssistedSnapshotsTest-1417905593 tempest-VolumesAssistedSnapshotsTest-1417905593-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.061s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:39:36 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-8c02b519-950f-4589-b8a9-dfd5dba161ca tempest-VolumesAssistedSnapshotsTest-1417905593 tempest-VolumesAssistedSnapshotsTest-1417905593-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75176) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 15:39:36 user nova-compute[75176]: INFO nova.compute.claims [None req-8c02b519-950f-4589-b8a9-dfd5dba161ca tempest-VolumesAssistedSnapshotsTest-1417905593 tempest-VolumesAssistedSnapshotsTest-1417905593-project-member] [instance: 1d99de1a-8a82-447a-8a18-02e4efd3b3f0] Claim successful on node user
Nov 28 15:39:36 user nova-compute[75176]: DEBUG nova.compute.manager [None req-49fd2865-6e0d-48a7-9d4d-bc4748d147ce tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] [instance: 916b82eb-97e8-411c-a8ea-8c27d101b48e] Allocating IP information in the background. {{(pid=75176) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 15:39:36 user nova-compute[75176]: DEBUG nova.network.neutron [None req-49fd2865-6e0d-48a7-9d4d-bc4748d147ce tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] [instance: 916b82eb-97e8-411c-a8ea-8c27d101b48e] allocate_for_instance() {{(pid=75176) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 15:39:36 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-49fd2865-6e0d-48a7-9d4d-bc4748d147ce tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] [instance: 916b82eb-97e8-411c-a8ea-8c27d101b48e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 15:39:36 user nova-compute[75176]: DEBUG nova.compute.manager [None req-49fd2865-6e0d-48a7-9d4d-bc4748d147ce tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] [instance: 916b82eb-97e8-411c-a8ea-8c27d101b48e] Start building block device mappings for instance. {{(pid=75176) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 15:39:36 user nova-compute[75176]: DEBUG nova.policy [None req-49fd2865-6e0d-48a7-9d4d-bc4748d147ce tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'aea69806df134eeb946d4ed91bd7152b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd68d78d1dd684c2c920ae8e4ce3eaa21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75176) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 15:39:36 user nova-compute[75176]: INFO nova.virt.block_device [None req-49fd2865-6e0d-48a7-9d4d-bc4748d147ce tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] [instance: 916b82eb-97e8-411c-a8ea-8c27d101b48e] Booting with volume ec90fb93-901a-43ab-ba96-58f9505953e9 at /dev/vda
Nov 28 15:39:36 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:39:36 user nova-compute[75176]: DEBUG os_brick.utils [None req-49fd2865-6e0d-48a7-9d4d-bc4748d147ce tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 15:39:36 user nova-compute[75176]: INFO oslo.privsep.daemon [None req-49fd2865-6e0d-48a7-9d4d-bc4748d147ce tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmpesngfyxr/privsep.sock']
Nov 28 15:39:36 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:39:36 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:39:36 user sudo[85634]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmpesngfyxr/privsep.sock
Nov 28 15:39:36 user sudo[85634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 28 15:39:36 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:39:36 user nova-compute[75176]: DEBUG nova.compute.provider_tree [None req-8c02b519-950f-4589-b8a9-dfd5dba161ca tempest-VolumesAssistedSnapshotsTest-1417905593 tempest-VolumesAssistedSnapshotsTest-1417905593-project-member] Inventory has not changed in ProviderTree for provider: b37848d8-f401-4155-a029-b0ffa09ff85b {{(pid=75176) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 15:39:36 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-8c02b519-950f-4589-b8a9-dfd5dba161ca tempest-VolumesAssistedSnapshotsTest-1417905593 tempest-VolumesAssistedSnapshotsTest-1417905593-project-member] Inventory has not changed for provider b37848d8-f401-4155-a029-b0ffa09ff85b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75176) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 15:39:36 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-8c02b519-950f-4589-b8a9-dfd5dba161ca tempest-VolumesAssistedSnapshotsTest-1417905593 tempest-VolumesAssistedSnapshotsTest-1417905593-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.638s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:39:36 user nova-compute[75176]: DEBUG nova.compute.manager [None req-8c02b519-950f-4589-b8a9-dfd5dba161ca tempest-VolumesAssistedSnapshotsTest-1417905593 tempest-VolumesAssistedSnapshotsTest-1417905593-project-member] [instance: 1d99de1a-8a82-447a-8a18-02e4efd3b3f0] Start building networks asynchronously for instance. {{(pid=75176) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 15:39:37 user nova-compute[75176]: DEBUG nova.compute.manager [None req-8c02b519-950f-4589-b8a9-dfd5dba161ca tempest-VolumesAssistedSnapshotsTest-1417905593 tempest-VolumesAssistedSnapshotsTest-1417905593-project-member] [instance: 1d99de1a-8a82-447a-8a18-02e4efd3b3f0] Allocating IP information in the background. {{(pid=75176) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 15:39:37 user nova-compute[75176]: DEBUG nova.network.neutron [None req-8c02b519-950f-4589-b8a9-dfd5dba161ca tempest-VolumesAssistedSnapshotsTest-1417905593 tempest-VolumesAssistedSnapshotsTest-1417905593-project-member] [instance: 1d99de1a-8a82-447a-8a18-02e4efd3b3f0] allocate_for_instance() {{(pid=75176) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 15:39:37 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-8c02b519-950f-4589-b8a9-dfd5dba161ca tempest-VolumesAssistedSnapshotsTest-1417905593 tempest-VolumesAssistedSnapshotsTest-1417905593-project-member] [instance: 1d99de1a-8a82-447a-8a18-02e4efd3b3f0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 15:39:37 user nova-compute[75176]: DEBUG nova.compute.manager [None req-8c02b519-950f-4589-b8a9-dfd5dba161ca tempest-VolumesAssistedSnapshotsTest-1417905593 tempest-VolumesAssistedSnapshotsTest-1417905593-project-member] [instance: 1d99de1a-8a82-447a-8a18-02e4efd3b3f0] Start building block device mappings for instance. {{(pid=75176) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 15:39:37 user nova-compute[75176]: DEBUG nova.policy [None req-8c02b519-950f-4589-b8a9-dfd5dba161ca tempest-VolumesAssistedSnapshotsTest-1417905593 tempest-VolumesAssistedSnapshotsTest-1417905593-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a886368ab6a548c697650bd7690dd009', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73137f167a804cddbf7f345f75763c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75176) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 15:39:37 user nova-compute[75176]: DEBUG nova.compute.manager [None req-8c02b519-950f-4589-b8a9-dfd5dba161ca tempest-VolumesAssistedSnapshotsTest-1417905593 tempest-VolumesAssistedSnapshotsTest-1417905593-project-member] [instance: 1d99de1a-8a82-447a-8a18-02e4efd3b3f0] Start spawning the instance on the hypervisor. {{(pid=75176) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 15:39:37 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-8c02b519-950f-4589-b8a9-dfd5dba161ca tempest-VolumesAssistedSnapshotsTest-1417905593 tempest-VolumesAssistedSnapshotsTest-1417905593-project-member] [instance: 1d99de1a-8a82-447a-8a18-02e4efd3b3f0] Creating instance directory {{(pid=75176) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 15:39:37 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-8c02b519-950f-4589-b8a9-dfd5dba161ca tempest-VolumesAssistedSnapshotsTest-1417905593 tempest-VolumesAssistedSnapshotsTest-1417905593-project-member] [instance: 1d99de1a-8a82-447a-8a18-02e4efd3b3f0] Creating image(s)
Nov 28 15:39:37 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-8c02b519-950f-4589-b8a9-dfd5dba161ca tempest-VolumesAssistedSnapshotsTest-1417905593 tempest-VolumesAssistedSnapshotsTest-1417905593-project-member] Acquiring lock "/opt/stack/data/nova/instances/1d99de1a-8a82-447a-8a18-02e4efd3b3f0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:39:37 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-8c02b519-950f-4589-b8a9-dfd5dba161ca tempest-VolumesAssistedSnapshotsTest-1417905593 tempest-VolumesAssistedSnapshotsTest-1417905593-project-member] Lock "/opt/stack/data/nova/instances/1d99de1a-8a82-447a-8a18-02e4efd3b3f0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:39:37 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-8c02b519-950f-4589-b8a9-dfd5dba161ca tempest-VolumesAssistedSnapshotsTest-1417905593 tempest-VolumesAssistedSnapshotsTest-1417905593-project-member] Lock "/opt/stack/data/nova/instances/1d99de1a-8a82-447a-8a18-02e4efd3b3f0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:39:37 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-8c02b519-950f-4589-b8a9-dfd5dba161ca tempest-VolumesAssistedSnapshotsTest-1417905593 tempest-VolumesAssistedSnapshotsTest-1417905593-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:39:37 user nova-compute[75176]: DEBUG nova.network.neutron [None req-49fd2865-6e0d-48a7-9d4d-bc4748d147ce tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] [instance: 916b82eb-97e8-411c-a8ea-8c27d101b48e] Successfully created port: 38bef3fc-c841-4db3-b429-8fe94a224783 {{(pid=75176) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 15:39:37 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-8c02b519-950f-4589-b8a9-dfd5dba161ca tempest-VolumesAssistedSnapshotsTest-1417905593 tempest-VolumesAssistedSnapshotsTest-1417905593-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json" returned: 0 in 0.220s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:39:37 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-8c02b519-950f-4589-b8a9-dfd5dba161ca tempest-VolumesAssistedSnapshotsTest-1417905593 tempest-VolumesAssistedSnapshotsTest-1417905593-project-member] Acquiring lock "5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:39:37 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-8c02b519-950f-4589-b8a9-dfd5dba161ca tempest-VolumesAssistedSnapshotsTest-1417905593 tempest-VolumesAssistedSnapshotsTest-1417905593-project-member] Lock "5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:39:37 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-8c02b519-950f-4589-b8a9-dfd5dba161ca tempest-VolumesAssistedSnapshotsTest-1417905593 tempest-VolumesAssistedSnapshotsTest-1417905593-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:39:37 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:39:37 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:39:37 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:39:37 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-8c02b519-950f-4589-b8a9-dfd5dba161ca tempest-VolumesAssistedSnapshotsTest-1417905593 tempest-VolumesAssistedSnapshotsTest-1417905593-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json" returned: 0 in 0.296s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:39:37 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-8c02b519-950f-4589-b8a9-dfd5dba161ca tempest-VolumesAssistedSnapshotsTest-1417905593 tempest-VolumesAssistedSnapshotsTest-1417905593-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2,backing_fmt=raw /opt/stack/data/nova/instances/1d99de1a-8a82-447a-8a18-02e4efd3b3f0/disk 1073741824 {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:39:37 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:39:37 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-8c02b519-950f-4589-b8a9-dfd5dba161ca tempest-VolumesAssistedSnapshotsTest-1417905593 tempest-VolumesAssistedSnapshotsTest-1417905593-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2,backing_fmt=raw /opt/stack/data/nova/instances/1d99de1a-8a82-447a-8a18-02e4efd3b3f0/disk 1073741824" returned: 0 in 0.104s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:39:37 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-8c02b519-950f-4589-b8a9-dfd5dba161ca tempest-VolumesAssistedSnapshotsTest-1417905593 tempest-VolumesAssistedSnapshotsTest-1417905593-project-member] Lock "5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.405s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:39:37 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-8c02b519-950f-4589-b8a9-dfd5dba161ca tempest-VolumesAssistedSnapshotsTest-1417905593 tempest-VolumesAssistedSnapshotsTest-1417905593-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:39:38 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-8c02b519-950f-4589-b8a9-dfd5dba161ca tempest-VolumesAssistedSnapshotsTest-1417905593 tempest-VolumesAssistedSnapshotsTest-1417905593-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json" returned: 0 in 0.218s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:39:38 user nova-compute[75176]: DEBUG nova.virt.disk.api [None req-8c02b519-950f-4589-b8a9-dfd5dba161ca tempest-VolumesAssistedSnapshotsTest-1417905593 tempest-VolumesAssistedSnapshotsTest-1417905593-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1d99de1a-8a82-447a-8a18-02e4efd3b3f0/disk. size=1073741824 {{(pid=75176) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 15:39:38 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-8c02b519-950f-4589-b8a9-dfd5dba161ca tempest-VolumesAssistedSnapshotsTest-1417905593 tempest-VolumesAssistedSnapshotsTest-1417905593-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d99de1a-8a82-447a-8a18-02e4efd3b3f0/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:39:38 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:39:38 user nova-compute[75176]: DEBUG nova.network.neutron [None req-8c02b519-950f-4589-b8a9-dfd5dba161ca tempest-VolumesAssistedSnapshotsTest-1417905593 tempest-VolumesAssistedSnapshotsTest-1417905593-project-member] [instance: 1d99de1a-8a82-447a-8a18-02e4efd3b3f0] Successfully created port: ab316a13-f7fd-49e0-b6f7-6aa0cc815eca {{(pid=75176) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 15:39:38 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-8c02b519-950f-4589-b8a9-dfd5dba161ca tempest-VolumesAssistedSnapshotsTest-1417905593 tempest-VolumesAssistedSnapshotsTest-1417905593-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d99de1a-8a82-447a-8a18-02e4efd3b3f0/disk --force-share --output=json" returned: 0 in 0.275s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:39:38 user nova-compute[75176]: DEBUG nova.virt.disk.api [None req-8c02b519-950f-4589-b8a9-dfd5dba161ca tempest-VolumesAssistedSnapshotsTest-1417905593 tempest-VolumesAssistedSnapshotsTest-1417905593-project-member] Cannot resize image /opt/stack/data/nova/instances/1d99de1a-8a82-447a-8a18-02e4efd3b3f0/disk to a smaller size. {{(pid=75176) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 15:39:38 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-8c02b519-950f-4589-b8a9-dfd5dba161ca tempest-VolumesAssistedSnapshotsTest-1417905593 tempest-VolumesAssistedSnapshotsTest-1417905593-project-member] [instance: 1d99de1a-8a82-447a-8a18-02e4efd3b3f0] Created local disks {{(pid=75176) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 15:39:38 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-8c02b519-950f-4589-b8a9-dfd5dba161ca tempest-VolumesAssistedSnapshotsTest-1417905593 tempest-VolumesAssistedSnapshotsTest-1417905593-project-member] [instance: 1d99de1a-8a82-447a-8a18-02e4efd3b3f0] Ensure instance console log exists: /opt/stack/data/nova/instances/1d99de1a-8a82-447a-8a18-02e4efd3b3f0/console.log {{(pid=75176) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 15:39:38 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-8c02b519-950f-4589-b8a9-dfd5dba161ca tempest-VolumesAssistedSnapshotsTest-1417905593 tempest-VolumesAssistedSnapshotsTest-1417905593-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:39:38 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-8c02b519-950f-4589-b8a9-dfd5dba161ca tempest-VolumesAssistedSnapshotsTest-1417905593 tempest-VolumesAssistedSnapshotsTest-1417905593-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:39:38 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-8c02b519-950f-4589-b8a9-dfd5dba161ca tempest-VolumesAssistedSnapshotsTest-1417905593 tempest-VolumesAssistedSnapshotsTest-1417905593-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:39:38 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:39:38 user sudo[85634]: pam_unix(sudo:session): session closed for user root
Nov 28 15:39:38 user nova-compute[75176]: INFO oslo.privsep.daemon [None req-49fd2865-6e0d-48a7-9d4d-bc4748d147ce tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] Spawned new privsep daemon via rootwrap
Nov 28 15:39:38 user nova-compute[75176]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 28 15:39:38 user nova-compute[75176]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 28 15:39:38 user nova-compute[75176]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Nov 28 15:39:38 user nova-compute[75176]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 85736
Nov 28 15:39:38 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:39:38 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:39:38 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[95f44838-304f-4caa-911f-cbfa68d7ae8f]: (2,) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:39:39 user nova-compute[75176]: DEBUG nova.network.neutron [None req-49fd2865-6e0d-48a7-9d4d-bc4748d147ce tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] [instance: 916b82eb-97e8-411c-a8ea-8c27d101b48e] Successfully updated port: 38bef3fc-c841-4db3-b429-8fe94a224783 {{(pid=75176) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 15:39:39 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:39:39 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-49fd2865-6e0d-48a7-9d4d-bc4748d147ce tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] Acquiring lock "refresh_cache-916b82eb-97e8-411c-a8ea-8c27d101b48e" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:39:39 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-49fd2865-6e0d-48a7-9d4d-bc4748d147ce tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] Acquired lock "refresh_cache-916b82eb-97e8-411c-a8ea-8c27d101b48e" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:39:39 user nova-compute[75176]: DEBUG nova.network.neutron [None req-49fd2865-6e0d-48a7-9d4d-bc4748d147ce tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] [instance: 916b82eb-97e8-411c-a8ea-8c27d101b48e] Building network info cache for instance {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 15:39:39 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.026s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:39:39 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[68d2443a-3c8a-4670-ad5d-0ce83d77d4d8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:edc924a949b2\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:39:39 user nova-compute[75176]: DEBUG nova.compute.manager [req-ef0fe63c-a34b-491b-80bc-9c85e7caad58 req-03eb9df6-24eb-47a2-8427-ec20f7b8fde1 service nova] [instance: 916b82eb-97e8-411c-a8ea-8c27d101b48e] Received event network-changed-38bef3fc-c841-4db3-b429-8fe94a224783 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:39:39 user nova-compute[75176]: DEBUG nova.compute.manager [req-ef0fe63c-a34b-491b-80bc-9c85e7caad58 req-03eb9df6-24eb-47a2-8427-ec20f7b8fde1 service nova] [instance: 916b82eb-97e8-411c-a8ea-8c27d101b48e] Refreshing instance network info cache due to event network-changed-38bef3fc-c841-4db3-b429-8fe94a224783. {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 15:39:39 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-ef0fe63c-a34b-491b-80bc-9c85e7caad58 req-03eb9df6-24eb-47a2-8427-ec20f7b8fde1 service nova] Acquiring lock "refresh_cache-916b82eb-97e8-411c-a8ea-8c27d101b48e" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:39:39 user nova-compute[75176]: WARNING os_brick.initiator.connectors.nvmeof [None req-49fd2865-6e0d-48a7-9d4d-bc4748d147ce tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Nov 28 15:39:39 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:39:39 user nova-compute[75176]: DEBUG nova.network.neutron [None req-8c02b519-950f-4589-b8a9-dfd5dba161ca tempest-VolumesAssistedSnapshotsTest-1417905593 tempest-VolumesAssistedSnapshotsTest-1417905593-project-member] [instance: 1d99de1a-8a82-447a-8a18-02e4efd3b3f0] Successfully updated port: ab316a13-f7fd-49e0-b6f7-6aa0cc815eca {{(pid=75176) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 15:39:39 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:39:39 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[404df94f-d6de-4e45-8bf6-da86cf34742d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:39:39 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:39:39 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-8c02b519-950f-4589-b8a9-dfd5dba161ca tempest-VolumesAssistedSnapshotsTest-1417905593 tempest-VolumesAssistedSnapshotsTest-1417905593-project-member] Acquiring lock "refresh_cache-1d99de1a-8a82-447a-8a18-02e4efd3b3f0" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:39:39 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-8c02b519-950f-4589-b8a9-dfd5dba161ca tempest-VolumesAssistedSnapshotsTest-1417905593 tempest-VolumesAssistedSnapshotsTest-1417905593-project-member] Acquired lock "refresh_cache-1d99de1a-8a82-447a-8a18-02e4efd3b3f0" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:39:39 user nova-compute[75176]: DEBUG nova.network.neutron [None req-8c02b519-950f-4589-b8a9-dfd5dba161ca tempest-VolumesAssistedSnapshotsTest-1417905593 tempest-VolumesAssistedSnapshotsTest-1417905593-project-member] [instance: 1d99de1a-8a82-447a-8a18-02e4efd3b3f0] Building network info cache for instance {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 15:39:39 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:39:39 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[22b35a54-9cb3-4a45-8922-55826410463d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:39:39 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2238cfd-18bf-4fab-8509-6d3e1e87c566]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:39:39 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-49fd2865-6e0d-48a7-9d4d-bc4748d147ce tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] Running cmd (subprocess): nvme version {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:39:39 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-49fd2865-6e0d-48a7-9d4d-bc4748d147ce tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] 'nvme version' failed. Not Retrying. {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 15:39:39 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.nvmeof [None req-49fd2865-6e0d-48a7-9d4d-bc4748d147ce tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] nvme not present on system {{(pid=75176) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 15:39:39 user nova-compute[75176]: DEBUG nova.compute.manager [req-7d2757f6-eda9-4903-accf-c9ba1c4c6088 req-737abd41-9e7c-4a4e-a51d-02c2ead65928 service nova] [instance: 1d99de1a-8a82-447a-8a18-02e4efd3b3f0] Received event network-changed-ab316a13-f7fd-49e0-b6f7-6aa0cc815eca {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:39:39 user nova-compute[75176]: DEBUG nova.compute.manager [req-7d2757f6-eda9-4903-accf-c9ba1c4c6088 req-737abd41-9e7c-4a4e-a51d-02c2ead65928 service nova] [instance: 1d99de1a-8a82-447a-8a18-02e4efd3b3f0] Refreshing instance network info cache due to event network-changed-ab316a13-f7fd-49e0-b6f7-6aa0cc815eca. {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 15:39:39 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-7d2757f6-eda9-4903-accf-c9ba1c4c6088 req-737abd41-9e7c-4a4e-a51d-02c2ead65928 service nova] Acquiring lock "refresh_cache-1d99de1a-8a82-447a-8a18-02e4efd3b3f0" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:39:39 user nova-compute[75176]: DEBUG nova.network.neutron [None req-49fd2865-6e0d-48a7-9d4d-bc4748d147ce tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] [instance: 916b82eb-97e8-411c-a8ea-8c27d101b48e] Instance cache missing network info. {{(pid=75176) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 15:39:39 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:39:39 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 15:39:39 user nova-compute[75176]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 15:39:39 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bd01749-1081-40d2-a9ce-b6e69b4a1d9c]: (4, '') {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:39:39 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.lightos [None req-49fd2865-6e0d-48a7-9d4d-bc4748d147ce tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75176) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 15:39:39 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.lightos [None req-49fd2865-6e0d-48a7-9d4d-bc4748d147ce tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75176) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 15:39:39 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.lightos [None req-49fd2865-6e0d-48a7-9d4d-bc4748d147ce tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] LIGHTOS: no hostnqn found. {{(pid=75176) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 15:39:39 user nova-compute[75176]: DEBUG os_brick.utils [None req-49fd2865-6e0d-48a7-9d4d-bc4748d147ce tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] <== get_connector_properties: return (2645ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:edc924a949b2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 15:39:39 user nova-compute[75176]: DEBUG nova.virt.block_device [None req-49fd2865-6e0d-48a7-9d4d-bc4748d147ce tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] [instance: 916b82eb-97e8-411c-a8ea-8c27d101b48e] Updating existing volume attachment record: d18774dd-8262-4de9-966b-d2abe4b58bca {{(pid=75176) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 15:39:39 user nova-compute[75176]: DEBUG nova.network.neutron [None req-8c02b519-950f-4589-b8a9-dfd5dba161ca tempest-VolumesAssistedSnapshotsTest-1417905593 tempest-VolumesAssistedSnapshotsTest-1417905593-project-member] [instance: 1d99de1a-8a82-447a-8a18-02e4efd3b3f0] Instance cache missing network info. {{(pid=75176) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 15:39:39 user nova-compute[75176]: DEBUG nova.network.neutron [None req-49fd2865-6e0d-48a7-9d4d-bc4748d147ce tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] [instance: 916b82eb-97e8-411c-a8ea-8c27d101b48e] Updating instance_info_cache with network_info: [{"id": "38bef3fc-c841-4db3-b429-8fe94a224783", "address": "fa:16:3e:13:6e:cf", "network": {"id": "dc41c201-1473-486f-abc4-30a09c441826", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2062231487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d68d78d1dd684c2c920ae8e4ce3eaa21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38bef3fc-c8", "ovs_interfaceid": "38bef3fc-c841-4db3-b429-8fe94a224783", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:39:39 user nova-compute[75176]: DEBUG nova.network.neutron [None req-8c02b519-950f-4589-b8a9-dfd5dba161ca tempest-VolumesAssistedSnapshotsTest-1417905593 tempest-VolumesAssistedSnapshotsTest-1417905593-project-member] [instance: 1d99de1a-8a82-447a-8a18-02e4efd3b3f0] Updating instance_info_cache with network_info: [{"id": "ab316a13-f7fd-49e0-b6f7-6aa0cc815eca", "address": "fa:16:3e:3c:27:99", "network": {"id": "0ef0c5c2-0325-4d50-8eb3-e72b53c4750c", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-311328630-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73137f167a804cddbf7f345f75763c71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab316a13-f7", "ovs_interfaceid": "ab316a13-f7fd-49e0-b6f7-6aa0cc815eca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:39:39 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-49fd2865-6e0d-48a7-9d4d-bc4748d147ce tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] Releasing lock "refresh_cache-916b82eb-97e8-411c-a8ea-8c27d101b48e" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:39:39 user nova-compute[75176]: DEBUG nova.compute.manager [None req-49fd2865-6e0d-48a7-9d4d-bc4748d147ce tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] [instance: 916b82eb-97e8-411c-a8ea-8c27d101b48e] Instance network_info: |[{"id": "38bef3fc-c841-4db3-b429-8fe94a224783", "address": "fa:16:3e:13:6e:cf", "network": {"id": "dc41c201-1473-486f-abc4-30a09c441826", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2062231487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d68d78d1dd684c2c920ae8e4ce3eaa21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38bef3fc-c8", "ovs_interfaceid": "38bef3fc-c841-4db3-b429-8fe94a224783", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75176) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 15:39:39 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-ef0fe63c-a34b-491b-80bc-9c85e7caad58 req-03eb9df6-24eb-47a2-8427-ec20f7b8fde1 service nova] Acquired lock "refresh_cache-916b82eb-97e8-411c-a8ea-8c27d101b48e" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:39:39 user nova-compute[75176]: DEBUG nova.network.neutron [req-ef0fe63c-a34b-491b-80bc-9c85e7caad58 req-03eb9df6-24eb-47a2-8427-ec20f7b8fde1 service nova] [instance: 916b82eb-97e8-411c-a8ea-8c27d101b48e] Refreshing network info cache for port 38bef3fc-c841-4db3-b429-8fe94a224783 {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 15:39:39 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-8c02b519-950f-4589-b8a9-dfd5dba161ca tempest-VolumesAssistedSnapshotsTest-1417905593 tempest-VolumesAssistedSnapshotsTest-1417905593-project-member] Releasing lock "refresh_cache-1d99de1a-8a82-447a-8a18-02e4efd3b3f0" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:39:39 user nova-compute[75176]: DEBUG nova.compute.manager [None req-8c02b519-950f-4589-b8a9-dfd5dba161ca tempest-VolumesAssistedSnapshotsTest-1417905593 tempest-VolumesAssistedSnapshotsTest-1417905593-project-member] [instance: 1d99de1a-8a82-447a-8a18-02e4efd3b3f0] Instance network_info: |[{"id": "ab316a13-f7fd-49e0-b6f7-6aa0cc815eca", "address": "fa:16:3e:3c:27:99", "network": {"id": "0ef0c5c2-0325-4d50-8eb3-e72b53c4750c", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-311328630-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73137f167a804cddbf7f345f75763c71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab316a13-f7", "ovs_interfaceid": "ab316a13-f7fd-49e0-b6f7-6aa0cc815eca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75176) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 15:39:39 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-7d2757f6-eda9-4903-accf-c9ba1c4c6088 req-737abd41-9e7c-4a4e-a51d-02c2ead65928 service nova] Acquired lock "refresh_cache-1d99de1a-8a82-447a-8a18-02e4efd3b3f0" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:39:39 user nova-compute[75176]: DEBUG nova.network.neutron [req-7d2757f6-eda9-4903-accf-c9ba1c4c6088 req-737abd41-9e7c-4a4e-a51d-02c2ead65928 service nova] [instance: 1d99de1a-8a82-447a-8a18-02e4efd3b3f0] Refreshing network info cache for port ab316a13-f7fd-49e0-b6f7-6aa0cc815eca {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 15:39:39 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-8c02b519-950f-4589-b8a9-dfd5dba161ca tempest-VolumesAssistedSnapshotsTest-1417905593 tempest-VolumesAssistedSnapshotsTest-1417905593-project-member] [instance: 1d99de1a-8a82-447a-8a18-02e4efd3b3f0] Start _get_guest_xml network_info=[{"id": "ab316a13-f7fd-49e0-b6f7-6aa0cc815eca", "address": "fa:16:3e:3c:27:99", "network": {"id": "0ef0c5c2-0325-4d50-8eb3-e72b53c4750c", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-311328630-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73137f167a804cddbf7f345f75763c71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab316a13-f7", "ovs_interfaceid": "ab316a13-f7fd-49e0-b6f7-6aa0cc815eca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T15:35:12Z,direct_url=<?>,disk_format='qcow2',id=1f41819e-c93f-4dc7-b253-37a27bbbbc74,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1b91c5d0672c4224a48df2e1f92688e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T15:35:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'size': 0, 'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'image_id': '1f41819e-c93f-4dc7-b253-37a27bbbbc74'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75176) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 15:39:39 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-8c02b519-950f-4589-b8a9-dfd5dba161ca tempest-VolumesAssistedSnapshotsTest-1417905593 tempest-VolumesAssistedSnapshotsTest-1417905593-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 15:39:39 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-8c02b519-950f-4589-b8a9-dfd5dba161ca tempest-VolumesAssistedSnapshotsTest-1417905593 tempest-VolumesAssistedSnapshotsTest-1417905593-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 15:39:39 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-8c02b519-950f-4589-b8a9-dfd5dba161ca tempest-VolumesAssistedSnapshotsTest-1417905593 tempest-VolumesAssistedSnapshotsTest-1417905593-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75176) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 15:39:39 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-8c02b519-950f-4589-b8a9-dfd5dba161ca tempest-VolumesAssistedSnapshotsTest-1417905593 tempest-VolumesAssistedSnapshotsTest-1417905593-project-member] CPU controller missing on host. {{(pid=75176) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 15:39:39 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:39:39 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-8c02b519-950f-4589-b8a9-dfd5dba161ca tempest-VolumesAssistedSnapshotsTest-1417905593 tempest-VolumesAssistedSnapshotsTest-1417905593-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75176) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 15:39:39 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-8c02b519-950f-4589-b8a9-dfd5dba161ca tempest-VolumesAssistedSnapshotsTest-1417905593 tempest-VolumesAssistedSnapshotsTest-1417905593-project-member] CPU controller found on host. {{(pid=75176) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 15:39:39 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-8c02b519-950f-4589-b8a9-dfd5dba161ca tempest-VolumesAssistedSnapshotsTest-1417905593 tempest-VolumesAssistedSnapshotsTest-1417905593-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75176) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 15:39:39 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-8c02b519-950f-4589-b8a9-dfd5dba161ca tempest-VolumesAssistedSnapshotsTest-1417905593 tempest-VolumesAssistedSnapshotsTest-1417905593-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T15:35:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T15:35:12Z,direct_url=<?>,disk_format='qcow2',id=1f41819e-c93f-4dc7-b253-37a27bbbbc74,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1b91c5d0672c4224a48df2e1f92688e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T15:35:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 15:39:39 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-8c02b519-950f-4589-b8a9-dfd5dba161ca tempest-VolumesAssistedSnapshotsTest-1417905593 tempest-VolumesAssistedSnapshotsTest-1417905593-project-member] Flavor limits 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 15:39:39 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-8c02b519-950f-4589-b8a9-dfd5dba161ca tempest-VolumesAssistedSnapshotsTest-1417905593 tempest-VolumesAssistedSnapshotsTest-1417905593-project-member] Image limits 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 15:39:39 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-8c02b519-950f-4589-b8a9-dfd5dba161ca tempest-VolumesAssistedSnapshotsTest-1417905593 tempest-VolumesAssistedSnapshotsTest-1417905593-project-member] Flavor pref 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 15:39:39 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-8c02b519-950f-4589-b8a9-dfd5dba161ca tempest-VolumesAssistedSnapshotsTest-1417905593 tempest-VolumesAssistedSnapshotsTest-1417905593-project-member] Image pref 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 15:39:39 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-8c02b519-950f-4589-b8a9-dfd5dba161ca tempest-VolumesAssistedSnapshotsTest-1417905593 tempest-VolumesAssistedSnapshotsTest-1417905593-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 15:39:39 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-8c02b519-950f-4589-b8a9-dfd5dba161ca tempest-VolumesAssistedSnapshotsTest-1417905593 tempest-VolumesAssistedSnapshotsTest-1417905593-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 15:39:39 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-8c02b519-950f-4589-b8a9-dfd5dba161ca tempest-VolumesAssistedSnapshotsTest-1417905593 tempest-VolumesAssistedSnapshotsTest-1417905593-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75176) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 15:39:39 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-8c02b519-950f-4589-b8a9-dfd5dba161ca tempest-VolumesAssistedSnapshotsTest-1417905593 tempest-VolumesAssistedSnapshotsTest-1417905593-project-member] Got 1 possible topologies {{(pid=75176) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 15:39:39 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-8c02b519-950f-4589-b8a9-dfd5dba161ca tempest-VolumesAssistedSnapshotsTest-1417905593 tempest-VolumesAssistedSnapshotsTest-1417905593-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 15:39:39 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-8c02b519-950f-4589-b8a9-dfd5dba161ca tempest-VolumesAssistedSnapshotsTest-1417905593 tempest-VolumesAssistedSnapshotsTest-1417905593-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 15:39:40 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-8c02b519-950f-4589-b8a9-dfd5dba161ca tempest-VolumesAssistedSnapshotsTest-1417905593 tempest-VolumesAssistedSnapshotsTest-1417905593-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T15:39:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-484194504',display_name='tempest-VolumesAssistedSnapshotsTest-server-484194504',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-484194504',id=9,image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKSgNC2asewx9LWdHcNWDjDRgjOEoSzsRsPdym6E1KUX7KI2Mg71iiy7r7btFMnUGrgjrsBQFw1yD0lNQ4aiC6raZoTaHTViIsAB48vZ/BZOsTR94ZtKL6s2v9Tv3vjnrA==',key_name='tempest-keypair-1335730655',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='73137f167a804cddbf7f345f75763c71',ramdisk_id='',reservation_id='r-c72fuk8h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1417905593',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1417905593-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T15:39:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a886368ab6a548c697650bd7690dd009',uuid=1d99de1a-8a82-447a-8a18-02e4efd3b3f0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ab316a13-f7fd-49e0-b6f7-6aa0cc815eca", "address": "fa:16:3e:3c:27:99", "network": {"id": "0ef0c5c2-0325-4d50-8eb3-e72b53c4750c", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-311328630-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73137f167a804cddbf7f345f75763c71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab316a13-f7", "ovs_interfaceid": "ab316a13-f7fd-49e0-b6f7-6aa0cc815eca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75176) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 15:39:40 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-8c02b519-950f-4589-b8a9-dfd5dba161ca tempest-VolumesAssistedSnapshotsTest-1417905593 tempest-VolumesAssistedSnapshotsTest-1417905593-project-member] Converting VIF {"id": "ab316a13-f7fd-49e0-b6f7-6aa0cc815eca", "address": "fa:16:3e:3c:27:99", "network": {"id": "0ef0c5c2-0325-4d50-8eb3-e72b53c4750c", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-311328630-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73137f167a804cddbf7f345f75763c71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab316a13-f7", "ovs_interfaceid": "ab316a13-f7fd-49e0-b6f7-6aa0cc815eca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:39:40 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-8c02b519-950f-4589-b8a9-dfd5dba161ca tempest-VolumesAssistedSnapshotsTest-1417905593 tempest-VolumesAssistedSnapshotsTest-1417905593-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:27:99,bridge_name='br-int',has_traffic_filtering=True,id=ab316a13-f7fd-49e0-b6f7-6aa0cc815eca,network=Network(0ef0c5c2-0325-4d50-8eb3-e72b53c4750c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab316a13-f7') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:39:40 user nova-compute[75176]: DEBUG nova.objects.instance [None req-8c02b519-950f-4589-b8a9-dfd5dba161ca tempest-VolumesAssistedSnapshotsTest-1417905593 tempest-VolumesAssistedSnapshotsTest-1417905593-project-member] Lazy-loading 'pci_devices' on Instance uuid 1d99de1a-8a82-447a-8a18-02e4efd3b3f0 {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:39:40 user nova-compute[75176]: DEBUG nova.compute.manager [None req-08041308-9867-45e8-8e9b-4b47f2e82d58 tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] [instance: e2e25e19-c832-4945-9257-64e6103feb0c] Instance event wait completed in 0 seconds for  {{(pid=75176) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 15:39:40 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-08041308-9867-45e8-8e9b-4b47f2e82d58 tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] [instance: e2e25e19-c832-4945-9257-64e6103feb0c] Guest created on hypervisor {{(pid=75176) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 15:39:40 user nova-compute[75176]: INFO nova.virt.libvirt.driver [-] [instance: e2e25e19-c832-4945-9257-64e6103feb0c] Instance spawned successfully.
Nov 28 15:39:40 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-08041308-9867-45e8-8e9b-4b47f2e82d58 tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] [instance: e2e25e19-c832-4945-9257-64e6103feb0c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 15:39:40 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-8c02b519-950f-4589-b8a9-dfd5dba161ca tempest-VolumesAssistedSnapshotsTest-1417905593 tempest-VolumesAssistedSnapshotsTest-1417905593-project-member] [instance: 1d99de1a-8a82-447a-8a18-02e4efd3b3f0] End _get_guest_xml xml=<domain type="kvm">
Nov 28 15:39:40 user nova-compute[75176]:   <uuid>1d99de1a-8a82-447a-8a18-02e4efd3b3f0</uuid>
Nov 28 15:39:40 user nova-compute[75176]:   <name>instance-00000009</name>
Nov 28 15:39:40 user nova-compute[75176]:   <memory>524288</memory>
Nov 28 15:39:40 user nova-compute[75176]:   <vcpu>1</vcpu>
Nov 28 15:39:40 user nova-compute[75176]:   <metadata>
Nov 28 15:39:40 user nova-compute[75176]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 15:39:40 user nova-compute[75176]:       <nova:package version="0.0.0"/>
Nov 28 15:39:40 user nova-compute[75176]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-484194504</nova:name>
Nov 28 15:39:40 user nova-compute[75176]:       <nova:creationTime>2023-11-28 15:39:39</nova:creationTime>
Nov 28 15:39:40 user nova-compute[75176]:       <nova:flavor name="m1.tiny">
Nov 28 15:39:40 user nova-compute[75176]:         <nova:memory>512</nova:memory>
Nov 28 15:39:40 user nova-compute[75176]:         <nova:disk>1</nova:disk>
Nov 28 15:39:40 user nova-compute[75176]:         <nova:swap>0</nova:swap>
Nov 28 15:39:40 user nova-compute[75176]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 15:39:40 user nova-compute[75176]:         <nova:vcpus>1</nova:vcpus>
Nov 28 15:39:40 user nova-compute[75176]:       </nova:flavor>
Nov 28 15:39:40 user nova-compute[75176]:       <nova:owner>
Nov 28 15:39:40 user nova-compute[75176]:         <nova:user uuid="a886368ab6a548c697650bd7690dd009">tempest-VolumesAssistedSnapshotsTest-1417905593-project-member</nova:user>
Nov 28 15:39:40 user nova-compute[75176]:         <nova:project uuid="73137f167a804cddbf7f345f75763c71">tempest-VolumesAssistedSnapshotsTest-1417905593</nova:project>
Nov 28 15:39:40 user nova-compute[75176]:       </nova:owner>
Nov 28 15:39:40 user nova-compute[75176]:       <nova:root type="image" uuid="1f41819e-c93f-4dc7-b253-37a27bbbbc74"/>
Nov 28 15:39:40 user nova-compute[75176]:       <nova:ports>
Nov 28 15:39:40 user nova-compute[75176]:         <nova:port uuid="ab316a13-f7fd-49e0-b6f7-6aa0cc815eca">
Nov 28 15:39:40 user nova-compute[75176]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 28 15:39:40 user nova-compute[75176]:         </nova:port>
Nov 28 15:39:40 user nova-compute[75176]:       </nova:ports>
Nov 28 15:39:40 user nova-compute[75176]:     </nova:instance>
Nov 28 15:39:40 user nova-compute[75176]:   </metadata>
Nov 28 15:39:40 user nova-compute[75176]:   <sysinfo type="smbios">
Nov 28 15:39:40 user nova-compute[75176]:     <system>
Nov 28 15:39:40 user nova-compute[75176]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 15:39:40 user nova-compute[75176]:       <entry name="product">OpenStack Nova</entry>
Nov 28 15:39:40 user nova-compute[75176]:       <entry name="version">0.0.0</entry>
Nov 28 15:39:40 user nova-compute[75176]:       <entry name="serial">1d99de1a-8a82-447a-8a18-02e4efd3b3f0</entry>
Nov 28 15:39:40 user nova-compute[75176]:       <entry name="uuid">1d99de1a-8a82-447a-8a18-02e4efd3b3f0</entry>
Nov 28 15:39:40 user nova-compute[75176]:       <entry name="family">Virtual Machine</entry>
Nov 28 15:39:40 user nova-compute[75176]:     </system>
Nov 28 15:39:40 user nova-compute[75176]:   </sysinfo>
Nov 28 15:39:40 user nova-compute[75176]:   <os>
Nov 28 15:39:40 user nova-compute[75176]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 15:39:40 user nova-compute[75176]:     <boot dev="hd"/>
Nov 28 15:39:40 user nova-compute[75176]:     <smbios mode="sysinfo"/>
Nov 28 15:39:40 user nova-compute[75176]:   </os>
Nov 28 15:39:40 user nova-compute[75176]:   <features>
Nov 28 15:39:40 user nova-compute[75176]:     <acpi/>
Nov 28 15:39:40 user nova-compute[75176]:     <apic/>
Nov 28 15:39:40 user nova-compute[75176]:     <vmcoreinfo/>
Nov 28 15:39:40 user nova-compute[75176]:   </features>
Nov 28 15:39:40 user nova-compute[75176]:   <clock offset="utc">
Nov 28 15:39:40 user nova-compute[75176]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 15:39:40 user nova-compute[75176]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 15:39:40 user nova-compute[75176]:     <timer name="hpet" present="no"/>
Nov 28 15:39:40 user nova-compute[75176]:   </clock>
Nov 28 15:39:40 user nova-compute[75176]:   <cpu mode="custom" match="exact">
Nov 28 15:39:40 user nova-compute[75176]:     <model>Nehalem</model>
Nov 28 15:39:40 user nova-compute[75176]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 15:39:40 user nova-compute[75176]:   </cpu>
Nov 28 15:39:40 user nova-compute[75176]:   <devices>
Nov 28 15:39:40 user nova-compute[75176]:     <disk type="file" device="disk">
Nov 28 15:39:40 user nova-compute[75176]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 15:39:40 user nova-compute[75176]:       <source file="/opt/stack/data/nova/instances/1d99de1a-8a82-447a-8a18-02e4efd3b3f0/disk"/>
Nov 28 15:39:40 user nova-compute[75176]:       <target dev="vda" bus="virtio"/>
Nov 28 15:39:40 user nova-compute[75176]:     </disk>
Nov 28 15:39:40 user nova-compute[75176]:     <interface type="ethernet">
Nov 28 15:39:40 user nova-compute[75176]:       <mac address="fa:16:3e:3c:27:99"/>
Nov 28 15:39:40 user nova-compute[75176]:       <model type="virtio"/>
Nov 28 15:39:40 user nova-compute[75176]:       <mtu size="1442"/>
Nov 28 15:39:40 user nova-compute[75176]:       <target dev="tapab316a13-f7"/>
Nov 28 15:39:40 user nova-compute[75176]:     </interface>
Nov 28 15:39:40 user nova-compute[75176]:     <serial type="pty">
Nov 28 15:39:40 user nova-compute[75176]:       <log file="/opt/stack/data/nova/instances/1d99de1a-8a82-447a-8a18-02e4efd3b3f0/console.log" append="off"/>
Nov 28 15:39:40 user nova-compute[75176]:     </serial>
Nov 28 15:39:40 user nova-compute[75176]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 15:39:40 user nova-compute[75176]:     <video>
Nov 28 15:39:40 user nova-compute[75176]:       <model type="virtio"/>
Nov 28 15:39:40 user nova-compute[75176]:     </video>
Nov 28 15:39:40 user nova-compute[75176]:     <rng model="virtio">
Nov 28 15:39:40 user nova-compute[75176]:       <backend model="random">/dev/urandom</backend>
Nov 28 15:39:40 user nova-compute[75176]:     </rng>
Nov 28 15:39:40 user nova-compute[75176]:     <controller type="usb" index="0" model="none"/>
Nov 28 15:39:40 user nova-compute[75176]:     <memballoon model="virtio">
Nov 28 15:39:40 user nova-compute[75176]:       <stats period="10"/>
Nov 28 15:39:40 user nova-compute[75176]:     </memballoon>
Nov 28 15:39:40 user nova-compute[75176]:   </devices>
Nov 28 15:39:40 user nova-compute[75176]: </domain>
Nov 28 15:39:40 user nova-compute[75176]:  {{(pid=75176) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 15:39:40 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-8c02b519-950f-4589-b8a9-dfd5dba161ca tempest-VolumesAssistedSnapshotsTest-1417905593 tempest-VolumesAssistedSnapshotsTest-1417905593-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T15:39:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-484194504',display_name='tempest-VolumesAssistedSnapshotsTest-server-484194504',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-484194504',id=9,image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKSgNC2asewx9LWdHcNWDjDRgjOEoSzsRsPdym6E1KUX7KI2Mg71iiy7r7btFMnUGrgjrsBQFw1yD0lNQ4aiC6raZoTaHTViIsAB48vZ/BZOsTR94ZtKL6s2v9Tv3vjnrA==',key_name='tempest-keypair-1335730655',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='73137f167a804cddbf7f345f75763c71',ramdisk_id='',reservation_id='r-c72fuk8h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1417905593',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1417905593-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T15:39:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a886368ab6a548c697650bd7690dd009',uuid=1d99de1a-8a82-447a-8a18-02e4efd3b3f0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ab316a13-f7fd-49e0-b6f7-6aa0cc815eca", "address": "fa:16:3e:3c:27:99", "network": {"id": "0ef0c5c2-0325-4d50-8eb3-e72b53c4750c", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-311328630-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73137f167a804cddbf7f345f75763c71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab316a13-f7", "ovs_interfaceid": "ab316a13-f7fd-49e0-b6f7-6aa0cc815eca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 15:39:40 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-8c02b519-950f-4589-b8a9-dfd5dba161ca tempest-VolumesAssistedSnapshotsTest-1417905593 tempest-VolumesAssistedSnapshotsTest-1417905593-project-member] Converting VIF {"id": "ab316a13-f7fd-49e0-b6f7-6aa0cc815eca", "address": "fa:16:3e:3c:27:99", "network": {"id": "0ef0c5c2-0325-4d50-8eb3-e72b53c4750c", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-311328630-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73137f167a804cddbf7f345f75763c71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab316a13-f7", "ovs_interfaceid": "ab316a13-f7fd-49e0-b6f7-6aa0cc815eca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:39:40 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-8c02b519-950f-4589-b8a9-dfd5dba161ca tempest-VolumesAssistedSnapshotsTest-1417905593 tempest-VolumesAssistedSnapshotsTest-1417905593-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:27:99,bridge_name='br-int',has_traffic_filtering=True,id=ab316a13-f7fd-49e0-b6f7-6aa0cc815eca,network=Network(0ef0c5c2-0325-4d50-8eb3-e72b53c4750c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab316a13-f7') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:39:40 user nova-compute[75176]: DEBUG os_vif [None req-8c02b519-950f-4589-b8a9-dfd5dba161ca tempest-VolumesAssistedSnapshotsTest-1417905593 tempest-VolumesAssistedSnapshotsTest-1417905593-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:27:99,bridge_name='br-int',has_traffic_filtering=True,id=ab316a13-f7fd-49e0-b6f7-6aa0cc815eca,network=Network(0ef0c5c2-0325-4d50-8eb3-e72b53c4750c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab316a13-f7') {{(pid=75176) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 15:39:40 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:39:40 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:39:40 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 15:39:40 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:39:40 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a3bf2be8-20c6-598c-ac33-96ad584ccf80', '_type': 'linux-noop'}}, row=False) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:39:40 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:39:40 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:39:40 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:39:40 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapab316a13-f7, may_exist=True, interface_attrs={}) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:39:40 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapab316a13-f7, col_values=(('qos', UUID('882b293d-a9a0-46f9-ae81-b3b950cfbe8f')),), if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:39:40 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapab316a13-f7, col_values=(('external_ids', {'iface-id': 'ab316a13-f7fd-49e0-b6f7-6aa0cc815eca', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3c:27:99', 'vm-uuid': '1d99de1a-8a82-447a-8a18-02e4efd3b3f0'}),), if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:39:40 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:39:40 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:39:40 user nova-compute[75176]: DEBUG nova.compute.manager [req-6363134b-4a3a-4d23-8bc4-03aaeed41761 req-41b03630-9cff-4d05-a253-d1187f689bbc service nova] [instance: e2e25e19-c832-4945-9257-64e6103feb0c] Received event network-vif-plugged-05efa912-30d1-4474-a2eb-7d88fa0813e7 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:39:40 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-6363134b-4a3a-4d23-8bc4-03aaeed41761 req-41b03630-9cff-4d05-a253-d1187f689bbc service nova] Acquiring lock "e2e25e19-c832-4945-9257-64e6103feb0c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:39:40 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-6363134b-4a3a-4d23-8bc4-03aaeed41761 req-41b03630-9cff-4d05-a253-d1187f689bbc service nova] Lock "e2e25e19-c832-4945-9257-64e6103feb0c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:39:40 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-6363134b-4a3a-4d23-8bc4-03aaeed41761 req-41b03630-9cff-4d05-a253-d1187f689bbc service nova] Lock "e2e25e19-c832-4945-9257-64e6103feb0c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:39:40 user nova-compute[75176]: DEBUG nova.compute.manager [req-6363134b-4a3a-4d23-8bc4-03aaeed41761 req-41b03630-9cff-4d05-a253-d1187f689bbc service nova] [instance: e2e25e19-c832-4945-9257-64e6103feb0c] No waiting events found dispatching network-vif-plugged-05efa912-30d1-4474-a2eb-7d88fa0813e7 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:39:40 user nova-compute[75176]: WARNING nova.compute.manager [req-6363134b-4a3a-4d23-8bc4-03aaeed41761 req-41b03630-9cff-4d05-a253-d1187f689bbc service nova] [instance: e2e25e19-c832-4945-9257-64e6103feb0c] Received unexpected event network-vif-plugged-05efa912-30d1-4474-a2eb-7d88fa0813e7 for instance with vm_state building and task_state spawning.
Nov 28 15:39:40 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-08041308-9867-45e8-8e9b-4b47f2e82d58 tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] [instance: e2e25e19-c832-4945-9257-64e6103feb0c] Found default for hw_cdrom_bus of ide {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:39:40 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-08041308-9867-45e8-8e9b-4b47f2e82d58 tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] [instance: e2e25e19-c832-4945-9257-64e6103feb0c] Found default for hw_disk_bus of virtio {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:39:40 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-08041308-9867-45e8-8e9b-4b47f2e82d58 tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] [instance: e2e25e19-c832-4945-9257-64e6103feb0c] Found default for hw_input_bus of None {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:39:40 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-08041308-9867-45e8-8e9b-4b47f2e82d58 tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] [instance: e2e25e19-c832-4945-9257-64e6103feb0c] Found default for hw_pointer_model of None {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:39:40 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-08041308-9867-45e8-8e9b-4b47f2e82d58 tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] [instance: e2e25e19-c832-4945-9257-64e6103feb0c] Found default for hw_video_model of virtio {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:39:40 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-08041308-9867-45e8-8e9b-4b47f2e82d58 tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] [instance: e2e25e19-c832-4945-9257-64e6103feb0c] Found default for hw_vif_model of virtio {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:39:40 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:39:40 user nova-compute[75176]: INFO os_vif [None req-8c02b519-950f-4589-b8a9-dfd5dba161ca tempest-VolumesAssistedSnapshotsTest-1417905593 tempest-VolumesAssistedSnapshotsTest-1417905593-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:27:99,bridge_name='br-int',has_traffic_filtering=True,id=ab316a13-f7fd-49e0-b6f7-6aa0cc815eca,network=Network(0ef0c5c2-0325-4d50-8eb3-e72b53c4750c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab316a13-f7')
Nov 28 15:39:40 user nova-compute[75176]: INFO nova.compute.manager [None req-08041308-9867-45e8-8e9b-4b47f2e82d58 tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] [instance: e2e25e19-c832-4945-9257-64e6103feb0c] Took 12.89 seconds to spawn the instance on the hypervisor.
Nov 28 15:39:40 user nova-compute[75176]: DEBUG nova.compute.manager [None req-08041308-9867-45e8-8e9b-4b47f2e82d58 tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] [instance: e2e25e19-c832-4945-9257-64e6103feb0c] Checking state {{(pid=75176) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 15:39:40 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-8c02b519-950f-4589-b8a9-dfd5dba161ca tempest-VolumesAssistedSnapshotsTest-1417905593 tempest-VolumesAssistedSnapshotsTest-1417905593-project-member] No BDM found with device name vda, not building metadata. {{(pid=75176) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 15:39:40 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-8c02b519-950f-4589-b8a9-dfd5dba161ca tempest-VolumesAssistedSnapshotsTest-1417905593 tempest-VolumesAssistedSnapshotsTest-1417905593-project-member] No VIF found with MAC fa:16:3e:3c:27:99, not building metadata {{(pid=75176) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 15:39:40 user nova-compute[75176]: INFO nova.compute.manager [None req-08041308-9867-45e8-8e9b-4b47f2e82d58 tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] [instance: e2e25e19-c832-4945-9257-64e6103feb0c] Took 14.02 seconds to build instance.
Nov 28 15:39:40 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-08041308-9867-45e8-8e9b-4b47f2e82d58 tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] Lock "e2e25e19-c832-4945-9257-64e6103feb0c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.306s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:39:40 user nova-compute[75176]: DEBUG nova.network.neutron [req-7d2757f6-eda9-4903-accf-c9ba1c4c6088 req-737abd41-9e7c-4a4e-a51d-02c2ead65928 service nova] [instance: 1d99de1a-8a82-447a-8a18-02e4efd3b3f0] Updated VIF entry in instance network info cache for port ab316a13-f7fd-49e0-b6f7-6aa0cc815eca. {{(pid=75176) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 15:39:40 user nova-compute[75176]: DEBUG nova.network.neutron [req-7d2757f6-eda9-4903-accf-c9ba1c4c6088 req-737abd41-9e7c-4a4e-a51d-02c2ead65928 service nova] [instance: 1d99de1a-8a82-447a-8a18-02e4efd3b3f0] Updating instance_info_cache with network_info: [{"id": "ab316a13-f7fd-49e0-b6f7-6aa0cc815eca", "address": "fa:16:3e:3c:27:99", "network": {"id": "0ef0c5c2-0325-4d50-8eb3-e72b53c4750c", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-311328630-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73137f167a804cddbf7f345f75763c71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab316a13-f7", "ovs_interfaceid": "ab316a13-f7fd-49e0-b6f7-6aa0cc815eca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:39:40 user nova-compute[75176]: DEBUG nova.network.neutron [req-ef0fe63c-a34b-491b-80bc-9c85e7caad58 req-03eb9df6-24eb-47a2-8427-ec20f7b8fde1 service nova] [instance: 916b82eb-97e8-411c-a8ea-8c27d101b48e] Updated VIF entry in instance network info cache for port 38bef3fc-c841-4db3-b429-8fe94a224783. {{(pid=75176) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 15:39:40 user nova-compute[75176]: DEBUG nova.network.neutron [req-ef0fe63c-a34b-491b-80bc-9c85e7caad58 req-03eb9df6-24eb-47a2-8427-ec20f7b8fde1 service nova] [instance: 916b82eb-97e8-411c-a8ea-8c27d101b48e] Updating instance_info_cache with network_info: [{"id": "38bef3fc-c841-4db3-b429-8fe94a224783", "address": "fa:16:3e:13:6e:cf", "network": {"id": "dc41c201-1473-486f-abc4-30a09c441826", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2062231487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d68d78d1dd684c2c920ae8e4ce3eaa21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38bef3fc-c8", "ovs_interfaceid": "38bef3fc-c841-4db3-b429-8fe94a224783", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:39:40 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-7d2757f6-eda9-4903-accf-c9ba1c4c6088 req-737abd41-9e7c-4a4e-a51d-02c2ead65928 service nova] Releasing lock "refresh_cache-1d99de1a-8a82-447a-8a18-02e4efd3b3f0" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:39:40 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-ef0fe63c-a34b-491b-80bc-9c85e7caad58 req-03eb9df6-24eb-47a2-8427-ec20f7b8fde1 service nova] Releasing lock "refresh_cache-916b82eb-97e8-411c-a8ea-8c27d101b48e" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:39:40 user nova-compute[75176]: DEBUG nova.compute.manager [None req-90378837-8250-492a-a41c-184d80ae6776 tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] [instance: 4ed0eb85-e975-446c-8da7-148a4bb36958] Instance event wait completed in 0 seconds for  {{(pid=75176) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 15:39:40 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-90378837-8250-492a-a41c-184d80ae6776 tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] [instance: 4ed0eb85-e975-446c-8da7-148a4bb36958] Guest created on hypervisor {{(pid=75176) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 15:39:40 user nova-compute[75176]: INFO nova.virt.libvirt.driver [-] [instance: 4ed0eb85-e975-446c-8da7-148a4bb36958] Instance spawned successfully.
Nov 28 15:39:40 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-90378837-8250-492a-a41c-184d80ae6776 tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] [instance: 4ed0eb85-e975-446c-8da7-148a4bb36958] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 15:39:40 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-90378837-8250-492a-a41c-184d80ae6776 tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] [instance: 4ed0eb85-e975-446c-8da7-148a4bb36958] Found default for hw_input_bus of None {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:39:40 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-90378837-8250-492a-a41c-184d80ae6776 tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] [instance: 4ed0eb85-e975-446c-8da7-148a4bb36958] Found default for hw_pointer_model of None {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:39:40 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-90378837-8250-492a-a41c-184d80ae6776 tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] [instance: 4ed0eb85-e975-446c-8da7-148a4bb36958] Found default for hw_video_model of virtio {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:39:40 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-90378837-8250-492a-a41c-184d80ae6776 tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] [instance: 4ed0eb85-e975-446c-8da7-148a4bb36958] Found default for hw_vif_model of virtio {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:39:40 user nova-compute[75176]: INFO nova.compute.manager [None req-90378837-8250-492a-a41c-184d80ae6776 tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] [instance: 4ed0eb85-e975-446c-8da7-148a4bb36958] Took 12.80 seconds to spawn the instance on the hypervisor.
Nov 28 15:39:40 user nova-compute[75176]: DEBUG nova.compute.manager [None req-90378837-8250-492a-a41c-184d80ae6776 tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] [instance: 4ed0eb85-e975-446c-8da7-148a4bb36958] Checking state {{(pid=75176) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 15:39:41 user nova-compute[75176]: INFO nova.compute.manager [None req-90378837-8250-492a-a41c-184d80ae6776 tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] [instance: 4ed0eb85-e975-446c-8da7-148a4bb36958] Took 14.62 seconds to build instance.
Nov 28 15:39:41 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-90378837-8250-492a-a41c-184d80ae6776 tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] Lock "4ed0eb85-e975-446c-8da7-148a4bb36958" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.900s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:39:41 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:39:41 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:39:41 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:39:42 user nova-compute[75176]: DEBUG nova.compute.manager [req-edb787cb-7b98-45ec-b0e2-82a50937e619 req-b0576369-0bfb-42fe-bc5e-f1ce3afbd270 service nova] [instance: e2e25e19-c832-4945-9257-64e6103feb0c] Received event network-vif-plugged-05efa912-30d1-4474-a2eb-7d88fa0813e7 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:39:42 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-edb787cb-7b98-45ec-b0e2-82a50937e619 req-b0576369-0bfb-42fe-bc5e-f1ce3afbd270 service nova] Acquiring lock "e2e25e19-c832-4945-9257-64e6103feb0c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:39:42 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-edb787cb-7b98-45ec-b0e2-82a50937e619 req-b0576369-0bfb-42fe-bc5e-f1ce3afbd270 service nova] Lock "e2e25e19-c832-4945-9257-64e6103feb0c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:39:42 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-edb787cb-7b98-45ec-b0e2-82a50937e619 req-b0576369-0bfb-42fe-bc5e-f1ce3afbd270 service nova] Lock "e2e25e19-c832-4945-9257-64e6103feb0c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:39:42 user nova-compute[75176]: DEBUG nova.compute.manager [req-edb787cb-7b98-45ec-b0e2-82a50937e619 req-b0576369-0bfb-42fe-bc5e-f1ce3afbd270 service nova] [instance: e2e25e19-c832-4945-9257-64e6103feb0c] No waiting events found dispatching network-vif-plugged-05efa912-30d1-4474-a2eb-7d88fa0813e7 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:39:42 user nova-compute[75176]: WARNING nova.compute.manager [req-edb787cb-7b98-45ec-b0e2-82a50937e619 req-b0576369-0bfb-42fe-bc5e-f1ce3afbd270 service nova] [instance: e2e25e19-c832-4945-9257-64e6103feb0c] Received unexpected event network-vif-plugged-05efa912-30d1-4474-a2eb-7d88fa0813e7 for instance with vm_state active and task_state None.
Nov 28 15:39:42 user nova-compute[75176]: DEBUG nova.compute.manager [req-edb787cb-7b98-45ec-b0e2-82a50937e619 req-b0576369-0bfb-42fe-bc5e-f1ce3afbd270 service nova] [instance: 4ed0eb85-e975-446c-8da7-148a4bb36958] Received event network-vif-plugged-9996a5ef-0801-4136-bd1d-fd5372d97e9d {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:39:42 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-edb787cb-7b98-45ec-b0e2-82a50937e619 req-b0576369-0bfb-42fe-bc5e-f1ce3afbd270 service nova] Acquiring lock "4ed0eb85-e975-446c-8da7-148a4bb36958-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:39:42 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-edb787cb-7b98-45ec-b0e2-82a50937e619 req-b0576369-0bfb-42fe-bc5e-f1ce3afbd270 service nova] Lock "4ed0eb85-e975-446c-8da7-148a4bb36958-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:39:42 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-edb787cb-7b98-45ec-b0e2-82a50937e619 req-b0576369-0bfb-42fe-bc5e-f1ce3afbd270 service nova] Lock "4ed0eb85-e975-446c-8da7-148a4bb36958-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:39:42 user nova-compute[75176]: DEBUG nova.compute.manager [req-edb787cb-7b98-45ec-b0e2-82a50937e619 req-b0576369-0bfb-42fe-bc5e-f1ce3afbd270 service nova] [instance: 4ed0eb85-e975-446c-8da7-148a4bb36958] No waiting events found dispatching network-vif-plugged-9996a5ef-0801-4136-bd1d-fd5372d97e9d {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:39:42 user nova-compute[75176]: WARNING nova.compute.manager [req-edb787cb-7b98-45ec-b0e2-82a50937e619 req-b0576369-0bfb-42fe-bc5e-f1ce3afbd270 service nova] [instance: 4ed0eb85-e975-446c-8da7-148a4bb36958] Received unexpected event network-vif-plugged-9996a5ef-0801-4136-bd1d-fd5372d97e9d for instance with vm_state active and task_state None.
Nov 28 15:39:42 user nova-compute[75176]: DEBUG nova.compute.manager [req-edb787cb-7b98-45ec-b0e2-82a50937e619 req-b0576369-0bfb-42fe-bc5e-f1ce3afbd270 service nova] [instance: 4ed0eb85-e975-446c-8da7-148a4bb36958] Received event network-vif-plugged-9996a5ef-0801-4136-bd1d-fd5372d97e9d {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:39:42 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-edb787cb-7b98-45ec-b0e2-82a50937e619 req-b0576369-0bfb-42fe-bc5e-f1ce3afbd270 service nova] Acquiring lock "4ed0eb85-e975-446c-8da7-148a4bb36958-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:39:42 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-edb787cb-7b98-45ec-b0e2-82a50937e619 req-b0576369-0bfb-42fe-bc5e-f1ce3afbd270 service nova] Lock "4ed0eb85-e975-446c-8da7-148a4bb36958-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:39:42 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-edb787cb-7b98-45ec-b0e2-82a50937e619 req-b0576369-0bfb-42fe-bc5e-f1ce3afbd270 service nova] Lock "4ed0eb85-e975-446c-8da7-148a4bb36958-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:39:42 user nova-compute[75176]: DEBUG nova.compute.manager [req-edb787cb-7b98-45ec-b0e2-82a50937e619 req-b0576369-0bfb-42fe-bc5e-f1ce3afbd270 service nova] [instance: 4ed0eb85-e975-446c-8da7-148a4bb36958] No waiting events found dispatching network-vif-plugged-9996a5ef-0801-4136-bd1d-fd5372d97e9d {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:39:42 user nova-compute[75176]: WARNING nova.compute.manager [req-edb787cb-7b98-45ec-b0e2-82a50937e619 req-b0576369-0bfb-42fe-bc5e-f1ce3afbd270 service nova] [instance: 4ed0eb85-e975-446c-8da7-148a4bb36958] Received unexpected event network-vif-plugged-9996a5ef-0801-4136-bd1d-fd5372d97e9d for instance with vm_state active and task_state None.
Nov 28 15:39:42 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:39:42 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Cleaning up deleted instances {{(pid=75176) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 28 15:39:42 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] There are 0 instances to clean {{(pid=75176) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 28 15:39:42 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:39:42 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75176) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 28 15:39:42 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:39:42 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:39:42 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:39:42 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:39:42 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:39:42 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:39:44 user nova-compute[75176]: DEBUG nova.compute.manager [req-590f41dc-a3ab-463a-89f8-a9f6a7861902 req-96eb3b28-ba20-4661-b56f-e7a343406725 service nova] [instance: 1d99de1a-8a82-447a-8a18-02e4efd3b3f0] Received event network-vif-plugged-ab316a13-f7fd-49e0-b6f7-6aa0cc815eca {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:39:44 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-590f41dc-a3ab-463a-89f8-a9f6a7861902 req-96eb3b28-ba20-4661-b56f-e7a343406725 service nova] Acquiring lock "1d99de1a-8a82-447a-8a18-02e4efd3b3f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:39:44 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-590f41dc-a3ab-463a-89f8-a9f6a7861902 req-96eb3b28-ba20-4661-b56f-e7a343406725 service nova] Lock "1d99de1a-8a82-447a-8a18-02e4efd3b3f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:39:44 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-590f41dc-a3ab-463a-89f8-a9f6a7861902 req-96eb3b28-ba20-4661-b56f-e7a343406725 service nova] Lock "1d99de1a-8a82-447a-8a18-02e4efd3b3f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:39:44 user nova-compute[75176]: DEBUG nova.compute.manager [req-590f41dc-a3ab-463a-89f8-a9f6a7861902 req-96eb3b28-ba20-4661-b56f-e7a343406725 service nova] [instance: 1d99de1a-8a82-447a-8a18-02e4efd3b3f0] No waiting events found dispatching network-vif-plugged-ab316a13-f7fd-49e0-b6f7-6aa0cc815eca {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:39:44 user nova-compute[75176]: WARNING nova.compute.manager [req-590f41dc-a3ab-463a-89f8-a9f6a7861902 req-96eb3b28-ba20-4661-b56f-e7a343406725 service nova] [instance: 1d99de1a-8a82-447a-8a18-02e4efd3b3f0] Received unexpected event network-vif-plugged-ab316a13-f7fd-49e0-b6f7-6aa0cc815eca for instance with vm_state building and task_state spawning.
Nov 28 15:39:44 user nova-compute[75176]: DEBUG nova.compute.manager [req-590f41dc-a3ab-463a-89f8-a9f6a7861902 req-96eb3b28-ba20-4661-b56f-e7a343406725 service nova] [instance: 1d99de1a-8a82-447a-8a18-02e4efd3b3f0] Received event network-vif-plugged-ab316a13-f7fd-49e0-b6f7-6aa0cc815eca {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:39:44 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-590f41dc-a3ab-463a-89f8-a9f6a7861902 req-96eb3b28-ba20-4661-b56f-e7a343406725 service nova] Acquiring lock "1d99de1a-8a82-447a-8a18-02e4efd3b3f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:39:44 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-590f41dc-a3ab-463a-89f8-a9f6a7861902 req-96eb3b28-ba20-4661-b56f-e7a343406725 service nova] Lock "1d99de1a-8a82-447a-8a18-02e4efd3b3f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:39:44 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-590f41dc-a3ab-463a-89f8-a9f6a7861902 req-96eb3b28-ba20-4661-b56f-e7a343406725 service nova] Lock "1d99de1a-8a82-447a-8a18-02e4efd3b3f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:39:44 user nova-compute[75176]: DEBUG nova.compute.manager [req-590f41dc-a3ab-463a-89f8-a9f6a7861902 req-96eb3b28-ba20-4661-b56f-e7a343406725 service nova] [instance: 1d99de1a-8a82-447a-8a18-02e4efd3b3f0] No waiting events found dispatching network-vif-plugged-ab316a13-f7fd-49e0-b6f7-6aa0cc815eca {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:39:44 user nova-compute[75176]: WARNING nova.compute.manager [req-590f41dc-a3ab-463a-89f8-a9f6a7861902 req-96eb3b28-ba20-4661-b56f-e7a343406725 service nova] [instance: 1d99de1a-8a82-447a-8a18-02e4efd3b3f0] Received unexpected event network-vif-plugged-ab316a13-f7fd-49e0-b6f7-6aa0cc815eca for instance with vm_state building and task_state spawning.
Nov 28 15:39:44 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:39:44 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:39:44 user nova-compute[75176]: DEBUG nova.compute.manager [None req-8c02b519-950f-4589-b8a9-dfd5dba161ca tempest-VolumesAssistedSnapshotsTest-1417905593 tempest-VolumesAssistedSnapshotsTest-1417905593-project-member] [instance: 1d99de1a-8a82-447a-8a18-02e4efd3b3f0] Instance event wait completed in 0 seconds for  {{(pid=75176) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 15:39:44 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-8c02b519-950f-4589-b8a9-dfd5dba161ca tempest-VolumesAssistedSnapshotsTest-1417905593 tempest-VolumesAssistedSnapshotsTest-1417905593-project-member] [instance: 1d99de1a-8a82-447a-8a18-02e4efd3b3f0] Guest created on hypervisor {{(pid=75176) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 15:39:44 user nova-compute[75176]: INFO nova.virt.libvirt.driver [-] [instance: 1d99de1a-8a82-447a-8a18-02e4efd3b3f0] Instance spawned successfully.
Nov 28 15:39:44 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-8c02b519-950f-4589-b8a9-dfd5dba161ca tempest-VolumesAssistedSnapshotsTest-1417905593 tempest-VolumesAssistedSnapshotsTest-1417905593-project-member] [instance: 1d99de1a-8a82-447a-8a18-02e4efd3b3f0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 15:39:44 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-8c02b519-950f-4589-b8a9-dfd5dba161ca tempest-VolumesAssistedSnapshotsTest-1417905593 tempest-VolumesAssistedSnapshotsTest-1417905593-project-member] [instance: 1d99de1a-8a82-447a-8a18-02e4efd3b3f0] Found default for hw_cdrom_bus of ide {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:39:44 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-8c02b519-950f-4589-b8a9-dfd5dba161ca tempest-VolumesAssistedSnapshotsTest-1417905593 tempest-VolumesAssistedSnapshotsTest-1417905593-project-member] [instance: 1d99de1a-8a82-447a-8a18-02e4efd3b3f0] Found default for hw_disk_bus of virtio {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:39:44 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-8c02b519-950f-4589-b8a9-dfd5dba161ca tempest-VolumesAssistedSnapshotsTest-1417905593 tempest-VolumesAssistedSnapshotsTest-1417905593-project-member] [instance: 1d99de1a-8a82-447a-8a18-02e4efd3b3f0] Found default for hw_input_bus of None {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:39:44 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-8c02b519-950f-4589-b8a9-dfd5dba161ca tempest-VolumesAssistedSnapshotsTest-1417905593 tempest-VolumesAssistedSnapshotsTest-1417905593-project-member] [instance: 1d99de1a-8a82-447a-8a18-02e4efd3b3f0] Found default for hw_pointer_model of None {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:39:44 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-8c02b519-950f-4589-b8a9-dfd5dba161ca tempest-VolumesAssistedSnapshotsTest-1417905593 tempest-VolumesAssistedSnapshotsTest-1417905593-project-member] [instance: 1d99de1a-8a82-447a-8a18-02e4efd3b3f0] Found default for hw_video_model of virtio {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:39:44 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-8c02b519-950f-4589-b8a9-dfd5dba161ca tempest-VolumesAssistedSnapshotsTest-1417905593 tempest-VolumesAssistedSnapshotsTest-1417905593-project-member] [instance: 1d99de1a-8a82-447a-8a18-02e4efd3b3f0] Found default for hw_vif_model of virtio {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:39:45 user nova-compute[75176]: INFO nova.compute.manager [None req-8c02b519-950f-4589-b8a9-dfd5dba161ca tempest-VolumesAssistedSnapshotsTest-1417905593 tempest-VolumesAssistedSnapshotsTest-1417905593-project-member] [instance: 1d99de1a-8a82-447a-8a18-02e4efd3b3f0] Took 7.64 seconds to spawn the instance on the hypervisor.
Nov 28 15:39:45 user nova-compute[75176]: DEBUG nova.compute.manager [None req-8c02b519-950f-4589-b8a9-dfd5dba161ca tempest-VolumesAssistedSnapshotsTest-1417905593 tempest-VolumesAssistedSnapshotsTest-1417905593-project-member] [instance: 1d99de1a-8a82-447a-8a18-02e4efd3b3f0] Checking state {{(pid=75176) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 15:39:45 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:39:45 user nova-compute[75176]: INFO nova.compute.manager [None req-8c02b519-950f-4589-b8a9-dfd5dba161ca tempest-VolumesAssistedSnapshotsTest-1417905593 tempest-VolumesAssistedSnapshotsTest-1417905593-project-member] [instance: 1d99de1a-8a82-447a-8a18-02e4efd3b3f0] Took 9.01 seconds to build instance.
Nov 28 15:39:45 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-8c02b519-950f-4589-b8a9-dfd5dba161ca tempest-VolumesAssistedSnapshotsTest-1417905593 tempest-VolumesAssistedSnapshotsTest-1417905593-project-member] Lock "1d99de1a-8a82-447a-8a18-02e4efd3b3f0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.162s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:39:45 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:39:45 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:39:45 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:39:45 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:39:45 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:39:45 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:39:45 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Auditing locally available compute resources for user (node: user) {{(pid=75176) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 15:39:46 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2e25e19-c832-4945-9257-64e6103feb0c/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:39:46 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2e25e19-c832-4945-9257-64e6103feb0c/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:39:46 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2e25e19-c832-4945-9257-64e6103feb0c/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:39:46 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2e25e19-c832-4945-9257-64e6103feb0c/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:39:46 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e8507b7-fccf-4196-b589-bf2b74f165ec/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:39:46 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e8507b7-fccf-4196-b589-bf2b74f165ec/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:39:46 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e8507b7-fccf-4196-b589-bf2b74f165ec/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:39:46 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e8507b7-fccf-4196-b589-bf2b74f165ec/disk --force-share --output=json" returned: 0 in 0.264s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:39:46 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d99de1a-8a82-447a-8a18-02e4efd3b3f0/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:39:47 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d99de1a-8a82-447a-8a18-02e4efd3b3f0/disk --force-share --output=json" returned: 0 in 0.275s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:39:47 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d99de1a-8a82-447a-8a18-02e4efd3b3f0/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:39:47 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d99de1a-8a82-447a-8a18-02e4efd3b3f0/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:39:47 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b18c889-7694-4edf-8cf2-b9032e60289e/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:39:47 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b18c889-7694-4edf-8cf2-b9032e60289e/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:39:47 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b18c889-7694-4edf-8cf2-b9032e60289e/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:39:47 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:39:47 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b18c889-7694-4edf-8cf2-b9032e60289e/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:39:47 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa223c49-d254-4727-8a01-873026847b37/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:39:48 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa223c49-d254-4727-8a01-873026847b37/disk --force-share --output=json" returned: 0 in 0.286s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:39:48 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa223c49-d254-4727-8a01-873026847b37/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:39:48 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa223c49-d254-4727-8a01-873026847b37/disk --force-share --output=json" returned: 0 in 0.273s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:39:48 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ab0619f-72e5-4975-ade8-53d7c0784d89/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:39:48 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ab0619f-72e5-4975-ade8-53d7c0784d89/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:39:48 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ab0619f-72e5-4975-ade8-53d7c0784d89/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:39:49 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ab0619f-72e5-4975-ade8-53d7c0784d89/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:39:49 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f81dc25c-3549-4e25-b27c-a75a50d9a448/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:39:49 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f81dc25c-3549-4e25-b27c-a75a50d9a448/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:39:49 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f81dc25c-3549-4e25-b27c-a75a50d9a448/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:39:49 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f81dc25c-3549-4e25-b27c-a75a50d9a448/disk --force-share --output=json" returned: 0 in 0.275s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:39:49 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ed0eb85-e975-446c-8da7-148a4bb36958/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:39:49 user nova-compute[75176]: DEBUG nova.compute.manager [None req-49fd2865-6e0d-48a7-9d4d-bc4748d147ce tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] [instance: 916b82eb-97e8-411c-a8ea-8c27d101b48e] Start spawning the instance on the hypervisor. {{(pid=75176) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 15:39:49 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-49fd2865-6e0d-48a7-9d4d-bc4748d147ce tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] [instance: 916b82eb-97e8-411c-a8ea-8c27d101b48e] Creating instance directory {{(pid=75176) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 15:39:49 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-49fd2865-6e0d-48a7-9d4d-bc4748d147ce tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] [instance: 916b82eb-97e8-411c-a8ea-8c27d101b48e] Creating image(s)
Nov 28 15:39:49 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-49fd2865-6e0d-48a7-9d4d-bc4748d147ce tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] [instance: 916b82eb-97e8-411c-a8ea-8c27d101b48e] Did not create local disks {{(pid=75176) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 28 15:39:49 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-49fd2865-6e0d-48a7-9d4d-bc4748d147ce tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] [instance: 916b82eb-97e8-411c-a8ea-8c27d101b48e] Ensure instance console log exists: /opt/stack/data/nova/instances/916b82eb-97e8-411c-a8ea-8c27d101b48e/console.log {{(pid=75176) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 15:39:49 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-49fd2865-6e0d-48a7-9d4d-bc4748d147ce tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:39:49 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-49fd2865-6e0d-48a7-9d4d-bc4748d147ce tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:39:49 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-49fd2865-6e0d-48a7-9d4d-bc4748d147ce tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:39:49 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-49fd2865-6e0d-48a7-9d4d-bc4748d147ce tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] [instance: 916b82eb-97e8-411c-a8ea-8c27d101b48e] Start _get_guest_xml network_info=[{"id": "38bef3fc-c841-4db3-b429-8fe94a224783", "address": "fa:16:3e:13:6e:cf", "network": {"id": "dc41c201-1473-486f-abc4-30a09c441826", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2062231487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d68d78d1dd684c2c920ae8e4ce3eaa21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38bef3fc-c8", "ovs_interfaceid": "38bef3fc-c841-4db3-b429-8fe94a224783", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IhQCYfRb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '916b82eb-97e8-411c-a8ea-8c27d101b48e', 'attached_at': '', 'detached_at': '', 'volume_id': 'ec90fb93-901a-43ab-ba96-58f9505953e9', 'serial': 'ec90fb93-901a-43ab-ba96-58f9505953e9'}, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'delete_on_termination': True, 'mount_device': '/dev/vda', 'attachment_id': 'd18774dd-8262-4de9-966b-d2abe4b58bca', 'volume_type': None} {{(pid=75176) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 15:39:49 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-49fd2865-6e0d-48a7-9d4d-bc4748d147ce tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 15:39:49 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-49fd2865-6e0d-48a7-9d4d-bc4748d147ce tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 15:39:49 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-49fd2865-6e0d-48a7-9d4d-bc4748d147ce tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75176) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 15:39:49 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-49fd2865-6e0d-48a7-9d4d-bc4748d147ce tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] CPU controller missing on host. {{(pid=75176) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 15:39:49 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-49fd2865-6e0d-48a7-9d4d-bc4748d147ce tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75176) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 15:39:49 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-49fd2865-6e0d-48a7-9d4d-bc4748d147ce tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] CPU controller found on host. {{(pid=75176) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 15:39:49 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-49fd2865-6e0d-48a7-9d4d-bc4748d147ce tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75176) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 15:39:49 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-49fd2865-6e0d-48a7-9d4d-bc4748d147ce tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T15:35:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 15:39:49 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-49fd2865-6e0d-48a7-9d4d-bc4748d147ce tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] Flavor limits 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 15:39:49 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-49fd2865-6e0d-48a7-9d4d-bc4748d147ce tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] Image limits 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 15:39:49 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-49fd2865-6e0d-48a7-9d4d-bc4748d147ce tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] Flavor pref 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 15:39:49 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-49fd2865-6e0d-48a7-9d4d-bc4748d147ce tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] Image pref 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 15:39:49 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-49fd2865-6e0d-48a7-9d4d-bc4748d147ce tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 15:39:49 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-49fd2865-6e0d-48a7-9d4d-bc4748d147ce tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 15:39:49 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-49fd2865-6e0d-48a7-9d4d-bc4748d147ce tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75176) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 15:39:49 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-49fd2865-6e0d-48a7-9d4d-bc4748d147ce tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] Got 1 possible topologies {{(pid=75176) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 15:39:49 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-49fd2865-6e0d-48a7-9d4d-bc4748d147ce tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 15:39:49 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-49fd2865-6e0d-48a7-9d4d-bc4748d147ce tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 15:39:49 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-49fd2865-6e0d-48a7-9d4d-bc4748d147ce tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:39:49 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-49fd2865-6e0d-48a7-9d4d-bc4748d147ce tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:39:49 user nova-compute[75176]: DEBUG os_brick.initiator.connector [None req-49fd2865-6e0d-48a7-9d4d-bc4748d147ce tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] Factory for ISCSI on None {{(pid=75176) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Nov 28 15:39:49 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-49fd2865-6e0d-48a7-9d4d-bc4748d147ce tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.007s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:39:49 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-49fd2865-6e0d-48a7-9d4d-bc4748d147ce tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] [instance: 916b82eb-97e8-411c-a8ea-8c27d101b48e] Calling os-brick to attach iSCSI Volume {{(pid=75176) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 15:39:49 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-49fd2865-6e0d-48a7-9d4d-bc4748d147ce tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c1b8a00>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IhQCYfRb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 15:39:49 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-49fd2865-6e0d-48a7-9d4d-bc4748d147ce tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 15:39:49 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-49fd2865-6e0d-48a7-9d4d-bc4748d147ce tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 15:39:49 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-49fd2865-6e0d-48a7-9d4d-bc4748d147ce tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 15:39:49 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-49fd2865-6e0d-48a7-9d4d-bc4748d147ce tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 15:39:49 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-49fd2865-6e0d-48a7-9d4d-bc4748d147ce tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 15:39:49 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-49fd2865-6e0d-48a7-9d4d-bc4748d147ce tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 15:39:49 user nova-compute[75176]: INFO os_brick.initiator.connectors.iscsi [None req-49fd2865-6e0d-48a7-9d4d-bc4748d147ce tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 15:39:49 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9 -p 172.16.0.220:3260 {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:39:49 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ed0eb85-e975-446c-8da7-148a4bb36958/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:39:49 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ed0eb85-e975-446c-8da7-148a4bb36958/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:39:49 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9 -p 172.16.0.220:3260" returned: 21 in 0.037s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:39:49 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e9818aa-1bbb-4a80-817e-baa005b05fc0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:39:49 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-49fd2865-6e0d-48a7-9d4d-bc4748d147ce tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 15:39:49 user nova-compute[75176]:  {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:39:49 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9 -p 172.16.0.220:3260 --interface default --op new {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:39:49 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:39:49 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7bc4091-9bba-4c47-89e4-e3ddb3eec1b3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9] added\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:39:49 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-49fd2865-6e0d-48a7-9d4d-bc4748d147ce tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9] added
Nov 28 15:39:49 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:39:49 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:39:49 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:39:49 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[73cc2667-bd6d-4b67-9111-d42d9660a9f4]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:39:49 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-49fd2865-6e0d-48a7-9d4d-bc4748d147ce tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:39:49 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:39:49 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:39:49 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd6cec1a-1793-4cd9-9ee1-64476a668bd8]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:39:49 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-49fd2865-6e0d-48a7-9d4d-bc4748d147ce tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:39:49 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IhQCYfRb {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:39:50 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IhQCYfRb" returned: 0 in 0.021s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:39:50 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[de2f0632-79a5-49c9-a124-7402ea3356f5]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:39:50 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-49fd2865-6e0d-48a7-9d4d-bc4748d147ce tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IhQCYfRb'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:39:50 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:39:50 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.030s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:39:50 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4fb110a-361f-47b3-95e4-e8fb2c095905]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:39:50 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-49fd2865-6e0d-48a7-9d4d-bc4748d147ce tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:39:50 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:39:50 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:39:50 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c0e9b85-fd14-4a5d-b987-4c7b8789724f]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:39:50 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-49fd2865-6e0d-48a7-9d4d-bc4748d147ce tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 28 15:39:50 user nova-compute[75176]:  {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:39:50 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-49fd2865-6e0d-48a7-9d4d-bc4748d147ce tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 28 15:39:50 user nova-compute[75176]:  {{(pid=75176) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 15:39:50 user nova-compute[75176]: WARNING os_brick.initiator.connectors.iscsi [None req-49fd2865-6e0d-48a7-9d4d-bc4748d147ce tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 28 15:39:50 user nova-compute[75176]: 
Nov 28 15:39:50 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9 -p 172.16.0.220:3260 --login {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:39:50 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ed0eb85-e975-446c-8da7-148a4bb36958/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:39:50 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:39:50 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9 -p 172.16.0.220:3260 --login" returned: 0 in 0.080s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:39:50 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5d7f4cb-86df-4ae2-94cb-f76f25d8d253]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:39:50 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-49fd2865-6e0d-48a7-9d4d-bc4748d147ce tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9, portal: 172.16.0.220,3260]
Nov 28 15:39:50 user nova-compute[75176]: Login to [iface: default, target: iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9, portal: 172.16.0.220,3260] successful.
Nov 28 15:39:50 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:39:50 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:39:50 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 15:39:50 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 15:39:50 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Hypervisor/Node resource view: name=user free_ram=7895MB free_disk=25.67165756225586GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75176) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 15:39:50 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:39:50 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:39:50 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:39:50 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[079ec9d6-b81f-4884-b8c4-c9d6c9328bfa]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:39:50 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-49fd2865-6e0d-48a7-9d4d-bc4748d147ce tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:39:50 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:39:50 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:39:50 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[f762d6b0-e88d-420f-a2cf-8d5fd28af0c6]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9 (non-flash)\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:39:50 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-49fd2865-6e0d-48a7-9d4d-bc4748d147ce tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9 (non-flash)
Nov 28 15:39:50 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:39:50 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-49fd2865-6e0d-48a7-9d4d-bc4748d147ce tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9 (non-flash)
Nov 28 15:39:50 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 15:39:50 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-49fd2865-6e0d-48a7-9d4d-bc4748d147ce tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.957s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 15:39:50 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-49fd2865-6e0d-48a7-9d4d-bc4748d147ce tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] Connected to 172.16.0.220:3260 {{(pid=75176) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 15:39:50 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-49fd2865-6e0d-48a7-9d4d-bc4748d147ce tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=75176) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 15:39:50 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-49fd2865-6e0d-48a7-9d4d-bc4748d147ce tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75176) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 15:39:50 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:39:50 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.026s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:39:50 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[1903937c-ee6b-464c-a8c6-cf42ad53f505]: (4, ('- - 0', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:39:50 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-49fd2865-6e0d-48a7-9d4d-bc4748d147ce tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75176) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 15:39:50 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-49fd2865-6e0d-48a7-9d4d-bc4748d147ce tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IhQCYfRb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75176) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 15:39:50 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance f81dc25c-3549-4e25-b27c-a75a50d9a448 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:39:50 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance 6ab0619f-72e5-4975-ade8-53d7c0784d89 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:39:50 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance aa223c49-d254-4727-8a01-873026847b37 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:39:50 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance 2e8507b7-fccf-4196-b589-bf2b74f165ec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:39:50 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance 5b18c889-7694-4edf-8cf2-b9032e60289e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:39:50 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance e2e25e19-c832-4945-9257-64e6103feb0c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:39:50 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance 4ed0eb85-e975-446c-8da7-148a4bb36958 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:39:50 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance 916b82eb-97e8-411c-a8ea-8c27d101b48e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:39:50 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance 1d99de1a-8a82-447a-8a18-02e4efd3b3f0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:39:50 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75176) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 15:39:50 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75176) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 15:39:51 user nova-compute[75176]: DEBUG nova.compute.provider_tree [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Inventory has not changed in ProviderTree for provider: b37848d8-f401-4155-a029-b0ffa09ff85b {{(pid=75176) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 15:39:51 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Inventory has not changed for provider b37848d8-f401-4155-a029-b0ffa09ff85b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75176) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 15:39:51 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Compute_service record updated for user:user {{(pid=75176) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 15:39:51 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.716s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:39:51 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-49fd2865-6e0d-48a7-9d4d-bc4748d147ce tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.013s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 15:39:51 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-49fd2865-6e0d-48a7-9d4d-bc4748d147ce tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] <== connect_volume: return (2015ms) {'type': 'block', 'scsi_wwn': '26533346230373363', 'path': '/dev/sdb'} {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 15:39:51 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-49fd2865-6e0d-48a7-9d4d-bc4748d147ce tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] [instance: 916b82eb-97e8-411c-a8ea-8c27d101b48e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26533346230373363', 'path': '/dev/sdb'} {{(pid=75176) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 15:39:51 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-49fd2865-6e0d-48a7-9d4d-bc4748d147ce tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T15:39:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-2102540116',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-2102540116',id=8,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCQNBGdiL2UyuS5dM6+KjwbgIJ/vX3p2dH1PNPmJxj5EzppPATyTzrKhi1oHmfMeT/UPJyLXI+eIry/aVtUhrMzZLSlMRjHwwDIb+xEYyhtsdb9ZUumnXRPBTV8py7ZAjw==',key_name='tempest-keypair-1515121820',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d68d78d1dd684c2c920ae8e4ce3eaa21',ramdisk_id='',reservation_id='r-uy5cy6al',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-267222163',owner_user_name='tempest-ServerActionsV293TestJSON-267222163-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T15:39:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aea69806df134eeb946d4ed91bd7152b',uuid=916b82eb-97e8-411c-a8ea-8c27d101b48e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "38bef3fc-c841-4db3-b429-8fe94a224783", "address": "fa:16:3e:13:6e:cf", "network": {"id": "dc41c201-1473-486f-abc4-30a09c441826", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2062231487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d68d78d1dd684c2c920ae8e4ce3eaa21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38bef3fc-c8", "ovs_interfaceid": "38bef3fc-c841-4db3-b429-8fe94a224783", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75176) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 15:39:51 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-49fd2865-6e0d-48a7-9d4d-bc4748d147ce tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] Converting VIF {"id": "38bef3fc-c841-4db3-b429-8fe94a224783", "address": "fa:16:3e:13:6e:cf", "network": {"id": "dc41c201-1473-486f-abc4-30a09c441826", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2062231487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d68d78d1dd684c2c920ae8e4ce3eaa21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38bef3fc-c8", "ovs_interfaceid": "38bef3fc-c841-4db3-b429-8fe94a224783", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:39:51 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-49fd2865-6e0d-48a7-9d4d-bc4748d147ce tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:6e:cf,bridge_name='br-int',has_traffic_filtering=True,id=38bef3fc-c841-4db3-b429-8fe94a224783,network=Network(dc41c201-1473-486f-abc4-30a09c441826),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38bef3fc-c8') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:39:51 user nova-compute[75176]: DEBUG nova.objects.instance [None req-49fd2865-6e0d-48a7-9d4d-bc4748d147ce tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] Lazy-loading 'pci_devices' on Instance uuid 916b82eb-97e8-411c-a8ea-8c27d101b48e {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:39:51 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-49fd2865-6e0d-48a7-9d4d-bc4748d147ce tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] [instance: 916b82eb-97e8-411c-a8ea-8c27d101b48e] End _get_guest_xml xml=<domain type="kvm">
Nov 28 15:39:51 user nova-compute[75176]:   <uuid>916b82eb-97e8-411c-a8ea-8c27d101b48e</uuid>
Nov 28 15:39:51 user nova-compute[75176]:   <name>instance-00000008</name>
Nov 28 15:39:51 user nova-compute[75176]:   <memory>524288</memory>
Nov 28 15:39:51 user nova-compute[75176]:   <vcpu>1</vcpu>
Nov 28 15:39:51 user nova-compute[75176]:   <metadata>
Nov 28 15:39:51 user nova-compute[75176]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 15:39:51 user nova-compute[75176]:       <nova:package version="0.0.0"/>
Nov 28 15:39:51 user nova-compute[75176]:       <nova:name>tempest-ServerActionsV293TestJSON-server-2102540116</nova:name>
Nov 28 15:39:51 user nova-compute[75176]:       <nova:creationTime>2023-11-28 15:39:49</nova:creationTime>
Nov 28 15:39:51 user nova-compute[75176]:       <nova:flavor name="m1.tiny">
Nov 28 15:39:51 user nova-compute[75176]:         <nova:memory>512</nova:memory>
Nov 28 15:39:51 user nova-compute[75176]:         <nova:disk>1</nova:disk>
Nov 28 15:39:51 user nova-compute[75176]:         <nova:swap>0</nova:swap>
Nov 28 15:39:51 user nova-compute[75176]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 15:39:51 user nova-compute[75176]:         <nova:vcpus>1</nova:vcpus>
Nov 28 15:39:51 user nova-compute[75176]:       </nova:flavor>
Nov 28 15:39:51 user nova-compute[75176]:       <nova:owner>
Nov 28 15:39:51 user nova-compute[75176]:         <nova:user uuid="aea69806df134eeb946d4ed91bd7152b">tempest-ServerActionsV293TestJSON-267222163-project-member</nova:user>
Nov 28 15:39:51 user nova-compute[75176]:         <nova:project uuid="d68d78d1dd684c2c920ae8e4ce3eaa21">tempest-ServerActionsV293TestJSON-267222163</nova:project>
Nov 28 15:39:51 user nova-compute[75176]:       </nova:owner>
Nov 28 15:39:51 user nova-compute[75176]:       <nova:ports>
Nov 28 15:39:51 user nova-compute[75176]:         <nova:port uuid="38bef3fc-c841-4db3-b429-8fe94a224783">
Nov 28 15:39:51 user nova-compute[75176]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 28 15:39:51 user nova-compute[75176]:         </nova:port>
Nov 28 15:39:51 user nova-compute[75176]:       </nova:ports>
Nov 28 15:39:51 user nova-compute[75176]:     </nova:instance>
Nov 28 15:39:51 user nova-compute[75176]:   </metadata>
Nov 28 15:39:51 user nova-compute[75176]:   <sysinfo type="smbios">
Nov 28 15:39:51 user nova-compute[75176]:     <system>
Nov 28 15:39:51 user nova-compute[75176]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 15:39:51 user nova-compute[75176]:       <entry name="product">OpenStack Nova</entry>
Nov 28 15:39:51 user nova-compute[75176]:       <entry name="version">0.0.0</entry>
Nov 28 15:39:51 user nova-compute[75176]:       <entry name="serial">916b82eb-97e8-411c-a8ea-8c27d101b48e</entry>
Nov 28 15:39:51 user nova-compute[75176]:       <entry name="uuid">916b82eb-97e8-411c-a8ea-8c27d101b48e</entry>
Nov 28 15:39:51 user nova-compute[75176]:       <entry name="family">Virtual Machine</entry>
Nov 28 15:39:51 user nova-compute[75176]:     </system>
Nov 28 15:39:51 user nova-compute[75176]:   </sysinfo>
Nov 28 15:39:51 user nova-compute[75176]:   <os>
Nov 28 15:39:51 user nova-compute[75176]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 15:39:51 user nova-compute[75176]:     <boot dev="hd"/>
Nov 28 15:39:51 user nova-compute[75176]:     <smbios mode="sysinfo"/>
Nov 28 15:39:51 user nova-compute[75176]:   </os>
Nov 28 15:39:51 user nova-compute[75176]:   <features>
Nov 28 15:39:51 user nova-compute[75176]:     <acpi/>
Nov 28 15:39:51 user nova-compute[75176]:     <apic/>
Nov 28 15:39:51 user nova-compute[75176]:     <vmcoreinfo/>
Nov 28 15:39:51 user nova-compute[75176]:   </features>
Nov 28 15:39:51 user nova-compute[75176]:   <clock offset="utc">
Nov 28 15:39:51 user nova-compute[75176]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 15:39:51 user nova-compute[75176]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 15:39:51 user nova-compute[75176]:     <timer name="hpet" present="no"/>
Nov 28 15:39:51 user nova-compute[75176]:   </clock>
Nov 28 15:39:51 user nova-compute[75176]:   <cpu mode="custom" match="exact">
Nov 28 15:39:51 user nova-compute[75176]:     <model>Nehalem</model>
Nov 28 15:39:51 user nova-compute[75176]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 15:39:51 user nova-compute[75176]:   </cpu>
Nov 28 15:39:51 user nova-compute[75176]:   <devices>
Nov 28 15:39:51 user nova-compute[75176]:     <disk type="block" device="disk">
Nov 28 15:39:51 user nova-compute[75176]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 15:39:51 user nova-compute[75176]:       <source dev="/dev/sdb"/>
Nov 28 15:39:51 user nova-compute[75176]:       <target dev="vda" bus="virtio"/>
Nov 28 15:39:51 user nova-compute[75176]:       <serial>ec90fb93-901a-43ab-ba96-58f9505953e9</serial>
Nov 28 15:39:51 user nova-compute[75176]:     </disk>
Nov 28 15:39:51 user nova-compute[75176]:     <interface type="ethernet">
Nov 28 15:39:51 user nova-compute[75176]:       <mac address="fa:16:3e:13:6e:cf"/>
Nov 28 15:39:51 user nova-compute[75176]:       <model type="virtio"/>
Nov 28 15:39:51 user nova-compute[75176]:       <mtu size="1442"/>
Nov 28 15:39:51 user nova-compute[75176]:       <target dev="tap38bef3fc-c8"/>
Nov 28 15:39:51 user nova-compute[75176]:     </interface>
Nov 28 15:39:51 user nova-compute[75176]:     <serial type="pty">
Nov 28 15:39:51 user nova-compute[75176]:       <log file="/opt/stack/data/nova/instances/916b82eb-97e8-411c-a8ea-8c27d101b48e/console.log" append="off"/>
Nov 28 15:39:51 user nova-compute[75176]:     </serial>
Nov 28 15:39:51 user nova-compute[75176]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 15:39:51 user nova-compute[75176]:     <video>
Nov 28 15:39:51 user nova-compute[75176]:       <model type="virtio"/>
Nov 28 15:39:51 user nova-compute[75176]:     </video>
Nov 28 15:39:51 user nova-compute[75176]:     <rng model="virtio">
Nov 28 15:39:51 user nova-compute[75176]:       <backend model="random">/dev/urandom</backend>
Nov 28 15:39:51 user nova-compute[75176]:     </rng>
Nov 28 15:39:51 user nova-compute[75176]:     <controller type="usb" index="0" model="none"/>
Nov 28 15:39:51 user nova-compute[75176]:     <memballoon model="virtio">
Nov 28 15:39:51 user nova-compute[75176]:       <stats period="10"/>
Nov 28 15:39:51 user nova-compute[75176]:     </memballoon>
Nov 28 15:39:51 user nova-compute[75176]:   </devices>
Nov 28 15:39:51 user nova-compute[75176]: </domain>
Nov 28 15:39:51 user nova-compute[75176]:  {{(pid=75176) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 15:39:51 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-49fd2865-6e0d-48a7-9d4d-bc4748d147ce tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T15:39:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-2102540116',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-2102540116',id=8,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCQNBGdiL2UyuS5dM6+KjwbgIJ/vX3p2dH1PNPmJxj5EzppPATyTzrKhi1oHmfMeT/UPJyLXI+eIry/aVtUhrMzZLSlMRjHwwDIb+xEYyhtsdb9ZUumnXRPBTV8py7ZAjw==',key_name='tempest-keypair-1515121820',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d68d78d1dd684c2c920ae8e4ce3eaa21',ramdisk_id='',reservation_id='r-uy5cy6al',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-267222163',owner_user_name='tempest-ServerActionsV293TestJSON-267222163-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T15:39:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aea69806df134eeb946d4ed91bd7152b',uuid=916b82eb-97e8-411c-a8ea-8c27d101b48e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "38bef3fc-c841-4db3-b429-8fe94a224783", "address": "fa:16:3e:13:6e:cf", "network": {"id": "dc41c201-1473-486f-abc4-30a09c441826", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2062231487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d68d78d1dd684c2c920ae8e4ce3eaa21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38bef3fc-c8", "ovs_interfaceid": "38bef3fc-c841-4db3-b429-8fe94a224783", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 15:39:51 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-49fd2865-6e0d-48a7-9d4d-bc4748d147ce tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] Converting VIF {"id": "38bef3fc-c841-4db3-b429-8fe94a224783", "address": "fa:16:3e:13:6e:cf", "network": {"id": "dc41c201-1473-486f-abc4-30a09c441826", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2062231487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d68d78d1dd684c2c920ae8e4ce3eaa21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38bef3fc-c8", "ovs_interfaceid": "38bef3fc-c841-4db3-b429-8fe94a224783", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:39:51 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-49fd2865-6e0d-48a7-9d4d-bc4748d147ce tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:6e:cf,bridge_name='br-int',has_traffic_filtering=True,id=38bef3fc-c841-4db3-b429-8fe94a224783,network=Network(dc41c201-1473-486f-abc4-30a09c441826),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38bef3fc-c8') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:39:51 user nova-compute[75176]: DEBUG os_vif [None req-49fd2865-6e0d-48a7-9d4d-bc4748d147ce tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:6e:cf,bridge_name='br-int',has_traffic_filtering=True,id=38bef3fc-c841-4db3-b429-8fe94a224783,network=Network(dc41c201-1473-486f-abc4-30a09c441826),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38bef3fc-c8') {{(pid=75176) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 15:39:51 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:39:51 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:39:51 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 15:39:51 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:39:51 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a7421129-5858-59dc-a331-fe7def718f91', '_type': 'linux-noop'}}, row=False) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:39:51 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:39:51 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:39:51 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:39:51 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap38bef3fc-c8, may_exist=True, interface_attrs={}) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:39:51 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap38bef3fc-c8, col_values=(('qos', UUID('8d52e8ae-fa49-49e6-a10d-4744be71067e')),), if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:39:51 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap38bef3fc-c8, col_values=(('external_ids', {'iface-id': '38bef3fc-c841-4db3-b429-8fe94a224783', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:13:6e:cf', 'vm-uuid': '916b82eb-97e8-411c-a8ea-8c27d101b48e'}),), if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:39:51 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:39:51 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:39:51 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:39:51 user nova-compute[75176]: INFO os_vif [None req-49fd2865-6e0d-48a7-9d4d-bc4748d147ce tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:6e:cf,bridge_name='br-int',has_traffic_filtering=True,id=38bef3fc-c841-4db3-b429-8fe94a224783,network=Network(dc41c201-1473-486f-abc4-30a09c441826),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38bef3fc-c8')
Nov 28 15:39:52 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-49fd2865-6e0d-48a7-9d4d-bc4748d147ce tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] No BDM found with device name vda, not building metadata. {{(pid=75176) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 15:39:52 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-49fd2865-6e0d-48a7-9d4d-bc4748d147ce tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] No VIF found with MAC fa:16:3e:13:6e:cf, not building metadata {{(pid=75176) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 15:39:52 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:39:52 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Starting heal instance info cache {{(pid=75176) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 15:39:52 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Rebuilding the list of instances to heal {{(pid=75176) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 15:39:52 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] [instance: 916b82eb-97e8-411c-a8ea-8c27d101b48e] Skipping network cache update for instance because it is Building. {{(pid=75176) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 28 15:39:52 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquiring lock "refresh_cache-f81dc25c-3549-4e25-b27c-a75a50d9a448" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:39:52 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquired lock "refresh_cache-f81dc25c-3549-4e25-b27c-a75a50d9a448" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:39:52 user nova-compute[75176]: DEBUG nova.network.neutron [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] [instance: f81dc25c-3549-4e25-b27c-a75a50d9a448] Forcefully refreshing network info cache for instance {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 15:39:52 user nova-compute[75176]: DEBUG nova.objects.instance [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lazy-loading 'info_cache' on Instance uuid f81dc25c-3549-4e25-b27c-a75a50d9a448 {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:39:52 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:39:53 user nova-compute[75176]: DEBUG nova.network.neutron [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] [instance: f81dc25c-3549-4e25-b27c-a75a50d9a448] Updating instance_info_cache with network_info: [{"id": "1e629a40-5a9f-4891-8148-7a2c925d8ad6", "address": "fa:16:3e:3f:fc:84", "network": {"id": "6e9a90b3-cbe8-4d24-a96b-78e5a8a588f0", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-468656063-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81856f8d465d408bbb6b0fbfe4dd2fa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e629a40-5a", "ovs_interfaceid": "1e629a40-5a9f-4891-8148-7a2c925d8ad6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:39:53 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Releasing lock "refresh_cache-f81dc25c-3549-4e25-b27c-a75a50d9a448" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:39:53 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] [instance: f81dc25c-3549-4e25-b27c-a75a50d9a448] Updated the network info_cache for instance {{(pid=75176) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 15:39:53 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:39:53 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:39:53 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:39:53 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75176) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 15:39:53 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:39:53 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:39:53 user nova-compute[75176]: DEBUG nova.compute.manager [req-e2ebad62-b0da-4489-ba30-b17e37d8d7f3 req-8c374515-0b80-4444-a617-0dad192fc55d service nova] [instance: 916b82eb-97e8-411c-a8ea-8c27d101b48e] Received event network-vif-plugged-38bef3fc-c841-4db3-b429-8fe94a224783 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:39:53 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-e2ebad62-b0da-4489-ba30-b17e37d8d7f3 req-8c374515-0b80-4444-a617-0dad192fc55d service nova] Acquiring lock "916b82eb-97e8-411c-a8ea-8c27d101b48e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:39:53 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-e2ebad62-b0da-4489-ba30-b17e37d8d7f3 req-8c374515-0b80-4444-a617-0dad192fc55d service nova] Lock "916b82eb-97e8-411c-a8ea-8c27d101b48e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:39:53 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-e2ebad62-b0da-4489-ba30-b17e37d8d7f3 req-8c374515-0b80-4444-a617-0dad192fc55d service nova] Lock "916b82eb-97e8-411c-a8ea-8c27d101b48e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:39:53 user nova-compute[75176]: DEBUG nova.compute.manager [req-e2ebad62-b0da-4489-ba30-b17e37d8d7f3 req-8c374515-0b80-4444-a617-0dad192fc55d service nova] [instance: 916b82eb-97e8-411c-a8ea-8c27d101b48e] No waiting events found dispatching network-vif-plugged-38bef3fc-c841-4db3-b429-8fe94a224783 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:39:53 user nova-compute[75176]: WARNING nova.compute.manager [req-e2ebad62-b0da-4489-ba30-b17e37d8d7f3 req-8c374515-0b80-4444-a617-0dad192fc55d service nova] [instance: 916b82eb-97e8-411c-a8ea-8c27d101b48e] Received unexpected event network-vif-plugged-38bef3fc-c841-4db3-b429-8fe94a224783 for instance with vm_state building and task_state spawning.
Nov 28 15:39:54 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:39:54 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:39:54 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:39:55 user nova-compute[75176]: DEBUG nova.compute.manager [req-2c84f3cc-ad63-43b2-a8a8-557ee195df0a req-b2757670-381d-402c-a1da-606a85fe21a3 service nova] [instance: 916b82eb-97e8-411c-a8ea-8c27d101b48e] Received event network-vif-plugged-38bef3fc-c841-4db3-b429-8fe94a224783 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:39:55 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-2c84f3cc-ad63-43b2-a8a8-557ee195df0a req-b2757670-381d-402c-a1da-606a85fe21a3 service nova] Acquiring lock "916b82eb-97e8-411c-a8ea-8c27d101b48e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:39:55 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-2c84f3cc-ad63-43b2-a8a8-557ee195df0a req-b2757670-381d-402c-a1da-606a85fe21a3 service nova] Lock "916b82eb-97e8-411c-a8ea-8c27d101b48e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:39:55 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-2c84f3cc-ad63-43b2-a8a8-557ee195df0a req-b2757670-381d-402c-a1da-606a85fe21a3 service nova] Lock "916b82eb-97e8-411c-a8ea-8c27d101b48e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:39:55 user nova-compute[75176]: DEBUG nova.compute.manager [req-2c84f3cc-ad63-43b2-a8a8-557ee195df0a req-b2757670-381d-402c-a1da-606a85fe21a3 service nova] [instance: 916b82eb-97e8-411c-a8ea-8c27d101b48e] No waiting events found dispatching network-vif-plugged-38bef3fc-c841-4db3-b429-8fe94a224783 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:39:55 user nova-compute[75176]: WARNING nova.compute.manager [req-2c84f3cc-ad63-43b2-a8a8-557ee195df0a req-b2757670-381d-402c-a1da-606a85fe21a3 service nova] [instance: 916b82eb-97e8-411c-a8ea-8c27d101b48e] Received unexpected event network-vif-plugged-38bef3fc-c841-4db3-b429-8fe94a224783 for instance with vm_state building and task_state spawning.
Nov 28 15:39:56 user nova-compute[75176]: DEBUG nova.compute.manager [None req-49fd2865-6e0d-48a7-9d4d-bc4748d147ce tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] [instance: 916b82eb-97e8-411c-a8ea-8c27d101b48e] Instance event wait completed in 0 seconds for  {{(pid=75176) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 15:39:56 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-49fd2865-6e0d-48a7-9d4d-bc4748d147ce tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] [instance: 916b82eb-97e8-411c-a8ea-8c27d101b48e] Guest created on hypervisor {{(pid=75176) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 15:39:56 user nova-compute[75176]: INFO nova.virt.libvirt.driver [-] [instance: 916b82eb-97e8-411c-a8ea-8c27d101b48e] Instance spawned successfully.
Nov 28 15:39:56 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-49fd2865-6e0d-48a7-9d4d-bc4748d147ce tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] [instance: 916b82eb-97e8-411c-a8ea-8c27d101b48e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 15:39:56 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-49fd2865-6e0d-48a7-9d4d-bc4748d147ce tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] [instance: 916b82eb-97e8-411c-a8ea-8c27d101b48e] Found default for hw_cdrom_bus of ide {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:39:56 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-49fd2865-6e0d-48a7-9d4d-bc4748d147ce tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] [instance: 916b82eb-97e8-411c-a8ea-8c27d101b48e] Found default for hw_disk_bus of virtio {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:39:56 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-49fd2865-6e0d-48a7-9d4d-bc4748d147ce tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] [instance: 916b82eb-97e8-411c-a8ea-8c27d101b48e] Found default for hw_input_bus of None {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:39:56 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-49fd2865-6e0d-48a7-9d4d-bc4748d147ce tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] [instance: 916b82eb-97e8-411c-a8ea-8c27d101b48e] Found default for hw_pointer_model of None {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:39:56 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-49fd2865-6e0d-48a7-9d4d-bc4748d147ce tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] [instance: 916b82eb-97e8-411c-a8ea-8c27d101b48e] Found default for hw_video_model of virtio {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:39:56 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-49fd2865-6e0d-48a7-9d4d-bc4748d147ce tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] [instance: 916b82eb-97e8-411c-a8ea-8c27d101b48e] Found default for hw_vif_model of virtio {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:39:56 user nova-compute[75176]: INFO nova.compute.manager [None req-49fd2865-6e0d-48a7-9d4d-bc4748d147ce tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] [instance: 916b82eb-97e8-411c-a8ea-8c27d101b48e] Took 6.54 seconds to spawn the instance on the hypervisor.
Nov 28 15:39:56 user nova-compute[75176]: DEBUG nova.compute.manager [None req-49fd2865-6e0d-48a7-9d4d-bc4748d147ce tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] [instance: 916b82eb-97e8-411c-a8ea-8c27d101b48e] Checking state {{(pid=75176) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 15:39:56 user nova-compute[75176]: INFO nova.compute.manager [None req-49fd2865-6e0d-48a7-9d4d-bc4748d147ce tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] [instance: 916b82eb-97e8-411c-a8ea-8c27d101b48e] Took 20.67 seconds to build instance.
Nov 28 15:39:56 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-49fd2865-6e0d-48a7-9d4d-bc4748d147ce tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] Lock "916b82eb-97e8-411c-a8ea-8c27d101b48e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.821s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:39:56 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:39:57 user nova-compute[75176]: DEBUG nova.compute.manager [req-a55fcac4-df0b-46a3-a3cf-b0193ce8dd00 req-74f47fca-a306-4208-9a1d-2801166952b6 service nova] [instance: f81dc25c-3549-4e25-b27c-a75a50d9a448] Received event network-vif-plugged-1e629a40-5a9f-4891-8148-7a2c925d8ad6 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:39:57 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-a55fcac4-df0b-46a3-a3cf-b0193ce8dd00 req-74f47fca-a306-4208-9a1d-2801166952b6 service nova] Acquiring lock "f81dc25c-3549-4e25-b27c-a75a50d9a448-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:39:57 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-a55fcac4-df0b-46a3-a3cf-b0193ce8dd00 req-74f47fca-a306-4208-9a1d-2801166952b6 service nova] Lock "f81dc25c-3549-4e25-b27c-a75a50d9a448-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:39:57 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-a55fcac4-df0b-46a3-a3cf-b0193ce8dd00 req-74f47fca-a306-4208-9a1d-2801166952b6 service nova] Lock "f81dc25c-3549-4e25-b27c-a75a50d9a448-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:39:57 user nova-compute[75176]: DEBUG nova.compute.manager [req-a55fcac4-df0b-46a3-a3cf-b0193ce8dd00 req-74f47fca-a306-4208-9a1d-2801166952b6 service nova] [instance: f81dc25c-3549-4e25-b27c-a75a50d9a448] No waiting events found dispatching network-vif-plugged-1e629a40-5a9f-4891-8148-7a2c925d8ad6 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:39:57 user nova-compute[75176]: WARNING nova.compute.manager [req-a55fcac4-df0b-46a3-a3cf-b0193ce8dd00 req-74f47fca-a306-4208-9a1d-2801166952b6 service nova] [instance: f81dc25c-3549-4e25-b27c-a75a50d9a448] Received unexpected event network-vif-plugged-1e629a40-5a9f-4891-8148-7a2c925d8ad6 for instance with vm_state active and task_state None.
Nov 28 15:39:57 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:39:58 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Acquiring lock "041af768-197b-4c76-a5a1-28e2dc8255bd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:39:58 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Lock "041af768-197b-4c76-a5a1-28e2dc8255bd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:39:58 user nova-compute[75176]: DEBUG nova.compute.manager [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] Starting instance... {{(pid=75176) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 15:39:59 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:39:59 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:39:59 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75176) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 15:39:59 user nova-compute[75176]: INFO nova.compute.claims [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] Claim successful on node user
Nov 28 15:39:59 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Refreshing inventories for resource provider b37848d8-f401-4155-a029-b0ffa09ff85b {{(pid=75176) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 28 15:39:59 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Updating ProviderTree inventory for provider b37848d8-f401-4155-a029-b0ffa09ff85b from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75176) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 28 15:39:59 user nova-compute[75176]: DEBUG nova.compute.provider_tree [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Updating inventory in ProviderTree for provider b37848d8-f401-4155-a029-b0ffa09ff85b with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75176) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 28 15:39:59 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Refreshing aggregate associations for resource provider b37848d8-f401-4155-a029-b0ffa09ff85b, aggregates: None {{(pid=75176) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 28 15:39:59 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Refreshing trait associations for resource provider b37848d8-f401-4155-a029-b0ffa09ff85b, traits: COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_RESCUE_BFV,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NODE,HW_CPU_X86_SSSE3,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE42,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE2,COMPUTE_ACCELERATORS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VIRTIO {{(pid=75176) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 28 15:39:59 user nova-compute[75176]: DEBUG nova.compute.manager [req-b0977ae0-c2bc-4bfc-987b-ad3a9e394135 req-7f7347d8-53a9-4d89-84db-e991faaaf95e service nova] [instance: f81dc25c-3549-4e25-b27c-a75a50d9a448] Received event network-vif-plugged-1e629a40-5a9f-4891-8148-7a2c925d8ad6 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:39:59 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-b0977ae0-c2bc-4bfc-987b-ad3a9e394135 req-7f7347d8-53a9-4d89-84db-e991faaaf95e service nova] Acquiring lock "f81dc25c-3549-4e25-b27c-a75a50d9a448-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:39:59 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-b0977ae0-c2bc-4bfc-987b-ad3a9e394135 req-7f7347d8-53a9-4d89-84db-e991faaaf95e service nova] Lock "f81dc25c-3549-4e25-b27c-a75a50d9a448-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:39:59 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-b0977ae0-c2bc-4bfc-987b-ad3a9e394135 req-7f7347d8-53a9-4d89-84db-e991faaaf95e service nova] Lock "f81dc25c-3549-4e25-b27c-a75a50d9a448-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:39:59 user nova-compute[75176]: DEBUG nova.compute.manager [req-b0977ae0-c2bc-4bfc-987b-ad3a9e394135 req-7f7347d8-53a9-4d89-84db-e991faaaf95e service nova] [instance: f81dc25c-3549-4e25-b27c-a75a50d9a448] No waiting events found dispatching network-vif-plugged-1e629a40-5a9f-4891-8148-7a2c925d8ad6 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:39:59 user nova-compute[75176]: WARNING nova.compute.manager [req-b0977ae0-c2bc-4bfc-987b-ad3a9e394135 req-7f7347d8-53a9-4d89-84db-e991faaaf95e service nova] [instance: f81dc25c-3549-4e25-b27c-a75a50d9a448] Received unexpected event network-vif-plugged-1e629a40-5a9f-4891-8148-7a2c925d8ad6 for instance with vm_state active and task_state None.
Nov 28 15:40:00 user nova-compute[75176]: DEBUG nova.compute.provider_tree [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Inventory has not changed in ProviderTree for provider: b37848d8-f401-4155-a029-b0ffa09ff85b {{(pid=75176) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 15:40:00 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Inventory has not changed for provider b37848d8-f401-4155-a029-b0ffa09ff85b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75176) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 15:40:00 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.702s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:40:00 user nova-compute[75176]: DEBUG nova.compute.manager [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] Start building networks asynchronously for instance. {{(pid=75176) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 15:40:00 user nova-compute[75176]: DEBUG nova.compute.manager [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] Allocating IP information in the background. {{(pid=75176) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 15:40:00 user nova-compute[75176]: DEBUG nova.network.neutron [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] allocate_for_instance() {{(pid=75176) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 15:40:00 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 15:40:00 user nova-compute[75176]: DEBUG nova.policy [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '97e02c028b814c6993edba6c1caa8afe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfdec2abaf704a1396611ff1bcb96e53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75176) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 15:40:00 user nova-compute[75176]: DEBUG nova.compute.manager [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] Start building block device mappings for instance. {{(pid=75176) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 15:40:00 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Acquiring lock "b714fb94-fcc7-40ae-b3a9-d8c9a60008f1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:40:00 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Lock "b714fb94-fcc7-40ae-b3a9-d8c9a60008f1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:40:00 user nova-compute[75176]: DEBUG nova.compute.manager [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] Starting instance... {{(pid=75176) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 15:40:00 user nova-compute[75176]: INFO nova.virt.block_device [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] Booting with volume 81326542-482f-4d50-895c-13c65fe4daf7 at /dev/vda
Nov 28 15:40:00 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:40:00 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:40:00 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75176) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 15:40:00 user nova-compute[75176]: INFO nova.compute.claims [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] Claim successful on node user
Nov 28 15:40:00 user nova-compute[75176]: DEBUG os_brick.utils [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 15:40:00 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:40:00 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:40:00 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[28df561b-5797-4dc1-80dc-b5aa75ebd206]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:edc924a949b2\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:40:00 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:40:00 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:40:00 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[b56a4f1c-ae7b-4940-aa95-9a1f3a5edb76]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:40:00 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:40:00 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:40:00 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[49494893-dc19-46a1-b992-d7082e55f9d8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:40:00 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[6649bbf6-c0fc-46dc-a453-1c260900b0f6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:40:00 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Running cmd (subprocess): nvme version {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:40:00 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] 'nvme version' failed. Not Retrying. {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 15:40:00 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] nvme not present on system {{(pid=75176) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 15:40:00 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:40:00 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 15:40:00 user nova-compute[75176]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 15:40:00 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[a150cb29-d80c-4857-aa03-352fdfea5dc4]: (4, '') {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:40:00 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.lightos [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75176) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 15:40:00 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.lightos [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75176) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 15:40:00 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.lightos [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] LIGHTOS: no hostnqn found. {{(pid=75176) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 15:40:00 user nova-compute[75176]: DEBUG os_brick.utils [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:edc924a949b2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 15:40:00 user nova-compute[75176]: DEBUG nova.virt.block_device [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] Updating existing volume attachment record: ee2bdda0-b792-4a54-bfe4-0ca947746824 {{(pid=75176) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 15:40:01 user nova-compute[75176]: DEBUG nova.network.neutron [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] Successfully created port: 99a8dbf9-5502-440a-a03d-cd52337b3009 {{(pid=75176) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 15:40:01 user nova-compute[75176]: DEBUG nova.compute.provider_tree [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Inventory has not changed in ProviderTree for provider: b37848d8-f401-4155-a029-b0ffa09ff85b {{(pid=75176) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 15:40:01 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Inventory has not changed for provider b37848d8-f401-4155-a029-b0ffa09ff85b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75176) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 15:40:01 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.622s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:40:01 user nova-compute[75176]: DEBUG nova.compute.manager [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] Start building networks asynchronously for instance. {{(pid=75176) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 15:40:01 user nova-compute[75176]: DEBUG nova.compute.manager [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] Allocating IP information in the background. {{(pid=75176) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 15:40:01 user nova-compute[75176]: DEBUG nova.network.neutron [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] allocate_for_instance() {{(pid=75176) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 15:40:01 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 15:40:01 user nova-compute[75176]: DEBUG nova.compute.manager [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] Start building block device mappings for instance. {{(pid=75176) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 15:40:01 user nova-compute[75176]: INFO nova.virt.block_device [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] Booting with volume 76ea4d3b-7c77-47d0-b48b-ad79886d4f9a at /dev/vda
Nov 28 15:40:01 user nova-compute[75176]: DEBUG nova.policy [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8fb5815faed648a1a207c402eafca90e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0108444c01e94416984b083707102c58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75176) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 15:40:01 user nova-compute[75176]: DEBUG os_brick.utils [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 15:40:01 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:40:01 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:40:01 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[b745a127-1821-4cd2-b908-10a605226232]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:edc924a949b2\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:40:01 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:40:01 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:40:01 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[4577ac76-5f8a-4fe1-85bc-791f79d14565]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:40:01 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:40:01 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.013s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:40:01 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[07fe2ed2-9304-4db9-8f80-9406c4f9a190]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:40:01 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1e6352e-b7c3-4bd8-8bfe-cb5e2a337524]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:40:01 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Running cmd (subprocess): nvme version {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:40:01 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] 'nvme version' failed. Not Retrying. {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 15:40:01 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.nvmeof [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] nvme not present on system {{(pid=75176) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 15:40:01 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:40:01 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 15:40:01 user nova-compute[75176]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 15:40:01 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[04247d3a-c932-4ae8-948b-4c1758ffe80c]: (4, '') {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:40:01 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.lightos [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75176) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 15:40:01 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.lightos [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75176) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 15:40:01 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.lightos [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] LIGHTOS: no hostnqn found. {{(pid=75176) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 15:40:01 user nova-compute[75176]: DEBUG os_brick.utils [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:edc924a949b2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 15:40:01 user nova-compute[75176]: DEBUG nova.virt.block_device [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] Updating existing volume attachment record: e63d9285-393f-450e-9e48-bf4cb85d2295 {{(pid=75176) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 15:40:01 user nova-compute[75176]: DEBUG nova.network.neutron [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] Successfully created port: 3a800e7a-5628-4668-ae3e-d49b537f7a62 {{(pid=75176) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 15:40:01 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:02 user nova-compute[75176]: DEBUG nova.network.neutron [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] Successfully created port: da7d30e5-6304-46ec-8d50-336986e6262f {{(pid=75176) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 15:40:02 user nova-compute[75176]: DEBUG nova.network.neutron [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] Successfully created port: d9a60043-45d0-46f1-8d0f-ad1c7b55fa06 {{(pid=75176) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 15:40:02 user nova-compute[75176]: DEBUG nova.network.neutron [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] Successfully created port: 04db431e-5bc8-4450-9bdd-82369fafba70 {{(pid=75176) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 15:40:02 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:03 user nova-compute[75176]: DEBUG nova.network.neutron [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] Successfully created port: 0c65b96a-0fce-4bff-b89c-443cc48f6995 {{(pid=75176) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 15:40:03 user nova-compute[75176]: DEBUG nova.network.neutron [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] Successfully created port: 0bc36ba8-7fc6-47b2-b7b1-08a445625b46 {{(pid=75176) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 15:40:03 user nova-compute[75176]: DEBUG nova.network.neutron [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] Successfully created port: 2df03152-b1aa-4794-965d-64886ac889ea {{(pid=75176) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 15:40:04 user nova-compute[75176]: DEBUG nova.network.neutron [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] Successfully created port: 0c08ccbe-f3de-4aed-b641-8e2b58bd73a0 {{(pid=75176) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 15:40:04 user nova-compute[75176]: DEBUG nova.network.neutron [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] Successfully updated port: 99a8dbf9-5502-440a-a03d-cd52337b3009 {{(pid=75176) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 15:40:04 user nova-compute[75176]: DEBUG nova.compute.manager [req-af4d20e4-a7a4-46ab-9606-626698fbbdfd req-f484cd25-29dc-49ab-85c5-b3c7eeb45412 service nova] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] Received event network-changed-99a8dbf9-5502-440a-a03d-cd52337b3009 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:40:04 user nova-compute[75176]: DEBUG nova.compute.manager [req-af4d20e4-a7a4-46ab-9606-626698fbbdfd req-f484cd25-29dc-49ab-85c5-b3c7eeb45412 service nova] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] Refreshing instance network info cache due to event network-changed-99a8dbf9-5502-440a-a03d-cd52337b3009. {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 15:40:04 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-af4d20e4-a7a4-46ab-9606-626698fbbdfd req-f484cd25-29dc-49ab-85c5-b3c7eeb45412 service nova] Acquiring lock "refresh_cache-041af768-197b-4c76-a5a1-28e2dc8255bd" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:40:04 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-af4d20e4-a7a4-46ab-9606-626698fbbdfd req-f484cd25-29dc-49ab-85c5-b3c7eeb45412 service nova] Acquired lock "refresh_cache-041af768-197b-4c76-a5a1-28e2dc8255bd" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:40:04 user nova-compute[75176]: DEBUG nova.network.neutron [req-af4d20e4-a7a4-46ab-9606-626698fbbdfd req-f484cd25-29dc-49ab-85c5-b3c7eeb45412 service nova] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] Refreshing network info cache for port 99a8dbf9-5502-440a-a03d-cd52337b3009 {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 15:40:04 user nova-compute[75176]: DEBUG nova.network.neutron [req-af4d20e4-a7a4-46ab-9606-626698fbbdfd req-f484cd25-29dc-49ab-85c5-b3c7eeb45412 service nova] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] Instance cache missing network info. {{(pid=75176) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 15:40:04 user nova-compute[75176]: DEBUG nova.network.neutron [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] Successfully created port: e0b49239-50a0-4864-9e92-22bddcbe7d21 {{(pid=75176) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 15:40:05 user nova-compute[75176]: DEBUG nova.compute.manager [req-ada2d92d-36d4-4d4f-8186-6d8973752652 req-bd968c13-6f90-4601-bde4-41025c14f6a5 service nova] [instance: 5b18c889-7694-4edf-8cf2-b9032e60289e] Received event network-vif-plugged-59bc046b-fdaa-432c-97b8-67a208dd399b {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:40:05 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-ada2d92d-36d4-4d4f-8186-6d8973752652 req-bd968c13-6f90-4601-bde4-41025c14f6a5 service nova] Acquiring lock "5b18c889-7694-4edf-8cf2-b9032e60289e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:40:05 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-ada2d92d-36d4-4d4f-8186-6d8973752652 req-bd968c13-6f90-4601-bde4-41025c14f6a5 service nova] Lock "5b18c889-7694-4edf-8cf2-b9032e60289e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:40:05 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-ada2d92d-36d4-4d4f-8186-6d8973752652 req-bd968c13-6f90-4601-bde4-41025c14f6a5 service nova] Lock "5b18c889-7694-4edf-8cf2-b9032e60289e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:40:05 user nova-compute[75176]: DEBUG nova.compute.manager [req-ada2d92d-36d4-4d4f-8186-6d8973752652 req-bd968c13-6f90-4601-bde4-41025c14f6a5 service nova] [instance: 5b18c889-7694-4edf-8cf2-b9032e60289e] No waiting events found dispatching network-vif-plugged-59bc046b-fdaa-432c-97b8-67a208dd399b {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:40:05 user nova-compute[75176]: WARNING nova.compute.manager [req-ada2d92d-36d4-4d4f-8186-6d8973752652 req-bd968c13-6f90-4601-bde4-41025c14f6a5 service nova] [instance: 5b18c889-7694-4edf-8cf2-b9032e60289e] Received unexpected event network-vif-plugged-59bc046b-fdaa-432c-97b8-67a208dd399b for instance with vm_state active and task_state None.
Nov 28 15:40:05 user nova-compute[75176]: DEBUG nova.network.neutron [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] Successfully updated port: 6c94b138-6202-4fb7-92c7-b3744cd8d19d {{(pid=75176) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 15:40:05 user nova-compute[75176]: DEBUG nova.network.neutron [req-af4d20e4-a7a4-46ab-9606-626698fbbdfd req-f484cd25-29dc-49ab-85c5-b3c7eeb45412 service nova] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] Updating instance_info_cache with network_info: [] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:40:05 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-af4d20e4-a7a4-46ab-9606-626698fbbdfd req-f484cd25-29dc-49ab-85c5-b3c7eeb45412 service nova] Releasing lock "refresh_cache-041af768-197b-4c76-a5a1-28e2dc8255bd" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:40:05 user nova-compute[75176]: DEBUG nova.network.neutron [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] Successfully updated port: 0ac967e7-41bc-4751-a2bc-499ffbface15 {{(pid=75176) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 15:40:05 user nova-compute[75176]: DEBUG nova.network.neutron [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] Successfully updated port: da7d30e5-6304-46ec-8d50-336986e6262f {{(pid=75176) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 15:40:06 user nova-compute[75176]: DEBUG nova.network.neutron [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] Successfully updated port: 3a800e7a-5628-4668-ae3e-d49b537f7a62 {{(pid=75176) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 15:40:06 user nova-compute[75176]: DEBUG nova.network.neutron [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] Successfully updated port: e1ac011f-d965-4d4c-b4c8-aa9bf5201518 {{(pid=75176) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 15:40:06 user nova-compute[75176]: DEBUG nova.compute.manager [req-1d09ad93-429c-462f-ac96-54f91d215f67 req-3630a52f-6019-44b9-9cb9-397dbb5fee98 service nova] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] Received event network-changed-6c94b138-6202-4fb7-92c7-b3744cd8d19d {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:40:06 user nova-compute[75176]: DEBUG nova.compute.manager [req-1d09ad93-429c-462f-ac96-54f91d215f67 req-3630a52f-6019-44b9-9cb9-397dbb5fee98 service nova] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] Refreshing instance network info cache due to event network-changed-6c94b138-6202-4fb7-92c7-b3744cd8d19d. {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 15:40:06 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-1d09ad93-429c-462f-ac96-54f91d215f67 req-3630a52f-6019-44b9-9cb9-397dbb5fee98 service nova] Acquiring lock "refresh_cache-041af768-197b-4c76-a5a1-28e2dc8255bd" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:40:06 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-1d09ad93-429c-462f-ac96-54f91d215f67 req-3630a52f-6019-44b9-9cb9-397dbb5fee98 service nova] Acquired lock "refresh_cache-041af768-197b-4c76-a5a1-28e2dc8255bd" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:40:06 user nova-compute[75176]: DEBUG nova.network.neutron [req-1d09ad93-429c-462f-ac96-54f91d215f67 req-3630a52f-6019-44b9-9cb9-397dbb5fee98 service nova] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] Refreshing network info cache for port 6c94b138-6202-4fb7-92c7-b3744cd8d19d {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 15:40:06 user nova-compute[75176]: DEBUG nova.network.neutron [req-1d09ad93-429c-462f-ac96-54f91d215f67 req-3630a52f-6019-44b9-9cb9-397dbb5fee98 service nova] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] Instance cache missing network info. {{(pid=75176) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 15:40:06 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:06 user nova-compute[75176]: DEBUG nova.network.neutron [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] Successfully updated port: d9a60043-45d0-46f1-8d0f-ad1c7b55fa06 {{(pid=75176) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 15:40:06 user nova-compute[75176]: DEBUG nova.network.neutron [req-1d09ad93-429c-462f-ac96-54f91d215f67 req-3630a52f-6019-44b9-9cb9-397dbb5fee98 service nova] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] Updating instance_info_cache with network_info: [] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:40:07 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-1d09ad93-429c-462f-ac96-54f91d215f67 req-3630a52f-6019-44b9-9cb9-397dbb5fee98 service nova] Releasing lock "refresh_cache-041af768-197b-4c76-a5a1-28e2dc8255bd" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:40:07 user nova-compute[75176]: DEBUG nova.compute.manager [req-1d09ad93-429c-462f-ac96-54f91d215f67 req-3630a52f-6019-44b9-9cb9-397dbb5fee98 service nova] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] Received event network-changed-0ac967e7-41bc-4751-a2bc-499ffbface15 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:40:07 user nova-compute[75176]: DEBUG nova.compute.manager [req-1d09ad93-429c-462f-ac96-54f91d215f67 req-3630a52f-6019-44b9-9cb9-397dbb5fee98 service nova] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] Refreshing instance network info cache due to event network-changed-0ac967e7-41bc-4751-a2bc-499ffbface15. {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 15:40:07 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-1d09ad93-429c-462f-ac96-54f91d215f67 req-3630a52f-6019-44b9-9cb9-397dbb5fee98 service nova] Acquiring lock "refresh_cache-041af768-197b-4c76-a5a1-28e2dc8255bd" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:40:07 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-1d09ad93-429c-462f-ac96-54f91d215f67 req-3630a52f-6019-44b9-9cb9-397dbb5fee98 service nova] Acquired lock "refresh_cache-041af768-197b-4c76-a5a1-28e2dc8255bd" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:40:07 user nova-compute[75176]: DEBUG nova.network.neutron [req-1d09ad93-429c-462f-ac96-54f91d215f67 req-3630a52f-6019-44b9-9cb9-397dbb5fee98 service nova] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] Refreshing network info cache for port 0ac967e7-41bc-4751-a2bc-499ffbface15 {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 15:40:07 user nova-compute[75176]: DEBUG nova.network.neutron [req-1d09ad93-429c-462f-ac96-54f91d215f67 req-3630a52f-6019-44b9-9cb9-397dbb5fee98 service nova] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] Instance cache missing network info. {{(pid=75176) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 15:40:07 user nova-compute[75176]: DEBUG nova.compute.manager [req-5ae82e94-2d6b-4d70-83ca-5989d2cdad01 req-297856e6-be61-4095-afc2-c10aa60bcca6 service nova] [instance: 5b18c889-7694-4edf-8cf2-b9032e60289e] Received event network-vif-plugged-59bc046b-fdaa-432c-97b8-67a208dd399b {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:40:07 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-5ae82e94-2d6b-4d70-83ca-5989d2cdad01 req-297856e6-be61-4095-afc2-c10aa60bcca6 service nova] Acquiring lock "5b18c889-7694-4edf-8cf2-b9032e60289e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:40:07 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-5ae82e94-2d6b-4d70-83ca-5989d2cdad01 req-297856e6-be61-4095-afc2-c10aa60bcca6 service nova] Lock "5b18c889-7694-4edf-8cf2-b9032e60289e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:40:07 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-5ae82e94-2d6b-4d70-83ca-5989d2cdad01 req-297856e6-be61-4095-afc2-c10aa60bcca6 service nova] Lock "5b18c889-7694-4edf-8cf2-b9032e60289e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:40:07 user nova-compute[75176]: DEBUG nova.compute.manager [req-5ae82e94-2d6b-4d70-83ca-5989d2cdad01 req-297856e6-be61-4095-afc2-c10aa60bcca6 service nova] [instance: 5b18c889-7694-4edf-8cf2-b9032e60289e] No waiting events found dispatching network-vif-plugged-59bc046b-fdaa-432c-97b8-67a208dd399b {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:40:07 user nova-compute[75176]: WARNING nova.compute.manager [req-5ae82e94-2d6b-4d70-83ca-5989d2cdad01 req-297856e6-be61-4095-afc2-c10aa60bcca6 service nova] [instance: 5b18c889-7694-4edf-8cf2-b9032e60289e] Received unexpected event network-vif-plugged-59bc046b-fdaa-432c-97b8-67a208dd399b for instance with vm_state active and task_state None.
Nov 28 15:40:07 user nova-compute[75176]: DEBUG nova.compute.manager [req-5ae82e94-2d6b-4d70-83ca-5989d2cdad01 req-297856e6-be61-4095-afc2-c10aa60bcca6 service nova] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] Received event network-changed-da7d30e5-6304-46ec-8d50-336986e6262f {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:40:07 user nova-compute[75176]: DEBUG nova.compute.manager [req-5ae82e94-2d6b-4d70-83ca-5989d2cdad01 req-297856e6-be61-4095-afc2-c10aa60bcca6 service nova] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] Refreshing instance network info cache due to event network-changed-da7d30e5-6304-46ec-8d50-336986e6262f. {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 15:40:07 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-5ae82e94-2d6b-4d70-83ca-5989d2cdad01 req-297856e6-be61-4095-afc2-c10aa60bcca6 service nova] Acquiring lock "refresh_cache-b714fb94-fcc7-40ae-b3a9-d8c9a60008f1" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:40:07 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-5ae82e94-2d6b-4d70-83ca-5989d2cdad01 req-297856e6-be61-4095-afc2-c10aa60bcca6 service nova] Acquired lock "refresh_cache-b714fb94-fcc7-40ae-b3a9-d8c9a60008f1" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:40:07 user nova-compute[75176]: DEBUG nova.network.neutron [req-5ae82e94-2d6b-4d70-83ca-5989d2cdad01 req-297856e6-be61-4095-afc2-c10aa60bcca6 service nova] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] Refreshing network info cache for port da7d30e5-6304-46ec-8d50-336986e6262f {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 15:40:07 user nova-compute[75176]: DEBUG nova.network.neutron [req-1d09ad93-429c-462f-ac96-54f91d215f67 req-3630a52f-6019-44b9-9cb9-397dbb5fee98 service nova] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] Updating instance_info_cache with network_info: [] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:40:07 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-1d09ad93-429c-462f-ac96-54f91d215f67 req-3630a52f-6019-44b9-9cb9-397dbb5fee98 service nova] Releasing lock "refresh_cache-041af768-197b-4c76-a5a1-28e2dc8255bd" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:40:07 user nova-compute[75176]: DEBUG nova.compute.manager [req-1d09ad93-429c-462f-ac96-54f91d215f67 req-3630a52f-6019-44b9-9cb9-397dbb5fee98 service nova] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] Received event network-changed-3a800e7a-5628-4668-ae3e-d49b537f7a62 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:40:07 user nova-compute[75176]: DEBUG nova.compute.manager [req-1d09ad93-429c-462f-ac96-54f91d215f67 req-3630a52f-6019-44b9-9cb9-397dbb5fee98 service nova] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] Refreshing instance network info cache due to event network-changed-3a800e7a-5628-4668-ae3e-d49b537f7a62. {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 15:40:07 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-1d09ad93-429c-462f-ac96-54f91d215f67 req-3630a52f-6019-44b9-9cb9-397dbb5fee98 service nova] Acquiring lock "refresh_cache-041af768-197b-4c76-a5a1-28e2dc8255bd" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:40:07 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-1d09ad93-429c-462f-ac96-54f91d215f67 req-3630a52f-6019-44b9-9cb9-397dbb5fee98 service nova] Acquired lock "refresh_cache-041af768-197b-4c76-a5a1-28e2dc8255bd" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:40:07 user nova-compute[75176]: DEBUG nova.network.neutron [req-1d09ad93-429c-462f-ac96-54f91d215f67 req-3630a52f-6019-44b9-9cb9-397dbb5fee98 service nova] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] Refreshing network info cache for port 3a800e7a-5628-4668-ae3e-d49b537f7a62 {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 15:40:07 user nova-compute[75176]: DEBUG nova.network.neutron [req-5ae82e94-2d6b-4d70-83ca-5989d2cdad01 req-297856e6-be61-4095-afc2-c10aa60bcca6 service nova] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] Instance cache missing network info. {{(pid=75176) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 15:40:07 user nova-compute[75176]: DEBUG nova.network.neutron [req-1d09ad93-429c-462f-ac96-54f91d215f67 req-3630a52f-6019-44b9-9cb9-397dbb5fee98 service nova] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] Instance cache missing network info. {{(pid=75176) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 15:40:07 user nova-compute[75176]: DEBUG nova.network.neutron [req-1d09ad93-429c-462f-ac96-54f91d215f67 req-3630a52f-6019-44b9-9cb9-397dbb5fee98 service nova] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] Updating instance_info_cache with network_info: [] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:40:07 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-1d09ad93-429c-462f-ac96-54f91d215f67 req-3630a52f-6019-44b9-9cb9-397dbb5fee98 service nova] Releasing lock "refresh_cache-041af768-197b-4c76-a5a1-28e2dc8255bd" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:40:07 user nova-compute[75176]: DEBUG nova.network.neutron [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] Successfully updated port: 61157920-954a-479e-bd66-b0746a7843a7 {{(pid=75176) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 15:40:07 user nova-compute[75176]: DEBUG nova.network.neutron [req-5ae82e94-2d6b-4d70-83ca-5989d2cdad01 req-297856e6-be61-4095-afc2-c10aa60bcca6 service nova] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] Updating instance_info_cache with network_info: [] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:40:07 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:07 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-5ae82e94-2d6b-4d70-83ca-5989d2cdad01 req-297856e6-be61-4095-afc2-c10aa60bcca6 service nova] Releasing lock "refresh_cache-b714fb94-fcc7-40ae-b3a9-d8c9a60008f1" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:40:07 user nova-compute[75176]: DEBUG nova.compute.manager [req-5ae82e94-2d6b-4d70-83ca-5989d2cdad01 req-297856e6-be61-4095-afc2-c10aa60bcca6 service nova] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] Received event network-changed-e1ac011f-d965-4d4c-b4c8-aa9bf5201518 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:40:07 user nova-compute[75176]: DEBUG nova.compute.manager [req-5ae82e94-2d6b-4d70-83ca-5989d2cdad01 req-297856e6-be61-4095-afc2-c10aa60bcca6 service nova] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] Refreshing instance network info cache due to event network-changed-e1ac011f-d965-4d4c-b4c8-aa9bf5201518. {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 15:40:07 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-5ae82e94-2d6b-4d70-83ca-5989d2cdad01 req-297856e6-be61-4095-afc2-c10aa60bcca6 service nova] Acquiring lock "refresh_cache-b714fb94-fcc7-40ae-b3a9-d8c9a60008f1" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:40:07 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-5ae82e94-2d6b-4d70-83ca-5989d2cdad01 req-297856e6-be61-4095-afc2-c10aa60bcca6 service nova] Acquired lock "refresh_cache-b714fb94-fcc7-40ae-b3a9-d8c9a60008f1" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:40:07 user nova-compute[75176]: DEBUG nova.network.neutron [req-5ae82e94-2d6b-4d70-83ca-5989d2cdad01 req-297856e6-be61-4095-afc2-c10aa60bcca6 service nova] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] Refreshing network info cache for port e1ac011f-d965-4d4c-b4c8-aa9bf5201518 {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 15:40:08 user nova-compute[75176]: DEBUG nova.network.neutron [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] Successfully updated port: 0c65b96a-0fce-4bff-b89c-443cc48f6995 {{(pid=75176) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 15:40:08 user nova-compute[75176]: DEBUG nova.network.neutron [req-5ae82e94-2d6b-4d70-83ca-5989d2cdad01 req-297856e6-be61-4095-afc2-c10aa60bcca6 service nova] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] Instance cache missing network info. {{(pid=75176) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 15:40:08 user nova-compute[75176]: DEBUG nova.network.neutron [req-5ae82e94-2d6b-4d70-83ca-5989d2cdad01 req-297856e6-be61-4095-afc2-c10aa60bcca6 service nova] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] Updating instance_info_cache with network_info: [] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:40:08 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-5ae82e94-2d6b-4d70-83ca-5989d2cdad01 req-297856e6-be61-4095-afc2-c10aa60bcca6 service nova] Releasing lock "refresh_cache-b714fb94-fcc7-40ae-b3a9-d8c9a60008f1" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:40:08 user nova-compute[75176]: DEBUG nova.compute.manager [req-83aa1153-dc53-40b8-8e65-7fd3045b4188 req-c66db70f-9a7b-4595-a4a0-a5b7d87b56a1 service nova] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] Received event network-changed-d9a60043-45d0-46f1-8d0f-ad1c7b55fa06 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:40:08 user nova-compute[75176]: DEBUG nova.compute.manager [req-83aa1153-dc53-40b8-8e65-7fd3045b4188 req-c66db70f-9a7b-4595-a4a0-a5b7d87b56a1 service nova] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] Refreshing instance network info cache due to event network-changed-d9a60043-45d0-46f1-8d0f-ad1c7b55fa06. {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 15:40:08 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-83aa1153-dc53-40b8-8e65-7fd3045b4188 req-c66db70f-9a7b-4595-a4a0-a5b7d87b56a1 service nova] Acquiring lock "refresh_cache-041af768-197b-4c76-a5a1-28e2dc8255bd" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:40:08 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-83aa1153-dc53-40b8-8e65-7fd3045b4188 req-c66db70f-9a7b-4595-a4a0-a5b7d87b56a1 service nova] Acquired lock "refresh_cache-041af768-197b-4c76-a5a1-28e2dc8255bd" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:40:08 user nova-compute[75176]: DEBUG nova.network.neutron [req-83aa1153-dc53-40b8-8e65-7fd3045b4188 req-c66db70f-9a7b-4595-a4a0-a5b7d87b56a1 service nova] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] Refreshing network info cache for port d9a60043-45d0-46f1-8d0f-ad1c7b55fa06 {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 15:40:08 user nova-compute[75176]: DEBUG nova.network.neutron [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] Successfully updated port: 04db431e-5bc8-4450-9bdd-82369fafba70 {{(pid=75176) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 15:40:08 user nova-compute[75176]: DEBUG nova.network.neutron [req-83aa1153-dc53-40b8-8e65-7fd3045b4188 req-c66db70f-9a7b-4595-a4a0-a5b7d87b56a1 service nova] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] Instance cache missing network info. {{(pid=75176) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 15:40:08 user nova-compute[75176]: INFO nova.virt.block_device [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] Booting with volume 27720cbf-c8ad-486b-845d-cdff5fbc4772 at /dev/vdb
Nov 28 15:40:08 user nova-compute[75176]: DEBUG os_brick.utils [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 15:40:08 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:40:08 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:40:08 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb5bcec2-7883-4841-a0f5-402d23f9c1e7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:edc924a949b2\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:40:08 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:40:08 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:40:08 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[45650b2d-ae5f-4dff-ae8a-c1f37be4baee]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:40:08 user nova-compute[75176]: DEBUG nova.network.neutron [req-83aa1153-dc53-40b8-8e65-7fd3045b4188 req-c66db70f-9a7b-4595-a4a0-a5b7d87b56a1 service nova] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] Updating instance_info_cache with network_info: [] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:40:08 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:40:08 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:40:08 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3d61e34-6584-490a-b1eb-7d71c4f66fde]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:40:08 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[75b95f6b-8896-4c9c-a143-569f0ffbdf5b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:40:08 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Running cmd (subprocess): nvme version {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:40:08 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] 'nvme version' failed. Not Retrying. {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 15:40:08 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] nvme not present on system {{(pid=75176) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 15:40:09 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-83aa1153-dc53-40b8-8e65-7fd3045b4188 req-c66db70f-9a7b-4595-a4a0-a5b7d87b56a1 service nova] Releasing lock "refresh_cache-041af768-197b-4c76-a5a1-28e2dc8255bd" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:40:09 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:40:09 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 15:40:09 user nova-compute[75176]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 15:40:09 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c6aef7d-35bb-42f0-abb0-96875820e9fa]: (4, '') {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:40:09 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.lightos [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75176) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 15:40:09 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.lightos [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75176) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 15:40:09 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.lightos [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] LIGHTOS: no hostnqn found. {{(pid=75176) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 15:40:09 user nova-compute[75176]: DEBUG os_brick.utils [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:edc924a949b2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 15:40:09 user nova-compute[75176]: DEBUG nova.virt.block_device [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] Updating existing volume attachment record: f4d82130-cdd4-4fb2-8181-892f20ea3caf {{(pid=75176) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 15:40:09 user nova-compute[75176]: DEBUG nova.network.neutron [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] Successfully updated port: 2df03152-b1aa-4794-965d-64886ac889ea {{(pid=75176) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 15:40:09 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Acquiring lock "refresh_cache-041af768-197b-4c76-a5a1-28e2dc8255bd" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:40:09 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Acquired lock "refresh_cache-041af768-197b-4c76-a5a1-28e2dc8255bd" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:40:09 user nova-compute[75176]: DEBUG nova.network.neutron [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] Building network info cache for instance {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 15:40:09 user nova-compute[75176]: DEBUG nova.network.neutron [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] Instance cache missing network info. {{(pid=75176) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 15:40:09 user nova-compute[75176]: DEBUG nova.compute.manager [req-733cf329-32fb-4c7f-be5e-210bae044d74 req-2f2e7e98-d9cc-45bd-8906-8dbde0d9cea1 service nova] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] Received event network-changed-61157920-954a-479e-bd66-b0746a7843a7 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:40:09 user nova-compute[75176]: DEBUG nova.compute.manager [req-733cf329-32fb-4c7f-be5e-210bae044d74 req-2f2e7e98-d9cc-45bd-8906-8dbde0d9cea1 service nova] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] Refreshing instance network info cache due to event network-changed-61157920-954a-479e-bd66-b0746a7843a7. {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 15:40:09 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-733cf329-32fb-4c7f-be5e-210bae044d74 req-2f2e7e98-d9cc-45bd-8906-8dbde0d9cea1 service nova] Acquiring lock "refresh_cache-b714fb94-fcc7-40ae-b3a9-d8c9a60008f1" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:40:09 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-733cf329-32fb-4c7f-be5e-210bae044d74 req-2f2e7e98-d9cc-45bd-8906-8dbde0d9cea1 service nova] Acquired lock "refresh_cache-b714fb94-fcc7-40ae-b3a9-d8c9a60008f1" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:40:09 user nova-compute[75176]: DEBUG nova.network.neutron [req-733cf329-32fb-4c7f-be5e-210bae044d74 req-2f2e7e98-d9cc-45bd-8906-8dbde0d9cea1 service nova] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] Refreshing network info cache for port 61157920-954a-479e-bd66-b0746a7843a7 {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 15:40:09 user nova-compute[75176]: DEBUG nova.network.neutron [req-733cf329-32fb-4c7f-be5e-210bae044d74 req-2f2e7e98-d9cc-45bd-8906-8dbde0d9cea1 service nova] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] Instance cache missing network info. {{(pid=75176) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 15:40:09 user nova-compute[75176]: DEBUG nova.network.neutron [req-733cf329-32fb-4c7f-be5e-210bae044d74 req-2f2e7e98-d9cc-45bd-8906-8dbde0d9cea1 service nova] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] Updating instance_info_cache with network_info: [] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:40:09 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-733cf329-32fb-4c7f-be5e-210bae044d74 req-2f2e7e98-d9cc-45bd-8906-8dbde0d9cea1 service nova] Releasing lock "refresh_cache-b714fb94-fcc7-40ae-b3a9-d8c9a60008f1" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:40:09 user nova-compute[75176]: DEBUG nova.compute.manager [req-733cf329-32fb-4c7f-be5e-210bae044d74 req-2f2e7e98-d9cc-45bd-8906-8dbde0d9cea1 service nova] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] Received event network-changed-0c65b96a-0fce-4bff-b89c-443cc48f6995 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:40:09 user nova-compute[75176]: DEBUG nova.compute.manager [req-733cf329-32fb-4c7f-be5e-210bae044d74 req-2f2e7e98-d9cc-45bd-8906-8dbde0d9cea1 service nova] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] Refreshing instance network info cache due to event network-changed-0c65b96a-0fce-4bff-b89c-443cc48f6995. {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 15:40:09 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-733cf329-32fb-4c7f-be5e-210bae044d74 req-2f2e7e98-d9cc-45bd-8906-8dbde0d9cea1 service nova] Acquiring lock "refresh_cache-041af768-197b-4c76-a5a1-28e2dc8255bd" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:40:09 user nova-compute[75176]: INFO nova.virt.block_device [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] Booting with volume 560d9b0e-d506-4723-8fc3-4068d690d5c8 at /dev/vdb
Nov 28 15:40:09 user nova-compute[75176]: DEBUG os_brick.utils [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 15:40:09 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:40:09 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:40:09 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[b75634a1-6dee-431c-af16-6421c6f6b2f1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:edc924a949b2\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:40:09 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:40:10 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:40:10 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e48894a-435b-4fcb-9a8f-48fa16c53cdf]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:40:10 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:40:10 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:40:10 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[480091d1-f6f9-4803-89d8-8b2ddd887f06]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:40:10 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[170b2b3c-18f4-4b79-b4d5-e05a4d78d514]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:40:10 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Running cmd (subprocess): nvme version {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:40:10 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] 'nvme version' failed. Not Retrying. {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 15:40:10 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.nvmeof [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] nvme not present on system {{(pid=75176) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 15:40:10 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:40:10 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 15:40:10 user nova-compute[75176]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 15:40:10 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f15d1d2-7852-464c-9456-691aecbc1f46]: (4, '') {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:40:10 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.lightos [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75176) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 15:40:10 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.lightos [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75176) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 15:40:10 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.lightos [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] LIGHTOS: no hostnqn found. {{(pid=75176) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 15:40:10 user nova-compute[75176]: DEBUG os_brick.utils [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] <== get_connector_properties: return (151ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:edc924a949b2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 15:40:10 user nova-compute[75176]: DEBUG nova.virt.block_device [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] Updating existing volume attachment record: 74725c0e-5bc9-47ed-9a9a-bf4d6a27bc16 {{(pid=75176) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 15:40:10 user nova-compute[75176]: DEBUG nova.network.neutron [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] Successfully updated port: 0bc36ba8-7fc6-47b2-b7b1-08a445625b46 {{(pid=75176) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 15:40:11 user nova-compute[75176]: DEBUG nova.network.neutron [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] Successfully updated port: 0c08ccbe-f3de-4aed-b641-8e2b58bd73a0 {{(pid=75176) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 15:40:11 user nova-compute[75176]: DEBUG nova.compute.manager [req-0a93d941-29ab-485b-9164-74270a37ee38 req-2bbc6efc-dd26-41a6-a76d-7417ed3db0d9 service nova] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] Received event network-changed-0bc36ba8-7fc6-47b2-b7b1-08a445625b46 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:40:11 user nova-compute[75176]: DEBUG nova.compute.manager [req-0a93d941-29ab-485b-9164-74270a37ee38 req-2bbc6efc-dd26-41a6-a76d-7417ed3db0d9 service nova] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] Refreshing instance network info cache due to event network-changed-0bc36ba8-7fc6-47b2-b7b1-08a445625b46. {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 15:40:11 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-0a93d941-29ab-485b-9164-74270a37ee38 req-2bbc6efc-dd26-41a6-a76d-7417ed3db0d9 service nova] Acquiring lock "refresh_cache-b714fb94-fcc7-40ae-b3a9-d8c9a60008f1" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:40:11 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-0a93d941-29ab-485b-9164-74270a37ee38 req-2bbc6efc-dd26-41a6-a76d-7417ed3db0d9 service nova] Acquired lock "refresh_cache-b714fb94-fcc7-40ae-b3a9-d8c9a60008f1" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:40:11 user nova-compute[75176]: DEBUG nova.network.neutron [req-0a93d941-29ab-485b-9164-74270a37ee38 req-2bbc6efc-dd26-41a6-a76d-7417ed3db0d9 service nova] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] Refreshing network info cache for port 0bc36ba8-7fc6-47b2-b7b1-08a445625b46 {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 15:40:11 user nova-compute[75176]: DEBUG nova.network.neutron [req-0a93d941-29ab-485b-9164-74270a37ee38 req-2bbc6efc-dd26-41a6-a76d-7417ed3db0d9 service nova] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] Instance cache missing network info. {{(pid=75176) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 15:40:11 user nova-compute[75176]: DEBUG nova.network.neutron [req-0a93d941-29ab-485b-9164-74270a37ee38 req-2bbc6efc-dd26-41a6-a76d-7417ed3db0d9 service nova] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] Updating instance_info_cache with network_info: [] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:40:11 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-0a93d941-29ab-485b-9164-74270a37ee38 req-2bbc6efc-dd26-41a6-a76d-7417ed3db0d9 service nova] Releasing lock "refresh_cache-b714fb94-fcc7-40ae-b3a9-d8c9a60008f1" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:40:11 user nova-compute[75176]: DEBUG nova.compute.manager [req-0a93d941-29ab-485b-9164-74270a37ee38 req-2bbc6efc-dd26-41a6-a76d-7417ed3db0d9 service nova] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] Received event network-changed-0c08ccbe-f3de-4aed-b641-8e2b58bd73a0 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:40:11 user nova-compute[75176]: DEBUG nova.compute.manager [req-0a93d941-29ab-485b-9164-74270a37ee38 req-2bbc6efc-dd26-41a6-a76d-7417ed3db0d9 service nova] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] Refreshing instance network info cache due to event network-changed-0c08ccbe-f3de-4aed-b641-8e2b58bd73a0. {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 15:40:11 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-0a93d941-29ab-485b-9164-74270a37ee38 req-2bbc6efc-dd26-41a6-a76d-7417ed3db0d9 service nova] Acquiring lock "refresh_cache-b714fb94-fcc7-40ae-b3a9-d8c9a60008f1" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:40:11 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-0a93d941-29ab-485b-9164-74270a37ee38 req-2bbc6efc-dd26-41a6-a76d-7417ed3db0d9 service nova] Acquired lock "refresh_cache-b714fb94-fcc7-40ae-b3a9-d8c9a60008f1" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:40:11 user nova-compute[75176]: DEBUG nova.network.neutron [req-0a93d941-29ab-485b-9164-74270a37ee38 req-2bbc6efc-dd26-41a6-a76d-7417ed3db0d9 service nova] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] Refreshing network info cache for port 0c08ccbe-f3de-4aed-b641-8e2b58bd73a0 {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 15:40:11 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:11 user nova-compute[75176]: DEBUG nova.network.neutron [req-0a93d941-29ab-485b-9164-74270a37ee38 req-2bbc6efc-dd26-41a6-a76d-7417ed3db0d9 service nova] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] Instance cache missing network info. {{(pid=75176) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 15:40:12 user nova-compute[75176]: DEBUG nova.network.neutron [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] Successfully updated port: e0b49239-50a0-4864-9e92-22bddcbe7d21 {{(pid=75176) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 15:40:12 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Acquiring lock "refresh_cache-b714fb94-fcc7-40ae-b3a9-d8c9a60008f1" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:40:12 user nova-compute[75176]: DEBUG nova.compute.manager [req-c6878c9a-4957-40a6-bb5f-6ee9b9db24e0 req-b0e58e0e-f050-4f3e-beaa-fcc14f47bbdb service nova] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] Received event network-changed-e0b49239-50a0-4864-9e92-22bddcbe7d21 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:40:12 user nova-compute[75176]: DEBUG nova.compute.manager [req-c6878c9a-4957-40a6-bb5f-6ee9b9db24e0 req-b0e58e0e-f050-4f3e-beaa-fcc14f47bbdb service nova] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] Refreshing instance network info cache due to event network-changed-e0b49239-50a0-4864-9e92-22bddcbe7d21. {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 15:40:12 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-c6878c9a-4957-40a6-bb5f-6ee9b9db24e0 req-b0e58e0e-f050-4f3e-beaa-fcc14f47bbdb service nova] Acquiring lock "refresh_cache-b714fb94-fcc7-40ae-b3a9-d8c9a60008f1" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:40:12 user nova-compute[75176]: DEBUG nova.network.neutron [req-0a93d941-29ab-485b-9164-74270a37ee38 req-2bbc6efc-dd26-41a6-a76d-7417ed3db0d9 service nova] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] Updating instance_info_cache with network_info: [] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:40:12 user nova-compute[75176]: DEBUG nova.network.neutron [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] Updating instance_info_cache with network_info: [{"id": "99a8dbf9-5502-440a-a03d-cd52337b3009", "address": "fa:16:3e:e2:26:17", "network": {"id": "9fe0d7b7-e9dc-4e03-a401-452fd502c940", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1675540815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfdec2abaf704a1396611ff1bcb96e53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99a8dbf9-55", "ovs_interfaceid": "99a8dbf9-5502-440a-a03d-cd52337b3009", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6c94b138-6202-4fb7-92c7-b3744cd8d19d", "address": "fa:16:3e:09:2f:ed", "network": {"id": "d7dbc9c3-816f-46fb-a3d3-e0e817e15de3", "bridge": "br-int", "label": "tempest-device-tagging-net1-136440967", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfdec2abaf704a1396611ff1bcb96e53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c94b138-62", "ovs_interfaceid": "6c94b138-6202-4fb7-92c7-b3744cd8d19d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0ac967e7-41bc-4751-a2bc-499ffbface15", "address": "fa:16:3e:ce:ed:17", "network": {"id": "d7dbc9c3-816f-46fb-a3d3-e0e817e15de3", "bridge": "br-int", "label": "tempest-device-tagging-net1-136440967", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.48", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfdec2abaf704a1396611ff1bcb96e53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ac967e7-41", "ovs_interfaceid": "0ac967e7-41bc-4751-a2bc-499ffbface15", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3a800e7a-5628-4668-ae3e-d49b537f7a62", "address": "fa:16:3e:e0:28:72", "network": {"id": "d7dbc9c3-816f-46fb-a3d3-e0e817e15de3", "bridge": "br-int", "label": "tempest-device-tagging-net1-136440967", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.25", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfdec2abaf704a1396611ff1bcb96e53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a800e7a-56", "ovs_interfaceid": "3a800e7a-5628-4668-ae3e-d49b537f7a62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d9a60043-45d0-46f1-8d0f-ad1c7b55fa06", "address": "fa:16:3e:5c:fb:31", "network": {"id": "d7dbc9c3-816f-46fb-a3d3-e0e817e15de3", "bridge": "br-int", "label": "tempest-device-tagging-net1-136440967", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.54", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfdec2abaf704a1396611ff1bcb96e53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9a60043-45", "ovs_interfaceid": "d9a60043-45d0-46f1-8d0f-ad1c7b55fa06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0c65b96a-0fce-4bff-b89c-443cc48f6995", "address": "fa:16:3e:c4:dc:af", "network": {"id": "6a9822be-add5-4d71-8ef1-1ce105eed6af", "bridge": "br-int", "label": "tempest-device-tagging-net2-401277966", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cfdec2abaf704a1396611ff1bcb96e53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c65b96a-0f", "ovs_interfaceid": "0c65b96a-0fce-4bff-b89c-443cc48f6995", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2df03152-b1aa-4794-965d-64886ac889ea", "address": "fa:16:3e:7a:2f:2c", "network": {"id": "6a9822be-add5-4d71-8ef1-1ce105eed6af", "bridge": "br-int", "label": "tempest-device-tagging-net2-401277966", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cfdec2abaf704a1396611ff1bcb96e53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2df03152-b1", "ovs_interfaceid": "2df03152-b1aa-4794-965d-64886ac889ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:40:12 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-0a93d941-29ab-485b-9164-74270a37ee38 req-2bbc6efc-dd26-41a6-a76d-7417ed3db0d9 service nova] Releasing lock "refresh_cache-b714fb94-fcc7-40ae-b3a9-d8c9a60008f1" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:40:12 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Acquired lock "refresh_cache-b714fb94-fcc7-40ae-b3a9-d8c9a60008f1" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:40:12 user nova-compute[75176]: DEBUG nova.network.neutron [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] Building network info cache for instance {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 15:40:12 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Releasing lock "refresh_cache-041af768-197b-4c76-a5a1-28e2dc8255bd" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:40:12 user nova-compute[75176]: DEBUG nova.compute.manager [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] Instance network_info: |[{"id": "99a8dbf9-5502-440a-a03d-cd52337b3009", "address": "fa:16:3e:e2:26:17", "network": {"id": "9fe0d7b7-e9dc-4e03-a401-452fd502c940", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1675540815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfdec2abaf704a1396611ff1bcb96e53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99a8dbf9-55", "ovs_interfaceid": "99a8dbf9-5502-440a-a03d-cd52337b3009", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6c94b138-6202-4fb7-92c7-b3744cd8d19d", "address": "fa:16:3e:09:2f:ed", "network": {"id": "d7dbc9c3-816f-46fb-a3d3-e0e817e15de3", "bridge": "br-int", "label": "tempest-device-tagging-net1-136440967", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfdec2abaf704a1396611ff1bcb96e53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c94b138-62", "ovs_interfaceid": "6c94b138-6202-4fb7-92c7-b3744cd8d19d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0ac967e7-41bc-4751-a2bc-499ffbface15", "address": "fa:16:3e:ce:ed:17", "network": {"id": "d7dbc9c3-816f-46fb-a3d3-e0e817e15de3", "bridge": "br-int", "label": "tempest-device-tagging-net1-136440967", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.48", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfdec2abaf704a1396611ff1bcb96e53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ac967e7-41", "ovs_interfaceid": "0ac967e7-41bc-4751-a2bc-499ffbface15", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3a800e7a-5628-4668-ae3e-d49b537f7a62", "address": "fa:16:3e:e0:28:72", "network": {"id": "d7dbc9c3-816f-46fb-a3d3-e0e817e15de3", "bridge": "br-int", "label": "tempest-device-tagging-net1-136440967", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.25", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfdec2abaf704a1396611ff1bcb96e53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a800e7a-56", "ovs_interfaceid": "3a800e7a-5628-4668-ae3e-d49b537f7a62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d9a60043-45d0-46f1-8d0f-ad1c7b55fa06", "address": "fa:16:3e:5c:fb:31", "network": {"id": "d7dbc9c3-816f-46fb-a3d3-e0e817e15de3", "bridge": "br-int", "label": "tempest-device-tagging-net1-136440967", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.54", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfdec2abaf704a1396611ff1bcb96e53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9a60043-45", "ovs_interfaceid": "d9a60043-45d0-46f1-8d0f-ad1c7b55fa06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0c65b96a-0fce-4bff-b89c-443cc48f6995", "address": "fa:16:3e:c4:dc:af", "network": {"id": "6a9822be-add5-4d71-8ef1-1ce105eed6af", "bridge": "br-int", "label": "tempest-device-tagging-net2-401277966", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cfdec2abaf704a1396611ff1bcb96e53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c65b96a-0f", "ovs_interfaceid": "0c65b96a-0fce-4bff-b89c-443cc48f6995", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2df03152-b1aa-4794-965d-64886ac889ea", "address": "fa:16:3e:7a:2f:2c", "network": {"id": "6a9822be-add5-4d71-8ef1-1ce105eed6af", "bridge": "br-int", "label": "tempest-device-tagging-net2-401277966", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cfdec2abaf704a1396611ff1bcb96e53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2df03152-b1", "ovs_interfaceid": "2df03152-b1aa-4794-965d-64886ac889ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75176) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 15:40:12 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-733cf329-32fb-4c7f-be5e-210bae044d74 req-2f2e7e98-d9cc-45bd-8906-8dbde0d9cea1 service nova] Acquired lock "refresh_cache-041af768-197b-4c76-a5a1-28e2dc8255bd" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:40:12 user nova-compute[75176]: DEBUG nova.network.neutron [req-733cf329-32fb-4c7f-be5e-210bae044d74 req-2f2e7e98-d9cc-45bd-8906-8dbde0d9cea1 service nova] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] Refreshing network info cache for port 0c65b96a-0fce-4bff-b89c-443cc48f6995 {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 15:40:12 user nova-compute[75176]: DEBUG nova.network.neutron [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] Instance cache missing network info. {{(pid=75176) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 15:40:12 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:13 user nova-compute[75176]: DEBUG nova.network.neutron [req-733cf329-32fb-4c7f-be5e-210bae044d74 req-2f2e7e98-d9cc-45bd-8906-8dbde0d9cea1 service nova] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] Updated VIF entry in instance network info cache for port 0c65b96a-0fce-4bff-b89c-443cc48f6995. {{(pid=75176) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 15:40:13 user nova-compute[75176]: DEBUG nova.network.neutron [req-733cf329-32fb-4c7f-be5e-210bae044d74 req-2f2e7e98-d9cc-45bd-8906-8dbde0d9cea1 service nova] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] Updating instance_info_cache with network_info: [{"id": "99a8dbf9-5502-440a-a03d-cd52337b3009", "address": "fa:16:3e:e2:26:17", "network": {"id": "9fe0d7b7-e9dc-4e03-a401-452fd502c940", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1675540815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfdec2abaf704a1396611ff1bcb96e53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99a8dbf9-55", "ovs_interfaceid": "99a8dbf9-5502-440a-a03d-cd52337b3009", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6c94b138-6202-4fb7-92c7-b3744cd8d19d", "address": "fa:16:3e:09:2f:ed", "network": {"id": "d7dbc9c3-816f-46fb-a3d3-e0e817e15de3", "bridge": "br-int", "label": "tempest-device-tagging-net1-136440967", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfdec2abaf704a1396611ff1bcb96e53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c94b138-62", "ovs_interfaceid": "6c94b138-6202-4fb7-92c7-b3744cd8d19d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0ac967e7-41bc-4751-a2bc-499ffbface15", "address": "fa:16:3e:ce:ed:17", "network": {"id": "d7dbc9c3-816f-46fb-a3d3-e0e817e15de3", "bridge": "br-int", "label": "tempest-device-tagging-net1-136440967", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.48", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfdec2abaf704a1396611ff1bcb96e53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ac967e7-41", "ovs_interfaceid": "0ac967e7-41bc-4751-a2bc-499ffbface15", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3a800e7a-5628-4668-ae3e-d49b537f7a62", "address": "fa:16:3e:e0:28:72", "network": {"id": "d7dbc9c3-816f-46fb-a3d3-e0e817e15de3", "bridge": "br-int", "label": "tempest-device-tagging-net1-136440967", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.25", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfdec2abaf704a1396611ff1bcb96e53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a800e7a-56", "ovs_interfaceid": "3a800e7a-5628-4668-ae3e-d49b537f7a62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d9a60043-45d0-46f1-8d0f-ad1c7b55fa06", "address": "fa:16:3e:5c:fb:31", "network": {"id": "d7dbc9c3-816f-46fb-a3d3-e0e817e15de3", "bridge": "br-int", "label": "tempest-device-tagging-net1-136440967", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.54", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfdec2abaf704a1396611ff1bcb96e53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9a60043-45", "ovs_interfaceid": "d9a60043-45d0-46f1-8d0f-ad1c7b55fa06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0c65b96a-0fce-4bff-b89c-443cc48f6995", "address": "fa:16:3e:c4:dc:af", "network": {"id": "6a9822be-add5-4d71-8ef1-1ce105eed6af", "bridge": "br-int", "label": "tempest-device-tagging-net2-401277966", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cfdec2abaf704a1396611ff1bcb96e53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c65b96a-0f", "ovs_interfaceid": "0c65b96a-0fce-4bff-b89c-443cc48f6995", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2df03152-b1aa-4794-965d-64886ac889ea", "address": "fa:16:3e:7a:2f:2c", "network": {"id": "6a9822be-add5-4d71-8ef1-1ce105eed6af", "bridge": "br-int", "label": "tempest-device-tagging-net2-401277966", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cfdec2abaf704a1396611ff1bcb96e53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2df03152-b1", "ovs_interfaceid": "2df03152-b1aa-4794-965d-64886ac889ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:40:13 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-733cf329-32fb-4c7f-be5e-210bae044d74 req-2f2e7e98-d9cc-45bd-8906-8dbde0d9cea1 service nova] Releasing lock "refresh_cache-041af768-197b-4c76-a5a1-28e2dc8255bd" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:40:13 user nova-compute[75176]: DEBUG nova.compute.manager [req-733cf329-32fb-4c7f-be5e-210bae044d74 req-2f2e7e98-d9cc-45bd-8906-8dbde0d9cea1 service nova] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] Received event network-changed-04db431e-5bc8-4450-9bdd-82369fafba70 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:40:13 user nova-compute[75176]: DEBUG nova.compute.manager [req-733cf329-32fb-4c7f-be5e-210bae044d74 req-2f2e7e98-d9cc-45bd-8906-8dbde0d9cea1 service nova] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] Refreshing instance network info cache due to event network-changed-04db431e-5bc8-4450-9bdd-82369fafba70. {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 15:40:13 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-733cf329-32fb-4c7f-be5e-210bae044d74 req-2f2e7e98-d9cc-45bd-8906-8dbde0d9cea1 service nova] Acquiring lock "refresh_cache-b714fb94-fcc7-40ae-b3a9-d8c9a60008f1" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:40:14 user nova-compute[75176]: DEBUG nova.network.neutron [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] Updating instance_info_cache with network_info: [{"id": "da7d30e5-6304-46ec-8d50-336986e6262f", "address": "fa:16:3e:63:83:5b", "network": {"id": "b1277b75-5749-436a-a651-3303fd60d8b4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1047877730-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0108444c01e94416984b083707102c58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda7d30e5-63", "ovs_interfaceid": "da7d30e5-6304-46ec-8d50-336986e6262f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e1ac011f-d965-4d4c-b4c8-aa9bf5201518", "address": "fa:16:3e:7f:e1:ea", "network": {"id": "26bf803a-6aa2-4e87-b407-caee3f8f7d3d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1638676687", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0108444c01e94416984b083707102c58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1ac011f-d9", "ovs_interfaceid": "e1ac011f-d965-4d4c-b4c8-aa9bf5201518", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "61157920-954a-479e-bd66-b0746a7843a7", "address": "fa:16:3e:8f:4f:39", "network": {"id": "26bf803a-6aa2-4e87-b407-caee3f8f7d3d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1638676687", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0108444c01e94416984b083707102c58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61157920-95", "ovs_interfaceid": "61157920-954a-479e-bd66-b0746a7843a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "04db431e-5bc8-4450-9bdd-82369fafba70", "address": "fa:16:3e:15:71:6f", "network": {"id": "26bf803a-6aa2-4e87-b407-caee3f8f7d3d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1638676687", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0108444c01e94416984b083707102c58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04db431e-5b", "ovs_interfaceid": "04db431e-5bc8-4450-9bdd-82369fafba70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0bc36ba8-7fc6-47b2-b7b1-08a445625b46", "address": "fa:16:3e:76:ce:76", "network": {"id": "26bf803a-6aa2-4e87-b407-caee3f8f7d3d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1638676687", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0108444c01e94416984b083707102c58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bc36ba8-7f", "ovs_interfaceid": "0bc36ba8-7fc6-47b2-b7b1-08a445625b46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0c08ccbe-f3de-4aed-b641-8e2b58bd73a0", "address": "fa:16:3e:59:54:f2", "network": {"id": "3936aa29-a691-4362-8bd9-536545b14473", "bridge": "br-int", "label": "tempest-device-tagging-net2-1089118081", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0108444c01e94416984b083707102c58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c08ccbe-f3", "ovs_interfaceid": "0c08ccbe-f3de-4aed-b641-8e2b58bd73a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e0b49239-50a0-4864-9e92-22bddcbe7d21", "address": "fa:16:3e:d8:78:24", "network": {"id": "3936aa29-a691-4362-8bd9-536545b14473", "bridge": "br-int", "label": "tempest-device-tagging-net2-1089118081", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0108444c01e94416984b083707102c58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0b49239-50", "ovs_interfaceid": "e0b49239-50a0-4864-9e92-22bddcbe7d21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:40:14 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Releasing lock "refresh_cache-b714fb94-fcc7-40ae-b3a9-d8c9a60008f1" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:40:14 user nova-compute[75176]: DEBUG nova.compute.manager [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] Instance network_info: |[{"id": "da7d30e5-6304-46ec-8d50-336986e6262f", "address": "fa:16:3e:63:83:5b", "network": {"id": "b1277b75-5749-436a-a651-3303fd60d8b4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1047877730-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0108444c01e94416984b083707102c58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda7d30e5-63", "ovs_interfaceid": "da7d30e5-6304-46ec-8d50-336986e6262f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e1ac011f-d965-4d4c-b4c8-aa9bf5201518", "address": "fa:16:3e:7f:e1:ea", "network": {"id": "26bf803a-6aa2-4e87-b407-caee3f8f7d3d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1638676687", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0108444c01e94416984b083707102c58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1ac011f-d9", "ovs_interfaceid": "e1ac011f-d965-4d4c-b4c8-aa9bf5201518", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "61157920-954a-479e-bd66-b0746a7843a7", "address": "fa:16:3e:8f:4f:39", "network": {"id": "26bf803a-6aa2-4e87-b407-caee3f8f7d3d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1638676687", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0108444c01e94416984b083707102c58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61157920-95", "ovs_interfaceid": "61157920-954a-479e-bd66-b0746a7843a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "04db431e-5bc8-4450-9bdd-82369fafba70", "address": "fa:16:3e:15:71:6f", "network": {"id": "26bf803a-6aa2-4e87-b407-caee3f8f7d3d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1638676687", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0108444c01e94416984b083707102c58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04db431e-5b", "ovs_interfaceid": "04db431e-5bc8-4450-9bdd-82369fafba70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0bc36ba8-7fc6-47b2-b7b1-08a445625b46", "address": "fa:16:3e:76:ce:76", "network": {"id": "26bf803a-6aa2-4e87-b407-caee3f8f7d3d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1638676687", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0108444c01e94416984b083707102c58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bc36ba8-7f", "ovs_interfaceid": "0bc36ba8-7fc6-47b2-b7b1-08a445625b46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0c08ccbe-f3de-4aed-b641-8e2b58bd73a0", "address": "fa:16:3e:59:54:f2", "network": {"id": "3936aa29-a691-4362-8bd9-536545b14473", "bridge": "br-int", "label": "tempest-device-tagging-net2-1089118081", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0108444c01e94416984b083707102c58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c08ccbe-f3", "ovs_interfaceid": "0c08ccbe-f3de-4aed-b641-8e2b58bd73a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e0b49239-50a0-4864-9e92-22bddcbe7d21", "address": "fa:16:3e:d8:78:24", "network": {"id": "3936aa29-a691-4362-8bd9-536545b14473", "bridge": "br-int", "label": "tempest-device-tagging-net2-1089118081", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0108444c01e94416984b083707102c58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0b49239-50", "ovs_interfaceid": "e0b49239-50a0-4864-9e92-22bddcbe7d21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75176) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 15:40:14 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-c6878c9a-4957-40a6-bb5f-6ee9b9db24e0 req-b0e58e0e-f050-4f3e-beaa-fcc14f47bbdb service nova] Acquired lock "refresh_cache-b714fb94-fcc7-40ae-b3a9-d8c9a60008f1" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:40:14 user nova-compute[75176]: DEBUG nova.network.neutron [req-c6878c9a-4957-40a6-bb5f-6ee9b9db24e0 req-b0e58e0e-f050-4f3e-beaa-fcc14f47bbdb service nova] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] Refreshing network info cache for port e0b49239-50a0-4864-9e92-22bddcbe7d21 {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 15:40:15 user nova-compute[75176]: DEBUG nova.network.neutron [req-c6878c9a-4957-40a6-bb5f-6ee9b9db24e0 req-b0e58e0e-f050-4f3e-beaa-fcc14f47bbdb service nova] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] Updated VIF entry in instance network info cache for port e0b49239-50a0-4864-9e92-22bddcbe7d21. {{(pid=75176) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 15:40:15 user nova-compute[75176]: DEBUG nova.network.neutron [req-c6878c9a-4957-40a6-bb5f-6ee9b9db24e0 req-b0e58e0e-f050-4f3e-beaa-fcc14f47bbdb service nova] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] Updating instance_info_cache with network_info: [{"id": "da7d30e5-6304-46ec-8d50-336986e6262f", "address": "fa:16:3e:63:83:5b", "network": {"id": "b1277b75-5749-436a-a651-3303fd60d8b4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1047877730-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0108444c01e94416984b083707102c58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda7d30e5-63", "ovs_interfaceid": "da7d30e5-6304-46ec-8d50-336986e6262f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e1ac011f-d965-4d4c-b4c8-aa9bf5201518", "address": "fa:16:3e:7f:e1:ea", "network": {"id": "26bf803a-6aa2-4e87-b407-caee3f8f7d3d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1638676687", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0108444c01e94416984b083707102c58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1ac011f-d9", "ovs_interfaceid": "e1ac011f-d965-4d4c-b4c8-aa9bf5201518", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "61157920-954a-479e-bd66-b0746a7843a7", "address": "fa:16:3e:8f:4f:39", "network": {"id": "26bf803a-6aa2-4e87-b407-caee3f8f7d3d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1638676687", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0108444c01e94416984b083707102c58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61157920-95", "ovs_interfaceid": "61157920-954a-479e-bd66-b0746a7843a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "04db431e-5bc8-4450-9bdd-82369fafba70", "address": "fa:16:3e:15:71:6f", "network": {"id": "26bf803a-6aa2-4e87-b407-caee3f8f7d3d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1638676687", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0108444c01e94416984b083707102c58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04db431e-5b", "ovs_interfaceid": "04db431e-5bc8-4450-9bdd-82369fafba70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0bc36ba8-7fc6-47b2-b7b1-08a445625b46", "address": "fa:16:3e:76:ce:76", "network": {"id": "26bf803a-6aa2-4e87-b407-caee3f8f7d3d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1638676687", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0108444c01e94416984b083707102c58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bc36ba8-7f", "ovs_interfaceid": "0bc36ba8-7fc6-47b2-b7b1-08a445625b46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0c08ccbe-f3de-4aed-b641-8e2b58bd73a0", "address": "fa:16:3e:59:54:f2", "network": {"id": "3936aa29-a691-4362-8bd9-536545b14473", "bridge": "br-int", "label": "tempest-device-tagging-net2-1089118081", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0108444c01e94416984b083707102c58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c08ccbe-f3", "ovs_interfaceid": "0c08ccbe-f3de-4aed-b641-8e2b58bd73a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e0b49239-50a0-4864-9e92-22bddcbe7d21", "address": "fa:16:3e:d8:78:24", "network": {"id": "3936aa29-a691-4362-8bd9-536545b14473", "bridge": "br-int", "label": "tempest-device-tagging-net2-1089118081", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0108444c01e94416984b083707102c58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0b49239-50", "ovs_interfaceid": "e0b49239-50a0-4864-9e92-22bddcbe7d21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:40:15 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-c6878c9a-4957-40a6-bb5f-6ee9b9db24e0 req-b0e58e0e-f050-4f3e-beaa-fcc14f47bbdb service nova] Releasing lock "refresh_cache-b714fb94-fcc7-40ae-b3a9-d8c9a60008f1" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:40:15 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-733cf329-32fb-4c7f-be5e-210bae044d74 req-2f2e7e98-d9cc-45bd-8906-8dbde0d9cea1 service nova] Acquired lock "refresh_cache-b714fb94-fcc7-40ae-b3a9-d8c9a60008f1" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:40:15 user nova-compute[75176]: DEBUG nova.network.neutron [req-733cf329-32fb-4c7f-be5e-210bae044d74 req-2f2e7e98-d9cc-45bd-8906-8dbde0d9cea1 service nova] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] Refreshing network info cache for port 04db431e-5bc8-4450-9bdd-82369fafba70 {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 15:40:15 user nova-compute[75176]: DEBUG nova.network.neutron [req-733cf329-32fb-4c7f-be5e-210bae044d74 req-2f2e7e98-d9cc-45bd-8906-8dbde0d9cea1 service nova] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] Updated VIF entry in instance network info cache for port 04db431e-5bc8-4450-9bdd-82369fafba70. {{(pid=75176) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 15:40:15 user nova-compute[75176]: DEBUG nova.network.neutron [req-733cf329-32fb-4c7f-be5e-210bae044d74 req-2f2e7e98-d9cc-45bd-8906-8dbde0d9cea1 service nova] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] Updating instance_info_cache with network_info: [{"id": "da7d30e5-6304-46ec-8d50-336986e6262f", "address": "fa:16:3e:63:83:5b", "network": {"id": "b1277b75-5749-436a-a651-3303fd60d8b4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1047877730-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0108444c01e94416984b083707102c58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda7d30e5-63", "ovs_interfaceid": "da7d30e5-6304-46ec-8d50-336986e6262f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e1ac011f-d965-4d4c-b4c8-aa9bf5201518", "address": "fa:16:3e:7f:e1:ea", "network": {"id": "26bf803a-6aa2-4e87-b407-caee3f8f7d3d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1638676687", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0108444c01e94416984b083707102c58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1ac011f-d9", "ovs_interfaceid": "e1ac011f-d965-4d4c-b4c8-aa9bf5201518", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "61157920-954a-479e-bd66-b0746a7843a7", "address": "fa:16:3e:8f:4f:39", "network": {"id": "26bf803a-6aa2-4e87-b407-caee3f8f7d3d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1638676687", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0108444c01e94416984b083707102c58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61157920-95", "ovs_interfaceid": "61157920-954a-479e-bd66-b0746a7843a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "04db431e-5bc8-4450-9bdd-82369fafba70", "address": "fa:16:3e:15:71:6f", "network": {"id": "26bf803a-6aa2-4e87-b407-caee3f8f7d3d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1638676687", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0108444c01e94416984b083707102c58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04db431e-5b", "ovs_interfaceid": "04db431e-5bc8-4450-9bdd-82369fafba70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0bc36ba8-7fc6-47b2-b7b1-08a445625b46", "address": "fa:16:3e:76:ce:76", "network": {"id": "26bf803a-6aa2-4e87-b407-caee3f8f7d3d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1638676687", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0108444c01e94416984b083707102c58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bc36ba8-7f", "ovs_interfaceid": "0bc36ba8-7fc6-47b2-b7b1-08a445625b46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0c08ccbe-f3de-4aed-b641-8e2b58bd73a0", "address": "fa:16:3e:59:54:f2", "network": {"id": "3936aa29-a691-4362-8bd9-536545b14473", "bridge": "br-int", "label": "tempest-device-tagging-net2-1089118081", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0108444c01e94416984b083707102c58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c08ccbe-f3", "ovs_interfaceid": "0c08ccbe-f3de-4aed-b641-8e2b58bd73a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e0b49239-50a0-4864-9e92-22bddcbe7d21", "address": "fa:16:3e:d8:78:24", "network": {"id": "3936aa29-a691-4362-8bd9-536545b14473", "bridge": "br-int", "label": "tempest-device-tagging-net2-1089118081", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0108444c01e94416984b083707102c58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0b49239-50", "ovs_interfaceid": "e0b49239-50a0-4864-9e92-22bddcbe7d21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:40:15 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-733cf329-32fb-4c7f-be5e-210bae044d74 req-2f2e7e98-d9cc-45bd-8906-8dbde0d9cea1 service nova] Releasing lock "refresh_cache-b714fb94-fcc7-40ae-b3a9-d8c9a60008f1" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:40:15 user nova-compute[75176]: DEBUG nova.compute.manager [req-733cf329-32fb-4c7f-be5e-210bae044d74 req-2f2e7e98-d9cc-45bd-8906-8dbde0d9cea1 service nova] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] Received event network-changed-2df03152-b1aa-4794-965d-64886ac889ea {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:40:15 user nova-compute[75176]: DEBUG nova.compute.manager [req-733cf329-32fb-4c7f-be5e-210bae044d74 req-2f2e7e98-d9cc-45bd-8906-8dbde0d9cea1 service nova] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] Refreshing instance network info cache due to event network-changed-2df03152-b1aa-4794-965d-64886ac889ea. {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 15:40:15 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-733cf329-32fb-4c7f-be5e-210bae044d74 req-2f2e7e98-d9cc-45bd-8906-8dbde0d9cea1 service nova] Acquiring lock "refresh_cache-041af768-197b-4c76-a5a1-28e2dc8255bd" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:40:15 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-733cf329-32fb-4c7f-be5e-210bae044d74 req-2f2e7e98-d9cc-45bd-8906-8dbde0d9cea1 service nova] Acquired lock "refresh_cache-041af768-197b-4c76-a5a1-28e2dc8255bd" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:40:15 user nova-compute[75176]: DEBUG nova.network.neutron [req-733cf329-32fb-4c7f-be5e-210bae044d74 req-2f2e7e98-d9cc-45bd-8906-8dbde0d9cea1 service nova] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] Refreshing network info cache for port 2df03152-b1aa-4794-965d-64886ac889ea {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 15:40:16 user nova-compute[75176]: DEBUG nova.network.neutron [req-733cf329-32fb-4c7f-be5e-210bae044d74 req-2f2e7e98-d9cc-45bd-8906-8dbde0d9cea1 service nova] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] Updated VIF entry in instance network info cache for port 2df03152-b1aa-4794-965d-64886ac889ea. {{(pid=75176) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 15:40:16 user nova-compute[75176]: DEBUG nova.network.neutron [req-733cf329-32fb-4c7f-be5e-210bae044d74 req-2f2e7e98-d9cc-45bd-8906-8dbde0d9cea1 service nova] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] Updating instance_info_cache with network_info: [{"id": "99a8dbf9-5502-440a-a03d-cd52337b3009", "address": "fa:16:3e:e2:26:17", "network": {"id": "9fe0d7b7-e9dc-4e03-a401-452fd502c940", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1675540815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfdec2abaf704a1396611ff1bcb96e53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99a8dbf9-55", "ovs_interfaceid": "99a8dbf9-5502-440a-a03d-cd52337b3009", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6c94b138-6202-4fb7-92c7-b3744cd8d19d", "address": "fa:16:3e:09:2f:ed", "network": {"id": "d7dbc9c3-816f-46fb-a3d3-e0e817e15de3", "bridge": "br-int", "label": "tempest-device-tagging-net1-136440967", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfdec2abaf704a1396611ff1bcb96e53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c94b138-62", "ovs_interfaceid": "6c94b138-6202-4fb7-92c7-b3744cd8d19d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0ac967e7-41bc-4751-a2bc-499ffbface15", "address": "fa:16:3e:ce:ed:17", "network": {"id": "d7dbc9c3-816f-46fb-a3d3-e0e817e15de3", "bridge": "br-int", "label": "tempest-device-tagging-net1-136440967", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.48", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfdec2abaf704a1396611ff1bcb96e53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ac967e7-41", "ovs_interfaceid": "0ac967e7-41bc-4751-a2bc-499ffbface15", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3a800e7a-5628-4668-ae3e-d49b537f7a62", "address": "fa:16:3e:e0:28:72", "network": {"id": "d7dbc9c3-816f-46fb-a3d3-e0e817e15de3", "bridge": "br-int", "label": "tempest-device-tagging-net1-136440967", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.25", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfdec2abaf704a1396611ff1bcb96e53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a800e7a-56", "ovs_interfaceid": "3a800e7a-5628-4668-ae3e-d49b537f7a62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d9a60043-45d0-46f1-8d0f-ad1c7b55fa06", "address": "fa:16:3e:5c:fb:31", "network": {"id": "d7dbc9c3-816f-46fb-a3d3-e0e817e15de3", "bridge": "br-int", "label": "tempest-device-tagging-net1-136440967", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.54", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfdec2abaf704a1396611ff1bcb96e53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9a60043-45", "ovs_interfaceid": "d9a60043-45d0-46f1-8d0f-ad1c7b55fa06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0c65b96a-0fce-4bff-b89c-443cc48f6995", "address": "fa:16:3e:c4:dc:af", "network": {"id": "6a9822be-add5-4d71-8ef1-1ce105eed6af", "bridge": "br-int", "label": "tempest-device-tagging-net2-401277966", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cfdec2abaf704a1396611ff1bcb96e53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c65b96a-0f", "ovs_interfaceid": "0c65b96a-0fce-4bff-b89c-443cc48f6995", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2df03152-b1aa-4794-965d-64886ac889ea", "address": "fa:16:3e:7a:2f:2c", "network": {"id": "6a9822be-add5-4d71-8ef1-1ce105eed6af", "bridge": "br-int", "label": "tempest-device-tagging-net2-401277966", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cfdec2abaf704a1396611ff1bcb96e53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2df03152-b1", "ovs_interfaceid": "2df03152-b1aa-4794-965d-64886ac889ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:40:16 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-733cf329-32fb-4c7f-be5e-210bae044d74 req-2f2e7e98-d9cc-45bd-8906-8dbde0d9cea1 service nova] Releasing lock "refresh_cache-041af768-197b-4c76-a5a1-28e2dc8255bd" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:40:16 user nova-compute[75176]: INFO nova.virt.block_device [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] Booting with volume 6e691257-74a3-4fef-9fd1-67d2ba725039 at /dev/vdc
Nov 28 15:40:16 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:17 user nova-compute[75176]: DEBUG os_brick.utils [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 15:40:17 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:40:17 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:40:17 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[93e85148-3e5b-4689-83cf-7acef4a9f525]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:edc924a949b2\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:40:17 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:40:17 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:40:17 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f225b43-1f31-45dc-a381-e3efe4f8127e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:40:17 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:40:17 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:40:17 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb067325-cdee-4770-aba6-9bb6f3675f7d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:40:17 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0a3aad5-26e7-44df-a083-ab4e0264da6a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:40:17 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Running cmd (subprocess): nvme version {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:40:17 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] 'nvme version' failed. Not Retrying. {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 15:40:17 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] nvme not present on system {{(pid=75176) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 15:40:17 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:40:17 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 15:40:17 user nova-compute[75176]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 15:40:17 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2cb116c-6151-45e2-bb9c-3c360e192ff6]: (4, '') {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:40:17 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.lightos [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75176) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 15:40:17 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.lightos [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75176) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 15:40:17 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.lightos [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] LIGHTOS: no hostnqn found. {{(pid=75176) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 15:40:17 user nova-compute[75176]: DEBUG os_brick.utils [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:edc924a949b2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 15:40:17 user nova-compute[75176]: DEBUG nova.virt.block_device [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] Updating existing volume attachment record: 8c03d6bc-3890-4321-8ce2-d01a9ceb8db3 {{(pid=75176) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 15:40:17 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:18 user nova-compute[75176]: INFO nova.virt.block_device [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] Booting with volume 763d605d-247d-4484-b7ec-762e36b92abc at /dev/vdc
Nov 28 15:40:18 user nova-compute[75176]: DEBUG os_brick.utils [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 15:40:18 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:40:18 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:40:18 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[85e1eae2-e3cb-42a3-8f11-6dd9596abad2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:edc924a949b2\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:40:18 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:40:18 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:40:18 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[6409cda6-dd6a-4bfb-a91f-4373ddf2489e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:40:18 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:40:18 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.012s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:40:18 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[affad7af-d6f0-4bab-ba25-8c8aa7116c06]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:40:18 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a3e62a0-cf2c-424c-af5d-700f92546a15]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:40:18 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Running cmd (subprocess): nvme version {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:40:18 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] 'nvme version' failed. Not Retrying. {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 15:40:18 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.nvmeof [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] nvme not present on system {{(pid=75176) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 15:40:18 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:40:18 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 15:40:18 user nova-compute[75176]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 15:40:18 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[0727b1b0-a075-413d-8504-88dbbb673cdd]: (4, '') {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:40:18 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.lightos [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75176) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 15:40:18 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.lightos [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75176) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 15:40:18 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.lightos [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] LIGHTOS: no hostnqn found. {{(pid=75176) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 15:40:18 user nova-compute[75176]: DEBUG os_brick.utils [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] <== get_connector_properties: return (155ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:edc924a949b2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 15:40:18 user nova-compute[75176]: DEBUG nova.virt.block_device [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] Updating existing volume attachment record: b014c859-95a2-48d2-bd26-ae03ea94a663 {{(pid=75176) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 15:40:21 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:22 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:24 user nova-compute[75176]: DEBUG nova.compute.manager [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] Start spawning the instance on the hypervisor. {{(pid=75176) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 15:40:24 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] Creating instance directory {{(pid=75176) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 15:40:24 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] Creating image(s)
Nov 28 15:40:24 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] Did not create local disks {{(pid=75176) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 28 15:40:24 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] Ensure instance console log exists: /opt/stack/data/nova/instances/041af768-197b-4c76-a5a1-28e2dc8255bd/console.log {{(pid=75176) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 15:40:24 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:40:24 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:40:24 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:40:24 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] Start _get_guest_xml network_info=[{"id": "99a8dbf9-5502-440a-a03d-cd52337b3009", "address": "fa:16:3e:e2:26:17", "network": {"id": "9fe0d7b7-e9dc-4e03-a401-452fd502c940", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1675540815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfdec2abaf704a1396611ff1bcb96e53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99a8dbf9-55", "ovs_interfaceid": "99a8dbf9-5502-440a-a03d-cd52337b3009", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6c94b138-6202-4fb7-92c7-b3744cd8d19d", "address": "fa:16:3e:09:2f:ed", "network": {"id": "d7dbc9c3-816f-46fb-a3d3-e0e817e15de3", "bridge": "br-int", "label": "tempest-device-tagging-net1-136440967", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfdec2abaf704a1396611ff1bcb96e53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c94b138-62", "ovs_interfaceid": "6c94b138-6202-4fb7-92c7-b3744cd8d19d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0ac967e7-41bc-4751-a2bc-499ffbface15", "address": "fa:16:3e:ce:ed:17", "network": {"id": "d7dbc9c3-816f-46fb-a3d3-e0e817e15de3", "bridge": "br-int", "label": "tempest-device-tagging-net1-136440967", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.48", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfdec2abaf704a1396611ff1bcb96e53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ac967e7-41", "ovs_interfaceid": "0ac967e7-41bc-4751-a2bc-499ffbface15", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3a800e7a-5628-4668-ae3e-d49b537f7a62", "address": "fa:16:3e:e0:28:72", "network": {"id": "d7dbc9c3-816f-46fb-a3d3-e0e817e15de3", "bridge": "br-int", "label": "tempest-device-tagging-net1-136440967", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.25", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfdec2abaf704a1396611ff1bcb96e53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a800e7a-56", "ovs_interfaceid": "3a800e7a-5628-4668-ae3e-d49b537f7a62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d9a60043-45d0-46f1-8d0f-ad1c7b55fa06", "address": "fa:16:3e:5c:fb:31", "network": {"id": "d7dbc9c3-816f-46fb-a3d3-e0e817e15de3", "bridge": "br-int", "label": "tempest-device-tagging-net1-136440967", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.54", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfdec2abaf704a1396611ff1bcb96e53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9a60043-45", "ovs_interfaceid": "d9a60043-45d0-46f1-8d0f-ad1c7b55fa06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0c65b96a-0fce-4bff-b89c-443cc48f6995", "address": "fa:16:3e:c4:dc:af", "network": {"id": "6a9822be-add5-4d71-8ef1-1ce105eed6af", "bridge": "br-int", "label": "tempest-device-tagging-net2-401277966", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cfdec2abaf704a1396611ff1bcb96e53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c65b96a-0f", "ovs_interfaceid": "0c65b96a-0fce-4bff-b89c-443cc48f6995", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2df03152-b1aa-4794-965d-64886ac889ea", "address": "fa:16:3e:7a:2f:2c", "network": {"id": "6a9822be-add5-4d71-8ef1-1ce105eed6af", "bridge": "br-int", "label": "tempest-device-tagging-net2-401277966", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cfdec2abaf704a1396611ff1bcb96e53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2df03152-b1", "ovs_interfaceid": "2df03152-b1aa-4794-965d-64886ac889ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T15:35:12Z,direct_url=<?>,disk_format='qcow2',id=1f41819e-c93f-4dc7-b253-37a27bbbbc74,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1b91c5d0672c4224a48df2e1f92688e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T15:35:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:81326542-482f-4d50-895c-13c65fe4daf7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CdovnAPQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '041af768-197b-4c76-a5a1-28e2dc8255bd', 'attached_at': '', 'detached_at': '', 'volume_id': '81326542-482f-4d50-895c-13c65fe4daf7', 'serial': '81326542-482f-4d50-895c-13c65fe4daf7'}, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'delete_on_termination': False, 'mount_device': '/dev/vda', 'attachment_id': 'ee2bdda0-b792-4a54-bfe4-0ca947746824', 'volume_type': None}, {'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:27720cbf-c8ad-486b-845d-cdff5fbc4772', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mkUsIMCG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '041af768-197b-4c76-a5a1-28e2dc8255bd', 'attached_at': '', 'detached_at': '', 'volume_id': '27720cbf-c8ad-486b-845d-cdff5fbc4772', 'serial': '27720cbf-c8ad-486b-845d-cdff5fbc4772'}, 'guest_format': None, 'device_type': 'disk', 'boot_index': 1, 'disk_bus': 'virtio', 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'attachment_id': 'f4d82130-cdd4-4fb2-8181-892f20ea3caf', 'volume_type': None}, {'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6e691257-74a3-4fef-9fd1-67d2ba725039', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sbWjatrv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '041af768-197b-4c76-a5a1-28e2dc8255bd', 'attached_at': '', 'detached_at': '', 'volume_id': '6e691257-74a3-4fef-9fd1-67d2ba725039', 'serial': '6e691257-74a3-4fef-9fd1-67d2ba725039'}, 'guest_format': None, 'device_type': 'disk', 'boot_index': 2, 'disk_bus': 'virtio', 'delete_on_termination': False, 'mount_device': '/dev/vdc', 'attachment_id': '8c03d6bc-3890-4321-8ce2-d01a9ceb8db3', 'volume_type': None} {{(pid=75176) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 15:40:24 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 15:40:24 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 15:40:24 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75176) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 15:40:24 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] CPU controller missing on host. {{(pid=75176) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 15:40:24 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75176) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 15:40:24 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] CPU controller found on host. {{(pid=75176) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 15:40:24 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75176) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 15:40:24 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T15:35:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T15:35:12Z,direct_url=<?>,disk_format='qcow2',id=1f41819e-c93f-4dc7-b253-37a27bbbbc74,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1b91c5d0672c4224a48df2e1f92688e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T15:35:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 15:40:24 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Flavor limits 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 15:40:24 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Image limits 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 15:40:24 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Flavor pref 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 15:40:24 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Image pref 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 15:40:24 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 15:40:24 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 15:40:24 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75176) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 15:40:24 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Got 1 possible topologies {{(pid=75176) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 15:40:24 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 15:40:24 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 15:40:24 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] Calling os-brick to attach iSCSI Volume {{(pid=75176) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 15:40:24 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c1b8a00>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:81326542-482f-4d50-895c-13c65fe4daf7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CdovnAPQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 15:40:24 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 15:40:24 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 15:40:24 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 15:40:24 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 15:40:24 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:81326542-482f-4d50-895c-13c65fe4daf7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 15:40:24 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:81326542-482f-4d50-895c-13c65fe4daf7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 15:40:24 user nova-compute[75176]: INFO os_brick.initiator.connectors.iscsi [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 15:40:24 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81326542-482f-4d50-895c-13c65fe4daf7 -p 172.16.0.220:3260 {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:40:24 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81326542-482f-4d50-895c-13c65fe4daf7 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:40:24 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[46883395-ea60-4d7e-b70b-9225caa9b2e5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:40:24 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 15:40:24 user nova-compute[75176]:  {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:40:24 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81326542-482f-4d50-895c-13c65fe4daf7 -p 172.16.0.220:3260 --interface default --op new {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:40:24 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81326542-482f-4d50-895c-13c65fe4daf7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:40:24 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[701f6fc7-ccc6-4900-b073-67d9455c49ff]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:81326542-482f-4d50-895c-13c65fe4daf7] added\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:40:24 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:81326542-482f-4d50-895c-13c65fe4daf7] added
Nov 28 15:40:24 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:40:24 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81326542-482f-4d50-895c-13c65fe4daf7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:40:24 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81326542-482f-4d50-895c-13c65fe4daf7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:40:24 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[672ef0ce-365c-4a6c-ac20-956b4067d162]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:40:24 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:40:24 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81326542-482f-4d50-895c-13c65fe4daf7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:40:24 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81326542-482f-4d50-895c-13c65fe4daf7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:40:24 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b689fdc-ce06-43df-a995-138c655c7e14]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:40:24 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:40:24 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81326542-482f-4d50-895c-13c65fe4daf7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CdovnAPQ {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:40:25 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81326542-482f-4d50-895c-13c65fe4daf7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CdovnAPQ" returned: 0 in 0.018s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:40:25 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[ede9992e-c637-49b5-bc5d-c7ef0b4a055e]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:40:25 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CdovnAPQ'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:40:25 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81326542-482f-4d50-895c-13c65fe4daf7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:40:25 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81326542-482f-4d50-895c-13c65fe4daf7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:40:25 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd9c4459-1b1b-4369-a05b-7dccda92f3e8]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:40:25 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:40:25 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:40:25 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:40:25 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[1251fdb9-cae3-4e42-947d-5e2ca2c0f7e6]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9 (non-flash)\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:40:25 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9 (non-flash)
Nov 28 15:40:25 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:40:25 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9 (non-flash)
Nov 28 15:40:25 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 15:40:25 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81326542-482f-4d50-895c-13c65fe4daf7 -p 172.16.0.220:3260 --login {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:40:25 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81326542-482f-4d50-895c-13c65fe4daf7 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:40:25 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed88b13c-651d-4e27-9fe2-f0b5104116af]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:81326542-482f-4d50-895c-13c65fe4daf7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:81326542-482f-4d50-895c-13c65fe4daf7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:40:25 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:81326542-482f-4d50-895c-13c65fe4daf7, portal: 172.16.0.220,3260]
Nov 28 15:40:25 user nova-compute[75176]: Login to [iface: default, target: iqn.2010-10.org.openstack:81326542-482f-4d50-895c-13c65fe4daf7, portal: 172.16.0.220,3260] successful.
Nov 28 15:40:25 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:40:25 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81326542-482f-4d50-895c-13c65fe4daf7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:40:25 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81326542-482f-4d50-895c-13c65fe4daf7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:40:25 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc3a23db-b6b3-47f1-af22-b008970a2e70]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:40:25 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:40:25 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:40:25 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:40:25 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ac29207-b337-4ea4-a412-f45e88f4fab1]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81326542-482f-4d50-895c-13c65fe4daf7 (non-flash)\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:40:25 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9 (non-flash)
Nov 28 15:40:25 user nova-compute[75176]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81326542-482f-4d50-895c-13c65fe4daf7 (non-flash)
Nov 28 15:40:25 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:40:25 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9 (non-flash)
Nov 28 15:40:25 user nova-compute[75176]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81326542-482f-4d50-895c-13c65fe4daf7 (non-flash)
Nov 28 15:40:25 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 15:40:25 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:81326542-482f-4d50-895c-13c65fe4daf7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.256s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 15:40:25 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Connected to 172.16.0.220:3260 {{(pid=75176) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 15:40:25 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=75176) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 15:40:25 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75176) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 15:40:25 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:40:25 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:40:25 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[b375d2c8-e2c4-4ee6-9c5b-12e6114ccf88]: (4, ('- - 0', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:40:25 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75176) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 15:40:25 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:81326542-482f-4d50-895c-13c65fe4daf7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CdovnAPQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75176) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 15:40:25 user nova-compute[75176]: DEBUG nova.compute.manager [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] Start spawning the instance on the hypervisor. {{(pid=75176) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 15:40:25 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] Creating instance directory {{(pid=75176) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 15:40:25 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] Creating image(s)
Nov 28 15:40:25 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] Did not create local disks {{(pid=75176) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 28 15:40:25 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] Ensure instance console log exists: /opt/stack/data/nova/instances/b714fb94-fcc7-40ae-b3a9-d8c9a60008f1/console.log {{(pid=75176) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 15:40:25 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:40:25 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:40:25 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:40:25 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] Start _get_guest_xml network_info=[{"id": "da7d30e5-6304-46ec-8d50-336986e6262f", "address": "fa:16:3e:63:83:5b", "network": {"id": "b1277b75-5749-436a-a651-3303fd60d8b4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1047877730-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0108444c01e94416984b083707102c58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda7d30e5-63", "ovs_interfaceid": "da7d30e5-6304-46ec-8d50-336986e6262f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e1ac011f-d965-4d4c-b4c8-aa9bf5201518", "address": "fa:16:3e:7f:e1:ea", "network": {"id": "26bf803a-6aa2-4e87-b407-caee3f8f7d3d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1638676687", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0108444c01e94416984b083707102c58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1ac011f-d9", "ovs_interfaceid": "e1ac011f-d965-4d4c-b4c8-aa9bf5201518", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "61157920-954a-479e-bd66-b0746a7843a7", "address": "fa:16:3e:8f:4f:39", "network": {"id": "26bf803a-6aa2-4e87-b407-caee3f8f7d3d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1638676687", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0108444c01e94416984b083707102c58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61157920-95", "ovs_interfaceid": "61157920-954a-479e-bd66-b0746a7843a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "04db431e-5bc8-4450-9bdd-82369fafba70", "address": "fa:16:3e:15:71:6f", "network": {"id": "26bf803a-6aa2-4e87-b407-caee3f8f7d3d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1638676687", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0108444c01e94416984b083707102c58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04db431e-5b", "ovs_interfaceid": "04db431e-5bc8-4450-9bdd-82369fafba70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0bc36ba8-7fc6-47b2-b7b1-08a445625b46", "address": "fa:16:3e:76:ce:76", "network": {"id": "26bf803a-6aa2-4e87-b407-caee3f8f7d3d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1638676687", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0108444c01e94416984b083707102c58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bc36ba8-7f", "ovs_interfaceid": "0bc36ba8-7fc6-47b2-b7b1-08a445625b46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0c08ccbe-f3de-4aed-b641-8e2b58bd73a0", "address": "fa:16:3e:59:54:f2", "network": {"id": "3936aa29-a691-4362-8bd9-536545b14473", "bridge": "br-int", "label": "tempest-device-tagging-net2-1089118081", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0108444c01e94416984b083707102c58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c08ccbe-f3", "ovs_interfaceid": "0c08ccbe-f3de-4aed-b641-8e2b58bd73a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e0b49239-50a0-4864-9e92-22bddcbe7d21", "address": "fa:16:3e:d8:78:24", "network": {"id": "3936aa29-a691-4362-8bd9-536545b14473", "bridge": "br-int", "label": "tempest-device-tagging-net2-1089118081", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0108444c01e94416984b083707102c58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0b49239-50", "ovs_interfaceid": "e0b49239-50a0-4864-9e92-22bddcbe7d21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T15:35:12Z,direct_url=<?>,disk_format='qcow2',id=1f41819e-c93f-4dc7-b253-37a27bbbbc74,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1b91c5d0672c4224a48df2e1f92688e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T15:35:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:76ea4d3b-7c77-47d0-b48b-ad79886d4f9a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bJrEVveQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b714fb94-fcc7-40ae-b3a9-d8c9a60008f1', 'attached_at': '', 'detached_at': '', 'volume_id': '76ea4d3b-7c77-47d0-b48b-ad79886d4f9a', 'serial': '76ea4d3b-7c77-47d0-b48b-ad79886d4f9a'}, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'delete_on_termination': False, 'mount_device': '/dev/vda', 'attachment_id': 'e63d9285-393f-450e-9e48-bf4cb85d2295', 'volume_type': None}, {'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:560d9b0e-d506-4723-8fc3-4068d690d5c8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aYDCJPOv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b714fb94-fcc7-40ae-b3a9-d8c9a60008f1', 'attached_at': '', 'detached_at': '', 'volume_id': '560d9b0e-d506-4723-8fc3-4068d690d5c8', 'serial': '560d9b0e-d506-4723-8fc3-4068d690d5c8'}, 'guest_format': None, 'device_type': 'disk', 'boot_index': 1, 'disk_bus': 'virtio', 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'attachment_id': '74725c0e-5bc9-47ed-9a9a-bf4d6a27bc16', 'volume_type': None}, {'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:763d605d-247d-4484-b7ec-762e36b92abc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wHMBuZWL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b714fb94-fcc7-40ae-b3a9-d8c9a60008f1', 'attached_at': '', 'detached_at': '', 'volume_id': '763d605d-247d-4484-b7ec-762e36b92abc', 'serial': '763d605d-247d-4484-b7ec-762e36b92abc'}, 'guest_format': None, 'device_type': 'disk', 'boot_index': 2, 'disk_bus': 'virtio', 'delete_on_termination': False, 'mount_device': '/dev/vdc', 'attachment_id': 'b014c859-95a2-48d2-bd26-ae03ea94a663', 'volume_type': None} {{(pid=75176) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 15:40:25 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 15:40:25 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 15:40:25 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75176) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 15:40:25 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] CPU controller missing on host. {{(pid=75176) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 15:40:25 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75176) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 15:40:25 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] CPU controller found on host. {{(pid=75176) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 15:40:26 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75176) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 15:40:26 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T15:35:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T15:35:12Z,direct_url=<?>,disk_format='qcow2',id=1f41819e-c93f-4dc7-b253-37a27bbbbc74,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1b91c5d0672c4224a48df2e1f92688e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T15:35:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 15:40:26 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Flavor limits 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 15:40:26 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Image limits 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 15:40:26 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Flavor pref 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 15:40:26 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Image pref 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 15:40:26 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 15:40:26 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 15:40:26 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75176) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 15:40:26 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Got 1 possible topologies {{(pid=75176) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 15:40:26 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 15:40:26 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 15:40:26 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] Calling os-brick to attach iSCSI Volume {{(pid=75176) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 15:40:26 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c1b8a00>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:76ea4d3b-7c77-47d0-b48b-ad79886d4f9a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bJrEVveQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 15:40:26 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 15:40:26 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 15:40:26 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.288s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 15:40:26 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] <== connect_volume: return (1289ms) {'type': 'block', 'scsi_wwn': '23063326235326661', 'path': '/dev/sdc'} {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 15:40:26 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23063326235326661', 'path': '/dev/sdc'} {{(pid=75176) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 15:40:26 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.160s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 15:40:26 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 15:40:26 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:76ea4d3b-7c77-47d0-b48b-ad79886d4f9a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 15:40:26 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:76ea4d3b-7c77-47d0-b48b-ad79886d4f9a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 15:40:26 user nova-compute[75176]: INFO os_brick.initiator.connectors.iscsi [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 15:40:26 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76ea4d3b-7c77-47d0-b48b-ad79886d4f9a -p 172.16.0.220:3260 {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:40:26 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76ea4d3b-7c77-47d0-b48b-ad79886d4f9a -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:40:26 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[815d79de-ad88-4149-a9d0-9c802e9aa5be]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:40:26 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 15:40:26 user nova-compute[75176]:  {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:40:26 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] Calling os-brick to attach iSCSI Volume {{(pid=75176) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 15:40:26 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c1b8a00>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:27720cbf-c8ad-486b-845d-cdff5fbc4772', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mkUsIMCG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 15:40:26 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 15:40:26 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 15:40:26 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76ea4d3b-7c77-47d0-b48b-ad79886d4f9a -p 172.16.0.220:3260 --interface default --op new {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:40:26 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76ea4d3b-7c77-47d0-b48b-ad79886d4f9a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:40:26 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c22cdcd-46b5-4e45-b996-fd795e42d7a1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:76ea4d3b-7c77-47d0-b48b-ad79886d4f9a] added\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:40:26 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:76ea4d3b-7c77-47d0-b48b-ad79886d4f9a] added
Nov 28 15:40:26 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:40:26 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76ea4d3b-7c77-47d0-b48b-ad79886d4f9a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:40:26 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76ea4d3b-7c77-47d0-b48b-ad79886d4f9a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:40:26 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[951d733b-7f4a-4b6e-9176-f576ecedda11]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:40:26 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:40:26 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76ea4d3b-7c77-47d0-b48b-ad79886d4f9a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:40:26 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76ea4d3b-7c77-47d0-b48b-ad79886d4f9a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:40:26 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf40b3cd-2ba7-4766-b87e-37cf4b79ddd0]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:40:26 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:40:26 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76ea4d3b-7c77-47d0-b48b-ad79886d4f9a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bJrEVveQ {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:40:26 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76ea4d3b-7c77-47d0-b48b-ad79886d4f9a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bJrEVveQ" returned: 0 in 0.016s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:40:26 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[2127c9e4-b7d6-4e80-84fd-315891b4bf5e]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:40:26 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bJrEVveQ'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:40:26 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76ea4d3b-7c77-47d0-b48b-ad79886d4f9a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:40:26 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76ea4d3b-7c77-47d0-b48b-ad79886d4f9a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:40:26 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b973161-f363-4c96-8bfe-e505665aac12]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:40:26 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:40:26 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:40:26 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:40:26 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[db13b5c7-950a-453b-bc88-d30ea273583d]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81326542-482f-4d50-895c-13c65fe4daf7 (non-flash)\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:40:26 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9 (non-flash)
Nov 28 15:40:26 user nova-compute[75176]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81326542-482f-4d50-895c-13c65fe4daf7 (non-flash)
Nov 28 15:40:26 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:40:26 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9 (non-flash)
Nov 28 15:40:26 user nova-compute[75176]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81326542-482f-4d50-895c-13c65fe4daf7 (non-flash)
Nov 28 15:40:26 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 15:40:26 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76ea4d3b-7c77-47d0-b48b-ad79886d4f9a -p 172.16.0.220:3260 --login {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:40:26 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76ea4d3b-7c77-47d0-b48b-ad79886d4f9a -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:40:26 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[2910ddf3-f13d-48c6-8c87-d21757914bd3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:76ea4d3b-7c77-47d0-b48b-ad79886d4f9a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:76ea4d3b-7c77-47d0-b48b-ad79886d4f9a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:40:26 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:76ea4d3b-7c77-47d0-b48b-ad79886d4f9a, portal: 172.16.0.220,3260]
Nov 28 15:40:26 user nova-compute[75176]: Login to [iface: default, target: iqn.2010-10.org.openstack:76ea4d3b-7c77-47d0-b48b-ad79886d4f9a, portal: 172.16.0.220,3260] successful.
Nov 28 15:40:26 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:40:26 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76ea4d3b-7c77-47d0-b48b-ad79886d4f9a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:40:26 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76ea4d3b-7c77-47d0-b48b-ad79886d4f9a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.016s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:40:26 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ab218f2-9742-4821-a87d-d293b94a3dd4]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:40:26 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:40:26 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:40:26 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:40:26 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e68b1af-0e2a-45b4-a528-1240b5705ff4]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81326542-482f-4d50-895c-13c65fe4daf7 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76ea4d3b-7c77-47d0-b48b-ad79886d4f9a (non-flash)\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:40:26 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9 (non-flash)
Nov 28 15:40:26 user nova-compute[75176]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81326542-482f-4d50-895c-13c65fe4daf7 (non-flash)
Nov 28 15:40:26 user nova-compute[75176]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76ea4d3b-7c77-47d0-b48b-ad79886d4f9a (non-flash)
Nov 28 15:40:26 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:40:26 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9 (non-flash)
Nov 28 15:40:26 user nova-compute[75176]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81326542-482f-4d50-895c-13c65fe4daf7 (non-flash)
Nov 28 15:40:26 user nova-compute[75176]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76ea4d3b-7c77-47d0-b48b-ad79886d4f9a (non-flash)
Nov 28 15:40:26 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 15:40:26 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:76ea4d3b-7c77-47d0-b48b-ad79886d4f9a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.243s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 15:40:26 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Connected to 172.16.0.220:3260 {{(pid=75176) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 15:40:26 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=75176) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 15:40:26 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75176) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 15:40:26 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:40:26 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.015s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:40:26 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f99c684-1317-4c81-beac-cdd2fdfeff7e]: (4, ('- - 0', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:40:26 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: None {{(pid=75176) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 15:40:26 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:27 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75176) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 15:40:27 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:76ea4d3b-7c77-47d0-b48b-ad79886d4f9a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bJrEVveQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75176) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 15:40:27 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.271s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 15:40:27 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] <== connect_volume: return (1431ms) {'type': 'block', 'scsi_wwn': '23232376364343163', 'path': '/dev/sdd'} {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 15:40:27 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23232376364343163', 'path': '/dev/sdd'} {{(pid=75176) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 15:40:27 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.246s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 15:40:27 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 15:40:27 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:27720cbf-c8ad-486b-845d-cdff5fbc4772" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 15:40:27 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:27720cbf-c8ad-486b-845d-cdff5fbc4772" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 15:40:27 user nova-compute[75176]: INFO os_brick.initiator.connectors.iscsi [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 15:40:27 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27720cbf-c8ad-486b-845d-cdff5fbc4772 -p 172.16.0.220:3260 {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:40:27 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27720cbf-c8ad-486b-845d-cdff5fbc4772 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:40:27 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbd61467-5994-43d0-89ed-00b4e2aaa00b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:40:27 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 15:40:27 user nova-compute[75176]:  {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:40:27 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27720cbf-c8ad-486b-845d-cdff5fbc4772 -p 172.16.0.220:3260 --interface default --op new {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:40:27 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] Calling os-brick to attach iSCSI Volume {{(pid=75176) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 15:40:27 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c1b8a00>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:560d9b0e-d506-4723-8fc3-4068d690d5c8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aYDCJPOv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 15:40:27 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 15:40:27 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 15:40:27 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27720cbf-c8ad-486b-845d-cdff5fbc4772 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:40:27 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[c51855bf-5352-4913-8344-c4724aa26338]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:27720cbf-c8ad-486b-845d-cdff5fbc4772] added\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:40:27 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:27720cbf-c8ad-486b-845d-cdff5fbc4772] added
Nov 28 15:40:27 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:40:27 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27720cbf-c8ad-486b-845d-cdff5fbc4772 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:40:27 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27720cbf-c8ad-486b-845d-cdff5fbc4772 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:40:27 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f6c6e40-9fde-4c10-a792-c07e191bd002]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:40:27 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:40:27 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27720cbf-c8ad-486b-845d-cdff5fbc4772 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:40:27 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27720cbf-c8ad-486b-845d-cdff5fbc4772 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:40:27 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[f16d81b7-f644-4ca3-aae8-c6a7416e2b7e]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:40:27 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:40:27 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27720cbf-c8ad-486b-845d-cdff5fbc4772 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mkUsIMCG {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:40:27 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27720cbf-c8ad-486b-845d-cdff5fbc4772 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mkUsIMCG" returned: 0 in 0.021s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:40:27 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbd0f496-81f4-41b9-a360-af1cae6ea3a4]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:40:27 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mkUsIMCG'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:40:27 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27720cbf-c8ad-486b-845d-cdff5fbc4772 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:40:27 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27720cbf-c8ad-486b-845d-cdff5fbc4772 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:40:27 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f6be230-b6f8-4450-b5ad-18e32b662e70]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:40:27 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:40:27 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:40:27 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:40:27 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[b054b72e-3e64-4af5-a2f8-230415a49068]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81326542-482f-4d50-895c-13c65fe4daf7 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76ea4d3b-7c77-47d0-b48b-ad79886d4f9a (non-flash)\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:40:27 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9 (non-flash)
Nov 28 15:40:27 user nova-compute[75176]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81326542-482f-4d50-895c-13c65fe4daf7 (non-flash)
Nov 28 15:40:27 user nova-compute[75176]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76ea4d3b-7c77-47d0-b48b-ad79886d4f9a (non-flash)
Nov 28 15:40:27 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:40:27 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9 (non-flash)
Nov 28 15:40:27 user nova-compute[75176]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81326542-482f-4d50-895c-13c65fe4daf7 (non-flash)
Nov 28 15:40:27 user nova-compute[75176]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76ea4d3b-7c77-47d0-b48b-ad79886d4f9a (non-flash)
Nov 28 15:40:27 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 15:40:27 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27720cbf-c8ad-486b-845d-cdff5fbc4772 -p 172.16.0.220:3260 --login {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:40:27 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27720cbf-c8ad-486b-845d-cdff5fbc4772 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:40:27 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[29fc03fe-7f6e-41f0-be72-e58be76ff7bf]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:27720cbf-c8ad-486b-845d-cdff5fbc4772, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:27720cbf-c8ad-486b-845d-cdff5fbc4772, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:40:27 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:27720cbf-c8ad-486b-845d-cdff5fbc4772, portal: 172.16.0.220,3260]
Nov 28 15:40:27 user nova-compute[75176]: Login to [iface: default, target: iqn.2010-10.org.openstack:27720cbf-c8ad-486b-845d-cdff5fbc4772, portal: 172.16.0.220,3260] successful.
Nov 28 15:40:27 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:40:27 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27720cbf-c8ad-486b-845d-cdff5fbc4772 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:40:27 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27720cbf-c8ad-486b-845d-cdff5fbc4772 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:40:27 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[530612b5-9c89-496e-ae96-997aef3b06da]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:40:27 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:40:27 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:40:27 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:40:27 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[edd3e2ae-ecd5-4275-b377-b0833453f9b3]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81326542-482f-4d50-895c-13c65fe4daf7 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76ea4d3b-7c77-47d0-b48b-ad79886d4f9a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27720cbf-c8ad-486b-845d-cdff5fbc4772 (non-flash)\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:40:27 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9 (non-flash)
Nov 28 15:40:27 user nova-compute[75176]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81326542-482f-4d50-895c-13c65fe4daf7 (non-flash)
Nov 28 15:40:27 user nova-compute[75176]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76ea4d3b-7c77-47d0-b48b-ad79886d4f9a (non-flash)
Nov 28 15:40:27 user nova-compute[75176]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27720cbf-c8ad-486b-845d-cdff5fbc4772 (non-flash)
Nov 28 15:40:27 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:40:27 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9 (non-flash)
Nov 28 15:40:27 user nova-compute[75176]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81326542-482f-4d50-895c-13c65fe4daf7 (non-flash)
Nov 28 15:40:27 user nova-compute[75176]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76ea4d3b-7c77-47d0-b48b-ad79886d4f9a (non-flash)
Nov 28 15:40:27 user nova-compute[75176]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27720cbf-c8ad-486b-845d-cdff5fbc4772 (non-flash)
Nov 28 15:40:27 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 15:40:27 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:27720cbf-c8ad-486b-845d-cdff5fbc4772" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.285s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 15:40:27 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Connected to 172.16.0.220:3260 {{(pid=75176) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 15:40:27 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=75176) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 15:40:27 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75176) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 15:40:27 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:40:27 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.015s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:40:27 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[73baa380-9d99-4554-82fe-1e51edc3e7d7]: (4, ('- - 0', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:40:27 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75176) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 15:40:27 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:27720cbf-c8ad-486b-845d-cdff5fbc4772', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mkUsIMCG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75176) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 15:40:27 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:28 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.317s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 15:40:28 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] <== connect_volume: return (2564ms) {'type': 'block', 'scsi_wwn': '26231356266356461', 'path': '/dev/sde'} {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 15:40:28 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26231356266356461', 'path': '/dev/sde'} {{(pid=75176) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 15:40:28 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.275s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 15:40:28 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 15:40:28 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:560d9b0e-d506-4723-8fc3-4068d690d5c8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 15:40:28 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:560d9b0e-d506-4723-8fc3-4068d690d5c8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 15:40:28 user nova-compute[75176]: INFO os_brick.initiator.connectors.iscsi [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 15:40:28 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:560d9b0e-d506-4723-8fc3-4068d690d5c8 -p 172.16.0.220:3260 {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:40:28 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:560d9b0e-d506-4723-8fc3-4068d690d5c8 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:40:28 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe6e4763-304b-4f8c-94c0-7e4b5528383e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:40:28 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 15:40:28 user nova-compute[75176]:  {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:40:28 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] Calling os-brick to attach iSCSI Volume {{(pid=75176) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 15:40:28 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c1b8a00>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6e691257-74a3-4fef-9fd1-67d2ba725039', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sbWjatrv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 15:40:28 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 15:40:28 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 15:40:28 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:560d9b0e-d506-4723-8fc3-4068d690d5c8 -p 172.16.0.220:3260 --interface default --op new {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:40:28 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:560d9b0e-d506-4723-8fc3-4068d690d5c8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:40:28 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[66a47742-3e8b-48a1-b03a-b671340d70a0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:560d9b0e-d506-4723-8fc3-4068d690d5c8] added\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:40:28 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:560d9b0e-d506-4723-8fc3-4068d690d5c8] added
Nov 28 15:40:28 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:40:28 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:560d9b0e-d506-4723-8fc3-4068d690d5c8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:40:28 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:560d9b0e-d506-4723-8fc3-4068d690d5c8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:40:28 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[8191e229-eab6-4a7b-bcd4-2db239bc6dc3]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:40:28 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:40:28 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:560d9b0e-d506-4723-8fc3-4068d690d5c8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:40:28 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:560d9b0e-d506-4723-8fc3-4068d690d5c8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:40:28 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9a80326-f7b7-40c0-a854-290eede9afa0]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:40:28 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:40:28 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:560d9b0e-d506-4723-8fc3-4068d690d5c8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aYDCJPOv {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:40:28 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:560d9b0e-d506-4723-8fc3-4068d690d5c8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aYDCJPOv" returned: 0 in 0.017s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:40:28 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[b071210e-c5b4-4ec8-8650-36e4528ac693]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:40:28 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'aYDCJPOv'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:40:28 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:560d9b0e-d506-4723-8fc3-4068d690d5c8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:40:28 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:560d9b0e-d506-4723-8fc3-4068d690d5c8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:40:28 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[d723b7e6-10ca-4227-b2c3-bf111fd51b31]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:40:28 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:40:28 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:40:28 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:40:28 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5ca4c8e-720e-443c-808d-e456dccacf8d]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81326542-482f-4d50-895c-13c65fe4daf7 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76ea4d3b-7c77-47d0-b48b-ad79886d4f9a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27720cbf-c8ad-486b-845d-cdff5fbc4772 (non-flash)\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:40:28 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9 (non-flash)
Nov 28 15:40:28 user nova-compute[75176]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81326542-482f-4d50-895c-13c65fe4daf7 (non-flash)
Nov 28 15:40:28 user nova-compute[75176]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76ea4d3b-7c77-47d0-b48b-ad79886d4f9a (non-flash)
Nov 28 15:40:28 user nova-compute[75176]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27720cbf-c8ad-486b-845d-cdff5fbc4772 (non-flash)
Nov 28 15:40:28 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:40:28 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9 (non-flash)
Nov 28 15:40:28 user nova-compute[75176]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81326542-482f-4d50-895c-13c65fe4daf7 (non-flash)
Nov 28 15:40:28 user nova-compute[75176]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76ea4d3b-7c77-47d0-b48b-ad79886d4f9a (non-flash)
Nov 28 15:40:28 user nova-compute[75176]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27720cbf-c8ad-486b-845d-cdff5fbc4772 (non-flash)
Nov 28 15:40:28 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 15:40:28 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:560d9b0e-d506-4723-8fc3-4068d690d5c8 -p 172.16.0.220:3260 --login {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:40:29 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:560d9b0e-d506-4723-8fc3-4068d690d5c8 -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:40:29 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[1489a730-ad2a-4247-b7d6-60b3ca1cc01a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:560d9b0e-d506-4723-8fc3-4068d690d5c8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:560d9b0e-d506-4723-8fc3-4068d690d5c8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:40:29 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:560d9b0e-d506-4723-8fc3-4068d690d5c8, portal: 172.16.0.220,3260]
Nov 28 15:40:29 user nova-compute[75176]: Login to [iface: default, target: iqn.2010-10.org.openstack:560d9b0e-d506-4723-8fc3-4068d690d5c8, portal: 172.16.0.220,3260] successful.
Nov 28 15:40:29 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:40:29 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:560d9b0e-d506-4723-8fc3-4068d690d5c8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:40:29 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:560d9b0e-d506-4723-8fc3-4068d690d5c8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:40:29 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[f307174c-2b9f-4203-9849-a87c650711e0]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:40:29 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:40:29 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:40:29 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:40:29 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[98863646-f80f-4e04-b4b7-bd9f9634906b]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81326542-482f-4d50-895c-13c65fe4daf7 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76ea4d3b-7c77-47d0-b48b-ad79886d4f9a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27720cbf-c8ad-486b-845d-cdff5fbc4772 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:560d9b0e-d506-4723-8fc3-4068d690d5c8 (non-flash)\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:40:29 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9 (non-flash)
Nov 28 15:40:29 user nova-compute[75176]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81326542-482f-4d50-895c-13c65fe4daf7 (non-flash)
Nov 28 15:40:29 user nova-compute[75176]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76ea4d3b-7c77-47d0-b48b-ad79886d4f9a (non-flash)
Nov 28 15:40:29 user nova-compute[75176]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27720cbf-c8ad-486b-845d-cdff5fbc4772 (non-flash)
Nov 28 15:40:29 user nova-compute[75176]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:560d9b0e-d506-4723-8fc3-4068d690d5c8 (non-flash)
Nov 28 15:40:29 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:40:29 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9 (non-flash)
Nov 28 15:40:29 user nova-compute[75176]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81326542-482f-4d50-895c-13c65fe4daf7 (non-flash)
Nov 28 15:40:29 user nova-compute[75176]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76ea4d3b-7c77-47d0-b48b-ad79886d4f9a (non-flash)
Nov 28 15:40:29 user nova-compute[75176]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27720cbf-c8ad-486b-845d-cdff5fbc4772 (non-flash)
Nov 28 15:40:29 user nova-compute[75176]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:560d9b0e-d506-4723-8fc3-4068d690d5c8 (non-flash)
Nov 28 15:40:29 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 15:40:29 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:560d9b0e-d506-4723-8fc3-4068d690d5c8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.281s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 15:40:29 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Connected to 172.16.0.220:3260 {{(pid=75176) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 15:40:29 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] HCTL ('37', '-', '-', 0) found on session 6 with lun 0 {{(pid=75176) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 15:40:29 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75176) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 15:40:29 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:40:29 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.018s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:40:29 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4c739c9-30cb-4ed2-8fb3-179a17d0f93c]: (4, ('- - 0', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:40:29 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Searching for a device in session 6 and hctl ['37', '*', '*', 0] yield: None {{(pid=75176) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 15:40:30 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Searching for a device in session 6 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75176) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 15:40:30 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:560d9b0e-d506-4723-8fc3-4068d690d5c8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aYDCJPOv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75176) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 15:40:30 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.311s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 15:40:30 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] <== connect_volume: return (2586ms) {'type': 'block', 'scsi_wwn': '23838376131613736', 'path': '/dev/sdf'} {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 15:40:30 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23838376131613736', 'path': '/dev/sdf'} {{(pid=75176) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 15:40:30 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.287s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 15:40:30 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 15:40:30 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6e691257-74a3-4fef-9fd1-67d2ba725039" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 15:40:30 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6e691257-74a3-4fef-9fd1-67d2ba725039" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 15:40:30 user nova-compute[75176]: INFO os_brick.initiator.connectors.iscsi [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 15:40:30 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e691257-74a3-4fef-9fd1-67d2ba725039 -p 172.16.0.220:3260 {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:40:30 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e691257-74a3-4fef-9fd1-67d2ba725039 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:40:30 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4e155d4-743a-4492-a4a2-598def8e5d78]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:40:30 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 15:40:30 user nova-compute[75176]:  {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:40:30 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] Calling os-brick to attach iSCSI Volume {{(pid=75176) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 15:40:30 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c1b8a00>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:763d605d-247d-4484-b7ec-762e36b92abc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wHMBuZWL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 15:40:30 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 15:40:30 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 15:40:30 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e691257-74a3-4fef-9fd1-67d2ba725039 -p 172.16.0.220:3260 --interface default --op new {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:40:30 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e691257-74a3-4fef-9fd1-67d2ba725039 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:40:30 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[abe8a9cb-6281-49c2-89f1-5f26084c495f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6e691257-74a3-4fef-9fd1-67d2ba725039] added\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:40:30 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6e691257-74a3-4fef-9fd1-67d2ba725039] added
Nov 28 15:40:30 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:40:30 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e691257-74a3-4fef-9fd1-67d2ba725039 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:40:30 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e691257-74a3-4fef-9fd1-67d2ba725039 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:40:30 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[30271a53-5678-471b-a43a-24a1c58b4352]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:40:30 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:40:30 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e691257-74a3-4fef-9fd1-67d2ba725039 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:40:30 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e691257-74a3-4fef-9fd1-67d2ba725039 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:40:30 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[f984b12f-762f-4a4e-aa56-f291680e34d4]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:40:30 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:40:30 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e691257-74a3-4fef-9fd1-67d2ba725039 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sbWjatrv {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:40:30 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e691257-74a3-4fef-9fd1-67d2ba725039 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sbWjatrv" returned: 0 in 0.024s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:40:30 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[08ed1fa4-e57a-4fca-aab8-05207eb582d5]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:40:30 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sbWjatrv'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:40:30 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e691257-74a3-4fef-9fd1-67d2ba725039 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:40:30 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e691257-74a3-4fef-9fd1-67d2ba725039 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:40:30 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[d229f9ec-3a30-4d8a-902c-2125df28fd23]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:40:30 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:40:30 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:40:30 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:40:30 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[a600d4bb-c44c-49fa-bc5e-6e1dc541e853]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81326542-482f-4d50-895c-13c65fe4daf7 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76ea4d3b-7c77-47d0-b48b-ad79886d4f9a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27720cbf-c8ad-486b-845d-cdff5fbc4772 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:560d9b0e-d506-4723-8fc3-4068d690d5c8 (non-flash)\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:40:30 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9 (non-flash)
Nov 28 15:40:30 user nova-compute[75176]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81326542-482f-4d50-895c-13c65fe4daf7 (non-flash)
Nov 28 15:40:30 user nova-compute[75176]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76ea4d3b-7c77-47d0-b48b-ad79886d4f9a (non-flash)
Nov 28 15:40:30 user nova-compute[75176]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27720cbf-c8ad-486b-845d-cdff5fbc4772 (non-flash)
Nov 28 15:40:30 user nova-compute[75176]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:560d9b0e-d506-4723-8fc3-4068d690d5c8 (non-flash)
Nov 28 15:40:30 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:40:30 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9 (non-flash)
Nov 28 15:40:30 user nova-compute[75176]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81326542-482f-4d50-895c-13c65fe4daf7 (non-flash)
Nov 28 15:40:30 user nova-compute[75176]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76ea4d3b-7c77-47d0-b48b-ad79886d4f9a (non-flash)
Nov 28 15:40:30 user nova-compute[75176]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27720cbf-c8ad-486b-845d-cdff5fbc4772 (non-flash)
Nov 28 15:40:30 user nova-compute[75176]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:560d9b0e-d506-4723-8fc3-4068d690d5c8 (non-flash)
Nov 28 15:40:30 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 15:40:30 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e691257-74a3-4fef-9fd1-67d2ba725039 -p 172.16.0.220:3260 --login {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:40:30 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e691257-74a3-4fef-9fd1-67d2ba725039 -p 172.16.0.220:3260 --login" returned: 0 in 0.091s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:40:30 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3c6753c-185d-4b4c-b9c6-e864da8fabff]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6e691257-74a3-4fef-9fd1-67d2ba725039, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6e691257-74a3-4fef-9fd1-67d2ba725039, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:40:30 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6e691257-74a3-4fef-9fd1-67d2ba725039, portal: 172.16.0.220,3260]
Nov 28 15:40:30 user nova-compute[75176]: Login to [iface: default, target: iqn.2010-10.org.openstack:6e691257-74a3-4fef-9fd1-67d2ba725039, portal: 172.16.0.220,3260] successful.
Nov 28 15:40:30 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:40:30 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e691257-74a3-4fef-9fd1-67d2ba725039 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:40:30 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e691257-74a3-4fef-9fd1-67d2ba725039 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:40:30 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[3919ba5e-7419-4900-bfb4-918aef5edd5c]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:40:30 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:40:30 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:40:30 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:40:30 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d64eb75-7892-4e75-8010-d143e6902064]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81326542-482f-4d50-895c-13c65fe4daf7 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76ea4d3b-7c77-47d0-b48b-ad79886d4f9a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27720cbf-c8ad-486b-845d-cdff5fbc4772 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:560d9b0e-d506-4723-8fc3-4068d690d5c8 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e691257-74a3-4fef-9fd1-67d2ba725039 (non-flash)\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:40:30 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9 (non-flash)
Nov 28 15:40:30 user nova-compute[75176]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81326542-482f-4d50-895c-13c65fe4daf7 (non-flash)
Nov 28 15:40:30 user nova-compute[75176]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76ea4d3b-7c77-47d0-b48b-ad79886d4f9a (non-flash)
Nov 28 15:40:30 user nova-compute[75176]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27720cbf-c8ad-486b-845d-cdff5fbc4772 (non-flash)
Nov 28 15:40:30 user nova-compute[75176]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:560d9b0e-d506-4723-8fc3-4068d690d5c8 (non-flash)
Nov 28 15:40:30 user nova-compute[75176]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e691257-74a3-4fef-9fd1-67d2ba725039 (non-flash)
Nov 28 15:40:30 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:40:30 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9 (non-flash)
Nov 28 15:40:30 user nova-compute[75176]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81326542-482f-4d50-895c-13c65fe4daf7 (non-flash)
Nov 28 15:40:30 user nova-compute[75176]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76ea4d3b-7c77-47d0-b48b-ad79886d4f9a (non-flash)
Nov 28 15:40:30 user nova-compute[75176]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27720cbf-c8ad-486b-845d-cdff5fbc4772 (non-flash)
Nov 28 15:40:30 user nova-compute[75176]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:560d9b0e-d506-4723-8fc3-4068d690d5c8 (non-flash)
Nov 28 15:40:30 user nova-compute[75176]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e691257-74a3-4fef-9fd1-67d2ba725039 (non-flash)
Nov 28 15:40:30 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 15:40:30 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6e691257-74a3-4fef-9fd1-67d2ba725039" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.335s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 15:40:30 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Connected to 172.16.0.220:3260 {{(pid=75176) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 15:40:30 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] HCTL ('38', '-', '-', 0) found on session 7 with lun 0 {{(pid=75176) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 15:40:30 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75176) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 15:40:30 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:40:30 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.017s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:40:30 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[3818a43b-5ec6-4b36-b880-a694a764cf64]: (4, ('- - 0', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:40:30 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Searching for a device in session 7 and hctl ['38', '*', '*', 0] yield: None {{(pid=75176) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 15:40:31 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Searching for a device in session 7 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75176) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 15:40:31 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:6e691257-74a3-4fef-9fd1-67d2ba725039', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sbWjatrv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75176) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 15:40:31 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.367s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 15:40:31 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] <== connect_volume: return (2654ms) {'type': 'block', 'scsi_wwn': '23430343736633233', 'path': '/dev/sdg'} {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 15:40:31 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23430343736633233', 'path': '/dev/sdg'} {{(pid=75176) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 15:40:31 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.343s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 15:40:31 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 15:40:31 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:763d605d-247d-4484-b7ec-762e36b92abc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 15:40:31 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:763d605d-247d-4484-b7ec-762e36b92abc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 15:40:31 user nova-compute[75176]: INFO os_brick.initiator.connectors.iscsi [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 15:40:31 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:763d605d-247d-4484-b7ec-762e36b92abc -p 172.16.0.220:3260 {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:40:31 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:763d605d-247d-4484-b7ec-762e36b92abc -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:40:31 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[feed828c-07a5-4349-9973-c37734ab925c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:40:31 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 15:40:31 user nova-compute[75176]:  {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:40:31 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T15:39:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1424070534',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1424070534',id=10,image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPn83B68ew19zNqtC6OrMzgf/bmXCz98qa+rH054zqhA5Gi3ZDmOGiOHPgSu1hkI/yV1KZdhZIiHhrJ1wuOhC1X2w3dTgpgbLguVyd7FUfhz3bRrtdjXABRlYuvBuQRV2A==',key_name='tempest-keypair-1772665281',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cfdec2abaf704a1396611ff1bcb96e53',ramdisk_id='',reservation_id='r-0j1w7c0x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1260942437',owner_user_name='tempest-TaggedBootDevicesTest_v242-1260942437-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T15:40:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='97e02c028b814c6993edba6c1caa8afe',uuid=041af768-197b-4c76-a5a1-28e2dc8255bd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "99a8dbf9-5502-440a-a03d-cd52337b3009", "address": "fa:16:3e:e2:26:17", "network": {"id": "9fe0d7b7-e9dc-4e03-a401-452fd502c940", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1675540815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfdec2abaf704a1396611ff1bcb96e53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99a8dbf9-55", "ovs_interfaceid": "99a8dbf9-5502-440a-a03d-cd52337b3009", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75176) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 15:40:31 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Converting VIF {"id": "99a8dbf9-5502-440a-a03d-cd52337b3009", "address": "fa:16:3e:e2:26:17", "network": {"id": "9fe0d7b7-e9dc-4e03-a401-452fd502c940", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1675540815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfdec2abaf704a1396611ff1bcb96e53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99a8dbf9-55", "ovs_interfaceid": "99a8dbf9-5502-440a-a03d-cd52337b3009", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:40:31 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:26:17,bridge_name='br-int',has_traffic_filtering=True,id=99a8dbf9-5502-440a-a03d-cd52337b3009,network=Network(9fe0d7b7-e9dc-4e03-a401-452fd502c940),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99a8dbf9-55') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:40:31 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T15:39:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1424070534',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1424070534',id=10,image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPn83B68ew19zNqtC6OrMzgf/bmXCz98qa+rH054zqhA5Gi3ZDmOGiOHPgSu1hkI/yV1KZdhZIiHhrJ1wuOhC1X2w3dTgpgbLguVyd7FUfhz3bRrtdjXABRlYuvBuQRV2A==',key_name='tempest-keypair-1772665281',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cfdec2abaf704a1396611ff1bcb96e53',ramdisk_id='',reservation_id='r-0j1w7c0x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1260942437',owner_user_name='tempest-TaggedBootDevicesTest_v242-1260942437-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T15:40:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='97e02c028b814c6993edba6c1caa8afe',uuid=041af768-197b-4c76-a5a1-28e2dc8255bd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6c94b138-6202-4fb7-92c7-b3744cd8d19d", "address": "fa:16:3e:09:2f:ed", "network": {"id": "d7dbc9c3-816f-46fb-a3d3-e0e817e15de3", "bridge": "br-int", "label": "tempest-device-tagging-net1-136440967", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfdec2abaf704a1396611ff1bcb96e53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c94b138-62", "ovs_interfaceid": "6c94b138-6202-4fb7-92c7-b3744cd8d19d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75176) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 15:40:31 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Converting VIF {"id": "6c94b138-6202-4fb7-92c7-b3744cd8d19d", "address": "fa:16:3e:09:2f:ed", "network": {"id": "d7dbc9c3-816f-46fb-a3d3-e0e817e15de3", "bridge": "br-int", "label": "tempest-device-tagging-net1-136440967", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfdec2abaf704a1396611ff1bcb96e53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c94b138-62", "ovs_interfaceid": "6c94b138-6202-4fb7-92c7-b3744cd8d19d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:40:31 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:2f:ed,bridge_name='br-int',has_traffic_filtering=True,id=6c94b138-6202-4fb7-92c7-b3744cd8d19d,network=Network(d7dbc9c3-816f-46fb-a3d3-e0e817e15de3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6c94b138-62') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:40:31 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T15:39:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1424070534',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1424070534',id=10,image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPn83B68ew19zNqtC6OrMzgf/bmXCz98qa+rH054zqhA5Gi3ZDmOGiOHPgSu1hkI/yV1KZdhZIiHhrJ1wuOhC1X2w3dTgpgbLguVyd7FUfhz3bRrtdjXABRlYuvBuQRV2A==',key_name='tempest-keypair-1772665281',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cfdec2abaf704a1396611ff1bcb96e53',ramdisk_id='',reservation_id='r-0j1w7c0x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1260942437',owner_user_name='tempest-TaggedBootDevicesTest_v242-1260942437-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T15:40:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='97e02c028b814c6993edba6c1caa8afe',uuid=041af768-197b-4c76-a5a1-28e2dc8255bd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0ac967e7-41bc-4751-a2bc-499ffbface15", "address": "fa:16:3e:ce:ed:17", "network": {"id": "d7dbc9c3-816f-46fb-a3d3-e0e817e15de3", "bridge": "br-int", "label": "tempest-device-tagging-net1-136440967", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.48", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfdec2abaf704a1396611ff1bcb96e53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ac967e7-41", "ovs_interfaceid": "0ac967e7-41bc-4751-a2bc-499ffbface15", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75176) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 15:40:31 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Converting VIF {"id": "0ac967e7-41bc-4751-a2bc-499ffbface15", "address": "fa:16:3e:ce:ed:17", "network": {"id": "d7dbc9c3-816f-46fb-a3d3-e0e817e15de3", "bridge": "br-int", "label": "tempest-device-tagging-net1-136440967", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.48", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfdec2abaf704a1396611ff1bcb96e53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ac967e7-41", "ovs_interfaceid": "0ac967e7-41bc-4751-a2bc-499ffbface15", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:40:31 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:ed:17,bridge_name='br-int',has_traffic_filtering=True,id=0ac967e7-41bc-4751-a2bc-499ffbface15,network=Network(d7dbc9c3-816f-46fb-a3d3-e0e817e15de3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0ac967e7-41') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:40:31 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T15:39:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1424070534',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1424070534',id=10,image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPn83B68ew19zNqtC6OrMzgf/bmXCz98qa+rH054zqhA5Gi3ZDmOGiOHPgSu1hkI/yV1KZdhZIiHhrJ1wuOhC1X2w3dTgpgbLguVyd7FUfhz3bRrtdjXABRlYuvBuQRV2A==',key_name='tempest-keypair-1772665281',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cfdec2abaf704a1396611ff1bcb96e53',ramdisk_id='',reservation_id='r-0j1w7c0x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1260942437',owner_user_name='tempest-TaggedBootDevicesTest_v242-1260942437-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T15:40:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='97e02c028b814c6993edba6c1caa8afe',uuid=041af768-197b-4c76-a5a1-28e2dc8255bd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3a800e7a-5628-4668-ae3e-d49b537f7a62", "address": "fa:16:3e:e0:28:72", "network": {"id": "d7dbc9c3-816f-46fb-a3d3-e0e817e15de3", "bridge": "br-int", "label": "tempest-device-tagging-net1-136440967", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.25", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfdec2abaf704a1396611ff1bcb96e53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a800e7a-56", "ovs_interfaceid": "3a800e7a-5628-4668-ae3e-d49b537f7a62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75176) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 15:40:31 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Converting VIF {"id": "3a800e7a-5628-4668-ae3e-d49b537f7a62", "address": "fa:16:3e:e0:28:72", "network": {"id": "d7dbc9c3-816f-46fb-a3d3-e0e817e15de3", "bridge": "br-int", "label": "tempest-device-tagging-net1-136440967", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.25", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfdec2abaf704a1396611ff1bcb96e53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a800e7a-56", "ovs_interfaceid": "3a800e7a-5628-4668-ae3e-d49b537f7a62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:40:31 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:28:72,bridge_name='br-int',has_traffic_filtering=True,id=3a800e7a-5628-4668-ae3e-d49b537f7a62,network=Network(d7dbc9c3-816f-46fb-a3d3-e0e817e15de3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a800e7a-56') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:40:31 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T15:39:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1424070534',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1424070534',id=10,image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPn83B68ew19zNqtC6OrMzgf/bmXCz98qa+rH054zqhA5Gi3ZDmOGiOHPgSu1hkI/yV1KZdhZIiHhrJ1wuOhC1X2w3dTgpgbLguVyd7FUfhz3bRrtdjXABRlYuvBuQRV2A==',key_name='tempest-keypair-1772665281',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cfdec2abaf704a1396611ff1bcb96e53',ramdisk_id='',reservation_id='r-0j1w7c0x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1260942437',owner_user_name='tempest-TaggedBootDevicesTest_v242-1260942437-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T15:40:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='97e02c028b814c6993edba6c1caa8afe',uuid=041af768-197b-4c76-a5a1-28e2dc8255bd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d9a60043-45d0-46f1-8d0f-ad1c7b55fa06", "address": "fa:16:3e:5c:fb:31", "network": {"id": "d7dbc9c3-816f-46fb-a3d3-e0e817e15de3", "bridge": "br-int", "label": "tempest-device-tagging-net1-136440967", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.54", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfdec2abaf704a1396611ff1bcb96e53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9a60043-45", "ovs_interfaceid": "d9a60043-45d0-46f1-8d0f-ad1c7b55fa06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75176) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 15:40:31 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Converting VIF {"id": "d9a60043-45d0-46f1-8d0f-ad1c7b55fa06", "address": "fa:16:3e:5c:fb:31", "network": {"id": "d7dbc9c3-816f-46fb-a3d3-e0e817e15de3", "bridge": "br-int", "label": "tempest-device-tagging-net1-136440967", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.54", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfdec2abaf704a1396611ff1bcb96e53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9a60043-45", "ovs_interfaceid": "d9a60043-45d0-46f1-8d0f-ad1c7b55fa06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:40:31 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:fb:31,bridge_name='br-int',has_traffic_filtering=True,id=d9a60043-45d0-46f1-8d0f-ad1c7b55fa06,network=Network(d7dbc9c3-816f-46fb-a3d3-e0e817e15de3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9a60043-45') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:40:31 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T15:39:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1424070534',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1424070534',id=10,image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPn83B68ew19zNqtC6OrMzgf/bmXCz98qa+rH054zqhA5Gi3ZDmOGiOHPgSu1hkI/yV1KZdhZIiHhrJ1wuOhC1X2w3dTgpgbLguVyd7FUfhz3bRrtdjXABRlYuvBuQRV2A==',key_name='tempest-keypair-1772665281',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cfdec2abaf704a1396611ff1bcb96e53',ramdisk_id='',reservation_id='r-0j1w7c0x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1260942437',owner_user_name='tempest-TaggedBootDevicesTest_v242-1260942437-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T15:40:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='97e02c028b814c6993edba6c1caa8afe',uuid=041af768-197b-4c76-a5a1-28e2dc8255bd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0c65b96a-0fce-4bff-b89c-443cc48f6995", "address": "fa:16:3e:c4:dc:af", "network": {"id": "6a9822be-add5-4d71-8ef1-1ce105eed6af", "bridge": "br-int", "label": "tempest-device-tagging-net2-401277966", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cfdec2abaf704a1396611ff1bcb96e53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c65b96a-0f", "ovs_interfaceid": "0c65b96a-0fce-4bff-b89c-443cc48f6995", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75176) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 15:40:31 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Converting VIF {"id": "0c65b96a-0fce-4bff-b89c-443cc48f6995", "address": "fa:16:3e:c4:dc:af", "network": {"id": "6a9822be-add5-4d71-8ef1-1ce105eed6af", "bridge": "br-int", "label": "tempest-device-tagging-net2-401277966", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cfdec2abaf704a1396611ff1bcb96e53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c65b96a-0f", "ovs_interfaceid": "0c65b96a-0fce-4bff-b89c-443cc48f6995", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:40:31 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:dc:af,bridge_name='br-int',has_traffic_filtering=True,id=0c65b96a-0fce-4bff-b89c-443cc48f6995,network=Network(6a9822be-add5-4d71-8ef1-1ce105eed6af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c65b96a-0f') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:40:31 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T15:39:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1424070534',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1424070534',id=10,image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPn83B68ew19zNqtC6OrMzgf/bmXCz98qa+rH054zqhA5Gi3ZDmOGiOHPgSu1hkI/yV1KZdhZIiHhrJ1wuOhC1X2w3dTgpgbLguVyd7FUfhz3bRrtdjXABRlYuvBuQRV2A==',key_name='tempest-keypair-1772665281',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cfdec2abaf704a1396611ff1bcb96e53',ramdisk_id='',reservation_id='r-0j1w7c0x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1260942437',owner_user_name='tempest-TaggedBootDevicesTest_v242-1260942437-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T15:40:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='97e02c028b814c6993edba6c1caa8afe',uuid=041af768-197b-4c76-a5a1-28e2dc8255bd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2df03152-b1aa-4794-965d-64886ac889ea", "address": "fa:16:3e:7a:2f:2c", "network": {"id": "6a9822be-add5-4d71-8ef1-1ce105eed6af", "bridge": "br-int", "label": "tempest-device-tagging-net2-401277966", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cfdec2abaf704a1396611ff1bcb96e53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2df03152-b1", "ovs_interfaceid": "2df03152-b1aa-4794-965d-64886ac889ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75176) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 15:40:31 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Converting VIF {"id": "2df03152-b1aa-4794-965d-64886ac889ea", "address": "fa:16:3e:7a:2f:2c", "network": {"id": "6a9822be-add5-4d71-8ef1-1ce105eed6af", "bridge": "br-int", "label": "tempest-device-tagging-net2-401277966", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cfdec2abaf704a1396611ff1bcb96e53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2df03152-b1", "ovs_interfaceid": "2df03152-b1aa-4794-965d-64886ac889ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:40:31 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:2f:2c,bridge_name='br-int',has_traffic_filtering=True,id=2df03152-b1aa-4794-965d-64886ac889ea,network=Network(6a9822be-add5-4d71-8ef1-1ce105eed6af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2df03152-b1') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:40:31 user nova-compute[75176]: DEBUG nova.objects.instance [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Lazy-loading 'pci_devices' on Instance uuid 041af768-197b-4c76-a5a1-28e2dc8255bd {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:40:31 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:763d605d-247d-4484-b7ec-762e36b92abc -p 172.16.0.220:3260 --interface default --op new {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:40:31 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:763d605d-247d-4484-b7ec-762e36b92abc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:40:31 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4912dad-3244-4d7f-a3d0-fc0a5ac16d9a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:763d605d-247d-4484-b7ec-762e36b92abc] added\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:40:31 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:763d605d-247d-4484-b7ec-762e36b92abc] added
Nov 28 15:40:31 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:40:31 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:763d605d-247d-4484-b7ec-762e36b92abc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:40:31 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] End _get_guest_xml xml=<domain type="kvm">
Nov 28 15:40:31 user nova-compute[75176]:   <uuid>041af768-197b-4c76-a5a1-28e2dc8255bd</uuid>
Nov 28 15:40:31 user nova-compute[75176]:   <name>instance-0000000a</name>
Nov 28 15:40:31 user nova-compute[75176]:   <memory>524288</memory>
Nov 28 15:40:31 user nova-compute[75176]:   <vcpu>1</vcpu>
Nov 28 15:40:31 user nova-compute[75176]:   <metadata>
Nov 28 15:40:31 user nova-compute[75176]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 15:40:31 user nova-compute[75176]:       <nova:package version="0.0.0"/>
Nov 28 15:40:31 user nova-compute[75176]:       <nova:name>tempest-device-tagging-server-1424070534</nova:name>
Nov 28 15:40:31 user nova-compute[75176]:       <nova:creationTime>2023-11-28 15:40:24</nova:creationTime>
Nov 28 15:40:31 user nova-compute[75176]:       <nova:flavor name="m1.tiny">
Nov 28 15:40:31 user nova-compute[75176]:         <nova:memory>512</nova:memory>
Nov 28 15:40:31 user nova-compute[75176]:         <nova:disk>1</nova:disk>
Nov 28 15:40:31 user nova-compute[75176]:         <nova:swap>0</nova:swap>
Nov 28 15:40:31 user nova-compute[75176]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 15:40:31 user nova-compute[75176]:         <nova:vcpus>1</nova:vcpus>
Nov 28 15:40:31 user nova-compute[75176]:       </nova:flavor>
Nov 28 15:40:31 user nova-compute[75176]:       <nova:owner>
Nov 28 15:40:31 user nova-compute[75176]:         <nova:user uuid="97e02c028b814c6993edba6c1caa8afe">tempest-TaggedBootDevicesTest_v242-1260942437-project-member</nova:user>
Nov 28 15:40:31 user nova-compute[75176]:         <nova:project uuid="cfdec2abaf704a1396611ff1bcb96e53">tempest-TaggedBootDevicesTest_v242-1260942437</nova:project>
Nov 28 15:40:31 user nova-compute[75176]:       </nova:owner>
Nov 28 15:40:31 user nova-compute[75176]:       <nova:root type="image" uuid="1f41819e-c93f-4dc7-b253-37a27bbbbc74"/>
Nov 28 15:40:31 user nova-compute[75176]:       <nova:ports>
Nov 28 15:40:31 user nova-compute[75176]:         <nova:port uuid="99a8dbf9-5502-440a-a03d-cd52337b3009">
Nov 28 15:40:31 user nova-compute[75176]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 28 15:40:31 user nova-compute[75176]:         </nova:port>
Nov 28 15:40:31 user nova-compute[75176]:         <nova:port uuid="6c94b138-6202-4fb7-92c7-b3744cd8d19d">
Nov 28 15:40:31 user nova-compute[75176]:           <nova:ip type="fixed" address="10.1.1.135" ipVersion="4"/>
Nov 28 15:40:31 user nova-compute[75176]:         </nova:port>
Nov 28 15:40:31 user nova-compute[75176]:         <nova:port uuid="0ac967e7-41bc-4751-a2bc-499ffbface15">
Nov 28 15:40:31 user nova-compute[75176]:           <nova:ip type="fixed" address="10.1.1.48" ipVersion="4"/>
Nov 28 15:40:31 user nova-compute[75176]:         </nova:port>
Nov 28 15:40:31 user nova-compute[75176]:         <nova:port uuid="3a800e7a-5628-4668-ae3e-d49b537f7a62">
Nov 28 15:40:31 user nova-compute[75176]:           <nova:ip type="fixed" address="10.1.1.25" ipVersion="4"/>
Nov 28 15:40:31 user nova-compute[75176]:         </nova:port>
Nov 28 15:40:31 user nova-compute[75176]:         <nova:port uuid="d9a60043-45d0-46f1-8d0f-ad1c7b55fa06">
Nov 28 15:40:31 user nova-compute[75176]:           <nova:ip type="fixed" address="10.1.1.54" ipVersion="4"/>
Nov 28 15:40:31 user nova-compute[75176]:         </nova:port>
Nov 28 15:40:31 user nova-compute[75176]:         <nova:port uuid="0c65b96a-0fce-4bff-b89c-443cc48f6995">
Nov 28 15:40:31 user nova-compute[75176]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 28 15:40:31 user nova-compute[75176]:         </nova:port>
Nov 28 15:40:31 user nova-compute[75176]:         <nova:port uuid="2df03152-b1aa-4794-965d-64886ac889ea">
Nov 28 15:40:31 user nova-compute[75176]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 28 15:40:31 user nova-compute[75176]:         </nova:port>
Nov 28 15:40:31 user nova-compute[75176]:       </nova:ports>
Nov 28 15:40:31 user nova-compute[75176]:     </nova:instance>
Nov 28 15:40:31 user nova-compute[75176]:   </metadata>
Nov 28 15:40:31 user nova-compute[75176]:   <sysinfo type="smbios">
Nov 28 15:40:31 user nova-compute[75176]:     <system>
Nov 28 15:40:31 user nova-compute[75176]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 15:40:31 user nova-compute[75176]:       <entry name="product">OpenStack Nova</entry>
Nov 28 15:40:31 user nova-compute[75176]:       <entry name="version">0.0.0</entry>
Nov 28 15:40:31 user nova-compute[75176]:       <entry name="serial">041af768-197b-4c76-a5a1-28e2dc8255bd</entry>
Nov 28 15:40:31 user nova-compute[75176]:       <entry name="uuid">041af768-197b-4c76-a5a1-28e2dc8255bd</entry>
Nov 28 15:40:31 user nova-compute[75176]:       <entry name="family">Virtual Machine</entry>
Nov 28 15:40:31 user nova-compute[75176]:     </system>
Nov 28 15:40:31 user nova-compute[75176]:   </sysinfo>
Nov 28 15:40:31 user nova-compute[75176]:   <os>
Nov 28 15:40:31 user nova-compute[75176]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 15:40:31 user nova-compute[75176]:     <boot dev="hd"/>
Nov 28 15:40:31 user nova-compute[75176]:     <smbios mode="sysinfo"/>
Nov 28 15:40:31 user nova-compute[75176]:   </os>
Nov 28 15:40:31 user nova-compute[75176]:   <features>
Nov 28 15:40:31 user nova-compute[75176]:     <acpi/>
Nov 28 15:40:31 user nova-compute[75176]:     <apic/>
Nov 28 15:40:31 user nova-compute[75176]:     <vmcoreinfo/>
Nov 28 15:40:31 user nova-compute[75176]:   </features>
Nov 28 15:40:31 user nova-compute[75176]:   <clock offset="utc">
Nov 28 15:40:31 user nova-compute[75176]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 15:40:31 user nova-compute[75176]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 15:40:31 user nova-compute[75176]:     <timer name="hpet" present="no"/>
Nov 28 15:40:31 user nova-compute[75176]:   </clock>
Nov 28 15:40:31 user nova-compute[75176]:   <cpu mode="custom" match="exact">
Nov 28 15:40:31 user nova-compute[75176]:     <model>Nehalem</model>
Nov 28 15:40:31 user nova-compute[75176]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 15:40:31 user nova-compute[75176]:   </cpu>
Nov 28 15:40:31 user nova-compute[75176]:   <devices>
Nov 28 15:40:31 user nova-compute[75176]:     <disk type="file" device="cdrom">
Nov 28 15:40:31 user nova-compute[75176]:       <driver name="qemu" type="raw" cache="none"/>
Nov 28 15:40:31 user nova-compute[75176]:       <source file="/opt/stack/data/nova/instances/041af768-197b-4c76-a5a1-28e2dc8255bd/disk.config"/>
Nov 28 15:40:31 user nova-compute[75176]:       <target dev="hda" bus="ide"/>
Nov 28 15:40:31 user nova-compute[75176]:     </disk>
Nov 28 15:40:31 user nova-compute[75176]:     <disk type="block" device="disk">
Nov 28 15:40:31 user nova-compute[75176]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 15:40:31 user nova-compute[75176]:       <source dev="/dev/sdc"/>
Nov 28 15:40:31 user nova-compute[75176]:       <target dev="vda" bus="virtio"/>
Nov 28 15:40:31 user nova-compute[75176]:       <serial>81326542-482f-4d50-895c-13c65fe4daf7</serial>
Nov 28 15:40:31 user nova-compute[75176]:     </disk>
Nov 28 15:40:31 user nova-compute[75176]:     <disk type="block" device="disk">
Nov 28 15:40:31 user nova-compute[75176]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 15:40:31 user nova-compute[75176]:       <source dev="/dev/sde"/>
Nov 28 15:40:31 user nova-compute[75176]:       <target dev="vdb" bus="virtio"/>
Nov 28 15:40:31 user nova-compute[75176]:       <serial>27720cbf-c8ad-486b-845d-cdff5fbc4772</serial>
Nov 28 15:40:31 user nova-compute[75176]:     </disk>
Nov 28 15:40:31 user nova-compute[75176]:     <disk type="block" device="disk">
Nov 28 15:40:31 user nova-compute[75176]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 15:40:31 user nova-compute[75176]:       <source dev="/dev/sdg"/>
Nov 28 15:40:31 user nova-compute[75176]:       <target dev="vdc" bus="virtio"/>
Nov 28 15:40:31 user nova-compute[75176]:       <serial>6e691257-74a3-4fef-9fd1-67d2ba725039</serial>
Nov 28 15:40:31 user nova-compute[75176]:     </disk>
Nov 28 15:40:31 user nova-compute[75176]:     <interface type="ethernet">
Nov 28 15:40:31 user nova-compute[75176]:       <mac address="fa:16:3e:e2:26:17"/>
Nov 28 15:40:31 user nova-compute[75176]:       <model type="virtio"/>
Nov 28 15:40:31 user nova-compute[75176]:       <mtu size="1442"/>
Nov 28 15:40:31 user nova-compute[75176]:       <target dev="tap99a8dbf9-55"/>
Nov 28 15:40:31 user nova-compute[75176]:     </interface>
Nov 28 15:40:31 user nova-compute[75176]:     <interface type="ethernet">
Nov 28 15:40:31 user nova-compute[75176]:       <mac address="fa:16:3e:09:2f:ed"/>
Nov 28 15:40:31 user nova-compute[75176]:       <model type="virtio"/>
Nov 28 15:40:31 user nova-compute[75176]:       <mtu size="1442"/>
Nov 28 15:40:31 user nova-compute[75176]:       <target dev="tap6c94b138-62"/>
Nov 28 15:40:31 user nova-compute[75176]:     </interface>
Nov 28 15:40:31 user nova-compute[75176]:     <interface type="ethernet">
Nov 28 15:40:31 user nova-compute[75176]:       <mac address="fa:16:3e:ce:ed:17"/>
Nov 28 15:40:31 user nova-compute[75176]:       <model type="virtio"/>
Nov 28 15:40:31 user nova-compute[75176]:       <mtu size="1442"/>
Nov 28 15:40:31 user nova-compute[75176]:       <target dev="tap0ac967e7-41"/>
Nov 28 15:40:31 user nova-compute[75176]:     </interface>
Nov 28 15:40:31 user nova-compute[75176]:     <interface type="ethernet">
Nov 28 15:40:31 user nova-compute[75176]:       <mac address="fa:16:3e:e0:28:72"/>
Nov 28 15:40:31 user nova-compute[75176]:       <model type="virtio"/>
Nov 28 15:40:31 user nova-compute[75176]:       <mtu size="1442"/>
Nov 28 15:40:31 user nova-compute[75176]:       <target dev="tap3a800e7a-56"/>
Nov 28 15:40:31 user nova-compute[75176]:     </interface>
Nov 28 15:40:31 user nova-compute[75176]:     <interface type="ethernet">
Nov 28 15:40:31 user nova-compute[75176]:       <mac address="fa:16:3e:5c:fb:31"/>
Nov 28 15:40:31 user nova-compute[75176]:       <model type="virtio"/>
Nov 28 15:40:31 user nova-compute[75176]:       <mtu size="1442"/>
Nov 28 15:40:31 user nova-compute[75176]:       <target dev="tapd9a60043-45"/>
Nov 28 15:40:31 user nova-compute[75176]:     </interface>
Nov 28 15:40:31 user nova-compute[75176]:     <interface type="ethernet">
Nov 28 15:40:31 user nova-compute[75176]:       <mac address="fa:16:3e:c4:dc:af"/>
Nov 28 15:40:31 user nova-compute[75176]:       <model type="virtio"/>
Nov 28 15:40:31 user nova-compute[75176]:       <mtu size="1442"/>
Nov 28 15:40:31 user nova-compute[75176]:       <target dev="tap0c65b96a-0f"/>
Nov 28 15:40:31 user nova-compute[75176]:     </interface>
Nov 28 15:40:31 user nova-compute[75176]:     <interface type="ethernet">
Nov 28 15:40:31 user nova-compute[75176]:       <mac address="fa:16:3e:7a:2f:2c"/>
Nov 28 15:40:31 user nova-compute[75176]:       <model type="virtio"/>
Nov 28 15:40:31 user nova-compute[75176]:       <mtu size="1442"/>
Nov 28 15:40:31 user nova-compute[75176]:       <target dev="tap2df03152-b1"/>
Nov 28 15:40:31 user nova-compute[75176]:     </interface>
Nov 28 15:40:31 user nova-compute[75176]:     <serial type="pty">
Nov 28 15:40:31 user nova-compute[75176]:       <log file="/opt/stack/data/nova/instances/041af768-197b-4c76-a5a1-28e2dc8255bd/console.log" append="off"/>
Nov 28 15:40:31 user nova-compute[75176]:     </serial>
Nov 28 15:40:31 user nova-compute[75176]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 15:40:31 user nova-compute[75176]:     <video>
Nov 28 15:40:31 user nova-compute[75176]:       <model type="virtio"/>
Nov 28 15:40:31 user nova-compute[75176]:     </video>
Nov 28 15:40:31 user nova-compute[75176]:     <rng model="virtio">
Nov 28 15:40:31 user nova-compute[75176]:       <backend model="random">/dev/urandom</backend>
Nov 28 15:40:31 user nova-compute[75176]:     </rng>
Nov 28 15:40:31 user nova-compute[75176]:     <controller type="usb" index="0" model="none"/>
Nov 28 15:40:31 user nova-compute[75176]:     <memballoon model="virtio">
Nov 28 15:40:31 user nova-compute[75176]:       <stats period="10"/>
Nov 28 15:40:31 user nova-compute[75176]:     </memballoon>
Nov 28 15:40:31 user nova-compute[75176]:   </devices>
Nov 28 15:40:31 user nova-compute[75176]: </domain>
Nov 28 15:40:31 user nova-compute[75176]:  {{(pid=75176) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 15:40:31 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T15:39:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1424070534',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1424070534',id=10,image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPn83B68ew19zNqtC6OrMzgf/bmXCz98qa+rH054zqhA5Gi3ZDmOGiOHPgSu1hkI/yV1KZdhZIiHhrJ1wuOhC1X2w3dTgpgbLguVyd7FUfhz3bRrtdjXABRlYuvBuQRV2A==',key_name='tempest-keypair-1772665281',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cfdec2abaf704a1396611ff1bcb96e53',ramdisk_id='',reservation_id='r-0j1w7c0x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1260942437',owner_user_name='tempest-TaggedBootDevicesTest_v242-1260942437-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T15:40:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='97e02c028b814c6993edba6c1caa8afe',uuid=041af768-197b-4c76-a5a1-28e2dc8255bd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "99a8dbf9-5502-440a-a03d-cd52337b3009", "address": "fa:16:3e:e2:26:17", "network": {"id": "9fe0d7b7-e9dc-4e03-a401-452fd502c940", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1675540815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfdec2abaf704a1396611ff1bcb96e53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99a8dbf9-55", "ovs_interfaceid": "99a8dbf9-5502-440a-a03d-cd52337b3009", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 15:40:31 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Converting VIF {"id": "99a8dbf9-5502-440a-a03d-cd52337b3009", "address": "fa:16:3e:e2:26:17", "network": {"id": "9fe0d7b7-e9dc-4e03-a401-452fd502c940", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1675540815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfdec2abaf704a1396611ff1bcb96e53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99a8dbf9-55", "ovs_interfaceid": "99a8dbf9-5502-440a-a03d-cd52337b3009", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:40:31 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:26:17,bridge_name='br-int',has_traffic_filtering=True,id=99a8dbf9-5502-440a-a03d-cd52337b3009,network=Network(9fe0d7b7-e9dc-4e03-a401-452fd502c940),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99a8dbf9-55') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:40:31 user nova-compute[75176]: DEBUG os_vif [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:26:17,bridge_name='br-int',has_traffic_filtering=True,id=99a8dbf9-5502-440a-a03d-cd52337b3009,network=Network(9fe0d7b7-e9dc-4e03-a401-452fd502c940),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99a8dbf9-55') {{(pid=75176) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 15:40:31 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:31 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:40:31 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 15:40:31 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:763d605d-247d-4484-b7ec-762e36b92abc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:40:31 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c5c196c-9a3a-4f91-ad13-893fcf8d60e8]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:40:31 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:31 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'aa6e2d56-f7fd-5d7b-8c1a-fc1b16dcbb8c', '_type': 'linux-noop'}}, row=False) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:40:31 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:40:31 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:31 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:763d605d-247d-4484-b7ec-762e36b92abc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:40:31 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:40:31 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:31 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap99a8dbf9-55, may_exist=True, interface_attrs={}) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:40:31 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap99a8dbf9-55, col_values=(('qos', UUID('c5582485-1c6c-433e-bf00-3fae13537192')),), if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:40:31 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap99a8dbf9-55, col_values=(('external_ids', {'iface-id': '99a8dbf9-5502-440a-a03d-cd52337b3009', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e2:26:17', 'vm-uuid': '041af768-197b-4c76-a5a1-28e2dc8255bd'}),), if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:40:31 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:31 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:40:31 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:763d605d-247d-4484-b7ec-762e36b92abc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:40:31 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc368c24-20e7-409e-a6bb-17059b57ed48]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:40:31 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:40:31 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:31 user nova-compute[75176]: INFO os_vif [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:26:17,bridge_name='br-int',has_traffic_filtering=True,id=99a8dbf9-5502-440a-a03d-cd52337b3009,network=Network(9fe0d7b7-e9dc-4e03-a401-452fd502c940),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99a8dbf9-55')
Nov 28 15:40:31 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T15:39:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1424070534',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1424070534',id=10,image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPn83B68ew19zNqtC6OrMzgf/bmXCz98qa+rH054zqhA5Gi3ZDmOGiOHPgSu1hkI/yV1KZdhZIiHhrJ1wuOhC1X2w3dTgpgbLguVyd7FUfhz3bRrtdjXABRlYuvBuQRV2A==',key_name='tempest-keypair-1772665281',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cfdec2abaf704a1396611ff1bcb96e53',ramdisk_id='',reservation_id='r-0j1w7c0x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1260942437',owner_user_name='tempest-TaggedBootDevicesTest_v242-1260942437-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T15:40:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='97e02c028b814c6993edba6c1caa8afe',uuid=041af768-197b-4c76-a5a1-28e2dc8255bd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6c94b138-6202-4fb7-92c7-b3744cd8d19d", "address": "fa:16:3e:09:2f:ed", "network": {"id": "d7dbc9c3-816f-46fb-a3d3-e0e817e15de3", "bridge": "br-int", "label": "tempest-device-tagging-net1-136440967", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfdec2abaf704a1396611ff1bcb96e53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c94b138-62", "ovs_interfaceid": "6c94b138-6202-4fb7-92c7-b3744cd8d19d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75176) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 15:40:31 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Converting VIF {"id": "6c94b138-6202-4fb7-92c7-b3744cd8d19d", "address": "fa:16:3e:09:2f:ed", "network": {"id": "d7dbc9c3-816f-46fb-a3d3-e0e817e15de3", "bridge": "br-int", "label": "tempest-device-tagging-net1-136440967", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfdec2abaf704a1396611ff1bcb96e53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c94b138-62", "ovs_interfaceid": "6c94b138-6202-4fb7-92c7-b3744cd8d19d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:40:31 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:2f:ed,bridge_name='br-int',has_traffic_filtering=True,id=6c94b138-6202-4fb7-92c7-b3744cd8d19d,network=Network(d7dbc9c3-816f-46fb-a3d3-e0e817e15de3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6c94b138-62') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:40:31 user nova-compute[75176]: DEBUG os_vif [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:2f:ed,bridge_name='br-int',has_traffic_filtering=True,id=6c94b138-6202-4fb7-92c7-b3744cd8d19d,network=Network(d7dbc9c3-816f-46fb-a3d3-e0e817e15de3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6c94b138-62') {{(pid=75176) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 15:40:31 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:763d605d-247d-4484-b7ec-762e36b92abc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wHMBuZWL {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:40:31 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:31 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:40:31 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 15:40:31 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:31 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd41ae562-f8e5-5250-8c54-56b5817dfc71', '_type': 'linux-noop'}}, row=False) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:40:31 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:31 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:40:31 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:763d605d-247d-4484-b7ec-762e36b92abc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wHMBuZWL" returned: 0 in 0.018s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:40:31 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b3d5b3f-adea-4122-bcf5-9acaa3dabedb]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:40:31 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wHMBuZWL'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:40:31 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:763d605d-247d-4484-b7ec-762e36b92abc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:40:31 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:31 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:31 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6c94b138-62, may_exist=True, interface_attrs={}) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:40:31 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6c94b138-62, col_values=(('qos', UUID('5f109779-e775-440b-8f0a-db5cf7d03d31')),), if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:40:31 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6c94b138-62, col_values=(('external_ids', {'iface-id': '6c94b138-6202-4fb7-92c7-b3744cd8d19d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:09:2f:ed', 'vm-uuid': '041af768-197b-4c76-a5a1-28e2dc8255bd'}),), if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:40:31 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:31 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:40:31 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:763d605d-247d-4484-b7ec-762e36b92abc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:40:31 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d5024ee-64fd-4615-8c11-01d093d10bf1]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:40:31 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:40:31 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:40:31 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:31 user nova-compute[75176]: INFO os_vif [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:2f:ed,bridge_name='br-int',has_traffic_filtering=True,id=6c94b138-6202-4fb7-92c7-b3744cd8d19d,network=Network(d7dbc9c3-816f-46fb-a3d3-e0e817e15de3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6c94b138-62')
Nov 28 15:40:31 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T15:39:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1424070534',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1424070534',id=10,image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPn83B68ew19zNqtC6OrMzgf/bmXCz98qa+rH054zqhA5Gi3ZDmOGiOHPgSu1hkI/yV1KZdhZIiHhrJ1wuOhC1X2w3dTgpgbLguVyd7FUfhz3bRrtdjXABRlYuvBuQRV2A==',key_name='tempest-keypair-1772665281',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cfdec2abaf704a1396611ff1bcb96e53',ramdisk_id='',reservation_id='r-0j1w7c0x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1260942437',owner_user_name='tempest-TaggedBootDevicesTest_v242-1260942437-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T15:40:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='97e02c028b814c6993edba6c1caa8afe',uuid=041af768-197b-4c76-a5a1-28e2dc8255bd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0ac967e7-41bc-4751-a2bc-499ffbface15", "address": "fa:16:3e:ce:ed:17", "network": {"id": "d7dbc9c3-816f-46fb-a3d3-e0e817e15de3", "bridge": "br-int", "label": "tempest-device-tagging-net1-136440967", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.48", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfdec2abaf704a1396611ff1bcb96e53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ac967e7-41", "ovs_interfaceid": "0ac967e7-41bc-4751-a2bc-499ffbface15", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75176) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 15:40:31 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Converting VIF {"id": "0ac967e7-41bc-4751-a2bc-499ffbface15", "address": "fa:16:3e:ce:ed:17", "network": {"id": "d7dbc9c3-816f-46fb-a3d3-e0e817e15de3", "bridge": "br-int", "label": "tempest-device-tagging-net1-136440967", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.48", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfdec2abaf704a1396611ff1bcb96e53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ac967e7-41", "ovs_interfaceid": "0ac967e7-41bc-4751-a2bc-499ffbface15", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:40:31 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:ed:17,bridge_name='br-int',has_traffic_filtering=True,id=0ac967e7-41bc-4751-a2bc-499ffbface15,network=Network(d7dbc9c3-816f-46fb-a3d3-e0e817e15de3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0ac967e7-41') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:40:31 user nova-compute[75176]: DEBUG os_vif [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:ed:17,bridge_name='br-int',has_traffic_filtering=True,id=0ac967e7-41bc-4751-a2bc-499ffbface15,network=Network(d7dbc9c3-816f-46fb-a3d3-e0e817e15de3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0ac967e7-41') {{(pid=75176) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 15:40:31 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:31 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:40:31 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 15:40:31 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:31 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6eafe688-8db4-5941-87d5-6abb751a8ee2', '_type': 'linux-noop'}}, row=False) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:40:31 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:31 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:40:31 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:40:31 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2c15443-10c4-4e93-b7a7-3158afb12d2c]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81326542-482f-4d50-895c-13c65fe4daf7 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76ea4d3b-7c77-47d0-b48b-ad79886d4f9a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27720cbf-c8ad-486b-845d-cdff5fbc4772 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:560d9b0e-d506-4723-8fc3-4068d690d5c8 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e691257-74a3-4fef-9fd1-67d2ba725039 (non-flash)\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:40:31 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9 (non-flash)
Nov 28 15:40:31 user nova-compute[75176]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81326542-482f-4d50-895c-13c65fe4daf7 (non-flash)
Nov 28 15:40:31 user nova-compute[75176]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76ea4d3b-7c77-47d0-b48b-ad79886d4f9a (non-flash)
Nov 28 15:40:31 user nova-compute[75176]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27720cbf-c8ad-486b-845d-cdff5fbc4772 (non-flash)
Nov 28 15:40:31 user nova-compute[75176]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:560d9b0e-d506-4723-8fc3-4068d690d5c8 (non-flash)
Nov 28 15:40:31 user nova-compute[75176]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e691257-74a3-4fef-9fd1-67d2ba725039 (non-flash)
Nov 28 15:40:31 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:40:31 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9 (non-flash)
Nov 28 15:40:31 user nova-compute[75176]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81326542-482f-4d50-895c-13c65fe4daf7 (non-flash)
Nov 28 15:40:31 user nova-compute[75176]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76ea4d3b-7c77-47d0-b48b-ad79886d4f9a (non-flash)
Nov 28 15:40:31 user nova-compute[75176]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27720cbf-c8ad-486b-845d-cdff5fbc4772 (non-flash)
Nov 28 15:40:31 user nova-compute[75176]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:560d9b0e-d506-4723-8fc3-4068d690d5c8 (non-flash)
Nov 28 15:40:31 user nova-compute[75176]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e691257-74a3-4fef-9fd1-67d2ba725039 (non-flash)
Nov 28 15:40:31 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 15:40:31 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:763d605d-247d-4484-b7ec-762e36b92abc -p 172.16.0.220:3260 --login {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:40:31 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:31 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:31 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0ac967e7-41, may_exist=True, interface_attrs={}) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:40:31 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0ac967e7-41, col_values=(('qos', UUID('bdb47afe-3693-4beb-9be2-b14a02a62e5f')),), if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:40:31 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0ac967e7-41, col_values=(('external_ids', {'iface-id': '0ac967e7-41bc-4751-a2bc-499ffbface15', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ce:ed:17', 'vm-uuid': '041af768-197b-4c76-a5a1-28e2dc8255bd'}),), if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:40:31 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:31 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:40:31 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:31 user nova-compute[75176]: INFO os_vif [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:ed:17,bridge_name='br-int',has_traffic_filtering=True,id=0ac967e7-41bc-4751-a2bc-499ffbface15,network=Network(d7dbc9c3-816f-46fb-a3d3-e0e817e15de3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0ac967e7-41')
Nov 28 15:40:31 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T15:39:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1424070534',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1424070534',id=10,image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPn83B68ew19zNqtC6OrMzgf/bmXCz98qa+rH054zqhA5Gi3ZDmOGiOHPgSu1hkI/yV1KZdhZIiHhrJ1wuOhC1X2w3dTgpgbLguVyd7FUfhz3bRrtdjXABRlYuvBuQRV2A==',key_name='tempest-keypair-1772665281',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cfdec2abaf704a1396611ff1bcb96e53',ramdisk_id='',reservation_id='r-0j1w7c0x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1260942437',owner_user_name='tempest-TaggedBootDevicesTest_v242-1260942437-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T15:40:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='97e02c028b814c6993edba6c1caa8afe',uuid=041af768-197b-4c76-a5a1-28e2dc8255bd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3a800e7a-5628-4668-ae3e-d49b537f7a62", "address": "fa:16:3e:e0:28:72", "network": {"id": "d7dbc9c3-816f-46fb-a3d3-e0e817e15de3", "bridge": "br-int", "label": "tempest-device-tagging-net1-136440967", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.25", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfdec2abaf704a1396611ff1bcb96e53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a800e7a-56", "ovs_interfaceid": "3a800e7a-5628-4668-ae3e-d49b537f7a62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 15:40:31 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Converting VIF {"id": "3a800e7a-5628-4668-ae3e-d49b537f7a62", "address": "fa:16:3e:e0:28:72", "network": {"id": "d7dbc9c3-816f-46fb-a3d3-e0e817e15de3", "bridge": "br-int", "label": "tempest-device-tagging-net1-136440967", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.25", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfdec2abaf704a1396611ff1bcb96e53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a800e7a-56", "ovs_interfaceid": "3a800e7a-5628-4668-ae3e-d49b537f7a62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:40:31 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:28:72,bridge_name='br-int',has_traffic_filtering=True,id=3a800e7a-5628-4668-ae3e-d49b537f7a62,network=Network(d7dbc9c3-816f-46fb-a3d3-e0e817e15de3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a800e7a-56') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:40:31 user nova-compute[75176]: DEBUG os_vif [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:28:72,bridge_name='br-int',has_traffic_filtering=True,id=3a800e7a-5628-4668-ae3e-d49b537f7a62,network=Network(d7dbc9c3-816f-46fb-a3d3-e0e817e15de3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a800e7a-56') {{(pid=75176) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 15:40:31 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:31 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:40:31 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 15:40:31 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:31 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c72c3e5c-869d-5742-a218-93b89b132f3d', '_type': 'linux-noop'}}, row=False) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:40:31 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:31 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:40:31 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:763d605d-247d-4484-b7ec-762e36b92abc -p 172.16.0.220:3260 --login" returned: 0 in 0.080s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:40:31 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[57ba04b8-03ed-4b2c-a82f-23f15b721d82]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:763d605d-247d-4484-b7ec-762e36b92abc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:763d605d-247d-4484-b7ec-762e36b92abc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:40:31 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:763d605d-247d-4484-b7ec-762e36b92abc, portal: 172.16.0.220,3260]
Nov 28 15:40:31 user nova-compute[75176]: Login to [iface: default, target: iqn.2010-10.org.openstack:763d605d-247d-4484-b7ec-762e36b92abc, portal: 172.16.0.220,3260] successful.
Nov 28 15:40:31 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:40:31 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:763d605d-247d-4484-b7ec-762e36b92abc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:40:31 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:31 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:31 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3a800e7a-56, may_exist=True, interface_attrs={}) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:40:31 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3a800e7a-56, col_values=(('qos', UUID('a7350ff4-857a-473c-8131-b081b17b8431')),), if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:40:31 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3a800e7a-56, col_values=(('external_ids', {'iface-id': '3a800e7a-5628-4668-ae3e-d49b537f7a62', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e0:28:72', 'vm-uuid': '041af768-197b-4c76-a5a1-28e2dc8255bd'}),), if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:40:31 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:31 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:763d605d-247d-4484-b7ec-762e36b92abc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:40:31 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[471945a5-f22b-4afa-91d4-72fefeefbd47]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:40:31 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:40:31 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:40:31 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:40:31 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:40:31 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[e44f498c-15e9-4d84-b5e1-027c1ff19979]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81326542-482f-4d50-895c-13c65fe4daf7 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76ea4d3b-7c77-47d0-b48b-ad79886d4f9a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27720cbf-c8ad-486b-845d-cdff5fbc4772 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:560d9b0e-d506-4723-8fc3-4068d690d5c8 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e691257-74a3-4fef-9fd1-67d2ba725039 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:763d605d-247d-4484-b7ec-762e36b92abc (non-flash)\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:40:31 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9 (non-flash)
Nov 28 15:40:31 user nova-compute[75176]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81326542-482f-4d50-895c-13c65fe4daf7 (non-flash)
Nov 28 15:40:31 user nova-compute[75176]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76ea4d3b-7c77-47d0-b48b-ad79886d4f9a (non-flash)
Nov 28 15:40:31 user nova-compute[75176]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27720cbf-c8ad-486b-845d-cdff5fbc4772 (non-flash)
Nov 28 15:40:31 user nova-compute[75176]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:560d9b0e-d506-4723-8fc3-4068d690d5c8 (non-flash)
Nov 28 15:40:31 user nova-compute[75176]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e691257-74a3-4fef-9fd1-67d2ba725039 (non-flash)
Nov 28 15:40:31 user nova-compute[75176]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:763d605d-247d-4484-b7ec-762e36b92abc (non-flash)
Nov 28 15:40:31 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:40:31 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9 (non-flash)
Nov 28 15:40:31 user nova-compute[75176]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81326542-482f-4d50-895c-13c65fe4daf7 (non-flash)
Nov 28 15:40:31 user nova-compute[75176]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76ea4d3b-7c77-47d0-b48b-ad79886d4f9a (non-flash)
Nov 28 15:40:31 user nova-compute[75176]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27720cbf-c8ad-486b-845d-cdff5fbc4772 (non-flash)
Nov 28 15:40:31 user nova-compute[75176]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:560d9b0e-d506-4723-8fc3-4068d690d5c8 (non-flash)
Nov 28 15:40:31 user nova-compute[75176]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e691257-74a3-4fef-9fd1-67d2ba725039 (non-flash)
Nov 28 15:40:31 user nova-compute[75176]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:763d605d-247d-4484-b7ec-762e36b92abc (non-flash)
Nov 28 15:40:31 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 15:40:31 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:763d605d-247d-4484-b7ec-762e36b92abc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.339s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 15:40:31 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Connected to 172.16.0.220:3260 {{(pid=75176) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 15:40:31 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] HCTL ('39', '-', '-', 0) found on session 8 with lun 0 {{(pid=75176) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 15:40:31 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=75176) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 15:40:31 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:31 user nova-compute[75176]: INFO os_vif [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:28:72,bridge_name='br-int',has_traffic_filtering=True,id=3a800e7a-5628-4668-ae3e-d49b537f7a62,network=Network(d7dbc9c3-816f-46fb-a3d3-e0e817e15de3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a800e7a-56')
Nov 28 15:40:31 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T15:39:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1424070534',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1424070534',id=10,image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPn83B68ew19zNqtC6OrMzgf/bmXCz98qa+rH054zqhA5Gi3ZDmOGiOHPgSu1hkI/yV1KZdhZIiHhrJ1wuOhC1X2w3dTgpgbLguVyd7FUfhz3bRrtdjXABRlYuvBuQRV2A==',key_name='tempest-keypair-1772665281',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cfdec2abaf704a1396611ff1bcb96e53',ramdisk_id='',reservation_id='r-0j1w7c0x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1260942437',owner_user_name='tempest-TaggedBootDevicesTest_v242-1260942437-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T15:40:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='97e02c028b814c6993edba6c1caa8afe',uuid=041af768-197b-4c76-a5a1-28e2dc8255bd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d9a60043-45d0-46f1-8d0f-ad1c7b55fa06", "address": "fa:16:3e:5c:fb:31", "network": {"id": "d7dbc9c3-816f-46fb-a3d3-e0e817e15de3", "bridge": "br-int", "label": "tempest-device-tagging-net1-136440967", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.54", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfdec2abaf704a1396611ff1bcb96e53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9a60043-45", "ovs_interfaceid": "d9a60043-45d0-46f1-8d0f-ad1c7b55fa06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 15:40:31 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Converting VIF {"id": "d9a60043-45d0-46f1-8d0f-ad1c7b55fa06", "address": "fa:16:3e:5c:fb:31", "network": {"id": "d7dbc9c3-816f-46fb-a3d3-e0e817e15de3", "bridge": "br-int", "label": "tempest-device-tagging-net1-136440967", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.54", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfdec2abaf704a1396611ff1bcb96e53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9a60043-45", "ovs_interfaceid": "d9a60043-45d0-46f1-8d0f-ad1c7b55fa06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:40:31 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:fb:31,bridge_name='br-int',has_traffic_filtering=True,id=d9a60043-45d0-46f1-8d0f-ad1c7b55fa06,network=Network(d7dbc9c3-816f-46fb-a3d3-e0e817e15de3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9a60043-45') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:40:31 user nova-compute[75176]: DEBUG os_vif [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:fb:31,bridge_name='br-int',has_traffic_filtering=True,id=d9a60043-45d0-46f1-8d0f-ad1c7b55fa06,network=Network(d7dbc9c3-816f-46fb-a3d3-e0e817e15de3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9a60043-45') {{(pid=75176) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 15:40:31 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:40:31 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:31 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:40:31 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 15:40:31 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:31 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6702a444-e341-58ca-a15d-8c6b1f7df2dd', '_type': 'linux-noop'}}, row=False) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:40:31 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:31 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:40:31 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.018s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:40:31 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c55fc33-deb1-4173-9b51-653cbb6bbd93]: (4, ('- - 0', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:40:31 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Searching for a device in session 8 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=75176) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 15:40:31 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:763d605d-247d-4484-b7ec-762e36b92abc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wHMBuZWL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75176) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 15:40:31 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:31 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:31 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd9a60043-45, may_exist=True, interface_attrs={}) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:40:31 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd9a60043-45, col_values=(('qos', UUID('affd9008-4bc2-4e0e-94f0-ced47cda6b6e')),), if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:40:31 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd9a60043-45, col_values=(('external_ids', {'iface-id': 'd9a60043-45d0-46f1-8d0f-ad1c7b55fa06', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5c:fb:31', 'vm-uuid': '041af768-197b-4c76-a5a1-28e2dc8255bd'}),), if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:40:31 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:31 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:40:31 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:31 user nova-compute[75176]: INFO os_vif [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:fb:31,bridge_name='br-int',has_traffic_filtering=True,id=d9a60043-45d0-46f1-8d0f-ad1c7b55fa06,network=Network(d7dbc9c3-816f-46fb-a3d3-e0e817e15de3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9a60043-45')
Nov 28 15:40:31 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T15:39:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1424070534',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1424070534',id=10,image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPn83B68ew19zNqtC6OrMzgf/bmXCz98qa+rH054zqhA5Gi3ZDmOGiOHPgSu1hkI/yV1KZdhZIiHhrJ1wuOhC1X2w3dTgpgbLguVyd7FUfhz3bRrtdjXABRlYuvBuQRV2A==',key_name='tempest-keypair-1772665281',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cfdec2abaf704a1396611ff1bcb96e53',ramdisk_id='',reservation_id='r-0j1w7c0x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1260942437',owner_user_name='tempest-TaggedBootDevicesTest_v242-1260942437-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T15:40:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='97e02c028b814c6993edba6c1caa8afe',uuid=041af768-197b-4c76-a5a1-28e2dc8255bd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0c65b96a-0fce-4bff-b89c-443cc48f6995", "address": "fa:16:3e:c4:dc:af", "network": {"id": "6a9822be-add5-4d71-8ef1-1ce105eed6af", "bridge": "br-int", "label": "tempest-device-tagging-net2-401277966", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cfdec2abaf704a1396611ff1bcb96e53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c65b96a-0f", "ovs_interfaceid": "0c65b96a-0fce-4bff-b89c-443cc48f6995", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 15:40:31 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Converting VIF {"id": "0c65b96a-0fce-4bff-b89c-443cc48f6995", "address": "fa:16:3e:c4:dc:af", "network": {"id": "6a9822be-add5-4d71-8ef1-1ce105eed6af", "bridge": "br-int", "label": "tempest-device-tagging-net2-401277966", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cfdec2abaf704a1396611ff1bcb96e53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c65b96a-0f", "ovs_interfaceid": "0c65b96a-0fce-4bff-b89c-443cc48f6995", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:40:31 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:dc:af,bridge_name='br-int',has_traffic_filtering=True,id=0c65b96a-0fce-4bff-b89c-443cc48f6995,network=Network(6a9822be-add5-4d71-8ef1-1ce105eed6af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c65b96a-0f') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:40:31 user nova-compute[75176]: DEBUG os_vif [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:dc:af,bridge_name='br-int',has_traffic_filtering=True,id=0c65b96a-0fce-4bff-b89c-443cc48f6995,network=Network(6a9822be-add5-4d71-8ef1-1ce105eed6af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c65b96a-0f') {{(pid=75176) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 15:40:31 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:31 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:40:31 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 15:40:31 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:31 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'dba797f6-ac53-55ba-bb07-1ed81a20e67c', '_type': 'linux-noop'}}, row=False) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:40:31 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:31 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:40:31 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:31 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:31 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0c65b96a-0f, may_exist=True, interface_attrs={}) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:40:31 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0c65b96a-0f, col_values=(('qos', UUID('0d2f0aef-14c3-464d-97ca-27ef55e5cdc0')),), if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:40:31 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0c65b96a-0f, col_values=(('external_ids', {'iface-id': '0c65b96a-0fce-4bff-b89c-443cc48f6995', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c4:dc:af', 'vm-uuid': '041af768-197b-4c76-a5a1-28e2dc8255bd'}),), if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:40:31 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:31 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:40:32 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:32 user nova-compute[75176]: INFO os_vif [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:dc:af,bridge_name='br-int',has_traffic_filtering=True,id=0c65b96a-0fce-4bff-b89c-443cc48f6995,network=Network(6a9822be-add5-4d71-8ef1-1ce105eed6af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c65b96a-0f')
Nov 28 15:40:32 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T15:39:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1424070534',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1424070534',id=10,image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPn83B68ew19zNqtC6OrMzgf/bmXCz98qa+rH054zqhA5Gi3ZDmOGiOHPgSu1hkI/yV1KZdhZIiHhrJ1wuOhC1X2w3dTgpgbLguVyd7FUfhz3bRrtdjXABRlYuvBuQRV2A==',key_name='tempest-keypair-1772665281',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cfdec2abaf704a1396611ff1bcb96e53',ramdisk_id='',reservation_id='r-0j1w7c0x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1260942437',owner_user_name='tempest-TaggedBootDevicesTest_v242-1260942437-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T15:40:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='97e02c028b814c6993edba6c1caa8afe',uuid=041af768-197b-4c76-a5a1-28e2dc8255bd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2df03152-b1aa-4794-965d-64886ac889ea", "address": "fa:16:3e:7a:2f:2c", "network": {"id": "6a9822be-add5-4d71-8ef1-1ce105eed6af", "bridge": "br-int", "label": "tempest-device-tagging-net2-401277966", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cfdec2abaf704a1396611ff1bcb96e53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2df03152-b1", "ovs_interfaceid": "2df03152-b1aa-4794-965d-64886ac889ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 15:40:32 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Converting VIF {"id": "2df03152-b1aa-4794-965d-64886ac889ea", "address": "fa:16:3e:7a:2f:2c", "network": {"id": "6a9822be-add5-4d71-8ef1-1ce105eed6af", "bridge": "br-int", "label": "tempest-device-tagging-net2-401277966", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cfdec2abaf704a1396611ff1bcb96e53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2df03152-b1", "ovs_interfaceid": "2df03152-b1aa-4794-965d-64886ac889ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:40:32 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:2f:2c,bridge_name='br-int',has_traffic_filtering=True,id=2df03152-b1aa-4794-965d-64886ac889ea,network=Network(6a9822be-add5-4d71-8ef1-1ce105eed6af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2df03152-b1') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:40:32 user nova-compute[75176]: DEBUG os_vif [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:2f:2c,bridge_name='br-int',has_traffic_filtering=True,id=2df03152-b1aa-4794-965d-64886ac889ea,network=Network(6a9822be-add5-4d71-8ef1-1ce105eed6af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2df03152-b1') {{(pid=75176) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 15:40:32 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:32 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:40:32 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 15:40:32 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:32 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '760abb65-65ae-5212-9c5b-e42b6e8e7efc', '_type': 'linux-noop'}}, row=False) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:40:32 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:32 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:40:32 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:32 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:32 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2df03152-b1, may_exist=True, interface_attrs={}) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:40:32 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2df03152-b1, col_values=(('qos', UUID('ef4b8284-5ff7-4fb3-8844-3adda5f60cc6')),), if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:40:32 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2df03152-b1, col_values=(('external_ids', {'iface-id': '2df03152-b1aa-4794-965d-64886ac889ea', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7a:2f:2c', 'vm-uuid': '041af768-197b-4c76-a5a1-28e2dc8255bd'}),), if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:40:32 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:32 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:40:32 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:32 user nova-compute[75176]: INFO os_vif [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:2f:2c,bridge_name='br-int',has_traffic_filtering=True,id=2df03152-b1aa-4794-965d-64886ac889ea,network=Network(6a9822be-add5-4d71-8ef1-1ce105eed6af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2df03152-b1')
Nov 28 15:40:32 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] No BDM found with device name hda, not building metadata. {{(pid=75176) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 15:40:32 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75176) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 15:40:32 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] No VIF found with MAC fa:16:3e:e2:26:17, not building metadata {{(pid=75176) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 15:40:32 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] No VIF found with MAC fa:16:3e:5c:fb:31, not building metadata {{(pid=75176) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 15:40:32 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] Using config drive
Nov 28 15:40:32 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] Creating config drive at /opt/stack/data/nova/instances/041af768-197b-4c76-a5a1-28e2dc8255bd/disk.config
Nov 28 15:40:32 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/041af768-197b-4c76-a5a1-28e2dc8255bd/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpuatckix6 {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:40:32 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/041af768-197b-4c76-a5a1-28e2dc8255bd/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpuatckix6" returned: 0 in 0.050s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:40:32 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.380s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 15:40:32 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] <== connect_volume: return (2724ms) {'type': 'block', 'scsi_wwn': '26633353731366264', 'path': '/dev/sdh'} {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 15:40:32 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26633353731366264', 'path': '/dev/sdh'} {{(pid=75176) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 15:40:32 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T15:39:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1004277851',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1004277851',id=11,image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAt/lLowBIWQygNmvQblLtMAxvEuh2XUt/OTwbCBERVkLqIQ96jTap/pkeH4XObeedowqO0iM5aqRH1Q9ITpqofPFkYQiFnqenRv5cljG1lxFMkS8D9qDEIlxMTWaLsb0A==',key_name='tempest-keypair-1203087070',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0108444c01e94416984b083707102c58',ramdisk_id='',reservation_id='r-j3sryyxs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1183582238',owner_user_name='tempest-TaggedBootDevicesTest-1183582238-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T15:40:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8fb5815faed648a1a207c402eafca90e',uuid=b714fb94-fcc7-40ae-b3a9-d8c9a60008f1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "da7d30e5-6304-46ec-8d50-336986e6262f", "address": "fa:16:3e:63:83:5b", "network": {"id": "b1277b75-5749-436a-a651-3303fd60d8b4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1047877730-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0108444c01e94416984b083707102c58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda7d30e5-63", "ovs_interfaceid": "da7d30e5-6304-46ec-8d50-336986e6262f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75176) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 15:40:32 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Converting VIF {"id": "da7d30e5-6304-46ec-8d50-336986e6262f", "address": "fa:16:3e:63:83:5b", "network": {"id": "b1277b75-5749-436a-a651-3303fd60d8b4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1047877730-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0108444c01e94416984b083707102c58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda7d30e5-63", "ovs_interfaceid": "da7d30e5-6304-46ec-8d50-336986e6262f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:40:32 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:63:83:5b,bridge_name='br-int',has_traffic_filtering=True,id=da7d30e5-6304-46ec-8d50-336986e6262f,network=Network(b1277b75-5749-436a-a651-3303fd60d8b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda7d30e5-63') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:40:32 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T15:39:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1004277851',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1004277851',id=11,image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAt/lLowBIWQygNmvQblLtMAxvEuh2XUt/OTwbCBERVkLqIQ96jTap/pkeH4XObeedowqO0iM5aqRH1Q9ITpqofPFkYQiFnqenRv5cljG1lxFMkS8D9qDEIlxMTWaLsb0A==',key_name='tempest-keypair-1203087070',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0108444c01e94416984b083707102c58',ramdisk_id='',reservation_id='r-j3sryyxs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1183582238',owner_user_name='tempest-TaggedBootDevicesTest-1183582238-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T15:40:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8fb5815faed648a1a207c402eafca90e',uuid=b714fb94-fcc7-40ae-b3a9-d8c9a60008f1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e1ac011f-d965-4d4c-b4c8-aa9bf5201518", "address": "fa:16:3e:7f:e1:ea", "network": {"id": "26bf803a-6aa2-4e87-b407-caee3f8f7d3d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1638676687", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0108444c01e94416984b083707102c58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1ac011f-d9", "ovs_interfaceid": "e1ac011f-d965-4d4c-b4c8-aa9bf5201518", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75176) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 15:40:32 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Converting VIF {"id": "e1ac011f-d965-4d4c-b4c8-aa9bf5201518", "address": "fa:16:3e:7f:e1:ea", "network": {"id": "26bf803a-6aa2-4e87-b407-caee3f8f7d3d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1638676687", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0108444c01e94416984b083707102c58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1ac011f-d9", "ovs_interfaceid": "e1ac011f-d965-4d4c-b4c8-aa9bf5201518", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:40:32 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:e1:ea,bridge_name='br-int',has_traffic_filtering=True,id=e1ac011f-d965-4d4c-b4c8-aa9bf5201518,network=Network(26bf803a-6aa2-4e87-b407-caee3f8f7d3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape1ac011f-d9') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:40:32 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T15:39:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1004277851',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1004277851',id=11,image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAt/lLowBIWQygNmvQblLtMAxvEuh2XUt/OTwbCBERVkLqIQ96jTap/pkeH4XObeedowqO0iM5aqRH1Q9ITpqofPFkYQiFnqenRv5cljG1lxFMkS8D9qDEIlxMTWaLsb0A==',key_name='tempest-keypair-1203087070',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0108444c01e94416984b083707102c58',ramdisk_id='',reservation_id='r-j3sryyxs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1183582238',owner_user_name='tempest-TaggedBootDevicesTest-1183582238-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T15:40:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8fb5815faed648a1a207c402eafca90e',uuid=b714fb94-fcc7-40ae-b3a9-d8c9a60008f1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "61157920-954a-479e-bd66-b0746a7843a7", "address": "fa:16:3e:8f:4f:39", "network": {"id": "26bf803a-6aa2-4e87-b407-caee3f8f7d3d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1638676687", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0108444c01e94416984b083707102c58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61157920-95", "ovs_interfaceid": "61157920-954a-479e-bd66-b0746a7843a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75176) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 15:40:32 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Converting VIF {"id": "61157920-954a-479e-bd66-b0746a7843a7", "address": "fa:16:3e:8f:4f:39", "network": {"id": "26bf803a-6aa2-4e87-b407-caee3f8f7d3d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1638676687", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0108444c01e94416984b083707102c58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61157920-95", "ovs_interfaceid": "61157920-954a-479e-bd66-b0746a7843a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:40:32 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:4f:39,bridge_name='br-int',has_traffic_filtering=True,id=61157920-954a-479e-bd66-b0746a7843a7,network=Network(26bf803a-6aa2-4e87-b407-caee3f8f7d3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap61157920-95') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:40:32 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T15:39:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1004277851',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1004277851',id=11,image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAt/lLowBIWQygNmvQblLtMAxvEuh2XUt/OTwbCBERVkLqIQ96jTap/pkeH4XObeedowqO0iM5aqRH1Q9ITpqofPFkYQiFnqenRv5cljG1lxFMkS8D9qDEIlxMTWaLsb0A==',key_name='tempest-keypair-1203087070',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0108444c01e94416984b083707102c58',ramdisk_id='',reservation_id='r-j3sryyxs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1183582238',owner_user_name='tempest-TaggedBootDevicesTest-1183582238-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T15:40:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8fb5815faed648a1a207c402eafca90e',uuid=b714fb94-fcc7-40ae-b3a9-d8c9a60008f1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "04db431e-5bc8-4450-9bdd-82369fafba70", "address": "fa:16:3e:15:71:6f", "network": {"id": "26bf803a-6aa2-4e87-b407-caee3f8f7d3d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1638676687", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0108444c01e94416984b083707102c58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04db431e-5b", "ovs_interfaceid": "04db431e-5bc8-4450-9bdd-82369fafba70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75176) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 15:40:32 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Converting VIF {"id": "04db431e-5bc8-4450-9bdd-82369fafba70", "address": "fa:16:3e:15:71:6f", "network": {"id": "26bf803a-6aa2-4e87-b407-caee3f8f7d3d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1638676687", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0108444c01e94416984b083707102c58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04db431e-5b", "ovs_interfaceid": "04db431e-5bc8-4450-9bdd-82369fafba70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:40:32 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:71:6f,bridge_name='br-int',has_traffic_filtering=True,id=04db431e-5bc8-4450-9bdd-82369fafba70,network=Network(26bf803a-6aa2-4e87-b407-caee3f8f7d3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04db431e-5b') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:40:32 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T15:39:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1004277851',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1004277851',id=11,image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAt/lLowBIWQygNmvQblLtMAxvEuh2XUt/OTwbCBERVkLqIQ96jTap/pkeH4XObeedowqO0iM5aqRH1Q9ITpqofPFkYQiFnqenRv5cljG1lxFMkS8D9qDEIlxMTWaLsb0A==',key_name='tempest-keypair-1203087070',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0108444c01e94416984b083707102c58',ramdisk_id='',reservation_id='r-j3sryyxs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1183582238',owner_user_name='tempest-TaggedBootDevicesTest-1183582238-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T15:40:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8fb5815faed648a1a207c402eafca90e',uuid=b714fb94-fcc7-40ae-b3a9-d8c9a60008f1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0bc36ba8-7fc6-47b2-b7b1-08a445625b46", "address": "fa:16:3e:76:ce:76", "network": {"id": "26bf803a-6aa2-4e87-b407-caee3f8f7d3d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1638676687", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0108444c01e94416984b083707102c58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bc36ba8-7f", "ovs_interfaceid": "0bc36ba8-7fc6-47b2-b7b1-08a445625b46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75176) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 15:40:32 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Converting VIF {"id": "0bc36ba8-7fc6-47b2-b7b1-08a445625b46", "address": "fa:16:3e:76:ce:76", "network": {"id": "26bf803a-6aa2-4e87-b407-caee3f8f7d3d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1638676687", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0108444c01e94416984b083707102c58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bc36ba8-7f", "ovs_interfaceid": "0bc36ba8-7fc6-47b2-b7b1-08a445625b46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:40:32 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:ce:76,bridge_name='br-int',has_traffic_filtering=True,id=0bc36ba8-7fc6-47b2-b7b1-08a445625b46,network=Network(26bf803a-6aa2-4e87-b407-caee3f8f7d3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bc36ba8-7f') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:40:32 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T15:39:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1004277851',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1004277851',id=11,image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAt/lLowBIWQygNmvQblLtMAxvEuh2XUt/OTwbCBERVkLqIQ96jTap/pkeH4XObeedowqO0iM5aqRH1Q9ITpqofPFkYQiFnqenRv5cljG1lxFMkS8D9qDEIlxMTWaLsb0A==',key_name='tempest-keypair-1203087070',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0108444c01e94416984b083707102c58',ramdisk_id='',reservation_id='r-j3sryyxs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1183582238',owner_user_name='tempest-TaggedBootDevicesTest-1183582238-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T15:40:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8fb5815faed648a1a207c402eafca90e',uuid=b714fb94-fcc7-40ae-b3a9-d8c9a60008f1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0c08ccbe-f3de-4aed-b641-8e2b58bd73a0", "address": "fa:16:3e:59:54:f2", "network": {"id": "3936aa29-a691-4362-8bd9-536545b14473", "bridge": "br-int", "label": "tempest-device-tagging-net2-1089118081", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0108444c01e94416984b083707102c58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c08ccbe-f3", "ovs_interfaceid": "0c08ccbe-f3de-4aed-b641-8e2b58bd73a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75176) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 15:40:32 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Converting VIF {"id": "0c08ccbe-f3de-4aed-b641-8e2b58bd73a0", "address": "fa:16:3e:59:54:f2", "network": {"id": "3936aa29-a691-4362-8bd9-536545b14473", "bridge": "br-int", "label": "tempest-device-tagging-net2-1089118081", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0108444c01e94416984b083707102c58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c08ccbe-f3", "ovs_interfaceid": "0c08ccbe-f3de-4aed-b641-8e2b58bd73a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:40:32 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:54:f2,bridge_name='br-int',has_traffic_filtering=True,id=0c08ccbe-f3de-4aed-b641-8e2b58bd73a0,network=Network(3936aa29-a691-4362-8bd9-536545b14473),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c08ccbe-f3') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:40:32 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T15:39:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1004277851',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1004277851',id=11,image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAt/lLowBIWQygNmvQblLtMAxvEuh2XUt/OTwbCBERVkLqIQ96jTap/pkeH4XObeedowqO0iM5aqRH1Q9ITpqofPFkYQiFnqenRv5cljG1lxFMkS8D9qDEIlxMTWaLsb0A==',key_name='tempest-keypair-1203087070',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0108444c01e94416984b083707102c58',ramdisk_id='',reservation_id='r-j3sryyxs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1183582238',owner_user_name='tempest-TaggedBootDevicesTest-1183582238-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T15:40:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8fb5815faed648a1a207c402eafca90e',uuid=b714fb94-fcc7-40ae-b3a9-d8c9a60008f1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e0b49239-50a0-4864-9e92-22bddcbe7d21", "address": "fa:16:3e:d8:78:24", "network": {"id": "3936aa29-a691-4362-8bd9-536545b14473", "bridge": "br-int", "label": "tempest-device-tagging-net2-1089118081", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0108444c01e94416984b083707102c58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0b49239-50", "ovs_interfaceid": "e0b49239-50a0-4864-9e92-22bddcbe7d21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75176) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 15:40:32 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Converting VIF {"id": "e0b49239-50a0-4864-9e92-22bddcbe7d21", "address": "fa:16:3e:d8:78:24", "network": {"id": "3936aa29-a691-4362-8bd9-536545b14473", "bridge": "br-int", "label": "tempest-device-tagging-net2-1089118081", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0108444c01e94416984b083707102c58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0b49239-50", "ovs_interfaceid": "e0b49239-50a0-4864-9e92-22bddcbe7d21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:40:32 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:78:24,bridge_name='br-int',has_traffic_filtering=True,id=e0b49239-50a0-4864-9e92-22bddcbe7d21,network=Network(3936aa29-a691-4362-8bd9-536545b14473),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0b49239-50') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:40:32 user nova-compute[75176]: DEBUG nova.objects.instance [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Lazy-loading 'pci_devices' on Instance uuid b714fb94-fcc7-40ae-b3a9-d8c9a60008f1 {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:40:32 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] End _get_guest_xml xml=<domain type="kvm">
Nov 28 15:40:32 user nova-compute[75176]:   <uuid>b714fb94-fcc7-40ae-b3a9-d8c9a60008f1</uuid>
Nov 28 15:40:32 user nova-compute[75176]:   <name>instance-0000000b</name>
Nov 28 15:40:32 user nova-compute[75176]:   <memory>524288</memory>
Nov 28 15:40:32 user nova-compute[75176]:   <vcpu>1</vcpu>
Nov 28 15:40:32 user nova-compute[75176]:   <metadata>
Nov 28 15:40:32 user nova-compute[75176]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 15:40:32 user nova-compute[75176]:       <nova:package version="0.0.0"/>
Nov 28 15:40:32 user nova-compute[75176]:       <nova:name>tempest-device-tagging-server-1004277851</nova:name>
Nov 28 15:40:32 user nova-compute[75176]:       <nova:creationTime>2023-11-28 15:40:25</nova:creationTime>
Nov 28 15:40:32 user nova-compute[75176]:       <nova:flavor name="m1.tiny">
Nov 28 15:40:32 user nova-compute[75176]:         <nova:memory>512</nova:memory>
Nov 28 15:40:32 user nova-compute[75176]:         <nova:disk>1</nova:disk>
Nov 28 15:40:32 user nova-compute[75176]:         <nova:swap>0</nova:swap>
Nov 28 15:40:32 user nova-compute[75176]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 15:40:32 user nova-compute[75176]:         <nova:vcpus>1</nova:vcpus>
Nov 28 15:40:32 user nova-compute[75176]:       </nova:flavor>
Nov 28 15:40:32 user nova-compute[75176]:       <nova:owner>
Nov 28 15:40:32 user nova-compute[75176]:         <nova:user uuid="8fb5815faed648a1a207c402eafca90e">tempest-TaggedBootDevicesTest-1183582238-project-member</nova:user>
Nov 28 15:40:32 user nova-compute[75176]:         <nova:project uuid="0108444c01e94416984b083707102c58">tempest-TaggedBootDevicesTest-1183582238</nova:project>
Nov 28 15:40:32 user nova-compute[75176]:       </nova:owner>
Nov 28 15:40:32 user nova-compute[75176]:       <nova:root type="image" uuid="1f41819e-c93f-4dc7-b253-37a27bbbbc74"/>
Nov 28 15:40:32 user nova-compute[75176]:       <nova:ports>
Nov 28 15:40:32 user nova-compute[75176]:         <nova:port uuid="da7d30e5-6304-46ec-8d50-336986e6262f">
Nov 28 15:40:32 user nova-compute[75176]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 28 15:40:32 user nova-compute[75176]:         </nova:port>
Nov 28 15:40:32 user nova-compute[75176]:         <nova:port uuid="e1ac011f-d965-4d4c-b4c8-aa9bf5201518">
Nov 28 15:40:32 user nova-compute[75176]:           <nova:ip type="fixed" address="10.1.1.3" ipVersion="4"/>
Nov 28 15:40:32 user nova-compute[75176]:         </nova:port>
Nov 28 15:40:32 user nova-compute[75176]:         <nova:port uuid="61157920-954a-479e-bd66-b0746a7843a7">
Nov 28 15:40:32 user nova-compute[75176]:           <nova:ip type="fixed" address="10.1.1.57" ipVersion="4"/>
Nov 28 15:40:32 user nova-compute[75176]:         </nova:port>
Nov 28 15:40:32 user nova-compute[75176]:         <nova:port uuid="04db431e-5bc8-4450-9bdd-82369fafba70">
Nov 28 15:40:32 user nova-compute[75176]:           <nova:ip type="fixed" address="10.1.1.32" ipVersion="4"/>
Nov 28 15:40:32 user nova-compute[75176]:         </nova:port>
Nov 28 15:40:32 user nova-compute[75176]:         <nova:port uuid="0bc36ba8-7fc6-47b2-b7b1-08a445625b46">
Nov 28 15:40:32 user nova-compute[75176]:           <nova:ip type="fixed" address="10.1.1.10" ipVersion="4"/>
Nov 28 15:40:32 user nova-compute[75176]:         </nova:port>
Nov 28 15:40:32 user nova-compute[75176]:         <nova:port uuid="0c08ccbe-f3de-4aed-b641-8e2b58bd73a0">
Nov 28 15:40:32 user nova-compute[75176]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 28 15:40:32 user nova-compute[75176]:         </nova:port>
Nov 28 15:40:32 user nova-compute[75176]:         <nova:port uuid="e0b49239-50a0-4864-9e92-22bddcbe7d21">
Nov 28 15:40:32 user nova-compute[75176]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 28 15:40:32 user nova-compute[75176]:         </nova:port>
Nov 28 15:40:32 user nova-compute[75176]:       </nova:ports>
Nov 28 15:40:32 user nova-compute[75176]:     </nova:instance>
Nov 28 15:40:32 user nova-compute[75176]:   </metadata>
Nov 28 15:40:32 user nova-compute[75176]:   <sysinfo type="smbios">
Nov 28 15:40:32 user nova-compute[75176]:     <system>
Nov 28 15:40:32 user nova-compute[75176]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 15:40:32 user nova-compute[75176]:       <entry name="product">OpenStack Nova</entry>
Nov 28 15:40:32 user nova-compute[75176]:       <entry name="version">0.0.0</entry>
Nov 28 15:40:32 user nova-compute[75176]:       <entry name="serial">b714fb94-fcc7-40ae-b3a9-d8c9a60008f1</entry>
Nov 28 15:40:32 user nova-compute[75176]:       <entry name="uuid">b714fb94-fcc7-40ae-b3a9-d8c9a60008f1</entry>
Nov 28 15:40:32 user nova-compute[75176]:       <entry name="family">Virtual Machine</entry>
Nov 28 15:40:32 user nova-compute[75176]:     </system>
Nov 28 15:40:32 user nova-compute[75176]:   </sysinfo>
Nov 28 15:40:32 user nova-compute[75176]:   <os>
Nov 28 15:40:32 user nova-compute[75176]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 15:40:32 user nova-compute[75176]:     <boot dev="hd"/>
Nov 28 15:40:32 user nova-compute[75176]:     <smbios mode="sysinfo"/>
Nov 28 15:40:32 user nova-compute[75176]:   </os>
Nov 28 15:40:32 user nova-compute[75176]:   <features>
Nov 28 15:40:32 user nova-compute[75176]:     <acpi/>
Nov 28 15:40:32 user nova-compute[75176]:     <apic/>
Nov 28 15:40:32 user nova-compute[75176]:     <vmcoreinfo/>
Nov 28 15:40:32 user nova-compute[75176]:   </features>
Nov 28 15:40:32 user nova-compute[75176]:   <clock offset="utc">
Nov 28 15:40:32 user nova-compute[75176]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 15:40:32 user nova-compute[75176]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 15:40:32 user nova-compute[75176]:     <timer name="hpet" present="no"/>
Nov 28 15:40:32 user nova-compute[75176]:   </clock>
Nov 28 15:40:32 user nova-compute[75176]:   <cpu mode="custom" match="exact">
Nov 28 15:40:32 user nova-compute[75176]:     <model>Nehalem</model>
Nov 28 15:40:32 user nova-compute[75176]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 15:40:32 user nova-compute[75176]:   </cpu>
Nov 28 15:40:32 user nova-compute[75176]:   <devices>
Nov 28 15:40:32 user nova-compute[75176]:     <disk type="file" device="cdrom">
Nov 28 15:40:32 user nova-compute[75176]:       <driver name="qemu" type="raw" cache="none"/>
Nov 28 15:40:32 user nova-compute[75176]:       <source file="/opt/stack/data/nova/instances/b714fb94-fcc7-40ae-b3a9-d8c9a60008f1/disk.config"/>
Nov 28 15:40:32 user nova-compute[75176]:       <target dev="hda" bus="ide"/>
Nov 28 15:40:32 user nova-compute[75176]:     </disk>
Nov 28 15:40:32 user nova-compute[75176]:     <disk type="block" device="disk">
Nov 28 15:40:32 user nova-compute[75176]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 15:40:32 user nova-compute[75176]:       <source dev="/dev/sdd"/>
Nov 28 15:40:32 user nova-compute[75176]:       <target dev="vda" bus="virtio"/>
Nov 28 15:40:32 user nova-compute[75176]:       <serial>76ea4d3b-7c77-47d0-b48b-ad79886d4f9a</serial>
Nov 28 15:40:32 user nova-compute[75176]:     </disk>
Nov 28 15:40:32 user nova-compute[75176]:     <disk type="block" device="disk">
Nov 28 15:40:32 user nova-compute[75176]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 15:40:32 user nova-compute[75176]:       <source dev="/dev/sdf"/>
Nov 28 15:40:32 user nova-compute[75176]:       <target dev="vdb" bus="virtio"/>
Nov 28 15:40:32 user nova-compute[75176]:       <serial>560d9b0e-d506-4723-8fc3-4068d690d5c8</serial>
Nov 28 15:40:32 user nova-compute[75176]:     </disk>
Nov 28 15:40:32 user nova-compute[75176]:     <disk type="block" device="disk">
Nov 28 15:40:32 user nova-compute[75176]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 15:40:32 user nova-compute[75176]:       <source dev="/dev/sdh"/>
Nov 28 15:40:32 user nova-compute[75176]:       <target dev="vdc" bus="virtio"/>
Nov 28 15:40:32 user nova-compute[75176]:       <serial>763d605d-247d-4484-b7ec-762e36b92abc</serial>
Nov 28 15:40:32 user nova-compute[75176]:     </disk>
Nov 28 15:40:32 user nova-compute[75176]:     <interface type="ethernet">
Nov 28 15:40:32 user nova-compute[75176]:       <mac address="fa:16:3e:63:83:5b"/>
Nov 28 15:40:32 user nova-compute[75176]:       <model type="virtio"/>
Nov 28 15:40:32 user nova-compute[75176]:       <mtu size="1442"/>
Nov 28 15:40:32 user nova-compute[75176]:       <target dev="tapda7d30e5-63"/>
Nov 28 15:40:32 user nova-compute[75176]:     </interface>
Nov 28 15:40:32 user nova-compute[75176]:     <interface type="ethernet">
Nov 28 15:40:32 user nova-compute[75176]:       <mac address="fa:16:3e:7f:e1:ea"/>
Nov 28 15:40:32 user nova-compute[75176]:       <model type="virtio"/>
Nov 28 15:40:32 user nova-compute[75176]:       <mtu size="1442"/>
Nov 28 15:40:32 user nova-compute[75176]:       <target dev="tape1ac011f-d9"/>
Nov 28 15:40:32 user nova-compute[75176]:     </interface>
Nov 28 15:40:32 user nova-compute[75176]:     <interface type="ethernet">
Nov 28 15:40:32 user nova-compute[75176]:       <mac address="fa:16:3e:8f:4f:39"/>
Nov 28 15:40:32 user nova-compute[75176]:       <model type="virtio"/>
Nov 28 15:40:32 user nova-compute[75176]:       <mtu size="1442"/>
Nov 28 15:40:32 user nova-compute[75176]:       <target dev="tap61157920-95"/>
Nov 28 15:40:32 user nova-compute[75176]:     </interface>
Nov 28 15:40:32 user nova-compute[75176]:     <interface type="ethernet">
Nov 28 15:40:32 user nova-compute[75176]:       <mac address="fa:16:3e:15:71:6f"/>
Nov 28 15:40:32 user nova-compute[75176]:       <model type="virtio"/>
Nov 28 15:40:32 user nova-compute[75176]:       <mtu size="1442"/>
Nov 28 15:40:32 user nova-compute[75176]:       <target dev="tap04db431e-5b"/>
Nov 28 15:40:32 user nova-compute[75176]:     </interface>
Nov 28 15:40:32 user nova-compute[75176]:     <interface type="ethernet">
Nov 28 15:40:32 user nova-compute[75176]:       <mac address="fa:16:3e:76:ce:76"/>
Nov 28 15:40:32 user nova-compute[75176]:       <model type="virtio"/>
Nov 28 15:40:32 user nova-compute[75176]:       <mtu size="1442"/>
Nov 28 15:40:32 user nova-compute[75176]:       <target dev="tap0bc36ba8-7f"/>
Nov 28 15:40:32 user nova-compute[75176]:     </interface>
Nov 28 15:40:32 user nova-compute[75176]:     <interface type="ethernet">
Nov 28 15:40:32 user nova-compute[75176]:       <mac address="fa:16:3e:59:54:f2"/>
Nov 28 15:40:32 user nova-compute[75176]:       <model type="virtio"/>
Nov 28 15:40:32 user nova-compute[75176]:       <mtu size="1442"/>
Nov 28 15:40:32 user nova-compute[75176]:       <target dev="tap0c08ccbe-f3"/>
Nov 28 15:40:32 user nova-compute[75176]:     </interface>
Nov 28 15:40:32 user nova-compute[75176]:     <interface type="ethernet">
Nov 28 15:40:32 user nova-compute[75176]:       <mac address="fa:16:3e:d8:78:24"/>
Nov 28 15:40:32 user nova-compute[75176]:       <model type="virtio"/>
Nov 28 15:40:32 user nova-compute[75176]:       <mtu size="1442"/>
Nov 28 15:40:32 user nova-compute[75176]:       <target dev="tape0b49239-50"/>
Nov 28 15:40:32 user nova-compute[75176]:     </interface>
Nov 28 15:40:32 user nova-compute[75176]:     <serial type="pty">
Nov 28 15:40:32 user nova-compute[75176]:       <log file="/opt/stack/data/nova/instances/b714fb94-fcc7-40ae-b3a9-d8c9a60008f1/console.log" append="off"/>
Nov 28 15:40:32 user nova-compute[75176]:     </serial>
Nov 28 15:40:32 user nova-compute[75176]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 15:40:32 user nova-compute[75176]:     <video>
Nov 28 15:40:32 user nova-compute[75176]:       <model type="virtio"/>
Nov 28 15:40:32 user nova-compute[75176]:     </video>
Nov 28 15:40:32 user nova-compute[75176]:     <rng model="virtio">
Nov 28 15:40:32 user nova-compute[75176]:       <backend model="random">/dev/urandom</backend>
Nov 28 15:40:32 user nova-compute[75176]:     </rng>
Nov 28 15:40:32 user nova-compute[75176]:     <controller type="usb" index="0" model="none"/>
Nov 28 15:40:32 user nova-compute[75176]:     <memballoon model="virtio">
Nov 28 15:40:32 user nova-compute[75176]:       <stats period="10"/>
Nov 28 15:40:32 user nova-compute[75176]:     </memballoon>
Nov 28 15:40:32 user nova-compute[75176]:   </devices>
Nov 28 15:40:32 user nova-compute[75176]: </domain>
Nov 28 15:40:32 user nova-compute[75176]:  {{(pid=75176) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 15:40:32 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T15:39:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1004277851',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1004277851',id=11,image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAt/lLowBIWQygNmvQblLtMAxvEuh2XUt/OTwbCBERVkLqIQ96jTap/pkeH4XObeedowqO0iM5aqRH1Q9ITpqofPFkYQiFnqenRv5cljG1lxFMkS8D9qDEIlxMTWaLsb0A==',key_name='tempest-keypair-1203087070',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0108444c01e94416984b083707102c58',ramdisk_id='',reservation_id='r-j3sryyxs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1183582238',owner_user_name='tempest-TaggedBootDevicesTest-1183582238-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T15:40:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8fb5815faed648a1a207c402eafca90e',uuid=b714fb94-fcc7-40ae-b3a9-d8c9a60008f1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "da7d30e5-6304-46ec-8d50-336986e6262f", "address": "fa:16:3e:63:83:5b", "network": {"id": "b1277b75-5749-436a-a651-3303fd60d8b4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1047877730-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0108444c01e94416984b083707102c58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda7d30e5-63", "ovs_interfaceid": "da7d30e5-6304-46ec-8d50-336986e6262f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 15:40:32 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Converting VIF {"id": "da7d30e5-6304-46ec-8d50-336986e6262f", "address": "fa:16:3e:63:83:5b", "network": {"id": "b1277b75-5749-436a-a651-3303fd60d8b4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1047877730-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0108444c01e94416984b083707102c58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda7d30e5-63", "ovs_interfaceid": "da7d30e5-6304-46ec-8d50-336986e6262f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:40:32 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:63:83:5b,bridge_name='br-int',has_traffic_filtering=True,id=da7d30e5-6304-46ec-8d50-336986e6262f,network=Network(b1277b75-5749-436a-a651-3303fd60d8b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda7d30e5-63') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:40:32 user nova-compute[75176]: DEBUG os_vif [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:83:5b,bridge_name='br-int',has_traffic_filtering=True,id=da7d30e5-6304-46ec-8d50-336986e6262f,network=Network(b1277b75-5749-436a-a651-3303fd60d8b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda7d30e5-63') {{(pid=75176) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 15:40:32 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:32 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:40:32 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 15:40:32 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:32 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '22af60d1-d427-55eb-952e-2fbcc1bb0e27', '_type': 'linux-noop'}}, row=False) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:40:32 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:32 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:40:32 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:32 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:32 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapda7d30e5-63, may_exist=True, interface_attrs={}) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:40:32 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapda7d30e5-63, col_values=(('qos', UUID('1dcd0f1a-58ab-4fbc-a1de-f63ce9644f7c')),), if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:40:32 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapda7d30e5-63, col_values=(('external_ids', {'iface-id': 'da7d30e5-6304-46ec-8d50-336986e6262f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:63:83:5b', 'vm-uuid': 'b714fb94-fcc7-40ae-b3a9-d8c9a60008f1'}),), if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:40:32 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:32 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:40:33 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:33 user nova-compute[75176]: INFO os_vif [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:83:5b,bridge_name='br-int',has_traffic_filtering=True,id=da7d30e5-6304-46ec-8d50-336986e6262f,network=Network(b1277b75-5749-436a-a651-3303fd60d8b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda7d30e5-63')
Nov 28 15:40:33 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T15:39:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1004277851',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1004277851',id=11,image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAt/lLowBIWQygNmvQblLtMAxvEuh2XUt/OTwbCBERVkLqIQ96jTap/pkeH4XObeedowqO0iM5aqRH1Q9ITpqofPFkYQiFnqenRv5cljG1lxFMkS8D9qDEIlxMTWaLsb0A==',key_name='tempest-keypair-1203087070',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0108444c01e94416984b083707102c58',ramdisk_id='',reservation_id='r-j3sryyxs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1183582238',owner_user_name='tempest-TaggedBootDevicesTest-1183582238-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T15:40:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8fb5815faed648a1a207c402eafca90e',uuid=b714fb94-fcc7-40ae-b3a9-d8c9a60008f1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e1ac011f-d965-4d4c-b4c8-aa9bf5201518", "address": "fa:16:3e:7f:e1:ea", "network": {"id": "26bf803a-6aa2-4e87-b407-caee3f8f7d3d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1638676687", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0108444c01e94416984b083707102c58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1ac011f-d9", "ovs_interfaceid": "e1ac011f-d965-4d4c-b4c8-aa9bf5201518", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75176) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 15:40:33 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Converting VIF {"id": "e1ac011f-d965-4d4c-b4c8-aa9bf5201518", "address": "fa:16:3e:7f:e1:ea", "network": {"id": "26bf803a-6aa2-4e87-b407-caee3f8f7d3d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1638676687", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0108444c01e94416984b083707102c58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1ac011f-d9", "ovs_interfaceid": "e1ac011f-d965-4d4c-b4c8-aa9bf5201518", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:40:33 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:e1:ea,bridge_name='br-int',has_traffic_filtering=True,id=e1ac011f-d965-4d4c-b4c8-aa9bf5201518,network=Network(26bf803a-6aa2-4e87-b407-caee3f8f7d3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape1ac011f-d9') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:40:33 user nova-compute[75176]: DEBUG os_vif [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:e1:ea,bridge_name='br-int',has_traffic_filtering=True,id=e1ac011f-d965-4d4c-b4c8-aa9bf5201518,network=Network(26bf803a-6aa2-4e87-b407-caee3f8f7d3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape1ac011f-d9') {{(pid=75176) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 15:40:33 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:33 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:40:33 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 15:40:33 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:33 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '55959224-8479-5280-b9f7-6695350ba5e3', '_type': 'linux-noop'}}, row=False) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:40:33 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:33 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:40:33 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:33 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:33 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape1ac011f-d9, may_exist=True, interface_attrs={}) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:40:33 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape1ac011f-d9, col_values=(('qos', UUID('abfec2c4-a57b-4c05-85d6-967f9386db0e')),), if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:40:33 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape1ac011f-d9, col_values=(('external_ids', {'iface-id': 'e1ac011f-d965-4d4c-b4c8-aa9bf5201518', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7f:e1:ea', 'vm-uuid': 'b714fb94-fcc7-40ae-b3a9-d8c9a60008f1'}),), if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:40:33 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:33 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:40:33 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:33 user nova-compute[75176]: INFO os_vif [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:e1:ea,bridge_name='br-int',has_traffic_filtering=True,id=e1ac011f-d965-4d4c-b4c8-aa9bf5201518,network=Network(26bf803a-6aa2-4e87-b407-caee3f8f7d3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape1ac011f-d9')
Nov 28 15:40:33 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T15:39:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1004277851',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1004277851',id=11,image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAt/lLowBIWQygNmvQblLtMAxvEuh2XUt/OTwbCBERVkLqIQ96jTap/pkeH4XObeedowqO0iM5aqRH1Q9ITpqofPFkYQiFnqenRv5cljG1lxFMkS8D9qDEIlxMTWaLsb0A==',key_name='tempest-keypair-1203087070',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0108444c01e94416984b083707102c58',ramdisk_id='',reservation_id='r-j3sryyxs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1183582238',owner_user_name='tempest-TaggedBootDevicesTest-1183582238-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T15:40:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8fb5815faed648a1a207c402eafca90e',uuid=b714fb94-fcc7-40ae-b3a9-d8c9a60008f1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "61157920-954a-479e-bd66-b0746a7843a7", "address": "fa:16:3e:8f:4f:39", "network": {"id": "26bf803a-6aa2-4e87-b407-caee3f8f7d3d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1638676687", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0108444c01e94416984b083707102c58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61157920-95", "ovs_interfaceid": "61157920-954a-479e-bd66-b0746a7843a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75176) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 15:40:33 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Converting VIF {"id": "61157920-954a-479e-bd66-b0746a7843a7", "address": "fa:16:3e:8f:4f:39", "network": {"id": "26bf803a-6aa2-4e87-b407-caee3f8f7d3d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1638676687", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0108444c01e94416984b083707102c58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61157920-95", "ovs_interfaceid": "61157920-954a-479e-bd66-b0746a7843a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:40:33 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:4f:39,bridge_name='br-int',has_traffic_filtering=True,id=61157920-954a-479e-bd66-b0746a7843a7,network=Network(26bf803a-6aa2-4e87-b407-caee3f8f7d3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap61157920-95') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:40:33 user nova-compute[75176]: DEBUG os_vif [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:4f:39,bridge_name='br-int',has_traffic_filtering=True,id=61157920-954a-479e-bd66-b0746a7843a7,network=Network(26bf803a-6aa2-4e87-b407-caee3f8f7d3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap61157920-95') {{(pid=75176) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 15:40:33 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:33 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:40:33 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 15:40:33 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:33 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a40af37b-5aa5-52c1-a778-121f748d3f99', '_type': 'linux-noop'}}, row=False) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:40:33 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:33 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:40:33 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:33 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:33 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap61157920-95, may_exist=True, interface_attrs={}) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:40:33 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap61157920-95, col_values=(('qos', UUID('6d37c9be-a14a-434c-be28-0b1e619e9459')),), if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:40:33 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap61157920-95, col_values=(('external_ids', {'iface-id': '61157920-954a-479e-bd66-b0746a7843a7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8f:4f:39', 'vm-uuid': 'b714fb94-fcc7-40ae-b3a9-d8c9a60008f1'}),), if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:40:33 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:33 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:40:33 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:33 user nova-compute[75176]: INFO os_vif [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:4f:39,bridge_name='br-int',has_traffic_filtering=True,id=61157920-954a-479e-bd66-b0746a7843a7,network=Network(26bf803a-6aa2-4e87-b407-caee3f8f7d3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap61157920-95')
Nov 28 15:40:33 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T15:39:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1004277851',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1004277851',id=11,image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAt/lLowBIWQygNmvQblLtMAxvEuh2XUt/OTwbCBERVkLqIQ96jTap/pkeH4XObeedowqO0iM5aqRH1Q9ITpqofPFkYQiFnqenRv5cljG1lxFMkS8D9qDEIlxMTWaLsb0A==',key_name='tempest-keypair-1203087070',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0108444c01e94416984b083707102c58',ramdisk_id='',reservation_id='r-j3sryyxs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1183582238',owner_user_name='tempest-TaggedBootDevicesTest-1183582238-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T15:40:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8fb5815faed648a1a207c402eafca90e',uuid=b714fb94-fcc7-40ae-b3a9-d8c9a60008f1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "04db431e-5bc8-4450-9bdd-82369fafba70", "address": "fa:16:3e:15:71:6f", "network": {"id": "26bf803a-6aa2-4e87-b407-caee3f8f7d3d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1638676687", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0108444c01e94416984b083707102c58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04db431e-5b", "ovs_interfaceid": "04db431e-5bc8-4450-9bdd-82369fafba70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 15:40:33 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Converting VIF {"id": "04db431e-5bc8-4450-9bdd-82369fafba70", "address": "fa:16:3e:15:71:6f", "network": {"id": "26bf803a-6aa2-4e87-b407-caee3f8f7d3d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1638676687", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0108444c01e94416984b083707102c58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04db431e-5b", "ovs_interfaceid": "04db431e-5bc8-4450-9bdd-82369fafba70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:40:33 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:71:6f,bridge_name='br-int',has_traffic_filtering=True,id=04db431e-5bc8-4450-9bdd-82369fafba70,network=Network(26bf803a-6aa2-4e87-b407-caee3f8f7d3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04db431e-5b') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:40:33 user nova-compute[75176]: DEBUG os_vif [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:71:6f,bridge_name='br-int',has_traffic_filtering=True,id=04db431e-5bc8-4450-9bdd-82369fafba70,network=Network(26bf803a-6aa2-4e87-b407-caee3f8f7d3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04db431e-5b') {{(pid=75176) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 15:40:33 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:33 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:40:33 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 15:40:33 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:33 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ce80295a-f519-5bc1-a87c-d99062a17b03', '_type': 'linux-noop'}}, row=False) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:40:33 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:33 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:40:33 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:33 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:33 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap04db431e-5b, may_exist=True, interface_attrs={}) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:40:33 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap04db431e-5b, col_values=(('qos', UUID('8a9c4a60-72ad-438f-9cd5-335f845473d2')),), if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:40:33 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap04db431e-5b, col_values=(('external_ids', {'iface-id': '04db431e-5bc8-4450-9bdd-82369fafba70', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:15:71:6f', 'vm-uuid': 'b714fb94-fcc7-40ae-b3a9-d8c9a60008f1'}),), if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:40:33 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:33 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:40:33 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:33 user nova-compute[75176]: INFO os_vif [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:71:6f,bridge_name='br-int',has_traffic_filtering=True,id=04db431e-5bc8-4450-9bdd-82369fafba70,network=Network(26bf803a-6aa2-4e87-b407-caee3f8f7d3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04db431e-5b')
Nov 28 15:40:33 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T15:39:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1004277851',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1004277851',id=11,image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAt/lLowBIWQygNmvQblLtMAxvEuh2XUt/OTwbCBERVkLqIQ96jTap/pkeH4XObeedowqO0iM5aqRH1Q9ITpqofPFkYQiFnqenRv5cljG1lxFMkS8D9qDEIlxMTWaLsb0A==',key_name='tempest-keypair-1203087070',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0108444c01e94416984b083707102c58',ramdisk_id='',reservation_id='r-j3sryyxs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1183582238',owner_user_name='tempest-TaggedBootDevicesTest-1183582238-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T15:40:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8fb5815faed648a1a207c402eafca90e',uuid=b714fb94-fcc7-40ae-b3a9-d8c9a60008f1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0bc36ba8-7fc6-47b2-b7b1-08a445625b46", "address": "fa:16:3e:76:ce:76", "network": {"id": "26bf803a-6aa2-4e87-b407-caee3f8f7d3d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1638676687", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0108444c01e94416984b083707102c58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bc36ba8-7f", "ovs_interfaceid": "0bc36ba8-7fc6-47b2-b7b1-08a445625b46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 15:40:33 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Converting VIF {"id": "0bc36ba8-7fc6-47b2-b7b1-08a445625b46", "address": "fa:16:3e:76:ce:76", "network": {"id": "26bf803a-6aa2-4e87-b407-caee3f8f7d3d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1638676687", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0108444c01e94416984b083707102c58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bc36ba8-7f", "ovs_interfaceid": "0bc36ba8-7fc6-47b2-b7b1-08a445625b46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:40:33 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:ce:76,bridge_name='br-int',has_traffic_filtering=True,id=0bc36ba8-7fc6-47b2-b7b1-08a445625b46,network=Network(26bf803a-6aa2-4e87-b407-caee3f8f7d3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bc36ba8-7f') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:40:33 user nova-compute[75176]: DEBUG os_vif [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:ce:76,bridge_name='br-int',has_traffic_filtering=True,id=0bc36ba8-7fc6-47b2-b7b1-08a445625b46,network=Network(26bf803a-6aa2-4e87-b407-caee3f8f7d3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bc36ba8-7f') {{(pid=75176) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 15:40:33 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:33 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:40:33 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 15:40:33 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:33 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9cfe6274-d838-5cb5-aa7c-0ff7854ad835', '_type': 'linux-noop'}}, row=False) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:40:33 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:33 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:40:33 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:33 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:33 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0bc36ba8-7f, may_exist=True, interface_attrs={}) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:40:33 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0bc36ba8-7f, col_values=(('qos', UUID('d39ad5ff-2054-48bd-9fd2-3f4b7bf9d3fa')),), if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:40:33 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0bc36ba8-7f, col_values=(('external_ids', {'iface-id': '0bc36ba8-7fc6-47b2-b7b1-08a445625b46', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:76:ce:76', 'vm-uuid': 'b714fb94-fcc7-40ae-b3a9-d8c9a60008f1'}),), if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:40:33 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:33 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:40:34 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:34 user nova-compute[75176]: INFO os_vif [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:ce:76,bridge_name='br-int',has_traffic_filtering=True,id=0bc36ba8-7fc6-47b2-b7b1-08a445625b46,network=Network(26bf803a-6aa2-4e87-b407-caee3f8f7d3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bc36ba8-7f')
Nov 28 15:40:34 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T15:39:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1004277851',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1004277851',id=11,image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAt/lLowBIWQygNmvQblLtMAxvEuh2XUt/OTwbCBERVkLqIQ96jTap/pkeH4XObeedowqO0iM5aqRH1Q9ITpqofPFkYQiFnqenRv5cljG1lxFMkS8D9qDEIlxMTWaLsb0A==',key_name='tempest-keypair-1203087070',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0108444c01e94416984b083707102c58',ramdisk_id='',reservation_id='r-j3sryyxs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1183582238',owner_user_name='tempest-TaggedBootDevicesTest-1183582238-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T15:40:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8fb5815faed648a1a207c402eafca90e',uuid=b714fb94-fcc7-40ae-b3a9-d8c9a60008f1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0c08ccbe-f3de-4aed-b641-8e2b58bd73a0", "address": "fa:16:3e:59:54:f2", "network": {"id": "3936aa29-a691-4362-8bd9-536545b14473", "bridge": "br-int", "label": "tempest-device-tagging-net2-1089118081", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0108444c01e94416984b083707102c58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c08ccbe-f3", "ovs_interfaceid": "0c08ccbe-f3de-4aed-b641-8e2b58bd73a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 15:40:34 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Converting VIF {"id": "0c08ccbe-f3de-4aed-b641-8e2b58bd73a0", "address": "fa:16:3e:59:54:f2", "network": {"id": "3936aa29-a691-4362-8bd9-536545b14473", "bridge": "br-int", "label": "tempest-device-tagging-net2-1089118081", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0108444c01e94416984b083707102c58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c08ccbe-f3", "ovs_interfaceid": "0c08ccbe-f3de-4aed-b641-8e2b58bd73a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:40:34 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:54:f2,bridge_name='br-int',has_traffic_filtering=True,id=0c08ccbe-f3de-4aed-b641-8e2b58bd73a0,network=Network(3936aa29-a691-4362-8bd9-536545b14473),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c08ccbe-f3') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:40:34 user nova-compute[75176]: DEBUG os_vif [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:54:f2,bridge_name='br-int',has_traffic_filtering=True,id=0c08ccbe-f3de-4aed-b641-8e2b58bd73a0,network=Network(3936aa29-a691-4362-8bd9-536545b14473),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c08ccbe-f3') {{(pid=75176) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 15:40:34 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:34 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:40:34 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 15:40:34 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:34 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '46b5189b-3286-5acf-bbe2-51f6203814fa', '_type': 'linux-noop'}}, row=False) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:40:34 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:34 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:40:34 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:34 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:34 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:34 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:34 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0c08ccbe-f3, may_exist=True, interface_attrs={}) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:40:34 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0c08ccbe-f3, col_values=(('qos', UUID('8ab9b48e-85d2-4c0b-b4bd-23a8f4791f80')),), if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:40:34 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0c08ccbe-f3, col_values=(('external_ids', {'iface-id': '0c08ccbe-f3de-4aed-b641-8e2b58bd73a0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:59:54:f2', 'vm-uuid': 'b714fb94-fcc7-40ae-b3a9-d8c9a60008f1'}),), if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:40:34 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:34 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:40:34 user nova-compute[75176]: DEBUG nova.compute.manager [req-be34a46b-030b-4179-ae86-338762189bf8 req-fdc0d150-3712-447e-8029-5725781353a8 service nova] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] Received event network-vif-plugged-99a8dbf9-5502-440a-a03d-cd52337b3009 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:40:34 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-be34a46b-030b-4179-ae86-338762189bf8 req-fdc0d150-3712-447e-8029-5725781353a8 service nova] Acquiring lock "041af768-197b-4c76-a5a1-28e2dc8255bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:40:34 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-be34a46b-030b-4179-ae86-338762189bf8 req-fdc0d150-3712-447e-8029-5725781353a8 service nova] Lock "041af768-197b-4c76-a5a1-28e2dc8255bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:40:34 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-be34a46b-030b-4179-ae86-338762189bf8 req-fdc0d150-3712-447e-8029-5725781353a8 service nova] Lock "041af768-197b-4c76-a5a1-28e2dc8255bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:40:34 user nova-compute[75176]: DEBUG nova.compute.manager [req-be34a46b-030b-4179-ae86-338762189bf8 req-fdc0d150-3712-447e-8029-5725781353a8 service nova] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] No waiting events found dispatching network-vif-plugged-99a8dbf9-5502-440a-a03d-cd52337b3009 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:40:34 user nova-compute[75176]: WARNING nova.compute.manager [req-be34a46b-030b-4179-ae86-338762189bf8 req-fdc0d150-3712-447e-8029-5725781353a8 service nova] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] Received unexpected event network-vif-plugged-99a8dbf9-5502-440a-a03d-cd52337b3009 for instance with vm_state building and task_state spawning.
Nov 28 15:40:34 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:34 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:34 user nova-compute[75176]: INFO os_vif [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:54:f2,bridge_name='br-int',has_traffic_filtering=True,id=0c08ccbe-f3de-4aed-b641-8e2b58bd73a0,network=Network(3936aa29-a691-4362-8bd9-536545b14473),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c08ccbe-f3')
Nov 28 15:40:34 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T15:39:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1004277851',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1004277851',id=11,image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAt/lLowBIWQygNmvQblLtMAxvEuh2XUt/OTwbCBERVkLqIQ96jTap/pkeH4XObeedowqO0iM5aqRH1Q9ITpqofPFkYQiFnqenRv5cljG1lxFMkS8D9qDEIlxMTWaLsb0A==',key_name='tempest-keypair-1203087070',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0108444c01e94416984b083707102c58',ramdisk_id='',reservation_id='r-j3sryyxs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1183582238',owner_user_name='tempest-TaggedBootDevicesTest-1183582238-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T15:40:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8fb5815faed648a1a207c402eafca90e',uuid=b714fb94-fcc7-40ae-b3a9-d8c9a60008f1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e0b49239-50a0-4864-9e92-22bddcbe7d21", "address": "fa:16:3e:d8:78:24", "network": {"id": "3936aa29-a691-4362-8bd9-536545b14473", "bridge": "br-int", "label": "tempest-device-tagging-net2-1089118081", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0108444c01e94416984b083707102c58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0b49239-50", "ovs_interfaceid": "e0b49239-50a0-4864-9e92-22bddcbe7d21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 15:40:34 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Converting VIF {"id": "e0b49239-50a0-4864-9e92-22bddcbe7d21", "address": "fa:16:3e:d8:78:24", "network": {"id": "3936aa29-a691-4362-8bd9-536545b14473", "bridge": "br-int", "label": "tempest-device-tagging-net2-1089118081", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0108444c01e94416984b083707102c58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0b49239-50", "ovs_interfaceid": "e0b49239-50a0-4864-9e92-22bddcbe7d21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:40:34 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:78:24,bridge_name='br-int',has_traffic_filtering=True,id=e0b49239-50a0-4864-9e92-22bddcbe7d21,network=Network(3936aa29-a691-4362-8bd9-536545b14473),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0b49239-50') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:40:34 user nova-compute[75176]: DEBUG os_vif [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:78:24,bridge_name='br-int',has_traffic_filtering=True,id=e0b49239-50a0-4864-9e92-22bddcbe7d21,network=Network(3936aa29-a691-4362-8bd9-536545b14473),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0b49239-50') {{(pid=75176) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 15:40:34 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:34 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:40:34 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 15:40:34 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:34 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '24bb6bd0-25d1-5fd7-973e-dd68a6ec46e6', '_type': 'linux-noop'}}, row=False) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:40:34 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:34 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:34 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:40:34 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:34 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:34 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:34 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape0b49239-50, may_exist=True, interface_attrs={}) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:40:34 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape0b49239-50, col_values=(('qos', UUID('2c92a616-28dd-460d-8f78-9404ac8f7929')),), if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:40:34 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape0b49239-50, col_values=(('external_ids', {'iface-id': 'e0b49239-50a0-4864-9e92-22bddcbe7d21', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d8:78:24', 'vm-uuid': 'b714fb94-fcc7-40ae-b3a9-d8c9a60008f1'}),), if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:40:34 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:34 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:40:34 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:34 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:34 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:35 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:35 user nova-compute[75176]: INFO os_vif [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:78:24,bridge_name='br-int',has_traffic_filtering=True,id=e0b49239-50a0-4864-9e92-22bddcbe7d21,network=Network(3936aa29-a691-4362-8bd9-536545b14473),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0b49239-50')
Nov 28 15:40:35 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:35 user nova-compute[75176]: DEBUG nova.compute.manager [req-053ec54f-a5d3-4344-b752-f21d16acaa71 req-65a63c17-c94c-4693-bb86-2c6a04101801 service nova] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] Received event network-vif-plugged-0ac967e7-41bc-4751-a2bc-499ffbface15 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:40:35 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-053ec54f-a5d3-4344-b752-f21d16acaa71 req-65a63c17-c94c-4693-bb86-2c6a04101801 service nova] Acquiring lock "041af768-197b-4c76-a5a1-28e2dc8255bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:40:35 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-053ec54f-a5d3-4344-b752-f21d16acaa71 req-65a63c17-c94c-4693-bb86-2c6a04101801 service nova] Lock "041af768-197b-4c76-a5a1-28e2dc8255bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:40:35 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-053ec54f-a5d3-4344-b752-f21d16acaa71 req-65a63c17-c94c-4693-bb86-2c6a04101801 service nova] Lock "041af768-197b-4c76-a5a1-28e2dc8255bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:40:35 user nova-compute[75176]: DEBUG nova.compute.manager [req-053ec54f-a5d3-4344-b752-f21d16acaa71 req-65a63c17-c94c-4693-bb86-2c6a04101801 service nova] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] No waiting events found dispatching network-vif-plugged-0ac967e7-41bc-4751-a2bc-499ffbface15 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:40:35 user nova-compute[75176]: WARNING nova.compute.manager [req-053ec54f-a5d3-4344-b752-f21d16acaa71 req-65a63c17-c94c-4693-bb86-2c6a04101801 service nova] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] Received unexpected event network-vif-plugged-0ac967e7-41bc-4751-a2bc-499ffbface15 for instance with vm_state building and task_state spawning.
Nov 28 15:40:35 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] No BDM found with device name hda, not building metadata. {{(pid=75176) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 15:40:35 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75176) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 15:40:35 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] No VIF found with MAC fa:16:3e:63:83:5b, not building metadata {{(pid=75176) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 15:40:35 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] No VIF found with MAC fa:16:3e:76:ce:76, not building metadata {{(pid=75176) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 15:40:35 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] Using config drive
Nov 28 15:40:35 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:35 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:35 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:35 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:35 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] Creating config drive at /opt/stack/data/nova/instances/b714fb94-fcc7-40ae-b3a9-d8c9a60008f1/disk.config
Nov 28 15:40:35 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/b714fb94-fcc7-40ae-b3a9-d8c9a60008f1/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpm5so8293 {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:40:35 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:35 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/b714fb94-fcc7-40ae-b3a9-d8c9a60008f1/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpm5so8293" returned: 0 in 0.054s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:40:35 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:35 user nova-compute[75176]: DEBUG nova.compute.manager [req-0347433d-c77a-4d49-b948-ff15cb01783a req-530632bc-948b-404e-bbc6-cd539f5925ac service nova] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] Received event network-vif-plugged-3a800e7a-5628-4668-ae3e-d49b537f7a62 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:40:35 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-0347433d-c77a-4d49-b948-ff15cb01783a req-530632bc-948b-404e-bbc6-cd539f5925ac service nova] Acquiring lock "041af768-197b-4c76-a5a1-28e2dc8255bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:40:35 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-0347433d-c77a-4d49-b948-ff15cb01783a req-530632bc-948b-404e-bbc6-cd539f5925ac service nova] Lock "041af768-197b-4c76-a5a1-28e2dc8255bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:40:35 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-0347433d-c77a-4d49-b948-ff15cb01783a req-530632bc-948b-404e-bbc6-cd539f5925ac service nova] Lock "041af768-197b-4c76-a5a1-28e2dc8255bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:40:35 user nova-compute[75176]: DEBUG nova.compute.manager [req-0347433d-c77a-4d49-b948-ff15cb01783a req-530632bc-948b-404e-bbc6-cd539f5925ac service nova] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] No waiting events found dispatching network-vif-plugged-3a800e7a-5628-4668-ae3e-d49b537f7a62 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:40:35 user nova-compute[75176]: WARNING nova.compute.manager [req-0347433d-c77a-4d49-b948-ff15cb01783a req-530632bc-948b-404e-bbc6-cd539f5925ac service nova] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] Received unexpected event network-vif-plugged-3a800e7a-5628-4668-ae3e-d49b537f7a62 for instance with vm_state building and task_state spawning.
Nov 28 15:40:35 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:35 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:35 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:36 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:36 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:36 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:36 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:36 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:36 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:36 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:36 user nova-compute[75176]: DEBUG nova.compute.manager [req-b0b6b991-c02b-40d8-8102-ed690c48bc69 req-909ceedf-b280-41cd-8b66-e258d12255b0 service nova] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] Received event network-vif-plugged-99a8dbf9-5502-440a-a03d-cd52337b3009 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:40:36 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-b0b6b991-c02b-40d8-8102-ed690c48bc69 req-909ceedf-b280-41cd-8b66-e258d12255b0 service nova] Acquiring lock "041af768-197b-4c76-a5a1-28e2dc8255bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:40:36 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-b0b6b991-c02b-40d8-8102-ed690c48bc69 req-909ceedf-b280-41cd-8b66-e258d12255b0 service nova] Lock "041af768-197b-4c76-a5a1-28e2dc8255bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:40:36 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-b0b6b991-c02b-40d8-8102-ed690c48bc69 req-909ceedf-b280-41cd-8b66-e258d12255b0 service nova] Lock "041af768-197b-4c76-a5a1-28e2dc8255bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:40:36 user nova-compute[75176]: DEBUG nova.compute.manager [req-b0b6b991-c02b-40d8-8102-ed690c48bc69 req-909ceedf-b280-41cd-8b66-e258d12255b0 service nova] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] No waiting events found dispatching network-vif-plugged-99a8dbf9-5502-440a-a03d-cd52337b3009 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:40:36 user nova-compute[75176]: WARNING nova.compute.manager [req-b0b6b991-c02b-40d8-8102-ed690c48bc69 req-909ceedf-b280-41cd-8b66-e258d12255b0 service nova] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] Received unexpected event network-vif-plugged-99a8dbf9-5502-440a-a03d-cd52337b3009 for instance with vm_state building and task_state spawning.
Nov 28 15:40:36 user nova-compute[75176]: DEBUG nova.compute.manager [req-b0b6b991-c02b-40d8-8102-ed690c48bc69 req-909ceedf-b280-41cd-8b66-e258d12255b0 service nova] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] Received event network-vif-plugged-6c94b138-6202-4fb7-92c7-b3744cd8d19d {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:40:36 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-b0b6b991-c02b-40d8-8102-ed690c48bc69 req-909ceedf-b280-41cd-8b66-e258d12255b0 service nova] Acquiring lock "041af768-197b-4c76-a5a1-28e2dc8255bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:40:36 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-b0b6b991-c02b-40d8-8102-ed690c48bc69 req-909ceedf-b280-41cd-8b66-e258d12255b0 service nova] Lock "041af768-197b-4c76-a5a1-28e2dc8255bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:40:36 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-b0b6b991-c02b-40d8-8102-ed690c48bc69 req-909ceedf-b280-41cd-8b66-e258d12255b0 service nova] Lock "041af768-197b-4c76-a5a1-28e2dc8255bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:40:36 user nova-compute[75176]: DEBUG nova.compute.manager [req-b0b6b991-c02b-40d8-8102-ed690c48bc69 req-909ceedf-b280-41cd-8b66-e258d12255b0 service nova] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] No waiting events found dispatching network-vif-plugged-6c94b138-6202-4fb7-92c7-b3744cd8d19d {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:40:36 user nova-compute[75176]: WARNING nova.compute.manager [req-b0b6b991-c02b-40d8-8102-ed690c48bc69 req-909ceedf-b280-41cd-8b66-e258d12255b0 service nova] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] Received unexpected event network-vif-plugged-6c94b138-6202-4fb7-92c7-b3744cd8d19d for instance with vm_state building and task_state spawning.
Nov 28 15:40:36 user nova-compute[75176]: DEBUG nova.compute.manager [req-b0b6b991-c02b-40d8-8102-ed690c48bc69 req-909ceedf-b280-41cd-8b66-e258d12255b0 service nova] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] Received event network-vif-plugged-6c94b138-6202-4fb7-92c7-b3744cd8d19d {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:40:36 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-b0b6b991-c02b-40d8-8102-ed690c48bc69 req-909ceedf-b280-41cd-8b66-e258d12255b0 service nova] Acquiring lock "041af768-197b-4c76-a5a1-28e2dc8255bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:40:36 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-b0b6b991-c02b-40d8-8102-ed690c48bc69 req-909ceedf-b280-41cd-8b66-e258d12255b0 service nova] Lock "041af768-197b-4c76-a5a1-28e2dc8255bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:40:36 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-b0b6b991-c02b-40d8-8102-ed690c48bc69 req-909ceedf-b280-41cd-8b66-e258d12255b0 service nova] Lock "041af768-197b-4c76-a5a1-28e2dc8255bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:40:36 user nova-compute[75176]: DEBUG nova.compute.manager [req-b0b6b991-c02b-40d8-8102-ed690c48bc69 req-909ceedf-b280-41cd-8b66-e258d12255b0 service nova] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] No waiting events found dispatching network-vif-plugged-6c94b138-6202-4fb7-92c7-b3744cd8d19d {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:40:36 user nova-compute[75176]: WARNING nova.compute.manager [req-b0b6b991-c02b-40d8-8102-ed690c48bc69 req-909ceedf-b280-41cd-8b66-e258d12255b0 service nova] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] Received unexpected event network-vif-plugged-6c94b138-6202-4fb7-92c7-b3744cd8d19d for instance with vm_state building and task_state spawning.
Nov 28 15:40:36 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:36 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:36 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:36 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:37 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:37 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:37 user nova-compute[75176]: DEBUG nova.compute.manager [req-9c5f012a-197d-435a-8ac3-bda2ad7c561d req-150abf3e-867b-4a49-b454-460492bd5cd1 service nova] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] Received event network-vif-plugged-0ac967e7-41bc-4751-a2bc-499ffbface15 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:40:37 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-9c5f012a-197d-435a-8ac3-bda2ad7c561d req-150abf3e-867b-4a49-b454-460492bd5cd1 service nova] Acquiring lock "041af768-197b-4c76-a5a1-28e2dc8255bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:40:37 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-9c5f012a-197d-435a-8ac3-bda2ad7c561d req-150abf3e-867b-4a49-b454-460492bd5cd1 service nova] Lock "041af768-197b-4c76-a5a1-28e2dc8255bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:40:37 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-9c5f012a-197d-435a-8ac3-bda2ad7c561d req-150abf3e-867b-4a49-b454-460492bd5cd1 service nova] Lock "041af768-197b-4c76-a5a1-28e2dc8255bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:40:37 user nova-compute[75176]: DEBUG nova.compute.manager [req-9c5f012a-197d-435a-8ac3-bda2ad7c561d req-150abf3e-867b-4a49-b454-460492bd5cd1 service nova] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] No waiting events found dispatching network-vif-plugged-0ac967e7-41bc-4751-a2bc-499ffbface15 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:40:37 user nova-compute[75176]: WARNING nova.compute.manager [req-9c5f012a-197d-435a-8ac3-bda2ad7c561d req-150abf3e-867b-4a49-b454-460492bd5cd1 service nova] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] Received unexpected event network-vif-plugged-0ac967e7-41bc-4751-a2bc-499ffbface15 for instance with vm_state building and task_state spawning.
Nov 28 15:40:37 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:37 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:37 user nova-compute[75176]: DEBUG nova.compute.manager [req-db6d8b9b-8a08-4cab-ad26-d21bfd0bb70b req-8ced993c-fdca-4dfc-bef8-943af6d59d89 service nova] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] Received event network-vif-plugged-3a800e7a-5628-4668-ae3e-d49b537f7a62 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:40:37 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-db6d8b9b-8a08-4cab-ad26-d21bfd0bb70b req-8ced993c-fdca-4dfc-bef8-943af6d59d89 service nova] Acquiring lock "041af768-197b-4c76-a5a1-28e2dc8255bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:40:37 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-db6d8b9b-8a08-4cab-ad26-d21bfd0bb70b req-8ced993c-fdca-4dfc-bef8-943af6d59d89 service nova] Lock "041af768-197b-4c76-a5a1-28e2dc8255bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:40:37 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-db6d8b9b-8a08-4cab-ad26-d21bfd0bb70b req-8ced993c-fdca-4dfc-bef8-943af6d59d89 service nova] Lock "041af768-197b-4c76-a5a1-28e2dc8255bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:40:37 user nova-compute[75176]: DEBUG nova.compute.manager [req-db6d8b9b-8a08-4cab-ad26-d21bfd0bb70b req-8ced993c-fdca-4dfc-bef8-943af6d59d89 service nova] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] No waiting events found dispatching network-vif-plugged-3a800e7a-5628-4668-ae3e-d49b537f7a62 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:40:37 user nova-compute[75176]: WARNING nova.compute.manager [req-db6d8b9b-8a08-4cab-ad26-d21bfd0bb70b req-8ced993c-fdca-4dfc-bef8-943af6d59d89 service nova] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] Received unexpected event network-vif-plugged-3a800e7a-5628-4668-ae3e-d49b537f7a62 for instance with vm_state building and task_state spawning.
Nov 28 15:40:37 user nova-compute[75176]: DEBUG nova.compute.manager [req-db6d8b9b-8a08-4cab-ad26-d21bfd0bb70b req-8ced993c-fdca-4dfc-bef8-943af6d59d89 service nova] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] Received event network-vif-plugged-d9a60043-45d0-46f1-8d0f-ad1c7b55fa06 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:40:37 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-db6d8b9b-8a08-4cab-ad26-d21bfd0bb70b req-8ced993c-fdca-4dfc-bef8-943af6d59d89 service nova] Acquiring lock "041af768-197b-4c76-a5a1-28e2dc8255bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:40:37 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-db6d8b9b-8a08-4cab-ad26-d21bfd0bb70b req-8ced993c-fdca-4dfc-bef8-943af6d59d89 service nova] Lock "041af768-197b-4c76-a5a1-28e2dc8255bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:40:37 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-db6d8b9b-8a08-4cab-ad26-d21bfd0bb70b req-8ced993c-fdca-4dfc-bef8-943af6d59d89 service nova] Lock "041af768-197b-4c76-a5a1-28e2dc8255bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:40:37 user nova-compute[75176]: DEBUG nova.compute.manager [req-db6d8b9b-8a08-4cab-ad26-d21bfd0bb70b req-8ced993c-fdca-4dfc-bef8-943af6d59d89 service nova] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] No waiting events found dispatching network-vif-plugged-d9a60043-45d0-46f1-8d0f-ad1c7b55fa06 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:40:37 user nova-compute[75176]: WARNING nova.compute.manager [req-db6d8b9b-8a08-4cab-ad26-d21bfd0bb70b req-8ced993c-fdca-4dfc-bef8-943af6d59d89 service nova] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] Received unexpected event network-vif-plugged-d9a60043-45d0-46f1-8d0f-ad1c7b55fa06 for instance with vm_state building and task_state spawning.
Nov 28 15:40:37 user nova-compute[75176]: DEBUG nova.compute.manager [req-db6d8b9b-8a08-4cab-ad26-d21bfd0bb70b req-8ced993c-fdca-4dfc-bef8-943af6d59d89 service nova] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] Received event network-vif-plugged-d9a60043-45d0-46f1-8d0f-ad1c7b55fa06 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:40:37 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-db6d8b9b-8a08-4cab-ad26-d21bfd0bb70b req-8ced993c-fdca-4dfc-bef8-943af6d59d89 service nova] Acquiring lock "041af768-197b-4c76-a5a1-28e2dc8255bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:40:37 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-db6d8b9b-8a08-4cab-ad26-d21bfd0bb70b req-8ced993c-fdca-4dfc-bef8-943af6d59d89 service nova] Lock "041af768-197b-4c76-a5a1-28e2dc8255bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:40:37 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-db6d8b9b-8a08-4cab-ad26-d21bfd0bb70b req-8ced993c-fdca-4dfc-bef8-943af6d59d89 service nova] Lock "041af768-197b-4c76-a5a1-28e2dc8255bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:40:37 user nova-compute[75176]: DEBUG nova.compute.manager [req-db6d8b9b-8a08-4cab-ad26-d21bfd0bb70b req-8ced993c-fdca-4dfc-bef8-943af6d59d89 service nova] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] No waiting events found dispatching network-vif-plugged-d9a60043-45d0-46f1-8d0f-ad1c7b55fa06 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:40:37 user nova-compute[75176]: WARNING nova.compute.manager [req-db6d8b9b-8a08-4cab-ad26-d21bfd0bb70b req-8ced993c-fdca-4dfc-bef8-943af6d59d89 service nova] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] Received unexpected event network-vif-plugged-d9a60043-45d0-46f1-8d0f-ad1c7b55fa06 for instance with vm_state building and task_state spawning.
Nov 28 15:40:37 user nova-compute[75176]: DEBUG nova.compute.manager [req-db6d8b9b-8a08-4cab-ad26-d21bfd0bb70b req-8ced993c-fdca-4dfc-bef8-943af6d59d89 service nova] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] Received event network-vif-plugged-0c65b96a-0fce-4bff-b89c-443cc48f6995 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:40:37 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-db6d8b9b-8a08-4cab-ad26-d21bfd0bb70b req-8ced993c-fdca-4dfc-bef8-943af6d59d89 service nova] Acquiring lock "041af768-197b-4c76-a5a1-28e2dc8255bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:40:37 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-db6d8b9b-8a08-4cab-ad26-d21bfd0bb70b req-8ced993c-fdca-4dfc-bef8-943af6d59d89 service nova] Lock "041af768-197b-4c76-a5a1-28e2dc8255bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:40:37 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-db6d8b9b-8a08-4cab-ad26-d21bfd0bb70b req-8ced993c-fdca-4dfc-bef8-943af6d59d89 service nova] Lock "041af768-197b-4c76-a5a1-28e2dc8255bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:40:37 user nova-compute[75176]: DEBUG nova.compute.manager [req-db6d8b9b-8a08-4cab-ad26-d21bfd0bb70b req-8ced993c-fdca-4dfc-bef8-943af6d59d89 service nova] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] No waiting events found dispatching network-vif-plugged-0c65b96a-0fce-4bff-b89c-443cc48f6995 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:40:37 user nova-compute[75176]: WARNING nova.compute.manager [req-db6d8b9b-8a08-4cab-ad26-d21bfd0bb70b req-8ced993c-fdca-4dfc-bef8-943af6d59d89 service nova] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] Received unexpected event network-vif-plugged-0c65b96a-0fce-4bff-b89c-443cc48f6995 for instance with vm_state building and task_state spawning.
Nov 28 15:40:37 user nova-compute[75176]: DEBUG nova.compute.manager [req-db6d8b9b-8a08-4cab-ad26-d21bfd0bb70b req-8ced993c-fdca-4dfc-bef8-943af6d59d89 service nova] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] Received event network-vif-plugged-0c65b96a-0fce-4bff-b89c-443cc48f6995 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:40:37 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-db6d8b9b-8a08-4cab-ad26-d21bfd0bb70b req-8ced993c-fdca-4dfc-bef8-943af6d59d89 service nova] Acquiring lock "041af768-197b-4c76-a5a1-28e2dc8255bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:40:37 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-db6d8b9b-8a08-4cab-ad26-d21bfd0bb70b req-8ced993c-fdca-4dfc-bef8-943af6d59d89 service nova] Lock "041af768-197b-4c76-a5a1-28e2dc8255bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:40:37 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-db6d8b9b-8a08-4cab-ad26-d21bfd0bb70b req-8ced993c-fdca-4dfc-bef8-943af6d59d89 service nova] Lock "041af768-197b-4c76-a5a1-28e2dc8255bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:40:37 user nova-compute[75176]: DEBUG nova.compute.manager [req-db6d8b9b-8a08-4cab-ad26-d21bfd0bb70b req-8ced993c-fdca-4dfc-bef8-943af6d59d89 service nova] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] No waiting events found dispatching network-vif-plugged-0c65b96a-0fce-4bff-b89c-443cc48f6995 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:40:37 user nova-compute[75176]: WARNING nova.compute.manager [req-db6d8b9b-8a08-4cab-ad26-d21bfd0bb70b req-8ced993c-fdca-4dfc-bef8-943af6d59d89 service nova] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] Received unexpected event network-vif-plugged-0c65b96a-0fce-4bff-b89c-443cc48f6995 for instance with vm_state building and task_state spawning.
Nov 28 15:40:37 user nova-compute[75176]: DEBUG nova.compute.manager [req-db6d8b9b-8a08-4cab-ad26-d21bfd0bb70b req-8ced993c-fdca-4dfc-bef8-943af6d59d89 service nova] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] Received event network-vif-plugged-2df03152-b1aa-4794-965d-64886ac889ea {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:40:37 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-db6d8b9b-8a08-4cab-ad26-d21bfd0bb70b req-8ced993c-fdca-4dfc-bef8-943af6d59d89 service nova] Acquiring lock "041af768-197b-4c76-a5a1-28e2dc8255bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:40:37 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-db6d8b9b-8a08-4cab-ad26-d21bfd0bb70b req-8ced993c-fdca-4dfc-bef8-943af6d59d89 service nova] Lock "041af768-197b-4c76-a5a1-28e2dc8255bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:40:37 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-db6d8b9b-8a08-4cab-ad26-d21bfd0bb70b req-8ced993c-fdca-4dfc-bef8-943af6d59d89 service nova] Lock "041af768-197b-4c76-a5a1-28e2dc8255bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:40:37 user nova-compute[75176]: DEBUG nova.compute.manager [req-db6d8b9b-8a08-4cab-ad26-d21bfd0bb70b req-8ced993c-fdca-4dfc-bef8-943af6d59d89 service nova] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] No waiting events found dispatching network-vif-plugged-2df03152-b1aa-4794-965d-64886ac889ea {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:40:37 user nova-compute[75176]: WARNING nova.compute.manager [req-db6d8b9b-8a08-4cab-ad26-d21bfd0bb70b req-8ced993c-fdca-4dfc-bef8-943af6d59d89 service nova] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] Received unexpected event network-vif-plugged-2df03152-b1aa-4794-965d-64886ac889ea for instance with vm_state building and task_state spawning.
Nov 28 15:40:37 user nova-compute[75176]: DEBUG nova.compute.manager [req-db6d8b9b-8a08-4cab-ad26-d21bfd0bb70b req-8ced993c-fdca-4dfc-bef8-943af6d59d89 service nova] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] Received event network-vif-plugged-2df03152-b1aa-4794-965d-64886ac889ea {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:40:37 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-db6d8b9b-8a08-4cab-ad26-d21bfd0bb70b req-8ced993c-fdca-4dfc-bef8-943af6d59d89 service nova] Acquiring lock "041af768-197b-4c76-a5a1-28e2dc8255bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:40:37 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-db6d8b9b-8a08-4cab-ad26-d21bfd0bb70b req-8ced993c-fdca-4dfc-bef8-943af6d59d89 service nova] Lock "041af768-197b-4c76-a5a1-28e2dc8255bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:40:37 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-db6d8b9b-8a08-4cab-ad26-d21bfd0bb70b req-8ced993c-fdca-4dfc-bef8-943af6d59d89 service nova] Lock "041af768-197b-4c76-a5a1-28e2dc8255bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:40:37 user nova-compute[75176]: DEBUG nova.compute.manager [req-db6d8b9b-8a08-4cab-ad26-d21bfd0bb70b req-8ced993c-fdca-4dfc-bef8-943af6d59d89 service nova] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] No waiting events found dispatching network-vif-plugged-2df03152-b1aa-4794-965d-64886ac889ea {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:40:37 user nova-compute[75176]: WARNING nova.compute.manager [req-db6d8b9b-8a08-4cab-ad26-d21bfd0bb70b req-8ced993c-fdca-4dfc-bef8-943af6d59d89 service nova] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] Received unexpected event network-vif-plugged-2df03152-b1aa-4794-965d-64886ac889ea for instance with vm_state building and task_state spawning.
Nov 28 15:40:37 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:37 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:37 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:37 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:37 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:37 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:38 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:38 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:38 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:38 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:38 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:38 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:38 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:38 user nova-compute[75176]: DEBUG nova.compute.manager [req-ca901f17-4c06-4422-a820-812a568260da req-e565253c-b8ca-4f44-9426-fe786f213cc6 service nova] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] Received event network-vif-plugged-61157920-954a-479e-bd66-b0746a7843a7 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:40:38 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-ca901f17-4c06-4422-a820-812a568260da req-e565253c-b8ca-4f44-9426-fe786f213cc6 service nova] Acquiring lock "b714fb94-fcc7-40ae-b3a9-d8c9a60008f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:40:38 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-ca901f17-4c06-4422-a820-812a568260da req-e565253c-b8ca-4f44-9426-fe786f213cc6 service nova] Lock "b714fb94-fcc7-40ae-b3a9-d8c9a60008f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:40:38 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-ca901f17-4c06-4422-a820-812a568260da req-e565253c-b8ca-4f44-9426-fe786f213cc6 service nova] Lock "b714fb94-fcc7-40ae-b3a9-d8c9a60008f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:40:38 user nova-compute[75176]: DEBUG nova.compute.manager [req-ca901f17-4c06-4422-a820-812a568260da req-e565253c-b8ca-4f44-9426-fe786f213cc6 service nova] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] No waiting events found dispatching network-vif-plugged-61157920-954a-479e-bd66-b0746a7843a7 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:40:38 user nova-compute[75176]: WARNING nova.compute.manager [req-ca901f17-4c06-4422-a820-812a568260da req-e565253c-b8ca-4f44-9426-fe786f213cc6 service nova] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] Received unexpected event network-vif-plugged-61157920-954a-479e-bd66-b0746a7843a7 for instance with vm_state building and task_state spawning.
Nov 28 15:40:38 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:38 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:38 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:38 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:38 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:39 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:39 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:39 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:39 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:39 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:39 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:39 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:39 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:39 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:39 user nova-compute[75176]: DEBUG nova.compute.manager [req-8b0e19b9-694a-4d3e-ad39-b2b83ecefc2c req-272d43ce-0827-4582-a2af-3943ffc461f1 service nova] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] Received event network-vif-plugged-e1ac011f-d965-4d4c-b4c8-aa9bf5201518 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:40:39 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-8b0e19b9-694a-4d3e-ad39-b2b83ecefc2c req-272d43ce-0827-4582-a2af-3943ffc461f1 service nova] Acquiring lock "b714fb94-fcc7-40ae-b3a9-d8c9a60008f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:40:39 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-8b0e19b9-694a-4d3e-ad39-b2b83ecefc2c req-272d43ce-0827-4582-a2af-3943ffc461f1 service nova] Lock "b714fb94-fcc7-40ae-b3a9-d8c9a60008f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:40:39 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-8b0e19b9-694a-4d3e-ad39-b2b83ecefc2c req-272d43ce-0827-4582-a2af-3943ffc461f1 service nova] Lock "b714fb94-fcc7-40ae-b3a9-d8c9a60008f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:40:39 user nova-compute[75176]: DEBUG nova.compute.manager [req-8b0e19b9-694a-4d3e-ad39-b2b83ecefc2c req-272d43ce-0827-4582-a2af-3943ffc461f1 service nova] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] No waiting events found dispatching network-vif-plugged-e1ac011f-d965-4d4c-b4c8-aa9bf5201518 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:40:39 user nova-compute[75176]: WARNING nova.compute.manager [req-8b0e19b9-694a-4d3e-ad39-b2b83ecefc2c req-272d43ce-0827-4582-a2af-3943ffc461f1 service nova] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] Received unexpected event network-vif-plugged-e1ac011f-d965-4d4c-b4c8-aa9bf5201518 for instance with vm_state building and task_state spawning.
Nov 28 15:40:39 user nova-compute[75176]: DEBUG nova.compute.manager [req-8b0e19b9-694a-4d3e-ad39-b2b83ecefc2c req-272d43ce-0827-4582-a2af-3943ffc461f1 service nova] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] Received event network-vif-plugged-e1ac011f-d965-4d4c-b4c8-aa9bf5201518 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:40:39 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-8b0e19b9-694a-4d3e-ad39-b2b83ecefc2c req-272d43ce-0827-4582-a2af-3943ffc461f1 service nova] Acquiring lock "b714fb94-fcc7-40ae-b3a9-d8c9a60008f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:40:39 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-8b0e19b9-694a-4d3e-ad39-b2b83ecefc2c req-272d43ce-0827-4582-a2af-3943ffc461f1 service nova] Lock "b714fb94-fcc7-40ae-b3a9-d8c9a60008f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:40:39 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-8b0e19b9-694a-4d3e-ad39-b2b83ecefc2c req-272d43ce-0827-4582-a2af-3943ffc461f1 service nova] Lock "b714fb94-fcc7-40ae-b3a9-d8c9a60008f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:40:39 user nova-compute[75176]: DEBUG nova.compute.manager [req-8b0e19b9-694a-4d3e-ad39-b2b83ecefc2c req-272d43ce-0827-4582-a2af-3943ffc461f1 service nova] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] No waiting events found dispatching network-vif-plugged-e1ac011f-d965-4d4c-b4c8-aa9bf5201518 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:40:39 user nova-compute[75176]: WARNING nova.compute.manager [req-8b0e19b9-694a-4d3e-ad39-b2b83ecefc2c req-272d43ce-0827-4582-a2af-3943ffc461f1 service nova] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] Received unexpected event network-vif-plugged-e1ac011f-d965-4d4c-b4c8-aa9bf5201518 for instance with vm_state building and task_state spawning.
Nov 28 15:40:39 user nova-compute[75176]: DEBUG nova.compute.manager [req-8b0e19b9-694a-4d3e-ad39-b2b83ecefc2c req-272d43ce-0827-4582-a2af-3943ffc461f1 service nova] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] Received event network-vif-plugged-04db431e-5bc8-4450-9bdd-82369fafba70 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:40:39 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-8b0e19b9-694a-4d3e-ad39-b2b83ecefc2c req-272d43ce-0827-4582-a2af-3943ffc461f1 service nova] Acquiring lock "b714fb94-fcc7-40ae-b3a9-d8c9a60008f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:40:39 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-8b0e19b9-694a-4d3e-ad39-b2b83ecefc2c req-272d43ce-0827-4582-a2af-3943ffc461f1 service nova] Lock "b714fb94-fcc7-40ae-b3a9-d8c9a60008f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:40:39 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-8b0e19b9-694a-4d3e-ad39-b2b83ecefc2c req-272d43ce-0827-4582-a2af-3943ffc461f1 service nova] Lock "b714fb94-fcc7-40ae-b3a9-d8c9a60008f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:40:39 user nova-compute[75176]: DEBUG nova.compute.manager [req-8b0e19b9-694a-4d3e-ad39-b2b83ecefc2c req-272d43ce-0827-4582-a2af-3943ffc461f1 service nova] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] No waiting events found dispatching network-vif-plugged-04db431e-5bc8-4450-9bdd-82369fafba70 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:40:39 user nova-compute[75176]: WARNING nova.compute.manager [req-8b0e19b9-694a-4d3e-ad39-b2b83ecefc2c req-272d43ce-0827-4582-a2af-3943ffc461f1 service nova] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] Received unexpected event network-vif-plugged-04db431e-5bc8-4450-9bdd-82369fafba70 for instance with vm_state building and task_state spawning.
Nov 28 15:40:39 user nova-compute[75176]: DEBUG nova.compute.manager [req-8b0e19b9-694a-4d3e-ad39-b2b83ecefc2c req-272d43ce-0827-4582-a2af-3943ffc461f1 service nova] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] Received event network-vif-plugged-04db431e-5bc8-4450-9bdd-82369fafba70 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:40:39 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-8b0e19b9-694a-4d3e-ad39-b2b83ecefc2c req-272d43ce-0827-4582-a2af-3943ffc461f1 service nova] Acquiring lock "b714fb94-fcc7-40ae-b3a9-d8c9a60008f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:40:39 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-8b0e19b9-694a-4d3e-ad39-b2b83ecefc2c req-272d43ce-0827-4582-a2af-3943ffc461f1 service nova] Lock "b714fb94-fcc7-40ae-b3a9-d8c9a60008f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:40:39 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-8b0e19b9-694a-4d3e-ad39-b2b83ecefc2c req-272d43ce-0827-4582-a2af-3943ffc461f1 service nova] Lock "b714fb94-fcc7-40ae-b3a9-d8c9a60008f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:40:39 user nova-compute[75176]: DEBUG nova.compute.manager [req-8b0e19b9-694a-4d3e-ad39-b2b83ecefc2c req-272d43ce-0827-4582-a2af-3943ffc461f1 service nova] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] No waiting events found dispatching network-vif-plugged-04db431e-5bc8-4450-9bdd-82369fafba70 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:40:39 user nova-compute[75176]: WARNING nova.compute.manager [req-8b0e19b9-694a-4d3e-ad39-b2b83ecefc2c req-272d43ce-0827-4582-a2af-3943ffc461f1 service nova] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] Received unexpected event network-vif-plugged-04db431e-5bc8-4450-9bdd-82369fafba70 for instance with vm_state building and task_state spawning.
Nov 28 15:40:39 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:39 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:39 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:39 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:39 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:39 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:39 user nova-compute[75176]: DEBUG nova.compute.manager [req-e0f1d16f-1f5d-4a3b-a719-df9b039c557f req-59dad753-3864-4ded-852f-c2f55ced3df5 service nova] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] Received event network-vif-plugged-da7d30e5-6304-46ec-8d50-336986e6262f {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:40:39 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-e0f1d16f-1f5d-4a3b-a719-df9b039c557f req-59dad753-3864-4ded-852f-c2f55ced3df5 service nova] Acquiring lock "b714fb94-fcc7-40ae-b3a9-d8c9a60008f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:40:39 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-e0f1d16f-1f5d-4a3b-a719-df9b039c557f req-59dad753-3864-4ded-852f-c2f55ced3df5 service nova] Lock "b714fb94-fcc7-40ae-b3a9-d8c9a60008f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:40:39 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-e0f1d16f-1f5d-4a3b-a719-df9b039c557f req-59dad753-3864-4ded-852f-c2f55ced3df5 service nova] Lock "b714fb94-fcc7-40ae-b3a9-d8c9a60008f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:40:39 user nova-compute[75176]: DEBUG nova.compute.manager [req-e0f1d16f-1f5d-4a3b-a719-df9b039c557f req-59dad753-3864-4ded-852f-c2f55ced3df5 service nova] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] No waiting events found dispatching network-vif-plugged-da7d30e5-6304-46ec-8d50-336986e6262f {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:40:39 user nova-compute[75176]: WARNING nova.compute.manager [req-e0f1d16f-1f5d-4a3b-a719-df9b039c557f req-59dad753-3864-4ded-852f-c2f55ced3df5 service nova] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] Received unexpected event network-vif-plugged-da7d30e5-6304-46ec-8d50-336986e6262f for instance with vm_state building and task_state spawning.
Nov 28 15:40:39 user nova-compute[75176]: DEBUG nova.compute.manager [req-e0f1d16f-1f5d-4a3b-a719-df9b039c557f req-59dad753-3864-4ded-852f-c2f55ced3df5 service nova] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] Received event network-vif-plugged-da7d30e5-6304-46ec-8d50-336986e6262f {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:40:39 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-e0f1d16f-1f5d-4a3b-a719-df9b039c557f req-59dad753-3864-4ded-852f-c2f55ced3df5 service nova] Acquiring lock "b714fb94-fcc7-40ae-b3a9-d8c9a60008f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:40:39 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-e0f1d16f-1f5d-4a3b-a719-df9b039c557f req-59dad753-3864-4ded-852f-c2f55ced3df5 service nova] Lock "b714fb94-fcc7-40ae-b3a9-d8c9a60008f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:40:39 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-e0f1d16f-1f5d-4a3b-a719-df9b039c557f req-59dad753-3864-4ded-852f-c2f55ced3df5 service nova] Lock "b714fb94-fcc7-40ae-b3a9-d8c9a60008f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:40:39 user nova-compute[75176]: DEBUG nova.compute.manager [req-e0f1d16f-1f5d-4a3b-a719-df9b039c557f req-59dad753-3864-4ded-852f-c2f55ced3df5 service nova] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] No waiting events found dispatching network-vif-plugged-da7d30e5-6304-46ec-8d50-336986e6262f {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:40:39 user nova-compute[75176]: WARNING nova.compute.manager [req-e0f1d16f-1f5d-4a3b-a719-df9b039c557f req-59dad753-3864-4ded-852f-c2f55ced3df5 service nova] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] Received unexpected event network-vif-plugged-da7d30e5-6304-46ec-8d50-336986e6262f for instance with vm_state building and task_state spawning.
Nov 28 15:40:39 user nova-compute[75176]: DEBUG nova.compute.manager [req-e0f1d16f-1f5d-4a3b-a719-df9b039c557f req-59dad753-3864-4ded-852f-c2f55ced3df5 service nova] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] Received event network-vif-plugged-0bc36ba8-7fc6-47b2-b7b1-08a445625b46 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:40:39 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-e0f1d16f-1f5d-4a3b-a719-df9b039c557f req-59dad753-3864-4ded-852f-c2f55ced3df5 service nova] Acquiring lock "b714fb94-fcc7-40ae-b3a9-d8c9a60008f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:40:39 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-e0f1d16f-1f5d-4a3b-a719-df9b039c557f req-59dad753-3864-4ded-852f-c2f55ced3df5 service nova] Lock "b714fb94-fcc7-40ae-b3a9-d8c9a60008f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:40:39 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-e0f1d16f-1f5d-4a3b-a719-df9b039c557f req-59dad753-3864-4ded-852f-c2f55ced3df5 service nova] Lock "b714fb94-fcc7-40ae-b3a9-d8c9a60008f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:40:39 user nova-compute[75176]: DEBUG nova.compute.manager [req-e0f1d16f-1f5d-4a3b-a719-df9b039c557f req-59dad753-3864-4ded-852f-c2f55ced3df5 service nova] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] No waiting events found dispatching network-vif-plugged-0bc36ba8-7fc6-47b2-b7b1-08a445625b46 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:40:39 user nova-compute[75176]: WARNING nova.compute.manager [req-e0f1d16f-1f5d-4a3b-a719-df9b039c557f req-59dad753-3864-4ded-852f-c2f55ced3df5 service nova] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] Received unexpected event network-vif-plugged-0bc36ba8-7fc6-47b2-b7b1-08a445625b46 for instance with vm_state building and task_state spawning.
Nov 28 15:40:39 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:40 user nova-compute[75176]: DEBUG nova.compute.manager [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] Instance event wait completed in 0 seconds for  {{(pid=75176) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 15:40:40 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] Guest created on hypervisor {{(pid=75176) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 15:40:40 user nova-compute[75176]: INFO nova.virt.libvirt.driver [-] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] Instance spawned successfully.
Nov 28 15:40:40 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 15:40:40 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:40 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:40 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:40 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] Found default for hw_cdrom_bus of ide {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:40:40 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] Found default for hw_disk_bus of virtio {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:40:40 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] Found default for hw_input_bus of None {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:40:40 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] Found default for hw_pointer_model of None {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:40:40 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] Found default for hw_video_model of virtio {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:40:40 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] Found default for hw_vif_model of virtio {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:40:40 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:40 user nova-compute[75176]: INFO nova.compute.manager [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] Took 15.40 seconds to spawn the instance on the hypervisor.
Nov 28 15:40:40 user nova-compute[75176]: DEBUG nova.compute.manager [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] Checking state {{(pid=75176) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 15:40:40 user nova-compute[75176]: INFO nova.compute.manager [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] Took 41.23 seconds to build instance.
Nov 28 15:40:40 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-bb732fa6-c35d-4d78-b5ce-44fc05a50103 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Lock "041af768-197b-4c76-a5a1-28e2dc8255bd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 41.412s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:40:40 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:40 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:40 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:40 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:40 user nova-compute[75176]: DEBUG nova.compute.manager [req-b1bd8f66-6c05-44a8-b911-3e844adab914 req-09b3d29c-8a25-4ab3-a1b6-e64fdf709ee7 service nova] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] Received event network-vif-plugged-61157920-954a-479e-bd66-b0746a7843a7 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:40:40 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-b1bd8f66-6c05-44a8-b911-3e844adab914 req-09b3d29c-8a25-4ab3-a1b6-e64fdf709ee7 service nova] Acquiring lock "b714fb94-fcc7-40ae-b3a9-d8c9a60008f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:40:40 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-b1bd8f66-6c05-44a8-b911-3e844adab914 req-09b3d29c-8a25-4ab3-a1b6-e64fdf709ee7 service nova] Lock "b714fb94-fcc7-40ae-b3a9-d8c9a60008f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:40:40 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-b1bd8f66-6c05-44a8-b911-3e844adab914 req-09b3d29c-8a25-4ab3-a1b6-e64fdf709ee7 service nova] Lock "b714fb94-fcc7-40ae-b3a9-d8c9a60008f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:40:40 user nova-compute[75176]: DEBUG nova.compute.manager [req-b1bd8f66-6c05-44a8-b911-3e844adab914 req-09b3d29c-8a25-4ab3-a1b6-e64fdf709ee7 service nova] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] No waiting events found dispatching network-vif-plugged-61157920-954a-479e-bd66-b0746a7843a7 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:40:40 user nova-compute[75176]: WARNING nova.compute.manager [req-b1bd8f66-6c05-44a8-b911-3e844adab914 req-09b3d29c-8a25-4ab3-a1b6-e64fdf709ee7 service nova] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] Received unexpected event network-vif-plugged-61157920-954a-479e-bd66-b0746a7843a7 for instance with vm_state building and task_state spawning.
Nov 28 15:40:40 user nova-compute[75176]: DEBUG nova.compute.manager [req-b1bd8f66-6c05-44a8-b911-3e844adab914 req-09b3d29c-8a25-4ab3-a1b6-e64fdf709ee7 service nova] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] Received event network-vif-plugged-0c08ccbe-f3de-4aed-b641-8e2b58bd73a0 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:40:40 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-b1bd8f66-6c05-44a8-b911-3e844adab914 req-09b3d29c-8a25-4ab3-a1b6-e64fdf709ee7 service nova] Acquiring lock "b714fb94-fcc7-40ae-b3a9-d8c9a60008f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:40:40 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-b1bd8f66-6c05-44a8-b911-3e844adab914 req-09b3d29c-8a25-4ab3-a1b6-e64fdf709ee7 service nova] Lock "b714fb94-fcc7-40ae-b3a9-d8c9a60008f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:40:40 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-b1bd8f66-6c05-44a8-b911-3e844adab914 req-09b3d29c-8a25-4ab3-a1b6-e64fdf709ee7 service nova] Lock "b714fb94-fcc7-40ae-b3a9-d8c9a60008f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:40:40 user nova-compute[75176]: DEBUG nova.compute.manager [req-b1bd8f66-6c05-44a8-b911-3e844adab914 req-09b3d29c-8a25-4ab3-a1b6-e64fdf709ee7 service nova] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] No waiting events found dispatching network-vif-plugged-0c08ccbe-f3de-4aed-b641-8e2b58bd73a0 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:40:40 user nova-compute[75176]: WARNING nova.compute.manager [req-b1bd8f66-6c05-44a8-b911-3e844adab914 req-09b3d29c-8a25-4ab3-a1b6-e64fdf709ee7 service nova] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] Received unexpected event network-vif-plugged-0c08ccbe-f3de-4aed-b641-8e2b58bd73a0 for instance with vm_state building and task_state spawning.
Nov 28 15:40:40 user nova-compute[75176]: DEBUG nova.compute.manager [req-b1bd8f66-6c05-44a8-b911-3e844adab914 req-09b3d29c-8a25-4ab3-a1b6-e64fdf709ee7 service nova] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] Received event network-vif-plugged-0c08ccbe-f3de-4aed-b641-8e2b58bd73a0 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:40:40 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-b1bd8f66-6c05-44a8-b911-3e844adab914 req-09b3d29c-8a25-4ab3-a1b6-e64fdf709ee7 service nova] Acquiring lock "b714fb94-fcc7-40ae-b3a9-d8c9a60008f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:40:40 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-b1bd8f66-6c05-44a8-b911-3e844adab914 req-09b3d29c-8a25-4ab3-a1b6-e64fdf709ee7 service nova] Lock "b714fb94-fcc7-40ae-b3a9-d8c9a60008f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:40:40 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-b1bd8f66-6c05-44a8-b911-3e844adab914 req-09b3d29c-8a25-4ab3-a1b6-e64fdf709ee7 service nova] Lock "b714fb94-fcc7-40ae-b3a9-d8c9a60008f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:40:40 user nova-compute[75176]: DEBUG nova.compute.manager [req-b1bd8f66-6c05-44a8-b911-3e844adab914 req-09b3d29c-8a25-4ab3-a1b6-e64fdf709ee7 service nova] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] No waiting events found dispatching network-vif-plugged-0c08ccbe-f3de-4aed-b641-8e2b58bd73a0 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:40:40 user nova-compute[75176]: WARNING nova.compute.manager [req-b1bd8f66-6c05-44a8-b911-3e844adab914 req-09b3d29c-8a25-4ab3-a1b6-e64fdf709ee7 service nova] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] Received unexpected event network-vif-plugged-0c08ccbe-f3de-4aed-b641-8e2b58bd73a0 for instance with vm_state building and task_state spawning.
Nov 28 15:40:40 user nova-compute[75176]: DEBUG nova.compute.manager [req-b1bd8f66-6c05-44a8-b911-3e844adab914 req-09b3d29c-8a25-4ab3-a1b6-e64fdf709ee7 service nova] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] Received event network-vif-plugged-e0b49239-50a0-4864-9e92-22bddcbe7d21 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:40:40 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-b1bd8f66-6c05-44a8-b911-3e844adab914 req-09b3d29c-8a25-4ab3-a1b6-e64fdf709ee7 service nova] Acquiring lock "b714fb94-fcc7-40ae-b3a9-d8c9a60008f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:40:40 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-b1bd8f66-6c05-44a8-b911-3e844adab914 req-09b3d29c-8a25-4ab3-a1b6-e64fdf709ee7 service nova] Lock "b714fb94-fcc7-40ae-b3a9-d8c9a60008f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:40:40 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-b1bd8f66-6c05-44a8-b911-3e844adab914 req-09b3d29c-8a25-4ab3-a1b6-e64fdf709ee7 service nova] Lock "b714fb94-fcc7-40ae-b3a9-d8c9a60008f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:40:40 user nova-compute[75176]: DEBUG nova.compute.manager [req-b1bd8f66-6c05-44a8-b911-3e844adab914 req-09b3d29c-8a25-4ab3-a1b6-e64fdf709ee7 service nova] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] No waiting events found dispatching network-vif-plugged-e0b49239-50a0-4864-9e92-22bddcbe7d21 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:40:40 user nova-compute[75176]: WARNING nova.compute.manager [req-b1bd8f66-6c05-44a8-b911-3e844adab914 req-09b3d29c-8a25-4ab3-a1b6-e64fdf709ee7 service nova] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] Received unexpected event network-vif-plugged-e0b49239-50a0-4864-9e92-22bddcbe7d21 for instance with vm_state building and task_state spawning.
Nov 28 15:40:40 user nova-compute[75176]: DEBUG nova.compute.manager [req-b1bd8f66-6c05-44a8-b911-3e844adab914 req-09b3d29c-8a25-4ab3-a1b6-e64fdf709ee7 service nova] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] Received event network-vif-plugged-e0b49239-50a0-4864-9e92-22bddcbe7d21 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:40:40 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-b1bd8f66-6c05-44a8-b911-3e844adab914 req-09b3d29c-8a25-4ab3-a1b6-e64fdf709ee7 service nova] Acquiring lock "b714fb94-fcc7-40ae-b3a9-d8c9a60008f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:40:40 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-b1bd8f66-6c05-44a8-b911-3e844adab914 req-09b3d29c-8a25-4ab3-a1b6-e64fdf709ee7 service nova] Lock "b714fb94-fcc7-40ae-b3a9-d8c9a60008f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:40:40 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-b1bd8f66-6c05-44a8-b911-3e844adab914 req-09b3d29c-8a25-4ab3-a1b6-e64fdf709ee7 service nova] Lock "b714fb94-fcc7-40ae-b3a9-d8c9a60008f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:40:40 user nova-compute[75176]: DEBUG nova.compute.manager [req-b1bd8f66-6c05-44a8-b911-3e844adab914 req-09b3d29c-8a25-4ab3-a1b6-e64fdf709ee7 service nova] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] No waiting events found dispatching network-vif-plugged-e0b49239-50a0-4864-9e92-22bddcbe7d21 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:40:40 user nova-compute[75176]: WARNING nova.compute.manager [req-b1bd8f66-6c05-44a8-b911-3e844adab914 req-09b3d29c-8a25-4ab3-a1b6-e64fdf709ee7 service nova] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] Received unexpected event network-vif-plugged-e0b49239-50a0-4864-9e92-22bddcbe7d21 for instance with vm_state building and task_state spawning.
Nov 28 15:40:40 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:41 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:41 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:41 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:41 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:41 user nova-compute[75176]: DEBUG nova.compute.manager [req-f5613201-fb6e-4f64-8ee7-48916ff1e543 req-be8f81f0-53a7-46bc-843a-49fa6fd6bfef service nova] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] Received event network-vif-plugged-0bc36ba8-7fc6-47b2-b7b1-08a445625b46 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:40:41 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-f5613201-fb6e-4f64-8ee7-48916ff1e543 req-be8f81f0-53a7-46bc-843a-49fa6fd6bfef service nova] Acquiring lock "b714fb94-fcc7-40ae-b3a9-d8c9a60008f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:40:41 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-f5613201-fb6e-4f64-8ee7-48916ff1e543 req-be8f81f0-53a7-46bc-843a-49fa6fd6bfef service nova] Lock "b714fb94-fcc7-40ae-b3a9-d8c9a60008f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:40:41 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-f5613201-fb6e-4f64-8ee7-48916ff1e543 req-be8f81f0-53a7-46bc-843a-49fa6fd6bfef service nova] Lock "b714fb94-fcc7-40ae-b3a9-d8c9a60008f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:40:41 user nova-compute[75176]: DEBUG nova.compute.manager [req-f5613201-fb6e-4f64-8ee7-48916ff1e543 req-be8f81f0-53a7-46bc-843a-49fa6fd6bfef service nova] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] No waiting events found dispatching network-vif-plugged-0bc36ba8-7fc6-47b2-b7b1-08a445625b46 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:40:41 user nova-compute[75176]: WARNING nova.compute.manager [req-f5613201-fb6e-4f64-8ee7-48916ff1e543 req-be8f81f0-53a7-46bc-843a-49fa6fd6bfef service nova] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] Received unexpected event network-vif-plugged-0bc36ba8-7fc6-47b2-b7b1-08a445625b46 for instance with vm_state building and task_state spawning.
Nov 28 15:40:41 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:41 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:42 user nova-compute[75176]: DEBUG nova.compute.manager [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] Instance event wait completed in 0 seconds for  {{(pid=75176) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 15:40:42 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] Guest created on hypervisor {{(pid=75176) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 15:40:42 user nova-compute[75176]: INFO nova.virt.libvirt.driver [-] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] Instance spawned successfully.
Nov 28 15:40:42 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 15:40:42 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] Found default for hw_cdrom_bus of ide {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:40:42 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] Found default for hw_disk_bus of virtio {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:40:42 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] Found default for hw_input_bus of None {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:40:42 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] Found default for hw_pointer_model of None {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:40:42 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] Found default for hw_video_model of virtio {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:40:42 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] Found default for hw_vif_model of virtio {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:40:42 user nova-compute[75176]: INFO nova.compute.manager [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] Took 16.19 seconds to spawn the instance on the hypervisor.
Nov 28 15:40:42 user nova-compute[75176]: DEBUG nova.compute.manager [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] Checking state {{(pid=75176) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 15:40:42 user nova-compute[75176]: INFO nova.compute.manager [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] Took 41.57 seconds to build instance.
Nov 28 15:40:42 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-68432b8b-ebab-4505-8d3f-19b4da481ded tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Lock "b714fb94-fcc7-40ae-b3a9-d8c9a60008f1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 41.755s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:40:43 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:44 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:40:44 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:45 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:40:46 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:40:47 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:40:47 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:40:47 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:40:47 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75176) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 15:40:47 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:40:47 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:40:47 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:40:47 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:40:47 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Auditing locally available compute resources for user (node: user) {{(pid=75176) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 15:40:47 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-2143056c-4e88-4ec7-be45-bd7c9eaf4fa5 tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] Acquiring lock "f81dc25c-3549-4e25-b27c-a75a50d9a448" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:40:47 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-2143056c-4e88-4ec7-be45-bd7c9eaf4fa5 tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] Lock "f81dc25c-3549-4e25-b27c-a75a50d9a448" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:40:47 user nova-compute[75176]: DEBUG nova.objects.instance [None req-2143056c-4e88-4ec7-be45-bd7c9eaf4fa5 tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] Lazy-loading 'flavor' on Instance uuid f81dc25c-3549-4e25-b27c-a75a50d9a448 {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:40:47 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-2143056c-4e88-4ec7-be45-bd7c9eaf4fa5 tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] Lock "f81dc25c-3549-4e25-b27c-a75a50d9a448" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.086s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:40:47 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2e25e19-c832-4945-9257-64e6103feb0c/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:40:47 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-2143056c-4e88-4ec7-be45-bd7c9eaf4fa5 tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] Acquiring lock "f81dc25c-3549-4e25-b27c-a75a50d9a448" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:40:47 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-2143056c-4e88-4ec7-be45-bd7c9eaf4fa5 tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] Lock "f81dc25c-3549-4e25-b27c-a75a50d9a448" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:40:47 user nova-compute[75176]: INFO nova.compute.manager [None req-2143056c-4e88-4ec7-be45-bd7c9eaf4fa5 tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] [instance: f81dc25c-3549-4e25-b27c-a75a50d9a448] Attaching volume 7e6e3cd2-e65a-4be4-b457-cb38e632d792 to /dev/vdb
Nov 28 15:40:48 user nova-compute[75176]: DEBUG os_brick.utils [None req-2143056c-4e88-4ec7-be45-bd7c9eaf4fa5 tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 15:40:48 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:40:48 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:40:48 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b1b8588-c03b-4d67-a0f1-3a53f19dbc4d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:edc924a949b2\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:40:48 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:40:48 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:40:48 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[81d3b8a4-93f7-4bbf-abdc-2e19013b95cf]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:40:48 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:40:48 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2e25e19-c832-4945-9257-64e6103feb0c/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:40:48 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2e25e19-c832-4945-9257-64e6103feb0c/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:40:48 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:40:48 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab9b1663-618c-431f-bf8f-03201fedaab5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:40:48 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[fab7c021-6307-4d3b-8db7-c68ffb5cf5ad]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:40:48 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-2143056c-4e88-4ec7-be45-bd7c9eaf4fa5 tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] Running cmd (subprocess): nvme version {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:40:48 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-2143056c-4e88-4ec7-be45-bd7c9eaf4fa5 tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] 'nvme version' failed. Not Retrying. {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 15:40:48 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2143056c-4e88-4ec7-be45-bd7c9eaf4fa5 tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] nvme not present on system {{(pid=75176) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 15:40:48 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:40:48 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:48 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 15:40:48 user nova-compute[75176]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 15:40:48 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[94fae819-c398-49e9-a93a-a38bb6ce5b10]: (4, '') {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:40:48 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.lightos [None req-2143056c-4e88-4ec7-be45-bd7c9eaf4fa5 tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75176) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 15:40:48 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.lightos [None req-2143056c-4e88-4ec7-be45-bd7c9eaf4fa5 tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75176) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 15:40:48 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.lightos [None req-2143056c-4e88-4ec7-be45-bd7c9eaf4fa5 tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] LIGHTOS: no hostnqn found. {{(pid=75176) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 15:40:48 user nova-compute[75176]: DEBUG os_brick.utils [None req-2143056c-4e88-4ec7-be45-bd7c9eaf4fa5 tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] <== get_connector_properties: return (152ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:edc924a949b2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 15:40:48 user nova-compute[75176]: DEBUG nova.virt.block_device [None req-2143056c-4e88-4ec7-be45-bd7c9eaf4fa5 tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] [instance: f81dc25c-3549-4e25-b27c-a75a50d9a448] Updating existing volume attachment record: 4dce00fa-551e-417b-b32f-aa5428585186 {{(pid=75176) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 15:40:48 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2e25e19-c832-4945-9257-64e6103feb0c/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:40:48 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e8507b7-fccf-4196-b589-bf2b74f165ec/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:40:48 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e8507b7-fccf-4196-b589-bf2b74f165ec/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:40:48 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e8507b7-fccf-4196-b589-bf2b74f165ec/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:40:48 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e8507b7-fccf-4196-b589-bf2b74f165ec/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:40:48 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75176) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 15:40:48 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75176) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 15:40:48 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] skipping disk /dev/sdh (vdc) as it is a volume {{(pid=75176) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 15:40:48 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75176) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 15:40:48 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75176) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 15:40:48 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=75176) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 15:40:48 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d99de1a-8a82-447a-8a18-02e4efd3b3f0/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:40:48 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d99de1a-8a82-447a-8a18-02e4efd3b3f0/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:40:48 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d99de1a-8a82-447a-8a18-02e4efd3b3f0/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:40:49 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d99de1a-8a82-447a-8a18-02e4efd3b3f0/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:40:49 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b18c889-7694-4edf-8cf2-b9032e60289e/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:40:49 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b18c889-7694-4edf-8cf2-b9032e60289e/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:40:49 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b18c889-7694-4edf-8cf2-b9032e60289e/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:40:49 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b18c889-7694-4edf-8cf2-b9032e60289e/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:40:49 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa223c49-d254-4727-8a01-873026847b37/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:40:49 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa223c49-d254-4727-8a01-873026847b37/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:40:49 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa223c49-d254-4727-8a01-873026847b37/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:40:49 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:50 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa223c49-d254-4727-8a01-873026847b37/disk --force-share --output=json" returned: 0 in 0.283s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:40:50 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ab0619f-72e5-4975-ade8-53d7c0784d89/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:40:50 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ab0619f-72e5-4975-ade8-53d7c0784d89/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:40:50 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ab0619f-72e5-4975-ade8-53d7c0784d89/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:40:50 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ab0619f-72e5-4975-ade8-53d7c0784d89/disk --force-share --output=json" returned: 0 in 0.413s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:40:50 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f81dc25c-3549-4e25-b27c-a75a50d9a448/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:40:50 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f81dc25c-3549-4e25-b27c-a75a50d9a448/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:40:50 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f81dc25c-3549-4e25-b27c-a75a50d9a448/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:40:51 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f81dc25c-3549-4e25-b27c-a75a50d9a448/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:40:51 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ed0eb85-e975-446c-8da7-148a4bb36958/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:40:51 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ed0eb85-e975-446c-8da7-148a4bb36958/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:40:51 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ed0eb85-e975-446c-8da7-148a4bb36958/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:40:51 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ed0eb85-e975-446c-8da7-148a4bb36958/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:40:51 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75176) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 15:40:52 user nova-compute[75176]: DEBUG nova.compute.manager [req-20ac6b53-0e8e-4595-a862-4044983c37df req-b4ad26f1-1adf-47c9-b620-812c11b6869d service nova] [instance: 6ab0619f-72e5-4975-ade8-53d7c0784d89] Received event network-changed-63e3a2a2-51d4-4899-806d-c3222f643878 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:40:52 user nova-compute[75176]: DEBUG nova.compute.manager [req-20ac6b53-0e8e-4595-a862-4044983c37df req-b4ad26f1-1adf-47c9-b620-812c11b6869d service nova] [instance: 6ab0619f-72e5-4975-ade8-53d7c0784d89] Refreshing instance network info cache due to event network-changed-63e3a2a2-51d4-4899-806d-c3222f643878. {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 15:40:52 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-20ac6b53-0e8e-4595-a862-4044983c37df req-b4ad26f1-1adf-47c9-b620-812c11b6869d service nova] Acquiring lock "refresh_cache-6ab0619f-72e5-4975-ade8-53d7c0784d89" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:40:52 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-20ac6b53-0e8e-4595-a862-4044983c37df req-b4ad26f1-1adf-47c9-b620-812c11b6869d service nova] Acquired lock "refresh_cache-6ab0619f-72e5-4975-ade8-53d7c0784d89" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:40:52 user nova-compute[75176]: DEBUG nova.network.neutron [req-20ac6b53-0e8e-4595-a862-4044983c37df req-b4ad26f1-1adf-47c9-b620-812c11b6869d service nova] [instance: 6ab0619f-72e5-4975-ade8-53d7c0784d89] Refreshing network info cache for port 63e3a2a2-51d4-4899-806d-c3222f643878 {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 15:40:52 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 15:40:52 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 15:40:52 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Hypervisor/Node resource view: name=user free_ram=6936MB free_disk=25.540679931640625GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75176) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 15:40:52 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:40:52 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:40:52 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance f81dc25c-3549-4e25-b27c-a75a50d9a448 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:40:52 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance 6ab0619f-72e5-4975-ade8-53d7c0784d89 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:40:52 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance aa223c49-d254-4727-8a01-873026847b37 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:40:52 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance 2e8507b7-fccf-4196-b589-bf2b74f165ec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:40:52 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance 5b18c889-7694-4edf-8cf2-b9032e60289e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:40:52 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance e2e25e19-c832-4945-9257-64e6103feb0c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:40:52 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance 4ed0eb85-e975-446c-8da7-148a4bb36958 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:40:52 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance 916b82eb-97e8-411c-a8ea-8c27d101b48e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:40:52 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance 1d99de1a-8a82-447a-8a18-02e4efd3b3f0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:40:52 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance 041af768-197b-4c76-a5a1-28e2dc8255bd actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:40:52 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance b714fb94-fcc7-40ae-b3a9-d8c9a60008f1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:40:52 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75176) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 15:40:52 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75176) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 15:40:53 user nova-compute[75176]: DEBUG nova.network.neutron [req-20ac6b53-0e8e-4595-a862-4044983c37df req-b4ad26f1-1adf-47c9-b620-812c11b6869d service nova] [instance: 6ab0619f-72e5-4975-ade8-53d7c0784d89] Updated VIF entry in instance network info cache for port 63e3a2a2-51d4-4899-806d-c3222f643878. {{(pid=75176) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 15:40:53 user nova-compute[75176]: DEBUG nova.network.neutron [req-20ac6b53-0e8e-4595-a862-4044983c37df req-b4ad26f1-1adf-47c9-b620-812c11b6869d service nova] [instance: 6ab0619f-72e5-4975-ade8-53d7c0784d89] Updating instance_info_cache with network_info: [{"id": "63e3a2a2-51d4-4899-806d-c3222f643878", "address": "fa:16:3e:4d:46:79", "network": {"id": "84bcb9a8-0292-4eed-a9eb-2a883619389c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1655598964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fa05294c527426383c66fe58b31c825", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63e3a2a2-51", "ovs_interfaceid": "63e3a2a2-51d4-4899-806d-c3222f643878", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:40:53 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-20ac6b53-0e8e-4595-a862-4044983c37df req-b4ad26f1-1adf-47c9-b620-812c11b6869d service nova] Releasing lock "refresh_cache-6ab0619f-72e5-4975-ade8-53d7c0784d89" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:40:53 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:53 user nova-compute[75176]: DEBUG nova.compute.provider_tree [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Inventory has not changed in ProviderTree for provider: b37848d8-f401-4155-a029-b0ffa09ff85b {{(pid=75176) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 15:40:53 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Inventory has not changed for provider b37848d8-f401-4155-a029-b0ffa09ff85b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75176) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 15:40:53 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Compute_service record updated for user:user {{(pid=75176) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 15:40:53 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.049s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:40:53 user nova-compute[75176]: DEBUG nova.compute.manager [None req-3d514cb7-51fb-4f1b-b5bb-be6eebc2fcd0 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] [instance: 6ab0619f-72e5-4975-ade8-53d7c0784d89] Checking state {{(pid=75176) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 15:40:53 user nova-compute[75176]: INFO nova.compute.manager [None req-3d514cb7-51fb-4f1b-b5bb-be6eebc2fcd0 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] [instance: 6ab0619f-72e5-4975-ade8-53d7c0784d89] instance snapshotting
Nov 28 15:40:53 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-3d514cb7-51fb-4f1b-b5bb-be6eebc2fcd0 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] [instance: 6ab0619f-72e5-4975-ade8-53d7c0784d89] Beginning live snapshot process
Nov 28 15:40:54 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-3d514cb7-51fb-4f1b-b5bb-be6eebc2fcd0 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ab0619f-72e5-4975-ade8-53d7c0784d89/disk --force-share --output=json -f qcow2 {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:40:54 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:40:54 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:40:54 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Starting heal instance info cache {{(pid=75176) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 15:40:54 user nova-compute[75176]: DEBUG nova.compute.manager [req-05e41b48-9cae-48d5-b125-de959e96f96f req-4bb00100-5cce-4748-9c5b-359026762b80 service nova] [instance: aa223c49-d254-4727-8a01-873026847b37] Received event network-changed-6514aeb6-8ea4-4a27-a54b-32f650c87957 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:40:54 user nova-compute[75176]: DEBUG nova.compute.manager [req-05e41b48-9cae-48d5-b125-de959e96f96f req-4bb00100-5cce-4748-9c5b-359026762b80 service nova] [instance: aa223c49-d254-4727-8a01-873026847b37] Refreshing instance network info cache due to event network-changed-6514aeb6-8ea4-4a27-a54b-32f650c87957. {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 15:40:54 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-05e41b48-9cae-48d5-b125-de959e96f96f req-4bb00100-5cce-4748-9c5b-359026762b80 service nova] Acquiring lock "refresh_cache-aa223c49-d254-4727-8a01-873026847b37" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:40:54 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-05e41b48-9cae-48d5-b125-de959e96f96f req-4bb00100-5cce-4748-9c5b-359026762b80 service nova] Acquired lock "refresh_cache-aa223c49-d254-4727-8a01-873026847b37" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:40:54 user nova-compute[75176]: DEBUG nova.network.neutron [req-05e41b48-9cae-48d5-b125-de959e96f96f req-4bb00100-5cce-4748-9c5b-359026762b80 service nova] [instance: aa223c49-d254-4727-8a01-873026847b37] Refreshing network info cache for port 6514aeb6-8ea4-4a27-a54b-32f650c87957 {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 15:40:54 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquiring lock "refresh_cache-6ab0619f-72e5-4975-ade8-53d7c0784d89" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:40:54 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquired lock "refresh_cache-6ab0619f-72e5-4975-ade8-53d7c0784d89" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:40:54 user nova-compute[75176]: DEBUG nova.network.neutron [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] [instance: 6ab0619f-72e5-4975-ade8-53d7c0784d89] Forcefully refreshing network info cache for instance {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 15:40:54 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-3d514cb7-51fb-4f1b-b5bb-be6eebc2fcd0 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ab0619f-72e5-4975-ade8-53d7c0784d89/disk --force-share --output=json -f qcow2" returned: 0 in 0.227s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:40:54 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-3d514cb7-51fb-4f1b-b5bb-be6eebc2fcd0 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ab0619f-72e5-4975-ade8-53d7c0784d89/disk --force-share --output=json -f qcow2 {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:40:54 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-3d514cb7-51fb-4f1b-b5bb-be6eebc2fcd0 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ab0619f-72e5-4975-ade8-53d7c0784d89/disk --force-share --output=json -f qcow2" returned: 0 in 0.226s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:40:54 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-3d514cb7-51fb-4f1b-b5bb-be6eebc2fcd0 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:40:54 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-3d514cb7-51fb-4f1b-b5bb-be6eebc2fcd0 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json" returned: 0 in 0.212s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:40:54 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-3d514cb7-51fb-4f1b-b5bb-be6eebc2fcd0 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpfh9t64m9/1057ac930ae842b5ac4ca7cf1f8a959f.delta 1073741824 {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:40:54 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-3d514cb7-51fb-4f1b-b5bb-be6eebc2fcd0 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpfh9t64m9/1057ac930ae842b5ac4ca7cf1f8a959f.delta 1073741824" returned: 0 in 0.057s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:40:54 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-3d514cb7-51fb-4f1b-b5bb-be6eebc2fcd0 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] [instance: 6ab0619f-72e5-4975-ade8-53d7c0784d89] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 28 15:40:54 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-3d514cb7-51fb-4f1b-b5bb-be6eebc2fcd0 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] Checking UEFI support for host arch (x86_64) {{(pid=75176) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1753}}
Nov 28 15:40:54 user nova-compute[75176]: INFO nova.virt.libvirt.host [None req-3d514cb7-51fb-4f1b-b5bb-be6eebc2fcd0 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] UEFI support detected
Nov 28 15:40:54 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:55 user nova-compute[75176]: DEBUG nova.network.neutron [req-05e41b48-9cae-48d5-b125-de959e96f96f req-4bb00100-5cce-4748-9c5b-359026762b80 service nova] [instance: aa223c49-d254-4727-8a01-873026847b37] Updated VIF entry in instance network info cache for port 6514aeb6-8ea4-4a27-a54b-32f650c87957. {{(pid=75176) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 15:40:55 user nova-compute[75176]: DEBUG nova.network.neutron [req-05e41b48-9cae-48d5-b125-de959e96f96f req-4bb00100-5cce-4748-9c5b-359026762b80 service nova] [instance: aa223c49-d254-4727-8a01-873026847b37] Updating instance_info_cache with network_info: [{"id": "6514aeb6-8ea4-4a27-a54b-32f650c87957", "address": "fa:16:3e:ea:a6:1b", "network": {"id": "51708ad4-dae1-47fc-bd26-aca8c478ca04", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-279988751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c2fe6bf5e4f4bb3b5d50901bfac0b38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6514aeb6-8e", "ovs_interfaceid": "6514aeb6-8ea4-4a27-a54b-32f650c87957", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:40:55 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-05e41b48-9cae-48d5-b125-de959e96f96f req-4bb00100-5cce-4748-9c5b-359026762b80 service nova] Releasing lock "refresh_cache-aa223c49-d254-4727-8a01-873026847b37" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:40:55 user nova-compute[75176]: DEBUG nova.network.neutron [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] [instance: 6ab0619f-72e5-4975-ade8-53d7c0784d89] Updating instance_info_cache with network_info: [{"id": "63e3a2a2-51d4-4899-806d-c3222f643878", "address": "fa:16:3e:4d:46:79", "network": {"id": "84bcb9a8-0292-4eed-a9eb-2a883619389c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1655598964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fa05294c527426383c66fe58b31c825", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63e3a2a2-51", "ovs_interfaceid": "63e3a2a2-51d4-4899-806d-c3222f643878", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:40:55 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Releasing lock "refresh_cache-6ab0619f-72e5-4975-ade8-53d7c0784d89" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:40:55 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] [instance: 6ab0619f-72e5-4975-ade8-53d7c0784d89] Updated the network info_cache for instance {{(pid=75176) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 15:40:55 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:40:55 user nova-compute[75176]: DEBUG nova.virt.libvirt.guest [None req-3d514cb7-51fb-4f1b-b5bb-be6eebc2fcd0 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75176) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 15:40:56 user nova-compute[75176]: DEBUG nova.virt.libvirt.guest [None req-3d514cb7-51fb-4f1b-b5bb-be6eebc2fcd0 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] COPY block job progress, current cursor: 13959168 final cursor: 75497472 {{(pid=75176) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 15:40:56 user nova-compute[75176]: DEBUG nova.compute.manager [req-db7e395c-f1ec-43e2-a897-0e712624807a req-ddf1a6ae-e09e-4fea-b2fb-88d32748cba6 service nova] [instance: 2e8507b7-fccf-4196-b589-bf2b74f165ec] Received event network-changed-3dc67fc3-7fcf-4655-8dbd-22febf2be39e {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:40:56 user nova-compute[75176]: DEBUG nova.compute.manager [req-db7e395c-f1ec-43e2-a897-0e712624807a req-ddf1a6ae-e09e-4fea-b2fb-88d32748cba6 service nova] [instance: 2e8507b7-fccf-4196-b589-bf2b74f165ec] Refreshing instance network info cache due to event network-changed-3dc67fc3-7fcf-4655-8dbd-22febf2be39e. {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 15:40:56 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-db7e395c-f1ec-43e2-a897-0e712624807a req-ddf1a6ae-e09e-4fea-b2fb-88d32748cba6 service nova] Acquiring lock "refresh_cache-2e8507b7-fccf-4196-b589-bf2b74f165ec" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:40:56 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-db7e395c-f1ec-43e2-a897-0e712624807a req-ddf1a6ae-e09e-4fea-b2fb-88d32748cba6 service nova] Acquired lock "refresh_cache-2e8507b7-fccf-4196-b589-bf2b74f165ec" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:40:56 user nova-compute[75176]: DEBUG nova.network.neutron [req-db7e395c-f1ec-43e2-a897-0e712624807a req-ddf1a6ae-e09e-4fea-b2fb-88d32748cba6 service nova] [instance: 2e8507b7-fccf-4196-b589-bf2b74f165ec] Refreshing network info cache for port 3dc67fc3-7fcf-4655-8dbd-22febf2be39e {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 15:40:56 user nova-compute[75176]: DEBUG nova.virt.libvirt.guest [None req-3d514cb7-51fb-4f1b-b5bb-be6eebc2fcd0 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75176) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 15:40:56 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-3d514cb7-51fb-4f1b-b5bb-be6eebc2fcd0 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] [instance: 6ab0619f-72e5-4975-ade8-53d7c0784d89] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 28 15:40:56 user nova-compute[75176]: DEBUG nova.privsep.utils [None req-3d514cb7-51fb-4f1b-b5bb-be6eebc2fcd0 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75176) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 28 15:40:56 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-3d514cb7-51fb-4f1b-b5bb-be6eebc2fcd0 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpfh9t64m9/1057ac930ae842b5ac4ca7cf1f8a959f.delta /opt/stack/data/nova/instances/snapshots/tmpfh9t64m9/1057ac930ae842b5ac4ca7cf1f8a959f {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:40:57 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2143056c-4e88-4ec7-be45-bd7c9eaf4fa5 tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] [instance: f81dc25c-3549-4e25-b27c-a75a50d9a448] Calling os-brick to attach iSCSI Volume {{(pid=75176) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 15:40:57 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-2143056c-4e88-4ec7-be45-bd7c9eaf4fa5 tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c1b8a00>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7e6e3cd2-e65a-4be4-b457-cb38e632d792', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CHgZoGea', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 15:40:57 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-2143056c-4e88-4ec7-be45-bd7c9eaf4fa5 tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 15:40:57 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-2143056c-4e88-4ec7-be45-bd7c9eaf4fa5 tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 15:40:57 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-2143056c-4e88-4ec7-be45-bd7c9eaf4fa5 tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 15:40:57 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-2143056c-4e88-4ec7-be45-bd7c9eaf4fa5 tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 15:40:57 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-2143056c-4e88-4ec7-be45-bd7c9eaf4fa5 tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7e6e3cd2-e65a-4be4-b457-cb38e632d792" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 15:40:57 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-2143056c-4e88-4ec7-be45-bd7c9eaf4fa5 tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7e6e3cd2-e65a-4be4-b457-cb38e632d792" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.008s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 15:40:57 user nova-compute[75176]: INFO os_brick.initiator.connectors.iscsi [None req-2143056c-4e88-4ec7-be45-bd7c9eaf4fa5 tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 15:40:57 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e6e3cd2-e65a-4be4-b457-cb38e632d792 -p 172.16.0.220:3260 {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:40:57 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e6e3cd2-e65a-4be4-b457-cb38e632d792 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:40:57 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ec7abd9-8d0c-4a50-aa83-e11213963282]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:40:57 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-2143056c-4e88-4ec7-be45-bd7c9eaf4fa5 tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 15:40:57 user nova-compute[75176]:  {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:40:57 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e6e3cd2-e65a-4be4-b457-cb38e632d792 -p 172.16.0.220:3260 --interface default --op new {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:40:57 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e6e3cd2-e65a-4be4-b457-cb38e632d792 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:40:57 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[368f48e9-6182-43ce-873a-aac6abc038fa]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7e6e3cd2-e65a-4be4-b457-cb38e632d792] added\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:40:57 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-2143056c-4e88-4ec7-be45-bd7c9eaf4fa5 tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7e6e3cd2-e65a-4be4-b457-cb38e632d792] added
Nov 28 15:40:57 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:40:57 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e6e3cd2-e65a-4be4-b457-cb38e632d792 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:40:57 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e6e3cd2-e65a-4be4-b457-cb38e632d792 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.065s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:40:57 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[539cfab4-e521-433d-8048-dfcf0c74234f]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:40:57 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-2143056c-4e88-4ec7-be45-bd7c9eaf4fa5 tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:40:57 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e6e3cd2-e65a-4be4-b457-cb38e632d792 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:40:57 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e6e3cd2-e65a-4be4-b457-cb38e632d792 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:40:57 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[b940d581-731d-464b-8f9e-0e40c96e4aca]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:40:57 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-2143056c-4e88-4ec7-be45-bd7c9eaf4fa5 tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:40:57 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e6e3cd2-e65a-4be4-b457-cb38e632d792 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CHgZoGea {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:40:57 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e6e3cd2-e65a-4be4-b457-cb38e632d792 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CHgZoGea" returned: 0 in 0.021s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:40:57 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[0496161e-f9d5-4e0e-9db0-704bf3a04469]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:40:57 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-2143056c-4e88-4ec7-be45-bd7c9eaf4fa5 tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CHgZoGea'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:40:57 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e6e3cd2-e65a-4be4-b457-cb38e632d792 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:40:57 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e6e3cd2-e65a-4be4-b457-cb38e632d792 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.093s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:40:57 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7c530f7-ef5b-40a7-8a89-3628913690a2]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:40:57 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-2143056c-4e88-4ec7-be45-bd7c9eaf4fa5 tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:40:57 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:40:57 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:40:57 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8f71b30-920f-4bf2-b9cb-4af01dfcacd7]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81326542-482f-4d50-895c-13c65fe4daf7 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76ea4d3b-7c77-47d0-b48b-ad79886d4f9a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27720cbf-c8ad-486b-845d-cdff5fbc4772 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:560d9b0e-d506-4723-8fc3-4068d690d5c8 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e691257-74a3-4fef-9fd1-67d2ba725039 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:763d605d-247d-4484-b7ec-762e36b92abc (non-flash)\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:40:57 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-2143056c-4e88-4ec7-be45-bd7c9eaf4fa5 tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9 (non-flash)
Nov 28 15:40:57 user nova-compute[75176]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81326542-482f-4d50-895c-13c65fe4daf7 (non-flash)
Nov 28 15:40:57 user nova-compute[75176]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76ea4d3b-7c77-47d0-b48b-ad79886d4f9a (non-flash)
Nov 28 15:40:57 user nova-compute[75176]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27720cbf-c8ad-486b-845d-cdff5fbc4772 (non-flash)
Nov 28 15:40:57 user nova-compute[75176]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:560d9b0e-d506-4723-8fc3-4068d690d5c8 (non-flash)
Nov 28 15:40:57 user nova-compute[75176]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e691257-74a3-4fef-9fd1-67d2ba725039 (non-flash)
Nov 28 15:40:57 user nova-compute[75176]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:763d605d-247d-4484-b7ec-762e36b92abc (non-flash)
Nov 28 15:40:57 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:40:57 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-2143056c-4e88-4ec7-be45-bd7c9eaf4fa5 tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9 (non-flash)
Nov 28 15:40:57 user nova-compute[75176]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81326542-482f-4d50-895c-13c65fe4daf7 (non-flash)
Nov 28 15:40:57 user nova-compute[75176]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76ea4d3b-7c77-47d0-b48b-ad79886d4f9a (non-flash)
Nov 28 15:40:57 user nova-compute[75176]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27720cbf-c8ad-486b-845d-cdff5fbc4772 (non-flash)
Nov 28 15:40:57 user nova-compute[75176]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:560d9b0e-d506-4723-8fc3-4068d690d5c8 (non-flash)
Nov 28 15:40:57 user nova-compute[75176]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e691257-74a3-4fef-9fd1-67d2ba725039 (non-flash)
Nov 28 15:40:57 user nova-compute[75176]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:763d605d-247d-4484-b7ec-762e36b92abc (non-flash)
Nov 28 15:40:57 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 15:40:57 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e6e3cd2-e65a-4be4-b457-cb38e632d792 -p 172.16.0.220:3260 --login {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:40:57 user nova-compute[75176]: DEBUG nova.network.neutron [req-db7e395c-f1ec-43e2-a897-0e712624807a req-ddf1a6ae-e09e-4fea-b2fb-88d32748cba6 service nova] [instance: 2e8507b7-fccf-4196-b589-bf2b74f165ec] Updated VIF entry in instance network info cache for port 3dc67fc3-7fcf-4655-8dbd-22febf2be39e. {{(pid=75176) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 15:40:57 user nova-compute[75176]: DEBUG nova.network.neutron [req-db7e395c-f1ec-43e2-a897-0e712624807a req-ddf1a6ae-e09e-4fea-b2fb-88d32748cba6 service nova] [instance: 2e8507b7-fccf-4196-b589-bf2b74f165ec] Updating instance_info_cache with network_info: [{"id": "3dc67fc3-7fcf-4655-8dbd-22febf2be39e", "address": "fa:16:3e:04:68:53", "network": {"id": "8b63f2d3-0683-4832-abc5-e4c796cf12ab", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-877608435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3704b38a2bd44cb78c28d3f6d86d9e60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dc67fc3-7f", "ovs_interfaceid": "3dc67fc3-7fcf-4655-8dbd-22febf2be39e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:40:58 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e6e3cd2-e65a-4be4-b457-cb38e632d792 -p 172.16.0.220:3260 --login" returned: 0 in 0.237s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:40:58 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[4499b4be-849f-4de1-aede-87944fcadfdb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7e6e3cd2-e65a-4be4-b457-cb38e632d792, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7e6e3cd2-e65a-4be4-b457-cb38e632d792, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:40:58 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-2143056c-4e88-4ec7-be45-bd7c9eaf4fa5 tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7e6e3cd2-e65a-4be4-b457-cb38e632d792, portal: 172.16.0.220,3260]
Nov 28 15:40:58 user nova-compute[75176]: Login to [iface: default, target: iqn.2010-10.org.openstack:7e6e3cd2-e65a-4be4-b457-cb38e632d792, portal: 172.16.0.220,3260] successful.
Nov 28 15:40:58 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:40:58 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e6e3cd2-e65a-4be4-b457-cb38e632d792 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:40:58 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-db7e395c-f1ec-43e2-a897-0e712624807a req-ddf1a6ae-e09e-4fea-b2fb-88d32748cba6 service nova] Releasing lock "refresh_cache-2e8507b7-fccf-4196-b589-bf2b74f165ec" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:40:58 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e6e3cd2-e65a-4be4-b457-cb38e632d792 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.034s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:40:58 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c37a281-85b9-4c30-8100-211787ed1041]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:40:58 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-2143056c-4e88-4ec7-be45-bd7c9eaf4fa5 tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:40:58 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:40:58 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.094s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:40:58 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[0be54230-8506-4a90-8de2-65bb4e140d4e]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81326542-482f-4d50-895c-13c65fe4daf7 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76ea4d3b-7c77-47d0-b48b-ad79886d4f9a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27720cbf-c8ad-486b-845d-cdff5fbc4772 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:560d9b0e-d506-4723-8fc3-4068d690d5c8 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e691257-74a3-4fef-9fd1-67d2ba725039 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:763d605d-247d-4484-b7ec-762e36b92abc (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e6e3cd2-e65a-4be4-b457-cb38e632d792 (non-flash)\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:40:58 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-2143056c-4e88-4ec7-be45-bd7c9eaf4fa5 tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9 (non-flash)
Nov 28 15:40:58 user nova-compute[75176]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81326542-482f-4d50-895c-13c65fe4daf7 (non-flash)
Nov 28 15:40:58 user nova-compute[75176]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76ea4d3b-7c77-47d0-b48b-ad79886d4f9a (non-flash)
Nov 28 15:40:58 user nova-compute[75176]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27720cbf-c8ad-486b-845d-cdff5fbc4772 (non-flash)
Nov 28 15:40:58 user nova-compute[75176]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:560d9b0e-d506-4723-8fc3-4068d690d5c8 (non-flash)
Nov 28 15:40:58 user nova-compute[75176]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e691257-74a3-4fef-9fd1-67d2ba725039 (non-flash)
Nov 28 15:40:58 user nova-compute[75176]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:763d605d-247d-4484-b7ec-762e36b92abc (non-flash)
Nov 28 15:40:58 user nova-compute[75176]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e6e3cd2-e65a-4be4-b457-cb38e632d792 (non-flash)
Nov 28 15:40:58 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:40:58 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-2143056c-4e88-4ec7-be45-bd7c9eaf4fa5 tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9 (non-flash)
Nov 28 15:40:58 user nova-compute[75176]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81326542-482f-4d50-895c-13c65fe4daf7 (non-flash)
Nov 28 15:40:58 user nova-compute[75176]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76ea4d3b-7c77-47d0-b48b-ad79886d4f9a (non-flash)
Nov 28 15:40:58 user nova-compute[75176]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27720cbf-c8ad-486b-845d-cdff5fbc4772 (non-flash)
Nov 28 15:40:58 user nova-compute[75176]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:560d9b0e-d506-4723-8fc3-4068d690d5c8 (non-flash)
Nov 28 15:40:58 user nova-compute[75176]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e691257-74a3-4fef-9fd1-67d2ba725039 (non-flash)
Nov 28 15:40:58 user nova-compute[75176]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:763d605d-247d-4484-b7ec-762e36b92abc (non-flash)
Nov 28 15:40:58 user nova-compute[75176]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e6e3cd2-e65a-4be4-b457-cb38e632d792 (non-flash)
Nov 28 15:40:58 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 15:40:58 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-2143056c-4e88-4ec7-be45-bd7c9eaf4fa5 tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7e6e3cd2-e65a-4be4-b457-cb38e632d792" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.762s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 15:40:58 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-2143056c-4e88-4ec7-be45-bd7c9eaf4fa5 tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] Connected to 172.16.0.220:3260 {{(pid=75176) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 15:40:58 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-2143056c-4e88-4ec7-be45-bd7c9eaf4fa5 tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] HCTL ('40', '-', '-', 0) found on session 9 with lun 0 {{(pid=75176) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 15:40:58 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-2143056c-4e88-4ec7-be45-bd7c9eaf4fa5 tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=75176) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 15:40:58 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:58 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:40:58 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.115s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:40:58 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0e8d405-6dc8-436b-b5fe-0ebf10b4acda]: (4, ('- - 0', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:40:58 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-2143056c-4e88-4ec7-be45-bd7c9eaf4fa5 tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] Searching for a device in session 9 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=75176) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 15:40:58 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-2143056c-4e88-4ec7-be45-bd7c9eaf4fa5 tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:7e6e3cd2-e65a-4be4-b457-cb38e632d792', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CHgZoGea', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75176) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 15:40:58 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-3d514cb7-51fb-4f1b-b5bb-be6eebc2fcd0 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpfh9t64m9/1057ac930ae842b5ac4ca7cf1f8a959f.delta /opt/stack/data/nova/instances/snapshots/tmpfh9t64m9/1057ac930ae842b5ac4ca7cf1f8a959f" returned: 0 in 1.612s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:40:58 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-3d514cb7-51fb-4f1b-b5bb-be6eebc2fcd0 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] [instance: 6ab0619f-72e5-4975-ade8-53d7c0784d89] Snapshot extracted, beginning image upload
Nov 28 15:40:59 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-2143056c-4e88-4ec7-be45-bd7c9eaf4fa5 tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.916s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 15:40:59 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-2143056c-4e88-4ec7-be45-bd7c9eaf4fa5 tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] <== connect_volume: return (1917ms) {'type': 'block', 'scsi_wwn': '23266376432323138', 'path': '/dev/sdi'} {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 15:40:59 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2143056c-4e88-4ec7-be45-bd7c9eaf4fa5 tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] [instance: f81dc25c-3549-4e25-b27c-a75a50d9a448] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23266376432323138', 'path': '/dev/sdi'} {{(pid=75176) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 15:40:59 user nova-compute[75176]: DEBUG nova.objects.instance [None req-2143056c-4e88-4ec7-be45-bd7c9eaf4fa5 tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] Lazy-loading 'flavor' on Instance uuid f81dc25c-3549-4e25-b27c-a75a50d9a448 {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:40:59 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:40:59 user nova-compute[75176]: DEBUG nova.virt.libvirt.guest [None req-2143056c-4e88-4ec7-be45-bd7c9eaf4fa5 tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 15:40:59 user nova-compute[75176]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 15:40:59 user nova-compute[75176]:   <source dev="/dev/sdi"/>
Nov 28 15:40:59 user nova-compute[75176]:   <target dev="vdb" bus="virtio"/>
Nov 28 15:40:59 user nova-compute[75176]:   <serial>7e6e3cd2-e65a-4be4-b457-cb38e632d792</serial>
Nov 28 15:40:59 user nova-compute[75176]: </disk>
Nov 28 15:40:59 user nova-compute[75176]:  {{(pid=75176) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 15:40:59 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:00 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-2143056c-4e88-4ec7-be45-bd7c9eaf4fa5 tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] No BDM found with device name vda, not building metadata. {{(pid=75176) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 15:41:00 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-2143056c-4e88-4ec7-be45-bd7c9eaf4fa5 tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75176) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 15:41:00 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-2143056c-4e88-4ec7-be45-bd7c9eaf4fa5 tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] No VIF found with MAC fa:16:3e:3f:fc:84, not building metadata {{(pid=75176) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 15:41:01 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-2143056c-4e88-4ec7-be45-bd7c9eaf4fa5 tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] Lock "f81dc25c-3549-4e25-b27c-a75a50d9a448" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.207s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:41:01 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-3d514cb7-51fb-4f1b-b5bb-be6eebc2fcd0 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] [instance: 6ab0619f-72e5-4975-ade8-53d7c0784d89] Snapshot image upload complete
Nov 28 15:41:01 user nova-compute[75176]: INFO nova.compute.manager [None req-3d514cb7-51fb-4f1b-b5bb-be6eebc2fcd0 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] [instance: 6ab0619f-72e5-4975-ade8-53d7c0784d89] Took 7.80 seconds to snapshot the instance on the hypervisor.
Nov 28 15:41:01 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:02 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-abc638d4-60cb-4e15-9604-d006abdbb8d2 tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] Acquiring lock "f81dc25c-3549-4e25-b27c-a75a50d9a448" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:41:02 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-abc638d4-60cb-4e15-9604-d006abdbb8d2 tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] Lock "f81dc25c-3549-4e25-b27c-a75a50d9a448" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:41:02 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-abc638d4-60cb-4e15-9604-d006abdbb8d2 tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] Acquiring lock "f81dc25c-3549-4e25-b27c-a75a50d9a448-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:41:02 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-abc638d4-60cb-4e15-9604-d006abdbb8d2 tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] Lock "f81dc25c-3549-4e25-b27c-a75a50d9a448-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:41:02 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-abc638d4-60cb-4e15-9604-d006abdbb8d2 tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] Lock "f81dc25c-3549-4e25-b27c-a75a50d9a448-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:41:02 user nova-compute[75176]: INFO nova.compute.manager [None req-abc638d4-60cb-4e15-9604-d006abdbb8d2 tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] [instance: f81dc25c-3549-4e25-b27c-a75a50d9a448] Terminating instance
Nov 28 15:41:02 user nova-compute[75176]: DEBUG nova.compute.manager [None req-abc638d4-60cb-4e15-9604-d006abdbb8d2 tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] [instance: f81dc25c-3549-4e25-b27c-a75a50d9a448] Start destroying the instance on the hypervisor. {{(pid=75176) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 15:41:02 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:02 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:02 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:02 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:02 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:03 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:03 user nova-compute[75176]: INFO nova.virt.libvirt.driver [-] [instance: f81dc25c-3549-4e25-b27c-a75a50d9a448] Instance destroyed successfully.
Nov 28 15:41:03 user nova-compute[75176]: DEBUG nova.objects.instance [None req-abc638d4-60cb-4e15-9604-d006abdbb8d2 tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] Lazy-loading 'resources' on Instance uuid f81dc25c-3549-4e25-b27c-a75a50d9a448 {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:41:03 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-abc638d4-60cb-4e15-9604-d006abdbb8d2 tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T15:38:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1200169567',display_name='tempest-DeleteServersTestJSON-server-1200169567',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1200169567',id=1,image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-28T15:39:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='81856f8d465d408bbb6b0fbfe4dd2fa4',ramdisk_id='',reservation_id='r-2mqgb6gs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-982919505',owner_user_name='tempest-DeleteServersTestJSON-982919505-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T15:39:13Z,user_data=None,user_id='bb8e82f7d5d54c2394e87bb268ce9434',uuid=f81dc25c-3549-4e25-b27c-a75a50d9a448,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1e629a40-5a9f-4891-8148-7a2c925d8ad6", "address": "fa:16:3e:3f:fc:84", "network": {"id": "6e9a90b3-cbe8-4d24-a96b-78e5a8a588f0", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-468656063-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81856f8d465d408bbb6b0fbfe4dd2fa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e629a40-5a", "ovs_interfaceid": "1e629a40-5a9f-4891-8148-7a2c925d8ad6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 15:41:03 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-abc638d4-60cb-4e15-9604-d006abdbb8d2 tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] Converting VIF {"id": "1e629a40-5a9f-4891-8148-7a2c925d8ad6", "address": "fa:16:3e:3f:fc:84", "network": {"id": "6e9a90b3-cbe8-4d24-a96b-78e5a8a588f0", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-468656063-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81856f8d465d408bbb6b0fbfe4dd2fa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e629a40-5a", "ovs_interfaceid": "1e629a40-5a9f-4891-8148-7a2c925d8ad6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:41:03 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-abc638d4-60cb-4e15-9604-d006abdbb8d2 tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:fc:84,bridge_name='br-int',has_traffic_filtering=True,id=1e629a40-5a9f-4891-8148-7a2c925d8ad6,network=Network(6e9a90b3-cbe8-4d24-a96b-78e5a8a588f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e629a40-5a') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:41:03 user nova-compute[75176]: DEBUG os_vif [None req-abc638d4-60cb-4e15-9604-d006abdbb8d2 tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:fc:84,bridge_name='br-int',has_traffic_filtering=True,id=1e629a40-5a9f-4891-8148-7a2c925d8ad6,network=Network(6e9a90b3-cbe8-4d24-a96b-78e5a8a588f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e629a40-5a') {{(pid=75176) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 15:41:03 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:03 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1e629a40-5a, bridge=br-int, if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:41:03 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:03 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:03 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:03 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e04fe7cf-8fc6-4b21-858b-4705efe4540f) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:41:03 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:03 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:03 user nova-compute[75176]: INFO os_vif [None req-abc638d4-60cb-4e15-9604-d006abdbb8d2 tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:fc:84,bridge_name='br-int',has_traffic_filtering=True,id=1e629a40-5a9f-4891-8148-7a2c925d8ad6,network=Network(6e9a90b3-cbe8-4d24-a96b-78e5a8a588f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e629a40-5a')
Nov 28 15:41:03 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-abc638d4-60cb-4e15-9604-d006abdbb8d2 tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] [instance: f81dc25c-3549-4e25-b27c-a75a50d9a448] calling os-brick to detach iSCSI Volume {{(pid=75176) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 15:41:03 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-abc638d4-60cb-4e15-9604-d006abdbb8d2 tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c1b8a00>, {'target_iqn': 'iqn.2010-10.org.openstack:7e6e3cd2-e65a-4be4-b457-cb38e632d792', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CHgZoGea', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': True}}" {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 15:41:03 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-abc638d4-60cb-4e15-9604-d006abdbb8d2 tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 15:41:03 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-abc638d4-60cb-4e15-9604-d006abdbb8d2 tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 15:41:03 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-abc638d4-60cb-4e15-9604-d006abdbb8d2 tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 15:41:03 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:41:03 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:41:03 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6d7bf73-2037-486a-8486-be6d6baac85a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:560d9b0e-d506-4723-8fc3-4068d690d5c8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:763d605d-247d-4484-b7ec-762e36b92abc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:27720cbf-c8ad-486b-845d-cdff5fbc4772\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:81326542-482f-4d50-895c-13c65fe4daf7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:76ea4d3b-7c77-47d0-b48b-ad79886d4f9a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7e6e3cd2-e65a-4be4-b457-cb38e632d792\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6e691257-74a3-4fef-9fd1-67d2ba725039\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:41:03 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-abc638d4-60cb-4e15-9604-d006abdbb8d2 tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 15:41:03 user nova-compute[75176]: No targets found.
Nov 28 15:41:03 user nova-compute[75176]: iSNS:
Nov 28 15:41:03 user nova-compute[75176]: No targets found.
Nov 28 15:41:03 user nova-compute[75176]: STATIC:
Nov 28 15:41:03 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:560d9b0e-d506-4723-8fc3-4068d690d5c8
Nov 28 15:41:03 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:41:03 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:41:03 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:763d605d-247d-4484-b7ec-762e36b92abc
Nov 28 15:41:03 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:41:03 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:41:03 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:27720cbf-c8ad-486b-845d-cdff5fbc4772
Nov 28 15:41:03 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:41:03 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:41:03 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:81326542-482f-4d50-895c-13c65fe4daf7
Nov 28 15:41:03 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:41:03 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:41:03 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:76ea4d3b-7c77-47d0-b48b-ad79886d4f9a
Nov 28 15:41:03 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:41:03 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:41:03 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:7e6e3cd2-e65a-4be4-b457-cb38e632d792
Nov 28 15:41:03 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:41:03 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:41:03 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:6e691257-74a3-4fef-9fd1-67d2ba725039
Nov 28 15:41:03 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:41:03 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:41:03 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9
Nov 28 15:41:03 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:41:03 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:41:03 user nova-compute[75176]: FIRMWARE:
Nov 28 15:41:03 user nova-compute[75176]: No targets found.
Nov 28 15:41:03 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:41:03 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-abc638d4-60cb-4e15-9604-d006abdbb8d2 tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 15:41:03 user nova-compute[75176]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 15:41:03 user nova-compute[75176]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75176) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 15:41:03 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-abc638d4-60cb-4e15-9604-d006abdbb8d2 tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7e6e3cd2-e65a-4be4-b457-cb38e632d792', 0)] {{(pid=75176) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 15:41:03 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:41:03 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:41:03 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9bfc898-74a0-4b7e-accb-1bd17cc93056]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:27720cbf-c8ad-486b-845d-cdff5fbc4772\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:560d9b0e-d506-4723-8fc3-4068d690d5c8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e691257-74a3-4fef-9fd1-67d2ba725039\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:763d605d-247d-4484-b7ec-762e36b92abc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:76ea4d3b-7c77-47d0-b48b-ad79886d4f9a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7e6e3cd2-e65a-4be4-b457-cb38e632d792\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:81326542-482f-4d50-895c-13c65fe4daf7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:41:03 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:41:03 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:41:03 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[96e9918c-a4a7-45d3-8b56-46cd0d607f20]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81326542-482f-4d50-895c-13c65fe4daf7 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76ea4d3b-7c77-47d0-b48b-ad79886d4f9a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27720cbf-c8ad-486b-845d-cdff5fbc4772 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:560d9b0e-d506-4723-8fc3-4068d690d5c8 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e691257-74a3-4fef-9fd1-67d2ba725039 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:763d605d-247d-4484-b7ec-762e36b92abc (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e6e3cd2-e65a-4be4-b457-cb38e632d792 (non-flash)\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:41:03 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-abc638d4-60cb-4e15-9604-d006abdbb8d2 tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9 (non-flash)
Nov 28 15:41:03 user nova-compute[75176]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81326542-482f-4d50-895c-13c65fe4daf7 (non-flash)
Nov 28 15:41:03 user nova-compute[75176]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76ea4d3b-7c77-47d0-b48b-ad79886d4f9a (non-flash)
Nov 28 15:41:03 user nova-compute[75176]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27720cbf-c8ad-486b-845d-cdff5fbc4772 (non-flash)
Nov 28 15:41:03 user nova-compute[75176]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:560d9b0e-d506-4723-8fc3-4068d690d5c8 (non-flash)
Nov 28 15:41:03 user nova-compute[75176]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e691257-74a3-4fef-9fd1-67d2ba725039 (non-flash)
Nov 28 15:41:03 user nova-compute[75176]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:763d605d-247d-4484-b7ec-762e36b92abc (non-flash)
Nov 28 15:41:03 user nova-compute[75176]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e6e3cd2-e65a-4be4-b457-cb38e632d792 (non-flash)
Nov 28 15:41:03 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:41:03 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-abc638d4-60cb-4e15-9604-d006abdbb8d2 tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9 (non-flash)
Nov 28 15:41:03 user nova-compute[75176]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81326542-482f-4d50-895c-13c65fe4daf7 (non-flash)
Nov 28 15:41:03 user nova-compute[75176]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76ea4d3b-7c77-47d0-b48b-ad79886d4f9a (non-flash)
Nov 28 15:41:03 user nova-compute[75176]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27720cbf-c8ad-486b-845d-cdff5fbc4772 (non-flash)
Nov 28 15:41:03 user nova-compute[75176]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:560d9b0e-d506-4723-8fc3-4068d690d5c8 (non-flash)
Nov 28 15:41:03 user nova-compute[75176]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e691257-74a3-4fef-9fd1-67d2ba725039 (non-flash)
Nov 28 15:41:03 user nova-compute[75176]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:763d605d-247d-4484-b7ec-762e36b92abc (non-flash)
Nov 28 15:41:03 user nova-compute[75176]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e6e3cd2-e65a-4be4-b457-cb38e632d792 (non-flash)
Nov 28 15:41:03 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 15:41:03 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-abc638d4-60cb-4e15-9604-d006abdbb8d2 tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f464d7789d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7e6e3cd2-e65a-4be4-b457-cb38e632d792'): ({'sdi'}, set())}) {{(pid=75176) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 15:41:03 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-abc638d4-60cb-4e15-9604-d006abdbb8d2 tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] Removing single pathed devices sdi {{(pid=75176) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 15:41:03 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:41:03 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.035s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:41:03 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a85f868-3936-48eb-8430-5506a435c1f2]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:41:03 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:41:03 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.019s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:41:03 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[83a1e068-de79-4c8b-a56c-da68a090dd43]: (4, ('ok\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:41:03 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-abc638d4-60cb-4e15-9604-d006abdbb8d2 tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] Flushing IO for device /dev/sdi {{(pid=75176) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 15:41:03 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:41:03 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.013s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:41:03 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[a37f5ae5-a2e1-43d0-a944-021242cb938c]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:41:03 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-abc638d4-60cb-4e15-9604-d006abdbb8d2 tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=75176) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 15:41:03 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:41:03 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.035s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:41:03 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[88a53b31-5edd-4441-9cf6-8b0695af53f5]: (4, ('1', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:41:03 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-abc638d4-60cb-4e15-9604-d006abdbb8d2 tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=75176) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 15:41:03 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-abc638d4-60cb-4e15-9604-d006abdbb8d2 tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] SCSI volumes sdi have been removed. {{(pid=75176) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 15:41:03 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-abc638d4-60cb-4e15-9604-d006abdbb8d2 tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7e6e3cd2-e65a-4be4-b457-cb38e632d792')] {{(pid=75176) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 15:41:03 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e6e3cd2-e65a-4be4-b457-cb38e632d792 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:41:03 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e6e3cd2-e65a-4be4-b457-cb38e632d792 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:41:03 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[0667aedb-6c30-4e4b-b1a1-9a1e7c938704]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:41:03 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-abc638d4-60cb-4e15-9604-d006abdbb8d2 tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:41:03 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e6e3cd2-e65a-4be4-b457-cb38e632d792 -p 172.16.0.220:3260 --logout {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:41:03 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e6e3cd2-e65a-4be4-b457-cb38e632d792 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:41:03 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d55fe50-011e-4150-b9e3-8162885fef2b]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:7e6e3cd2-e65a-4be4-b457-cb38e632d792, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:7e6e3cd2-e65a-4be4-b457-cb38e632d792, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:41:03 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-abc638d4-60cb-4e15-9604-d006abdbb8d2 tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:7e6e3cd2-e65a-4be4-b457-cb38e632d792, portal: 172.16.0.220,3260]
Nov 28 15:41:03 user nova-compute[75176]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:7e6e3cd2-e65a-4be4-b457-cb38e632d792, portal: 172.16.0.220,3260] successful.
Nov 28 15:41:03 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:41:03 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e6e3cd2-e65a-4be4-b457-cb38e632d792 -p 172.16.0.220:3260 --op delete {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:41:03 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e6e3cd2-e65a-4be4-b457-cb38e632d792 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:41:03 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[027275af-b348-4d0a-acf9-9904299f1603]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:41:03 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-abc638d4-60cb-4e15-9604-d006abdbb8d2 tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:41:03 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-abc638d4-60cb-4e15-9604-d006abdbb8d2 tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.360s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 15:41:03 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-abc638d4-60cb-4e15-9604-d006abdbb8d2 tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] <== disconnect_volume: return (361ms) None {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 15:41:03 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-abc638d4-60cb-4e15-9604-d006abdbb8d2 tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] [instance: f81dc25c-3549-4e25-b27c-a75a50d9a448] Disconnected iSCSI Volume {{(pid=75176) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 15:41:03 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-abc638d4-60cb-4e15-9604-d006abdbb8d2 tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] [instance: f81dc25c-3549-4e25-b27c-a75a50d9a448] Deleting instance files /opt/stack/data/nova/instances/f81dc25c-3549-4e25-b27c-a75a50d9a448_del
Nov 28 15:41:03 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-abc638d4-60cb-4e15-9604-d006abdbb8d2 tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] [instance: f81dc25c-3549-4e25-b27c-a75a50d9a448] Deletion of /opt/stack/data/nova/instances/f81dc25c-3549-4e25-b27c-a75a50d9a448_del complete
Nov 28 15:41:03 user nova-compute[75176]: INFO nova.compute.manager [None req-abc638d4-60cb-4e15-9604-d006abdbb8d2 tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] [instance: f81dc25c-3549-4e25-b27c-a75a50d9a448] Took 1.37 seconds to destroy the instance on the hypervisor.
Nov 28 15:41:03 user nova-compute[75176]: DEBUG oslo.service.loopingcall [None req-abc638d4-60cb-4e15-9604-d006abdbb8d2 tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75176) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 15:41:03 user nova-compute[75176]: DEBUG nova.compute.manager [-] [instance: f81dc25c-3549-4e25-b27c-a75a50d9a448] Deallocating network for instance {{(pid=75176) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 15:41:03 user nova-compute[75176]: DEBUG nova.network.neutron [-] [instance: f81dc25c-3549-4e25-b27c-a75a50d9a448] deallocate_for_instance() {{(pid=75176) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 15:41:04 user nova-compute[75176]: DEBUG nova.compute.manager [req-c7586dd1-2ea3-41a9-99e3-d43dc6f4ad48 req-ffc150a2-a008-4dca-b849-60e1bcd52e64 service nova] [instance: f81dc25c-3549-4e25-b27c-a75a50d9a448] Received event network-vif-deleted-1e629a40-5a9f-4891-8148-7a2c925d8ad6 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:41:04 user nova-compute[75176]: INFO nova.compute.manager [req-c7586dd1-2ea3-41a9-99e3-d43dc6f4ad48 req-ffc150a2-a008-4dca-b849-60e1bcd52e64 service nova] [instance: f81dc25c-3549-4e25-b27c-a75a50d9a448] Neutron deleted interface 1e629a40-5a9f-4891-8148-7a2c925d8ad6; detaching it from the instance and deleting it from the info cache
Nov 28 15:41:04 user nova-compute[75176]: DEBUG nova.network.neutron [req-c7586dd1-2ea3-41a9-99e3-d43dc6f4ad48 req-ffc150a2-a008-4dca-b849-60e1bcd52e64 service nova] [instance: f81dc25c-3549-4e25-b27c-a75a50d9a448] Updating instance_info_cache with network_info: [] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:41:04 user nova-compute[75176]: DEBUG nova.network.neutron [-] [instance: f81dc25c-3549-4e25-b27c-a75a50d9a448] Updating instance_info_cache with network_info: [] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:41:04 user nova-compute[75176]: INFO nova.compute.manager [-] [instance: f81dc25c-3549-4e25-b27c-a75a50d9a448] Took 0.73 seconds to deallocate network for instance.
Nov 28 15:41:04 user nova-compute[75176]: DEBUG nova.compute.manager [req-c7586dd1-2ea3-41a9-99e3-d43dc6f4ad48 req-ffc150a2-a008-4dca-b849-60e1bcd52e64 service nova] [instance: f81dc25c-3549-4e25-b27c-a75a50d9a448] Detach interface failed, port_id=1e629a40-5a9f-4891-8148-7a2c925d8ad6, reason: Instance f81dc25c-3549-4e25-b27c-a75a50d9a448 could not be found. {{(pid=75176) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 28 15:41:05 user nova-compute[75176]: INFO nova.compute.manager [None req-abc638d4-60cb-4e15-9604-d006abdbb8d2 tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] [instance: f81dc25c-3549-4e25-b27c-a75a50d9a448] Took 0.95 seconds to detach 1 volumes for instance.
Nov 28 15:41:05 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-abc638d4-60cb-4e15-9604-d006abdbb8d2 tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:41:05 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-abc638d4-60cb-4e15-9604-d006abdbb8d2 tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:41:05 user nova-compute[75176]: DEBUG nova.compute.provider_tree [None req-abc638d4-60cb-4e15-9604-d006abdbb8d2 tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] Inventory has not changed in ProviderTree for provider: b37848d8-f401-4155-a029-b0ffa09ff85b {{(pid=75176) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 15:41:05 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-abc638d4-60cb-4e15-9604-d006abdbb8d2 tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] Inventory has not changed for provider b37848d8-f401-4155-a029-b0ffa09ff85b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75176) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 15:41:05 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-abc638d4-60cb-4e15-9604-d006abdbb8d2 tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.324s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:41:05 user nova-compute[75176]: INFO nova.scheduler.client.report [None req-abc638d4-60cb-4e15-9604-d006abdbb8d2 tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] Deleted allocations for instance f81dc25c-3549-4e25-b27c-a75a50d9a448
Nov 28 15:41:06 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-abc638d4-60cb-4e15-9604-d006abdbb8d2 tempest-DeleteServersTestJSON-982919505 tempest-DeleteServersTestJSON-982919505-project-member] Lock "f81dc25c-3549-4e25-b27c-a75a50d9a448" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.567s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:41:06 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:08 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:08 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:08 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:11 user nova-compute[75176]: DEBUG nova.compute.manager [req-e2c16305-bcd9-4ad5-8ea8-989a5e6bfcd7 req-1e55a209-77a7-4fcb-a3b3-171e87e8e6e9 service nova] [instance: 5b18c889-7694-4edf-8cf2-b9032e60289e] Received event network-changed-59bc046b-fdaa-432c-97b8-67a208dd399b {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:41:11 user nova-compute[75176]: DEBUG nova.compute.manager [req-e2c16305-bcd9-4ad5-8ea8-989a5e6bfcd7 req-1e55a209-77a7-4fcb-a3b3-171e87e8e6e9 service nova] [instance: 5b18c889-7694-4edf-8cf2-b9032e60289e] Refreshing instance network info cache due to event network-changed-59bc046b-fdaa-432c-97b8-67a208dd399b. {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 15:41:11 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-e2c16305-bcd9-4ad5-8ea8-989a5e6bfcd7 req-1e55a209-77a7-4fcb-a3b3-171e87e8e6e9 service nova] Acquiring lock "refresh_cache-5b18c889-7694-4edf-8cf2-b9032e60289e" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:41:11 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-e2c16305-bcd9-4ad5-8ea8-989a5e6bfcd7 req-1e55a209-77a7-4fcb-a3b3-171e87e8e6e9 service nova] Acquired lock "refresh_cache-5b18c889-7694-4edf-8cf2-b9032e60289e" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:41:11 user nova-compute[75176]: DEBUG nova.network.neutron [req-e2c16305-bcd9-4ad5-8ea8-989a5e6bfcd7 req-1e55a209-77a7-4fcb-a3b3-171e87e8e6e9 service nova] [instance: 5b18c889-7694-4edf-8cf2-b9032e60289e] Refreshing network info cache for port 59bc046b-fdaa-432c-97b8-67a208dd399b {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 15:41:12 user nova-compute[75176]: DEBUG nova.network.neutron [req-e2c16305-bcd9-4ad5-8ea8-989a5e6bfcd7 req-1e55a209-77a7-4fcb-a3b3-171e87e8e6e9 service nova] [instance: 5b18c889-7694-4edf-8cf2-b9032e60289e] Updated VIF entry in instance network info cache for port 59bc046b-fdaa-432c-97b8-67a208dd399b. {{(pid=75176) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 15:41:12 user nova-compute[75176]: DEBUG nova.network.neutron [req-e2c16305-bcd9-4ad5-8ea8-989a5e6bfcd7 req-1e55a209-77a7-4fcb-a3b3-171e87e8e6e9 service nova] [instance: 5b18c889-7694-4edf-8cf2-b9032e60289e] Updating instance_info_cache with network_info: [{"id": "59bc046b-fdaa-432c-97b8-67a208dd399b", "address": "fa:16:3e:e5:e8:01", "network": {"id": "1c357ee9-ff80-4a4b-9fd5-f2f348b36acc", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1869945166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0518c3ca77e4ecebb6ea8fbf6e60219", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59bc046b-fd", "ovs_interfaceid": "59bc046b-fdaa-432c-97b8-67a208dd399b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:41:12 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-e2c16305-bcd9-4ad5-8ea8-989a5e6bfcd7 req-1e55a209-77a7-4fcb-a3b3-171e87e8e6e9 service nova] Releasing lock "refresh_cache-5b18c889-7694-4edf-8cf2-b9032e60289e" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:41:12 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-158ecf2a-7d92-49de-a136-21fc6b6eaa50 tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Acquiring lock "47306d53-9ad7-4cae-ba6d-1f65239ef30f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:41:12 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-158ecf2a-7d92-49de-a136-21fc6b6eaa50 tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Lock "47306d53-9ad7-4cae-ba6d-1f65239ef30f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:41:12 user nova-compute[75176]: DEBUG nova.compute.manager [None req-158ecf2a-7d92-49de-a136-21fc6b6eaa50 tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] [instance: 47306d53-9ad7-4cae-ba6d-1f65239ef30f] Starting instance... {{(pid=75176) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 15:41:12 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-158ecf2a-7d92-49de-a136-21fc6b6eaa50 tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:41:12 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-158ecf2a-7d92-49de-a136-21fc6b6eaa50 tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:41:12 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-158ecf2a-7d92-49de-a136-21fc6b6eaa50 tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75176) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 15:41:12 user nova-compute[75176]: INFO nova.compute.claims [None req-158ecf2a-7d92-49de-a136-21fc6b6eaa50 tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] [instance: 47306d53-9ad7-4cae-ba6d-1f65239ef30f] Claim successful on node user
Nov 28 15:41:13 user nova-compute[75176]: DEBUG nova.compute.provider_tree [None req-158ecf2a-7d92-49de-a136-21fc6b6eaa50 tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Inventory has not changed in ProviderTree for provider: b37848d8-f401-4155-a029-b0ffa09ff85b {{(pid=75176) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 15:41:13 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-158ecf2a-7d92-49de-a136-21fc6b6eaa50 tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Inventory has not changed for provider b37848d8-f401-4155-a029-b0ffa09ff85b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75176) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 15:41:13 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:13 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-158ecf2a-7d92-49de-a136-21fc6b6eaa50 tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.445s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:41:13 user nova-compute[75176]: DEBUG nova.compute.manager [None req-158ecf2a-7d92-49de-a136-21fc6b6eaa50 tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] [instance: 47306d53-9ad7-4cae-ba6d-1f65239ef30f] Start building networks asynchronously for instance. {{(pid=75176) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 15:41:13 user nova-compute[75176]: DEBUG nova.compute.manager [None req-158ecf2a-7d92-49de-a136-21fc6b6eaa50 tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] [instance: 47306d53-9ad7-4cae-ba6d-1f65239ef30f] Allocating IP information in the background. {{(pid=75176) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 15:41:13 user nova-compute[75176]: DEBUG nova.network.neutron [None req-158ecf2a-7d92-49de-a136-21fc6b6eaa50 tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] [instance: 47306d53-9ad7-4cae-ba6d-1f65239ef30f] allocate_for_instance() {{(pid=75176) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 15:41:13 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-158ecf2a-7d92-49de-a136-21fc6b6eaa50 tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] [instance: 47306d53-9ad7-4cae-ba6d-1f65239ef30f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 15:41:13 user nova-compute[75176]: DEBUG nova.compute.manager [None req-158ecf2a-7d92-49de-a136-21fc6b6eaa50 tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] [instance: 47306d53-9ad7-4cae-ba6d-1f65239ef30f] Start building block device mappings for instance. {{(pid=75176) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 15:41:13 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:13 user nova-compute[75176]: DEBUG nova.policy [None req-158ecf2a-7d92-49de-a136-21fc6b6eaa50 tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '54766bbdce4346c0bd508451478b50aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1dfeef484e4627a0061d9d36fd2b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75176) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 15:41:13 user nova-compute[75176]: DEBUG nova.compute.manager [None req-158ecf2a-7d92-49de-a136-21fc6b6eaa50 tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] [instance: 47306d53-9ad7-4cae-ba6d-1f65239ef30f] Start spawning the instance on the hypervisor. {{(pid=75176) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 15:41:13 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-158ecf2a-7d92-49de-a136-21fc6b6eaa50 tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] [instance: 47306d53-9ad7-4cae-ba6d-1f65239ef30f] Creating instance directory {{(pid=75176) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 15:41:13 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-158ecf2a-7d92-49de-a136-21fc6b6eaa50 tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] [instance: 47306d53-9ad7-4cae-ba6d-1f65239ef30f] Creating image(s)
Nov 28 15:41:13 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-158ecf2a-7d92-49de-a136-21fc6b6eaa50 tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Acquiring lock "/opt/stack/data/nova/instances/47306d53-9ad7-4cae-ba6d-1f65239ef30f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:41:13 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-158ecf2a-7d92-49de-a136-21fc6b6eaa50 tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Lock "/opt/stack/data/nova/instances/47306d53-9ad7-4cae-ba6d-1f65239ef30f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:41:13 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-158ecf2a-7d92-49de-a136-21fc6b6eaa50 tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Lock "/opt/stack/data/nova/instances/47306d53-9ad7-4cae-ba6d-1f65239ef30f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:41:13 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-158ecf2a-7d92-49de-a136-21fc6b6eaa50 tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Acquiring lock "8c801c4a08f51b6bad2df9b91a5eb50e82891ca5" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:41:13 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-158ecf2a-7d92-49de-a136-21fc6b6eaa50 tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Lock "8c801c4a08f51b6bad2df9b91a5eb50e82891ca5" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:41:13 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-158ecf2a-7d92-49de-a136-21fc6b6eaa50 tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c801c4a08f51b6bad2df9b91a5eb50e82891ca5.part --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:41:14 user nova-compute[75176]: DEBUG nova.network.neutron [None req-158ecf2a-7d92-49de-a136-21fc6b6eaa50 tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] [instance: 47306d53-9ad7-4cae-ba6d-1f65239ef30f] Successfully created port: c3d44009-c128-4e98-8594-132ed6c85dbc {{(pid=75176) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 15:41:14 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-158ecf2a-7d92-49de-a136-21fc6b6eaa50 tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c801c4a08f51b6bad2df9b91a5eb50e82891ca5.part --force-share --output=json" returned: 0 in 0.279s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:41:14 user nova-compute[75176]: DEBUG nova.virt.images [None req-158ecf2a-7d92-49de-a136-21fc6b6eaa50 tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] 920bce21-95d9-45fe-a682-1abb452c4ccc was qcow2, converting to raw {{(pid=75176) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 28 15:41:14 user nova-compute[75176]: DEBUG nova.privsep.utils [None req-158ecf2a-7d92-49de-a136-21fc6b6eaa50 tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75176) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 28 15:41:14 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-158ecf2a-7d92-49de-a136-21fc6b6eaa50 tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/8c801c4a08f51b6bad2df9b91a5eb50e82891ca5.part /opt/stack/data/nova/instances/_base/8c801c4a08f51b6bad2df9b91a5eb50e82891ca5.converted {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:41:14 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-41468019-e790-4b45-9ae4-207eb132590f tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] Acquiring lock "5b18c889-7694-4edf-8cf2-b9032e60289e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:41:14 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-41468019-e790-4b45-9ae4-207eb132590f tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] Lock "5b18c889-7694-4edf-8cf2-b9032e60289e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:41:14 user nova-compute[75176]: DEBUG nova.objects.instance [None req-41468019-e790-4b45-9ae4-207eb132590f tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] Lazy-loading 'flavor' on Instance uuid 5b18c889-7694-4edf-8cf2-b9032e60289e {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:41:14 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-41468019-e790-4b45-9ae4-207eb132590f tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] Lock "5b18c889-7694-4edf-8cf2-b9032e60289e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.085s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:41:14 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-158ecf2a-7d92-49de-a136-21fc6b6eaa50 tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/8c801c4a08f51b6bad2df9b91a5eb50e82891ca5.part /opt/stack/data/nova/instances/_base/8c801c4a08f51b6bad2df9b91a5eb50e82891ca5.converted" returned: 0 in 0.156s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:41:14 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-158ecf2a-7d92-49de-a136-21fc6b6eaa50 tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c801c4a08f51b6bad2df9b91a5eb50e82891ca5.converted --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:41:14 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-41468019-e790-4b45-9ae4-207eb132590f tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] Acquiring lock "5b18c889-7694-4edf-8cf2-b9032e60289e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:41:14 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-41468019-e790-4b45-9ae4-207eb132590f tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] Lock "5b18c889-7694-4edf-8cf2-b9032e60289e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:41:14 user nova-compute[75176]: INFO nova.compute.manager [None req-41468019-e790-4b45-9ae4-207eb132590f tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] [instance: 5b18c889-7694-4edf-8cf2-b9032e60289e] Attaching volume a1d37820-ff6e-4bc6-a564-582b18c0beb2 to /dev/vdb
Nov 28 15:41:14 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-158ecf2a-7d92-49de-a136-21fc6b6eaa50 tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c801c4a08f51b6bad2df9b91a5eb50e82891ca5.converted --force-share --output=json" returned: 0 in 0.219s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:41:14 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-158ecf2a-7d92-49de-a136-21fc6b6eaa50 tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Lock "8c801c4a08f51b6bad2df9b91a5eb50e82891ca5" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.113s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:41:14 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-158ecf2a-7d92-49de-a136-21fc6b6eaa50 tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c801c4a08f51b6bad2df9b91a5eb50e82891ca5 --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:41:14 user nova-compute[75176]: DEBUG nova.network.neutron [None req-158ecf2a-7d92-49de-a136-21fc6b6eaa50 tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] [instance: 47306d53-9ad7-4cae-ba6d-1f65239ef30f] Successfully updated port: c3d44009-c128-4e98-8594-132ed6c85dbc {{(pid=75176) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 15:41:14 user nova-compute[75176]: DEBUG os_brick.utils [None req-41468019-e790-4b45-9ae4-207eb132590f tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 15:41:14 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:41:14 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-158ecf2a-7d92-49de-a136-21fc6b6eaa50 tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Acquiring lock "refresh_cache-47306d53-9ad7-4cae-ba6d-1f65239ef30f" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:41:14 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-158ecf2a-7d92-49de-a136-21fc6b6eaa50 tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Acquired lock "refresh_cache-47306d53-9ad7-4cae-ba6d-1f65239ef30f" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:41:14 user nova-compute[75176]: DEBUG nova.network.neutron [None req-158ecf2a-7d92-49de-a136-21fc6b6eaa50 tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] [instance: 47306d53-9ad7-4cae-ba6d-1f65239ef30f] Building network info cache for instance {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 15:41:14 user nova-compute[75176]: DEBUG nova.compute.manager [req-195d3a44-e733-4eee-bfbc-5b408aa846a1 req-c63c8334-93f0-4be9-bd68-ddc50e023008 service nova] [instance: 47306d53-9ad7-4cae-ba6d-1f65239ef30f] Received event network-changed-c3d44009-c128-4e98-8594-132ed6c85dbc {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:41:14 user nova-compute[75176]: DEBUG nova.compute.manager [req-195d3a44-e733-4eee-bfbc-5b408aa846a1 req-c63c8334-93f0-4be9-bd68-ddc50e023008 service nova] [instance: 47306d53-9ad7-4cae-ba6d-1f65239ef30f] Refreshing instance network info cache due to event network-changed-c3d44009-c128-4e98-8594-132ed6c85dbc. {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 15:41:14 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-195d3a44-e733-4eee-bfbc-5b408aa846a1 req-c63c8334-93f0-4be9-bd68-ddc50e023008 service nova] Acquiring lock "refresh_cache-47306d53-9ad7-4cae-ba6d-1f65239ef30f" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:41:14 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:41:14 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e99e230-0c19-4856-a939-fd1ebf938288]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:edc924a949b2\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:41:14 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:41:14 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.023s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:41:14 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[48d0e6c5-c2ad-4aa5-954c-20ff113a4bfc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:41:14 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:41:14 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:41:14 user nova-compute[75176]: DEBUG nova.network.neutron [None req-158ecf2a-7d92-49de-a136-21fc6b6eaa50 tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] [instance: 47306d53-9ad7-4cae-ba6d-1f65239ef30f] Instance cache missing network info. {{(pid=75176) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 15:41:14 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[955d324a-3b4d-4141-b6f0-34710450e512]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:41:14 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3f260ec-e3b5-4381-ba0b-3f8f280a190e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:41:14 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-41468019-e790-4b45-9ae4-207eb132590f tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] Running cmd (subprocess): nvme version {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:41:14 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-41468019-e790-4b45-9ae4-207eb132590f tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] 'nvme version' failed. Not Retrying. {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 15:41:14 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.nvmeof [None req-41468019-e790-4b45-9ae4-207eb132590f tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] nvme not present on system {{(pid=75176) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 15:41:14 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:41:14 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 15:41:14 user nova-compute[75176]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 15:41:14 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeed1ef3-6bf2-4377-89a8-90e57b270d7c]: (4, '') {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:41:14 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.lightos [None req-41468019-e790-4b45-9ae4-207eb132590f tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75176) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 15:41:14 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.lightos [None req-41468019-e790-4b45-9ae4-207eb132590f tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75176) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 15:41:14 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.lightos [None req-41468019-e790-4b45-9ae4-207eb132590f tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] LIGHTOS: no hostnqn found. {{(pid=75176) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 15:41:14 user nova-compute[75176]: DEBUG os_brick.utils [None req-41468019-e790-4b45-9ae4-207eb132590f tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] <== get_connector_properties: return (154ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:edc924a949b2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 15:41:14 user nova-compute[75176]: DEBUG nova.virt.block_device [None req-41468019-e790-4b45-9ae4-207eb132590f tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] [instance: 5b18c889-7694-4edf-8cf2-b9032e60289e] Updating existing volume attachment record: b6a74f26-d316-468a-b081-de1dcd5b3547 {{(pid=75176) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 15:41:14 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-158ecf2a-7d92-49de-a136-21fc6b6eaa50 tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c801c4a08f51b6bad2df9b91a5eb50e82891ca5 --force-share --output=json" returned: 0 in 0.229s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:41:14 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-158ecf2a-7d92-49de-a136-21fc6b6eaa50 tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Acquiring lock "8c801c4a08f51b6bad2df9b91a5eb50e82891ca5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:41:14 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-158ecf2a-7d92-49de-a136-21fc6b6eaa50 tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Lock "8c801c4a08f51b6bad2df9b91a5eb50e82891ca5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:41:14 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-158ecf2a-7d92-49de-a136-21fc6b6eaa50 tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c801c4a08f51b6bad2df9b91a5eb50e82891ca5 --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:41:15 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-158ecf2a-7d92-49de-a136-21fc6b6eaa50 tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c801c4a08f51b6bad2df9b91a5eb50e82891ca5 --force-share --output=json" returned: 0 in 0.176s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:41:15 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-158ecf2a-7d92-49de-a136-21fc6b6eaa50 tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c801c4a08f51b6bad2df9b91a5eb50e82891ca5,backing_fmt=raw /opt/stack/data/nova/instances/47306d53-9ad7-4cae-ba6d-1f65239ef30f/disk 1073741824 {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:41:15 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-158ecf2a-7d92-49de-a136-21fc6b6eaa50 tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c801c4a08f51b6bad2df9b91a5eb50e82891ca5,backing_fmt=raw /opt/stack/data/nova/instances/47306d53-9ad7-4cae-ba6d-1f65239ef30f/disk 1073741824" returned: 0 in 0.051s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:41:15 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-158ecf2a-7d92-49de-a136-21fc6b6eaa50 tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Lock "8c801c4a08f51b6bad2df9b91a5eb50e82891ca5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.235s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:41:15 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-158ecf2a-7d92-49de-a136-21fc6b6eaa50 tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c801c4a08f51b6bad2df9b91a5eb50e82891ca5 --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:41:15 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-158ecf2a-7d92-49de-a136-21fc6b6eaa50 tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c801c4a08f51b6bad2df9b91a5eb50e82891ca5 --force-share --output=json" returned: 0 in 0.177s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:41:15 user nova-compute[75176]: DEBUG nova.virt.disk.api [None req-158ecf2a-7d92-49de-a136-21fc6b6eaa50 tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Checking if we can resize image /opt/stack/data/nova/instances/47306d53-9ad7-4cae-ba6d-1f65239ef30f/disk. size=1073741824 {{(pid=75176) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 15:41:15 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-158ecf2a-7d92-49de-a136-21fc6b6eaa50 tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47306d53-9ad7-4cae-ba6d-1f65239ef30f/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:41:15 user nova-compute[75176]: DEBUG nova.network.neutron [None req-158ecf2a-7d92-49de-a136-21fc6b6eaa50 tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] [instance: 47306d53-9ad7-4cae-ba6d-1f65239ef30f] Updating instance_info_cache with network_info: [{"id": "c3d44009-c128-4e98-8594-132ed6c85dbc", "address": "fa:16:3e:0b:f3:cf", "network": {"id": "b06b85af-96d9-41cb-9ad2-7fc0523761e7", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-850315220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc1dfeef484e4627a0061d9d36fd2b40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3d44009-c1", "ovs_interfaceid": "c3d44009-c128-4e98-8594-132ed6c85dbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:41:15 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-158ecf2a-7d92-49de-a136-21fc6b6eaa50 tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Releasing lock "refresh_cache-47306d53-9ad7-4cae-ba6d-1f65239ef30f" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:41:15 user nova-compute[75176]: DEBUG nova.compute.manager [None req-158ecf2a-7d92-49de-a136-21fc6b6eaa50 tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] [instance: 47306d53-9ad7-4cae-ba6d-1f65239ef30f] Instance network_info: |[{"id": "c3d44009-c128-4e98-8594-132ed6c85dbc", "address": "fa:16:3e:0b:f3:cf", "network": {"id": "b06b85af-96d9-41cb-9ad2-7fc0523761e7", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-850315220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc1dfeef484e4627a0061d9d36fd2b40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3d44009-c1", "ovs_interfaceid": "c3d44009-c128-4e98-8594-132ed6c85dbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75176) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 15:41:15 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-195d3a44-e733-4eee-bfbc-5b408aa846a1 req-c63c8334-93f0-4be9-bd68-ddc50e023008 service nova] Acquired lock "refresh_cache-47306d53-9ad7-4cae-ba6d-1f65239ef30f" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:41:15 user nova-compute[75176]: DEBUG nova.network.neutron [req-195d3a44-e733-4eee-bfbc-5b408aa846a1 req-c63c8334-93f0-4be9-bd68-ddc50e023008 service nova] [instance: 47306d53-9ad7-4cae-ba6d-1f65239ef30f] Refreshing network info cache for port c3d44009-c128-4e98-8594-132ed6c85dbc {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 15:41:15 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-158ecf2a-7d92-49de-a136-21fc6b6eaa50 tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47306d53-9ad7-4cae-ba6d-1f65239ef30f/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:41:15 user nova-compute[75176]: DEBUG nova.virt.disk.api [None req-158ecf2a-7d92-49de-a136-21fc6b6eaa50 tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Cannot resize image /opt/stack/data/nova/instances/47306d53-9ad7-4cae-ba6d-1f65239ef30f/disk to a smaller size. {{(pid=75176) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 15:41:15 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-158ecf2a-7d92-49de-a136-21fc6b6eaa50 tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] [instance: 47306d53-9ad7-4cae-ba6d-1f65239ef30f] Created local disks {{(pid=75176) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 15:41:15 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-158ecf2a-7d92-49de-a136-21fc6b6eaa50 tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] [instance: 47306d53-9ad7-4cae-ba6d-1f65239ef30f] Ensure instance console log exists: /opt/stack/data/nova/instances/47306d53-9ad7-4cae-ba6d-1f65239ef30f/console.log {{(pid=75176) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 15:41:15 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-158ecf2a-7d92-49de-a136-21fc6b6eaa50 tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:41:15 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-158ecf2a-7d92-49de-a136-21fc6b6eaa50 tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:41:15 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-158ecf2a-7d92-49de-a136-21fc6b6eaa50 tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:41:15 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-158ecf2a-7d92-49de-a136-21fc6b6eaa50 tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] [instance: 47306d53-9ad7-4cae-ba6d-1f65239ef30f] Start _get_guest_xml network_info=[{"id": "c3d44009-c128-4e98-8594-132ed6c85dbc", "address": "fa:16:3e:0b:f3:cf", "network": {"id": "b06b85af-96d9-41cb-9ad2-7fc0523761e7", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-850315220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc1dfeef484e4627a0061d9d36fd2b40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3d44009-c1", "ovs_interfaceid": "c3d44009-c128-4e98-8594-132ed6c85dbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T15:41:10Z,direct_url=<?>,disk_format='qcow2',id=920bce21-95d9-45fe-a682-1abb452c4ccc,min_disk=0,min_ram=0,name='tempest-scenario-img--1609105896',owner='bc1dfeef484e4627a0061d9d36fd2b40',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T15:41:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'size': 0, 'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'image_id': '920bce21-95d9-45fe-a682-1abb452c4ccc'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75176) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 15:41:15 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-158ecf2a-7d92-49de-a136-21fc6b6eaa50 tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 15:41:15 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-158ecf2a-7d92-49de-a136-21fc6b6eaa50 tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 15:41:15 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-158ecf2a-7d92-49de-a136-21fc6b6eaa50 tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75176) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 15:41:15 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-158ecf2a-7d92-49de-a136-21fc6b6eaa50 tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] CPU controller missing on host. {{(pid=75176) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 15:41:15 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-158ecf2a-7d92-49de-a136-21fc6b6eaa50 tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75176) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 15:41:15 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-158ecf2a-7d92-49de-a136-21fc6b6eaa50 tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] CPU controller found on host. {{(pid=75176) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 15:41:15 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-158ecf2a-7d92-49de-a136-21fc6b6eaa50 tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75176) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 15:41:15 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-158ecf2a-7d92-49de-a136-21fc6b6eaa50 tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T15:35:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T15:41:10Z,direct_url=<?>,disk_format='qcow2',id=920bce21-95d9-45fe-a682-1abb452c4ccc,min_disk=0,min_ram=0,name='tempest-scenario-img--1609105896',owner='bc1dfeef484e4627a0061d9d36fd2b40',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T15:41:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 15:41:15 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-158ecf2a-7d92-49de-a136-21fc6b6eaa50 tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Flavor limits 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 15:41:15 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-158ecf2a-7d92-49de-a136-21fc6b6eaa50 tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Image limits 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 15:41:15 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-158ecf2a-7d92-49de-a136-21fc6b6eaa50 tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Flavor pref 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 15:41:15 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-158ecf2a-7d92-49de-a136-21fc6b6eaa50 tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Image pref 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 15:41:15 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-158ecf2a-7d92-49de-a136-21fc6b6eaa50 tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 15:41:15 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-158ecf2a-7d92-49de-a136-21fc6b6eaa50 tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 15:41:15 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-158ecf2a-7d92-49de-a136-21fc6b6eaa50 tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75176) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 15:41:15 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-158ecf2a-7d92-49de-a136-21fc6b6eaa50 tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Got 1 possible topologies {{(pid=75176) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 15:41:15 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-158ecf2a-7d92-49de-a136-21fc6b6eaa50 tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 15:41:15 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-158ecf2a-7d92-49de-a136-21fc6b6eaa50 tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 15:41:15 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-158ecf2a-7d92-49de-a136-21fc6b6eaa50 tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T15:41:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1171264206',display_name='tempest-TestMinimumBasicScenario-server-1171264206',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1171264206',id=12,image_ref='920bce21-95d9-45fe-a682-1abb452c4ccc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK1Yogtu9cHTqj/O0yW5ilhTCHe9GWdz8HcrAmcuCSEjGwLVrrqLCp+oEhqH6U3k5OzpunBE1hBj3JYBdp1D5PZTdSdrxBnMO+7y0Ja6VHcYxZP1f9WjFaePvpMxZeLKXg==',key_name='tempest-TestMinimumBasicScenario-327229554',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bc1dfeef484e4627a0061d9d36fd2b40',ramdisk_id='',reservation_id='r-mryylpp6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='920bce21-95d9-45fe-a682-1abb452c4ccc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-438096803',owner_user_name='tempest-TestMinimumBasicScenario-438096803-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T15:41:13Z,user_data=None,user_id='54766bbdce4346c0bd508451478b50aa',uuid=47306d53-9ad7-4cae-ba6d-1f65239ef30f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c3d44009-c128-4e98-8594-132ed6c85dbc", "address": "fa:16:3e:0b:f3:cf", "network": {"id": "b06b85af-96d9-41cb-9ad2-7fc0523761e7", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-850315220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc1dfeef484e4627a0061d9d36fd2b40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3d44009-c1", "ovs_interfaceid": "c3d44009-c128-4e98-8594-132ed6c85dbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75176) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 15:41:15 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-158ecf2a-7d92-49de-a136-21fc6b6eaa50 tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Converting VIF {"id": "c3d44009-c128-4e98-8594-132ed6c85dbc", "address": "fa:16:3e:0b:f3:cf", "network": {"id": "b06b85af-96d9-41cb-9ad2-7fc0523761e7", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-850315220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc1dfeef484e4627a0061d9d36fd2b40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3d44009-c1", "ovs_interfaceid": "c3d44009-c128-4e98-8594-132ed6c85dbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:41:15 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-158ecf2a-7d92-49de-a136-21fc6b6eaa50 tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:f3:cf,bridge_name='br-int',has_traffic_filtering=True,id=c3d44009-c128-4e98-8594-132ed6c85dbc,network=Network(b06b85af-96d9-41cb-9ad2-7fc0523761e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3d44009-c1') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:41:15 user nova-compute[75176]: DEBUG nova.objects.instance [None req-158ecf2a-7d92-49de-a136-21fc6b6eaa50 tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Lazy-loading 'pci_devices' on Instance uuid 47306d53-9ad7-4cae-ba6d-1f65239ef30f {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:41:15 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-158ecf2a-7d92-49de-a136-21fc6b6eaa50 tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] [instance: 47306d53-9ad7-4cae-ba6d-1f65239ef30f] End _get_guest_xml xml=<domain type="kvm">
Nov 28 15:41:15 user nova-compute[75176]:   <uuid>47306d53-9ad7-4cae-ba6d-1f65239ef30f</uuid>
Nov 28 15:41:15 user nova-compute[75176]:   <name>instance-0000000c</name>
Nov 28 15:41:15 user nova-compute[75176]:   <memory>524288</memory>
Nov 28 15:41:15 user nova-compute[75176]:   <vcpu>1</vcpu>
Nov 28 15:41:15 user nova-compute[75176]:   <metadata>
Nov 28 15:41:15 user nova-compute[75176]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 15:41:15 user nova-compute[75176]:       <nova:package version="0.0.0"/>
Nov 28 15:41:15 user nova-compute[75176]:       <nova:name>tempest-TestMinimumBasicScenario-server-1171264206</nova:name>
Nov 28 15:41:15 user nova-compute[75176]:       <nova:creationTime>2023-11-28 15:41:15</nova:creationTime>
Nov 28 15:41:15 user nova-compute[75176]:       <nova:flavor name="m1.tiny">
Nov 28 15:41:15 user nova-compute[75176]:         <nova:memory>512</nova:memory>
Nov 28 15:41:15 user nova-compute[75176]:         <nova:disk>1</nova:disk>
Nov 28 15:41:15 user nova-compute[75176]:         <nova:swap>0</nova:swap>
Nov 28 15:41:15 user nova-compute[75176]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 15:41:15 user nova-compute[75176]:         <nova:vcpus>1</nova:vcpus>
Nov 28 15:41:15 user nova-compute[75176]:       </nova:flavor>
Nov 28 15:41:15 user nova-compute[75176]:       <nova:owner>
Nov 28 15:41:15 user nova-compute[75176]:         <nova:user uuid="54766bbdce4346c0bd508451478b50aa">tempest-TestMinimumBasicScenario-438096803-project-member</nova:user>
Nov 28 15:41:15 user nova-compute[75176]:         <nova:project uuid="bc1dfeef484e4627a0061d9d36fd2b40">tempest-TestMinimumBasicScenario-438096803</nova:project>
Nov 28 15:41:15 user nova-compute[75176]:       </nova:owner>
Nov 28 15:41:15 user nova-compute[75176]:       <nova:root type="image" uuid="920bce21-95d9-45fe-a682-1abb452c4ccc"/>
Nov 28 15:41:15 user nova-compute[75176]:       <nova:ports>
Nov 28 15:41:15 user nova-compute[75176]:         <nova:port uuid="c3d44009-c128-4e98-8594-132ed6c85dbc">
Nov 28 15:41:15 user nova-compute[75176]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 28 15:41:15 user nova-compute[75176]:         </nova:port>
Nov 28 15:41:15 user nova-compute[75176]:       </nova:ports>
Nov 28 15:41:15 user nova-compute[75176]:     </nova:instance>
Nov 28 15:41:15 user nova-compute[75176]:   </metadata>
Nov 28 15:41:15 user nova-compute[75176]:   <sysinfo type="smbios">
Nov 28 15:41:15 user nova-compute[75176]:     <system>
Nov 28 15:41:15 user nova-compute[75176]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 15:41:15 user nova-compute[75176]:       <entry name="product">OpenStack Nova</entry>
Nov 28 15:41:15 user nova-compute[75176]:       <entry name="version">0.0.0</entry>
Nov 28 15:41:15 user nova-compute[75176]:       <entry name="serial">47306d53-9ad7-4cae-ba6d-1f65239ef30f</entry>
Nov 28 15:41:15 user nova-compute[75176]:       <entry name="uuid">47306d53-9ad7-4cae-ba6d-1f65239ef30f</entry>
Nov 28 15:41:15 user nova-compute[75176]:       <entry name="family">Virtual Machine</entry>
Nov 28 15:41:15 user nova-compute[75176]:     </system>
Nov 28 15:41:15 user nova-compute[75176]:   </sysinfo>
Nov 28 15:41:15 user nova-compute[75176]:   <os>
Nov 28 15:41:15 user nova-compute[75176]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 15:41:15 user nova-compute[75176]:     <boot dev="hd"/>
Nov 28 15:41:15 user nova-compute[75176]:     <smbios mode="sysinfo"/>
Nov 28 15:41:15 user nova-compute[75176]:   </os>
Nov 28 15:41:15 user nova-compute[75176]:   <features>
Nov 28 15:41:15 user nova-compute[75176]:     <acpi/>
Nov 28 15:41:15 user nova-compute[75176]:     <apic/>
Nov 28 15:41:15 user nova-compute[75176]:     <vmcoreinfo/>
Nov 28 15:41:15 user nova-compute[75176]:   </features>
Nov 28 15:41:15 user nova-compute[75176]:   <clock offset="utc">
Nov 28 15:41:15 user nova-compute[75176]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 15:41:15 user nova-compute[75176]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 15:41:15 user nova-compute[75176]:     <timer name="hpet" present="no"/>
Nov 28 15:41:15 user nova-compute[75176]:   </clock>
Nov 28 15:41:15 user nova-compute[75176]:   <cpu mode="custom" match="exact">
Nov 28 15:41:15 user nova-compute[75176]:     <model>Nehalem</model>
Nov 28 15:41:15 user nova-compute[75176]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 15:41:15 user nova-compute[75176]:   </cpu>
Nov 28 15:41:15 user nova-compute[75176]:   <devices>
Nov 28 15:41:15 user nova-compute[75176]:     <disk type="file" device="disk">
Nov 28 15:41:15 user nova-compute[75176]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 15:41:15 user nova-compute[75176]:       <source file="/opt/stack/data/nova/instances/47306d53-9ad7-4cae-ba6d-1f65239ef30f/disk"/>
Nov 28 15:41:15 user nova-compute[75176]:       <target dev="vda" bus="virtio"/>
Nov 28 15:41:15 user nova-compute[75176]:     </disk>
Nov 28 15:41:15 user nova-compute[75176]:     <interface type="ethernet">
Nov 28 15:41:15 user nova-compute[75176]:       <mac address="fa:16:3e:0b:f3:cf"/>
Nov 28 15:41:15 user nova-compute[75176]:       <model type="virtio"/>
Nov 28 15:41:15 user nova-compute[75176]:       <mtu size="1442"/>
Nov 28 15:41:15 user nova-compute[75176]:       <target dev="tapc3d44009-c1"/>
Nov 28 15:41:15 user nova-compute[75176]:     </interface>
Nov 28 15:41:15 user nova-compute[75176]:     <serial type="pty">
Nov 28 15:41:15 user nova-compute[75176]:       <log file="/opt/stack/data/nova/instances/47306d53-9ad7-4cae-ba6d-1f65239ef30f/console.log" append="off"/>
Nov 28 15:41:15 user nova-compute[75176]:     </serial>
Nov 28 15:41:15 user nova-compute[75176]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 15:41:15 user nova-compute[75176]:     <video>
Nov 28 15:41:15 user nova-compute[75176]:       <model type="virtio"/>
Nov 28 15:41:15 user nova-compute[75176]:     </video>
Nov 28 15:41:15 user nova-compute[75176]:     <rng model="virtio">
Nov 28 15:41:15 user nova-compute[75176]:       <backend model="random">/dev/urandom</backend>
Nov 28 15:41:15 user nova-compute[75176]:     </rng>
Nov 28 15:41:15 user nova-compute[75176]:     <controller type="usb" index="0" model="none"/>
Nov 28 15:41:15 user nova-compute[75176]:     <memballoon model="virtio">
Nov 28 15:41:15 user nova-compute[75176]:       <stats period="10"/>
Nov 28 15:41:15 user nova-compute[75176]:     </memballoon>
Nov 28 15:41:15 user nova-compute[75176]:   </devices>
Nov 28 15:41:15 user nova-compute[75176]: </domain>
Nov 28 15:41:15 user nova-compute[75176]:  {{(pid=75176) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 15:41:15 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-158ecf2a-7d92-49de-a136-21fc6b6eaa50 tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T15:41:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1171264206',display_name='tempest-TestMinimumBasicScenario-server-1171264206',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1171264206',id=12,image_ref='920bce21-95d9-45fe-a682-1abb452c4ccc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK1Yogtu9cHTqj/O0yW5ilhTCHe9GWdz8HcrAmcuCSEjGwLVrrqLCp+oEhqH6U3k5OzpunBE1hBj3JYBdp1D5PZTdSdrxBnMO+7y0Ja6VHcYxZP1f9WjFaePvpMxZeLKXg==',key_name='tempest-TestMinimumBasicScenario-327229554',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bc1dfeef484e4627a0061d9d36fd2b40',ramdisk_id='',reservation_id='r-mryylpp6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='920bce21-95d9-45fe-a682-1abb452c4ccc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-438096803',owner_user_name='tempest-TestMinimumBasicScenario-438096803-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T15:41:13Z,user_data=None,user_id='54766bbdce4346c0bd508451478b50aa',uuid=47306d53-9ad7-4cae-ba6d-1f65239ef30f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c3d44009-c128-4e98-8594-132ed6c85dbc", "address": "fa:16:3e:0b:f3:cf", "network": {"id": "b06b85af-96d9-41cb-9ad2-7fc0523761e7", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-850315220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc1dfeef484e4627a0061d9d36fd2b40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3d44009-c1", "ovs_interfaceid": "c3d44009-c128-4e98-8594-132ed6c85dbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 15:41:15 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-158ecf2a-7d92-49de-a136-21fc6b6eaa50 tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Converting VIF {"id": "c3d44009-c128-4e98-8594-132ed6c85dbc", "address": "fa:16:3e:0b:f3:cf", "network": {"id": "b06b85af-96d9-41cb-9ad2-7fc0523761e7", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-850315220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc1dfeef484e4627a0061d9d36fd2b40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3d44009-c1", "ovs_interfaceid": "c3d44009-c128-4e98-8594-132ed6c85dbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:41:15 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-158ecf2a-7d92-49de-a136-21fc6b6eaa50 tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:f3:cf,bridge_name='br-int',has_traffic_filtering=True,id=c3d44009-c128-4e98-8594-132ed6c85dbc,network=Network(b06b85af-96d9-41cb-9ad2-7fc0523761e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3d44009-c1') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:41:15 user nova-compute[75176]: DEBUG os_vif [None req-158ecf2a-7d92-49de-a136-21fc6b6eaa50 tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:f3:cf,bridge_name='br-int',has_traffic_filtering=True,id=c3d44009-c128-4e98-8594-132ed6c85dbc,network=Network(b06b85af-96d9-41cb-9ad2-7fc0523761e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3d44009-c1') {{(pid=75176) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 15:41:15 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:15 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:41:15 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 15:41:15 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:15 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '66b7e38d-4666-5612-abc5-a7a11048b458', '_type': 'linux-noop'}}, row=False) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:41:15 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:15 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:15 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:15 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc3d44009-c1, may_exist=True, interface_attrs={}) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:41:15 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc3d44009-c1, col_values=(('qos', UUID('77270294-5f6a-4788-bfa4-540cab3328e8')),), if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:41:15 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc3d44009-c1, col_values=(('external_ids', {'iface-id': 'c3d44009-c128-4e98-8594-132ed6c85dbc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0b:f3:cf', 'vm-uuid': '47306d53-9ad7-4cae-ba6d-1f65239ef30f'}),), if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:41:15 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:15 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:41:15 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:15 user nova-compute[75176]: INFO os_vif [None req-158ecf2a-7d92-49de-a136-21fc6b6eaa50 tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:f3:cf,bridge_name='br-int',has_traffic_filtering=True,id=c3d44009-c128-4e98-8594-132ed6c85dbc,network=Network(b06b85af-96d9-41cb-9ad2-7fc0523761e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3d44009-c1')
Nov 28 15:41:15 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-158ecf2a-7d92-49de-a136-21fc6b6eaa50 tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] No BDM found with device name vda, not building metadata. {{(pid=75176) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 15:41:15 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-158ecf2a-7d92-49de-a136-21fc6b6eaa50 tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] No VIF found with MAC fa:16:3e:0b:f3:cf, not building metadata {{(pid=75176) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 15:41:15 user nova-compute[75176]: DEBUG nova.network.neutron [req-195d3a44-e733-4eee-bfbc-5b408aa846a1 req-c63c8334-93f0-4be9-bd68-ddc50e023008 service nova] [instance: 47306d53-9ad7-4cae-ba6d-1f65239ef30f] Updated VIF entry in instance network info cache for port c3d44009-c128-4e98-8594-132ed6c85dbc. {{(pid=75176) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 15:41:15 user nova-compute[75176]: DEBUG nova.network.neutron [req-195d3a44-e733-4eee-bfbc-5b408aa846a1 req-c63c8334-93f0-4be9-bd68-ddc50e023008 service nova] [instance: 47306d53-9ad7-4cae-ba6d-1f65239ef30f] Updating instance_info_cache with network_info: [{"id": "c3d44009-c128-4e98-8594-132ed6c85dbc", "address": "fa:16:3e:0b:f3:cf", "network": {"id": "b06b85af-96d9-41cb-9ad2-7fc0523761e7", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-850315220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc1dfeef484e4627a0061d9d36fd2b40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3d44009-c1", "ovs_interfaceid": "c3d44009-c128-4e98-8594-132ed6c85dbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:41:15 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-195d3a44-e733-4eee-bfbc-5b408aa846a1 req-c63c8334-93f0-4be9-bd68-ddc50e023008 service nova] Releasing lock "refresh_cache-47306d53-9ad7-4cae-ba6d-1f65239ef30f" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:41:17 user nova-compute[75176]: DEBUG nova.compute.manager [req-27f8b9fb-6866-4f27-aace-602df99da3d1 req-2c1a3c7e-a512-4d97-adac-0a4c7f4c8c70 service nova] [instance: 4ed0eb85-e975-446c-8da7-148a4bb36958] Received event network-changed-9996a5ef-0801-4136-bd1d-fd5372d97e9d {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:41:17 user nova-compute[75176]: DEBUG nova.compute.manager [req-27f8b9fb-6866-4f27-aace-602df99da3d1 req-2c1a3c7e-a512-4d97-adac-0a4c7f4c8c70 service nova] [instance: 4ed0eb85-e975-446c-8da7-148a4bb36958] Refreshing instance network info cache due to event network-changed-9996a5ef-0801-4136-bd1d-fd5372d97e9d. {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 15:41:17 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-27f8b9fb-6866-4f27-aace-602df99da3d1 req-2c1a3c7e-a512-4d97-adac-0a4c7f4c8c70 service nova] Acquiring lock "refresh_cache-4ed0eb85-e975-446c-8da7-148a4bb36958" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:41:17 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-27f8b9fb-6866-4f27-aace-602df99da3d1 req-2c1a3c7e-a512-4d97-adac-0a4c7f4c8c70 service nova] Acquired lock "refresh_cache-4ed0eb85-e975-446c-8da7-148a4bb36958" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:41:17 user nova-compute[75176]: DEBUG nova.network.neutron [req-27f8b9fb-6866-4f27-aace-602df99da3d1 req-2c1a3c7e-a512-4d97-adac-0a4c7f4c8c70 service nova] [instance: 4ed0eb85-e975-446c-8da7-148a4bb36958] Refreshing network info cache for port 9996a5ef-0801-4136-bd1d-fd5372d97e9d {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 15:41:17 user nova-compute[75176]: DEBUG nova.compute.manager [req-5f3d8457-d170-4118-99e4-a8f784fe503c req-ec897fc8-157a-4801-b927-46fe26aa36aa service nova] [instance: e2e25e19-c832-4945-9257-64e6103feb0c] Received event network-changed-05efa912-30d1-4474-a2eb-7d88fa0813e7 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:41:17 user nova-compute[75176]: DEBUG nova.compute.manager [req-5f3d8457-d170-4118-99e4-a8f784fe503c req-ec897fc8-157a-4801-b927-46fe26aa36aa service nova] [instance: e2e25e19-c832-4945-9257-64e6103feb0c] Refreshing instance network info cache due to event network-changed-05efa912-30d1-4474-a2eb-7d88fa0813e7. {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 15:41:17 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-5f3d8457-d170-4118-99e4-a8f784fe503c req-ec897fc8-157a-4801-b927-46fe26aa36aa service nova] Acquiring lock "refresh_cache-e2e25e19-c832-4945-9257-64e6103feb0c" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:41:17 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-5f3d8457-d170-4118-99e4-a8f784fe503c req-ec897fc8-157a-4801-b927-46fe26aa36aa service nova] Acquired lock "refresh_cache-e2e25e19-c832-4945-9257-64e6103feb0c" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:41:17 user nova-compute[75176]: DEBUG nova.network.neutron [req-5f3d8457-d170-4118-99e4-a8f784fe503c req-ec897fc8-157a-4801-b927-46fe26aa36aa service nova] [instance: e2e25e19-c832-4945-9257-64e6103feb0c] Refreshing network info cache for port 05efa912-30d1-4474-a2eb-7d88fa0813e7 {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 15:41:17 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:17 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:17 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:17 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:17 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-f79077f3-2c19-43f9-aeb0-5ffc85cf8bca tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] Acquiring lock "interface-e2e25e19-c832-4945-9257-64e6103feb0c-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:41:17 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-f79077f3-2c19-43f9-aeb0-5ffc85cf8bca tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] Lock "interface-e2e25e19-c832-4945-9257-64e6103feb0c-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:41:17 user nova-compute[75176]: DEBUG nova.objects.instance [None req-f79077f3-2c19-43f9-aeb0-5ffc85cf8bca tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] Lazy-loading 'flavor' on Instance uuid e2e25e19-c832-4945-9257-64e6103feb0c {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:41:17 user nova-compute[75176]: DEBUG nova.objects.instance [None req-f79077f3-2c19-43f9-aeb0-5ffc85cf8bca tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] Lazy-loading 'pci_requests' on Instance uuid e2e25e19-c832-4945-9257-64e6103feb0c {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:41:17 user nova-compute[75176]: DEBUG nova.objects.base [None req-f79077f3-2c19-43f9-aeb0-5ffc85cf8bca tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] Object Instance<e2e25e19-c832-4945-9257-64e6103feb0c> lazy-loaded attributes: flavor,pci_requests {{(pid=75176) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 15:41:17 user nova-compute[75176]: DEBUG nova.network.neutron [None req-f79077f3-2c19-43f9-aeb0-5ffc85cf8bca tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] [instance: e2e25e19-c832-4945-9257-64e6103feb0c] allocate_for_instance() {{(pid=75176) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 15:41:17 user nova-compute[75176]: DEBUG nova.policy [None req-f79077f3-2c19-43f9-aeb0-5ffc85cf8bca tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5b8c4eae6ef14fa2b416c67f86e85971', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca8d4f7f4934dbdbd6ba92f51fba4b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75176) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 15:41:18 user nova-compute[75176]: DEBUG nova.network.neutron [req-27f8b9fb-6866-4f27-aace-602df99da3d1 req-2c1a3c7e-a512-4d97-adac-0a4c7f4c8c70 service nova] [instance: 4ed0eb85-e975-446c-8da7-148a4bb36958] Updated VIF entry in instance network info cache for port 9996a5ef-0801-4136-bd1d-fd5372d97e9d. {{(pid=75176) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 15:41:18 user nova-compute[75176]: DEBUG nova.network.neutron [req-27f8b9fb-6866-4f27-aace-602df99da3d1 req-2c1a3c7e-a512-4d97-adac-0a4c7f4c8c70 service nova] [instance: 4ed0eb85-e975-446c-8da7-148a4bb36958] Updating instance_info_cache with network_info: [{"id": "9996a5ef-0801-4136-bd1d-fd5372d97e9d", "address": "fa:16:3e:e6:32:e5", "network": {"id": "66701df7-e5c6-4815-936c-2cfec02c127d", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-506481626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eed2357254f24be99031f60700f97988", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9996a5ef-08", "ovs_interfaceid": "9996a5ef-0801-4136-bd1d-fd5372d97e9d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:41:18 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-27f8b9fb-6866-4f27-aace-602df99da3d1 req-2c1a3c7e-a512-4d97-adac-0a4c7f4c8c70 service nova] Releasing lock "refresh_cache-4ed0eb85-e975-446c-8da7-148a4bb36958" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:41:18 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:18 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:18 user nova-compute[75176]: DEBUG nova.network.neutron [req-5f3d8457-d170-4118-99e4-a8f784fe503c req-ec897fc8-157a-4801-b927-46fe26aa36aa service nova] [instance: e2e25e19-c832-4945-9257-64e6103feb0c] Updated VIF entry in instance network info cache for port 05efa912-30d1-4474-a2eb-7d88fa0813e7. {{(pid=75176) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 15:41:18 user nova-compute[75176]: DEBUG nova.network.neutron [req-5f3d8457-d170-4118-99e4-a8f784fe503c req-ec897fc8-157a-4801-b927-46fe26aa36aa service nova] [instance: e2e25e19-c832-4945-9257-64e6103feb0c] Updating instance_info_cache with network_info: [{"id": "05efa912-30d1-4474-a2eb-7d88fa0813e7", "address": "fa:16:3e:b8:ab:c4", "network": {"id": "8bf6c19c-1190-430d-8e20-bc6439072a45", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-211502152-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ca8d4f7f4934dbdbd6ba92f51fba4b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05efa912-30", "ovs_interfaceid": "05efa912-30d1-4474-a2eb-7d88fa0813e7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:41:18 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:18 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-5f3d8457-d170-4118-99e4-a8f784fe503c req-ec897fc8-157a-4801-b927-46fe26aa36aa service nova] Releasing lock "refresh_cache-e2e25e19-c832-4945-9257-64e6103feb0c" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:41:18 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:18 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:18 user nova-compute[75176]: DEBUG nova.network.neutron [None req-f79077f3-2c19-43f9-aeb0-5ffc85cf8bca tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] [instance: e2e25e19-c832-4945-9257-64e6103feb0c] Successfully created port: e5bd47ee-addd-42fc-9585-aa5515c145f7 {{(pid=75176) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 15:41:19 user nova-compute[75176]: DEBUG nova.network.neutron [None req-f79077f3-2c19-43f9-aeb0-5ffc85cf8bca tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] [instance: e2e25e19-c832-4945-9257-64e6103feb0c] Successfully updated port: e5bd47ee-addd-42fc-9585-aa5515c145f7 {{(pid=75176) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 15:41:19 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-f79077f3-2c19-43f9-aeb0-5ffc85cf8bca tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] Acquiring lock "refresh_cache-e2e25e19-c832-4945-9257-64e6103feb0c" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:41:19 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-f79077f3-2c19-43f9-aeb0-5ffc85cf8bca tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] Acquired lock "refresh_cache-e2e25e19-c832-4945-9257-64e6103feb0c" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:41:19 user nova-compute[75176]: DEBUG nova.network.neutron [None req-f79077f3-2c19-43f9-aeb0-5ffc85cf8bca tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] [instance: e2e25e19-c832-4945-9257-64e6103feb0c] Building network info cache for instance {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 15:41:19 user nova-compute[75176]: DEBUG nova.compute.manager [req-4224a12a-0353-4b8a-a238-4ee6b71272a5 req-c32f0388-321f-476d-b632-aa8e05d030b9 service nova] [instance: 47306d53-9ad7-4cae-ba6d-1f65239ef30f] Received event network-vif-plugged-c3d44009-c128-4e98-8594-132ed6c85dbc {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:41:19 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-4224a12a-0353-4b8a-a238-4ee6b71272a5 req-c32f0388-321f-476d-b632-aa8e05d030b9 service nova] Acquiring lock "47306d53-9ad7-4cae-ba6d-1f65239ef30f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:41:19 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-4224a12a-0353-4b8a-a238-4ee6b71272a5 req-c32f0388-321f-476d-b632-aa8e05d030b9 service nova] Lock "47306d53-9ad7-4cae-ba6d-1f65239ef30f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:41:19 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-4224a12a-0353-4b8a-a238-4ee6b71272a5 req-c32f0388-321f-476d-b632-aa8e05d030b9 service nova] Lock "47306d53-9ad7-4cae-ba6d-1f65239ef30f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:41:19 user nova-compute[75176]: DEBUG nova.compute.manager [req-4224a12a-0353-4b8a-a238-4ee6b71272a5 req-c32f0388-321f-476d-b632-aa8e05d030b9 service nova] [instance: 47306d53-9ad7-4cae-ba6d-1f65239ef30f] No waiting events found dispatching network-vif-plugged-c3d44009-c128-4e98-8594-132ed6c85dbc {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:41:19 user nova-compute[75176]: WARNING nova.compute.manager [req-4224a12a-0353-4b8a-a238-4ee6b71272a5 req-c32f0388-321f-476d-b632-aa8e05d030b9 service nova] [instance: 47306d53-9ad7-4cae-ba6d-1f65239ef30f] Received unexpected event network-vif-plugged-c3d44009-c128-4e98-8594-132ed6c85dbc for instance with vm_state building and task_state spawning.
Nov 28 15:41:19 user nova-compute[75176]: DEBUG nova.compute.manager [req-4224a12a-0353-4b8a-a238-4ee6b71272a5 req-c32f0388-321f-476d-b632-aa8e05d030b9 service nova] [instance: 47306d53-9ad7-4cae-ba6d-1f65239ef30f] Received event network-vif-plugged-c3d44009-c128-4e98-8594-132ed6c85dbc {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:41:19 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-4224a12a-0353-4b8a-a238-4ee6b71272a5 req-c32f0388-321f-476d-b632-aa8e05d030b9 service nova] Acquiring lock "47306d53-9ad7-4cae-ba6d-1f65239ef30f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:41:19 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-4224a12a-0353-4b8a-a238-4ee6b71272a5 req-c32f0388-321f-476d-b632-aa8e05d030b9 service nova] Lock "47306d53-9ad7-4cae-ba6d-1f65239ef30f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:41:19 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-4224a12a-0353-4b8a-a238-4ee6b71272a5 req-c32f0388-321f-476d-b632-aa8e05d030b9 service nova] Lock "47306d53-9ad7-4cae-ba6d-1f65239ef30f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:41:19 user nova-compute[75176]: DEBUG nova.compute.manager [req-4224a12a-0353-4b8a-a238-4ee6b71272a5 req-c32f0388-321f-476d-b632-aa8e05d030b9 service nova] [instance: 47306d53-9ad7-4cae-ba6d-1f65239ef30f] No waiting events found dispatching network-vif-plugged-c3d44009-c128-4e98-8594-132ed6c85dbc {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:41:19 user nova-compute[75176]: WARNING nova.compute.manager [req-4224a12a-0353-4b8a-a238-4ee6b71272a5 req-c32f0388-321f-476d-b632-aa8e05d030b9 service nova] [instance: 47306d53-9ad7-4cae-ba6d-1f65239ef30f] Received unexpected event network-vif-plugged-c3d44009-c128-4e98-8594-132ed6c85dbc for instance with vm_state building and task_state spawning.
Nov 28 15:41:19 user nova-compute[75176]: DEBUG nova.compute.manager [req-e4efa1e2-4f35-441b-9b35-10cba1a8899c req-87dea545-557e-4428-bb6f-f6cf3ec59706 service nova] [instance: e2e25e19-c832-4945-9257-64e6103feb0c] Received event network-changed-e5bd47ee-addd-42fc-9585-aa5515c145f7 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:41:19 user nova-compute[75176]: DEBUG nova.compute.manager [req-e4efa1e2-4f35-441b-9b35-10cba1a8899c req-87dea545-557e-4428-bb6f-f6cf3ec59706 service nova] [instance: e2e25e19-c832-4945-9257-64e6103feb0c] Refreshing instance network info cache due to event network-changed-e5bd47ee-addd-42fc-9585-aa5515c145f7. {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 15:41:19 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-e4efa1e2-4f35-441b-9b35-10cba1a8899c req-87dea545-557e-4428-bb6f-f6cf3ec59706 service nova] Acquiring lock "refresh_cache-e2e25e19-c832-4945-9257-64e6103feb0c" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:41:19 user nova-compute[75176]: DEBUG nova.compute.manager [None req-158ecf2a-7d92-49de-a136-21fc6b6eaa50 tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] [instance: 47306d53-9ad7-4cae-ba6d-1f65239ef30f] Instance event wait completed in 0 seconds for  {{(pid=75176) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 15:41:19 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-158ecf2a-7d92-49de-a136-21fc6b6eaa50 tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] [instance: 47306d53-9ad7-4cae-ba6d-1f65239ef30f] Guest created on hypervisor {{(pid=75176) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 15:41:19 user nova-compute[75176]: INFO nova.virt.libvirt.driver [-] [instance: 47306d53-9ad7-4cae-ba6d-1f65239ef30f] Instance spawned successfully.
Nov 28 15:41:19 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-158ecf2a-7d92-49de-a136-21fc6b6eaa50 tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] [instance: 47306d53-9ad7-4cae-ba6d-1f65239ef30f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 15:41:19 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-158ecf2a-7d92-49de-a136-21fc6b6eaa50 tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] [instance: 47306d53-9ad7-4cae-ba6d-1f65239ef30f] Found default for hw_cdrom_bus of ide {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:41:19 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-158ecf2a-7d92-49de-a136-21fc6b6eaa50 tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] [instance: 47306d53-9ad7-4cae-ba6d-1f65239ef30f] Found default for hw_disk_bus of virtio {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:41:19 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-158ecf2a-7d92-49de-a136-21fc6b6eaa50 tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] [instance: 47306d53-9ad7-4cae-ba6d-1f65239ef30f] Found default for hw_input_bus of None {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:41:19 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-158ecf2a-7d92-49de-a136-21fc6b6eaa50 tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] [instance: 47306d53-9ad7-4cae-ba6d-1f65239ef30f] Found default for hw_pointer_model of None {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:41:19 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-158ecf2a-7d92-49de-a136-21fc6b6eaa50 tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] [instance: 47306d53-9ad7-4cae-ba6d-1f65239ef30f] Found default for hw_video_model of virtio {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:41:19 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-158ecf2a-7d92-49de-a136-21fc6b6eaa50 tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] [instance: 47306d53-9ad7-4cae-ba6d-1f65239ef30f] Found default for hw_vif_model of virtio {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:41:19 user nova-compute[75176]: DEBUG nova.network.neutron [None req-f79077f3-2c19-43f9-aeb0-5ffc85cf8bca tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] [instance: e2e25e19-c832-4945-9257-64e6103feb0c] Updating instance_info_cache with network_info: [{"id": "05efa912-30d1-4474-a2eb-7d88fa0813e7", "address": "fa:16:3e:b8:ab:c4", "network": {"id": "8bf6c19c-1190-430d-8e20-bc6439072a45", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-211502152-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ca8d4f7f4934dbdbd6ba92f51fba4b6", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05efa912-30", "ovs_interfaceid": "05efa912-30d1-4474-a2eb-7d88fa0813e7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e5bd47ee-addd-42fc-9585-aa5515c145f7", "address": "fa:16:3e:be:ab:10", "network": {"id": "e04fe3c5-8edf-4a87-bdec-9fd7e9374310", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1938354238", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "2ca8d4f7f4934dbdbd6ba92f51fba4b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5bd47ee-ad", "ovs_interfaceid": "e5bd47ee-addd-42fc-9585-aa5515c145f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:41:19 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-f79077f3-2c19-43f9-aeb0-5ffc85cf8bca tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] Releasing lock "refresh_cache-e2e25e19-c832-4945-9257-64e6103feb0c" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:41:19 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-e4efa1e2-4f35-441b-9b35-10cba1a8899c req-87dea545-557e-4428-bb6f-f6cf3ec59706 service nova] Acquired lock "refresh_cache-e2e25e19-c832-4945-9257-64e6103feb0c" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:41:19 user nova-compute[75176]: DEBUG nova.network.neutron [req-e4efa1e2-4f35-441b-9b35-10cba1a8899c req-87dea545-557e-4428-bb6f-f6cf3ec59706 service nova] [instance: e2e25e19-c832-4945-9257-64e6103feb0c] Refreshing network info cache for port e5bd47ee-addd-42fc-9585-aa5515c145f7 {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 15:41:19 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-f79077f3-2c19-43f9-aeb0-5ffc85cf8bca tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T15:39:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1735788857',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1735788857',id=6,image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLYd6lLWkEZSf+41ikXMqtG28NM8Q+hVwVe3wmXerHL+M0XqnrZ3u3KddSHLIIe0vvFogrQWiaY5StKzsHvoccjRJn8doyVKS0uym1H0FtgpShdYQ4yF2e0Gu6ZxuZcJSg==',key_name='tempest-keypair-1836481900',keypairs=<?>,launch_index=0,launched_at=2023-11-28T15:39:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='2ca8d4f7f4934dbdbd6ba92f51fba4b6',ramdisk_id='',reservation_id='r-62ikbebi',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-231716548',owner_user_name='tempest-TaggedAttachmentsTest-231716548-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T15:39:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5b8c4eae6ef14fa2b416c67f86e85971',uuid=e2e25e19-c832-4945-9257-64e6103feb0c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e5bd47ee-addd-42fc-9585-aa5515c145f7", "address": "fa:16:3e:be:ab:10", "network": {"id": "e04fe3c5-8edf-4a87-bdec-9fd7e9374310", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1938354238", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "2ca8d4f7f4934dbdbd6ba92f51fba4b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5bd47ee-ad", "ovs_interfaceid": "e5bd47ee-addd-42fc-9585-aa5515c145f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 15:41:19 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-f79077f3-2c19-43f9-aeb0-5ffc85cf8bca tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] Converting VIF {"id": "e5bd47ee-addd-42fc-9585-aa5515c145f7", "address": "fa:16:3e:be:ab:10", "network": {"id": "e04fe3c5-8edf-4a87-bdec-9fd7e9374310", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1938354238", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "2ca8d4f7f4934dbdbd6ba92f51fba4b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5bd47ee-ad", "ovs_interfaceid": "e5bd47ee-addd-42fc-9585-aa5515c145f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:41:19 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-f79077f3-2c19-43f9-aeb0-5ffc85cf8bca tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:ab:10,bridge_name='br-int',has_traffic_filtering=True,id=e5bd47ee-addd-42fc-9585-aa5515c145f7,network=Network(e04fe3c5-8edf-4a87-bdec-9fd7e9374310),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5bd47ee-ad') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:41:19 user nova-compute[75176]: DEBUG os_vif [None req-f79077f3-2c19-43f9-aeb0-5ffc85cf8bca tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:ab:10,bridge_name='br-int',has_traffic_filtering=True,id=e5bd47ee-addd-42fc-9585-aa5515c145f7,network=Network(e04fe3c5-8edf-4a87-bdec-9fd7e9374310),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5bd47ee-ad') {{(pid=75176) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 15:41:19 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:19 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:41:19 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 15:41:19 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:19 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '321c67ed-7812-5681-866e-a8423ee332df', '_type': 'linux-noop'}}, row=False) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:41:19 user nova-compute[75176]: INFO nova.compute.manager [None req-158ecf2a-7d92-49de-a136-21fc6b6eaa50 tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] [instance: 47306d53-9ad7-4cae-ba6d-1f65239ef30f] Took 6.34 seconds to spawn the instance on the hypervisor.
Nov 28 15:41:19 user nova-compute[75176]: DEBUG nova.compute.manager [None req-158ecf2a-7d92-49de-a136-21fc6b6eaa50 tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] [instance: 47306d53-9ad7-4cae-ba6d-1f65239ef30f] Checking state {{(pid=75176) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 15:41:19 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:41:19 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:19 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape5bd47ee-ad, may_exist=True, interface_attrs={}) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:41:19 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape5bd47ee-ad, col_values=(('qos', UUID('18304ea4-13bd-4494-948f-ec4a23a0df61')),), if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:41:19 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape5bd47ee-ad, col_values=(('external_ids', {'iface-id': 'e5bd47ee-addd-42fc-9585-aa5515c145f7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:be:ab:10', 'vm-uuid': 'e2e25e19-c832-4945-9257-64e6103feb0c'}),), if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:41:19 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:41:19 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:19 user nova-compute[75176]: INFO os_vif [None req-f79077f3-2c19-43f9-aeb0-5ffc85cf8bca tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:ab:10,bridge_name='br-int',has_traffic_filtering=True,id=e5bd47ee-addd-42fc-9585-aa5515c145f7,network=Network(e04fe3c5-8edf-4a87-bdec-9fd7e9374310),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5bd47ee-ad')
Nov 28 15:41:19 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-f79077f3-2c19-43f9-aeb0-5ffc85cf8bca tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T15:39:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1735788857',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1735788857',id=6,image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLYd6lLWkEZSf+41ikXMqtG28NM8Q+hVwVe3wmXerHL+M0XqnrZ3u3KddSHLIIe0vvFogrQWiaY5StKzsHvoccjRJn8doyVKS0uym1H0FtgpShdYQ4yF2e0Gu6ZxuZcJSg==',key_name='tempest-keypair-1836481900',keypairs=<?>,launch_index=0,launched_at=2023-11-28T15:39:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='2ca8d4f7f4934dbdbd6ba92f51fba4b6',ramdisk_id='',reservation_id='r-62ikbebi',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-231716548',owner_user_name='tempest-TaggedAttachmentsTest-231716548-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T15:39:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5b8c4eae6ef14fa2b416c67f86e85971',uuid=e2e25e19-c832-4945-9257-64e6103feb0c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e5bd47ee-addd-42fc-9585-aa5515c145f7", "address": "fa:16:3e:be:ab:10", "network": {"id": "e04fe3c5-8edf-4a87-bdec-9fd7e9374310", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1938354238", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "2ca8d4f7f4934dbdbd6ba92f51fba4b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5bd47ee-ad", "ovs_interfaceid": "e5bd47ee-addd-42fc-9585-aa5515c145f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75176) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 15:41:19 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-f79077f3-2c19-43f9-aeb0-5ffc85cf8bca tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] Converting VIF {"id": "e5bd47ee-addd-42fc-9585-aa5515c145f7", "address": "fa:16:3e:be:ab:10", "network": {"id": "e04fe3c5-8edf-4a87-bdec-9fd7e9374310", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1938354238", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "2ca8d4f7f4934dbdbd6ba92f51fba4b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5bd47ee-ad", "ovs_interfaceid": "e5bd47ee-addd-42fc-9585-aa5515c145f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:41:19 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-f79077f3-2c19-43f9-aeb0-5ffc85cf8bca tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:ab:10,bridge_name='br-int',has_traffic_filtering=True,id=e5bd47ee-addd-42fc-9585-aa5515c145f7,network=Network(e04fe3c5-8edf-4a87-bdec-9fd7e9374310),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5bd47ee-ad') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:41:19 user nova-compute[75176]: DEBUG nova.virt.libvirt.guest [None req-f79077f3-2c19-43f9-aeb0-5ffc85cf8bca tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] attach device xml: <interface type="ethernet">
Nov 28 15:41:19 user nova-compute[75176]:   <mac address="fa:16:3e:be:ab:10"/>
Nov 28 15:41:19 user nova-compute[75176]:   <model type="virtio"/>
Nov 28 15:41:19 user nova-compute[75176]:   <mtu size="1442"/>
Nov 28 15:41:19 user nova-compute[75176]:   <target dev="tape5bd47ee-ad"/>
Nov 28 15:41:19 user nova-compute[75176]: </interface>
Nov 28 15:41:19 user nova-compute[75176]:  {{(pid=75176) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 15:41:19 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:19 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:19 user nova-compute[75176]: INFO nova.compute.manager [None req-158ecf2a-7d92-49de-a136-21fc6b6eaa50 tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] [instance: 47306d53-9ad7-4cae-ba6d-1f65239ef30f] Took 7.19 seconds to build instance.
Nov 28 15:41:20 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-a61d4692-2c3c-4715-89f7-96a67c4b0ff1 tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] Acquiring lock "4ed0eb85-e975-446c-8da7-148a4bb36958" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:41:20 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-a61d4692-2c3c-4715-89f7-96a67c4b0ff1 tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] Lock "4ed0eb85-e975-446c-8da7-148a4bb36958" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:41:20 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-158ecf2a-7d92-49de-a136-21fc6b6eaa50 tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Lock "47306d53-9ad7-4cae-ba6d-1f65239ef30f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.404s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:41:20 user nova-compute[75176]: DEBUG nova.objects.instance [None req-a61d4692-2c3c-4715-89f7-96a67c4b0ff1 tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] Lazy-loading 'flavor' on Instance uuid 4ed0eb85-e975-446c-8da7-148a4bb36958 {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:41:20 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:20 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:20 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:20 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-a61d4692-2c3c-4715-89f7-96a67c4b0ff1 tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] Lock "4ed0eb85-e975-446c-8da7-148a4bb36958" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.087s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:41:20 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-a61d4692-2c3c-4715-89f7-96a67c4b0ff1 tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] Acquiring lock "4ed0eb85-e975-446c-8da7-148a4bb36958" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:41:20 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-a61d4692-2c3c-4715-89f7-96a67c4b0ff1 tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] Lock "4ed0eb85-e975-446c-8da7-148a4bb36958" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:41:20 user nova-compute[75176]: INFO nova.compute.manager [None req-a61d4692-2c3c-4715-89f7-96a67c4b0ff1 tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] [instance: 4ed0eb85-e975-446c-8da7-148a4bb36958] Attaching volume 3f34a214-dc9b-45b2-b64c-66c29fb2081a to /dev/sdc
Nov 28 15:41:20 user nova-compute[75176]: DEBUG os_brick.utils [None req-a61d4692-2c3c-4715-89f7-96a67c4b0ff1 tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 15:41:20 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:41:20 user nova-compute[75176]: DEBUG nova.compute.manager [req-84a065c2-d3d7-44d1-8cad-0efb578f56dc req-d7049529-ee33-4b4d-82b8-1b889f98a245 service nova] [instance: e2e25e19-c832-4945-9257-64e6103feb0c] Received event network-vif-plugged-e5bd47ee-addd-42fc-9585-aa5515c145f7 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:41:20 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-84a065c2-d3d7-44d1-8cad-0efb578f56dc req-d7049529-ee33-4b4d-82b8-1b889f98a245 service nova] Acquiring lock "e2e25e19-c832-4945-9257-64e6103feb0c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:41:20 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-84a065c2-d3d7-44d1-8cad-0efb578f56dc req-d7049529-ee33-4b4d-82b8-1b889f98a245 service nova] Lock "e2e25e19-c832-4945-9257-64e6103feb0c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:41:20 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-84a065c2-d3d7-44d1-8cad-0efb578f56dc req-d7049529-ee33-4b4d-82b8-1b889f98a245 service nova] Lock "e2e25e19-c832-4945-9257-64e6103feb0c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:41:20 user nova-compute[75176]: DEBUG nova.compute.manager [req-84a065c2-d3d7-44d1-8cad-0efb578f56dc req-d7049529-ee33-4b4d-82b8-1b889f98a245 service nova] [instance: e2e25e19-c832-4945-9257-64e6103feb0c] No waiting events found dispatching network-vif-plugged-e5bd47ee-addd-42fc-9585-aa5515c145f7 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:41:20 user nova-compute[75176]: WARNING nova.compute.manager [req-84a065c2-d3d7-44d1-8cad-0efb578f56dc req-d7049529-ee33-4b4d-82b8-1b889f98a245 service nova] [instance: e2e25e19-c832-4945-9257-64e6103feb0c] Received unexpected event network-vif-plugged-e5bd47ee-addd-42fc-9585-aa5515c145f7 for instance with vm_state active and task_state None.
Nov 28 15:41:20 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-f79077f3-2c19-43f9-aeb0-5ffc85cf8bca tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] No BDM found with device name vda, not building metadata. {{(pid=75176) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 15:41:20 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-f79077f3-2c19-43f9-aeb0-5ffc85cf8bca tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] No BDM found with device name hda, not building metadata. {{(pid=75176) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 15:41:20 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-f79077f3-2c19-43f9-aeb0-5ffc85cf8bca tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] No VIF found with MAC fa:16:3e:b8:ab:c4, not building metadata {{(pid=75176) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 15:41:20 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:41:20 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[017c2cb4-cd8a-4697-a946-d83c4eb132c1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:edc924a949b2\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:41:20 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:41:20 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.024s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:41:20 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[02c840d4-7346-4888-9ed9-56989735c992]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:41:20 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:41:20 user nova-compute[75176]: DEBUG nova.virt.libvirt.guest [None req-f79077f3-2c19-43f9-aeb0-5ffc85cf8bca tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 15:41:20 user nova-compute[75176]:   <nova:package version="0.0.0"/>
Nov 28 15:41:20 user nova-compute[75176]:   <nova:name>tempest-device-tagging-server-1735788857</nova:name>
Nov 28 15:41:20 user nova-compute[75176]:   <nova:creationTime>2023-11-28 15:41:20</nova:creationTime>
Nov 28 15:41:20 user nova-compute[75176]:   <nova:flavor name="m1.tiny">
Nov 28 15:41:20 user nova-compute[75176]:     <nova:memory>512</nova:memory>
Nov 28 15:41:20 user nova-compute[75176]:     <nova:disk>1</nova:disk>
Nov 28 15:41:20 user nova-compute[75176]:     <nova:swap>0</nova:swap>
Nov 28 15:41:20 user nova-compute[75176]:     <nova:ephemeral>0</nova:ephemeral>
Nov 28 15:41:20 user nova-compute[75176]:     <nova:vcpus>1</nova:vcpus>
Nov 28 15:41:20 user nova-compute[75176]:   </nova:flavor>
Nov 28 15:41:20 user nova-compute[75176]:   <nova:owner>
Nov 28 15:41:20 user nova-compute[75176]:     <nova:user uuid="5b8c4eae6ef14fa2b416c67f86e85971">tempest-TaggedAttachmentsTest-231716548-project-member</nova:user>
Nov 28 15:41:20 user nova-compute[75176]:     <nova:project uuid="2ca8d4f7f4934dbdbd6ba92f51fba4b6">tempest-TaggedAttachmentsTest-231716548</nova:project>
Nov 28 15:41:20 user nova-compute[75176]:   </nova:owner>
Nov 28 15:41:20 user nova-compute[75176]:   <nova:root type="image" uuid="1f41819e-c93f-4dc7-b253-37a27bbbbc74"/>
Nov 28 15:41:20 user nova-compute[75176]:   <nova:ports>
Nov 28 15:41:20 user nova-compute[75176]:     <nova:port uuid="05efa912-30d1-4474-a2eb-7d88fa0813e7">
Nov 28 15:41:20 user nova-compute[75176]:       <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 28 15:41:20 user nova-compute[75176]:     </nova:port>
Nov 28 15:41:20 user nova-compute[75176]:     <nova:port uuid="e5bd47ee-addd-42fc-9585-aa5515c145f7">
Nov 28 15:41:20 user nova-compute[75176]:       <nova:ip type="fixed" address="10.10.10.153" ipVersion="4"/>
Nov 28 15:41:20 user nova-compute[75176]:     </nova:port>
Nov 28 15:41:20 user nova-compute[75176]:   </nova:ports>
Nov 28 15:41:20 user nova-compute[75176]: </nova:instance>
Nov 28 15:41:20 user nova-compute[75176]:  {{(pid=75176) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 28 15:41:20 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:41:20 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[aab2038e-dcb6-4cf1-91fd-dde17c9605c1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:41:20 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c6ac411-df24-4e22-a865-b27bdd91ecfa]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:41:20 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-a61d4692-2c3c-4715-89f7-96a67c4b0ff1 tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] Running cmd (subprocess): nvme version {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:41:20 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-a61d4692-2c3c-4715-89f7-96a67c4b0ff1 tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] 'nvme version' failed. Not Retrying. {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 15:41:20 user nova-compute[75176]: DEBUG nova.network.neutron [req-e4efa1e2-4f35-441b-9b35-10cba1a8899c req-87dea545-557e-4428-bb6f-f6cf3ec59706 service nova] [instance: e2e25e19-c832-4945-9257-64e6103feb0c] Updated VIF entry in instance network info cache for port e5bd47ee-addd-42fc-9585-aa5515c145f7. {{(pid=75176) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 15:41:20 user nova-compute[75176]: DEBUG nova.network.neutron [req-e4efa1e2-4f35-441b-9b35-10cba1a8899c req-87dea545-557e-4428-bb6f-f6cf3ec59706 service nova] [instance: e2e25e19-c832-4945-9257-64e6103feb0c] Updating instance_info_cache with network_info: [{"id": "05efa912-30d1-4474-a2eb-7d88fa0813e7", "address": "fa:16:3e:b8:ab:c4", "network": {"id": "8bf6c19c-1190-430d-8e20-bc6439072a45", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-211502152-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ca8d4f7f4934dbdbd6ba92f51fba4b6", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05efa912-30", "ovs_interfaceid": "05efa912-30d1-4474-a2eb-7d88fa0813e7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e5bd47ee-addd-42fc-9585-aa5515c145f7", "address": "fa:16:3e:be:ab:10", "network": {"id": "e04fe3c5-8edf-4a87-bdec-9fd7e9374310", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1938354238", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "2ca8d4f7f4934dbdbd6ba92f51fba4b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5bd47ee-ad", "ovs_interfaceid": "e5bd47ee-addd-42fc-9585-aa5515c145f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:41:20 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a61d4692-2c3c-4715-89f7-96a67c4b0ff1 tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] nvme not present on system {{(pid=75176) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 15:41:20 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-f79077f3-2c19-43f9-aeb0-5ffc85cf8bca tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] Lock "interface-e2e25e19-c832-4945-9257-64e6103feb0c-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 3.017s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:41:20 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:41:20 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-e4efa1e2-4f35-441b-9b35-10cba1a8899c req-87dea545-557e-4428-bb6f-f6cf3ec59706 service nova] Releasing lock "refresh_cache-e2e25e19-c832-4945-9257-64e6103feb0c" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:41:20 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 15:41:20 user nova-compute[75176]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 15:41:20 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[8503d695-1909-4075-84f9-b744b8a85d95]: (4, '') {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:41:20 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.lightos [None req-a61d4692-2c3c-4715-89f7-96a67c4b0ff1 tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75176) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 15:41:20 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.lightos [None req-a61d4692-2c3c-4715-89f7-96a67c4b0ff1 tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75176) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 15:41:20 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.lightos [None req-a61d4692-2c3c-4715-89f7-96a67c4b0ff1 tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] LIGHTOS: no hostnqn found. {{(pid=75176) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 15:41:20 user nova-compute[75176]: DEBUG os_brick.utils [None req-a61d4692-2c3c-4715-89f7-96a67c4b0ff1 tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] <== get_connector_properties: return (167ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:edc924a949b2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 15:41:20 user nova-compute[75176]: DEBUG nova.virt.block_device [None req-a61d4692-2c3c-4715-89f7-96a67c4b0ff1 tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] [instance: 4ed0eb85-e975-446c-8da7-148a4bb36958] Updating existing volume attachment record: 760105a7-ef92-4cfd-b380-a2b2355baf14 {{(pid=75176) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 15:41:20 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:20 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:20 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:20 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-51a1f08e-e13a-4c5f-88fe-11cb1e094878 tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] Acquiring lock "e2e25e19-c832-4945-9257-64e6103feb0c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:41:20 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-51a1f08e-e13a-4c5f-88fe-11cb1e094878 tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] Lock "e2e25e19-c832-4945-9257-64e6103feb0c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:41:20 user nova-compute[75176]: DEBUG nova.objects.instance [None req-51a1f08e-e13a-4c5f-88fe-11cb1e094878 tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] Lazy-loading 'flavor' on Instance uuid e2e25e19-c832-4945-9257-64e6103feb0c {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:41:20 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-51a1f08e-e13a-4c5f-88fe-11cb1e094878 tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] Lock "e2e25e19-c832-4945-9257-64e6103feb0c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:41:21 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-51a1f08e-e13a-4c5f-88fe-11cb1e094878 tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] Acquiring lock "e2e25e19-c832-4945-9257-64e6103feb0c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:41:21 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-51a1f08e-e13a-4c5f-88fe-11cb1e094878 tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] Lock "e2e25e19-c832-4945-9257-64e6103feb0c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:41:21 user nova-compute[75176]: INFO nova.compute.manager [None req-51a1f08e-e13a-4c5f-88fe-11cb1e094878 tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] [instance: e2e25e19-c832-4945-9257-64e6103feb0c] Attaching volume 0dba49e9-5e6e-4896-b644-66558707591d to /dev/vdb
Nov 28 15:41:21 user nova-compute[75176]: DEBUG os_brick.utils [None req-51a1f08e-e13a-4c5f-88fe-11cb1e094878 tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 15:41:21 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:41:21 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:41:21 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b7a7f1d-b5b5-4e7d-8c12-056f8b622c61]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:edc924a949b2\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:41:21 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:41:21 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.026s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:41:21 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[f449051f-999e-42c9-8690-5c955f0a6937]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:41:21 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:41:21 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:41:21 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[31a2156f-2a88-4412-a1ae-8275c34e3530]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:41:21 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8fa10d2-cede-4fdc-9f99-c115b778ec2a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:41:21 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-51a1f08e-e13a-4c5f-88fe-11cb1e094878 tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] Running cmd (subprocess): nvme version {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:41:21 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-51a1f08e-e13a-4c5f-88fe-11cb1e094878 tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] 'nvme version' failed. Not Retrying. {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 15:41:21 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.nvmeof [None req-51a1f08e-e13a-4c5f-88fe-11cb1e094878 tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] nvme not present on system {{(pid=75176) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 15:41:21 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:41:21 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 15:41:21 user nova-compute[75176]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 15:41:21 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[5450fd0a-03e9-4c1c-bfa5-abe1e18e5a26]: (4, '') {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:41:21 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.lightos [None req-51a1f08e-e13a-4c5f-88fe-11cb1e094878 tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75176) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 15:41:21 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.lightos [None req-51a1f08e-e13a-4c5f-88fe-11cb1e094878 tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75176) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 15:41:21 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.lightos [None req-51a1f08e-e13a-4c5f-88fe-11cb1e094878 tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] LIGHTOS: no hostnqn found. {{(pid=75176) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 15:41:21 user nova-compute[75176]: DEBUG os_brick.utils [None req-51a1f08e-e13a-4c5f-88fe-11cb1e094878 tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:edc924a949b2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 15:41:21 user nova-compute[75176]: DEBUG nova.virt.block_device [None req-51a1f08e-e13a-4c5f-88fe-11cb1e094878 tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] [instance: e2e25e19-c832-4945-9257-64e6103feb0c] Updating existing volume attachment record: 207265d4-26f0-46ae-950a-b07ced00ad72 {{(pid=75176) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 15:41:22 user nova-compute[75176]: DEBUG nova.compute.manager [req-a46bb96d-f091-411b-996f-18952966ab0f req-2f80b8ab-3312-4ad6-88f8-371fbf7f4e49 service nova] [instance: e2e25e19-c832-4945-9257-64e6103feb0c] Received event network-vif-plugged-e5bd47ee-addd-42fc-9585-aa5515c145f7 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:41:22 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-a46bb96d-f091-411b-996f-18952966ab0f req-2f80b8ab-3312-4ad6-88f8-371fbf7f4e49 service nova] Acquiring lock "e2e25e19-c832-4945-9257-64e6103feb0c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:41:22 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-a46bb96d-f091-411b-996f-18952966ab0f req-2f80b8ab-3312-4ad6-88f8-371fbf7f4e49 service nova] Lock "e2e25e19-c832-4945-9257-64e6103feb0c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:41:22 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-a46bb96d-f091-411b-996f-18952966ab0f req-2f80b8ab-3312-4ad6-88f8-371fbf7f4e49 service nova] Lock "e2e25e19-c832-4945-9257-64e6103feb0c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:41:22 user nova-compute[75176]: DEBUG nova.compute.manager [req-a46bb96d-f091-411b-996f-18952966ab0f req-2f80b8ab-3312-4ad6-88f8-371fbf7f4e49 service nova] [instance: e2e25e19-c832-4945-9257-64e6103feb0c] No waiting events found dispatching network-vif-plugged-e5bd47ee-addd-42fc-9585-aa5515c145f7 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:41:22 user nova-compute[75176]: WARNING nova.compute.manager [req-a46bb96d-f091-411b-996f-18952966ab0f req-2f80b8ab-3312-4ad6-88f8-371fbf7f4e49 service nova] [instance: e2e25e19-c832-4945-9257-64e6103feb0c] Received unexpected event network-vif-plugged-e5bd47ee-addd-42fc-9585-aa5515c145f7 for instance with vm_state active and task_state None.
Nov 28 15:41:23 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:23 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-41468019-e790-4b45-9ae4-207eb132590f tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] [instance: 5b18c889-7694-4edf-8cf2-b9032e60289e] Calling os-brick to attach iSCSI Volume {{(pid=75176) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 15:41:23 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-41468019-e790-4b45-9ae4-207eb132590f tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c1b8a00>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a1d37820-ff6e-4bc6-a564-582b18c0beb2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IoOwFjpU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 15:41:23 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-41468019-e790-4b45-9ae4-207eb132590f tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 15:41:23 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-41468019-e790-4b45-9ae4-207eb132590f tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 15:41:23 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-41468019-e790-4b45-9ae4-207eb132590f tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 15:41:23 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-41468019-e790-4b45-9ae4-207eb132590f tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 15:41:23 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-41468019-e790-4b45-9ae4-207eb132590f tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a1d37820-ff6e-4bc6-a564-582b18c0beb2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 15:41:23 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-41468019-e790-4b45-9ae4-207eb132590f tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a1d37820-ff6e-4bc6-a564-582b18c0beb2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 15:41:23 user nova-compute[75176]: INFO os_brick.initiator.connectors.iscsi [None req-41468019-e790-4b45-9ae4-207eb132590f tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 15:41:23 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1d37820-ff6e-4bc6-a564-582b18c0beb2 -p 172.16.0.220:3260 {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:41:23 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1d37820-ff6e-4bc6-a564-582b18c0beb2 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:41:23 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d8acc45-e745-49bc-8302-d2d148d3198e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:41:23 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-41468019-e790-4b45-9ae4-207eb132590f tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 15:41:23 user nova-compute[75176]:  {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:41:23 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1d37820-ff6e-4bc6-a564-582b18c0beb2 -p 172.16.0.220:3260 --interface default --op new {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:41:23 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1d37820-ff6e-4bc6-a564-582b18c0beb2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:41:23 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ff82c38-2da5-4e0b-82d7-ed3012cdf60e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a1d37820-ff6e-4bc6-a564-582b18c0beb2] added\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:41:23 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-41468019-e790-4b45-9ae4-207eb132590f tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a1d37820-ff6e-4bc6-a564-582b18c0beb2] added
Nov 28 15:41:23 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:41:23 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1d37820-ff6e-4bc6-a564-582b18c0beb2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:41:23 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1d37820-ff6e-4bc6-a564-582b18c0beb2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:41:23 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[8af6e995-c05a-4d85-a302-0a105e09493f]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:41:23 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-41468019-e790-4b45-9ae4-207eb132590f tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:41:23 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1d37820-ff6e-4bc6-a564-582b18c0beb2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:41:23 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1d37820-ff6e-4bc6-a564-582b18c0beb2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:41:23 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ff67144-c107-489a-a69d-ea673e8c22a9]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:41:23 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-41468019-e790-4b45-9ae4-207eb132590f tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:41:23 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1d37820-ff6e-4bc6-a564-582b18c0beb2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IoOwFjpU {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:41:23 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1d37820-ff6e-4bc6-a564-582b18c0beb2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IoOwFjpU" returned: 0 in 0.024s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:41:23 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[32edcb3a-4d8f-4180-b209-cb179b4da2a5]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:41:23 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-41468019-e790-4b45-9ae4-207eb132590f tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IoOwFjpU'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:41:23 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1d37820-ff6e-4bc6-a564-582b18c0beb2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:41:23 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1d37820-ff6e-4bc6-a564-582b18c0beb2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:41:23 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae2c698e-dfc0-40a3-84ea-2d2b688cb487]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:41:23 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-41468019-e790-4b45-9ae4-207eb132590f tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:41:23 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:41:23 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:41:23 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[20c35f42-05ad-40c9-a5b7-a04bf66d462e]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81326542-482f-4d50-895c-13c65fe4daf7 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76ea4d3b-7c77-47d0-b48b-ad79886d4f9a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27720cbf-c8ad-486b-845d-cdff5fbc4772 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:560d9b0e-d506-4723-8fc3-4068d690d5c8 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e691257-74a3-4fef-9fd1-67d2ba725039 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:763d605d-247d-4484-b7ec-762e36b92abc (non-flash)\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:41:23 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-41468019-e790-4b45-9ae4-207eb132590f tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9 (non-flash)
Nov 28 15:41:23 user nova-compute[75176]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81326542-482f-4d50-895c-13c65fe4daf7 (non-flash)
Nov 28 15:41:23 user nova-compute[75176]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76ea4d3b-7c77-47d0-b48b-ad79886d4f9a (non-flash)
Nov 28 15:41:23 user nova-compute[75176]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27720cbf-c8ad-486b-845d-cdff5fbc4772 (non-flash)
Nov 28 15:41:23 user nova-compute[75176]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:560d9b0e-d506-4723-8fc3-4068d690d5c8 (non-flash)
Nov 28 15:41:23 user nova-compute[75176]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e691257-74a3-4fef-9fd1-67d2ba725039 (non-flash)
Nov 28 15:41:23 user nova-compute[75176]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:763d605d-247d-4484-b7ec-762e36b92abc (non-flash)
Nov 28 15:41:23 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:41:23 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-41468019-e790-4b45-9ae4-207eb132590f tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9 (non-flash)
Nov 28 15:41:23 user nova-compute[75176]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81326542-482f-4d50-895c-13c65fe4daf7 (non-flash)
Nov 28 15:41:23 user nova-compute[75176]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76ea4d3b-7c77-47d0-b48b-ad79886d4f9a (non-flash)
Nov 28 15:41:23 user nova-compute[75176]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27720cbf-c8ad-486b-845d-cdff5fbc4772 (non-flash)
Nov 28 15:41:23 user nova-compute[75176]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:560d9b0e-d506-4723-8fc3-4068d690d5c8 (non-flash)
Nov 28 15:41:23 user nova-compute[75176]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e691257-74a3-4fef-9fd1-67d2ba725039 (non-flash)
Nov 28 15:41:23 user nova-compute[75176]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:763d605d-247d-4484-b7ec-762e36b92abc (non-flash)
Nov 28 15:41:23 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 15:41:23 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1d37820-ff6e-4bc6-a564-582b18c0beb2 -p 172.16.0.220:3260 --login {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:41:23 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1d37820-ff6e-4bc6-a564-582b18c0beb2 -p 172.16.0.220:3260 --login" returned: 0 in 0.140s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:41:23 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a85d032-466e-4998-9f6a-8209e74a8d08]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a1d37820-ff6e-4bc6-a564-582b18c0beb2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a1d37820-ff6e-4bc6-a564-582b18c0beb2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:41:23 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-41468019-e790-4b45-9ae4-207eb132590f tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a1d37820-ff6e-4bc6-a564-582b18c0beb2, portal: 172.16.0.220,3260]
Nov 28 15:41:23 user nova-compute[75176]: Login to [iface: default, target: iqn.2010-10.org.openstack:a1d37820-ff6e-4bc6-a564-582b18c0beb2, portal: 172.16.0.220,3260] successful.
Nov 28 15:41:23 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:41:23 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1d37820-ff6e-4bc6-a564-582b18c0beb2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:41:23 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1d37820-ff6e-4bc6-a564-582b18c0beb2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.059s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:41:23 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8125256-45b1-4bf0-a64b-8f7ab00af1aa]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:41:23 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-41468019-e790-4b45-9ae4-207eb132590f tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:41:23 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:41:23 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:41:23 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[449e0d86-f838-4591-88e7-82ab7adf07ab]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1d37820-ff6e-4bc6-a564-582b18c0beb2 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81326542-482f-4d50-895c-13c65fe4daf7 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76ea4d3b-7c77-47d0-b48b-ad79886d4f9a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27720cbf-c8ad-486b-845d-cdff5fbc4772 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:560d9b0e-d506-4723-8fc3-4068d690d5c8 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e691257-74a3-4fef-9fd1-67d2ba725039 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:763d605d-247d-4484-b7ec-762e36b92abc (non-flash)\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:41:23 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-41468019-e790-4b45-9ae4-207eb132590f tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1d37820-ff6e-4bc6-a564-582b18c0beb2 (non-flash)
Nov 28 15:41:23 user nova-compute[75176]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9 (non-flash)
Nov 28 15:41:23 user nova-compute[75176]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81326542-482f-4d50-895c-13c65fe4daf7 (non-flash)
Nov 28 15:41:23 user nova-compute[75176]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76ea4d3b-7c77-47d0-b48b-ad79886d4f9a (non-flash)
Nov 28 15:41:23 user nova-compute[75176]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27720cbf-c8ad-486b-845d-cdff5fbc4772 (non-flash)
Nov 28 15:41:23 user nova-compute[75176]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:560d9b0e-d506-4723-8fc3-4068d690d5c8 (non-flash)
Nov 28 15:41:23 user nova-compute[75176]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e691257-74a3-4fef-9fd1-67d2ba725039 (non-flash)
Nov 28 15:41:23 user nova-compute[75176]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:763d605d-247d-4484-b7ec-762e36b92abc (non-flash)
Nov 28 15:41:23 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:41:23 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-41468019-e790-4b45-9ae4-207eb132590f tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1d37820-ff6e-4bc6-a564-582b18c0beb2 (non-flash)
Nov 28 15:41:23 user nova-compute[75176]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9 (non-flash)
Nov 28 15:41:23 user nova-compute[75176]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81326542-482f-4d50-895c-13c65fe4daf7 (non-flash)
Nov 28 15:41:23 user nova-compute[75176]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76ea4d3b-7c77-47d0-b48b-ad79886d4f9a (non-flash)
Nov 28 15:41:23 user nova-compute[75176]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27720cbf-c8ad-486b-845d-cdff5fbc4772 (non-flash)
Nov 28 15:41:23 user nova-compute[75176]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:560d9b0e-d506-4723-8fc3-4068d690d5c8 (non-flash)
Nov 28 15:41:23 user nova-compute[75176]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e691257-74a3-4fef-9fd1-67d2ba725039 (non-flash)
Nov 28 15:41:23 user nova-compute[75176]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:763d605d-247d-4484-b7ec-762e36b92abc (non-flash)
Nov 28 15:41:23 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 15:41:23 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-41468019-e790-4b45-9ae4-207eb132590f tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a1d37820-ff6e-4bc6-a564-582b18c0beb2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.442s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 15:41:23 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-41468019-e790-4b45-9ae4-207eb132590f tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] Connected to 172.16.0.220:3260 {{(pid=75176) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 15:41:23 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-41468019-e790-4b45-9ae4-207eb132590f tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] HCTL ('40', '-', '-', 0) found on session 10 with lun 0 {{(pid=75176) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 15:41:23 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-41468019-e790-4b45-9ae4-207eb132590f tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=75176) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 15:41:23 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:41:23 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.019s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:41:23 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[67f80ae3-3a65-4d36-9759-10124dabf457]: (4, ('- - 0', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:41:23 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-41468019-e790-4b45-9ae4-207eb132590f tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] Searching for a device in session 10 and hctl ['40', '*', '*', 0] yield: None {{(pid=75176) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 15:41:24 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:24 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-41468019-e790-4b45-9ae4-207eb132590f tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] Searching for a device in session 10 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=75176) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 15:41:24 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-41468019-e790-4b45-9ae4-207eb132590f tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:a1d37820-ff6e-4bc6-a564-582b18c0beb2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IoOwFjpU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75176) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 15:41:24 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-41468019-e790-4b45-9ae4-207eb132590f tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.476s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 15:41:24 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-41468019-e790-4b45-9ae4-207eb132590f tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] <== connect_volume: return (1477ms) {'type': 'block', 'scsi_wwn': '26137616166626134', 'path': '/dev/sdi'} {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 15:41:24 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-41468019-e790-4b45-9ae4-207eb132590f tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] [instance: 5b18c889-7694-4edf-8cf2-b9032e60289e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26137616166626134', 'path': '/dev/sdi'} {{(pid=75176) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 15:41:24 user nova-compute[75176]: DEBUG nova.objects.instance [None req-41468019-e790-4b45-9ae4-207eb132590f tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] Lazy-loading 'flavor' on Instance uuid 5b18c889-7694-4edf-8cf2-b9032e60289e {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:41:24 user nova-compute[75176]: DEBUG nova.virt.libvirt.guest [None req-41468019-e790-4b45-9ae4-207eb132590f tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 15:41:24 user nova-compute[75176]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 15:41:24 user nova-compute[75176]:   <source dev="/dev/sdi"/>
Nov 28 15:41:24 user nova-compute[75176]:   <target dev="vdb" bus="virtio"/>
Nov 28 15:41:24 user nova-compute[75176]:   <serial>a1d37820-ff6e-4bc6-a564-582b18c0beb2</serial>
Nov 28 15:41:24 user nova-compute[75176]: </disk>
Nov 28 15:41:24 user nova-compute[75176]:  {{(pid=75176) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 15:41:25 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-41468019-e790-4b45-9ae4-207eb132590f tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] No BDM found with device name vda, not building metadata. {{(pid=75176) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 15:41:25 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-41468019-e790-4b45-9ae4-207eb132590f tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75176) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 15:41:25 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-41468019-e790-4b45-9ae4-207eb132590f tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] No VIF found with MAC fa:16:3e:e5:e8:01, not building metadata {{(pid=75176) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 15:41:25 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-41468019-e790-4b45-9ae4-207eb132590f tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] Lock "5b18c889-7694-4edf-8cf2-b9032e60289e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.994s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:41:26 user nova-compute[75176]: DEBUG nova.compute.manager [req-62e40cad-b69f-4881-a19b-05e6f99cdfe0 req-0d93ff24-c17b-4356-a76f-c5a8ad772fca service nova] [instance: 916b82eb-97e8-411c-a8ea-8c27d101b48e] Received event network-changed-38bef3fc-c841-4db3-b429-8fe94a224783 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:41:26 user nova-compute[75176]: DEBUG nova.compute.manager [req-62e40cad-b69f-4881-a19b-05e6f99cdfe0 req-0d93ff24-c17b-4356-a76f-c5a8ad772fca service nova] [instance: 916b82eb-97e8-411c-a8ea-8c27d101b48e] Refreshing instance network info cache due to event network-changed-38bef3fc-c841-4db3-b429-8fe94a224783. {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 15:41:26 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-62e40cad-b69f-4881-a19b-05e6f99cdfe0 req-0d93ff24-c17b-4356-a76f-c5a8ad772fca service nova] Acquiring lock "refresh_cache-916b82eb-97e8-411c-a8ea-8c27d101b48e" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:41:26 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-62e40cad-b69f-4881-a19b-05e6f99cdfe0 req-0d93ff24-c17b-4356-a76f-c5a8ad772fca service nova] Acquired lock "refresh_cache-916b82eb-97e8-411c-a8ea-8c27d101b48e" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:41:26 user nova-compute[75176]: DEBUG nova.network.neutron [req-62e40cad-b69f-4881-a19b-05e6f99cdfe0 req-0d93ff24-c17b-4356-a76f-c5a8ad772fca service nova] [instance: 916b82eb-97e8-411c-a8ea-8c27d101b48e] Refreshing network info cache for port 38bef3fc-c841-4db3-b429-8fe94a224783 {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 15:41:26 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-d0913eec-b913-4ec0-8c8d-fbb0bc616891 tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] Acquiring lock "5b18c889-7694-4edf-8cf2-b9032e60289e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:41:26 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-d0913eec-b913-4ec0-8c8d-fbb0bc616891 tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] Lock "5b18c889-7694-4edf-8cf2-b9032e60289e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:41:26 user nova-compute[75176]: INFO nova.compute.manager [None req-d0913eec-b913-4ec0-8c8d-fbb0bc616891 tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] [instance: 5b18c889-7694-4edf-8cf2-b9032e60289e] Detaching volume a1d37820-ff6e-4bc6-a564-582b18c0beb2
Nov 28 15:41:26 user nova-compute[75176]: INFO nova.virt.block_device [None req-d0913eec-b913-4ec0-8c8d-fbb0bc616891 tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] [instance: 5b18c889-7694-4edf-8cf2-b9032e60289e] Attempting to driver detach volume a1d37820-ff6e-4bc6-a564-582b18c0beb2 from mountpoint /dev/vdb
Nov 28 15:41:26 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-d0913eec-b913-4ec0-8c8d-fbb0bc616891 tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] Attempting to detach device vdb from instance 5b18c889-7694-4edf-8cf2-b9032e60289e from the persistent domain config. {{(pid=75176) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 15:41:26 user nova-compute[75176]: DEBUG nova.virt.libvirt.guest [None req-d0913eec-b913-4ec0-8c8d-fbb0bc616891 tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 15:41:26 user nova-compute[75176]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 15:41:26 user nova-compute[75176]:   <source dev="/dev/sdi"/>
Nov 28 15:41:26 user nova-compute[75176]:   <target dev="vdb" bus="virtio"/>
Nov 28 15:41:26 user nova-compute[75176]:   <serial>a1d37820-ff6e-4bc6-a564-582b18c0beb2</serial>
Nov 28 15:41:26 user nova-compute[75176]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 15:41:26 user nova-compute[75176]: </disk>
Nov 28 15:41:26 user nova-compute[75176]:  {{(pid=75176) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 15:41:26 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-d0913eec-b913-4ec0-8c8d-fbb0bc616891 tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] Successfully detached device vdb from instance 5b18c889-7694-4edf-8cf2-b9032e60289e from the persistent domain config.
Nov 28 15:41:26 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-d0913eec-b913-4ec0-8c8d-fbb0bc616891 tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5b18c889-7694-4edf-8cf2-b9032e60289e from the live domain config. {{(pid=75176) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 15:41:26 user nova-compute[75176]: DEBUG nova.virt.libvirt.guest [None req-d0913eec-b913-4ec0-8c8d-fbb0bc616891 tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 15:41:26 user nova-compute[75176]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 15:41:26 user nova-compute[75176]:   <source dev="/dev/sdi"/>
Nov 28 15:41:26 user nova-compute[75176]:   <target dev="vdb" bus="virtio"/>
Nov 28 15:41:26 user nova-compute[75176]:   <serial>a1d37820-ff6e-4bc6-a564-582b18c0beb2</serial>
Nov 28 15:41:26 user nova-compute[75176]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 15:41:26 user nova-compute[75176]: </disk>
Nov 28 15:41:26 user nova-compute[75176]:  {{(pid=75176) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 15:41:26 user nova-compute[75176]: DEBUG nova.compute.manager [req-aeced1a6-123e-4cd7-966f-cb1e9140c22f req-6d91f156-a0fb-4049-9d30-cde941e50cf8 service nova] [instance: 1d99de1a-8a82-447a-8a18-02e4efd3b3f0] Received event network-changed-ab316a13-f7fd-49e0-b6f7-6aa0cc815eca {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:41:26 user nova-compute[75176]: DEBUG nova.compute.manager [req-aeced1a6-123e-4cd7-966f-cb1e9140c22f req-6d91f156-a0fb-4049-9d30-cde941e50cf8 service nova] [instance: 1d99de1a-8a82-447a-8a18-02e4efd3b3f0] Refreshing instance network info cache due to event network-changed-ab316a13-f7fd-49e0-b6f7-6aa0cc815eca. {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 15:41:26 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-aeced1a6-123e-4cd7-966f-cb1e9140c22f req-6d91f156-a0fb-4049-9d30-cde941e50cf8 service nova] Acquiring lock "refresh_cache-1d99de1a-8a82-447a-8a18-02e4efd3b3f0" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:41:26 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-aeced1a6-123e-4cd7-966f-cb1e9140c22f req-6d91f156-a0fb-4049-9d30-cde941e50cf8 service nova] Acquired lock "refresh_cache-1d99de1a-8a82-447a-8a18-02e4efd3b3f0" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:41:26 user nova-compute[75176]: DEBUG nova.network.neutron [req-aeced1a6-123e-4cd7-966f-cb1e9140c22f req-6d91f156-a0fb-4049-9d30-cde941e50cf8 service nova] [instance: 1d99de1a-8a82-447a-8a18-02e4efd3b3f0] Refreshing network info cache for port ab316a13-f7fd-49e0-b6f7-6aa0cc815eca {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 15:41:27 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-bf276c76-77bd-4496-a872-fb75fb27ac03 tempest-VolumesAssistedSnapshotsTest-1324886908 tempest-VolumesAssistedSnapshotsTest-1324886908-project-admin] Acquiring lock "1d99de1a-8a82-447a-8a18-02e4efd3b3f0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:41:27 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-bf276c76-77bd-4496-a872-fb75fb27ac03 tempest-VolumesAssistedSnapshotsTest-1324886908 tempest-VolumesAssistedSnapshotsTest-1324886908-project-admin] Lock "1d99de1a-8a82-447a-8a18-02e4efd3b3f0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:41:27 user nova-compute[75176]: DEBUG nova.network.neutron [req-62e40cad-b69f-4881-a19b-05e6f99cdfe0 req-0d93ff24-c17b-4356-a76f-c5a8ad772fca service nova] [instance: 916b82eb-97e8-411c-a8ea-8c27d101b48e] Updated VIF entry in instance network info cache for port 38bef3fc-c841-4db3-b429-8fe94a224783. {{(pid=75176) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 15:41:27 user nova-compute[75176]: DEBUG nova.network.neutron [req-62e40cad-b69f-4881-a19b-05e6f99cdfe0 req-0d93ff24-c17b-4356-a76f-c5a8ad772fca service nova] [instance: 916b82eb-97e8-411c-a8ea-8c27d101b48e] Updating instance_info_cache with network_info: [{"id": "38bef3fc-c841-4db3-b429-8fe94a224783", "address": "fa:16:3e:13:6e:cf", "network": {"id": "dc41c201-1473-486f-abc4-30a09c441826", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2062231487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d68d78d1dd684c2c920ae8e4ce3eaa21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38bef3fc-c8", "ovs_interfaceid": "38bef3fc-c841-4db3-b429-8fe94a224783", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:41:27 user nova-compute[75176]: DEBUG nova.objects.instance [None req-bf276c76-77bd-4496-a872-fb75fb27ac03 tempest-VolumesAssistedSnapshotsTest-1324886908 tempest-VolumesAssistedSnapshotsTest-1324886908-project-admin] Lazy-loading 'flavor' on Instance uuid 1d99de1a-8a82-447a-8a18-02e4efd3b3f0 {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:41:27 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-62e40cad-b69f-4881-a19b-05e6f99cdfe0 req-0d93ff24-c17b-4356-a76f-c5a8ad772fca service nova] Releasing lock "refresh_cache-916b82eb-97e8-411c-a8ea-8c27d101b48e" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:41:27 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-bf276c76-77bd-4496-a872-fb75fb27ac03 tempest-VolumesAssistedSnapshotsTest-1324886908 tempest-VolumesAssistedSnapshotsTest-1324886908-project-admin] Lock "1d99de1a-8a82-447a-8a18-02e4efd3b3f0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.080s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:41:27 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-d0913eec-b913-4ec0-8c8d-fbb0bc616891 tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5b18c889-7694-4edf-8cf2-b9032e60289e {{(pid=75176) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 15:41:27 user nova-compute[75176]: DEBUG nova.network.neutron [req-aeced1a6-123e-4cd7-966f-cb1e9140c22f req-6d91f156-a0fb-4049-9d30-cde941e50cf8 service nova] [instance: 1d99de1a-8a82-447a-8a18-02e4efd3b3f0] Updated VIF entry in instance network info cache for port ab316a13-f7fd-49e0-b6f7-6aa0cc815eca. {{(pid=75176) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 15:41:27 user nova-compute[75176]: DEBUG nova.network.neutron [req-aeced1a6-123e-4cd7-966f-cb1e9140c22f req-6d91f156-a0fb-4049-9d30-cde941e50cf8 service nova] [instance: 1d99de1a-8a82-447a-8a18-02e4efd3b3f0] Updating instance_info_cache with network_info: [{"id": "ab316a13-f7fd-49e0-b6f7-6aa0cc815eca", "address": "fa:16:3e:3c:27:99", "network": {"id": "0ef0c5c2-0325-4d50-8eb3-e72b53c4750c", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-311328630-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73137f167a804cddbf7f345f75763c71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab316a13-f7", "ovs_interfaceid": "ab316a13-f7fd-49e0-b6f7-6aa0cc815eca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:41:27 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-aeced1a6-123e-4cd7-966f-cb1e9140c22f req-6d91f156-a0fb-4049-9d30-cde941e50cf8 service nova] Releasing lock "refresh_cache-1d99de1a-8a82-447a-8a18-02e4efd3b3f0" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:41:27 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-bf276c76-77bd-4496-a872-fb75fb27ac03 tempest-VolumesAssistedSnapshotsTest-1324886908 tempest-VolumesAssistedSnapshotsTest-1324886908-project-admin] Acquiring lock "1d99de1a-8a82-447a-8a18-02e4efd3b3f0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:41:27 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-bf276c76-77bd-4496-a872-fb75fb27ac03 tempest-VolumesAssistedSnapshotsTest-1324886908 tempest-VolumesAssistedSnapshotsTest-1324886908-project-admin] Lock "1d99de1a-8a82-447a-8a18-02e4efd3b3f0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:41:27 user nova-compute[75176]: INFO nova.compute.manager [None req-bf276c76-77bd-4496-a872-fb75fb27ac03 tempest-VolumesAssistedSnapshotsTest-1324886908 tempest-VolumesAssistedSnapshotsTest-1324886908-project-admin] [instance: 1d99de1a-8a82-447a-8a18-02e4efd3b3f0] Attaching volume ff70e82d-37da-4392-b25a-e9b80992af80 to /dev/vdb
Nov 28 15:41:27 user nova-compute[75176]: DEBUG os_brick.utils [None req-bf276c76-77bd-4496-a872-fb75fb27ac03 tempest-VolumesAssistedSnapshotsTest-1324886908 tempest-VolumesAssistedSnapshotsTest-1324886908-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 15:41:27 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:41:27 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:41:27 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a4cc9f8-b954-4f46-a2f7-3559bbef9420]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:edc924a949b2\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:41:27 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:41:27 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:41:27 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[0709b593-5593-46bd-855a-7c8c94bae0b0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:41:27 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:41:27 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:41:27 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6bea2e5-cf39-46c0-974e-d9100ba970c3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:41:27 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1c0b223-69c7-4292-82bb-60ba70eafb6f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:41:27 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-bf276c76-77bd-4496-a872-fb75fb27ac03 tempest-VolumesAssistedSnapshotsTest-1324886908 tempest-VolumesAssistedSnapshotsTest-1324886908-project-admin] Running cmd (subprocess): nvme version {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:41:27 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-bf276c76-77bd-4496-a872-fb75fb27ac03 tempest-VolumesAssistedSnapshotsTest-1324886908 tempest-VolumesAssistedSnapshotsTest-1324886908-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 15:41:27 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bf276c76-77bd-4496-a872-fb75fb27ac03 tempest-VolumesAssistedSnapshotsTest-1324886908 tempest-VolumesAssistedSnapshotsTest-1324886908-project-admin] nvme not present on system {{(pid=75176) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 15:41:27 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:41:27 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 15:41:27 user nova-compute[75176]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 15:41:27 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[035ca9c0-e710-4469-9ded-8dbdd91e2aca]: (4, '') {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:41:27 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.lightos [None req-bf276c76-77bd-4496-a872-fb75fb27ac03 tempest-VolumesAssistedSnapshotsTest-1324886908 tempest-VolumesAssistedSnapshotsTest-1324886908-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75176) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 15:41:27 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.lightos [None req-bf276c76-77bd-4496-a872-fb75fb27ac03 tempest-VolumesAssistedSnapshotsTest-1324886908 tempest-VolumesAssistedSnapshotsTest-1324886908-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75176) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 15:41:27 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.lightos [None req-bf276c76-77bd-4496-a872-fb75fb27ac03 tempest-VolumesAssistedSnapshotsTest-1324886908 tempest-VolumesAssistedSnapshotsTest-1324886908-project-admin] LIGHTOS: no hostnqn found. {{(pid=75176) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 15:41:27 user nova-compute[75176]: DEBUG os_brick.utils [None req-bf276c76-77bd-4496-a872-fb75fb27ac03 tempest-VolumesAssistedSnapshotsTest-1324886908 tempest-VolumesAssistedSnapshotsTest-1324886908-project-admin] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:edc924a949b2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 15:41:27 user nova-compute[75176]: DEBUG nova.virt.block_device [None req-bf276c76-77bd-4496-a872-fb75fb27ac03 tempest-VolumesAssistedSnapshotsTest-1324886908 tempest-VolumesAssistedSnapshotsTest-1324886908-project-admin] [instance: 1d99de1a-8a82-447a-8a18-02e4efd3b3f0] Updating existing volume attachment record: 78efe986-a801-428b-b6c5-9b46e69eb902 {{(pid=75176) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 15:41:27 user nova-compute[75176]: INFO nova.compute.manager [None req-c40e5dd9-3bda-442e-8465-b1850c720249 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] [instance: 916b82eb-97e8-411c-a8ea-8c27d101b48e] Rebuilding instance
Nov 28 15:41:27 user nova-compute[75176]: DEBUG nova.compute.manager [None req-c40e5dd9-3bda-442e-8465-b1850c720249 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] [instance: 916b82eb-97e8-411c-a8ea-8c27d101b48e] Checking state {{(pid=75176) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 15:41:28 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:28 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:28 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:28 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:28 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:28 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:28 user nova-compute[75176]: DEBUG nova.compute.manager [req-78dcb3cb-0784-4ba3-9591-b2cd7383f48f req-e892fcd8-6b55-4baa-b1de-71316df0b450 service nova] [instance: 916b82eb-97e8-411c-a8ea-8c27d101b48e] Received event network-vif-unplugged-38bef3fc-c841-4db3-b429-8fe94a224783 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:41:28 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-78dcb3cb-0784-4ba3-9591-b2cd7383f48f req-e892fcd8-6b55-4baa-b1de-71316df0b450 service nova] Acquiring lock "916b82eb-97e8-411c-a8ea-8c27d101b48e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:41:28 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-78dcb3cb-0784-4ba3-9591-b2cd7383f48f req-e892fcd8-6b55-4baa-b1de-71316df0b450 service nova] Lock "916b82eb-97e8-411c-a8ea-8c27d101b48e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:41:28 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-78dcb3cb-0784-4ba3-9591-b2cd7383f48f req-e892fcd8-6b55-4baa-b1de-71316df0b450 service nova] Lock "916b82eb-97e8-411c-a8ea-8c27d101b48e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:41:28 user nova-compute[75176]: DEBUG nova.compute.manager [req-78dcb3cb-0784-4ba3-9591-b2cd7383f48f req-e892fcd8-6b55-4baa-b1de-71316df0b450 service nova] [instance: 916b82eb-97e8-411c-a8ea-8c27d101b48e] No waiting events found dispatching network-vif-unplugged-38bef3fc-c841-4db3-b429-8fe94a224783 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:41:28 user nova-compute[75176]: WARNING nova.compute.manager [req-78dcb3cb-0784-4ba3-9591-b2cd7383f48f req-e892fcd8-6b55-4baa-b1de-71316df0b450 service nova] [instance: 916b82eb-97e8-411c-a8ea-8c27d101b48e] Received unexpected event network-vif-unplugged-38bef3fc-c841-4db3-b429-8fe94a224783 for instance with vm_state active and task_state rebuilding.
Nov 28 15:41:28 user nova-compute[75176]: INFO nova.virt.libvirt.driver [-] [instance: 916b82eb-97e8-411c-a8ea-8c27d101b48e] Instance destroyed successfully.
Nov 28 15:41:28 user nova-compute[75176]: INFO nova.virt.libvirt.driver [-] [instance: 916b82eb-97e8-411c-a8ea-8c27d101b48e] Instance destroyed successfully.
Nov 28 15:41:28 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-c40e5dd9-3bda-442e-8465-b1850c720249 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T15:39:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-762836390',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-2102540116',id=8,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCQNBGdiL2UyuS5dM6+KjwbgIJ/vX3p2dH1PNPmJxj5EzppPATyTzrKhi1oHmfMeT/UPJyLXI+eIry/aVtUhrMzZLSlMRjHwwDIb+xEYyhtsdb9ZUumnXRPBTV8py7ZAjw==',key_name='tempest-keypair-1515121820',keypairs=<?>,launch_index=0,launched_at=2023-11-28T15:39:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='d68d78d1dd684c2c920ae8e4ce3eaa21',ramdisk_id='',reservation_id='r-uy5cy6al',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-267222163',owner_user_name='tempest-ServerActionsV293TestJSON-267222163-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T15:41:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aea69806df134eeb946d4ed91bd7152b',uuid=916b82eb-97e8-411c-a8ea-8c27d101b48e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "38bef3fc-c841-4db3-b429-8fe94a224783", "address": "fa:16:3e:13:6e:cf", "network": {"id": "dc41c201-1473-486f-abc4-30a09c441826", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2062231487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d68d78d1dd684c2c920ae8e4ce3eaa21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38bef3fc-c8", "ovs_interfaceid": "38bef3fc-c841-4db3-b429-8fe94a224783", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 15:41:28 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-c40e5dd9-3bda-442e-8465-b1850c720249 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] Converting VIF {"id": "38bef3fc-c841-4db3-b429-8fe94a224783", "address": "fa:16:3e:13:6e:cf", "network": {"id": "dc41c201-1473-486f-abc4-30a09c441826", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2062231487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d68d78d1dd684c2c920ae8e4ce3eaa21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38bef3fc-c8", "ovs_interfaceid": "38bef3fc-c841-4db3-b429-8fe94a224783", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:41:28 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-c40e5dd9-3bda-442e-8465-b1850c720249 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:13:6e:cf,bridge_name='br-int',has_traffic_filtering=True,id=38bef3fc-c841-4db3-b429-8fe94a224783,network=Network(dc41c201-1473-486f-abc4-30a09c441826),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38bef3fc-c8') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:41:28 user nova-compute[75176]: DEBUG os_vif [None req-c40e5dd9-3bda-442e-8465-b1850c720249 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:13:6e:cf,bridge_name='br-int',has_traffic_filtering=True,id=38bef3fc-c841-4db3-b429-8fe94a224783,network=Network(dc41c201-1473-486f-abc4-30a09c441826),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38bef3fc-c8') {{(pid=75176) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 15:41:28 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:28 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap38bef3fc-c8, bridge=br-int, if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:41:28 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:29 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:41:29 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a61d4692-2c3c-4715-89f7-96a67c4b0ff1 tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] [instance: 4ed0eb85-e975-446c-8da7-148a4bb36958] Calling os-brick to attach iSCSI Volume {{(pid=75176) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 15:41:29 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-a61d4692-2c3c-4715-89f7-96a67c4b0ff1 tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c1b8a00>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3f34a214-dc9b-45b2-b64c-66c29fb2081a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rCPmRvQZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 15:41:29 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-a61d4692-2c3c-4715-89f7-96a67c4b0ff1 tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 15:41:29 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-a61d4692-2c3c-4715-89f7-96a67c4b0ff1 tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 15:41:29 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-a61d4692-2c3c-4715-89f7-96a67c4b0ff1 tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 15:41:29 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-a61d4692-2c3c-4715-89f7-96a67c4b0ff1 tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 15:41:29 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-a61d4692-2c3c-4715-89f7-96a67c4b0ff1 tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3f34a214-dc9b-45b2-b64c-66c29fb2081a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 15:41:29 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-a61d4692-2c3c-4715-89f7-96a67c4b0ff1 tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3f34a214-dc9b-45b2-b64c-66c29fb2081a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 15:41:29 user nova-compute[75176]: INFO os_brick.initiator.connectors.iscsi [None req-a61d4692-2c3c-4715-89f7-96a67c4b0ff1 tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 15:41:29 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f34a214-dc9b-45b2-b64c-66c29fb2081a -p 172.16.0.220:3260 {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:41:29 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:29 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8d52e8ae-fa49-49e6-a10d-4744be71067e) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:41:29 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:29 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:29 user nova-compute[75176]: INFO os_vif [None req-c40e5dd9-3bda-442e-8465-b1850c720249 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:13:6e:cf,bridge_name='br-int',has_traffic_filtering=True,id=38bef3fc-c841-4db3-b429-8fe94a224783,network=Network(dc41c201-1473-486f-abc4-30a09c441826),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38bef3fc-c8')
Nov 28 15:41:29 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c40e5dd9-3bda-442e-8465-b1850c720249 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] [instance: 916b82eb-97e8-411c-a8ea-8c27d101b48e] calling os-brick to detach iSCSI Volume {{(pid=75176) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 15:41:29 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-c40e5dd9-3bda-442e-8465-b1850c720249 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c1b8a00>, {'target_iqn': 'iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IhQCYfRb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 15:41:29 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-c40e5dd9-3bda-442e-8465-b1850c720249 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 28 15:41:29 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-c40e5dd9-3bda-442e-8465-b1850c720249 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 15:41:29 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f34a214-dc9b-45b2-b64c-66c29fb2081a -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:41:29 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[161429c3-1786-4999-98ab-e967d6be1e52]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:41:29 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-a61d4692-2c3c-4715-89f7-96a67c4b0ff1 tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 15:41:29 user nova-compute[75176]:  {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:41:29 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f34a214-dc9b-45b2-b64c-66c29fb2081a -p 172.16.0.220:3260 --interface default --op new {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:41:29 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f34a214-dc9b-45b2-b64c-66c29fb2081a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:41:29 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f659505-a88d-4116-8419-ec8446286243]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3f34a214-dc9b-45b2-b64c-66c29fb2081a] added\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:41:29 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-a61d4692-2c3c-4715-89f7-96a67c4b0ff1 tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3f34a214-dc9b-45b2-b64c-66c29fb2081a] added
Nov 28 15:41:29 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:41:29 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f34a214-dc9b-45b2-b64c-66c29fb2081a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:41:29 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f34a214-dc9b-45b2-b64c-66c29fb2081a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:41:29 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f2dbf88-007d-4d09-84d0-019b03f085d7]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:41:29 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-a61d4692-2c3c-4715-89f7-96a67c4b0ff1 tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:41:29 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f34a214-dc9b-45b2-b64c-66c29fb2081a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:41:29 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f34a214-dc9b-45b2-b64c-66c29fb2081a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:41:29 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2545a3c-d4d7-4f89-bc32-c6340b525fd5]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:41:29 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-a61d4692-2c3c-4715-89f7-96a67c4b0ff1 tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:41:29 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f34a214-dc9b-45b2-b64c-66c29fb2081a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rCPmRvQZ {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:41:29 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f34a214-dc9b-45b2-b64c-66c29fb2081a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rCPmRvQZ" returned: 0 in 0.018s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:41:29 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[096894ee-3bdf-4226-9d4d-6991e50120f5]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:41:29 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-a61d4692-2c3c-4715-89f7-96a67c4b0ff1 tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rCPmRvQZ'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:41:29 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f34a214-dc9b-45b2-b64c-66c29fb2081a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:41:29 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f34a214-dc9b-45b2-b64c-66c29fb2081a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.032s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:41:29 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[e730f670-dcf3-47ec-995d-1a4dda76ef87]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:41:29 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-a61d4692-2c3c-4715-89f7-96a67c4b0ff1 tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:41:29 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:41:29 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:41:29 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5a2ce64-93e8-42f4-93a3-0157659007cb]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1d37820-ff6e-4bc6-a564-582b18c0beb2 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81326542-482f-4d50-895c-13c65fe4daf7 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76ea4d3b-7c77-47d0-b48b-ad79886d4f9a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27720cbf-c8ad-486b-845d-cdff5fbc4772 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:560d9b0e-d506-4723-8fc3-4068d690d5c8 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e691257-74a3-4fef-9fd1-67d2ba725039 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:763d605d-247d-4484-b7ec-762e36b92abc (non-flash)\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:41:29 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-a61d4692-2c3c-4715-89f7-96a67c4b0ff1 tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1d37820-ff6e-4bc6-a564-582b18c0beb2 (non-flash)
Nov 28 15:41:29 user nova-compute[75176]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9 (non-flash)
Nov 28 15:41:29 user nova-compute[75176]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81326542-482f-4d50-895c-13c65fe4daf7 (non-flash)
Nov 28 15:41:29 user nova-compute[75176]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76ea4d3b-7c77-47d0-b48b-ad79886d4f9a (non-flash)
Nov 28 15:41:29 user nova-compute[75176]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27720cbf-c8ad-486b-845d-cdff5fbc4772 (non-flash)
Nov 28 15:41:29 user nova-compute[75176]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:560d9b0e-d506-4723-8fc3-4068d690d5c8 (non-flash)
Nov 28 15:41:29 user nova-compute[75176]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e691257-74a3-4fef-9fd1-67d2ba725039 (non-flash)
Nov 28 15:41:29 user nova-compute[75176]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:763d605d-247d-4484-b7ec-762e36b92abc (non-flash)
Nov 28 15:41:29 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:41:29 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-a61d4692-2c3c-4715-89f7-96a67c4b0ff1 tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1d37820-ff6e-4bc6-a564-582b18c0beb2 (non-flash)
Nov 28 15:41:29 user nova-compute[75176]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9 (non-flash)
Nov 28 15:41:29 user nova-compute[75176]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81326542-482f-4d50-895c-13c65fe4daf7 (non-flash)
Nov 28 15:41:29 user nova-compute[75176]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76ea4d3b-7c77-47d0-b48b-ad79886d4f9a (non-flash)
Nov 28 15:41:29 user nova-compute[75176]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27720cbf-c8ad-486b-845d-cdff5fbc4772 (non-flash)
Nov 28 15:41:29 user nova-compute[75176]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:560d9b0e-d506-4723-8fc3-4068d690d5c8 (non-flash)
Nov 28 15:41:29 user nova-compute[75176]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e691257-74a3-4fef-9fd1-67d2ba725039 (non-flash)
Nov 28 15:41:29 user nova-compute[75176]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:763d605d-247d-4484-b7ec-762e36b92abc (non-flash)
Nov 28 15:41:29 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 15:41:29 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f34a214-dc9b-45b2-b64c-66c29fb2081a -p 172.16.0.220:3260 --login {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:41:29 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f34a214-dc9b-45b2-b64c-66c29fb2081a -p 172.16.0.220:3260 --login" returned: 0 in 0.097s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:41:29 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdd3a95f-4643-4836-ac36-3fafe6a436fb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3f34a214-dc9b-45b2-b64c-66c29fb2081a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3f34a214-dc9b-45b2-b64c-66c29fb2081a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:41:29 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-a61d4692-2c3c-4715-89f7-96a67c4b0ff1 tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3f34a214-dc9b-45b2-b64c-66c29fb2081a, portal: 172.16.0.220,3260]
Nov 28 15:41:29 user nova-compute[75176]: Login to [iface: default, target: iqn.2010-10.org.openstack:3f34a214-dc9b-45b2-b64c-66c29fb2081a, portal: 172.16.0.220,3260] successful.
Nov 28 15:41:29 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:41:29 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f34a214-dc9b-45b2-b64c-66c29fb2081a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:41:29 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f34a214-dc9b-45b2-b64c-66c29fb2081a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:41:29 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a020ef6-3df9-49a0-8018-9a6bc8b945d8]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:41:29 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-a61d4692-2c3c-4715-89f7-96a67c4b0ff1 tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:41:29 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:41:29 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:41:29 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[039d7f4b-fcf7-4550-b676-318596c214e9]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1d37820-ff6e-4bc6-a564-582b18c0beb2 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f34a214-dc9b-45b2-b64c-66c29fb2081a (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81326542-482f-4d50-895c-13c65fe4daf7 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76ea4d3b-7c77-47d0-b48b-ad79886d4f9a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27720cbf-c8ad-486b-845d-cdff5fbc4772 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:560d9b0e-d506-4723-8fc3-4068d690d5c8 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e691257-74a3-4fef-9fd1-67d2ba725039 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:763d605d-247d-4484-b7ec-762e36b92abc (non-flash)\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:41:29 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-a61d4692-2c3c-4715-89f7-96a67c4b0ff1 tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1d37820-ff6e-4bc6-a564-582b18c0beb2 (non-flash)
Nov 28 15:41:29 user nova-compute[75176]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f34a214-dc9b-45b2-b64c-66c29fb2081a (non-flash)
Nov 28 15:41:29 user nova-compute[75176]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9 (non-flash)
Nov 28 15:41:29 user nova-compute[75176]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81326542-482f-4d50-895c-13c65fe4daf7 (non-flash)
Nov 28 15:41:29 user nova-compute[75176]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76ea4d3b-7c77-47d0-b48b-ad79886d4f9a (non-flash)
Nov 28 15:41:29 user nova-compute[75176]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27720cbf-c8ad-486b-845d-cdff5fbc4772 (non-flash)
Nov 28 15:41:29 user nova-compute[75176]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:560d9b0e-d506-4723-8fc3-4068d690d5c8 (non-flash)
Nov 28 15:41:29 user nova-compute[75176]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e691257-74a3-4fef-9fd1-67d2ba725039 (non-flash)
Nov 28 15:41:29 user nova-compute[75176]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:763d605d-247d-4484-b7ec-762e36b92abc (non-flash)
Nov 28 15:41:29 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:41:29 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-a61d4692-2c3c-4715-89f7-96a67c4b0ff1 tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1d37820-ff6e-4bc6-a564-582b18c0beb2 (non-flash)
Nov 28 15:41:29 user nova-compute[75176]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f34a214-dc9b-45b2-b64c-66c29fb2081a (non-flash)
Nov 28 15:41:29 user nova-compute[75176]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9 (non-flash)
Nov 28 15:41:29 user nova-compute[75176]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81326542-482f-4d50-895c-13c65fe4daf7 (non-flash)
Nov 28 15:41:29 user nova-compute[75176]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76ea4d3b-7c77-47d0-b48b-ad79886d4f9a (non-flash)
Nov 28 15:41:29 user nova-compute[75176]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27720cbf-c8ad-486b-845d-cdff5fbc4772 (non-flash)
Nov 28 15:41:29 user nova-compute[75176]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:560d9b0e-d506-4723-8fc3-4068d690d5c8 (non-flash)
Nov 28 15:41:29 user nova-compute[75176]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e691257-74a3-4fef-9fd1-67d2ba725039 (non-flash)
Nov 28 15:41:29 user nova-compute[75176]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:763d605d-247d-4484-b7ec-762e36b92abc (non-flash)
Nov 28 15:41:29 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 15:41:29 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-a61d4692-2c3c-4715-89f7-96a67c4b0ff1 tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3f34a214-dc9b-45b2-b64c-66c29fb2081a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.371s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 15:41:29 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-a61d4692-2c3c-4715-89f7-96a67c4b0ff1 tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] Connected to 172.16.0.220:3260 {{(pid=75176) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 15:41:29 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-a61d4692-2c3c-4715-89f7-96a67c4b0ff1 tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] HCTL ('41', '-', '-', 0) found on session 11 with lun 0 {{(pid=75176) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 15:41:29 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-a61d4692-2c3c-4715-89f7-96a67c4b0ff1 tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] Scanning host 41 c: -, t: -, l: 0) {{(pid=75176) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 15:41:29 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:41:29 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.016s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:41:29 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfd7ecb5-7b16-4d6d-84d4-41bdab44a881]: (4, ('- - 0', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:41:29 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-a61d4692-2c3c-4715-89f7-96a67c4b0ff1 tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] Searching for a device in session 11 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=75176) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 15:41:29 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-a61d4692-2c3c-4715-89f7-96a67c4b0ff1 tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] Connected to sdj using {'target_iqn': 'iqn.2010-10.org.openstack:3f34a214-dc9b-45b2-b64c-66c29fb2081a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rCPmRvQZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75176) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 15:41:29 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-51a1f08e-e13a-4c5f-88fe-11cb1e094878 tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] [instance: e2e25e19-c832-4945-9257-64e6103feb0c] Calling os-brick to attach iSCSI Volume {{(pid=75176) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 15:41:29 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-51a1f08e-e13a-4c5f-88fe-11cb1e094878 tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c1b8a00>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0dba49e9-5e6e-4896-b644-66558707591d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HstFqQNh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 15:41:29 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-51a1f08e-e13a-4c5f-88fe-11cb1e094878 tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 15:41:29 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-51a1f08e-e13a-4c5f-88fe-11cb1e094878 tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 15:41:30 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-a61d4692-2c3c-4715-89f7-96a67c4b0ff1 tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.408s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 15:41:30 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-a61d4692-2c3c-4715-89f7-96a67c4b0ff1 tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] <== connect_volume: return (1411ms) {'type': 'block', 'scsi_wwn': '23438393462626465', 'path': '/dev/sdj'} {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 15:41:30 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a61d4692-2c3c-4715-89f7-96a67c4b0ff1 tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] [instance: 4ed0eb85-e975-446c-8da7-148a4bb36958] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23438393462626465', 'path': '/dev/sdj'} {{(pid=75176) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 15:41:30 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-c40e5dd9-3bda-442e-8465-b1850c720249 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.380s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 15:41:30 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:41:30 user nova-compute[75176]: DEBUG nova.objects.instance [None req-a61d4692-2c3c-4715-89f7-96a67c4b0ff1 tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] Lazy-loading 'flavor' on Instance uuid 4ed0eb85-e975-446c-8da7-148a4bb36958 {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:41:30 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:41:30 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[44fff9c7-d2c9-448e-a972-e777d7d919fb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a1d37820-ff6e-4bc6-a564-582b18c0beb2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:560d9b0e-d506-4723-8fc3-4068d690d5c8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:763d605d-247d-4484-b7ec-762e36b92abc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:27720cbf-c8ad-486b-845d-cdff5fbc4772\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:81326542-482f-4d50-895c-13c65fe4daf7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:76ea4d3b-7c77-47d0-b48b-ad79886d4f9a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3f34a214-dc9b-45b2-b64c-66c29fb2081a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6e691257-74a3-4fef-9fd1-67d2ba725039\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:41:30 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-c40e5dd9-3bda-442e-8465-b1850c720249 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 15:41:30 user nova-compute[75176]: No targets found.
Nov 28 15:41:30 user nova-compute[75176]: iSNS:
Nov 28 15:41:30 user nova-compute[75176]: No targets found.
Nov 28 15:41:30 user nova-compute[75176]: STATIC:
Nov 28 15:41:30 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:a1d37820-ff6e-4bc6-a564-582b18c0beb2
Nov 28 15:41:30 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:41:30 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:41:30 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:560d9b0e-d506-4723-8fc3-4068d690d5c8
Nov 28 15:41:30 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:41:30 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:41:30 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:763d605d-247d-4484-b7ec-762e36b92abc
Nov 28 15:41:30 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:41:30 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:41:30 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:27720cbf-c8ad-486b-845d-cdff5fbc4772
Nov 28 15:41:30 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:41:30 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:41:30 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:81326542-482f-4d50-895c-13c65fe4daf7
Nov 28 15:41:30 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:41:30 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:41:30 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:76ea4d3b-7c77-47d0-b48b-ad79886d4f9a
Nov 28 15:41:30 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:41:30 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:41:30 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:3f34a214-dc9b-45b2-b64c-66c29fb2081a
Nov 28 15:41:30 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:41:30 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:41:30 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:6e691257-74a3-4fef-9fd1-67d2ba725039
Nov 28 15:41:30 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:41:30 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:41:30 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9
Nov 28 15:41:30 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:41:30 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:41:30 user nova-compute[75176]: FIRMWARE:
Nov 28 15:41:30 user nova-compute[75176]: No targets found.
Nov 28 15:41:30 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:41:30 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-c40e5dd9-3bda-442e-8465-b1850c720249 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 15:41:30 user nova-compute[75176]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 15:41:30 user nova-compute[75176]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75176) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 15:41:30 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-c40e5dd9-3bda-442e-8465-b1850c720249 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9', 0)] {{(pid=75176) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 15:41:30 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:41:30 user nova-compute[75176]: DEBUG nova.virt.libvirt.guest [None req-a61d4692-2c3c-4715-89f7-96a67c4b0ff1 tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 15:41:30 user nova-compute[75176]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 15:41:30 user nova-compute[75176]:   <source dev="/dev/sdj"/>
Nov 28 15:41:30 user nova-compute[75176]:   <target dev="sdc" bus="scsi"/>
Nov 28 15:41:30 user nova-compute[75176]:   <serial>3f34a214-dc9b-45b2-b64c-66c29fb2081a</serial>
Nov 28 15:41:30 user nova-compute[75176]:   <address type="drive" controller="0" unit="2"/>
Nov 28 15:41:30 user nova-compute[75176]: </disk>
Nov 28 15:41:30 user nova-compute[75176]:  {{(pid=75176) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 15:41:30 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:41:30 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[22092087-87d5-4f45-bbcc-00ac70169acc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:27720cbf-c8ad-486b-845d-cdff5fbc4772\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3f34a214-dc9b-45b2-b64c-66c29fb2081a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:560d9b0e-d506-4723-8fc3-4068d690d5c8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e691257-74a3-4fef-9fd1-67d2ba725039\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:763d605d-247d-4484-b7ec-762e36b92abc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:76ea4d3b-7c77-47d0-b48b-ad79886d4f9a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:81326542-482f-4d50-895c-13c65fe4daf7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a1d37820-ff6e-4bc6-a564-582b18c0beb2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:41:30 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:41:30 user nova-compute[75176]: DEBUG nova.compute.manager [req-8c6444e4-f72b-4d69-b5ba-a074529ba988 req-c5cdc372-5945-485e-9fb5-94f17f8c554c service nova] [instance: 916b82eb-97e8-411c-a8ea-8c27d101b48e] Received event network-vif-plugged-38bef3fc-c841-4db3-b429-8fe94a224783 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:41:30 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-8c6444e4-f72b-4d69-b5ba-a074529ba988 req-c5cdc372-5945-485e-9fb5-94f17f8c554c service nova] Acquiring lock "916b82eb-97e8-411c-a8ea-8c27d101b48e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:41:30 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-8c6444e4-f72b-4d69-b5ba-a074529ba988 req-c5cdc372-5945-485e-9fb5-94f17f8c554c service nova] Lock "916b82eb-97e8-411c-a8ea-8c27d101b48e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:41:30 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-8c6444e4-f72b-4d69-b5ba-a074529ba988 req-c5cdc372-5945-485e-9fb5-94f17f8c554c service nova] Lock "916b82eb-97e8-411c-a8ea-8c27d101b48e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:41:30 user nova-compute[75176]: DEBUG nova.compute.manager [req-8c6444e4-f72b-4d69-b5ba-a074529ba988 req-c5cdc372-5945-485e-9fb5-94f17f8c554c service nova] [instance: 916b82eb-97e8-411c-a8ea-8c27d101b48e] No waiting events found dispatching network-vif-plugged-38bef3fc-c841-4db3-b429-8fe94a224783 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:41:30 user nova-compute[75176]: WARNING nova.compute.manager [req-8c6444e4-f72b-4d69-b5ba-a074529ba988 req-c5cdc372-5945-485e-9fb5-94f17f8c554c service nova] [instance: 916b82eb-97e8-411c-a8ea-8c27d101b48e] Received unexpected event network-vif-plugged-38bef3fc-c841-4db3-b429-8fe94a224783 for instance with vm_state active and task_state rebuilding.
Nov 28 15:41:30 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:41:30 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc2106bc-246b-437d-b367-59e5f9b99131]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1d37820-ff6e-4bc6-a564-582b18c0beb2 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f34a214-dc9b-45b2-b64c-66c29fb2081a (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81326542-482f-4d50-895c-13c65fe4daf7 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76ea4d3b-7c77-47d0-b48b-ad79886d4f9a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27720cbf-c8ad-486b-845d-cdff5fbc4772 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:560d9b0e-d506-4723-8fc3-4068d690d5c8 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e691257-74a3-4fef-9fd1-67d2ba725039 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:763d605d-247d-4484-b7ec-762e36b92abc (non-flash)\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:41:30 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-c40e5dd9-3bda-442e-8465-b1850c720249 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1d37820-ff6e-4bc6-a564-582b18c0beb2 (non-flash)
Nov 28 15:41:30 user nova-compute[75176]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f34a214-dc9b-45b2-b64c-66c29fb2081a (non-flash)
Nov 28 15:41:30 user nova-compute[75176]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9 (non-flash)
Nov 28 15:41:30 user nova-compute[75176]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81326542-482f-4d50-895c-13c65fe4daf7 (non-flash)
Nov 28 15:41:30 user nova-compute[75176]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76ea4d3b-7c77-47d0-b48b-ad79886d4f9a (non-flash)
Nov 28 15:41:30 user nova-compute[75176]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27720cbf-c8ad-486b-845d-cdff5fbc4772 (non-flash)
Nov 28 15:41:30 user nova-compute[75176]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:560d9b0e-d506-4723-8fc3-4068d690d5c8 (non-flash)
Nov 28 15:41:30 user nova-compute[75176]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e691257-74a3-4fef-9fd1-67d2ba725039 (non-flash)
Nov 28 15:41:30 user nova-compute[75176]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:763d605d-247d-4484-b7ec-762e36b92abc (non-flash)
Nov 28 15:41:30 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:41:30 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-c40e5dd9-3bda-442e-8465-b1850c720249 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1d37820-ff6e-4bc6-a564-582b18c0beb2 (non-flash)
Nov 28 15:41:30 user nova-compute[75176]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f34a214-dc9b-45b2-b64c-66c29fb2081a (non-flash)
Nov 28 15:41:30 user nova-compute[75176]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9 (non-flash)
Nov 28 15:41:30 user nova-compute[75176]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81326542-482f-4d50-895c-13c65fe4daf7 (non-flash)
Nov 28 15:41:30 user nova-compute[75176]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76ea4d3b-7c77-47d0-b48b-ad79886d4f9a (non-flash)
Nov 28 15:41:30 user nova-compute[75176]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27720cbf-c8ad-486b-845d-cdff5fbc4772 (non-flash)
Nov 28 15:41:30 user nova-compute[75176]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:560d9b0e-d506-4723-8fc3-4068d690d5c8 (non-flash)
Nov 28 15:41:30 user nova-compute[75176]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e691257-74a3-4fef-9fd1-67d2ba725039 (non-flash)
Nov 28 15:41:30 user nova-compute[75176]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:763d605d-247d-4484-b7ec-762e36b92abc (non-flash)
Nov 28 15:41:30 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 15:41:30 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-c40e5dd9-3bda-442e-8465-b1850c720249 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f464c1fecb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9'): ({'sdb'}, set())}) {{(pid=75176) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 15:41:30 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-c40e5dd9-3bda-442e-8465-b1850c720249 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] Removing single pathed devices sdb {{(pid=75176) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 15:41:30 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:41:30 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:41:30 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[807a84e4-d15b-4d03-9dc6-34265aafebce]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:41:30 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:41:30 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:41:30 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b3ed5e2-e6d8-4d98-95b9-b3a87ce86804]: (4, ('ok\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:41:30 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-c40e5dd9-3bda-442e-8465-b1850c720249 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] Flushing IO for device /dev/sdb {{(pid=75176) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 15:41:30 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:41:30 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:41:30 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c0ed2ac-5ff3-42bb-8d70-6762d79ef333]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:41:30 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-c40e5dd9-3bda-442e-8465-b1850c720249 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75176) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 15:41:30 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:41:30 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:41:30 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4219d3b-372f-451e-b8ec-4d4781fc4a88]: (4, ('1', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:41:30 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-c40e5dd9-3bda-442e-8465-b1850c720249 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75176) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 15:41:30 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-c40e5dd9-3bda-442e-8465-b1850c720249 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] SCSI volumes sdb have been removed. {{(pid=75176) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 15:41:30 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-c40e5dd9-3bda-442e-8465-b1850c720249 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9')] {{(pid=75176) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 15:41:30 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:41:30 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.031s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:41:30 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[af2e422b-a8c2-43d4-8cf4-aa1a439f9606]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:41:30 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-c40e5dd9-3bda-442e-8465-b1850c720249 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:41:30 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9 -p 172.16.0.220:3260 --logout {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:41:30 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.080s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:41:30 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6b51e8c-8e68-48eb-98ae-884f06d6bc7d]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:41:30 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-c40e5dd9-3bda-442e-8465-b1850c720249 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9, portal: 172.16.0.220,3260]
Nov 28 15:41:30 user nova-compute[75176]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9, portal: 172.16.0.220,3260] successful.
Nov 28 15:41:30 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:41:30 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9 -p 172.16.0.220:3260 --op delete {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:41:30 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:41:30 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ba03032-a483-415c-8fca-e56f2c17307a]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:41:30 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-c40e5dd9-3bda-442e-8465-b1850c720249 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:41:30 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-c40e5dd9-3bda-442e-8465-b1850c720249 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.355s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 15:41:30 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-c40e5dd9-3bda-442e-8465-b1850c720249 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] <== disconnect_volume: return (1735ms) None {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 15:41:30 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c40e5dd9-3bda-442e-8465-b1850c720249 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] [instance: 916b82eb-97e8-411c-a8ea-8c27d101b48e] Disconnected iSCSI Volume {{(pid=75176) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 15:41:30 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-c40e5dd9-3bda-442e-8465-b1850c720249 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] [instance: 916b82eb-97e8-411c-a8ea-8c27d101b48e] Deleting instance files /opt/stack/data/nova/instances/916b82eb-97e8-411c-a8ea-8c27d101b48e_del
Nov 28 15:41:30 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-c40e5dd9-3bda-442e-8465-b1850c720249 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] [instance: 916b82eb-97e8-411c-a8ea-8c27d101b48e] Deletion of /opt/stack/data/nova/instances/916b82eb-97e8-411c-a8ea-8c27d101b48e_del complete
Nov 28 15:41:30 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-51a1f08e-e13a-4c5f-88fe-11cb1e094878 tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.027s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 15:41:30 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-51a1f08e-e13a-4c5f-88fe-11cb1e094878 tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 15:41:30 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-51a1f08e-e13a-4c5f-88fe-11cb1e094878 tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0dba49e9-5e6e-4896-b644-66558707591d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 15:41:30 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-51a1f08e-e13a-4c5f-88fe-11cb1e094878 tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0dba49e9-5e6e-4896-b644-66558707591d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 15:41:30 user nova-compute[75176]: INFO os_brick.initiator.connectors.iscsi [None req-51a1f08e-e13a-4c5f-88fe-11cb1e094878 tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 15:41:30 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0dba49e9-5e6e-4896-b644-66558707591d -p 172.16.0.220:3260 {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:41:30 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0dba49e9-5e6e-4896-b644-66558707591d -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:41:30 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[82fc7205-f642-49e9-bbaa-cd0c358e1766]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:41:30 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-51a1f08e-e13a-4c5f-88fe-11cb1e094878 tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 15:41:30 user nova-compute[75176]:  {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:41:30 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0dba49e9-5e6e-4896-b644-66558707591d -p 172.16.0.220:3260 --interface default --op new {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:41:30 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0dba49e9-5e6e-4896-b644-66558707591d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:41:30 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[7455affc-3a17-4a94-83f9-8fb38feb0afe]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0dba49e9-5e6e-4896-b644-66558707591d] added\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:41:30 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-51a1f08e-e13a-4c5f-88fe-11cb1e094878 tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0dba49e9-5e6e-4896-b644-66558707591d] added
Nov 28 15:41:30 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:41:30 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0dba49e9-5e6e-4896-b644-66558707591d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:41:30 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0dba49e9-5e6e-4896-b644-66558707591d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:41:30 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b414981-b487-487e-9a1f-1e62e273c106]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:41:30 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-51a1f08e-e13a-4c5f-88fe-11cb1e094878 tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:41:30 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0dba49e9-5e6e-4896-b644-66558707591d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:41:30 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0dba49e9-5e6e-4896-b644-66558707591d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:41:30 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fbcba43-0018-4122-ad53-bfb32940f866]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:41:30 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-51a1f08e-e13a-4c5f-88fe-11cb1e094878 tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:41:30 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0dba49e9-5e6e-4896-b644-66558707591d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HstFqQNh {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:41:30 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0dba49e9-5e6e-4896-b644-66558707591d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HstFqQNh" returned: 0 in 0.023s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:41:30 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f838255-720f-486c-8740-59e1f0a17c68]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:41:30 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-51a1f08e-e13a-4c5f-88fe-11cb1e094878 tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HstFqQNh'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:41:30 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0dba49e9-5e6e-4896-b644-66558707591d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:41:30 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-a61d4692-2c3c-4715-89f7-96a67c4b0ff1 tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] No BDM found with device name sda, not building metadata. {{(pid=75176) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 15:41:30 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-a61d4692-2c3c-4715-89f7-96a67c4b0ff1 tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] No BDM found with device name sdb, not building metadata. {{(pid=75176) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 15:41:30 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-a61d4692-2c3c-4715-89f7-96a67c4b0ff1 tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] No BDM found with device name sdc, not building metadata. {{(pid=75176) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 15:41:30 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-a61d4692-2c3c-4715-89f7-96a67c4b0ff1 tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] No VIF found with MAC fa:16:3e:e6:32:e5, not building metadata {{(pid=75176) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 15:41:30 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0dba49e9-5e6e-4896-b644-66558707591d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.029s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:41:30 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[8642d8ab-c207-4bc4-9c88-e646faa4b71c]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:41:30 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-51a1f08e-e13a-4c5f-88fe-11cb1e094878 tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:41:30 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:41:31 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.044s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:41:31 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[f02aab4f-6e0a-4d78-956d-d3c5c4194c52]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1d37820-ff6e-4bc6-a564-582b18c0beb2 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f34a214-dc9b-45b2-b64c-66c29fb2081a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81326542-482f-4d50-895c-13c65fe4daf7 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76ea4d3b-7c77-47d0-b48b-ad79886d4f9a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27720cbf-c8ad-486b-845d-cdff5fbc4772 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:560d9b0e-d506-4723-8fc3-4068d690d5c8 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e691257-74a3-4fef-9fd1-67d2ba725039 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:763d605d-247d-4484-b7ec-762e36b92abc (non-flash)\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:41:31 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-51a1f08e-e13a-4c5f-88fe-11cb1e094878 tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1d37820-ff6e-4bc6-a564-582b18c0beb2 (non-flash)
Nov 28 15:41:31 user nova-compute[75176]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f34a214-dc9b-45b2-b64c-66c29fb2081a (non-flash)
Nov 28 15:41:31 user nova-compute[75176]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81326542-482f-4d50-895c-13c65fe4daf7 (non-flash)
Nov 28 15:41:31 user nova-compute[75176]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76ea4d3b-7c77-47d0-b48b-ad79886d4f9a (non-flash)
Nov 28 15:41:31 user nova-compute[75176]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27720cbf-c8ad-486b-845d-cdff5fbc4772 (non-flash)
Nov 28 15:41:31 user nova-compute[75176]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:560d9b0e-d506-4723-8fc3-4068d690d5c8 (non-flash)
Nov 28 15:41:31 user nova-compute[75176]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e691257-74a3-4fef-9fd1-67d2ba725039 (non-flash)
Nov 28 15:41:31 user nova-compute[75176]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:763d605d-247d-4484-b7ec-762e36b92abc (non-flash)
Nov 28 15:41:31 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:41:31 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-51a1f08e-e13a-4c5f-88fe-11cb1e094878 tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1d37820-ff6e-4bc6-a564-582b18c0beb2 (non-flash)
Nov 28 15:41:31 user nova-compute[75176]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f34a214-dc9b-45b2-b64c-66c29fb2081a (non-flash)
Nov 28 15:41:31 user nova-compute[75176]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81326542-482f-4d50-895c-13c65fe4daf7 (non-flash)
Nov 28 15:41:31 user nova-compute[75176]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76ea4d3b-7c77-47d0-b48b-ad79886d4f9a (non-flash)
Nov 28 15:41:31 user nova-compute[75176]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27720cbf-c8ad-486b-845d-cdff5fbc4772 (non-flash)
Nov 28 15:41:31 user nova-compute[75176]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:560d9b0e-d506-4723-8fc3-4068d690d5c8 (non-flash)
Nov 28 15:41:31 user nova-compute[75176]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e691257-74a3-4fef-9fd1-67d2ba725039 (non-flash)
Nov 28 15:41:31 user nova-compute[75176]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:763d605d-247d-4484-b7ec-762e36b92abc (non-flash)
Nov 28 15:41:31 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 15:41:31 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0dba49e9-5e6e-4896-b644-66558707591d -p 172.16.0.220:3260 --login {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:41:31 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0dba49e9-5e6e-4896-b644-66558707591d -p 172.16.0.220:3260 --login" returned: 0 in 0.104s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:41:31 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[65ee2c99-a2e0-40ec-9be0-b8329d01061a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0dba49e9-5e6e-4896-b644-66558707591d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0dba49e9-5e6e-4896-b644-66558707591d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:41:31 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-51a1f08e-e13a-4c5f-88fe-11cb1e094878 tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0dba49e9-5e6e-4896-b644-66558707591d, portal: 172.16.0.220,3260]
Nov 28 15:41:31 user nova-compute[75176]: Login to [iface: default, target: iqn.2010-10.org.openstack:0dba49e9-5e6e-4896-b644-66558707591d, portal: 172.16.0.220,3260] successful.
Nov 28 15:41:31 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:41:31 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0dba49e9-5e6e-4896-b644-66558707591d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:41:31 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-a61d4692-2c3c-4715-89f7-96a67c4b0ff1 tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] Lock "4ed0eb85-e975-446c-8da7-148a4bb36958" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.848s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:41:31 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0dba49e9-5e6e-4896-b644-66558707591d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.030s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:41:31 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[e55ed53f-a1c7-43ac-8dde-d3780e8f8105]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:41:31 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-51a1f08e-e13a-4c5f-88fe-11cb1e094878 tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:41:31 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:41:31 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-c40e5dd9-3bda-442e-8465-b1850c720249 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] [instance: 916b82eb-97e8-411c-a8ea-8c27d101b48e] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance 916b82eb-97e8-411c-a8ea-8c27d101b48e could not be found.
Nov 28 15:41:31 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c40e5dd9-3bda-442e-8465-b1850c720249 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] [instance: 916b82eb-97e8-411c-a8ea-8c27d101b48e] calling os-brick to detach iSCSI Volume {{(pid=75176) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 15:41:31 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-c40e5dd9-3bda-442e-8465-b1850c720249 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c1b8a00>, {'target_iqn': 'iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IhQCYfRb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 15:41:31 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-c40e5dd9-3bda-442e-8465-b1850c720249 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 28 15:41:31 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-c40e5dd9-3bda-442e-8465-b1850c720249 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 15:41:31 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.042s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:41:31 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[d536dd15-144c-46c7-8c20-8c0d5443b4ad]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1d37820-ff6e-4bc6-a564-582b18c0beb2 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f34a214-dc9b-45b2-b64c-66c29fb2081a (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dba49e9-5e6e-4896-b644-66558707591d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81326542-482f-4d50-895c-13c65fe4daf7 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76ea4d3b-7c77-47d0-b48b-ad79886d4f9a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27720cbf-c8ad-486b-845d-cdff5fbc4772 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:560d9b0e-d506-4723-8fc3-4068d690d5c8 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e691257-74a3-4fef-9fd1-67d2ba725039 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:763d605d-247d-4484-b7ec-762e36b92abc (non-flash)\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:41:31 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-51a1f08e-e13a-4c5f-88fe-11cb1e094878 tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1d37820-ff6e-4bc6-a564-582b18c0beb2 (non-flash)
Nov 28 15:41:31 user nova-compute[75176]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f34a214-dc9b-45b2-b64c-66c29fb2081a (non-flash)
Nov 28 15:41:31 user nova-compute[75176]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dba49e9-5e6e-4896-b644-66558707591d (non-flash)
Nov 28 15:41:31 user nova-compute[75176]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81326542-482f-4d50-895c-13c65fe4daf7 (non-flash)
Nov 28 15:41:31 user nova-compute[75176]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76ea4d3b-7c77-47d0-b48b-ad79886d4f9a (non-flash)
Nov 28 15:41:31 user nova-compute[75176]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27720cbf-c8ad-486b-845d-cdff5fbc4772 (non-flash)
Nov 28 15:41:31 user nova-compute[75176]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:560d9b0e-d506-4723-8fc3-4068d690d5c8 (non-flash)
Nov 28 15:41:31 user nova-compute[75176]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e691257-74a3-4fef-9fd1-67d2ba725039 (non-flash)
Nov 28 15:41:31 user nova-compute[75176]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:763d605d-247d-4484-b7ec-762e36b92abc (non-flash)
Nov 28 15:41:31 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:41:31 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-51a1f08e-e13a-4c5f-88fe-11cb1e094878 tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1d37820-ff6e-4bc6-a564-582b18c0beb2 (non-flash)
Nov 28 15:41:31 user nova-compute[75176]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f34a214-dc9b-45b2-b64c-66c29fb2081a (non-flash)
Nov 28 15:41:31 user nova-compute[75176]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dba49e9-5e6e-4896-b644-66558707591d (non-flash)
Nov 28 15:41:31 user nova-compute[75176]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81326542-482f-4d50-895c-13c65fe4daf7 (non-flash)
Nov 28 15:41:31 user nova-compute[75176]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76ea4d3b-7c77-47d0-b48b-ad79886d4f9a (non-flash)
Nov 28 15:41:31 user nova-compute[75176]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27720cbf-c8ad-486b-845d-cdff5fbc4772 (non-flash)
Nov 28 15:41:31 user nova-compute[75176]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:560d9b0e-d506-4723-8fc3-4068d690d5c8 (non-flash)
Nov 28 15:41:31 user nova-compute[75176]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e691257-74a3-4fef-9fd1-67d2ba725039 (non-flash)
Nov 28 15:41:31 user nova-compute[75176]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:763d605d-247d-4484-b7ec-762e36b92abc (non-flash)
Nov 28 15:41:31 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 15:41:31 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-51a1f08e-e13a-4c5f-88fe-11cb1e094878 tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0dba49e9-5e6e-4896-b644-66558707591d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.447s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 15:41:31 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-51a1f08e-e13a-4c5f-88fe-11cb1e094878 tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] Connected to 172.16.0.220:3260 {{(pid=75176) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 15:41:31 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-51a1f08e-e13a-4c5f-88fe-11cb1e094878 tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] HCTL ('33', '-', '-', 0) found on session 12 with lun 0 {{(pid=75176) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 15:41:31 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-51a1f08e-e13a-4c5f-88fe-11cb1e094878 tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75176) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 15:41:31 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:41:31 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.022s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:41:31 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bf98db9-c3c4-4ce7-8e1a-dd11c462766d]: (4, ('- - 0', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:41:31 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-51a1f08e-e13a-4c5f-88fe-11cb1e094878 tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] Searching for a device in session 12 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75176) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 15:41:31 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-51a1f08e-e13a-4c5f-88fe-11cb1e094878 tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:0dba49e9-5e6e-4896-b644-66558707591d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HstFqQNh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75176) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 15:41:32 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-c76a39ee-2d2c-42cd-b237-920e258bf13f tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] Acquiring lock "4ed0eb85-e975-446c-8da7-148a4bb36958" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:41:32 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-c76a39ee-2d2c-42cd-b237-920e258bf13f tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] Lock "4ed0eb85-e975-446c-8da7-148a4bb36958" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:41:32 user nova-compute[75176]: INFO nova.compute.manager [None req-c76a39ee-2d2c-42cd-b237-920e258bf13f tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] [instance: 4ed0eb85-e975-446c-8da7-148a4bb36958] Detaching volume 3f34a214-dc9b-45b2-b64c-66c29fb2081a
Nov 28 15:41:32 user nova-compute[75176]: INFO nova.virt.block_device [None req-c76a39ee-2d2c-42cd-b237-920e258bf13f tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] [instance: 4ed0eb85-e975-446c-8da7-148a4bb36958] Attempting to driver detach volume 3f34a214-dc9b-45b2-b64c-66c29fb2081a from mountpoint /dev/sdc
Nov 28 15:41:32 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-c76a39ee-2d2c-42cd-b237-920e258bf13f tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] Attempting to detach device sdc from instance 4ed0eb85-e975-446c-8da7-148a4bb36958 from the persistent domain config. {{(pid=75176) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 15:41:32 user nova-compute[75176]: DEBUG nova.virt.libvirt.guest [None req-c76a39ee-2d2c-42cd-b237-920e258bf13f tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 15:41:32 user nova-compute[75176]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 15:41:32 user nova-compute[75176]:   <source dev="/dev/sdj"/>
Nov 28 15:41:32 user nova-compute[75176]:   <target dev="sdc" bus="scsi"/>
Nov 28 15:41:32 user nova-compute[75176]:   <serial>3f34a214-dc9b-45b2-b64c-66c29fb2081a</serial>
Nov 28 15:41:32 user nova-compute[75176]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 28 15:41:32 user nova-compute[75176]: </disk>
Nov 28 15:41:32 user nova-compute[75176]:  {{(pid=75176) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 15:41:32 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-c76a39ee-2d2c-42cd-b237-920e258bf13f tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] Successfully detached device sdc from instance 4ed0eb85-e975-446c-8da7-148a4bb36958 from the persistent domain config.
Nov 28 15:41:32 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-c76a39ee-2d2c-42cd-b237-920e258bf13f tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance 4ed0eb85-e975-446c-8da7-148a4bb36958 from the live domain config. {{(pid=75176) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 15:41:32 user nova-compute[75176]: DEBUG nova.virt.libvirt.guest [None req-c76a39ee-2d2c-42cd-b237-920e258bf13f tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 15:41:32 user nova-compute[75176]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 15:41:32 user nova-compute[75176]:   <source dev="/dev/sdj"/>
Nov 28 15:41:32 user nova-compute[75176]:   <target dev="sdc" bus="scsi"/>
Nov 28 15:41:32 user nova-compute[75176]:   <serial>3f34a214-dc9b-45b2-b64c-66c29fb2081a</serial>
Nov 28 15:41:32 user nova-compute[75176]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 28 15:41:32 user nova-compute[75176]: </disk>
Nov 28 15:41:32 user nova-compute[75176]:  {{(pid=75176) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 15:41:32 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-51a1f08e-e13a-4c5f-88fe-11cb1e094878 tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.497s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 15:41:32 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-51a1f08e-e13a-4c5f-88fe-11cb1e094878 tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] <== connect_volume: return (2524ms) {'type': 'block', 'scsi_wwn': '26564653466626664', 'path': '/dev/sdb'} {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 15:41:32 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-51a1f08e-e13a-4c5f-88fe-11cb1e094878 tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] [instance: e2e25e19-c832-4945-9257-64e6103feb0c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26564653466626664', 'path': '/dev/sdb'} {{(pid=75176) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 15:41:32 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-c40e5dd9-3bda-442e-8465-b1850c720249 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.053s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 15:41:32 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:41:32 user nova-compute[75176]: DEBUG nova.objects.instance [None req-51a1f08e-e13a-4c5f-88fe-11cb1e094878 tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] Lazy-loading 'flavor' on Instance uuid e2e25e19-c832-4945-9257-64e6103feb0c {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:41:32 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:41:32 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[f37287ee-60f8-4cf9-a57a-f3c07c3148d6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a1d37820-ff6e-4bc6-a564-582b18c0beb2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:560d9b0e-d506-4723-8fc3-4068d690d5c8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:763d605d-247d-4484-b7ec-762e36b92abc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:27720cbf-c8ad-486b-845d-cdff5fbc4772\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:81326542-482f-4d50-895c-13c65fe4daf7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:76ea4d3b-7c77-47d0-b48b-ad79886d4f9a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3f34a214-dc9b-45b2-b64c-66c29fb2081a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6e691257-74a3-4fef-9fd1-67d2ba725039\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0dba49e9-5e6e-4896-b644-66558707591d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:41:32 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-c40e5dd9-3bda-442e-8465-b1850c720249 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 15:41:32 user nova-compute[75176]: No targets found.
Nov 28 15:41:32 user nova-compute[75176]: iSNS:
Nov 28 15:41:32 user nova-compute[75176]: No targets found.
Nov 28 15:41:32 user nova-compute[75176]: STATIC:
Nov 28 15:41:32 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:a1d37820-ff6e-4bc6-a564-582b18c0beb2
Nov 28 15:41:32 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:41:32 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:41:32 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:560d9b0e-d506-4723-8fc3-4068d690d5c8
Nov 28 15:41:32 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:41:32 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:41:32 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:763d605d-247d-4484-b7ec-762e36b92abc
Nov 28 15:41:32 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:41:32 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:41:32 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:27720cbf-c8ad-486b-845d-cdff5fbc4772
Nov 28 15:41:32 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:41:32 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:41:32 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:81326542-482f-4d50-895c-13c65fe4daf7
Nov 28 15:41:32 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:41:32 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:41:32 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:76ea4d3b-7c77-47d0-b48b-ad79886d4f9a
Nov 28 15:41:32 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:41:32 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:41:32 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:3f34a214-dc9b-45b2-b64c-66c29fb2081a
Nov 28 15:41:32 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:41:32 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:41:32 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:6e691257-74a3-4fef-9fd1-67d2ba725039
Nov 28 15:41:32 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:41:32 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:41:32 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:0dba49e9-5e6e-4896-b644-66558707591d
Nov 28 15:41:32 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:41:32 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:41:32 user nova-compute[75176]: FIRMWARE:
Nov 28 15:41:32 user nova-compute[75176]: No targets found.
Nov 28 15:41:32 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:41:32 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-c40e5dd9-3bda-442e-8465-b1850c720249 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 15:41:32 user nova-compute[75176]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 15:41:32 user nova-compute[75176]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75176) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 15:41:32 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-c40e5dd9-3bda-442e-8465-b1850c720249 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9', 0)] {{(pid=75176) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 15:41:32 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:41:32 user nova-compute[75176]: DEBUG nova.virt.libvirt.guest [None req-51a1f08e-e13a-4c5f-88fe-11cb1e094878 tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 15:41:32 user nova-compute[75176]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 15:41:32 user nova-compute[75176]:   <source dev="/dev/sdb"/>
Nov 28 15:41:32 user nova-compute[75176]:   <target dev="vdb" bus="virtio"/>
Nov 28 15:41:32 user nova-compute[75176]:   <serial>0dba49e9-5e6e-4896-b644-66558707591d</serial>
Nov 28 15:41:32 user nova-compute[75176]: </disk>
Nov 28 15:41:32 user nova-compute[75176]:  {{(pid=75176) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 15:41:32 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:41:32 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e450866-8e82-41a7-be74-96506651004b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0dba49e9-5e6e-4896-b644-66558707591d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:27720cbf-c8ad-486b-845d-cdff5fbc4772\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3f34a214-dc9b-45b2-b64c-66c29fb2081a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:560d9b0e-d506-4723-8fc3-4068d690d5c8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e691257-74a3-4fef-9fd1-67d2ba725039\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:763d605d-247d-4484-b7ec-762e36b92abc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:76ea4d3b-7c77-47d0-b48b-ad79886d4f9a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:81326542-482f-4d50-895c-13c65fe4daf7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a1d37820-ff6e-4bc6-a564-582b18c0beb2\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:41:32 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:41:32 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:41:32 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[37afab8c-01b2-4846-90ce-d6e0b073f134]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1d37820-ff6e-4bc6-a564-582b18c0beb2 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f34a214-dc9b-45b2-b64c-66c29fb2081a (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dba49e9-5e6e-4896-b644-66558707591d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81326542-482f-4d50-895c-13c65fe4daf7 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76ea4d3b-7c77-47d0-b48b-ad79886d4f9a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27720cbf-c8ad-486b-845d-cdff5fbc4772 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:560d9b0e-d506-4723-8fc3-4068d690d5c8 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e691257-74a3-4fef-9fd1-67d2ba725039 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:763d605d-247d-4484-b7ec-762e36b92abc (non-flash)\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:41:32 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-c40e5dd9-3bda-442e-8465-b1850c720249 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1d37820-ff6e-4bc6-a564-582b18c0beb2 (non-flash)
Nov 28 15:41:32 user nova-compute[75176]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f34a214-dc9b-45b2-b64c-66c29fb2081a (non-flash)
Nov 28 15:41:32 user nova-compute[75176]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dba49e9-5e6e-4896-b644-66558707591d (non-flash)
Nov 28 15:41:32 user nova-compute[75176]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81326542-482f-4d50-895c-13c65fe4daf7 (non-flash)
Nov 28 15:41:32 user nova-compute[75176]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76ea4d3b-7c77-47d0-b48b-ad79886d4f9a (non-flash)
Nov 28 15:41:32 user nova-compute[75176]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27720cbf-c8ad-486b-845d-cdff5fbc4772 (non-flash)
Nov 28 15:41:32 user nova-compute[75176]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:560d9b0e-d506-4723-8fc3-4068d690d5c8 (non-flash)
Nov 28 15:41:32 user nova-compute[75176]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e691257-74a3-4fef-9fd1-67d2ba725039 (non-flash)
Nov 28 15:41:32 user nova-compute[75176]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:763d605d-247d-4484-b7ec-762e36b92abc (non-flash)
Nov 28 15:41:32 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:41:32 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-c40e5dd9-3bda-442e-8465-b1850c720249 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1d37820-ff6e-4bc6-a564-582b18c0beb2 (non-flash)
Nov 28 15:41:32 user nova-compute[75176]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f34a214-dc9b-45b2-b64c-66c29fb2081a (non-flash)
Nov 28 15:41:32 user nova-compute[75176]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dba49e9-5e6e-4896-b644-66558707591d (non-flash)
Nov 28 15:41:32 user nova-compute[75176]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81326542-482f-4d50-895c-13c65fe4daf7 (non-flash)
Nov 28 15:41:32 user nova-compute[75176]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76ea4d3b-7c77-47d0-b48b-ad79886d4f9a (non-flash)
Nov 28 15:41:32 user nova-compute[75176]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27720cbf-c8ad-486b-845d-cdff5fbc4772 (non-flash)
Nov 28 15:41:32 user nova-compute[75176]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:560d9b0e-d506-4723-8fc3-4068d690d5c8 (non-flash)
Nov 28 15:41:32 user nova-compute[75176]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e691257-74a3-4fef-9fd1-67d2ba725039 (non-flash)
Nov 28 15:41:32 user nova-compute[75176]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:763d605d-247d-4484-b7ec-762e36b92abc (non-flash)
Nov 28 15:41:32 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 15:41:32 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-c40e5dd9-3bda-442e-8465-b1850c720249 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f464c0d2440>, {}) {{(pid=75176) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 15:41:32 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-c40e5dd9-3bda-442e-8465-b1850c720249 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] Disconnecting from: [] {{(pid=75176) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 15:41:32 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-c40e5dd9-3bda-442e-8465-b1850c720249 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.107s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 15:41:32 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-c40e5dd9-3bda-442e-8465-b1850c720249 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] <== disconnect_volume: return (1160ms) None {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 15:41:32 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c40e5dd9-3bda-442e-8465-b1850c720249 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] [instance: 916b82eb-97e8-411c-a8ea-8c27d101b48e] Disconnected iSCSI Volume {{(pid=75176) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 15:41:32 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-c76a39ee-2d2c-42cd-b237-920e258bf13f tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance 4ed0eb85-e975-446c-8da7-148a4bb36958 {{(pid=75176) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 15:41:33 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-51a1f08e-e13a-4c5f-88fe-11cb1e094878 tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] No BDM found with device name vda, not building metadata. {{(pid=75176) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 15:41:33 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-51a1f08e-e13a-4c5f-88fe-11cb1e094878 tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] No BDM found with device name hda, not building metadata. {{(pid=75176) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 15:41:33 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-51a1f08e-e13a-4c5f-88fe-11cb1e094878 tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] No VIF found with MAC fa:16:3e:b8:ab:c4, not building metadata {{(pid=75176) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 15:41:33 user nova-compute[75176]: DEBUG nova.compute.manager [None req-c40e5dd9-3bda-442e-8465-b1850c720249 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] [instance: 916b82eb-97e8-411c-a8ea-8c27d101b48e] Preparing to wait for external event volume-reimaged-ec90fb93-901a-43ab-ba96-58f9505953e9 {{(pid=75176) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Nov 28 15:41:33 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-c40e5dd9-3bda-442e-8465-b1850c720249 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] Acquiring lock "916b82eb-97e8-411c-a8ea-8c27d101b48e-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:41:33 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-c40e5dd9-3bda-442e-8465-b1850c720249 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] Lock "916b82eb-97e8-411c-a8ea-8c27d101b48e-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:41:33 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-c40e5dd9-3bda-442e-8465-b1850c720249 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] Lock "916b82eb-97e8-411c-a8ea-8c27d101b48e-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:41:33 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:33 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-51a1f08e-e13a-4c5f-88fe-11cb1e094878 tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] Lock "e2e25e19-c832-4945-9257-64e6103feb0c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.203s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:41:34 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:35 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-a6d20036-7a6f-4750-9aed-016a7bc081df tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] Acquiring lock "e2e25e19-c832-4945-9257-64e6103feb0c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:41:35 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-a6d20036-7a6f-4750-9aed-016a7bc081df tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] Lock "e2e25e19-c832-4945-9257-64e6103feb0c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:41:35 user nova-compute[75176]: INFO nova.compute.manager [None req-a6d20036-7a6f-4750-9aed-016a7bc081df tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] [instance: e2e25e19-c832-4945-9257-64e6103feb0c] Detaching volume 0dba49e9-5e6e-4896-b644-66558707591d
Nov 28 15:41:35 user nova-compute[75176]: INFO nova.virt.block_device [None req-a6d20036-7a6f-4750-9aed-016a7bc081df tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] [instance: e2e25e19-c832-4945-9257-64e6103feb0c] Attempting to driver detach volume 0dba49e9-5e6e-4896-b644-66558707591d from mountpoint /dev/vdb
Nov 28 15:41:35 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-a6d20036-7a6f-4750-9aed-016a7bc081df tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] Attempting to detach device vdb from instance e2e25e19-c832-4945-9257-64e6103feb0c from the persistent domain config. {{(pid=75176) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 15:41:35 user nova-compute[75176]: DEBUG nova.virt.libvirt.guest [None req-a6d20036-7a6f-4750-9aed-016a7bc081df tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 15:41:35 user nova-compute[75176]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 15:41:35 user nova-compute[75176]:   <source dev="/dev/sdb"/>
Nov 28 15:41:35 user nova-compute[75176]:   <target dev="vdb" bus="virtio"/>
Nov 28 15:41:35 user nova-compute[75176]:   <serial>0dba49e9-5e6e-4896-b644-66558707591d</serial>
Nov 28 15:41:35 user nova-compute[75176]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 28 15:41:35 user nova-compute[75176]: </disk>
Nov 28 15:41:35 user nova-compute[75176]:  {{(pid=75176) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 15:41:35 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-a6d20036-7a6f-4750-9aed-016a7bc081df tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] Successfully detached device vdb from instance e2e25e19-c832-4945-9257-64e6103feb0c from the persistent domain config.
Nov 28 15:41:35 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-a6d20036-7a6f-4750-9aed-016a7bc081df tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e2e25e19-c832-4945-9257-64e6103feb0c from the live domain config. {{(pid=75176) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 15:41:35 user nova-compute[75176]: DEBUG nova.virt.libvirt.guest [None req-a6d20036-7a6f-4750-9aed-016a7bc081df tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 15:41:35 user nova-compute[75176]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 15:41:35 user nova-compute[75176]:   <source dev="/dev/sdb"/>
Nov 28 15:41:35 user nova-compute[75176]:   <target dev="vdb" bus="virtio"/>
Nov 28 15:41:35 user nova-compute[75176]:   <serial>0dba49e9-5e6e-4896-b644-66558707591d</serial>
Nov 28 15:41:35 user nova-compute[75176]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 28 15:41:35 user nova-compute[75176]: </disk>
Nov 28 15:41:35 user nova-compute[75176]:  {{(pid=75176) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 15:41:35 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-a6d20036-7a6f-4750-9aed-016a7bc081df tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e2e25e19-c832-4945-9257-64e6103feb0c {{(pid=75176) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 15:41:36 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf276c76-77bd-4496-a872-fb75fb27ac03 tempest-VolumesAssistedSnapshotsTest-1324886908 tempest-VolumesAssistedSnapshotsTest-1324886908-project-admin] [instance: 1d99de1a-8a82-447a-8a18-02e4efd3b3f0] Calling os-brick to attach iSCSI Volume {{(pid=75176) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 15:41:36 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf276c76-77bd-4496-a872-fb75fb27ac03 tempest-VolumesAssistedSnapshotsTest-1324886908 tempest-VolumesAssistedSnapshotsTest-1324886908-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c1b8a00>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ff70e82d-37da-4392-b25a-e9b80992af80', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kEKaPUXB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 15:41:36 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-bf276c76-77bd-4496-a872-fb75fb27ac03 tempest-VolumesAssistedSnapshotsTest-1324886908 tempest-VolumesAssistedSnapshotsTest-1324886908-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 15:41:36 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-bf276c76-77bd-4496-a872-fb75fb27ac03 tempest-VolumesAssistedSnapshotsTest-1324886908 tempest-VolumesAssistedSnapshotsTest-1324886908-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 15:41:36 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-bf276c76-77bd-4496-a872-fb75fb27ac03 tempest-VolumesAssistedSnapshotsTest-1324886908 tempest-VolumesAssistedSnapshotsTest-1324886908-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 15:41:36 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-bf276c76-77bd-4496-a872-fb75fb27ac03 tempest-VolumesAssistedSnapshotsTest-1324886908 tempest-VolumesAssistedSnapshotsTest-1324886908-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 15:41:36 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-bf276c76-77bd-4496-a872-fb75fb27ac03 tempest-VolumesAssistedSnapshotsTest-1324886908 tempest-VolumesAssistedSnapshotsTest-1324886908-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ff70e82d-37da-4392-b25a-e9b80992af80" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 15:41:36 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-bf276c76-77bd-4496-a872-fb75fb27ac03 tempest-VolumesAssistedSnapshotsTest-1324886908 tempest-VolumesAssistedSnapshotsTest-1324886908-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ff70e82d-37da-4392-b25a-e9b80992af80" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 15:41:36 user nova-compute[75176]: INFO os_brick.initiator.connectors.iscsi [None req-bf276c76-77bd-4496-a872-fb75fb27ac03 tempest-VolumesAssistedSnapshotsTest-1324886908 tempest-VolumesAssistedSnapshotsTest-1324886908-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 15:41:36 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff70e82d-37da-4392-b25a-e9b80992af80 -p 172.16.0.220:3260 {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:41:36 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff70e82d-37da-4392-b25a-e9b80992af80 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:41:36 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[673a2d2b-2d65-46d5-8637-46c686e5dfca]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:41:36 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf276c76-77bd-4496-a872-fb75fb27ac03 tempest-VolumesAssistedSnapshotsTest-1324886908 tempest-VolumesAssistedSnapshotsTest-1324886908-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 15:41:36 user nova-compute[75176]:  {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:41:36 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff70e82d-37da-4392-b25a-e9b80992af80 -p 172.16.0.220:3260 --interface default --op new {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:41:36 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff70e82d-37da-4392-b25a-e9b80992af80 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:41:36 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[86ab0460-f156-4a4a-8253-843ff58d0488]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ff70e82d-37da-4392-b25a-e9b80992af80] added\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:41:36 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf276c76-77bd-4496-a872-fb75fb27ac03 tempest-VolumesAssistedSnapshotsTest-1324886908 tempest-VolumesAssistedSnapshotsTest-1324886908-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ff70e82d-37da-4392-b25a-e9b80992af80] added
Nov 28 15:41:36 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:41:36 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff70e82d-37da-4392-b25a-e9b80992af80 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:41:36 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff70e82d-37da-4392-b25a-e9b80992af80 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:41:36 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[925fc632-0ce7-4d06-b8d5-ba4e1e6ed7c1]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:41:36 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf276c76-77bd-4496-a872-fb75fb27ac03 tempest-VolumesAssistedSnapshotsTest-1324886908 tempest-VolumesAssistedSnapshotsTest-1324886908-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:41:36 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff70e82d-37da-4392-b25a-e9b80992af80 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:41:36 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff70e82d-37da-4392-b25a-e9b80992af80 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:41:36 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[26d12401-e356-4606-8116-c1d22d05cd40]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:41:36 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf276c76-77bd-4496-a872-fb75fb27ac03 tempest-VolumesAssistedSnapshotsTest-1324886908 tempest-VolumesAssistedSnapshotsTest-1324886908-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:41:36 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff70e82d-37da-4392-b25a-e9b80992af80 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kEKaPUXB {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:41:36 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff70e82d-37da-4392-b25a-e9b80992af80 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kEKaPUXB" returned: 0 in 0.018s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:41:36 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[26630a1e-a7fc-4b91-a78f-33b3ec161d2c]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:41:36 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf276c76-77bd-4496-a872-fb75fb27ac03 tempest-VolumesAssistedSnapshotsTest-1324886908 tempest-VolumesAssistedSnapshotsTest-1324886908-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kEKaPUXB'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:41:36 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff70e82d-37da-4392-b25a-e9b80992af80 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:41:36 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff70e82d-37da-4392-b25a-e9b80992af80 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:41:36 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dd15201-f42f-40ab-a039-83cf06d82955]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:41:36 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf276c76-77bd-4496-a872-fb75fb27ac03 tempest-VolumesAssistedSnapshotsTest-1324886908 tempest-VolumesAssistedSnapshotsTest-1324886908-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:41:36 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:41:36 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:41:36 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bd968c7-905b-4678-af90-771135156001]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1d37820-ff6e-4bc6-a564-582b18c0beb2 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f34a214-dc9b-45b2-b64c-66c29fb2081a (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dba49e9-5e6e-4896-b644-66558707591d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81326542-482f-4d50-895c-13c65fe4daf7 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76ea4d3b-7c77-47d0-b48b-ad79886d4f9a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27720cbf-c8ad-486b-845d-cdff5fbc4772 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:560d9b0e-d506-4723-8fc3-4068d690d5c8 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e691257-74a3-4fef-9fd1-67d2ba725039 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:763d605d-247d-4484-b7ec-762e36b92abc (non-flash)\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:41:36 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf276c76-77bd-4496-a872-fb75fb27ac03 tempest-VolumesAssistedSnapshotsTest-1324886908 tempest-VolumesAssistedSnapshotsTest-1324886908-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1d37820-ff6e-4bc6-a564-582b18c0beb2 (non-flash)
Nov 28 15:41:36 user nova-compute[75176]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f34a214-dc9b-45b2-b64c-66c29fb2081a (non-flash)
Nov 28 15:41:36 user nova-compute[75176]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dba49e9-5e6e-4896-b644-66558707591d (non-flash)
Nov 28 15:41:36 user nova-compute[75176]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81326542-482f-4d50-895c-13c65fe4daf7 (non-flash)
Nov 28 15:41:36 user nova-compute[75176]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76ea4d3b-7c77-47d0-b48b-ad79886d4f9a (non-flash)
Nov 28 15:41:36 user nova-compute[75176]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27720cbf-c8ad-486b-845d-cdff5fbc4772 (non-flash)
Nov 28 15:41:36 user nova-compute[75176]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:560d9b0e-d506-4723-8fc3-4068d690d5c8 (non-flash)
Nov 28 15:41:36 user nova-compute[75176]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e691257-74a3-4fef-9fd1-67d2ba725039 (non-flash)
Nov 28 15:41:36 user nova-compute[75176]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:763d605d-247d-4484-b7ec-762e36b92abc (non-flash)
Nov 28 15:41:36 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:41:36 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf276c76-77bd-4496-a872-fb75fb27ac03 tempest-VolumesAssistedSnapshotsTest-1324886908 tempest-VolumesAssistedSnapshotsTest-1324886908-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1d37820-ff6e-4bc6-a564-582b18c0beb2 (non-flash)
Nov 28 15:41:36 user nova-compute[75176]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f34a214-dc9b-45b2-b64c-66c29fb2081a (non-flash)
Nov 28 15:41:36 user nova-compute[75176]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dba49e9-5e6e-4896-b644-66558707591d (non-flash)
Nov 28 15:41:36 user nova-compute[75176]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81326542-482f-4d50-895c-13c65fe4daf7 (non-flash)
Nov 28 15:41:36 user nova-compute[75176]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76ea4d3b-7c77-47d0-b48b-ad79886d4f9a (non-flash)
Nov 28 15:41:36 user nova-compute[75176]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27720cbf-c8ad-486b-845d-cdff5fbc4772 (non-flash)
Nov 28 15:41:36 user nova-compute[75176]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:560d9b0e-d506-4723-8fc3-4068d690d5c8 (non-flash)
Nov 28 15:41:36 user nova-compute[75176]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e691257-74a3-4fef-9fd1-67d2ba725039 (non-flash)
Nov 28 15:41:36 user nova-compute[75176]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:763d605d-247d-4484-b7ec-762e36b92abc (non-flash)
Nov 28 15:41:36 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 15:41:36 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff70e82d-37da-4392-b25a-e9b80992af80 -p 172.16.0.220:3260 --login {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:41:36 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff70e82d-37da-4392-b25a-e9b80992af80 -p 172.16.0.220:3260 --login" returned: 0 in 0.088s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:41:36 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[27a4bcfd-6842-4b0a-b47f-ae6aa20efd95]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ff70e82d-37da-4392-b25a-e9b80992af80, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ff70e82d-37da-4392-b25a-e9b80992af80, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:41:36 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf276c76-77bd-4496-a872-fb75fb27ac03 tempest-VolumesAssistedSnapshotsTest-1324886908 tempest-VolumesAssistedSnapshotsTest-1324886908-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ff70e82d-37da-4392-b25a-e9b80992af80, portal: 172.16.0.220,3260]
Nov 28 15:41:36 user nova-compute[75176]: Login to [iface: default, target: iqn.2010-10.org.openstack:ff70e82d-37da-4392-b25a-e9b80992af80, portal: 172.16.0.220,3260] successful.
Nov 28 15:41:36 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:41:36 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff70e82d-37da-4392-b25a-e9b80992af80 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:41:36 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff70e82d-37da-4392-b25a-e9b80992af80 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:41:36 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[eab7dbff-9659-4e9e-ad2a-8ce9d07c325d]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:41:36 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf276c76-77bd-4496-a872-fb75fb27ac03 tempest-VolumesAssistedSnapshotsTest-1324886908 tempest-VolumesAssistedSnapshotsTest-1324886908-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:41:36 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:41:36 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:41:36 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bd33088-a5fc-42c3-9b39-0500bde1cd11]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1d37820-ff6e-4bc6-a564-582b18c0beb2 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f34a214-dc9b-45b2-b64c-66c29fb2081a (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dba49e9-5e6e-4896-b644-66558707591d (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff70e82d-37da-4392-b25a-e9b80992af80 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81326542-482f-4d50-895c-13c65fe4daf7 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76ea4d3b-7c77-47d0-b48b-ad79886d4f9a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27720cbf-c8ad-486b-845d-cdff5fbc4772 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:560d9b0e-d506-4723-8fc3-4068d690d5c8 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e691257-74a3-4fef-9fd1-67d2ba725039 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:763d605d-247d-4484-b7ec-762e36b92abc (non-flash)\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:41:36 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf276c76-77bd-4496-a872-fb75fb27ac03 tempest-VolumesAssistedSnapshotsTest-1324886908 tempest-VolumesAssistedSnapshotsTest-1324886908-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1d37820-ff6e-4bc6-a564-582b18c0beb2 (non-flash)
Nov 28 15:41:36 user nova-compute[75176]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f34a214-dc9b-45b2-b64c-66c29fb2081a (non-flash)
Nov 28 15:41:36 user nova-compute[75176]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dba49e9-5e6e-4896-b644-66558707591d (non-flash)
Nov 28 15:41:36 user nova-compute[75176]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff70e82d-37da-4392-b25a-e9b80992af80 (non-flash)
Nov 28 15:41:36 user nova-compute[75176]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81326542-482f-4d50-895c-13c65fe4daf7 (non-flash)
Nov 28 15:41:36 user nova-compute[75176]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76ea4d3b-7c77-47d0-b48b-ad79886d4f9a (non-flash)
Nov 28 15:41:36 user nova-compute[75176]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27720cbf-c8ad-486b-845d-cdff5fbc4772 (non-flash)
Nov 28 15:41:36 user nova-compute[75176]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:560d9b0e-d506-4723-8fc3-4068d690d5c8 (non-flash)
Nov 28 15:41:36 user nova-compute[75176]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e691257-74a3-4fef-9fd1-67d2ba725039 (non-flash)
Nov 28 15:41:36 user nova-compute[75176]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:763d605d-247d-4484-b7ec-762e36b92abc (non-flash)
Nov 28 15:41:36 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:41:36 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf276c76-77bd-4496-a872-fb75fb27ac03 tempest-VolumesAssistedSnapshotsTest-1324886908 tempest-VolumesAssistedSnapshotsTest-1324886908-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1d37820-ff6e-4bc6-a564-582b18c0beb2 (non-flash)
Nov 28 15:41:36 user nova-compute[75176]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f34a214-dc9b-45b2-b64c-66c29fb2081a (non-flash)
Nov 28 15:41:36 user nova-compute[75176]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dba49e9-5e6e-4896-b644-66558707591d (non-flash)
Nov 28 15:41:36 user nova-compute[75176]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff70e82d-37da-4392-b25a-e9b80992af80 (non-flash)
Nov 28 15:41:36 user nova-compute[75176]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81326542-482f-4d50-895c-13c65fe4daf7 (non-flash)
Nov 28 15:41:36 user nova-compute[75176]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76ea4d3b-7c77-47d0-b48b-ad79886d4f9a (non-flash)
Nov 28 15:41:36 user nova-compute[75176]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27720cbf-c8ad-486b-845d-cdff5fbc4772 (non-flash)
Nov 28 15:41:36 user nova-compute[75176]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:560d9b0e-d506-4723-8fc3-4068d690d5c8 (non-flash)
Nov 28 15:41:36 user nova-compute[75176]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e691257-74a3-4fef-9fd1-67d2ba725039 (non-flash)
Nov 28 15:41:36 user nova-compute[75176]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:763d605d-247d-4484-b7ec-762e36b92abc (non-flash)
Nov 28 15:41:36 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 15:41:36 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-bf276c76-77bd-4496-a872-fb75fb27ac03 tempest-VolumesAssistedSnapshotsTest-1324886908 tempest-VolumesAssistedSnapshotsTest-1324886908-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ff70e82d-37da-4392-b25a-e9b80992af80" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.324s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 15:41:36 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf276c76-77bd-4496-a872-fb75fb27ac03 tempest-VolumesAssistedSnapshotsTest-1324886908 tempest-VolumesAssistedSnapshotsTest-1324886908-project-admin] Connected to 172.16.0.220:3260 {{(pid=75176) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 15:41:36 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-bf276c76-77bd-4496-a872-fb75fb27ac03 tempest-VolumesAssistedSnapshotsTest-1324886908 tempest-VolumesAssistedSnapshotsTest-1324886908-project-admin] HCTL ('42', '-', '-', 0) found on session 13 with lun 0 {{(pid=75176) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 15:41:36 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-bf276c76-77bd-4496-a872-fb75fb27ac03 tempest-VolumesAssistedSnapshotsTest-1324886908 tempest-VolumesAssistedSnapshotsTest-1324886908-project-admin] Scanning host 42 c: -, t: -, l: 0) {{(pid=75176) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 15:41:36 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host42/scan {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:41:36 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host42/scan" returned: 0 in 0.017s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:41:36 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[136a0d84-c2a4-4ecc-bde1-bda0fb8c8c28]: (4, ('- - 0', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:41:36 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-bf276c76-77bd-4496-a872-fb75fb27ac03 tempest-VolumesAssistedSnapshotsTest-1324886908 tempest-VolumesAssistedSnapshotsTest-1324886908-project-admin] Searching for a device in session 13 and hctl ['42', '*', '*', 0] yield: sdk {{(pid=75176) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 15:41:36 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf276c76-77bd-4496-a872-fb75fb27ac03 tempest-VolumesAssistedSnapshotsTest-1324886908 tempest-VolumesAssistedSnapshotsTest-1324886908-project-admin] Connected to sdk using {'target_iqn': 'iqn.2010-10.org.openstack:ff70e82d-37da-4392-b25a-e9b80992af80', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kEKaPUXB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75176) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 15:41:37 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-bf276c76-77bd-4496-a872-fb75fb27ac03 tempest-VolumesAssistedSnapshotsTest-1324886908 tempest-VolumesAssistedSnapshotsTest-1324886908-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.371s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 15:41:37 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf276c76-77bd-4496-a872-fb75fb27ac03 tempest-VolumesAssistedSnapshotsTest-1324886908 tempest-VolumesAssistedSnapshotsTest-1324886908-project-admin] <== connect_volume: return (1373ms) {'type': 'block', 'scsi_wwn': '26266343063376439', 'path': '/dev/sdk'} {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 15:41:37 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf276c76-77bd-4496-a872-fb75fb27ac03 tempest-VolumesAssistedSnapshotsTest-1324886908 tempest-VolumesAssistedSnapshotsTest-1324886908-project-admin] [instance: 1d99de1a-8a82-447a-8a18-02e4efd3b3f0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26266343063376439', 'path': '/dev/sdk'} {{(pid=75176) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 15:41:37 user nova-compute[75176]: DEBUG nova.objects.instance [None req-bf276c76-77bd-4496-a872-fb75fb27ac03 tempest-VolumesAssistedSnapshotsTest-1324886908 tempest-VolumesAssistedSnapshotsTest-1324886908-project-admin] Lazy-loading 'flavor' on Instance uuid 1d99de1a-8a82-447a-8a18-02e4efd3b3f0 {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:41:37 user nova-compute[75176]: DEBUG nova.virt.libvirt.guest [None req-bf276c76-77bd-4496-a872-fb75fb27ac03 tempest-VolumesAssistedSnapshotsTest-1324886908 tempest-VolumesAssistedSnapshotsTest-1324886908-project-admin] attach device xml: <disk type="block" device="disk">
Nov 28 15:41:37 user nova-compute[75176]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 15:41:37 user nova-compute[75176]:   <source dev="/dev/sdk"/>
Nov 28 15:41:37 user nova-compute[75176]:   <target dev="vdb" bus="virtio"/>
Nov 28 15:41:37 user nova-compute[75176]:   <serial>ff70e82d-37da-4392-b25a-e9b80992af80</serial>
Nov 28 15:41:37 user nova-compute[75176]: </disk>
Nov 28 15:41:37 user nova-compute[75176]:  {{(pid=75176) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 15:41:37 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-bf276c76-77bd-4496-a872-fb75fb27ac03 tempest-VolumesAssistedSnapshotsTest-1324886908 tempest-VolumesAssistedSnapshotsTest-1324886908-project-admin] No BDM found with device name vda, not building metadata. {{(pid=75176) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 15:41:37 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-bf276c76-77bd-4496-a872-fb75fb27ac03 tempest-VolumesAssistedSnapshotsTest-1324886908 tempest-VolumesAssistedSnapshotsTest-1324886908-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=75176) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 15:41:37 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-bf276c76-77bd-4496-a872-fb75fb27ac03 tempest-VolumesAssistedSnapshotsTest-1324886908 tempest-VolumesAssistedSnapshotsTest-1324886908-project-admin] No VIF found with MAC fa:16:3e:3c:27:99, not building metadata {{(pid=75176) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 15:41:38 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-bf276c76-77bd-4496-a872-fb75fb27ac03 tempest-VolumesAssistedSnapshotsTest-1324886908 tempest-VolumesAssistedSnapshotsTest-1324886908-project-admin] Lock "1d99de1a-8a82-447a-8a18-02e4efd3b3f0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.592s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:41:38 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:39 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:39 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-d017c2f2-93d3-4d02-83e1-0ec7ee9cc1fc tempest-VolumesAssistedSnapshotsTest-1120890509 tempest-VolumesAssistedSnapshotsTest-1120890509-project] [instance: 1d99de1a-8a82-447a-8a18-02e4efd3b3f0] volume_snapshot_create: create_info: {'snapshot_id': 'e30c469b-cec9-45aa-b532-09c25c36f5a2', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=75176) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3576}}
Nov 28 15:41:39 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-d017c2f2-93d3-4d02-83e1-0ec7ee9cc1fc tempest-VolumesAssistedSnapshotsTest-1120890509 tempest-VolumesAssistedSnapshotsTest-1120890509-project] [instance: 1d99de1a-8a82-447a-8a18-02e4efd3b3f0] snap xml: <domainsnapshot>
Nov 28 15:41:39 user nova-compute[75176]:   <disks>
Nov 28 15:41:39 user nova-compute[75176]:     <disk name="/dev/sdk" snapshot="external" type="file">
Nov 28 15:41:39 user nova-compute[75176]:       <source file="/dev/new_file"/>
Nov 28 15:41:39 user nova-compute[75176]:     </disk>
Nov 28 15:41:39 user nova-compute[75176]:     <disk name="vda" snapshot="no"/>
Nov 28 15:41:39 user nova-compute[75176]:   </disks>
Nov 28 15:41:39 user nova-compute[75176]: </domainsnapshot>
Nov 28 15:41:39 user nova-compute[75176]:  {{(pid=75176) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3517}}
Nov 28 15:41:39 user nova-compute[75176]: DEBUG nova.objects.instance [None req-d017c2f2-93d3-4d02-83e1-0ec7ee9cc1fc tempest-VolumesAssistedSnapshotsTest-1120890509 tempest-VolumesAssistedSnapshotsTest-1120890509-project] Lazy-loading 'system_metadata' on Instance uuid 1d99de1a-8a82-447a-8a18-02e4efd3b3f0 {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:41:39 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-d017c2f2-93d3-4d02-83e1-0ec7ee9cc1fc tempest-VolumesAssistedSnapshotsTest-1120890509 tempest-VolumesAssistedSnapshotsTest-1120890509-project] [instance: 1d99de1a-8a82-447a-8a18-02e4efd3b3f0] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 28 15:41:39 user nova-compute[75176]: ERROR nova.virt.libvirt.driver [None req-d017c2f2-93d3-4d02-83e1-0ec7ee9cc1fc tempest-VolumesAssistedSnapshotsTest-1120890509 tempest-VolumesAssistedSnapshotsTest-1120890509-project] [instance: 1d99de1a-8a82-447a-8a18-02e4efd3b3f0] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 28 15:41:39 user nova-compute[75176]: ERROR nova.virt.libvirt.driver [instance: 1d99de1a-8a82-447a-8a18-02e4efd3b3f0] Traceback (most recent call last):
Nov 28 15:41:39 user nova-compute[75176]: ERROR nova.virt.libvirt.driver [instance: 1d99de1a-8a82-447a-8a18-02e4efd3b3f0]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 28 15:41:39 user nova-compute[75176]: ERROR nova.virt.libvirt.driver [instance: 1d99de1a-8a82-447a-8a18-02e4efd3b3f0]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 28 15:41:39 user nova-compute[75176]: ERROR nova.virt.libvirt.driver [instance: 1d99de1a-8a82-447a-8a18-02e4efd3b3f0]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 28 15:41:39 user nova-compute[75176]: ERROR nova.virt.libvirt.driver [instance: 1d99de1a-8a82-447a-8a18-02e4efd3b3f0]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 28 15:41:39 user nova-compute[75176]: ERROR nova.virt.libvirt.driver [instance: 1d99de1a-8a82-447a-8a18-02e4efd3b3f0]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 28 15:41:39 user nova-compute[75176]: ERROR nova.virt.libvirt.driver [instance: 1d99de1a-8a82-447a-8a18-02e4efd3b3f0]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 28 15:41:39 user nova-compute[75176]: ERROR nova.virt.libvirt.driver [instance: 1d99de1a-8a82-447a-8a18-02e4efd3b3f0]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 28 15:41:39 user nova-compute[75176]: ERROR nova.virt.libvirt.driver [instance: 1d99de1a-8a82-447a-8a18-02e4efd3b3f0]     rv = execute(f, *args, **kwargs)
Nov 28 15:41:39 user nova-compute[75176]: ERROR nova.virt.libvirt.driver [instance: 1d99de1a-8a82-447a-8a18-02e4efd3b3f0]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 28 15:41:39 user nova-compute[75176]: ERROR nova.virt.libvirt.driver [instance: 1d99de1a-8a82-447a-8a18-02e4efd3b3f0]     six.reraise(c, e, tb)
Nov 28 15:41:39 user nova-compute[75176]: ERROR nova.virt.libvirt.driver [instance: 1d99de1a-8a82-447a-8a18-02e4efd3b3f0]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 28 15:41:39 user nova-compute[75176]: ERROR nova.virt.libvirt.driver [instance: 1d99de1a-8a82-447a-8a18-02e4efd3b3f0]     raise value
Nov 28 15:41:39 user nova-compute[75176]: ERROR nova.virt.libvirt.driver [instance: 1d99de1a-8a82-447a-8a18-02e4efd3b3f0]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 28 15:41:39 user nova-compute[75176]: ERROR nova.virt.libvirt.driver [instance: 1d99de1a-8a82-447a-8a18-02e4efd3b3f0]     rv = meth(*args, **kwargs)
Nov 28 15:41:39 user nova-compute[75176]: ERROR nova.virt.libvirt.driver [instance: 1d99de1a-8a82-447a-8a18-02e4efd3b3f0]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 28 15:41:39 user nova-compute[75176]: ERROR nova.virt.libvirt.driver [instance: 1d99de1a-8a82-447a-8a18-02e4efd3b3f0]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 28 15:41:39 user nova-compute[75176]: ERROR nova.virt.libvirt.driver [instance: 1d99de1a-8a82-447a-8a18-02e4efd3b3f0] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 28 15:41:39 user nova-compute[75176]: ERROR nova.virt.libvirt.driver [instance: 1d99de1a-8a82-447a-8a18-02e4efd3b3f0] 
Nov 28 15:41:39 user nova-compute[75176]: ERROR nova.virt.libvirt.driver [None req-d017c2f2-93d3-4d02-83e1-0ec7ee9cc1fc tempest-VolumesAssistedSnapshotsTest-1120890509 tempest-VolumesAssistedSnapshotsTest-1120890509-project] [instance: 1d99de1a-8a82-447a-8a18-02e4efd3b3f0] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 28 15:41:39 user nova-compute[75176]: ERROR nova.virt.libvirt.driver [instance: 1d99de1a-8a82-447a-8a18-02e4efd3b3f0] Traceback (most recent call last):
Nov 28 15:41:39 user nova-compute[75176]: ERROR nova.virt.libvirt.driver [instance: 1d99de1a-8a82-447a-8a18-02e4efd3b3f0]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 28 15:41:39 user nova-compute[75176]: ERROR nova.virt.libvirt.driver [instance: 1d99de1a-8a82-447a-8a18-02e4efd3b3f0]     self._volume_snapshot_create(context, instance, guest,
Nov 28 15:41:39 user nova-compute[75176]: ERROR nova.virt.libvirt.driver [instance: 1d99de1a-8a82-447a-8a18-02e4efd3b3f0]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 28 15:41:39 user nova-compute[75176]: ERROR nova.virt.libvirt.driver [instance: 1d99de1a-8a82-447a-8a18-02e4efd3b3f0]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 28 15:41:39 user nova-compute[75176]: ERROR nova.virt.libvirt.driver [instance: 1d99de1a-8a82-447a-8a18-02e4efd3b3f0]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 28 15:41:39 user nova-compute[75176]: ERROR nova.virt.libvirt.driver [instance: 1d99de1a-8a82-447a-8a18-02e4efd3b3f0]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 28 15:41:39 user nova-compute[75176]: ERROR nova.virt.libvirt.driver [instance: 1d99de1a-8a82-447a-8a18-02e4efd3b3f0]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 28 15:41:39 user nova-compute[75176]: ERROR nova.virt.libvirt.driver [instance: 1d99de1a-8a82-447a-8a18-02e4efd3b3f0]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 28 15:41:39 user nova-compute[75176]: ERROR nova.virt.libvirt.driver [instance: 1d99de1a-8a82-447a-8a18-02e4efd3b3f0]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 28 15:41:39 user nova-compute[75176]: ERROR nova.virt.libvirt.driver [instance: 1d99de1a-8a82-447a-8a18-02e4efd3b3f0]     rv = execute(f, *args, **kwargs)
Nov 28 15:41:39 user nova-compute[75176]: ERROR nova.virt.libvirt.driver [instance: 1d99de1a-8a82-447a-8a18-02e4efd3b3f0]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 28 15:41:39 user nova-compute[75176]: ERROR nova.virt.libvirt.driver [instance: 1d99de1a-8a82-447a-8a18-02e4efd3b3f0]     six.reraise(c, e, tb)
Nov 28 15:41:39 user nova-compute[75176]: ERROR nova.virt.libvirt.driver [instance: 1d99de1a-8a82-447a-8a18-02e4efd3b3f0]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 28 15:41:39 user nova-compute[75176]: ERROR nova.virt.libvirt.driver [instance: 1d99de1a-8a82-447a-8a18-02e4efd3b3f0]     raise value
Nov 28 15:41:39 user nova-compute[75176]: ERROR nova.virt.libvirt.driver [instance: 1d99de1a-8a82-447a-8a18-02e4efd3b3f0]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 28 15:41:39 user nova-compute[75176]: ERROR nova.virt.libvirt.driver [instance: 1d99de1a-8a82-447a-8a18-02e4efd3b3f0]     rv = meth(*args, **kwargs)
Nov 28 15:41:39 user nova-compute[75176]: ERROR nova.virt.libvirt.driver [instance: 1d99de1a-8a82-447a-8a18-02e4efd3b3f0]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 28 15:41:39 user nova-compute[75176]: ERROR nova.virt.libvirt.driver [instance: 1d99de1a-8a82-447a-8a18-02e4efd3b3f0]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 28 15:41:39 user nova-compute[75176]: ERROR nova.virt.libvirt.driver [instance: 1d99de1a-8a82-447a-8a18-02e4efd3b3f0] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 28 15:41:39 user nova-compute[75176]: ERROR nova.virt.libvirt.driver [instance: 1d99de1a-8a82-447a-8a18-02e4efd3b3f0] 
Nov 28 15:41:39 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-6b34a8ea-6afa-48af-9095-740fe0d68ab1 tempest-VolumesAssistedSnapshotsTest-1120890509 tempest-VolumesAssistedSnapshotsTest-1120890509-project] [instance: 1d99de1a-8a82-447a-8a18-02e4efd3b3f0] volume_snapshot_delete: delete_info: {'volume_id': 'ff70e82d-37da-4392-b25a-e9b80992af80'} {{(pid=75176) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3677}}
Nov 28 15:41:39 user nova-compute[75176]: ERROR nova.virt.libvirt.driver [None req-6b34a8ea-6afa-48af-9095-740fe0d68ab1 tempest-VolumesAssistedSnapshotsTest-1120890509 tempest-VolumesAssistedSnapshotsTest-1120890509-project] [instance: 1d99de1a-8a82-447a-8a18-02e4efd3b3f0] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Nov 28 15:41:39 user nova-compute[75176]: ERROR nova.virt.libvirt.driver [instance: 1d99de1a-8a82-447a-8a18-02e4efd3b3f0] Traceback (most recent call last):
Nov 28 15:41:39 user nova-compute[75176]: ERROR nova.virt.libvirt.driver [instance: 1d99de1a-8a82-447a-8a18-02e4efd3b3f0]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 28 15:41:39 user nova-compute[75176]: ERROR nova.virt.libvirt.driver [instance: 1d99de1a-8a82-447a-8a18-02e4efd3b3f0]     self._volume_snapshot_delete(context, instance, volume_id,
Nov 28 15:41:39 user nova-compute[75176]: ERROR nova.virt.libvirt.driver [instance: 1d99de1a-8a82-447a-8a18-02e4efd3b3f0]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 28 15:41:39 user nova-compute[75176]: ERROR nova.virt.libvirt.driver [instance: 1d99de1a-8a82-447a-8a18-02e4efd3b3f0]     if delete_info['type'] != 'qcow2':
Nov 28 15:41:39 user nova-compute[75176]: ERROR nova.virt.libvirt.driver [instance: 1d99de1a-8a82-447a-8a18-02e4efd3b3f0] KeyError: 'type'
Nov 28 15:41:39 user nova-compute[75176]: ERROR nova.virt.libvirt.driver [instance: 1d99de1a-8a82-447a-8a18-02e4efd3b3f0] 
Nov 28 15:41:39 user nova-compute[75176]: ERROR nova.virt.libvirt.driver [None req-6b34a8ea-6afa-48af-9095-740fe0d68ab1 tempest-VolumesAssistedSnapshotsTest-1120890509 tempest-VolumesAssistedSnapshotsTest-1120890509-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 28 15:41:39 user nova-compute[75176]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 28 15:41:39 user nova-compute[75176]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 28 15:41:39 user nova-compute[75176]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Nov 28 15:41:39 user nova-compute[75176]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 28 15:41:39 user nova-compute[75176]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Nov 28 15:41:39 user nova-compute[75176]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Nov 28 15:41:39 user nova-compute[75176]: ERROR nova.virt.libvirt.driver 
Nov 28 15:41:39 user nova-compute[75176]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 28 15:41:39 user nova-compute[75176]: ERROR nova.virt.libvirt.driver 
Nov 28 15:41:39 user nova-compute[75176]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 28 15:41:39 user nova-compute[75176]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 28 15:41:39 user nova-compute[75176]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 28 15:41:39 user nova-compute[75176]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 28 15:41:39 user nova-compute[75176]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 28 15:41:39 user nova-compute[75176]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 28 15:41:39 user nova-compute[75176]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 28 15:41:39 user nova-compute[75176]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 28 15:41:39 user nova-compute[75176]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 28 15:41:39 user nova-compute[75176]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 28 15:41:39 user nova-compute[75176]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 28 15:41:39 user nova-compute[75176]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 28 15:41:39 user nova-compute[75176]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 28 15:41:39 user nova-compute[75176]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 28 15:41:39 user nova-compute[75176]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 28 15:41:39 user nova-compute[75176]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-7115a467-22e2-43b6-acc7-f522b0b1965c)
Nov 28 15:41:39 user nova-compute[75176]: ERROR nova.virt.libvirt.driver 
Nov 28 15:41:39 user nova-compute[75176]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 28 15:41:39 user nova-compute[75176]: ERROR nova.virt.libvirt.driver 
Nov 28 15:41:39 user nova-compute[75176]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 28 15:41:39 user nova-compute[75176]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 28 15:41:39 user nova-compute[75176]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 28 15:41:39 user nova-compute[75176]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 28 15:41:39 user nova-compute[75176]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 28 15:41:39 user nova-compute[75176]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 28 15:41:39 user nova-compute[75176]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 28 15:41:39 user nova-compute[75176]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 28 15:41:39 user nova-compute[75176]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 28 15:41:39 user nova-compute[75176]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 28 15:41:39 user nova-compute[75176]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 28 15:41:39 user nova-compute[75176]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 28 15:41:39 user nova-compute[75176]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 28 15:41:39 user nova-compute[75176]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 28 15:41:39 user nova-compute[75176]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 28 15:41:39 user nova-compute[75176]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 28 15:41:39 user nova-compute[75176]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 28 15:41:39 user nova-compute[75176]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 28 15:41:39 user nova-compute[75176]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 28 15:41:39 user nova-compute[75176]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 28 15:41:39 user nova-compute[75176]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 28 15:41:39 user nova-compute[75176]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 28 15:41:39 user nova-compute[75176]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 28 15:41:39 user nova-compute[75176]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 28 15:41:39 user nova-compute[75176]: ERROR nova.virt.libvirt.driver 
Nov 28 15:41:39 user nova-compute[75176]: ERROR nova.virt.libvirt.driver [None req-d017c2f2-93d3-4d02-83e1-0ec7ee9cc1fc tempest-VolumesAssistedSnapshotsTest-1120890509 tempest-VolumesAssistedSnapshotsTest-1120890509-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot e30c469b-cec9-45aa-b532-09c25c36f5a2 could not be found.
Nov 28 15:41:39 user nova-compute[75176]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 28 15:41:39 user nova-compute[75176]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 28 15:41:39 user nova-compute[75176]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Nov 28 15:41:39 user nova-compute[75176]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 28 15:41:39 user nova-compute[75176]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 28 15:41:39 user nova-compute[75176]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 28 15:41:39 user nova-compute[75176]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 28 15:41:39 user nova-compute[75176]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 28 15:41:39 user nova-compute[75176]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 28 15:41:39 user nova-compute[75176]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 28 15:41:39 user nova-compute[75176]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Nov 28 15:41:39 user nova-compute[75176]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 28 15:41:39 user nova-compute[75176]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Nov 28 15:41:39 user nova-compute[75176]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 28 15:41:39 user nova-compute[75176]: ERROR nova.virt.libvirt.driver     raise value
Nov 28 15:41:39 user nova-compute[75176]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 28 15:41:39 user nova-compute[75176]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Nov 28 15:41:39 user nova-compute[75176]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 28 15:41:39 user nova-compute[75176]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 28 15:41:39 user nova-compute[75176]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 28 15:41:39 user nova-compute[75176]: ERROR nova.virt.libvirt.driver 
Nov 28 15:41:39 user nova-compute[75176]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 28 15:41:39 user nova-compute[75176]: ERROR nova.virt.libvirt.driver 
Nov 28 15:41:39 user nova-compute[75176]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 28 15:41:39 user nova-compute[75176]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 28 15:41:39 user nova-compute[75176]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 28 15:41:39 user nova-compute[75176]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 28 15:41:39 user nova-compute[75176]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 28 15:41:39 user nova-compute[75176]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 28 15:41:39 user nova-compute[75176]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 28 15:41:39 user nova-compute[75176]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 28 15:41:39 user nova-compute[75176]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 28 15:41:39 user nova-compute[75176]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 28 15:41:39 user nova-compute[75176]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 28 15:41:39 user nova-compute[75176]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 28 15:41:39 user nova-compute[75176]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 28 15:41:39 user nova-compute[75176]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 28 15:41:39 user nova-compute[75176]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 28 15:41:39 user nova-compute[75176]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot e30c469b-cec9-45aa-b532-09c25c36f5a2 could not be found. (HTTP 404) (Request-ID: req-62c0cb76-7ec9-4df3-bedf-79b4188c1a24)
Nov 28 15:41:39 user nova-compute[75176]: ERROR nova.virt.libvirt.driver 
Nov 28 15:41:39 user nova-compute[75176]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 28 15:41:39 user nova-compute[75176]: ERROR nova.virt.libvirt.driver 
Nov 28 15:41:39 user nova-compute[75176]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 28 15:41:39 user nova-compute[75176]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 28 15:41:39 user nova-compute[75176]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 28 15:41:39 user nova-compute[75176]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 28 15:41:39 user nova-compute[75176]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 28 15:41:39 user nova-compute[75176]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 28 15:41:39 user nova-compute[75176]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 28 15:41:39 user nova-compute[75176]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 28 15:41:39 user nova-compute[75176]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 28 15:41:39 user nova-compute[75176]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 28 15:41:39 user nova-compute[75176]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 28 15:41:39 user nova-compute[75176]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 28 15:41:39 user nova-compute[75176]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 28 15:41:39 user nova-compute[75176]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 28 15:41:39 user nova-compute[75176]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 28 15:41:39 user nova-compute[75176]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 28 15:41:39 user nova-compute[75176]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 28 15:41:39 user nova-compute[75176]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 28 15:41:39 user nova-compute[75176]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 28 15:41:39 user nova-compute[75176]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 28 15:41:39 user nova-compute[75176]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 28 15:41:39 user nova-compute[75176]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 28 15:41:39 user nova-compute[75176]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 28 15:41:39 user nova-compute[75176]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot e30c469b-cec9-45aa-b532-09c25c36f5a2 could not be found.
Nov 28 15:41:39 user nova-compute[75176]: ERROR nova.virt.libvirt.driver 
Nov 28 15:41:39 user nova-compute[75176]: ERROR oslo_messaging.rpc.server [None req-6b34a8ea-6afa-48af-9095-740fe0d68ab1 tempest-VolumesAssistedSnapshotsTest-1120890509 tempest-VolumesAssistedSnapshotsTest-1120890509-project] Exception during message handling: KeyError: 'type'
Nov 28 15:41:39 user nova-compute[75176]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 28 15:41:39 user nova-compute[75176]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 28 15:41:39 user nova-compute[75176]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 28 15:41:39 user nova-compute[75176]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 28 15:41:39 user nova-compute[75176]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 28 15:41:39 user nova-compute[75176]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 28 15:41:39 user nova-compute[75176]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 28 15:41:39 user nova-compute[75176]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 28 15:41:39 user nova-compute[75176]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 28 15:41:39 user nova-compute[75176]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 28 15:41:39 user nova-compute[75176]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 28 15:41:39 user nova-compute[75176]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 28 15:41:39 user nova-compute[75176]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 28 15:41:39 user nova-compute[75176]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 28 15:41:39 user nova-compute[75176]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 28 15:41:39 user nova-compute[75176]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 28 15:41:39 user nova-compute[75176]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 28 15:41:39 user nova-compute[75176]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4517, in volume_snapshot_delete
Nov 28 15:41:39 user nova-compute[75176]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Nov 28 15:41:39 user nova-compute[75176]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3853, in volume_snapshot_delete
Nov 28 15:41:39 user nova-compute[75176]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 28 15:41:39 user nova-compute[75176]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 28 15:41:39 user nova-compute[75176]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 28 15:41:39 user nova-compute[75176]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 28 15:41:39 user nova-compute[75176]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 28 15:41:39 user nova-compute[75176]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 28 15:41:39 user nova-compute[75176]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Nov 28 15:41:39 user nova-compute[75176]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 28 15:41:39 user nova-compute[75176]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Nov 28 15:41:39 user nova-compute[75176]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Nov 28 15:41:39 user nova-compute[75176]: ERROR oslo_messaging.rpc.server 
Nov 28 15:41:39 user nova-compute[75176]: ERROR oslo_messaging.rpc.server [None req-d017c2f2-93d3-4d02-83e1-0ec7ee9cc1fc tempest-VolumesAssistedSnapshotsTest-1120890509 tempest-VolumesAssistedSnapshotsTest-1120890509-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 28 15:41:39 user nova-compute[75176]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 28 15:41:39 user nova-compute[75176]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 28 15:41:39 user nova-compute[75176]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 28 15:41:39 user nova-compute[75176]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 28 15:41:39 user nova-compute[75176]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 28 15:41:39 user nova-compute[75176]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 28 15:41:39 user nova-compute[75176]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 28 15:41:39 user nova-compute[75176]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 28 15:41:39 user nova-compute[75176]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 28 15:41:39 user nova-compute[75176]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 28 15:41:39 user nova-compute[75176]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 28 15:41:39 user nova-compute[75176]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 28 15:41:39 user nova-compute[75176]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 28 15:41:39 user nova-compute[75176]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 28 15:41:39 user nova-compute[75176]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 28 15:41:39 user nova-compute[75176]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 28 15:41:39 user nova-compute[75176]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 28 15:41:39 user nova-compute[75176]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4505, in volume_snapshot_create
Nov 28 15:41:39 user nova-compute[75176]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Nov 28 15:41:39 user nova-compute[75176]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3597, in volume_snapshot_create
Nov 28 15:41:39 user nova-compute[75176]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 28 15:41:39 user nova-compute[75176]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 28 15:41:39 user nova-compute[75176]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 28 15:41:39 user nova-compute[75176]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 28 15:41:39 user nova-compute[75176]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 28 15:41:39 user nova-compute[75176]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 28 15:41:39 user nova-compute[75176]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Nov 28 15:41:39 user nova-compute[75176]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 28 15:41:39 user nova-compute[75176]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 28 15:41:39 user nova-compute[75176]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 28 15:41:39 user nova-compute[75176]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 28 15:41:39 user nova-compute[75176]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 28 15:41:39 user nova-compute[75176]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 28 15:41:39 user nova-compute[75176]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 28 15:41:39 user nova-compute[75176]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Nov 28 15:41:39 user nova-compute[75176]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 28 15:41:39 user nova-compute[75176]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Nov 28 15:41:39 user nova-compute[75176]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 28 15:41:39 user nova-compute[75176]: ERROR oslo_messaging.rpc.server     raise value
Nov 28 15:41:39 user nova-compute[75176]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 28 15:41:39 user nova-compute[75176]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Nov 28 15:41:39 user nova-compute[75176]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 28 15:41:39 user nova-compute[75176]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 28 15:41:39 user nova-compute[75176]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 28 15:41:39 user nova-compute[75176]: ERROR oslo_messaging.rpc.server 
Nov 28 15:41:39 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7cdc348f-cb18-4af3-afbd-6e884b995494 tempest-VolumesAssistedSnapshotsTest-1324886908 tempest-VolumesAssistedSnapshotsTest-1324886908-project-admin] Acquiring lock "1d99de1a-8a82-447a-8a18-02e4efd3b3f0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:41:39 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7cdc348f-cb18-4af3-afbd-6e884b995494 tempest-VolumesAssistedSnapshotsTest-1324886908 tempest-VolumesAssistedSnapshotsTest-1324886908-project-admin] Lock "1d99de1a-8a82-447a-8a18-02e4efd3b3f0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:41:39 user nova-compute[75176]: INFO nova.compute.manager [None req-7cdc348f-cb18-4af3-afbd-6e884b995494 tempest-VolumesAssistedSnapshotsTest-1324886908 tempest-VolumesAssistedSnapshotsTest-1324886908-project-admin] [instance: 1d99de1a-8a82-447a-8a18-02e4efd3b3f0] Detaching volume ff70e82d-37da-4392-b25a-e9b80992af80
Nov 28 15:41:39 user nova-compute[75176]: INFO nova.virt.block_device [None req-7cdc348f-cb18-4af3-afbd-6e884b995494 tempest-VolumesAssistedSnapshotsTest-1324886908 tempest-VolumesAssistedSnapshotsTest-1324886908-project-admin] [instance: 1d99de1a-8a82-447a-8a18-02e4efd3b3f0] Attempting to driver detach volume ff70e82d-37da-4392-b25a-e9b80992af80 from mountpoint /dev/vdb
Nov 28 15:41:39 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-7cdc348f-cb18-4af3-afbd-6e884b995494 tempest-VolumesAssistedSnapshotsTest-1324886908 tempest-VolumesAssistedSnapshotsTest-1324886908-project-admin] Attempting to detach device vdb from instance 1d99de1a-8a82-447a-8a18-02e4efd3b3f0 from the persistent domain config. {{(pid=75176) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 15:41:39 user nova-compute[75176]: DEBUG nova.virt.libvirt.guest [None req-7cdc348f-cb18-4af3-afbd-6e884b995494 tempest-VolumesAssistedSnapshotsTest-1324886908 tempest-VolumesAssistedSnapshotsTest-1324886908-project-admin] detach device xml: <disk type="block" device="disk">
Nov 28 15:41:39 user nova-compute[75176]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 15:41:39 user nova-compute[75176]:   <source dev="/dev/sdk"/>
Nov 28 15:41:39 user nova-compute[75176]:   <target dev="vdb" bus="virtio"/>
Nov 28 15:41:39 user nova-compute[75176]:   <serial>ff70e82d-37da-4392-b25a-e9b80992af80</serial>
Nov 28 15:41:39 user nova-compute[75176]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 15:41:39 user nova-compute[75176]: </disk>
Nov 28 15:41:39 user nova-compute[75176]:  {{(pid=75176) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 15:41:39 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-7cdc348f-cb18-4af3-afbd-6e884b995494 tempest-VolumesAssistedSnapshotsTest-1324886908 tempest-VolumesAssistedSnapshotsTest-1324886908-project-admin] Successfully detached device vdb from instance 1d99de1a-8a82-447a-8a18-02e4efd3b3f0 from the persistent domain config.
Nov 28 15:41:39 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-7cdc348f-cb18-4af3-afbd-6e884b995494 tempest-VolumesAssistedSnapshotsTest-1324886908 tempest-VolumesAssistedSnapshotsTest-1324886908-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 1d99de1a-8a82-447a-8a18-02e4efd3b3f0 from the live domain config. {{(pid=75176) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 15:41:39 user nova-compute[75176]: DEBUG nova.virt.libvirt.guest [None req-7cdc348f-cb18-4af3-afbd-6e884b995494 tempest-VolumesAssistedSnapshotsTest-1324886908 tempest-VolumesAssistedSnapshotsTest-1324886908-project-admin] detach device xml: <disk type="block" device="disk">
Nov 28 15:41:39 user nova-compute[75176]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 15:41:39 user nova-compute[75176]:   <source dev="/dev/sdk"/>
Nov 28 15:41:39 user nova-compute[75176]:   <target dev="vdb" bus="virtio"/>
Nov 28 15:41:39 user nova-compute[75176]:   <serial>ff70e82d-37da-4392-b25a-e9b80992af80</serial>
Nov 28 15:41:39 user nova-compute[75176]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 15:41:39 user nova-compute[75176]: </disk>
Nov 28 15:41:39 user nova-compute[75176]:  {{(pid=75176) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 15:41:39 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-7cdc348f-cb18-4af3-afbd-6e884b995494 tempest-VolumesAssistedSnapshotsTest-1324886908 tempest-VolumesAssistedSnapshotsTest-1324886908-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 1d99de1a-8a82-447a-8a18-02e4efd3b3f0 {{(pid=75176) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 15:41:43 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:44 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:44 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:41:46 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:41:47 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-d0913eec-b913-4ec0-8c8d-fbb0bc616891 tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 5b18c889-7694-4edf-8cf2-b9032e60289e is timed out.
Nov 28 15:41:47 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-d0913eec-b913-4ec0-8c8d-fbb0bc616891 tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] Successfully detached device vdb from instance 5b18c889-7694-4edf-8cf2-b9032e60289e from the live domain config.
Nov 28 15:41:47 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d0913eec-b913-4ec0-8c8d-fbb0bc616891 tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] [instance: 5b18c889-7694-4edf-8cf2-b9032e60289e] calling os-brick to detach iSCSI Volume {{(pid=75176) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 15:41:47 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0913eec-b913-4ec0-8c8d-fbb0bc616891 tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c1b8a00>, {'target_iqn': 'iqn.2010-10.org.openstack:a1d37820-ff6e-4bc6-a564-582b18c0beb2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IoOwFjpU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 15:41:47 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-d0913eec-b913-4ec0-8c8d-fbb0bc616891 tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 15:41:47 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-d0913eec-b913-4ec0-8c8d-fbb0bc616891 tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 15:41:47 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-d0913eec-b913-4ec0-8c8d-fbb0bc616891 tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 15:41:47 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:41:47 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:41:47 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[74c53f88-8fb5-4a66-9d1f-5c3ca2cde514]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a1d37820-ff6e-4bc6-a564-582b18c0beb2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:560d9b0e-d506-4723-8fc3-4068d690d5c8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:763d605d-247d-4484-b7ec-762e36b92abc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:27720cbf-c8ad-486b-845d-cdff5fbc4772\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:81326542-482f-4d50-895c-13c65fe4daf7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:76ea4d3b-7c77-47d0-b48b-ad79886d4f9a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ff70e82d-37da-4392-b25a-e9b80992af80\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3f34a214-dc9b-45b2-b64c-66c29fb2081a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6e691257-74a3-4fef-9fd1-67d2ba725039\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0dba49e9-5e6e-4896-b644-66558707591d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:41:47 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0913eec-b913-4ec0-8c8d-fbb0bc616891 tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 15:41:47 user nova-compute[75176]: No targets found.
Nov 28 15:41:47 user nova-compute[75176]: iSNS:
Nov 28 15:41:47 user nova-compute[75176]: No targets found.
Nov 28 15:41:47 user nova-compute[75176]: STATIC:
Nov 28 15:41:47 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:a1d37820-ff6e-4bc6-a564-582b18c0beb2
Nov 28 15:41:47 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:41:47 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:41:47 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:560d9b0e-d506-4723-8fc3-4068d690d5c8
Nov 28 15:41:47 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:41:47 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:41:47 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:763d605d-247d-4484-b7ec-762e36b92abc
Nov 28 15:41:47 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:41:47 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:41:47 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:27720cbf-c8ad-486b-845d-cdff5fbc4772
Nov 28 15:41:47 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:41:47 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:41:47 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:81326542-482f-4d50-895c-13c65fe4daf7
Nov 28 15:41:47 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:41:47 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:41:47 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:76ea4d3b-7c77-47d0-b48b-ad79886d4f9a
Nov 28 15:41:47 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:41:47 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:41:47 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:ff70e82d-37da-4392-b25a-e9b80992af80
Nov 28 15:41:47 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:41:47 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:41:47 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:3f34a214-dc9b-45b2-b64c-66c29fb2081a
Nov 28 15:41:47 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:41:47 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:41:47 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:6e691257-74a3-4fef-9fd1-67d2ba725039
Nov 28 15:41:47 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:41:47 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:41:47 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9
Nov 28 15:41:47 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:41:47 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:41:47 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:0dba49e9-5e6e-4896-b644-66558707591d
Nov 28 15:41:47 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:41:47 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:41:47 user nova-compute[75176]: FIRMWARE:
Nov 28 15:41:47 user nova-compute[75176]: No targets found.
Nov 28 15:41:47 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:41:47 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0913eec-b913-4ec0-8c8d-fbb0bc616891 tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 15:41:47 user nova-compute[75176]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 15:41:47 user nova-compute[75176]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75176) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 15:41:47 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0913eec-b913-4ec0-8c8d-fbb0bc616891 tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a1d37820-ff6e-4bc6-a564-582b18c0beb2', 0)] {{(pid=75176) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 15:41:47 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:41:47 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:41:47 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[4476f129-a14d-4eca-a000-3faa50801d17]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0dba49e9-5e6e-4896-b644-66558707591d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:27720cbf-c8ad-486b-845d-cdff5fbc4772\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3f34a214-dc9b-45b2-b64c-66c29fb2081a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:560d9b0e-d506-4723-8fc3-4068d690d5c8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e691257-74a3-4fef-9fd1-67d2ba725039\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:763d605d-247d-4484-b7ec-762e36b92abc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:76ea4d3b-7c77-47d0-b48b-ad79886d4f9a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:81326542-482f-4d50-895c-13c65fe4daf7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a1d37820-ff6e-4bc6-a564-582b18c0beb2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ff70e82d-37da-4392-b25a-e9b80992af80\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:41:47 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:41:47 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:41:47 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[98947ba2-e3c6-4dde-ad5c-da1ad8bea6ad]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1d37820-ff6e-4bc6-a564-582b18c0beb2 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f34a214-dc9b-45b2-b64c-66c29fb2081a (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dba49e9-5e6e-4896-b644-66558707591d (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff70e82d-37da-4392-b25a-e9b80992af80 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81326542-482f-4d50-895c-13c65fe4daf7 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76ea4d3b-7c77-47d0-b48b-ad79886d4f9a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27720cbf-c8ad-486b-845d-cdff5fbc4772 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:560d9b0e-d506-4723-8fc3-4068d690d5c8 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e691257-74a3-4fef-9fd1-67d2ba725039 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:763d605d-247d-4484-b7ec-762e36b92abc (non-flash)\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:41:47 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0913eec-b913-4ec0-8c8d-fbb0bc616891 tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1d37820-ff6e-4bc6-a564-582b18c0beb2 (non-flash)
Nov 28 15:41:47 user nova-compute[75176]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f34a214-dc9b-45b2-b64c-66c29fb2081a (non-flash)
Nov 28 15:41:47 user nova-compute[75176]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dba49e9-5e6e-4896-b644-66558707591d (non-flash)
Nov 28 15:41:47 user nova-compute[75176]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff70e82d-37da-4392-b25a-e9b80992af80 (non-flash)
Nov 28 15:41:47 user nova-compute[75176]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9 (non-flash)
Nov 28 15:41:47 user nova-compute[75176]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81326542-482f-4d50-895c-13c65fe4daf7 (non-flash)
Nov 28 15:41:47 user nova-compute[75176]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76ea4d3b-7c77-47d0-b48b-ad79886d4f9a (non-flash)
Nov 28 15:41:47 user nova-compute[75176]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27720cbf-c8ad-486b-845d-cdff5fbc4772 (non-flash)
Nov 28 15:41:47 user nova-compute[75176]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:560d9b0e-d506-4723-8fc3-4068d690d5c8 (non-flash)
Nov 28 15:41:47 user nova-compute[75176]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e691257-74a3-4fef-9fd1-67d2ba725039 (non-flash)
Nov 28 15:41:47 user nova-compute[75176]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:763d605d-247d-4484-b7ec-762e36b92abc (non-flash)
Nov 28 15:41:47 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:41:47 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0913eec-b913-4ec0-8c8d-fbb0bc616891 tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1d37820-ff6e-4bc6-a564-582b18c0beb2 (non-flash)
Nov 28 15:41:47 user nova-compute[75176]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f34a214-dc9b-45b2-b64c-66c29fb2081a (non-flash)
Nov 28 15:41:47 user nova-compute[75176]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dba49e9-5e6e-4896-b644-66558707591d (non-flash)
Nov 28 15:41:47 user nova-compute[75176]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff70e82d-37da-4392-b25a-e9b80992af80 (non-flash)
Nov 28 15:41:47 user nova-compute[75176]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9 (non-flash)
Nov 28 15:41:47 user nova-compute[75176]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81326542-482f-4d50-895c-13c65fe4daf7 (non-flash)
Nov 28 15:41:47 user nova-compute[75176]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76ea4d3b-7c77-47d0-b48b-ad79886d4f9a (non-flash)
Nov 28 15:41:47 user nova-compute[75176]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27720cbf-c8ad-486b-845d-cdff5fbc4772 (non-flash)
Nov 28 15:41:47 user nova-compute[75176]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:560d9b0e-d506-4723-8fc3-4068d690d5c8 (non-flash)
Nov 28 15:41:47 user nova-compute[75176]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e691257-74a3-4fef-9fd1-67d2ba725039 (non-flash)
Nov 28 15:41:47 user nova-compute[75176]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:763d605d-247d-4484-b7ec-762e36b92abc (non-flash)
Nov 28 15:41:47 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 15:41:47 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0913eec-b913-4ec0-8c8d-fbb0bc616891 tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f464c3d72e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a1d37820-ff6e-4bc6-a564-582b18c0beb2'): ({'sdi'}, set())}) {{(pid=75176) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 15:41:47 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-d0913eec-b913-4ec0-8c8d-fbb0bc616891 tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] Removing single pathed devices sdi {{(pid=75176) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 15:41:47 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:41:47 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:41:47 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e61cc58-d8ae-43be-92e0-22fb64c69c98]: (4, ('path checker states:\nup                  11\n\npaths: 0\nbusy: False\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:41:47 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:41:47 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.019s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:41:47 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[e08880b0-51d5-4185-8900-ab66f09e4088]: (4, ('ok\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:41:47 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-d0913eec-b913-4ec0-8c8d-fbb0bc616891 tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] Flushing IO for device /dev/sdi {{(pid=75176) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 15:41:47 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:41:47 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.012s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:41:47 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d523047-ee84-4da3-b9c1-3e2a1ba02ba9]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:41:47 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-d0913eec-b913-4ec0-8c8d-fbb0bc616891 tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=75176) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 15:41:47 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:41:47 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.044s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:41:47 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f7ec164-e749-4e90-a642-ae00a6a4d2c1]: (4, ('1', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:41:47 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-d0913eec-b913-4ec0-8c8d-fbb0bc616891 tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=75176) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 15:41:47 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-d0913eec-b913-4ec0-8c8d-fbb0bc616891 tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] SCSI volumes sdi have been removed. {{(pid=75176) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 15:41:47 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0913eec-b913-4ec0-8c8d-fbb0bc616891 tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a1d37820-ff6e-4bc6-a564-582b18c0beb2')] {{(pid=75176) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 15:41:47 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1d37820-ff6e-4bc6-a564-582b18c0beb2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:41:47 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1d37820-ff6e-4bc6-a564-582b18c0beb2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:41:47 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d4750fa-3a60-4d59-9825-659f1d426716]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:41:47 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0913eec-b913-4ec0-8c8d-fbb0bc616891 tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:41:47 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1d37820-ff6e-4bc6-a564-582b18c0beb2 -p 172.16.0.220:3260 --logout {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:41:47 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:41:47 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1d37820-ff6e-4bc6-a564-582b18c0beb2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.233s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:41:47 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[d767b0ce-17bb-49ca-bc9e-4d1f132aac9e]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:a1d37820-ff6e-4bc6-a564-582b18c0beb2, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:a1d37820-ff6e-4bc6-a564-582b18c0beb2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:41:47 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0913eec-b913-4ec0-8c8d-fbb0bc616891 tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:a1d37820-ff6e-4bc6-a564-582b18c0beb2, portal: 172.16.0.220,3260]
Nov 28 15:41:47 user nova-compute[75176]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:a1d37820-ff6e-4bc6-a564-582b18c0beb2, portal: 172.16.0.220,3260] successful.
Nov 28 15:41:47 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:41:47 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1d37820-ff6e-4bc6-a564-582b18c0beb2 -p 172.16.0.220:3260 --op delete {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:41:47 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1d37820-ff6e-4bc6-a564-582b18c0beb2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.042s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:41:47 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[28e191fc-592b-463a-933d-d999f6f2a2fe]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:41:47 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0913eec-b913-4ec0-8c8d-fbb0bc616891 tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:41:47 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-d0913eec-b913-4ec0-8c8d-fbb0bc616891 tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.513s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 15:41:47 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0913eec-b913-4ec0-8c8d-fbb0bc616891 tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] <== disconnect_volume: return (514ms) None {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 15:41:47 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d0913eec-b913-4ec0-8c8d-fbb0bc616891 tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] [instance: 5b18c889-7694-4edf-8cf2-b9032e60289e] Disconnected iSCSI Volume {{(pid=75176) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 15:41:48 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:48 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:41:48 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:41:48 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75176) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 15:41:48 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:41:48 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:41:48 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:41:48 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:41:48 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Auditing locally available compute resources for user (node: user) {{(pid=75176) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 15:41:49 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:49 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2e25e19-c832-4945-9257-64e6103feb0c/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:41:49 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2e25e19-c832-4945-9257-64e6103feb0c/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:41:49 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2e25e19-c832-4945-9257-64e6103feb0c/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:41:49 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2e25e19-c832-4945-9257-64e6103feb0c/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:41:49 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e8507b7-fccf-4196-b589-bf2b74f165ec/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:41:49 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e8507b7-fccf-4196-b589-bf2b74f165ec/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:41:49 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e8507b7-fccf-4196-b589-bf2b74f165ec/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:41:49 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e8507b7-fccf-4196-b589-bf2b74f165ec/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:41:49 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75176) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 15:41:49 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75176) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 15:41:49 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] skipping disk /dev/sdh (vdc) as it is a volume {{(pid=75176) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 15:41:49 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75176) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 15:41:49 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75176) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 15:41:49 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=75176) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 15:41:49 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d99de1a-8a82-447a-8a18-02e4efd3b3f0/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:41:49 user nova-compute[75176]: DEBUG nova.objects.instance [None req-d0913eec-b913-4ec0-8c8d-fbb0bc616891 tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] Lazy-loading 'flavor' on Instance uuid 5b18c889-7694-4edf-8cf2-b9032e60289e {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:41:49 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-d0913eec-b913-4ec0-8c8d-fbb0bc616891 tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] Lock "5b18c889-7694-4edf-8cf2-b9032e60289e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 23.335s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:41:50 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d99de1a-8a82-447a-8a18-02e4efd3b3f0/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:41:50 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d99de1a-8a82-447a-8a18-02e4efd3b3f0/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:41:50 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d99de1a-8a82-447a-8a18-02e4efd3b3f0/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:41:50 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b18c889-7694-4edf-8cf2-b9032e60289e/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:41:50 user nova-compute[75176]: DEBUG nova.compute.manager [req-1a9e6857-7b6c-4ea5-a967-6533340b7109 req-0f5648c5-372a-4037-a64d-7ae8cdc43cd8 service nova] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] Received event network-changed-99a8dbf9-5502-440a-a03d-cd52337b3009 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:41:50 user nova-compute[75176]: DEBUG nova.compute.manager [req-1a9e6857-7b6c-4ea5-a967-6533340b7109 req-0f5648c5-372a-4037-a64d-7ae8cdc43cd8 service nova] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] Refreshing instance network info cache due to event network-changed-99a8dbf9-5502-440a-a03d-cd52337b3009. {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 15:41:50 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-1a9e6857-7b6c-4ea5-a967-6533340b7109 req-0f5648c5-372a-4037-a64d-7ae8cdc43cd8 service nova] Acquiring lock "refresh_cache-041af768-197b-4c76-a5a1-28e2dc8255bd" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:41:50 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-1a9e6857-7b6c-4ea5-a967-6533340b7109 req-0f5648c5-372a-4037-a64d-7ae8cdc43cd8 service nova] Acquired lock "refresh_cache-041af768-197b-4c76-a5a1-28e2dc8255bd" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:41:50 user nova-compute[75176]: DEBUG nova.network.neutron [req-1a9e6857-7b6c-4ea5-a967-6533340b7109 req-0f5648c5-372a-4037-a64d-7ae8cdc43cd8 service nova] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] Refreshing network info cache for port 99a8dbf9-5502-440a-a03d-cd52337b3009 {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 15:41:50 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b18c889-7694-4edf-8cf2-b9032e60289e/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:41:50 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b18c889-7694-4edf-8cf2-b9032e60289e/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:41:50 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b18c889-7694-4edf-8cf2-b9032e60289e/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:41:50 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa223c49-d254-4727-8a01-873026847b37/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:41:50 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa223c49-d254-4727-8a01-873026847b37/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:41:50 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa223c49-d254-4727-8a01-873026847b37/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:41:50 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa223c49-d254-4727-8a01-873026847b37/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:41:50 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ab0619f-72e5-4975-ade8-53d7c0784d89/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:41:51 user nova-compute[75176]: DEBUG nova.network.neutron [req-1a9e6857-7b6c-4ea5-a967-6533340b7109 req-0f5648c5-372a-4037-a64d-7ae8cdc43cd8 service nova] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] Updated VIF entry in instance network info cache for port 99a8dbf9-5502-440a-a03d-cd52337b3009. {{(pid=75176) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 15:41:51 user nova-compute[75176]: DEBUG nova.network.neutron [req-1a9e6857-7b6c-4ea5-a967-6533340b7109 req-0f5648c5-372a-4037-a64d-7ae8cdc43cd8 service nova] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] Updating instance_info_cache with network_info: [{"id": "99a8dbf9-5502-440a-a03d-cd52337b3009", "address": "fa:16:3e:e2:26:17", "network": {"id": "9fe0d7b7-e9dc-4e03-a401-452fd502c940", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1675540815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfdec2abaf704a1396611ff1bcb96e53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99a8dbf9-55", "ovs_interfaceid": "99a8dbf9-5502-440a-a03d-cd52337b3009", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6c94b138-6202-4fb7-92c7-b3744cd8d19d", "address": "fa:16:3e:09:2f:ed", "network": {"id": "d7dbc9c3-816f-46fb-a3d3-e0e817e15de3", "bridge": "br-int", "label": "tempest-device-tagging-net1-136440967", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfdec2abaf704a1396611ff1bcb96e53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c94b138-62", "ovs_interfaceid": "6c94b138-6202-4fb7-92c7-b3744cd8d19d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0ac967e7-41bc-4751-a2bc-499ffbface15", "address": "fa:16:3e:ce:ed:17", "network": {"id": "d7dbc9c3-816f-46fb-a3d3-e0e817e15de3", "bridge": "br-int", "label": "tempest-device-tagging-net1-136440967", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.48", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfdec2abaf704a1396611ff1bcb96e53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ac967e7-41", "ovs_interfaceid": "0ac967e7-41bc-4751-a2bc-499ffbface15", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3a800e7a-5628-4668-ae3e-d49b537f7a62", "address": "fa:16:3e:e0:28:72", "network": {"id": "d7dbc9c3-816f-46fb-a3d3-e0e817e15de3", "bridge": "br-int", "label": "tempest-device-tagging-net1-136440967", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.25", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfdec2abaf704a1396611ff1bcb96e53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a800e7a-56", "ovs_interfaceid": "3a800e7a-5628-4668-ae3e-d49b537f7a62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d9a60043-45d0-46f1-8d0f-ad1c7b55fa06", "address": "fa:16:3e:5c:fb:31", "network": {"id": "d7dbc9c3-816f-46fb-a3d3-e0e817e15de3", "bridge": "br-int", "label": "tempest-device-tagging-net1-136440967", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.54", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfdec2abaf704a1396611ff1bcb96e53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9a60043-45", "ovs_interfaceid": "d9a60043-45d0-46f1-8d0f-ad1c7b55fa06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0c65b96a-0fce-4bff-b89c-443cc48f6995", "address": "fa:16:3e:c4:dc:af", "network": {"id": "6a9822be-add5-4d71-8ef1-1ce105eed6af", "bridge": "br-int", "label": "tempest-device-tagging-net2-401277966", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cfdec2abaf704a1396611ff1bcb96e53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c65b96a-0f", "ovs_interfaceid": "0c65b96a-0fce-4bff-b89c-443cc48f6995", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2df03152-b1aa-4794-965d-64886ac889ea", "address": "fa:16:3e:7a:2f:2c", "network": {"id": "6a9822be-add5-4d71-8ef1-1ce105eed6af", "bridge": "br-int", "label": "tempest-device-tagging-net2-401277966", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cfdec2abaf704a1396611ff1bcb96e53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2df03152-b1", "ovs_interfaceid": "2df03152-b1aa-4794-965d-64886ac889ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:41:51 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-1a9e6857-7b6c-4ea5-a967-6533340b7109 req-0f5648c5-372a-4037-a64d-7ae8cdc43cd8 service nova] Releasing lock "refresh_cache-041af768-197b-4c76-a5a1-28e2dc8255bd" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:41:51 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ab0619f-72e5-4975-ade8-53d7c0784d89/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:41:51 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ab0619f-72e5-4975-ade8-53d7c0784d89/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:41:51 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ab0619f-72e5-4975-ade8-53d7c0784d89/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:41:51 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47306d53-9ad7-4cae-ba6d-1f65239ef30f/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:41:51 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47306d53-9ad7-4cae-ba6d-1f65239ef30f/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:41:51 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47306d53-9ad7-4cae-ba6d-1f65239ef30f/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:41:51 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47306d53-9ad7-4cae-ba6d-1f65239ef30f/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:41:51 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ed0eb85-e975-446c-8da7-148a4bb36958/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:41:51 user nova-compute[75176]: DEBUG nova.compute.manager [req-c40e5dd9-3bda-442e-8465-b1850c720249 req-ff5f1dce-1bf1-474c-a317-d310e9a52129 service nova] [instance: 916b82eb-97e8-411c-a8ea-8c27d101b48e] Received event volume-reimaged-ec90fb93-901a-43ab-ba96-58f9505953e9 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:41:51 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-c40e5dd9-3bda-442e-8465-b1850c720249 req-ff5f1dce-1bf1-474c-a317-d310e9a52129 service nova] Acquiring lock "916b82eb-97e8-411c-a8ea-8c27d101b48e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:41:51 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-c40e5dd9-3bda-442e-8465-b1850c720249 req-ff5f1dce-1bf1-474c-a317-d310e9a52129 service nova] Lock "916b82eb-97e8-411c-a8ea-8c27d101b48e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:41:51 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-c40e5dd9-3bda-442e-8465-b1850c720249 req-ff5f1dce-1bf1-474c-a317-d310e9a52129 service nova] Lock "916b82eb-97e8-411c-a8ea-8c27d101b48e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:41:51 user nova-compute[75176]: DEBUG nova.compute.manager [req-c40e5dd9-3bda-442e-8465-b1850c720249 req-ff5f1dce-1bf1-474c-a317-d310e9a52129 service nova] [instance: 916b82eb-97e8-411c-a8ea-8c27d101b48e] Processing event volume-reimaged-ec90fb93-901a-43ab-ba96-58f9505953e9 {{(pid=75176) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10872}}
Nov 28 15:41:51 user nova-compute[75176]: DEBUG nova.compute.manager [None req-c40e5dd9-3bda-442e-8465-b1850c720249 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] [instance: 916b82eb-97e8-411c-a8ea-8c27d101b48e] Instance event wait completed in 18 seconds for volume-reimaged {{(pid=75176) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 15:41:51 user nova-compute[75176]: INFO nova.virt.block_device [None req-c40e5dd9-3bda-442e-8465-b1850c720249 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] [instance: 916b82eb-97e8-411c-a8ea-8c27d101b48e] Booting with volume ec90fb93-901a-43ab-ba96-58f9505953e9 at /dev/vda
Nov 28 15:41:51 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ed0eb85-e975-446c-8da7-148a4bb36958/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:41:51 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ed0eb85-e975-446c-8da7-148a4bb36958/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:41:51 user nova-compute[75176]: DEBUG os_brick.utils [None req-c40e5dd9-3bda-442e-8465-b1850c720249 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 15:41:51 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:41:51 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:41:51 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b76e5b5-5671-4fc3-b4cf-d901a30d9cc9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:edc924a949b2\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:41:51 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:41:52 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:41:52 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0a493e0-ae30-4d68-a406-9cac3de4b64b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:41:52 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:41:52 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:41:52 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[249fae13-d1c4-4a76-98a2-518de7cf24ef]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:41:52 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d0825d1-8408-488d-8bf5-43d9df3c8118]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:41:52 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-c40e5dd9-3bda-442e-8465-b1850c720249 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] Running cmd (subprocess): nvme version {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:41:52 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-c40e5dd9-3bda-442e-8465-b1850c720249 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] 'nvme version' failed. Not Retrying. {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 15:41:52 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c40e5dd9-3bda-442e-8465-b1850c720249 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] nvme not present on system {{(pid=75176) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 15:41:52 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:41:52 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 15:41:52 user nova-compute[75176]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 15:41:52 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[60414370-18a0-4695-a314-4f2656997feb]: (4, '') {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:41:52 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.lightos [None req-c40e5dd9-3bda-442e-8465-b1850c720249 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75176) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 15:41:52 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.lightos [None req-c40e5dd9-3bda-442e-8465-b1850c720249 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75176) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 15:41:52 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.lightos [None req-c40e5dd9-3bda-442e-8465-b1850c720249 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] LIGHTOS: no hostnqn found. {{(pid=75176) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 15:41:52 user nova-compute[75176]: DEBUG os_brick.utils [None req-c40e5dd9-3bda-442e-8465-b1850c720249 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:edc924a949b2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 15:41:52 user nova-compute[75176]: DEBUG nova.virt.block_device [None req-c40e5dd9-3bda-442e-8465-b1850c720249 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] [instance: 916b82eb-97e8-411c-a8ea-8c27d101b48e] Updating existing volume attachment record: cf4f91b9-5953-4d4d-a876-8cbbed325399 {{(pid=75176) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 15:41:52 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ed0eb85-e975-446c-8da7-148a4bb36958/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:41:52 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-c76a39ee-2d2c-42cd-b237-920e258bf13f tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] Waiting for libvirt event about the detach of device sdc with device alias scsi0-0-0-2 from instance 4ed0eb85-e975-446c-8da7-148a4bb36958 is timed out.
Nov 28 15:41:52 user nova-compute[75176]: DEBUG nova.compute.manager [req-ed71f32b-e5b1-4910-953d-6ec052004f8a req-0498a9bc-b73e-403f-b86d-6bfd3fc4906a service nova] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] Received event network-changed-da7d30e5-6304-46ec-8d50-336986e6262f {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:41:52 user nova-compute[75176]: DEBUG nova.compute.manager [req-ed71f32b-e5b1-4910-953d-6ec052004f8a req-0498a9bc-b73e-403f-b86d-6bfd3fc4906a service nova] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] Refreshing instance network info cache due to event network-changed-da7d30e5-6304-46ec-8d50-336986e6262f. {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 15:41:52 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-ed71f32b-e5b1-4910-953d-6ec052004f8a req-0498a9bc-b73e-403f-b86d-6bfd3fc4906a service nova] Acquiring lock "refresh_cache-b714fb94-fcc7-40ae-b3a9-d8c9a60008f1" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:41:52 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-ed71f32b-e5b1-4910-953d-6ec052004f8a req-0498a9bc-b73e-403f-b86d-6bfd3fc4906a service nova] Acquired lock "refresh_cache-b714fb94-fcc7-40ae-b3a9-d8c9a60008f1" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:41:52 user nova-compute[75176]: DEBUG nova.network.neutron [req-ed71f32b-e5b1-4910-953d-6ec052004f8a req-0498a9bc-b73e-403f-b86d-6bfd3fc4906a service nova] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] Refreshing network info cache for port da7d30e5-6304-46ec-8d50-336986e6262f {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 15:41:52 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-c76a39ee-2d2c-42cd-b237-920e258bf13f tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] Successfully detached device sdc from instance 4ed0eb85-e975-446c-8da7-148a4bb36958 from the live domain config.
Nov 28 15:41:52 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c76a39ee-2d2c-42cd-b237-920e258bf13f tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] [instance: 4ed0eb85-e975-446c-8da7-148a4bb36958] calling os-brick to detach iSCSI Volume {{(pid=75176) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 15:41:52 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-c76a39ee-2d2c-42cd-b237-920e258bf13f tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c1b8a00>, {'target_iqn': 'iqn.2010-10.org.openstack:3f34a214-dc9b-45b2-b64c-66c29fb2081a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rCPmRvQZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, None), 'kwargs': False}}" {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 15:41:52 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-c76a39ee-2d2c-42cd-b237-920e258bf13f tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 15:41:52 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-c76a39ee-2d2c-42cd-b237-920e258bf13f tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 15:41:52 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-c76a39ee-2d2c-42cd-b237-920e258bf13f tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 15:41:52 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:41:52 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 15:41:52 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 15:41:52 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Hypervisor/Node resource view: name=user free_ram=7110MB free_disk=25.389339447021484GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75176) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 15:41:52 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:41:52 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:41:52 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:41:52 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[69975f61-3fbc-413d-859e-09804231a8f9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:560d9b0e-d506-4723-8fc3-4068d690d5c8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:763d605d-247d-4484-b7ec-762e36b92abc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:27720cbf-c8ad-486b-845d-cdff5fbc4772\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:81326542-482f-4d50-895c-13c65fe4daf7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:76ea4d3b-7c77-47d0-b48b-ad79886d4f9a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ff70e82d-37da-4392-b25a-e9b80992af80\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3f34a214-dc9b-45b2-b64c-66c29fb2081a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6e691257-74a3-4fef-9fd1-67d2ba725039\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0dba49e9-5e6e-4896-b644-66558707591d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:41:52 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-c76a39ee-2d2c-42cd-b237-920e258bf13f tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 15:41:52 user nova-compute[75176]: No targets found.
Nov 28 15:41:52 user nova-compute[75176]: iSNS:
Nov 28 15:41:52 user nova-compute[75176]: No targets found.
Nov 28 15:41:52 user nova-compute[75176]: STATIC:
Nov 28 15:41:52 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:560d9b0e-d506-4723-8fc3-4068d690d5c8
Nov 28 15:41:52 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:41:52 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:41:52 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:763d605d-247d-4484-b7ec-762e36b92abc
Nov 28 15:41:52 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:41:52 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:41:52 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:27720cbf-c8ad-486b-845d-cdff5fbc4772
Nov 28 15:41:52 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:41:52 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:41:52 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:81326542-482f-4d50-895c-13c65fe4daf7
Nov 28 15:41:52 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:41:52 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:41:52 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:76ea4d3b-7c77-47d0-b48b-ad79886d4f9a
Nov 28 15:41:52 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:41:52 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:41:52 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:ff70e82d-37da-4392-b25a-e9b80992af80
Nov 28 15:41:52 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:41:52 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:41:52 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:3f34a214-dc9b-45b2-b64c-66c29fb2081a
Nov 28 15:41:52 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:41:52 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:41:52 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:6e691257-74a3-4fef-9fd1-67d2ba725039
Nov 28 15:41:52 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:41:52 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:41:52 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:0dba49e9-5e6e-4896-b644-66558707591d
Nov 28 15:41:52 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:41:52 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:41:52 user nova-compute[75176]: FIRMWARE:
Nov 28 15:41:52 user nova-compute[75176]: No targets found.
Nov 28 15:41:52 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:41:52 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-c76a39ee-2d2c-42cd-b237-920e258bf13f tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 15:41:52 user nova-compute[75176]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 15:41:52 user nova-compute[75176]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75176) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 15:41:52 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-c76a39ee-2d2c-42cd-b237-920e258bf13f tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3f34a214-dc9b-45b2-b64c-66c29fb2081a', 0)] {{(pid=75176) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 15:41:52 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:41:52 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:41:52 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[e73423c6-4774-4db0-b873-9b8fcbcb738a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0dba49e9-5e6e-4896-b644-66558707591d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:27720cbf-c8ad-486b-845d-cdff5fbc4772\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3f34a214-dc9b-45b2-b64c-66c29fb2081a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:560d9b0e-d506-4723-8fc3-4068d690d5c8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e691257-74a3-4fef-9fd1-67d2ba725039\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:763d605d-247d-4484-b7ec-762e36b92abc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:76ea4d3b-7c77-47d0-b48b-ad79886d4f9a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:81326542-482f-4d50-895c-13c65fe4daf7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ff70e82d-37da-4392-b25a-e9b80992af80\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:41:52 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:41:52 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:41:52 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[33b911f2-17c8-4e11-ad83-8327d5ef4a22]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f34a214-dc9b-45b2-b64c-66c29fb2081a (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dba49e9-5e6e-4896-b644-66558707591d (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff70e82d-37da-4392-b25a-e9b80992af80 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81326542-482f-4d50-895c-13c65fe4daf7 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76ea4d3b-7c77-47d0-b48b-ad79886d4f9a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27720cbf-c8ad-486b-845d-cdff5fbc4772 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:560d9b0e-d506-4723-8fc3-4068d690d5c8 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e691257-74a3-4fef-9fd1-67d2ba725039 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:763d605d-247d-4484-b7ec-762e36b92abc (non-flash)\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:41:52 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-c76a39ee-2d2c-42cd-b237-920e258bf13f tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f34a214-dc9b-45b2-b64c-66c29fb2081a (non-flash)
Nov 28 15:41:52 user nova-compute[75176]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dba49e9-5e6e-4896-b644-66558707591d (non-flash)
Nov 28 15:41:52 user nova-compute[75176]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff70e82d-37da-4392-b25a-e9b80992af80 (non-flash)
Nov 28 15:41:52 user nova-compute[75176]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81326542-482f-4d50-895c-13c65fe4daf7 (non-flash)
Nov 28 15:41:52 user nova-compute[75176]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76ea4d3b-7c77-47d0-b48b-ad79886d4f9a (non-flash)
Nov 28 15:41:52 user nova-compute[75176]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27720cbf-c8ad-486b-845d-cdff5fbc4772 (non-flash)
Nov 28 15:41:52 user nova-compute[75176]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:560d9b0e-d506-4723-8fc3-4068d690d5c8 (non-flash)
Nov 28 15:41:52 user nova-compute[75176]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e691257-74a3-4fef-9fd1-67d2ba725039 (non-flash)
Nov 28 15:41:52 user nova-compute[75176]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:763d605d-247d-4484-b7ec-762e36b92abc (non-flash)
Nov 28 15:41:52 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:41:52 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-c76a39ee-2d2c-42cd-b237-920e258bf13f tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f34a214-dc9b-45b2-b64c-66c29fb2081a (non-flash)
Nov 28 15:41:52 user nova-compute[75176]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dba49e9-5e6e-4896-b644-66558707591d (non-flash)
Nov 28 15:41:52 user nova-compute[75176]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff70e82d-37da-4392-b25a-e9b80992af80 (non-flash)
Nov 28 15:41:52 user nova-compute[75176]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81326542-482f-4d50-895c-13c65fe4daf7 (non-flash)
Nov 28 15:41:52 user nova-compute[75176]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76ea4d3b-7c77-47d0-b48b-ad79886d4f9a (non-flash)
Nov 28 15:41:52 user nova-compute[75176]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27720cbf-c8ad-486b-845d-cdff5fbc4772 (non-flash)
Nov 28 15:41:52 user nova-compute[75176]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:560d9b0e-d506-4723-8fc3-4068d690d5c8 (non-flash)
Nov 28 15:41:52 user nova-compute[75176]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e691257-74a3-4fef-9fd1-67d2ba725039 (non-flash)
Nov 28 15:41:52 user nova-compute[75176]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:763d605d-247d-4484-b7ec-762e36b92abc (non-flash)
Nov 28 15:41:52 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 15:41:52 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-c76a39ee-2d2c-42cd-b237-920e258bf13f tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f464c3a1360>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3f34a214-dc9b-45b2-b64c-66c29fb2081a'): ({'sdj'}, set())}) {{(pid=75176) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 15:41:52 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-c76a39ee-2d2c-42cd-b237-920e258bf13f tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] Removing single pathed devices sdj {{(pid=75176) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 15:41:52 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:41:52 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-585335e7-3eb7-4c3d-9395-77097f973761 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Acquiring lock "041af768-197b-4c76-a5a1-28e2dc8255bd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:41:52 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-585335e7-3eb7-4c3d-9395-77097f973761 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Lock "041af768-197b-4c76-a5a1-28e2dc8255bd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:41:52 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-585335e7-3eb7-4c3d-9395-77097f973761 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Acquiring lock "041af768-197b-4c76-a5a1-28e2dc8255bd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:41:52 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-585335e7-3eb7-4c3d-9395-77097f973761 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Lock "041af768-197b-4c76-a5a1-28e2dc8255bd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:41:52 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-585335e7-3eb7-4c3d-9395-77097f973761 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Lock "041af768-197b-4c76-a5a1-28e2dc8255bd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:41:52 user nova-compute[75176]: INFO nova.compute.manager [None req-585335e7-3eb7-4c3d-9395-77097f973761 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] Terminating instance
Nov 28 15:41:52 user nova-compute[75176]: DEBUG nova.compute.manager [None req-585335e7-3eb7-4c3d-9395-77097f973761 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] Start destroying the instance on the hypervisor. {{(pid=75176) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 15:41:52 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:41:52 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[04f379f1-e44d-4c80-bf7b-74436eb0fbc6]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:41:52 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:41:52 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance 6ab0619f-72e5-4975-ade8-53d7c0784d89 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:41:52 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance aa223c49-d254-4727-8a01-873026847b37 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:41:52 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance 2e8507b7-fccf-4196-b589-bf2b74f165ec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:41:52 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance 5b18c889-7694-4edf-8cf2-b9032e60289e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:41:52 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance e2e25e19-c832-4945-9257-64e6103feb0c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:41:52 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance 4ed0eb85-e975-446c-8da7-148a4bb36958 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:41:52 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance 916b82eb-97e8-411c-a8ea-8c27d101b48e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:41:52 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance 1d99de1a-8a82-447a-8a18-02e4efd3b3f0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:41:52 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance 041af768-197b-4c76-a5a1-28e2dc8255bd actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:41:52 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance b714fb94-fcc7-40ae-b3a9-d8c9a60008f1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:41:52 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance 47306d53-9ad7-4cae-ba6d-1f65239ef30f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:41:52 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75176) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 15:41:52 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75176) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 15:41:52 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.019s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:41:52 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[a20b1460-750c-481e-9258-3ce07e4c6204]: (4, ('ok\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:41:52 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-c76a39ee-2d2c-42cd-b237-920e258bf13f tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] Flushing IO for device /dev/sdj {{(pid=75176) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 15:41:52 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:41:52 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.014s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:41:52 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[30bbb37a-4e56-4aff-a278-88cd2e949d3b]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:41:52 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-c76a39ee-2d2c-42cd-b237-920e258bf13f tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=75176) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 15:41:52 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:41:52 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.067s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:41:52 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[45b3d8b5-74d7-4b80-9373-7439bb05bb72]: (4, ('1', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:41:52 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-c76a39ee-2d2c-42cd-b237-920e258bf13f tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] Checking to see if SCSI volumes sdj have been removed. {{(pid=75176) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 15:41:52 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-c76a39ee-2d2c-42cd-b237-920e258bf13f tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] SCSI volumes sdj have been removed. {{(pid=75176) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 15:41:52 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-c76a39ee-2d2c-42cd-b237-920e258bf13f tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3f34a214-dc9b-45b2-b64c-66c29fb2081a')] {{(pid=75176) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 15:41:52 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f34a214-dc9b-45b2-b64c-66c29fb2081a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:41:52 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:53 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f34a214-dc9b-45b2-b64c-66c29fb2081a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.037s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:41:53 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b77ffbb-f837-401d-b560-0c4b52e886dd]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:41:53 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-c76a39ee-2d2c-42cd-b237-920e258bf13f tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:41:53 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f34a214-dc9b-45b2-b64c-66c29fb2081a -p 172.16.0.220:3260 --logout {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:41:53 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:53 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:53 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:53 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f34a214-dc9b-45b2-b64c-66c29fb2081a -p 172.16.0.220:3260 --logout" returned: 0 in 0.123s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:41:53 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[09e026de-daef-456f-ade2-4e79005313ae]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:3f34a214-dc9b-45b2-b64c-66c29fb2081a, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:3f34a214-dc9b-45b2-b64c-66c29fb2081a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:41:53 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-c76a39ee-2d2c-42cd-b237-920e258bf13f tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:3f34a214-dc9b-45b2-b64c-66c29fb2081a, portal: 172.16.0.220,3260]
Nov 28 15:41:53 user nova-compute[75176]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:3f34a214-dc9b-45b2-b64c-66c29fb2081a, portal: 172.16.0.220,3260] successful.
Nov 28 15:41:53 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:41:53 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f34a214-dc9b-45b2-b64c-66c29fb2081a -p 172.16.0.220:3260 --op delete {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:41:53 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:53 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:53 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f34a214-dc9b-45b2-b64c-66c29fb2081a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.055s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:41:53 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[0057b2b8-ed82-4f86-8337-5d9ec4b515d1]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:41:53 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-c76a39ee-2d2c-42cd-b237-920e258bf13f tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:41:53 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-c76a39ee-2d2c-42cd-b237-920e258bf13f tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.525s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 15:41:53 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-c76a39ee-2d2c-42cd-b237-920e258bf13f tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] <== disconnect_volume: return (526ms) None {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 15:41:53 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c76a39ee-2d2c-42cd-b237-920e258bf13f tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] [instance: 4ed0eb85-e975-446c-8da7-148a4bb36958] Disconnected iSCSI Volume {{(pid=75176) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 15:41:53 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:53 user nova-compute[75176]: DEBUG nova.compute.provider_tree [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Inventory has not changed in ProviderTree for provider: b37848d8-f401-4155-a029-b0ffa09ff85b {{(pid=75176) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 15:41:53 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Inventory has not changed for provider b37848d8-f401-4155-a029-b0ffa09ff85b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75176) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 15:41:53 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:53 user nova-compute[75176]: DEBUG nova.network.neutron [req-ed71f32b-e5b1-4910-953d-6ec052004f8a req-0498a9bc-b73e-403f-b86d-6bfd3fc4906a service nova] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] Updated VIF entry in instance network info cache for port da7d30e5-6304-46ec-8d50-336986e6262f. {{(pid=75176) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 15:41:53 user nova-compute[75176]: DEBUG nova.network.neutron [req-ed71f32b-e5b1-4910-953d-6ec052004f8a req-0498a9bc-b73e-403f-b86d-6bfd3fc4906a service nova] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] Updating instance_info_cache with network_info: [{"id": "da7d30e5-6304-46ec-8d50-336986e6262f", "address": "fa:16:3e:63:83:5b", "network": {"id": "b1277b75-5749-436a-a651-3303fd60d8b4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1047877730-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0108444c01e94416984b083707102c58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda7d30e5-63", "ovs_interfaceid": "da7d30e5-6304-46ec-8d50-336986e6262f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e1ac011f-d965-4d4c-b4c8-aa9bf5201518", "address": "fa:16:3e:7f:e1:ea", "network": {"id": "26bf803a-6aa2-4e87-b407-caee3f8f7d3d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1638676687", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0108444c01e94416984b083707102c58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1ac011f-d9", "ovs_interfaceid": "e1ac011f-d965-4d4c-b4c8-aa9bf5201518", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "61157920-954a-479e-bd66-b0746a7843a7", "address": "fa:16:3e:8f:4f:39", "network": {"id": "26bf803a-6aa2-4e87-b407-caee3f8f7d3d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1638676687", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0108444c01e94416984b083707102c58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61157920-95", "ovs_interfaceid": "61157920-954a-479e-bd66-b0746a7843a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "04db431e-5bc8-4450-9bdd-82369fafba70", "address": "fa:16:3e:15:71:6f", "network": {"id": "26bf803a-6aa2-4e87-b407-caee3f8f7d3d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1638676687", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0108444c01e94416984b083707102c58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04db431e-5b", "ovs_interfaceid": "04db431e-5bc8-4450-9bdd-82369fafba70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0bc36ba8-7fc6-47b2-b7b1-08a445625b46", "address": "fa:16:3e:76:ce:76", "network": {"id": "26bf803a-6aa2-4e87-b407-caee3f8f7d3d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1638676687", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0108444c01e94416984b083707102c58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bc36ba8-7f", "ovs_interfaceid": "0bc36ba8-7fc6-47b2-b7b1-08a445625b46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0c08ccbe-f3de-4aed-b641-8e2b58bd73a0", "address": "fa:16:3e:59:54:f2", "network": {"id": "3936aa29-a691-4362-8bd9-536545b14473", "bridge": "br-int", "label": "tempest-device-tagging-net2-1089118081", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0108444c01e94416984b083707102c58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c08ccbe-f3", "ovs_interfaceid": "0c08ccbe-f3de-4aed-b641-8e2b58bd73a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e0b49239-50a0-4864-9e92-22bddcbe7d21", "address": "fa:16:3e:d8:78:24", "network": {"id": "3936aa29-a691-4362-8bd9-536545b14473", "bridge": "br-int", "label": "tempest-device-tagging-net2-1089118081", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0108444c01e94416984b083707102c58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0b49239-50", "ovs_interfaceid": "e0b49239-50a0-4864-9e92-22bddcbe7d21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:41:53 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:53 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-ed71f32b-e5b1-4910-953d-6ec052004f8a req-0498a9bc-b73e-403f-b86d-6bfd3fc4906a service nova] Releasing lock "refresh_cache-b714fb94-fcc7-40ae-b3a9-d8c9a60008f1" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:41:53 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Compute_service record updated for user:user {{(pid=75176) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 15:41:53 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.671s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:41:53 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:53 user nova-compute[75176]: DEBUG nova.compute.manager [req-9baa8e76-b724-4000-84db-913d74817c1e req-fb67236b-b4f3-4229-81c1-0a39d1c1ca66 service nova] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] Received event network-vif-unplugged-99a8dbf9-5502-440a-a03d-cd52337b3009 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:41:53 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-9baa8e76-b724-4000-84db-913d74817c1e req-fb67236b-b4f3-4229-81c1-0a39d1c1ca66 service nova] Acquiring lock "041af768-197b-4c76-a5a1-28e2dc8255bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:41:53 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-9baa8e76-b724-4000-84db-913d74817c1e req-fb67236b-b4f3-4229-81c1-0a39d1c1ca66 service nova] Lock "041af768-197b-4c76-a5a1-28e2dc8255bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:41:53 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-9baa8e76-b724-4000-84db-913d74817c1e req-fb67236b-b4f3-4229-81c1-0a39d1c1ca66 service nova] Lock "041af768-197b-4c76-a5a1-28e2dc8255bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:41:53 user nova-compute[75176]: DEBUG nova.compute.manager [req-9baa8e76-b724-4000-84db-913d74817c1e req-fb67236b-b4f3-4229-81c1-0a39d1c1ca66 service nova] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] No waiting events found dispatching network-vif-unplugged-99a8dbf9-5502-440a-a03d-cd52337b3009 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:41:53 user nova-compute[75176]: DEBUG nova.compute.manager [req-9baa8e76-b724-4000-84db-913d74817c1e req-fb67236b-b4f3-4229-81c1-0a39d1c1ca66 service nova] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] Received event network-vif-unplugged-99a8dbf9-5502-440a-a03d-cd52337b3009 for instance with task_state deleting. {{(pid=75176) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 15:41:53 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:53 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:53 user nova-compute[75176]: DEBUG nova.compute.manager [req-01c4f3ef-c11e-442d-adae-87c2cc414f26 req-b66e9b7a-bd0a-45d1-8493-3ef83d239177 service nova] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] Received event network-vif-unplugged-3a800e7a-5628-4668-ae3e-d49b537f7a62 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:41:53 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-01c4f3ef-c11e-442d-adae-87c2cc414f26 req-b66e9b7a-bd0a-45d1-8493-3ef83d239177 service nova] Acquiring lock "041af768-197b-4c76-a5a1-28e2dc8255bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:41:53 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-01c4f3ef-c11e-442d-adae-87c2cc414f26 req-b66e9b7a-bd0a-45d1-8493-3ef83d239177 service nova] Lock "041af768-197b-4c76-a5a1-28e2dc8255bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:41:53 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-01c4f3ef-c11e-442d-adae-87c2cc414f26 req-b66e9b7a-bd0a-45d1-8493-3ef83d239177 service nova] Lock "041af768-197b-4c76-a5a1-28e2dc8255bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:41:53 user nova-compute[75176]: DEBUG nova.compute.manager [req-01c4f3ef-c11e-442d-adae-87c2cc414f26 req-b66e9b7a-bd0a-45d1-8493-3ef83d239177 service nova] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] No waiting events found dispatching network-vif-unplugged-3a800e7a-5628-4668-ae3e-d49b537f7a62 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:41:53 user nova-compute[75176]: DEBUG nova.compute.manager [req-01c4f3ef-c11e-442d-adae-87c2cc414f26 req-b66e9b7a-bd0a-45d1-8493-3ef83d239177 service nova] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] Received event network-vif-unplugged-3a800e7a-5628-4668-ae3e-d49b537f7a62 for instance with task_state deleting. {{(pid=75176) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 15:41:53 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:53 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:53 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:53 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:53 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:53 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:53 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:54 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:54 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-b469a21b-cdfb-4f59-9409-786dfeb47caf tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Acquiring lock "b714fb94-fcc7-40ae-b3a9-d8c9a60008f1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:41:54 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-b469a21b-cdfb-4f59-9409-786dfeb47caf tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Lock "b714fb94-fcc7-40ae-b3a9-d8c9a60008f1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:41:54 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-b469a21b-cdfb-4f59-9409-786dfeb47caf tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Acquiring lock "b714fb94-fcc7-40ae-b3a9-d8c9a60008f1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:41:54 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-b469a21b-cdfb-4f59-9409-786dfeb47caf tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Lock "b714fb94-fcc7-40ae-b3a9-d8c9a60008f1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:41:54 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-b469a21b-cdfb-4f59-9409-786dfeb47caf tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Lock "b714fb94-fcc7-40ae-b3a9-d8c9a60008f1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:41:54 user nova-compute[75176]: INFO nova.compute.manager [None req-b469a21b-cdfb-4f59-9409-786dfeb47caf tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] Terminating instance
Nov 28 15:41:54 user nova-compute[75176]: DEBUG nova.compute.manager [None req-b469a21b-cdfb-4f59-9409-786dfeb47caf tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] Start destroying the instance on the hypervisor. {{(pid=75176) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 15:41:54 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:54 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:54 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:54 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:54 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:41:54 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Starting heal instance info cache {{(pid=75176) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 15:41:54 user nova-compute[75176]: DEBUG nova.compute.manager [req-36ed5f7b-0c32-42a5-8fce-da6de2af4410 req-888977a3-5a70-4199-8839-bf37072a82a3 service nova] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] Received event network-vif-unplugged-0ac967e7-41bc-4751-a2bc-499ffbface15 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:41:54 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-36ed5f7b-0c32-42a5-8fce-da6de2af4410 req-888977a3-5a70-4199-8839-bf37072a82a3 service nova] Acquiring lock "041af768-197b-4c76-a5a1-28e2dc8255bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:41:54 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-36ed5f7b-0c32-42a5-8fce-da6de2af4410 req-888977a3-5a70-4199-8839-bf37072a82a3 service nova] Lock "041af768-197b-4c76-a5a1-28e2dc8255bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:41:54 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-36ed5f7b-0c32-42a5-8fce-da6de2af4410 req-888977a3-5a70-4199-8839-bf37072a82a3 service nova] Lock "041af768-197b-4c76-a5a1-28e2dc8255bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:41:54 user nova-compute[75176]: DEBUG nova.compute.manager [req-36ed5f7b-0c32-42a5-8fce-da6de2af4410 req-888977a3-5a70-4199-8839-bf37072a82a3 service nova] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] No waiting events found dispatching network-vif-unplugged-0ac967e7-41bc-4751-a2bc-499ffbface15 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:41:54 user nova-compute[75176]: DEBUG nova.compute.manager [req-36ed5f7b-0c32-42a5-8fce-da6de2af4410 req-888977a3-5a70-4199-8839-bf37072a82a3 service nova] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] Received event network-vif-unplugged-0ac967e7-41bc-4751-a2bc-499ffbface15 for instance with task_state deleting. {{(pid=75176) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 15:41:54 user nova-compute[75176]: DEBUG nova.compute.manager [req-36ed5f7b-0c32-42a5-8fce-da6de2af4410 req-888977a3-5a70-4199-8839-bf37072a82a3 service nova] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] Received event network-vif-plugged-0ac967e7-41bc-4751-a2bc-499ffbface15 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:41:54 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-36ed5f7b-0c32-42a5-8fce-da6de2af4410 req-888977a3-5a70-4199-8839-bf37072a82a3 service nova] Acquiring lock "041af768-197b-4c76-a5a1-28e2dc8255bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:41:54 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-36ed5f7b-0c32-42a5-8fce-da6de2af4410 req-888977a3-5a70-4199-8839-bf37072a82a3 service nova] Lock "041af768-197b-4c76-a5a1-28e2dc8255bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:41:54 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-36ed5f7b-0c32-42a5-8fce-da6de2af4410 req-888977a3-5a70-4199-8839-bf37072a82a3 service nova] Lock "041af768-197b-4c76-a5a1-28e2dc8255bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:41:54 user nova-compute[75176]: DEBUG nova.compute.manager [req-36ed5f7b-0c32-42a5-8fce-da6de2af4410 req-888977a3-5a70-4199-8839-bf37072a82a3 service nova] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] No waiting events found dispatching network-vif-plugged-0ac967e7-41bc-4751-a2bc-499ffbface15 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:41:54 user nova-compute[75176]: WARNING nova.compute.manager [req-36ed5f7b-0c32-42a5-8fce-da6de2af4410 req-888977a3-5a70-4199-8839-bf37072a82a3 service nova] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] Received unexpected event network-vif-plugged-0ac967e7-41bc-4751-a2bc-499ffbface15 for instance with vm_state active and task_state deleting.
Nov 28 15:41:54 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:54 user nova-compute[75176]: DEBUG nova.objects.instance [None req-c76a39ee-2d2c-42cd-b237-920e258bf13f tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] Lazy-loading 'flavor' on Instance uuid 4ed0eb85-e975-446c-8da7-148a4bb36958 {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:41:54 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquiring lock "refresh_cache-aa223c49-d254-4727-8a01-873026847b37" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:41:54 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquired lock "refresh_cache-aa223c49-d254-4727-8a01-873026847b37" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:41:54 user nova-compute[75176]: DEBUG nova.network.neutron [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] [instance: aa223c49-d254-4727-8a01-873026847b37] Forcefully refreshing network info cache for instance {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 15:41:54 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-c76a39ee-2d2c-42cd-b237-920e258bf13f tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] Lock "4ed0eb85-e975-446c-8da7-148a4bb36958" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.490s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:41:54 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:54 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:54 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:54 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:55 user nova-compute[75176]: INFO nova.virt.libvirt.driver [-] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] Instance destroyed successfully.
Nov 28 15:41:55 user nova-compute[75176]: DEBUG nova.objects.instance [None req-585335e7-3eb7-4c3d-9395-77097f973761 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Lazy-loading 'resources' on Instance uuid 041af768-197b-4c76-a5a1-28e2dc8255bd {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:41:55 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-585335e7-3eb7-4c3d-9395-77097f973761 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T15:39:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1424070534',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1424070534',id=10,image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPn83B68ew19zNqtC6OrMzgf/bmXCz98qa+rH054zqhA5Gi3ZDmOGiOHPgSu1hkI/yV1KZdhZIiHhrJ1wuOhC1X2w3dTgpgbLguVyd7FUfhz3bRrtdjXABRlYuvBuQRV2A==',key_name='tempest-keypair-1772665281',keypairs=<?>,launch_index=0,launched_at=2023-11-28T15:40:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cfdec2abaf704a1396611ff1bcb96e53',ramdisk_id='',reservation_id='r-0j1w7c0x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1260942437',owner_user_name='tempest-TaggedBootDevicesTest_v242-1260942437-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T15:40:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='97e02c028b814c6993edba6c1caa8afe',uuid=041af768-197b-4c76-a5a1-28e2dc8255bd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "99a8dbf9-5502-440a-a03d-cd52337b3009", "address": "fa:16:3e:e2:26:17", "network": {"id": "9fe0d7b7-e9dc-4e03-a401-452fd502c940", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1675540815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfdec2abaf704a1396611ff1bcb96e53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99a8dbf9-55", "ovs_interfaceid": "99a8dbf9-5502-440a-a03d-cd52337b3009", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 15:41:55 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-585335e7-3eb7-4c3d-9395-77097f973761 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Converting VIF {"id": "99a8dbf9-5502-440a-a03d-cd52337b3009", "address": "fa:16:3e:e2:26:17", "network": {"id": "9fe0d7b7-e9dc-4e03-a401-452fd502c940", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1675540815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfdec2abaf704a1396611ff1bcb96e53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99a8dbf9-55", "ovs_interfaceid": "99a8dbf9-5502-440a-a03d-cd52337b3009", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:41:55 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-585335e7-3eb7-4c3d-9395-77097f973761 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e2:26:17,bridge_name='br-int',has_traffic_filtering=True,id=99a8dbf9-5502-440a-a03d-cd52337b3009,network=Network(9fe0d7b7-e9dc-4e03-a401-452fd502c940),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99a8dbf9-55') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:41:55 user nova-compute[75176]: DEBUG os_vif [None req-585335e7-3eb7-4c3d-9395-77097f973761 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e2:26:17,bridge_name='br-int',has_traffic_filtering=True,id=99a8dbf9-5502-440a-a03d-cd52337b3009,network=Network(9fe0d7b7-e9dc-4e03-a401-452fd502c940),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99a8dbf9-55') {{(pid=75176) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 15:41:55 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:55 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap99a8dbf9-55, bridge=br-int, if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:41:55 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:55 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:41:55 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:55 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:55 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:55 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:55 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:55 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c5582485-1c6c-433e-bf00-3fae13537192) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:41:55 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:55 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:41:55 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-4c851341-a4c2-4026-b00d-1e1e8ea739d0 tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] Acquiring lock "4ed0eb85-e975-446c-8da7-148a4bb36958" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:41:55 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-4c851341-a4c2-4026-b00d-1e1e8ea739d0 tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] Lock "4ed0eb85-e975-446c-8da7-148a4bb36958" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:41:55 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-4c851341-a4c2-4026-b00d-1e1e8ea739d0 tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] Acquiring lock "4ed0eb85-e975-446c-8da7-148a4bb36958-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:41:55 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-4c851341-a4c2-4026-b00d-1e1e8ea739d0 tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] Lock "4ed0eb85-e975-446c-8da7-148a4bb36958-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:41:55 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-4c851341-a4c2-4026-b00d-1e1e8ea739d0 tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] Lock "4ed0eb85-e975-446c-8da7-148a4bb36958-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:41:55 user nova-compute[75176]: INFO nova.compute.manager [None req-4c851341-a4c2-4026-b00d-1e1e8ea739d0 tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] [instance: 4ed0eb85-e975-446c-8da7-148a4bb36958] Terminating instance
Nov 28 15:41:55 user nova-compute[75176]: DEBUG nova.compute.manager [None req-4c851341-a4c2-4026-b00d-1e1e8ea739d0 tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] [instance: 4ed0eb85-e975-446c-8da7-148a4bb36958] Start destroying the instance on the hypervisor. {{(pid=75176) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 15:41:55 user nova-compute[75176]: DEBUG nova.network.neutron [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] [instance: aa223c49-d254-4727-8a01-873026847b37] Updating instance_info_cache with network_info: [{"id": "6514aeb6-8ea4-4a27-a54b-32f650c87957", "address": "fa:16:3e:ea:a6:1b", "network": {"id": "51708ad4-dae1-47fc-bd26-aca8c478ca04", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-279988751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c2fe6bf5e4f4bb3b5d50901bfac0b38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6514aeb6-8e", "ovs_interfaceid": "6514aeb6-8ea4-4a27-a54b-32f650c87957", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:41:55 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Releasing lock "refresh_cache-aa223c49-d254-4727-8a01-873026847b37" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:41:55 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] [instance: aa223c49-d254-4727-8a01-873026847b37] Updated the network info_cache for instance {{(pid=75176) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 15:41:55 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:41:55 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:41:55 user nova-compute[75176]: DEBUG nova.compute.manager [req-cb8a77ee-8722-49b6-87b3-3a38ac852936 req-939b5469-8b43-4f73-bab0-4f72c5198ac1 service nova] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] Received event network-vif-plugged-99a8dbf9-5502-440a-a03d-cd52337b3009 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:41:55 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-cb8a77ee-8722-49b6-87b3-3a38ac852936 req-939b5469-8b43-4f73-bab0-4f72c5198ac1 service nova] Acquiring lock "041af768-197b-4c76-a5a1-28e2dc8255bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:41:55 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-cb8a77ee-8722-49b6-87b3-3a38ac852936 req-939b5469-8b43-4f73-bab0-4f72c5198ac1 service nova] Lock "041af768-197b-4c76-a5a1-28e2dc8255bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:41:55 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-cb8a77ee-8722-49b6-87b3-3a38ac852936 req-939b5469-8b43-4f73-bab0-4f72c5198ac1 service nova] Lock "041af768-197b-4c76-a5a1-28e2dc8255bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:41:55 user nova-compute[75176]: DEBUG nova.compute.manager [req-cb8a77ee-8722-49b6-87b3-3a38ac852936 req-939b5469-8b43-4f73-bab0-4f72c5198ac1 service nova] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] No waiting events found dispatching network-vif-plugged-99a8dbf9-5502-440a-a03d-cd52337b3009 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:41:55 user nova-compute[75176]: WARNING nova.compute.manager [req-cb8a77ee-8722-49b6-87b3-3a38ac852936 req-939b5469-8b43-4f73-bab0-4f72c5198ac1 service nova] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] Received unexpected event network-vif-plugged-99a8dbf9-5502-440a-a03d-cd52337b3009 for instance with vm_state active and task_state deleting.
Nov 28 15:41:55 user nova-compute[75176]: DEBUG nova.compute.manager [req-cb8a77ee-8722-49b6-87b3-3a38ac852936 req-939b5469-8b43-4f73-bab0-4f72c5198ac1 service nova] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] Received event network-vif-unplugged-6c94b138-6202-4fb7-92c7-b3744cd8d19d {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:41:55 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-cb8a77ee-8722-49b6-87b3-3a38ac852936 req-939b5469-8b43-4f73-bab0-4f72c5198ac1 service nova] Acquiring lock "041af768-197b-4c76-a5a1-28e2dc8255bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:41:55 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-cb8a77ee-8722-49b6-87b3-3a38ac852936 req-939b5469-8b43-4f73-bab0-4f72c5198ac1 service nova] Lock "041af768-197b-4c76-a5a1-28e2dc8255bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:41:55 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-cb8a77ee-8722-49b6-87b3-3a38ac852936 req-939b5469-8b43-4f73-bab0-4f72c5198ac1 service nova] Lock "041af768-197b-4c76-a5a1-28e2dc8255bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:41:55 user nova-compute[75176]: DEBUG nova.compute.manager [req-cb8a77ee-8722-49b6-87b3-3a38ac852936 req-939b5469-8b43-4f73-bab0-4f72c5198ac1 service nova] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] No waiting events found dispatching network-vif-unplugged-6c94b138-6202-4fb7-92c7-b3744cd8d19d {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:41:55 user nova-compute[75176]: DEBUG nova.compute.manager [req-cb8a77ee-8722-49b6-87b3-3a38ac852936 req-939b5469-8b43-4f73-bab0-4f72c5198ac1 service nova] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] Received event network-vif-unplugged-6c94b138-6202-4fb7-92c7-b3744cd8d19d for instance with task_state deleting. {{(pid=75176) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 15:41:55 user nova-compute[75176]: DEBUG nova.compute.manager [req-cb8a77ee-8722-49b6-87b3-3a38ac852936 req-939b5469-8b43-4f73-bab0-4f72c5198ac1 service nova] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] Received event network-vif-plugged-6c94b138-6202-4fb7-92c7-b3744cd8d19d {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:41:55 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-cb8a77ee-8722-49b6-87b3-3a38ac852936 req-939b5469-8b43-4f73-bab0-4f72c5198ac1 service nova] Acquiring lock "041af768-197b-4c76-a5a1-28e2dc8255bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:41:55 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-cb8a77ee-8722-49b6-87b3-3a38ac852936 req-939b5469-8b43-4f73-bab0-4f72c5198ac1 service nova] Lock "041af768-197b-4c76-a5a1-28e2dc8255bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:41:55 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-cb8a77ee-8722-49b6-87b3-3a38ac852936 req-939b5469-8b43-4f73-bab0-4f72c5198ac1 service nova] Lock "041af768-197b-4c76-a5a1-28e2dc8255bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:41:55 user nova-compute[75176]: DEBUG nova.compute.manager [req-cb8a77ee-8722-49b6-87b3-3a38ac852936 req-939b5469-8b43-4f73-bab0-4f72c5198ac1 service nova] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] No waiting events found dispatching network-vif-plugged-6c94b138-6202-4fb7-92c7-b3744cd8d19d {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:41:55 user nova-compute[75176]: WARNING nova.compute.manager [req-cb8a77ee-8722-49b6-87b3-3a38ac852936 req-939b5469-8b43-4f73-bab0-4f72c5198ac1 service nova] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] Received unexpected event network-vif-plugged-6c94b138-6202-4fb7-92c7-b3744cd8d19d for instance with vm_state active and task_state deleting.
Nov 28 15:41:55 user nova-compute[75176]: DEBUG nova.compute.manager [req-cb8a77ee-8722-49b6-87b3-3a38ac852936 req-939b5469-8b43-4f73-bab0-4f72c5198ac1 service nova] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] Received event network-vif-unplugged-61157920-954a-479e-bd66-b0746a7843a7 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:41:55 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-cb8a77ee-8722-49b6-87b3-3a38ac852936 req-939b5469-8b43-4f73-bab0-4f72c5198ac1 service nova] Acquiring lock "b714fb94-fcc7-40ae-b3a9-d8c9a60008f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:41:55 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-cb8a77ee-8722-49b6-87b3-3a38ac852936 req-939b5469-8b43-4f73-bab0-4f72c5198ac1 service nova] Lock "b714fb94-fcc7-40ae-b3a9-d8c9a60008f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:41:55 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-cb8a77ee-8722-49b6-87b3-3a38ac852936 req-939b5469-8b43-4f73-bab0-4f72c5198ac1 service nova] Lock "b714fb94-fcc7-40ae-b3a9-d8c9a60008f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:41:55 user nova-compute[75176]: DEBUG nova.compute.manager [req-cb8a77ee-8722-49b6-87b3-3a38ac852936 req-939b5469-8b43-4f73-bab0-4f72c5198ac1 service nova] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] No waiting events found dispatching network-vif-unplugged-61157920-954a-479e-bd66-b0746a7843a7 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:41:55 user nova-compute[75176]: DEBUG nova.compute.manager [req-cb8a77ee-8722-49b6-87b3-3a38ac852936 req-939b5469-8b43-4f73-bab0-4f72c5198ac1 service nova] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] Received event network-vif-unplugged-61157920-954a-479e-bd66-b0746a7843a7 for instance with task_state deleting. {{(pid=75176) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 15:41:55 user nova-compute[75176]: DEBUG nova.compute.manager [req-cb8a77ee-8722-49b6-87b3-3a38ac852936 req-939b5469-8b43-4f73-bab0-4f72c5198ac1 service nova] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] Received event network-vif-plugged-61157920-954a-479e-bd66-b0746a7843a7 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:41:55 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-cb8a77ee-8722-49b6-87b3-3a38ac852936 req-939b5469-8b43-4f73-bab0-4f72c5198ac1 service nova] Acquiring lock "b714fb94-fcc7-40ae-b3a9-d8c9a60008f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:41:55 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-cb8a77ee-8722-49b6-87b3-3a38ac852936 req-939b5469-8b43-4f73-bab0-4f72c5198ac1 service nova] Lock "b714fb94-fcc7-40ae-b3a9-d8c9a60008f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:41:55 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-cb8a77ee-8722-49b6-87b3-3a38ac852936 req-939b5469-8b43-4f73-bab0-4f72c5198ac1 service nova] Lock "b714fb94-fcc7-40ae-b3a9-d8c9a60008f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:41:55 user nova-compute[75176]: DEBUG nova.compute.manager [req-cb8a77ee-8722-49b6-87b3-3a38ac852936 req-939b5469-8b43-4f73-bab0-4f72c5198ac1 service nova] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] No waiting events found dispatching network-vif-plugged-61157920-954a-479e-bd66-b0746a7843a7 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:41:55 user nova-compute[75176]: WARNING nova.compute.manager [req-cb8a77ee-8722-49b6-87b3-3a38ac852936 req-939b5469-8b43-4f73-bab0-4f72c5198ac1 service nova] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] Received unexpected event network-vif-plugged-61157920-954a-479e-bd66-b0746a7843a7 for instance with vm_state active and task_state deleting.
Nov 28 15:41:55 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:55 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:55 user nova-compute[75176]: DEBUG nova.compute.manager [req-e4a718a4-c7d2-4407-a76c-b8b9ec278e6b req-82049487-4f89-4233-a845-5afbabe0bef0 service nova] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] Received event network-vif-plugged-3a800e7a-5628-4668-ae3e-d49b537f7a62 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:41:55 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-e4a718a4-c7d2-4407-a76c-b8b9ec278e6b req-82049487-4f89-4233-a845-5afbabe0bef0 service nova] Acquiring lock "041af768-197b-4c76-a5a1-28e2dc8255bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:41:55 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-e4a718a4-c7d2-4407-a76c-b8b9ec278e6b req-82049487-4f89-4233-a845-5afbabe0bef0 service nova] Lock "041af768-197b-4c76-a5a1-28e2dc8255bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:41:55 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-e4a718a4-c7d2-4407-a76c-b8b9ec278e6b req-82049487-4f89-4233-a845-5afbabe0bef0 service nova] Lock "041af768-197b-4c76-a5a1-28e2dc8255bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:41:55 user nova-compute[75176]: DEBUG nova.compute.manager [req-e4a718a4-c7d2-4407-a76c-b8b9ec278e6b req-82049487-4f89-4233-a845-5afbabe0bef0 service nova] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] No waiting events found dispatching network-vif-plugged-3a800e7a-5628-4668-ae3e-d49b537f7a62 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:41:55 user nova-compute[75176]: WARNING nova.compute.manager [req-e4a718a4-c7d2-4407-a76c-b8b9ec278e6b req-82049487-4f89-4233-a845-5afbabe0bef0 service nova] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] Received unexpected event network-vif-plugged-3a800e7a-5628-4668-ae3e-d49b537f7a62 for instance with vm_state active and task_state deleting.
Nov 28 15:41:55 user nova-compute[75176]: DEBUG nova.compute.manager [req-e4a718a4-c7d2-4407-a76c-b8b9ec278e6b req-82049487-4f89-4233-a845-5afbabe0bef0 service nova] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] Received event network-vif-unplugged-d9a60043-45d0-46f1-8d0f-ad1c7b55fa06 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:41:55 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-e4a718a4-c7d2-4407-a76c-b8b9ec278e6b req-82049487-4f89-4233-a845-5afbabe0bef0 service nova] Acquiring lock "041af768-197b-4c76-a5a1-28e2dc8255bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:41:55 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-e4a718a4-c7d2-4407-a76c-b8b9ec278e6b req-82049487-4f89-4233-a845-5afbabe0bef0 service nova] Lock "041af768-197b-4c76-a5a1-28e2dc8255bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:41:55 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-e4a718a4-c7d2-4407-a76c-b8b9ec278e6b req-82049487-4f89-4233-a845-5afbabe0bef0 service nova] Lock "041af768-197b-4c76-a5a1-28e2dc8255bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:41:55 user nova-compute[75176]: DEBUG nova.compute.manager [req-e4a718a4-c7d2-4407-a76c-b8b9ec278e6b req-82049487-4f89-4233-a845-5afbabe0bef0 service nova] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] No waiting events found dispatching network-vif-unplugged-d9a60043-45d0-46f1-8d0f-ad1c7b55fa06 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:41:55 user nova-compute[75176]: DEBUG nova.compute.manager [req-e4a718a4-c7d2-4407-a76c-b8b9ec278e6b req-82049487-4f89-4233-a845-5afbabe0bef0 service nova] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] Received event network-vif-unplugged-d9a60043-45d0-46f1-8d0f-ad1c7b55fa06 for instance with task_state deleting. {{(pid=75176) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 15:41:55 user nova-compute[75176]: DEBUG nova.compute.manager [req-e4a718a4-c7d2-4407-a76c-b8b9ec278e6b req-82049487-4f89-4233-a845-5afbabe0bef0 service nova] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] Received event network-vif-plugged-d9a60043-45d0-46f1-8d0f-ad1c7b55fa06 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:41:55 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-e4a718a4-c7d2-4407-a76c-b8b9ec278e6b req-82049487-4f89-4233-a845-5afbabe0bef0 service nova] Acquiring lock "041af768-197b-4c76-a5a1-28e2dc8255bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:41:55 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-e4a718a4-c7d2-4407-a76c-b8b9ec278e6b req-82049487-4f89-4233-a845-5afbabe0bef0 service nova] Lock "041af768-197b-4c76-a5a1-28e2dc8255bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:41:55 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-e4a718a4-c7d2-4407-a76c-b8b9ec278e6b req-82049487-4f89-4233-a845-5afbabe0bef0 service nova] Lock "041af768-197b-4c76-a5a1-28e2dc8255bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:41:55 user nova-compute[75176]: DEBUG nova.compute.manager [req-e4a718a4-c7d2-4407-a76c-b8b9ec278e6b req-82049487-4f89-4233-a845-5afbabe0bef0 service nova] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] No waiting events found dispatching network-vif-plugged-d9a60043-45d0-46f1-8d0f-ad1c7b55fa06 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:41:55 user nova-compute[75176]: WARNING nova.compute.manager [req-e4a718a4-c7d2-4407-a76c-b8b9ec278e6b req-82049487-4f89-4233-a845-5afbabe0bef0 service nova] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] Received unexpected event network-vif-plugged-d9a60043-45d0-46f1-8d0f-ad1c7b55fa06 for instance with vm_state active and task_state deleting.
Nov 28 15:41:55 user nova-compute[75176]: DEBUG nova.compute.manager [req-e4a718a4-c7d2-4407-a76c-b8b9ec278e6b req-82049487-4f89-4233-a845-5afbabe0bef0 service nova] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] Received event network-vif-unplugged-0c65b96a-0fce-4bff-b89c-443cc48f6995 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:41:55 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-e4a718a4-c7d2-4407-a76c-b8b9ec278e6b req-82049487-4f89-4233-a845-5afbabe0bef0 service nova] Acquiring lock "041af768-197b-4c76-a5a1-28e2dc8255bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:41:55 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-e4a718a4-c7d2-4407-a76c-b8b9ec278e6b req-82049487-4f89-4233-a845-5afbabe0bef0 service nova] Lock "041af768-197b-4c76-a5a1-28e2dc8255bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:41:55 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-e4a718a4-c7d2-4407-a76c-b8b9ec278e6b req-82049487-4f89-4233-a845-5afbabe0bef0 service nova] Lock "041af768-197b-4c76-a5a1-28e2dc8255bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:41:55 user nova-compute[75176]: DEBUG nova.compute.manager [req-e4a718a4-c7d2-4407-a76c-b8b9ec278e6b req-82049487-4f89-4233-a845-5afbabe0bef0 service nova] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] No waiting events found dispatching network-vif-unplugged-0c65b96a-0fce-4bff-b89c-443cc48f6995 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:41:55 user nova-compute[75176]: DEBUG nova.compute.manager [req-e4a718a4-c7d2-4407-a76c-b8b9ec278e6b req-82049487-4f89-4233-a845-5afbabe0bef0 service nova] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] Received event network-vif-unplugged-0c65b96a-0fce-4bff-b89c-443cc48f6995 for instance with task_state deleting. {{(pid=75176) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 15:41:55 user nova-compute[75176]: DEBUG nova.compute.manager [req-e4a718a4-c7d2-4407-a76c-b8b9ec278e6b req-82049487-4f89-4233-a845-5afbabe0bef0 service nova] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] Received event network-vif-plugged-0c65b96a-0fce-4bff-b89c-443cc48f6995 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:41:55 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-e4a718a4-c7d2-4407-a76c-b8b9ec278e6b req-82049487-4f89-4233-a845-5afbabe0bef0 service nova] Acquiring lock "041af768-197b-4c76-a5a1-28e2dc8255bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:41:55 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-e4a718a4-c7d2-4407-a76c-b8b9ec278e6b req-82049487-4f89-4233-a845-5afbabe0bef0 service nova] Lock "041af768-197b-4c76-a5a1-28e2dc8255bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:41:55 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-e4a718a4-c7d2-4407-a76c-b8b9ec278e6b req-82049487-4f89-4233-a845-5afbabe0bef0 service nova] Lock "041af768-197b-4c76-a5a1-28e2dc8255bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:41:55 user nova-compute[75176]: DEBUG nova.compute.manager [req-e4a718a4-c7d2-4407-a76c-b8b9ec278e6b req-82049487-4f89-4233-a845-5afbabe0bef0 service nova] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] No waiting events found dispatching network-vif-plugged-0c65b96a-0fce-4bff-b89c-443cc48f6995 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:41:55 user nova-compute[75176]: WARNING nova.compute.manager [req-e4a718a4-c7d2-4407-a76c-b8b9ec278e6b req-82049487-4f89-4233-a845-5afbabe0bef0 service nova] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] Received unexpected event network-vif-plugged-0c65b96a-0fce-4bff-b89c-443cc48f6995 for instance with vm_state active and task_state deleting.
Nov 28 15:41:55 user nova-compute[75176]: DEBUG nova.compute.manager [req-e4a718a4-c7d2-4407-a76c-b8b9ec278e6b req-82049487-4f89-4233-a845-5afbabe0bef0 service nova] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] Received event network-vif-unplugged-2df03152-b1aa-4794-965d-64886ac889ea {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:41:55 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-e4a718a4-c7d2-4407-a76c-b8b9ec278e6b req-82049487-4f89-4233-a845-5afbabe0bef0 service nova] Acquiring lock "041af768-197b-4c76-a5a1-28e2dc8255bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:41:55 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-e4a718a4-c7d2-4407-a76c-b8b9ec278e6b req-82049487-4f89-4233-a845-5afbabe0bef0 service nova] Lock "041af768-197b-4c76-a5a1-28e2dc8255bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:41:55 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-e4a718a4-c7d2-4407-a76c-b8b9ec278e6b req-82049487-4f89-4233-a845-5afbabe0bef0 service nova] Lock "041af768-197b-4c76-a5a1-28e2dc8255bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:41:55 user nova-compute[75176]: DEBUG nova.compute.manager [req-e4a718a4-c7d2-4407-a76c-b8b9ec278e6b req-82049487-4f89-4233-a845-5afbabe0bef0 service nova] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] No waiting events found dispatching network-vif-unplugged-2df03152-b1aa-4794-965d-64886ac889ea {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:41:55 user nova-compute[75176]: DEBUG nova.compute.manager [req-e4a718a4-c7d2-4407-a76c-b8b9ec278e6b req-82049487-4f89-4233-a845-5afbabe0bef0 service nova] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] Received event network-vif-unplugged-2df03152-b1aa-4794-965d-64886ac889ea for instance with task_state deleting. {{(pid=75176) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 15:41:55 user nova-compute[75176]: DEBUG nova.compute.manager [req-e4a718a4-c7d2-4407-a76c-b8b9ec278e6b req-82049487-4f89-4233-a845-5afbabe0bef0 service nova] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] Received event network-vif-plugged-2df03152-b1aa-4794-965d-64886ac889ea {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:41:55 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-e4a718a4-c7d2-4407-a76c-b8b9ec278e6b req-82049487-4f89-4233-a845-5afbabe0bef0 service nova] Acquiring lock "041af768-197b-4c76-a5a1-28e2dc8255bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:41:55 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-e4a718a4-c7d2-4407-a76c-b8b9ec278e6b req-82049487-4f89-4233-a845-5afbabe0bef0 service nova] Lock "041af768-197b-4c76-a5a1-28e2dc8255bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:41:55 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-e4a718a4-c7d2-4407-a76c-b8b9ec278e6b req-82049487-4f89-4233-a845-5afbabe0bef0 service nova] Lock "041af768-197b-4c76-a5a1-28e2dc8255bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:41:55 user nova-compute[75176]: DEBUG nova.compute.manager [req-e4a718a4-c7d2-4407-a76c-b8b9ec278e6b req-82049487-4f89-4233-a845-5afbabe0bef0 service nova] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] No waiting events found dispatching network-vif-plugged-2df03152-b1aa-4794-965d-64886ac889ea {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:41:55 user nova-compute[75176]: WARNING nova.compute.manager [req-e4a718a4-c7d2-4407-a76c-b8b9ec278e6b req-82049487-4f89-4233-a845-5afbabe0bef0 service nova] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] Received unexpected event network-vif-plugged-2df03152-b1aa-4794-965d-64886ac889ea for instance with vm_state active and task_state deleting.
Nov 28 15:41:55 user nova-compute[75176]: DEBUG nova.compute.manager [req-e4a718a4-c7d2-4407-a76c-b8b9ec278e6b req-82049487-4f89-4233-a845-5afbabe0bef0 service nova] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] Received event network-vif-unplugged-da7d30e5-6304-46ec-8d50-336986e6262f {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:41:55 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-e4a718a4-c7d2-4407-a76c-b8b9ec278e6b req-82049487-4f89-4233-a845-5afbabe0bef0 service nova] Acquiring lock "b714fb94-fcc7-40ae-b3a9-d8c9a60008f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:41:55 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-e4a718a4-c7d2-4407-a76c-b8b9ec278e6b req-82049487-4f89-4233-a845-5afbabe0bef0 service nova] Lock "b714fb94-fcc7-40ae-b3a9-d8c9a60008f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:41:55 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-e4a718a4-c7d2-4407-a76c-b8b9ec278e6b req-82049487-4f89-4233-a845-5afbabe0bef0 service nova] Lock "b714fb94-fcc7-40ae-b3a9-d8c9a60008f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:41:55 user nova-compute[75176]: DEBUG nova.compute.manager [req-e4a718a4-c7d2-4407-a76c-b8b9ec278e6b req-82049487-4f89-4233-a845-5afbabe0bef0 service nova] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] No waiting events found dispatching network-vif-unplugged-da7d30e5-6304-46ec-8d50-336986e6262f {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:41:55 user nova-compute[75176]: DEBUG nova.compute.manager [req-e4a718a4-c7d2-4407-a76c-b8b9ec278e6b req-82049487-4f89-4233-a845-5afbabe0bef0 service nova] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] Received event network-vif-unplugged-da7d30e5-6304-46ec-8d50-336986e6262f for instance with task_state deleting. {{(pid=75176) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 15:41:55 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-a6d20036-7a6f-4750-9aed-016a7bc081df tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance e2e25e19-c832-4945-9257-64e6103feb0c is timed out.
Nov 28 15:41:55 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:55 user nova-compute[75176]: INFO os_vif [None req-585335e7-3eb7-4c3d-9395-77097f973761 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e2:26:17,bridge_name='br-int',has_traffic_filtering=True,id=99a8dbf9-5502-440a-a03d-cd52337b3009,network=Network(9fe0d7b7-e9dc-4e03-a401-452fd502c940),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99a8dbf9-55')
Nov 28 15:41:55 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-585335e7-3eb7-4c3d-9395-77097f973761 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T15:39:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1424070534',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1424070534',id=10,image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPn83B68ew19zNqtC6OrMzgf/bmXCz98qa+rH054zqhA5Gi3ZDmOGiOHPgSu1hkI/yV1KZdhZIiHhrJ1wuOhC1X2w3dTgpgbLguVyd7FUfhz3bRrtdjXABRlYuvBuQRV2A==',key_name='tempest-keypair-1772665281',keypairs=<?>,launch_index=0,launched_at=2023-11-28T15:40:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cfdec2abaf704a1396611ff1bcb96e53',ramdisk_id='',reservation_id='r-0j1w7c0x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1260942437',owner_user_name='tempest-TaggedBootDevicesTest_v242-1260942437-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T15:40:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='97e02c028b814c6993edba6c1caa8afe',uuid=041af768-197b-4c76-a5a1-28e2dc8255bd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6c94b138-6202-4fb7-92c7-b3744cd8d19d", "address": "fa:16:3e:09:2f:ed", "network": {"id": "d7dbc9c3-816f-46fb-a3d3-e0e817e15de3", "bridge": "br-int", "label": "tempest-device-tagging-net1-136440967", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfdec2abaf704a1396611ff1bcb96e53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c94b138-62", "ovs_interfaceid": "6c94b138-6202-4fb7-92c7-b3744cd8d19d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75176) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 15:41:55 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-585335e7-3eb7-4c3d-9395-77097f973761 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Converting VIF {"id": "6c94b138-6202-4fb7-92c7-b3744cd8d19d", "address": "fa:16:3e:09:2f:ed", "network": {"id": "d7dbc9c3-816f-46fb-a3d3-e0e817e15de3", "bridge": "br-int", "label": "tempest-device-tagging-net1-136440967", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfdec2abaf704a1396611ff1bcb96e53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c94b138-62", "ovs_interfaceid": "6c94b138-6202-4fb7-92c7-b3744cd8d19d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:41:55 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-585335e7-3eb7-4c3d-9395-77097f973761 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:2f:ed,bridge_name='br-int',has_traffic_filtering=True,id=6c94b138-6202-4fb7-92c7-b3744cd8d19d,network=Network(d7dbc9c3-816f-46fb-a3d3-e0e817e15de3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6c94b138-62') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:41:55 user nova-compute[75176]: DEBUG os_vif [None req-585335e7-3eb7-4c3d-9395-77097f973761 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:2f:ed,bridge_name='br-int',has_traffic_filtering=True,id=6c94b138-6202-4fb7-92c7-b3744cd8d19d,network=Network(d7dbc9c3-816f-46fb-a3d3-e0e817e15de3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6c94b138-62') {{(pid=75176) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 15:41:55 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-a6d20036-7a6f-4750-9aed-016a7bc081df tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] Successfully detached device vdb from instance e2e25e19-c832-4945-9257-64e6103feb0c from the live domain config.
Nov 28 15:41:55 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:55 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6c94b138-62, bridge=br-int, if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:41:55 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:55 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:41:55 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a6d20036-7a6f-4750-9aed-016a7bc081df tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] [instance: e2e25e19-c832-4945-9257-64e6103feb0c] calling os-brick to detach iSCSI Volume {{(pid=75176) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 15:41:55 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6d20036-7a6f-4750-9aed-016a7bc081df tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c1b8a00>, {'target_iqn': 'iqn.2010-10.org.openstack:0dba49e9-5e6e-4896-b644-66558707591d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HstFqQNh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 15:41:55 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-a6d20036-7a6f-4750-9aed-016a7bc081df tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 15:41:55 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-a6d20036-7a6f-4750-9aed-016a7bc081df tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 15:41:55 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-a6d20036-7a6f-4750-9aed-016a7bc081df tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.004s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 15:41:55 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:41:55 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.029s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:41:55 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3c817a9-045e-405d-8aee-94e13a231ee5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:560d9b0e-d506-4723-8fc3-4068d690d5c8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:763d605d-247d-4484-b7ec-762e36b92abc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:27720cbf-c8ad-486b-845d-cdff5fbc4772\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:81326542-482f-4d50-895c-13c65fe4daf7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:76ea4d3b-7c77-47d0-b48b-ad79886d4f9a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ff70e82d-37da-4392-b25a-e9b80992af80\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6e691257-74a3-4fef-9fd1-67d2ba725039\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0dba49e9-5e6e-4896-b644-66558707591d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:41:55 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6d20036-7a6f-4750-9aed-016a7bc081df tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 15:41:55 user nova-compute[75176]: No targets found.
Nov 28 15:41:55 user nova-compute[75176]: iSNS:
Nov 28 15:41:55 user nova-compute[75176]: No targets found.
Nov 28 15:41:55 user nova-compute[75176]: STATIC:
Nov 28 15:41:55 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:560d9b0e-d506-4723-8fc3-4068d690d5c8
Nov 28 15:41:55 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:41:55 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:41:55 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:763d605d-247d-4484-b7ec-762e36b92abc
Nov 28 15:41:55 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:41:55 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:41:55 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:27720cbf-c8ad-486b-845d-cdff5fbc4772
Nov 28 15:41:55 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:41:55 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:41:55 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:81326542-482f-4d50-895c-13c65fe4daf7
Nov 28 15:41:55 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:41:55 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:41:55 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:76ea4d3b-7c77-47d0-b48b-ad79886d4f9a
Nov 28 15:41:55 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:41:55 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:41:55 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:ff70e82d-37da-4392-b25a-e9b80992af80
Nov 28 15:41:55 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:41:55 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:41:55 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:6e691257-74a3-4fef-9fd1-67d2ba725039
Nov 28 15:41:55 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:41:55 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:41:55 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:0dba49e9-5e6e-4896-b644-66558707591d
Nov 28 15:41:55 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:41:55 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:41:55 user nova-compute[75176]: FIRMWARE:
Nov 28 15:41:55 user nova-compute[75176]: No targets found.
Nov 28 15:41:55 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:41:55 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6d20036-7a6f-4750-9aed-016a7bc081df tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 15:41:55 user nova-compute[75176]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 15:41:55 user nova-compute[75176]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75176) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 15:41:55 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6d20036-7a6f-4750-9aed-016a7bc081df tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0dba49e9-5e6e-4896-b644-66558707591d', 0)] {{(pid=75176) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 15:41:55 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:41:55 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:41:55 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[d45e71f8-dda0-407c-b8c7-cc7c3e366045]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0dba49e9-5e6e-4896-b644-66558707591d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:27720cbf-c8ad-486b-845d-cdff5fbc4772\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:560d9b0e-d506-4723-8fc3-4068d690d5c8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e691257-74a3-4fef-9fd1-67d2ba725039\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:763d605d-247d-4484-b7ec-762e36b92abc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:76ea4d3b-7c77-47d0-b48b-ad79886d4f9a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:81326542-482f-4d50-895c-13c65fe4daf7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ff70e82d-37da-4392-b25a-e9b80992af80\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:41:55 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:55 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:41:55 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:41:55 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[807b6757-01ed-4cf3-ab63-44ad225665bc]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dba49e9-5e6e-4896-b644-66558707591d (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff70e82d-37da-4392-b25a-e9b80992af80 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81326542-482f-4d50-895c-13c65fe4daf7 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76ea4d3b-7c77-47d0-b48b-ad79886d4f9a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27720cbf-c8ad-486b-845d-cdff5fbc4772 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:560d9b0e-d506-4723-8fc3-4068d690d5c8 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e691257-74a3-4fef-9fd1-67d2ba725039 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:763d605d-247d-4484-b7ec-762e36b92abc (non-flash)\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:41:55 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6d20036-7a6f-4750-9aed-016a7bc081df tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dba49e9-5e6e-4896-b644-66558707591d (non-flash)
Nov 28 15:41:55 user nova-compute[75176]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff70e82d-37da-4392-b25a-e9b80992af80 (non-flash)
Nov 28 15:41:55 user nova-compute[75176]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81326542-482f-4d50-895c-13c65fe4daf7 (non-flash)
Nov 28 15:41:55 user nova-compute[75176]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76ea4d3b-7c77-47d0-b48b-ad79886d4f9a (non-flash)
Nov 28 15:41:55 user nova-compute[75176]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27720cbf-c8ad-486b-845d-cdff5fbc4772 (non-flash)
Nov 28 15:41:55 user nova-compute[75176]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:560d9b0e-d506-4723-8fc3-4068d690d5c8 (non-flash)
Nov 28 15:41:55 user nova-compute[75176]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e691257-74a3-4fef-9fd1-67d2ba725039 (non-flash)
Nov 28 15:41:55 user nova-compute[75176]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:763d605d-247d-4484-b7ec-762e36b92abc (non-flash)
Nov 28 15:41:55 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:41:55 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6d20036-7a6f-4750-9aed-016a7bc081df tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dba49e9-5e6e-4896-b644-66558707591d (non-flash)
Nov 28 15:41:55 user nova-compute[75176]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff70e82d-37da-4392-b25a-e9b80992af80 (non-flash)
Nov 28 15:41:55 user nova-compute[75176]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81326542-482f-4d50-895c-13c65fe4daf7 (non-flash)
Nov 28 15:41:55 user nova-compute[75176]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76ea4d3b-7c77-47d0-b48b-ad79886d4f9a (non-flash)
Nov 28 15:41:55 user nova-compute[75176]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27720cbf-c8ad-486b-845d-cdff5fbc4772 (non-flash)
Nov 28 15:41:55 user nova-compute[75176]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:560d9b0e-d506-4723-8fc3-4068d690d5c8 (non-flash)
Nov 28 15:41:55 user nova-compute[75176]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e691257-74a3-4fef-9fd1-67d2ba725039 (non-flash)
Nov 28 15:41:55 user nova-compute[75176]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:763d605d-247d-4484-b7ec-762e36b92abc (non-flash)
Nov 28 15:41:55 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 15:41:55 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6d20036-7a6f-4750-9aed-016a7bc081df tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4644165750>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0dba49e9-5e6e-4896-b644-66558707591d'): ({'sdb'}, set())}) {{(pid=75176) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 15:41:55 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-a6d20036-7a6f-4750-9aed-016a7bc081df tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] Removing single pathed devices sdb {{(pid=75176) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 15:41:55 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:41:55 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:41:55 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5922583-05c0-4cd4-8b0c-13cadac0f0b9]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:41:55 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:41:56 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:41:56 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[7afcebeb-075a-4b48-92ad-bb2136716a10]: (4, ('ok\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:41:56 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-a6d20036-7a6f-4750-9aed-016a7bc081df tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] Flushing IO for device /dev/sdb {{(pid=75176) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 15:41:56 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:41:56 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:41:56 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d61b39f-e2d3-45d1-be22-47a8bf8c0f8f]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:41:56 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-a6d20036-7a6f-4750-9aed-016a7bc081df tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75176) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 15:41:56 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:41:56 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:56 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:56 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5f109779-e775-440b-8f0a-db5cf7d03d31) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:41:56 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:56 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:41:56 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:41:56 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bd89883-c155-4d8d-bb0e-0b69ef1b775c]: (4, ('1', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:41:56 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-a6d20036-7a6f-4750-9aed-016a7bc081df tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75176) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 15:41:56 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-a6d20036-7a6f-4750-9aed-016a7bc081df tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] SCSI volumes sdb have been removed. {{(pid=75176) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 15:41:56 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6d20036-7a6f-4750-9aed-016a7bc081df tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0dba49e9-5e6e-4896-b644-66558707591d')] {{(pid=75176) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 15:41:56 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0dba49e9-5e6e-4896-b644-66558707591d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:41:56 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0dba49e9-5e6e-4896-b644-66558707591d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:41:56 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d22f5d5-d54d-43f7-97be-ccb5a2965dd0]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:41:56 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6d20036-7a6f-4750-9aed-016a7bc081df tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:41:56 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0dba49e9-5e6e-4896-b644-66558707591d -p 172.16.0.220:3260 --logout {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:41:56 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:56 user nova-compute[75176]: INFO nova.virt.libvirt.driver [-] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] Instance destroyed successfully.
Nov 28 15:41:56 user nova-compute[75176]: DEBUG nova.objects.instance [None req-b469a21b-cdfb-4f59-9409-786dfeb47caf tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Lazy-loading 'resources' on Instance uuid b714fb94-fcc7-40ae-b3a9-d8c9a60008f1 {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:41:56 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-b469a21b-cdfb-4f59-9409-786dfeb47caf tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T15:39:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1004277851',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1004277851',id=11,image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAt/lLowBIWQygNmvQblLtMAxvEuh2XUt/OTwbCBERVkLqIQ96jTap/pkeH4XObeedowqO0iM5aqRH1Q9ITpqofPFkYQiFnqenRv5cljG1lxFMkS8D9qDEIlxMTWaLsb0A==',key_name='tempest-keypair-1203087070',keypairs=<?>,launch_index=0,launched_at=2023-11-28T15:40:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0108444c01e94416984b083707102c58',ramdisk_id='',reservation_id='r-j3sryyxs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1183582238',owner_user_name='tempest-TaggedBootDevicesTest-1183582238-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T15:40:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8fb5815faed648a1a207c402eafca90e',uuid=b714fb94-fcc7-40ae-b3a9-d8c9a60008f1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "da7d30e5-6304-46ec-8d50-336986e6262f", "address": "fa:16:3e:63:83:5b", "network": {"id": "b1277b75-5749-436a-a651-3303fd60d8b4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1047877730-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0108444c01e94416984b083707102c58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda7d30e5-63", "ovs_interfaceid": "da7d30e5-6304-46ec-8d50-336986e6262f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 15:41:56 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-b469a21b-cdfb-4f59-9409-786dfeb47caf tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Converting VIF {"id": "da7d30e5-6304-46ec-8d50-336986e6262f", "address": "fa:16:3e:63:83:5b", "network": {"id": "b1277b75-5749-436a-a651-3303fd60d8b4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1047877730-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0108444c01e94416984b083707102c58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda7d30e5-63", "ovs_interfaceid": "da7d30e5-6304-46ec-8d50-336986e6262f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:41:56 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-b469a21b-cdfb-4f59-9409-786dfeb47caf tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:63:83:5b,bridge_name='br-int',has_traffic_filtering=True,id=da7d30e5-6304-46ec-8d50-336986e6262f,network=Network(b1277b75-5749-436a-a651-3303fd60d8b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda7d30e5-63') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:41:56 user nova-compute[75176]: DEBUG os_vif [None req-b469a21b-cdfb-4f59-9409-786dfeb47caf tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:63:83:5b,bridge_name='br-int',has_traffic_filtering=True,id=da7d30e5-6304-46ec-8d50-336986e6262f,network=Network(b1277b75-5749-436a-a651-3303fd60d8b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda7d30e5-63') {{(pid=75176) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 15:41:56 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0dba49e9-5e6e-4896-b644-66558707591d -p 172.16.0.220:3260 --logout" returned: 0 in 0.089s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:41:56 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddcd8641-4f31-476a-a5a7-c3d26823e76c]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:0dba49e9-5e6e-4896-b644-66558707591d, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:0dba49e9-5e6e-4896-b644-66558707591d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:41:56 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6d20036-7a6f-4750-9aed-016a7bc081df tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:0dba49e9-5e6e-4896-b644-66558707591d, portal: 172.16.0.220,3260]
Nov 28 15:41:56 user nova-compute[75176]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:0dba49e9-5e6e-4896-b644-66558707591d, portal: 172.16.0.220,3260] successful.
Nov 28 15:41:56 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:41:56 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0dba49e9-5e6e-4896-b644-66558707591d -p 172.16.0.220:3260 --op delete {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:41:56 user nova-compute[75176]: INFO nova.virt.libvirt.driver [-] [instance: 4ed0eb85-e975-446c-8da7-148a4bb36958] Instance destroyed successfully.
Nov 28 15:41:56 user nova-compute[75176]: DEBUG nova.objects.instance [None req-4c851341-a4c2-4026-b00d-1e1e8ea739d0 tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] Lazy-loading 'resources' on Instance uuid 4ed0eb85-e975-446c-8da7-148a4bb36958 {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:41:56 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-4c851341-a4c2-4026-b00d-1e1e8ea739d0 tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T15:39:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-874981218',display_name='tempest-AttachSCSIVolumeTestJSON-server-874981218',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-874981218',id=7,image_ref='1cea193d-2f53-4621-897c-2c6c5842cffc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMlpzYK0RzAIepUVAKA1KXFqeWlbFbPMAArTFQcS8aZKYNK26AHQKFwet0utXsLcCzs80Go+Q9P3YIwr4NJPcCbUuV2p2fH5QEd+FHBnazt8wR3j3ZeaqEfIag6TbuaTjQ==',key_name='tempest-keypair-2004663028',keypairs=<?>,launch_index=0,launched_at=2023-11-28T15:39:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='eed2357254f24be99031f60700f97988',ramdisk_id='',reservation_id='r-j0df32nq',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1cea193d-2f53-4621-897c-2c6c5842cffc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-729958549',owner_user_name='tempest-AttachSCSIVolumeTestJSON-729958549-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T15:39:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='84613ff663a942df897c3510ef40888f',uuid=4ed0eb85-e975-446c-8da7-148a4bb36958,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9996a5ef-0801-4136-bd1d-fd5372d97e9d", "address": "fa:16:3e:e6:32:e5", "network": {"id": "66701df7-e5c6-4815-936c-2cfec02c127d", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-506481626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eed2357254f24be99031f60700f97988", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9996a5ef-08", "ovs_interfaceid": "9996a5ef-0801-4136-bd1d-fd5372d97e9d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 15:41:56 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-4c851341-a4c2-4026-b00d-1e1e8ea739d0 tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] Converting VIF {"id": "9996a5ef-0801-4136-bd1d-fd5372d97e9d", "address": "fa:16:3e:e6:32:e5", "network": {"id": "66701df7-e5c6-4815-936c-2cfec02c127d", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-506481626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eed2357254f24be99031f60700f97988", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9996a5ef-08", "ovs_interfaceid": "9996a5ef-0801-4136-bd1d-fd5372d97e9d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:41:56 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-4c851341-a4c2-4026-b00d-1e1e8ea739d0 tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e6:32:e5,bridge_name='br-int',has_traffic_filtering=True,id=9996a5ef-0801-4136-bd1d-fd5372d97e9d,network=Network(66701df7-e5c6-4815-936c-2cfec02c127d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9996a5ef-08') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:41:56 user nova-compute[75176]: DEBUG os_vif [None req-4c851341-a4c2-4026-b00d-1e1e8ea739d0 tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e6:32:e5,bridge_name='br-int',has_traffic_filtering=True,id=9996a5ef-0801-4136-bd1d-fd5372d97e9d,network=Network(66701df7-e5c6-4815-936c-2cfec02c127d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9996a5ef-08') {{(pid=75176) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 15:41:56 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:56 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0dba49e9-5e6e-4896-b644-66558707591d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:41:56 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[5de2bdf7-f3d0-4b70-86f3-532813ee028e]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:41:56 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6d20036-7a6f-4750-9aed-016a7bc081df tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:41:56 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-a6d20036-7a6f-4750-9aed-016a7bc081df tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.405s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 15:41:56 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6d20036-7a6f-4750-9aed-016a7bc081df tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] <== disconnect_volume: return (409ms) None {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 15:41:56 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a6d20036-7a6f-4750-9aed-016a7bc081df tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] [instance: e2e25e19-c832-4945-9257-64e6103feb0c] Disconnected iSCSI Volume {{(pid=75176) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 15:41:56 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:56 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:56 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapda7d30e5-63, bridge=br-int, if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:41:56 user nova-compute[75176]: INFO os_vif [None req-585335e7-3eb7-4c3d-9395-77097f973761 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:2f:ed,bridge_name='br-int',has_traffic_filtering=True,id=6c94b138-6202-4fb7-92c7-b3744cd8d19d,network=Network(d7dbc9c3-816f-46fb-a3d3-e0e817e15de3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6c94b138-62')
Nov 28 15:41:56 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-585335e7-3eb7-4c3d-9395-77097f973761 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T15:39:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1424070534',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1424070534',id=10,image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPn83B68ew19zNqtC6OrMzgf/bmXCz98qa+rH054zqhA5Gi3ZDmOGiOHPgSu1hkI/yV1KZdhZIiHhrJ1wuOhC1X2w3dTgpgbLguVyd7FUfhz3bRrtdjXABRlYuvBuQRV2A==',key_name='tempest-keypair-1772665281',keypairs=<?>,launch_index=0,launched_at=2023-11-28T15:40:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cfdec2abaf704a1396611ff1bcb96e53',ramdisk_id='',reservation_id='r-0j1w7c0x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1260942437',owner_user_name='tempest-TaggedBootDevicesTest_v242-1260942437-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T15:40:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='97e02c028b814c6993edba6c1caa8afe',uuid=041af768-197b-4c76-a5a1-28e2dc8255bd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0ac967e7-41bc-4751-a2bc-499ffbface15", "address": "fa:16:3e:ce:ed:17", "network": {"id": "d7dbc9c3-816f-46fb-a3d3-e0e817e15de3", "bridge": "br-int", "label": "tempest-device-tagging-net1-136440967", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.48", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfdec2abaf704a1396611ff1bcb96e53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ac967e7-41", "ovs_interfaceid": "0ac967e7-41bc-4751-a2bc-499ffbface15", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75176) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 15:41:56 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-585335e7-3eb7-4c3d-9395-77097f973761 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Converting VIF {"id": "0ac967e7-41bc-4751-a2bc-499ffbface15", "address": "fa:16:3e:ce:ed:17", "network": {"id": "d7dbc9c3-816f-46fb-a3d3-e0e817e15de3", "bridge": "br-int", "label": "tempest-device-tagging-net1-136440967", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.48", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfdec2abaf704a1396611ff1bcb96e53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ac967e7-41", "ovs_interfaceid": "0ac967e7-41bc-4751-a2bc-499ffbface15", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:41:56 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-585335e7-3eb7-4c3d-9395-77097f973761 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:ed:17,bridge_name='br-int',has_traffic_filtering=True,id=0ac967e7-41bc-4751-a2bc-499ffbface15,network=Network(d7dbc9c3-816f-46fb-a3d3-e0e817e15de3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0ac967e7-41') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:41:56 user nova-compute[75176]: DEBUG os_vif [None req-585335e7-3eb7-4c3d-9395-77097f973761 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:ed:17,bridge_name='br-int',has_traffic_filtering=True,id=0ac967e7-41bc-4751-a2bc-499ffbface15,network=Network(d7dbc9c3-816f-46fb-a3d3-e0e817e15de3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0ac967e7-41') {{(pid=75176) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 15:41:56 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:56 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:41:56 user nova-compute[75176]: DEBUG nova.compute.manager [req-c5066fa5-6825-42e1-8a3e-3208b3c3bb2b req-80592f5c-db77-4456-968a-46c97e1a6422 service nova] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] Received event network-vif-unplugged-e1ac011f-d965-4d4c-b4c8-aa9bf5201518 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:41:56 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-c5066fa5-6825-42e1-8a3e-3208b3c3bb2b req-80592f5c-db77-4456-968a-46c97e1a6422 service nova] Acquiring lock "b714fb94-fcc7-40ae-b3a9-d8c9a60008f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:41:56 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-c5066fa5-6825-42e1-8a3e-3208b3c3bb2b req-80592f5c-db77-4456-968a-46c97e1a6422 service nova] Lock "b714fb94-fcc7-40ae-b3a9-d8c9a60008f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:41:56 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-c5066fa5-6825-42e1-8a3e-3208b3c3bb2b req-80592f5c-db77-4456-968a-46c97e1a6422 service nova] Lock "b714fb94-fcc7-40ae-b3a9-d8c9a60008f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:41:56 user nova-compute[75176]: DEBUG nova.compute.manager [req-c5066fa5-6825-42e1-8a3e-3208b3c3bb2b req-80592f5c-db77-4456-968a-46c97e1a6422 service nova] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] No waiting events found dispatching network-vif-unplugged-e1ac011f-d965-4d4c-b4c8-aa9bf5201518 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:41:56 user nova-compute[75176]: DEBUG nova.compute.manager [req-c5066fa5-6825-42e1-8a3e-3208b3c3bb2b req-80592f5c-db77-4456-968a-46c97e1a6422 service nova] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] Received event network-vif-unplugged-e1ac011f-d965-4d4c-b4c8-aa9bf5201518 for instance with task_state deleting. {{(pid=75176) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 15:41:56 user nova-compute[75176]: DEBUG nova.compute.manager [req-c5066fa5-6825-42e1-8a3e-3208b3c3bb2b req-80592f5c-db77-4456-968a-46c97e1a6422 service nova] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] Received event network-vif-plugged-e1ac011f-d965-4d4c-b4c8-aa9bf5201518 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:41:56 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-c5066fa5-6825-42e1-8a3e-3208b3c3bb2b req-80592f5c-db77-4456-968a-46c97e1a6422 service nova] Acquiring lock "b714fb94-fcc7-40ae-b3a9-d8c9a60008f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:41:56 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-c5066fa5-6825-42e1-8a3e-3208b3c3bb2b req-80592f5c-db77-4456-968a-46c97e1a6422 service nova] Lock "b714fb94-fcc7-40ae-b3a9-d8c9a60008f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:41:56 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-c5066fa5-6825-42e1-8a3e-3208b3c3bb2b req-80592f5c-db77-4456-968a-46c97e1a6422 service nova] Lock "b714fb94-fcc7-40ae-b3a9-d8c9a60008f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:41:56 user nova-compute[75176]: DEBUG nova.compute.manager [req-c5066fa5-6825-42e1-8a3e-3208b3c3bb2b req-80592f5c-db77-4456-968a-46c97e1a6422 service nova] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] No waiting events found dispatching network-vif-plugged-e1ac011f-d965-4d4c-b4c8-aa9bf5201518 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:41:56 user nova-compute[75176]: WARNING nova.compute.manager [req-c5066fa5-6825-42e1-8a3e-3208b3c3bb2b req-80592f5c-db77-4456-968a-46c97e1a6422 service nova] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] Received unexpected event network-vif-plugged-e1ac011f-d965-4d4c-b4c8-aa9bf5201518 for instance with vm_state active and task_state deleting.
Nov 28 15:41:56 user nova-compute[75176]: DEBUG nova.compute.manager [req-c5066fa5-6825-42e1-8a3e-3208b3c3bb2b req-80592f5c-db77-4456-968a-46c97e1a6422 service nova] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] Received event network-vif-unplugged-04db431e-5bc8-4450-9bdd-82369fafba70 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:41:56 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-c5066fa5-6825-42e1-8a3e-3208b3c3bb2b req-80592f5c-db77-4456-968a-46c97e1a6422 service nova] Acquiring lock "b714fb94-fcc7-40ae-b3a9-d8c9a60008f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:41:56 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-c5066fa5-6825-42e1-8a3e-3208b3c3bb2b req-80592f5c-db77-4456-968a-46c97e1a6422 service nova] Lock "b714fb94-fcc7-40ae-b3a9-d8c9a60008f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:41:56 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-c5066fa5-6825-42e1-8a3e-3208b3c3bb2b req-80592f5c-db77-4456-968a-46c97e1a6422 service nova] Lock "b714fb94-fcc7-40ae-b3a9-d8c9a60008f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:41:56 user nova-compute[75176]: DEBUG nova.compute.manager [req-c5066fa5-6825-42e1-8a3e-3208b3c3bb2b req-80592f5c-db77-4456-968a-46c97e1a6422 service nova] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] No waiting events found dispatching network-vif-unplugged-04db431e-5bc8-4450-9bdd-82369fafba70 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:41:56 user nova-compute[75176]: DEBUG nova.compute.manager [req-c5066fa5-6825-42e1-8a3e-3208b3c3bb2b req-80592f5c-db77-4456-968a-46c97e1a6422 service nova] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] Received event network-vif-unplugged-04db431e-5bc8-4450-9bdd-82369fafba70 for instance with task_state deleting. {{(pid=75176) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 15:41:56 user nova-compute[75176]: DEBUG nova.compute.manager [req-c5066fa5-6825-42e1-8a3e-3208b3c3bb2b req-80592f5c-db77-4456-968a-46c97e1a6422 service nova] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] Received event network-vif-plugged-04db431e-5bc8-4450-9bdd-82369fafba70 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:41:56 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-c5066fa5-6825-42e1-8a3e-3208b3c3bb2b req-80592f5c-db77-4456-968a-46c97e1a6422 service nova] Acquiring lock "b714fb94-fcc7-40ae-b3a9-d8c9a60008f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:41:56 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-c5066fa5-6825-42e1-8a3e-3208b3c3bb2b req-80592f5c-db77-4456-968a-46c97e1a6422 service nova] Lock "b714fb94-fcc7-40ae-b3a9-d8c9a60008f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:41:56 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-c5066fa5-6825-42e1-8a3e-3208b3c3bb2b req-80592f5c-db77-4456-968a-46c97e1a6422 service nova] Lock "b714fb94-fcc7-40ae-b3a9-d8c9a60008f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:41:56 user nova-compute[75176]: DEBUG nova.compute.manager [req-c5066fa5-6825-42e1-8a3e-3208b3c3bb2b req-80592f5c-db77-4456-968a-46c97e1a6422 service nova] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] No waiting events found dispatching network-vif-plugged-04db431e-5bc8-4450-9bdd-82369fafba70 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:41:56 user nova-compute[75176]: WARNING nova.compute.manager [req-c5066fa5-6825-42e1-8a3e-3208b3c3bb2b req-80592f5c-db77-4456-968a-46c97e1a6422 service nova] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] Received unexpected event network-vif-plugged-04db431e-5bc8-4450-9bdd-82369fafba70 for instance with vm_state active and task_state deleting.
Nov 28 15:41:56 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:56 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:56 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:56 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9996a5ef-08, bridge=br-int, if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:41:56 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:56 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:41:56 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:56 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:56 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1dcd0f1a-58ab-4fbc-a1de-f63ce9644f7c) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:41:56 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:56 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:41:56 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:56 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:56 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0ac967e7-41, bridge=br-int, if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:41:56 user nova-compute[75176]: INFO os_vif [None req-b469a21b-cdfb-4f59-9409-786dfeb47caf tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:63:83:5b,bridge_name='br-int',has_traffic_filtering=True,id=da7d30e5-6304-46ec-8d50-336986e6262f,network=Network(b1277b75-5749-436a-a651-3303fd60d8b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda7d30e5-63')
Nov 28 15:41:56 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-b469a21b-cdfb-4f59-9409-786dfeb47caf tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T15:39:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1004277851',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1004277851',id=11,image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAt/lLowBIWQygNmvQblLtMAxvEuh2XUt/OTwbCBERVkLqIQ96jTap/pkeH4XObeedowqO0iM5aqRH1Q9ITpqofPFkYQiFnqenRv5cljG1lxFMkS8D9qDEIlxMTWaLsb0A==',key_name='tempest-keypair-1203087070',keypairs=<?>,launch_index=0,launched_at=2023-11-28T15:40:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0108444c01e94416984b083707102c58',ramdisk_id='',reservation_id='r-j3sryyxs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1183582238',owner_user_name='tempest-TaggedBootDevicesTest-1183582238-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T15:40:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8fb5815faed648a1a207c402eafca90e',uuid=b714fb94-fcc7-40ae-b3a9-d8c9a60008f1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e1ac011f-d965-4d4c-b4c8-aa9bf5201518", "address": "fa:16:3e:7f:e1:ea", "network": {"id": "26bf803a-6aa2-4e87-b407-caee3f8f7d3d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1638676687", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0108444c01e94416984b083707102c58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1ac011f-d9", "ovs_interfaceid": "e1ac011f-d965-4d4c-b4c8-aa9bf5201518", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75176) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 15:41:57 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-b469a21b-cdfb-4f59-9409-786dfeb47caf tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Converting VIF {"id": "e1ac011f-d965-4d4c-b4c8-aa9bf5201518", "address": "fa:16:3e:7f:e1:ea", "network": {"id": "26bf803a-6aa2-4e87-b407-caee3f8f7d3d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1638676687", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0108444c01e94416984b083707102c58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1ac011f-d9", "ovs_interfaceid": "e1ac011f-d965-4d4c-b4c8-aa9bf5201518", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:41:57 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-b469a21b-cdfb-4f59-9409-786dfeb47caf tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:e1:ea,bridge_name='br-int',has_traffic_filtering=True,id=e1ac011f-d965-4d4c-b4c8-aa9bf5201518,network=Network(26bf803a-6aa2-4e87-b407-caee3f8f7d3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape1ac011f-d9') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:41:57 user nova-compute[75176]: DEBUG os_vif [None req-b469a21b-cdfb-4f59-9409-786dfeb47caf tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:e1:ea,bridge_name='br-int',has_traffic_filtering=True,id=e1ac011f-d965-4d4c-b4c8-aa9bf5201518,network=Network(26bf803a-6aa2-4e87-b407-caee3f8f7d3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape1ac011f-d9') {{(pid=75176) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 15:41:57 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:57 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:41:57 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:57 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:57 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c3e84c24-d6e1-4e70-adf4-a1cd6646a5ea) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:41:57 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:57 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:41:57 user nova-compute[75176]: DEBUG nova.objects.instance [None req-a6d20036-7a6f-4750-9aed-016a7bc081df tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] Lazy-loading 'flavor' on Instance uuid e2e25e19-c832-4945-9257-64e6103feb0c {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:41:57 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-a6d20036-7a6f-4750-9aed-016a7bc081df tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] Lock "e2e25e19-c832-4945-9257-64e6103feb0c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.012s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:41:57 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:57 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:57 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape1ac011f-d9, bridge=br-int, if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:41:57 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:57 user nova-compute[75176]: INFO os_vif [None req-4c851341-a4c2-4026-b00d-1e1e8ea739d0 tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e6:32:e5,bridge_name='br-int',has_traffic_filtering=True,id=9996a5ef-0801-4136-bd1d-fd5372d97e9d,network=Network(66701df7-e5c6-4815-936c-2cfec02c127d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9996a5ef-08')
Nov 28 15:41:57 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-4c851341-a4c2-4026-b00d-1e1e8ea739d0 tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] [instance: 4ed0eb85-e975-446c-8da7-148a4bb36958] Deleting instance files /opt/stack/data/nova/instances/4ed0eb85-e975-446c-8da7-148a4bb36958_del
Nov 28 15:41:57 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-4c851341-a4c2-4026-b00d-1e1e8ea739d0 tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] [instance: 4ed0eb85-e975-446c-8da7-148a4bb36958] Deletion of /opt/stack/data/nova/instances/4ed0eb85-e975-446c-8da7-148a4bb36958_del complete
Nov 28 15:41:57 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:41:57 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:57 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:57 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bdb47afe-3693-4beb-9be2-b14a02a62e5f) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:41:57 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:57 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:41:57 user nova-compute[75176]: INFO nova.compute.manager [None req-4c851341-a4c2-4026-b00d-1e1e8ea739d0 tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] [instance: 4ed0eb85-e975-446c-8da7-148a4bb36958] Took 1.97 seconds to destroy the instance on the hypervisor.
Nov 28 15:41:57 user nova-compute[75176]: DEBUG oslo.service.loopingcall [None req-4c851341-a4c2-4026-b00d-1e1e8ea739d0 tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75176) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 15:41:57 user nova-compute[75176]: DEBUG nova.compute.manager [-] [instance: 4ed0eb85-e975-446c-8da7-148a4bb36958] Deallocating network for instance {{(pid=75176) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 15:41:57 user nova-compute[75176]: DEBUG nova.network.neutron [-] [instance: 4ed0eb85-e975-446c-8da7-148a4bb36958] deallocate_for_instance() {{(pid=75176) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 15:41:57 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:57 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:57 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=abfec2c4-a57b-4c05-85d6-967f9386db0e) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:41:57 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:57 user nova-compute[75176]: INFO os_vif [None req-585335e7-3eb7-4c3d-9395-77097f973761 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:ed:17,bridge_name='br-int',has_traffic_filtering=True,id=0ac967e7-41bc-4751-a2bc-499ffbface15,network=Network(d7dbc9c3-816f-46fb-a3d3-e0e817e15de3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0ac967e7-41')
Nov 28 15:41:57 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-585335e7-3eb7-4c3d-9395-77097f973761 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T15:39:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1424070534',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1424070534',id=10,image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPn83B68ew19zNqtC6OrMzgf/bmXCz98qa+rH054zqhA5Gi3ZDmOGiOHPgSu1hkI/yV1KZdhZIiHhrJ1wuOhC1X2w3dTgpgbLguVyd7FUfhz3bRrtdjXABRlYuvBuQRV2A==',key_name='tempest-keypair-1772665281',keypairs=<?>,launch_index=0,launched_at=2023-11-28T15:40:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cfdec2abaf704a1396611ff1bcb96e53',ramdisk_id='',reservation_id='r-0j1w7c0x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1260942437',owner_user_name='tempest-TaggedBootDevicesTest_v242-1260942437-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T15:40:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='97e02c028b814c6993edba6c1caa8afe',uuid=041af768-197b-4c76-a5a1-28e2dc8255bd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3a800e7a-5628-4668-ae3e-d49b537f7a62", "address": "fa:16:3e:e0:28:72", "network": {"id": "d7dbc9c3-816f-46fb-a3d3-e0e817e15de3", "bridge": "br-int", "label": "tempest-device-tagging-net1-136440967", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.25", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfdec2abaf704a1396611ff1bcb96e53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a800e7a-56", "ovs_interfaceid": "3a800e7a-5628-4668-ae3e-d49b537f7a62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 15:41:57 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-585335e7-3eb7-4c3d-9395-77097f973761 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Converting VIF {"id": "3a800e7a-5628-4668-ae3e-d49b537f7a62", "address": "fa:16:3e:e0:28:72", "network": {"id": "d7dbc9c3-816f-46fb-a3d3-e0e817e15de3", "bridge": "br-int", "label": "tempest-device-tagging-net1-136440967", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.25", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfdec2abaf704a1396611ff1bcb96e53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a800e7a-56", "ovs_interfaceid": "3a800e7a-5628-4668-ae3e-d49b537f7a62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:41:57 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-585335e7-3eb7-4c3d-9395-77097f973761 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:28:72,bridge_name='br-int',has_traffic_filtering=True,id=3a800e7a-5628-4668-ae3e-d49b537f7a62,network=Network(d7dbc9c3-816f-46fb-a3d3-e0e817e15de3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a800e7a-56') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:41:57 user nova-compute[75176]: DEBUG os_vif [None req-585335e7-3eb7-4c3d-9395-77097f973761 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:28:72,bridge_name='br-int',has_traffic_filtering=True,id=3a800e7a-5628-4668-ae3e-d49b537f7a62,network=Network(d7dbc9c3-816f-46fb-a3d3-e0e817e15de3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a800e7a-56') {{(pid=75176) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 15:41:57 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:41:57 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:57 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:57 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3a800e7a-56, bridge=br-int, if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:41:57 user nova-compute[75176]: INFO os_vif [None req-b469a21b-cdfb-4f59-9409-786dfeb47caf tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:e1:ea,bridge_name='br-int',has_traffic_filtering=True,id=e1ac011f-d965-4d4c-b4c8-aa9bf5201518,network=Network(26bf803a-6aa2-4e87-b407-caee3f8f7d3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape1ac011f-d9')
Nov 28 15:41:57 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-b469a21b-cdfb-4f59-9409-786dfeb47caf tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T15:39:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1004277851',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1004277851',id=11,image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAt/lLowBIWQygNmvQblLtMAxvEuh2XUt/OTwbCBERVkLqIQ96jTap/pkeH4XObeedowqO0iM5aqRH1Q9ITpqofPFkYQiFnqenRv5cljG1lxFMkS8D9qDEIlxMTWaLsb0A==',key_name='tempest-keypair-1203087070',keypairs=<?>,launch_index=0,launched_at=2023-11-28T15:40:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0108444c01e94416984b083707102c58',ramdisk_id='',reservation_id='r-j3sryyxs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1183582238',owner_user_name='tempest-TaggedBootDevicesTest-1183582238-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T15:40:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8fb5815faed648a1a207c402eafca90e',uuid=b714fb94-fcc7-40ae-b3a9-d8c9a60008f1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "61157920-954a-479e-bd66-b0746a7843a7", "address": "fa:16:3e:8f:4f:39", "network": {"id": "26bf803a-6aa2-4e87-b407-caee3f8f7d3d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1638676687", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0108444c01e94416984b083707102c58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61157920-95", "ovs_interfaceid": "61157920-954a-479e-bd66-b0746a7843a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75176) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 15:41:57 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-b469a21b-cdfb-4f59-9409-786dfeb47caf tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Converting VIF {"id": "61157920-954a-479e-bd66-b0746a7843a7", "address": "fa:16:3e:8f:4f:39", "network": {"id": "26bf803a-6aa2-4e87-b407-caee3f8f7d3d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1638676687", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0108444c01e94416984b083707102c58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61157920-95", "ovs_interfaceid": "61157920-954a-479e-bd66-b0746a7843a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:41:57 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-b469a21b-cdfb-4f59-9409-786dfeb47caf tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:4f:39,bridge_name='br-int',has_traffic_filtering=True,id=61157920-954a-479e-bd66-b0746a7843a7,network=Network(26bf803a-6aa2-4e87-b407-caee3f8f7d3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap61157920-95') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:41:57 user nova-compute[75176]: DEBUG os_vif [None req-b469a21b-cdfb-4f59-9409-786dfeb47caf tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:4f:39,bridge_name='br-int',has_traffic_filtering=True,id=61157920-954a-479e-bd66-b0746a7843a7,network=Network(26bf803a-6aa2-4e87-b407-caee3f8f7d3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap61157920-95') {{(pid=75176) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 15:41:57 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:57 user nova-compute[75176]: DEBUG nova.compute.manager [req-2ff83331-367d-4d1f-81d5-1418ac034198 req-58627bbf-3a58-4250-80c0-5b6109ee87f3 service nova] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] Received event network-vif-unplugged-0c08ccbe-f3de-4aed-b641-8e2b58bd73a0 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:41:57 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-2ff83331-367d-4d1f-81d5-1418ac034198 req-58627bbf-3a58-4250-80c0-5b6109ee87f3 service nova] Acquiring lock "b714fb94-fcc7-40ae-b3a9-d8c9a60008f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:41:57 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-2ff83331-367d-4d1f-81d5-1418ac034198 req-58627bbf-3a58-4250-80c0-5b6109ee87f3 service nova] Lock "b714fb94-fcc7-40ae-b3a9-d8c9a60008f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:41:57 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-2ff83331-367d-4d1f-81d5-1418ac034198 req-58627bbf-3a58-4250-80c0-5b6109ee87f3 service nova] Lock "b714fb94-fcc7-40ae-b3a9-d8c9a60008f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:41:57 user nova-compute[75176]: DEBUG nova.compute.manager [req-2ff83331-367d-4d1f-81d5-1418ac034198 req-58627bbf-3a58-4250-80c0-5b6109ee87f3 service nova] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] No waiting events found dispatching network-vif-unplugged-0c08ccbe-f3de-4aed-b641-8e2b58bd73a0 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:41:57 user nova-compute[75176]: DEBUG nova.compute.manager [req-2ff83331-367d-4d1f-81d5-1418ac034198 req-58627bbf-3a58-4250-80c0-5b6109ee87f3 service nova] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] Received event network-vif-unplugged-0c08ccbe-f3de-4aed-b641-8e2b58bd73a0 for instance with task_state deleting. {{(pid=75176) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 15:41:57 user nova-compute[75176]: DEBUG nova.compute.manager [req-2ff83331-367d-4d1f-81d5-1418ac034198 req-58627bbf-3a58-4250-80c0-5b6109ee87f3 service nova] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] Received event network-vif-plugged-0c08ccbe-f3de-4aed-b641-8e2b58bd73a0 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:41:57 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-2ff83331-367d-4d1f-81d5-1418ac034198 req-58627bbf-3a58-4250-80c0-5b6109ee87f3 service nova] Acquiring lock "b714fb94-fcc7-40ae-b3a9-d8c9a60008f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:41:57 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-2ff83331-367d-4d1f-81d5-1418ac034198 req-58627bbf-3a58-4250-80c0-5b6109ee87f3 service nova] Lock "b714fb94-fcc7-40ae-b3a9-d8c9a60008f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:41:57 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-2ff83331-367d-4d1f-81d5-1418ac034198 req-58627bbf-3a58-4250-80c0-5b6109ee87f3 service nova] Lock "b714fb94-fcc7-40ae-b3a9-d8c9a60008f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:41:57 user nova-compute[75176]: DEBUG nova.compute.manager [req-2ff83331-367d-4d1f-81d5-1418ac034198 req-58627bbf-3a58-4250-80c0-5b6109ee87f3 service nova] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] No waiting events found dispatching network-vif-plugged-0c08ccbe-f3de-4aed-b641-8e2b58bd73a0 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:41:57 user nova-compute[75176]: WARNING nova.compute.manager [req-2ff83331-367d-4d1f-81d5-1418ac034198 req-58627bbf-3a58-4250-80c0-5b6109ee87f3 service nova] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] Received unexpected event network-vif-plugged-0c08ccbe-f3de-4aed-b641-8e2b58bd73a0 for instance with vm_state active and task_state deleting.
Nov 28 15:41:57 user nova-compute[75176]: DEBUG nova.compute.manager [req-2ff83331-367d-4d1f-81d5-1418ac034198 req-58627bbf-3a58-4250-80c0-5b6109ee87f3 service nova] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] Received event network-vif-unplugged-e0b49239-50a0-4864-9e92-22bddcbe7d21 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:41:57 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-2ff83331-367d-4d1f-81d5-1418ac034198 req-58627bbf-3a58-4250-80c0-5b6109ee87f3 service nova] Acquiring lock "b714fb94-fcc7-40ae-b3a9-d8c9a60008f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:41:57 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-2ff83331-367d-4d1f-81d5-1418ac034198 req-58627bbf-3a58-4250-80c0-5b6109ee87f3 service nova] Lock "b714fb94-fcc7-40ae-b3a9-d8c9a60008f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:41:57 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-2ff83331-367d-4d1f-81d5-1418ac034198 req-58627bbf-3a58-4250-80c0-5b6109ee87f3 service nova] Lock "b714fb94-fcc7-40ae-b3a9-d8c9a60008f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:41:57 user nova-compute[75176]: DEBUG nova.compute.manager [req-2ff83331-367d-4d1f-81d5-1418ac034198 req-58627bbf-3a58-4250-80c0-5b6109ee87f3 service nova] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] No waiting events found dispatching network-vif-unplugged-e0b49239-50a0-4864-9e92-22bddcbe7d21 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:41:57 user nova-compute[75176]: DEBUG nova.compute.manager [req-2ff83331-367d-4d1f-81d5-1418ac034198 req-58627bbf-3a58-4250-80c0-5b6109ee87f3 service nova] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] Received event network-vif-unplugged-e0b49239-50a0-4864-9e92-22bddcbe7d21 for instance with task_state deleting. {{(pid=75176) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 15:41:57 user nova-compute[75176]: DEBUG nova.compute.manager [req-2ff83331-367d-4d1f-81d5-1418ac034198 req-58627bbf-3a58-4250-80c0-5b6109ee87f3 service nova] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] Received event network-vif-plugged-e0b49239-50a0-4864-9e92-22bddcbe7d21 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:41:57 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-2ff83331-367d-4d1f-81d5-1418ac034198 req-58627bbf-3a58-4250-80c0-5b6109ee87f3 service nova] Acquiring lock "b714fb94-fcc7-40ae-b3a9-d8c9a60008f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:41:57 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-2ff83331-367d-4d1f-81d5-1418ac034198 req-58627bbf-3a58-4250-80c0-5b6109ee87f3 service nova] Lock "b714fb94-fcc7-40ae-b3a9-d8c9a60008f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:41:57 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-2ff83331-367d-4d1f-81d5-1418ac034198 req-58627bbf-3a58-4250-80c0-5b6109ee87f3 service nova] Lock "b714fb94-fcc7-40ae-b3a9-d8c9a60008f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:41:57 user nova-compute[75176]: DEBUG nova.compute.manager [req-2ff83331-367d-4d1f-81d5-1418ac034198 req-58627bbf-3a58-4250-80c0-5b6109ee87f3 service nova] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] No waiting events found dispatching network-vif-plugged-e0b49239-50a0-4864-9e92-22bddcbe7d21 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:41:57 user nova-compute[75176]: WARNING nova.compute.manager [req-2ff83331-367d-4d1f-81d5-1418ac034198 req-58627bbf-3a58-4250-80c0-5b6109ee87f3 service nova] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] Received unexpected event network-vif-plugged-e0b49239-50a0-4864-9e92-22bddcbe7d21 for instance with vm_state active and task_state deleting.
Nov 28 15:41:57 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:41:57 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:57 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:57 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap61157920-95, bridge=br-int, if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:41:57 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:57 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:41:57 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:57 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:57 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a7350ff4-857a-473c-8131-b081b17b8431) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:41:57 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:57 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:41:57 user nova-compute[75176]: DEBUG nova.compute.manager [req-0ab94cb0-b699-4fa2-b55f-0b6c35bfc5dd req-a12dd7e0-2fb3-4ab7-a66a-c6e2f8d38eb6 service nova] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] Received event network-vif-plugged-da7d30e5-6304-46ec-8d50-336986e6262f {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:41:57 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-0ab94cb0-b699-4fa2-b55f-0b6c35bfc5dd req-a12dd7e0-2fb3-4ab7-a66a-c6e2f8d38eb6 service nova] Acquiring lock "b714fb94-fcc7-40ae-b3a9-d8c9a60008f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:41:57 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-0ab94cb0-b699-4fa2-b55f-0b6c35bfc5dd req-a12dd7e0-2fb3-4ab7-a66a-c6e2f8d38eb6 service nova] Lock "b714fb94-fcc7-40ae-b3a9-d8c9a60008f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:41:57 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-0ab94cb0-b699-4fa2-b55f-0b6c35bfc5dd req-a12dd7e0-2fb3-4ab7-a66a-c6e2f8d38eb6 service nova] Lock "b714fb94-fcc7-40ae-b3a9-d8c9a60008f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:41:57 user nova-compute[75176]: DEBUG nova.compute.manager [req-0ab94cb0-b699-4fa2-b55f-0b6c35bfc5dd req-a12dd7e0-2fb3-4ab7-a66a-c6e2f8d38eb6 service nova] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] No waiting events found dispatching network-vif-plugged-da7d30e5-6304-46ec-8d50-336986e6262f {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:41:57 user nova-compute[75176]: WARNING nova.compute.manager [req-0ab94cb0-b699-4fa2-b55f-0b6c35bfc5dd req-a12dd7e0-2fb3-4ab7-a66a-c6e2f8d38eb6 service nova] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] Received unexpected event network-vif-plugged-da7d30e5-6304-46ec-8d50-336986e6262f for instance with vm_state active and task_state deleting.
Nov 28 15:41:57 user nova-compute[75176]: DEBUG nova.compute.manager [req-0ab94cb0-b699-4fa2-b55f-0b6c35bfc5dd req-a12dd7e0-2fb3-4ab7-a66a-c6e2f8d38eb6 service nova] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] Received event network-vif-unplugged-0bc36ba8-7fc6-47b2-b7b1-08a445625b46 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:41:57 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-0ab94cb0-b699-4fa2-b55f-0b6c35bfc5dd req-a12dd7e0-2fb3-4ab7-a66a-c6e2f8d38eb6 service nova] Acquiring lock "b714fb94-fcc7-40ae-b3a9-d8c9a60008f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:41:57 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-0ab94cb0-b699-4fa2-b55f-0b6c35bfc5dd req-a12dd7e0-2fb3-4ab7-a66a-c6e2f8d38eb6 service nova] Lock "b714fb94-fcc7-40ae-b3a9-d8c9a60008f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:41:57 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-0ab94cb0-b699-4fa2-b55f-0b6c35bfc5dd req-a12dd7e0-2fb3-4ab7-a66a-c6e2f8d38eb6 service nova] Lock "b714fb94-fcc7-40ae-b3a9-d8c9a60008f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:41:57 user nova-compute[75176]: DEBUG nova.compute.manager [req-0ab94cb0-b699-4fa2-b55f-0b6c35bfc5dd req-a12dd7e0-2fb3-4ab7-a66a-c6e2f8d38eb6 service nova] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] No waiting events found dispatching network-vif-unplugged-0bc36ba8-7fc6-47b2-b7b1-08a445625b46 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:41:57 user nova-compute[75176]: DEBUG nova.compute.manager [req-0ab94cb0-b699-4fa2-b55f-0b6c35bfc5dd req-a12dd7e0-2fb3-4ab7-a66a-c6e2f8d38eb6 service nova] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] Received event network-vif-unplugged-0bc36ba8-7fc6-47b2-b7b1-08a445625b46 for instance with task_state deleting. {{(pid=75176) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 15:41:57 user nova-compute[75176]: DEBUG nova.compute.manager [req-0ab94cb0-b699-4fa2-b55f-0b6c35bfc5dd req-a12dd7e0-2fb3-4ab7-a66a-c6e2f8d38eb6 service nova] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] Received event network-vif-plugged-0bc36ba8-7fc6-47b2-b7b1-08a445625b46 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:41:57 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-0ab94cb0-b699-4fa2-b55f-0b6c35bfc5dd req-a12dd7e0-2fb3-4ab7-a66a-c6e2f8d38eb6 service nova] Acquiring lock "b714fb94-fcc7-40ae-b3a9-d8c9a60008f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:41:57 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-0ab94cb0-b699-4fa2-b55f-0b6c35bfc5dd req-a12dd7e0-2fb3-4ab7-a66a-c6e2f8d38eb6 service nova] Lock "b714fb94-fcc7-40ae-b3a9-d8c9a60008f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:41:57 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-0ab94cb0-b699-4fa2-b55f-0b6c35bfc5dd req-a12dd7e0-2fb3-4ab7-a66a-c6e2f8d38eb6 service nova] Lock "b714fb94-fcc7-40ae-b3a9-d8c9a60008f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:41:57 user nova-compute[75176]: DEBUG nova.compute.manager [req-0ab94cb0-b699-4fa2-b55f-0b6c35bfc5dd req-a12dd7e0-2fb3-4ab7-a66a-c6e2f8d38eb6 service nova] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] No waiting events found dispatching network-vif-plugged-0bc36ba8-7fc6-47b2-b7b1-08a445625b46 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:41:57 user nova-compute[75176]: WARNING nova.compute.manager [req-0ab94cb0-b699-4fa2-b55f-0b6c35bfc5dd req-a12dd7e0-2fb3-4ab7-a66a-c6e2f8d38eb6 service nova] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] Received unexpected event network-vif-plugged-0bc36ba8-7fc6-47b2-b7b1-08a445625b46 for instance with vm_state active and task_state deleting.
Nov 28 15:41:57 user nova-compute[75176]: DEBUG nova.compute.manager [req-0ab94cb0-b699-4fa2-b55f-0b6c35bfc5dd req-a12dd7e0-2fb3-4ab7-a66a-c6e2f8d38eb6 service nova] [instance: 4ed0eb85-e975-446c-8da7-148a4bb36958] Received event network-vif-unplugged-9996a5ef-0801-4136-bd1d-fd5372d97e9d {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:41:57 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-0ab94cb0-b699-4fa2-b55f-0b6c35bfc5dd req-a12dd7e0-2fb3-4ab7-a66a-c6e2f8d38eb6 service nova] Acquiring lock "4ed0eb85-e975-446c-8da7-148a4bb36958-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:41:57 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-0ab94cb0-b699-4fa2-b55f-0b6c35bfc5dd req-a12dd7e0-2fb3-4ab7-a66a-c6e2f8d38eb6 service nova] Lock "4ed0eb85-e975-446c-8da7-148a4bb36958-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:41:57 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-0ab94cb0-b699-4fa2-b55f-0b6c35bfc5dd req-a12dd7e0-2fb3-4ab7-a66a-c6e2f8d38eb6 service nova] Lock "4ed0eb85-e975-446c-8da7-148a4bb36958-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:41:57 user nova-compute[75176]: DEBUG nova.compute.manager [req-0ab94cb0-b699-4fa2-b55f-0b6c35bfc5dd req-a12dd7e0-2fb3-4ab7-a66a-c6e2f8d38eb6 service nova] [instance: 4ed0eb85-e975-446c-8da7-148a4bb36958] No waiting events found dispatching network-vif-unplugged-9996a5ef-0801-4136-bd1d-fd5372d97e9d {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:41:57 user nova-compute[75176]: DEBUG nova.compute.manager [req-0ab94cb0-b699-4fa2-b55f-0b6c35bfc5dd req-a12dd7e0-2fb3-4ab7-a66a-c6e2f8d38eb6 service nova] [instance: 4ed0eb85-e975-446c-8da7-148a4bb36958] Received event network-vif-unplugged-9996a5ef-0801-4136-bd1d-fd5372d97e9d for instance with task_state deleting. {{(pid=75176) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 15:41:57 user nova-compute[75176]: DEBUG nova.compute.manager [req-0ab94cb0-b699-4fa2-b55f-0b6c35bfc5dd req-a12dd7e0-2fb3-4ab7-a66a-c6e2f8d38eb6 service nova] [instance: 4ed0eb85-e975-446c-8da7-148a4bb36958] Received event network-vif-plugged-9996a5ef-0801-4136-bd1d-fd5372d97e9d {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:41:57 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-0ab94cb0-b699-4fa2-b55f-0b6c35bfc5dd req-a12dd7e0-2fb3-4ab7-a66a-c6e2f8d38eb6 service nova] Acquiring lock "4ed0eb85-e975-446c-8da7-148a4bb36958-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:41:57 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-0ab94cb0-b699-4fa2-b55f-0b6c35bfc5dd req-a12dd7e0-2fb3-4ab7-a66a-c6e2f8d38eb6 service nova] Lock "4ed0eb85-e975-446c-8da7-148a4bb36958-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:41:57 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-0ab94cb0-b699-4fa2-b55f-0b6c35bfc5dd req-a12dd7e0-2fb3-4ab7-a66a-c6e2f8d38eb6 service nova] Lock "4ed0eb85-e975-446c-8da7-148a4bb36958-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:41:57 user nova-compute[75176]: DEBUG nova.compute.manager [req-0ab94cb0-b699-4fa2-b55f-0b6c35bfc5dd req-a12dd7e0-2fb3-4ab7-a66a-c6e2f8d38eb6 service nova] [instance: 4ed0eb85-e975-446c-8da7-148a4bb36958] No waiting events found dispatching network-vif-plugged-9996a5ef-0801-4136-bd1d-fd5372d97e9d {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:41:57 user nova-compute[75176]: WARNING nova.compute.manager [req-0ab94cb0-b699-4fa2-b55f-0b6c35bfc5dd req-a12dd7e0-2fb3-4ab7-a66a-c6e2f8d38eb6 service nova] [instance: 4ed0eb85-e975-446c-8da7-148a4bb36958] Received unexpected event network-vif-plugged-9996a5ef-0801-4136-bd1d-fd5372d97e9d for instance with vm_state active and task_state deleting.
Nov 28 15:41:57 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:57 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:57 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6d37c9be-a14a-434c-be28-0b1e619e9459) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:41:57 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:57 user nova-compute[75176]: INFO os_vif [None req-585335e7-3eb7-4c3d-9395-77097f973761 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:28:72,bridge_name='br-int',has_traffic_filtering=True,id=3a800e7a-5628-4668-ae3e-d49b537f7a62,network=Network(d7dbc9c3-816f-46fb-a3d3-e0e817e15de3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a800e7a-56')
Nov 28 15:41:57 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-585335e7-3eb7-4c3d-9395-77097f973761 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T15:39:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1424070534',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1424070534',id=10,image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPn83B68ew19zNqtC6OrMzgf/bmXCz98qa+rH054zqhA5Gi3ZDmOGiOHPgSu1hkI/yV1KZdhZIiHhrJ1wuOhC1X2w3dTgpgbLguVyd7FUfhz3bRrtdjXABRlYuvBuQRV2A==',key_name='tempest-keypair-1772665281',keypairs=<?>,launch_index=0,launched_at=2023-11-28T15:40:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cfdec2abaf704a1396611ff1bcb96e53',ramdisk_id='',reservation_id='r-0j1w7c0x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1260942437',owner_user_name='tempest-TaggedBootDevicesTest_v242-1260942437-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T15:40:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='97e02c028b814c6993edba6c1caa8afe',uuid=041af768-197b-4c76-a5a1-28e2dc8255bd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d9a60043-45d0-46f1-8d0f-ad1c7b55fa06", "address": "fa:16:3e:5c:fb:31", "network": {"id": "d7dbc9c3-816f-46fb-a3d3-e0e817e15de3", "bridge": "br-int", "label": "tempest-device-tagging-net1-136440967", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.54", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfdec2abaf704a1396611ff1bcb96e53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9a60043-45", "ovs_interfaceid": "d9a60043-45d0-46f1-8d0f-ad1c7b55fa06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 15:41:57 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-585335e7-3eb7-4c3d-9395-77097f973761 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Converting VIF {"id": "d9a60043-45d0-46f1-8d0f-ad1c7b55fa06", "address": "fa:16:3e:5c:fb:31", "network": {"id": "d7dbc9c3-816f-46fb-a3d3-e0e817e15de3", "bridge": "br-int", "label": "tempest-device-tagging-net1-136440967", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.54", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfdec2abaf704a1396611ff1bcb96e53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9a60043-45", "ovs_interfaceid": "d9a60043-45d0-46f1-8d0f-ad1c7b55fa06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:41:57 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-585335e7-3eb7-4c3d-9395-77097f973761 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:fb:31,bridge_name='br-int',has_traffic_filtering=True,id=d9a60043-45d0-46f1-8d0f-ad1c7b55fa06,network=Network(d7dbc9c3-816f-46fb-a3d3-e0e817e15de3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9a60043-45') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:41:57 user nova-compute[75176]: DEBUG os_vif [None req-585335e7-3eb7-4c3d-9395-77097f973761 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:fb:31,bridge_name='br-int',has_traffic_filtering=True,id=d9a60043-45d0-46f1-8d0f-ad1c7b55fa06,network=Network(d7dbc9c3-816f-46fb-a3d3-e0e817e15de3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9a60043-45') {{(pid=75176) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 15:41:57 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:41:57 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:57 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:57 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd9a60043-45, bridge=br-int, if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:41:57 user nova-compute[75176]: INFO os_vif [None req-b469a21b-cdfb-4f59-9409-786dfeb47caf tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:4f:39,bridge_name='br-int',has_traffic_filtering=True,id=61157920-954a-479e-bd66-b0746a7843a7,network=Network(26bf803a-6aa2-4e87-b407-caee3f8f7d3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap61157920-95')
Nov 28 15:41:57 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-b469a21b-cdfb-4f59-9409-786dfeb47caf tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T15:39:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1004277851',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1004277851',id=11,image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAt/lLowBIWQygNmvQblLtMAxvEuh2XUt/OTwbCBERVkLqIQ96jTap/pkeH4XObeedowqO0iM5aqRH1Q9ITpqofPFkYQiFnqenRv5cljG1lxFMkS8D9qDEIlxMTWaLsb0A==',key_name='tempest-keypair-1203087070',keypairs=<?>,launch_index=0,launched_at=2023-11-28T15:40:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0108444c01e94416984b083707102c58',ramdisk_id='',reservation_id='r-j3sryyxs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1183582238',owner_user_name='tempest-TaggedBootDevicesTest-1183582238-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T15:40:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8fb5815faed648a1a207c402eafca90e',uuid=b714fb94-fcc7-40ae-b3a9-d8c9a60008f1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "04db431e-5bc8-4450-9bdd-82369fafba70", "address": "fa:16:3e:15:71:6f", "network": {"id": "26bf803a-6aa2-4e87-b407-caee3f8f7d3d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1638676687", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0108444c01e94416984b083707102c58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04db431e-5b", "ovs_interfaceid": "04db431e-5bc8-4450-9bdd-82369fafba70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 15:41:57 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-b469a21b-cdfb-4f59-9409-786dfeb47caf tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Converting VIF {"id": "04db431e-5bc8-4450-9bdd-82369fafba70", "address": "fa:16:3e:15:71:6f", "network": {"id": "26bf803a-6aa2-4e87-b407-caee3f8f7d3d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1638676687", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0108444c01e94416984b083707102c58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04db431e-5b", "ovs_interfaceid": "04db431e-5bc8-4450-9bdd-82369fafba70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:41:57 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-b469a21b-cdfb-4f59-9409-786dfeb47caf tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:71:6f,bridge_name='br-int',has_traffic_filtering=True,id=04db431e-5bc8-4450-9bdd-82369fafba70,network=Network(26bf803a-6aa2-4e87-b407-caee3f8f7d3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04db431e-5b') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:41:57 user nova-compute[75176]: DEBUG os_vif [None req-b469a21b-cdfb-4f59-9409-786dfeb47caf tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:71:6f,bridge_name='br-int',has_traffic_filtering=True,id=04db431e-5bc8-4450-9bdd-82369fafba70,network=Network(26bf803a-6aa2-4e87-b407-caee3f8f7d3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04db431e-5b') {{(pid=75176) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 15:41:57 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:57 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:41:57 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:57 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:57 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap04db431e-5b, bridge=br-int, if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:41:57 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:58 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:41:58 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:58 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:58 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=affd9008-4bc2-4e0e-94f0-ced47cda6b6e) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:41:58 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:58 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:41:58 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-1d25bad1-7d08-4172-b1ea-9e3f1ad2ebaa tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] Acquiring lock "interface-e2e25e19-c832-4945-9257-64e6103feb0c-e5bd47ee-addd-42fc-9585-aa5515c145f7" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:41:58 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-1d25bad1-7d08-4172-b1ea-9e3f1ad2ebaa tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] Lock "interface-e2e25e19-c832-4945-9257-64e6103feb0c-e5bd47ee-addd-42fc-9585-aa5515c145f7" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:41:58 user nova-compute[75176]: DEBUG nova.objects.instance [None req-1d25bad1-7d08-4172-b1ea-9e3f1ad2ebaa tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] Lazy-loading 'flavor' on Instance uuid e2e25e19-c832-4945-9257-64e6103feb0c {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:41:58 user nova-compute[75176]: DEBUG nova.network.neutron [-] [instance: 4ed0eb85-e975-446c-8da7-148a4bb36958] Updating instance_info_cache with network_info: [] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:41:58 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:58 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:58 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8a9c4a60-72ad-438f-9cd5-335f845473d2) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:41:58 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:58 user nova-compute[75176]: INFO os_vif [None req-585335e7-3eb7-4c3d-9395-77097f973761 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:fb:31,bridge_name='br-int',has_traffic_filtering=True,id=d9a60043-45d0-46f1-8d0f-ad1c7b55fa06,network=Network(d7dbc9c3-816f-46fb-a3d3-e0e817e15de3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9a60043-45')
Nov 28 15:41:58 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-585335e7-3eb7-4c3d-9395-77097f973761 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T15:39:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1424070534',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1424070534',id=10,image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPn83B68ew19zNqtC6OrMzgf/bmXCz98qa+rH054zqhA5Gi3ZDmOGiOHPgSu1hkI/yV1KZdhZIiHhrJ1wuOhC1X2w3dTgpgbLguVyd7FUfhz3bRrtdjXABRlYuvBuQRV2A==',key_name='tempest-keypair-1772665281',keypairs=<?>,launch_index=0,launched_at=2023-11-28T15:40:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cfdec2abaf704a1396611ff1bcb96e53',ramdisk_id='',reservation_id='r-0j1w7c0x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1260942437',owner_user_name='tempest-TaggedBootDevicesTest_v242-1260942437-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T15:40:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='97e02c028b814c6993edba6c1caa8afe',uuid=041af768-197b-4c76-a5a1-28e2dc8255bd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0c65b96a-0fce-4bff-b89c-443cc48f6995", "address": "fa:16:3e:c4:dc:af", "network": {"id": "6a9822be-add5-4d71-8ef1-1ce105eed6af", "bridge": "br-int", "label": "tempest-device-tagging-net2-401277966", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cfdec2abaf704a1396611ff1bcb96e53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c65b96a-0f", "ovs_interfaceid": "0c65b96a-0fce-4bff-b89c-443cc48f6995", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 15:41:58 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-585335e7-3eb7-4c3d-9395-77097f973761 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Converting VIF {"id": "0c65b96a-0fce-4bff-b89c-443cc48f6995", "address": "fa:16:3e:c4:dc:af", "network": {"id": "6a9822be-add5-4d71-8ef1-1ce105eed6af", "bridge": "br-int", "label": "tempest-device-tagging-net2-401277966", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cfdec2abaf704a1396611ff1bcb96e53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c65b96a-0f", "ovs_interfaceid": "0c65b96a-0fce-4bff-b89c-443cc48f6995", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:41:58 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-585335e7-3eb7-4c3d-9395-77097f973761 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:dc:af,bridge_name='br-int',has_traffic_filtering=True,id=0c65b96a-0fce-4bff-b89c-443cc48f6995,network=Network(6a9822be-add5-4d71-8ef1-1ce105eed6af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c65b96a-0f') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:41:58 user nova-compute[75176]: DEBUG os_vif [None req-585335e7-3eb7-4c3d-9395-77097f973761 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:dc:af,bridge_name='br-int',has_traffic_filtering=True,id=0c65b96a-0fce-4bff-b89c-443cc48f6995,network=Network(6a9822be-add5-4d71-8ef1-1ce105eed6af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c65b96a-0f') {{(pid=75176) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 15:41:58 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:41:58 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-1d25bad1-7d08-4172-b1ea-9e3f1ad2ebaa tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T15:39:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1735788857',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1735788857',id=6,image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLYd6lLWkEZSf+41ikXMqtG28NM8Q+hVwVe3wmXerHL+M0XqnrZ3u3KddSHLIIe0vvFogrQWiaY5StKzsHvoccjRJn8doyVKS0uym1H0FtgpShdYQ4yF2e0Gu6ZxuZcJSg==',key_name='tempest-keypair-1836481900',keypairs=<?>,launch_index=0,launched_at=2023-11-28T15:39:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2ca8d4f7f4934dbdbd6ba92f51fba4b6',ramdisk_id='',reservation_id='r-62ikbebi',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-231716548',owner_user_name='tempest-TaggedAttachmentsTest-231716548-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T15:39:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5b8c4eae6ef14fa2b416c67f86e85971',uuid=e2e25e19-c832-4945-9257-64e6103feb0c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e5bd47ee-addd-42fc-9585-aa5515c145f7", "address": "fa:16:3e:be:ab:10", "network": {"id": "e04fe3c5-8edf-4a87-bdec-9fd7e9374310", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1938354238", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "2ca8d4f7f4934dbdbd6ba92f51fba4b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5bd47ee-ad", "ovs_interfaceid": "e5bd47ee-addd-42fc-9585-aa5515c145f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75176) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 15:41:58 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-1d25bad1-7d08-4172-b1ea-9e3f1ad2ebaa tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] Converting VIF {"id": "e5bd47ee-addd-42fc-9585-aa5515c145f7", "address": "fa:16:3e:be:ab:10", "network": {"id": "e04fe3c5-8edf-4a87-bdec-9fd7e9374310", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1938354238", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "2ca8d4f7f4934dbdbd6ba92f51fba4b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5bd47ee-ad", "ovs_interfaceid": "e5bd47ee-addd-42fc-9585-aa5515c145f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:41:58 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-1d25bad1-7d08-4172-b1ea-9e3f1ad2ebaa tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:ab:10,bridge_name='br-int',has_traffic_filtering=True,id=e5bd47ee-addd-42fc-9585-aa5515c145f7,network=Network(e04fe3c5-8edf-4a87-bdec-9fd7e9374310),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5bd47ee-ad') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:41:58 user nova-compute[75176]: INFO nova.compute.manager [-] [instance: 4ed0eb85-e975-446c-8da7-148a4bb36958] Took 0.77 seconds to deallocate network for instance.
Nov 28 15:41:58 user nova-compute[75176]: DEBUG nova.virt.libvirt.guest [None req-1d25bad1-7d08-4172-b1ea-9e3f1ad2ebaa tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:be:ab:10"/><model type="virtio"/><mtu size="1442"/><target dev="tape5bd47ee-ad"/></interface> {{(pid=75176) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 28 15:41:58 user nova-compute[75176]: DEBUG nova.virt.libvirt.guest [None req-1d25bad1-7d08-4172-b1ea-9e3f1ad2ebaa tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:be:ab:10"/><model type="virtio"/><mtu size="1442"/><target dev="tape5bd47ee-ad"/></interface> {{(pid=75176) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 28 15:41:58 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-1d25bad1-7d08-4172-b1ea-9e3f1ad2ebaa tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] Attempting to detach device tape5bd47ee-ad from instance e2e25e19-c832-4945-9257-64e6103feb0c from the persistent domain config. {{(pid=75176) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 15:41:58 user nova-compute[75176]: DEBUG nova.virt.libvirt.guest [None req-1d25bad1-7d08-4172-b1ea-9e3f1ad2ebaa tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] detach device xml: <interface type="ethernet">
Nov 28 15:41:58 user nova-compute[75176]:   <mac address="fa:16:3e:be:ab:10"/>
Nov 28 15:41:58 user nova-compute[75176]:   <model type="virtio"/>
Nov 28 15:41:58 user nova-compute[75176]:   <mtu size="1442"/>
Nov 28 15:41:58 user nova-compute[75176]:   <target dev="tape5bd47ee-ad"/>
Nov 28 15:41:58 user nova-compute[75176]: </interface>
Nov 28 15:41:58 user nova-compute[75176]:  {{(pid=75176) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 15:41:58 user nova-compute[75176]: DEBUG nova.virt.libvirt.guest [None req-1d25bad1-7d08-4172-b1ea-9e3f1ad2ebaa tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:be:ab:10"/><model type="virtio"/><mtu size="1442"/><target dev="tape5bd47ee-ad"/></interface> {{(pid=75176) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 28 15:41:58 user nova-compute[75176]: DEBUG nova.virt.libvirt.guest [None req-1d25bad1-7d08-4172-b1ea-9e3f1ad2ebaa tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:be:ab:10"/><model type="virtio"/><mtu size="1442"/><target dev="tape5bd47ee-ad"/></interface>not found in domain: <domain type='kvm' id='6'>
Nov 28 15:41:58 user nova-compute[75176]:   <name>instance-00000006</name>
Nov 28 15:41:58 user nova-compute[75176]:   <uuid>e2e25e19-c832-4945-9257-64e6103feb0c</uuid>
Nov 28 15:41:58 user nova-compute[75176]:   <metadata>
Nov 28 15:41:58 user nova-compute[75176]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 15:41:58 user nova-compute[75176]:   <nova:package version="0.0.0"/>
Nov 28 15:41:58 user nova-compute[75176]:   <nova:name>tempest-device-tagging-server-1735788857</nova:name>
Nov 28 15:41:58 user nova-compute[75176]:   <nova:creationTime>2023-11-28 15:41:20</nova:creationTime>
Nov 28 15:41:58 user nova-compute[75176]:   <nova:flavor name="m1.tiny">
Nov 28 15:41:58 user nova-compute[75176]:     <nova:memory>512</nova:memory>
Nov 28 15:41:58 user nova-compute[75176]:     <nova:disk>1</nova:disk>
Nov 28 15:41:58 user nova-compute[75176]:     <nova:swap>0</nova:swap>
Nov 28 15:41:58 user nova-compute[75176]:     <nova:ephemeral>0</nova:ephemeral>
Nov 28 15:41:58 user nova-compute[75176]:     <nova:vcpus>1</nova:vcpus>
Nov 28 15:41:58 user nova-compute[75176]:   </nova:flavor>
Nov 28 15:41:58 user nova-compute[75176]:   <nova:owner>
Nov 28 15:41:58 user nova-compute[75176]:     <nova:user uuid="5b8c4eae6ef14fa2b416c67f86e85971">tempest-TaggedAttachmentsTest-231716548-project-member</nova:user>
Nov 28 15:41:58 user nova-compute[75176]:     <nova:project uuid="2ca8d4f7f4934dbdbd6ba92f51fba4b6">tempest-TaggedAttachmentsTest-231716548</nova:project>
Nov 28 15:41:58 user nova-compute[75176]:   </nova:owner>
Nov 28 15:41:58 user nova-compute[75176]:   <nova:root type="image" uuid="1f41819e-c93f-4dc7-b253-37a27bbbbc74"/>
Nov 28 15:41:58 user nova-compute[75176]:   <nova:ports>
Nov 28 15:41:58 user nova-compute[75176]:     <nova:port uuid="05efa912-30d1-4474-a2eb-7d88fa0813e7">
Nov 28 15:41:58 user nova-compute[75176]:       <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 28 15:41:58 user nova-compute[75176]:     </nova:port>
Nov 28 15:41:58 user nova-compute[75176]:     <nova:port uuid="e5bd47ee-addd-42fc-9585-aa5515c145f7">
Nov 28 15:41:58 user nova-compute[75176]:       <nova:ip type="fixed" address="10.10.10.153" ipVersion="4"/>
Nov 28 15:41:58 user nova-compute[75176]:     </nova:port>
Nov 28 15:41:58 user nova-compute[75176]:   </nova:ports>
Nov 28 15:41:58 user nova-compute[75176]: </nova:instance>
Nov 28 15:41:58 user nova-compute[75176]:   </metadata>
Nov 28 15:41:58 user nova-compute[75176]:   <memory unit='KiB'>524288</memory>
Nov 28 15:41:58 user nova-compute[75176]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 28 15:41:58 user nova-compute[75176]:   <vcpu placement='static'>1</vcpu>
Nov 28 15:41:58 user nova-compute[75176]:   <resource>
Nov 28 15:41:58 user nova-compute[75176]:     <partition>/machine</partition>
Nov 28 15:41:58 user nova-compute[75176]:   </resource>
Nov 28 15:41:58 user nova-compute[75176]:   <sysinfo type='smbios'>
Nov 28 15:41:58 user nova-compute[75176]:     <system>
Nov 28 15:41:58 user nova-compute[75176]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 28 15:41:58 user nova-compute[75176]:       <entry name='product'>OpenStack Nova</entry>
Nov 28 15:41:58 user nova-compute[75176]:       <entry name='version'>0.0.0</entry>
Nov 28 15:41:58 user nova-compute[75176]:       <entry name='serial'>e2e25e19-c832-4945-9257-64e6103feb0c</entry>
Nov 28 15:41:58 user nova-compute[75176]:       <entry name='uuid'>e2e25e19-c832-4945-9257-64e6103feb0c</entry>
Nov 28 15:41:58 user nova-compute[75176]:       <entry name='family'>Virtual Machine</entry>
Nov 28 15:41:58 user nova-compute[75176]:     </system>
Nov 28 15:41:58 user nova-compute[75176]:   </sysinfo>
Nov 28 15:41:58 user nova-compute[75176]:   <os>
Nov 28 15:41:58 user nova-compute[75176]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 28 15:41:58 user nova-compute[75176]:     <boot dev='hd'/>
Nov 28 15:41:58 user nova-compute[75176]:     <smbios mode='sysinfo'/>
Nov 28 15:41:58 user nova-compute[75176]:   </os>
Nov 28 15:41:58 user nova-compute[75176]:   <features>
Nov 28 15:41:58 user nova-compute[75176]:     <acpi/>
Nov 28 15:41:58 user nova-compute[75176]:     <apic/>
Nov 28 15:41:58 user nova-compute[75176]:     <vmcoreinfo state='on'/>
Nov 28 15:41:58 user nova-compute[75176]:   </features>
Nov 28 15:41:58 user nova-compute[75176]:   <cpu mode='custom' match='exact' check='full'>
Nov 28 15:41:58 user nova-compute[75176]:     <model fallback='forbid'>Nehalem</model>
Nov 28 15:41:58 user nova-compute[75176]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 28 15:41:58 user nova-compute[75176]:     <feature policy='require' name='vme'/>
Nov 28 15:41:58 user nova-compute[75176]:     <feature policy='require' name='x2apic'/>
Nov 28 15:41:58 user nova-compute[75176]:     <feature policy='require' name='hypervisor'/>
Nov 28 15:41:58 user nova-compute[75176]:   </cpu>
Nov 28 15:41:58 user nova-compute[75176]:   <clock offset='utc'>
Nov 28 15:41:58 user nova-compute[75176]:     <timer name='pit' tickpolicy='delay'/>
Nov 28 15:41:58 user nova-compute[75176]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 28 15:41:58 user nova-compute[75176]:     <timer name='hpet' present='no'/>
Nov 28 15:41:58 user nova-compute[75176]:   </clock>
Nov 28 15:41:58 user nova-compute[75176]:   <on_poweroff>destroy</on_poweroff>
Nov 28 15:41:58 user nova-compute[75176]:   <on_reboot>restart</on_reboot>
Nov 28 15:41:58 user nova-compute[75176]:   <on_crash>destroy</on_crash>
Nov 28 15:41:58 user nova-compute[75176]:   <devices>
Nov 28 15:41:58 user nova-compute[75176]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 28 15:41:58 user nova-compute[75176]:     <disk type='file' device='disk'>
Nov 28 15:41:58 user nova-compute[75176]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 28 15:41:58 user nova-compute[75176]:       <source file='/opt/stack/data/nova/instances/e2e25e19-c832-4945-9257-64e6103feb0c/disk' index='2'/>
Nov 28 15:41:58 user nova-compute[75176]:       <backingStore type='file' index='3'>
Nov 28 15:41:58 user nova-compute[75176]:         <format type='raw'/>
Nov 28 15:41:58 user nova-compute[75176]:         <source file='/opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2'/>
Nov 28 15:41:58 user nova-compute[75176]:         <backingStore/>
Nov 28 15:41:58 user nova-compute[75176]:       </backingStore>
Nov 28 15:41:58 user nova-compute[75176]:       <target dev='vda' bus='virtio'/>
Nov 28 15:41:58 user nova-compute[75176]:       <alias name='virtio-disk0'/>
Nov 28 15:41:58 user nova-compute[75176]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 28 15:41:58 user nova-compute[75176]:     </disk>
Nov 28 15:41:58 user nova-compute[75176]:     <disk type='file' device='cdrom'>
Nov 28 15:41:58 user nova-compute[75176]:       <driver name='qemu' type='raw' cache='none'/>
Nov 28 15:41:58 user nova-compute[75176]:       <source file='/opt/stack/data/nova/instances/e2e25e19-c832-4945-9257-64e6103feb0c/disk.config' index='1'/>
Nov 28 15:41:58 user nova-compute[75176]:       <backingStore/>
Nov 28 15:41:58 user nova-compute[75176]:       <target dev='hda' bus='ide'/>
Nov 28 15:41:58 user nova-compute[75176]:       <readonly/>
Nov 28 15:41:58 user nova-compute[75176]:       <alias name='ide0-0-0'/>
Nov 28 15:41:58 user nova-compute[75176]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 28 15:41:58 user nova-compute[75176]:     </disk>
Nov 28 15:41:58 user nova-compute[75176]:     <controller type='usb' index='0' model='none'>
Nov 28 15:41:58 user nova-compute[75176]:       <alias name='usb'/>
Nov 28 15:41:58 user nova-compute[75176]:     </controller>
Nov 28 15:41:58 user nova-compute[75176]:     <controller type='pci' index='0' model='pci-root'>
Nov 28 15:41:58 user nova-compute[75176]:       <alias name='pci.0'/>
Nov 28 15:41:58 user nova-compute[75176]:     </controller>
Nov 28 15:41:58 user nova-compute[75176]:     <controller type='ide' index='0'>
Nov 28 15:41:58 user nova-compute[75176]:       <alias name='ide'/>
Nov 28 15:41:58 user nova-compute[75176]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 28 15:41:58 user nova-compute[75176]:     </controller>
Nov 28 15:41:58 user nova-compute[75176]:     <interface type='ethernet'>
Nov 28 15:41:58 user nova-compute[75176]:       <mac address='fa:16:3e:b8:ab:c4'/>
Nov 28 15:41:58 user nova-compute[75176]:       <target dev='tap05efa912-30'/>
Nov 28 15:41:58 user nova-compute[75176]:       <model type='virtio'/>
Nov 28 15:41:58 user nova-compute[75176]:       <mtu size='1442'/>
Nov 28 15:41:58 user nova-compute[75176]:       <alias name='net0'/>
Nov 28 15:41:58 user nova-compute[75176]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 28 15:41:58 user nova-compute[75176]:     </interface>
Nov 28 15:41:58 user nova-compute[75176]:     <interface type='ethernet'>
Nov 28 15:41:58 user nova-compute[75176]:       <mac address='fa:16:3e:be:ab:10'/>
Nov 28 15:41:58 user nova-compute[75176]:       <target dev='tape5bd47ee-ad'/>
Nov 28 15:41:58 user nova-compute[75176]:       <model type='virtio'/>
Nov 28 15:41:58 user nova-compute[75176]:       <mtu size='1442'/>
Nov 28 15:41:58 user nova-compute[75176]:       <alias name='net1'/>
Nov 28 15:41:58 user nova-compute[75176]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Nov 28 15:41:58 user nova-compute[75176]:     </interface>
Nov 28 15:41:58 user nova-compute[75176]:     <serial type='pty'>
Nov 28 15:41:58 user nova-compute[75176]:       <source path='/dev/pts/5'/>
Nov 28 15:41:58 user nova-compute[75176]:       <log file='/opt/stack/data/nova/instances/e2e25e19-c832-4945-9257-64e6103feb0c/console.log' append='off'/>
Nov 28 15:41:58 user nova-compute[75176]:       <target type='isa-serial' port='0'>
Nov 28 15:41:58 user nova-compute[75176]:         <model name='isa-serial'/>
Nov 28 15:41:58 user nova-compute[75176]:       </target>
Nov 28 15:41:58 user nova-compute[75176]:       <alias name='serial0'/>
Nov 28 15:41:58 user nova-compute[75176]:     </serial>
Nov 28 15:41:58 user nova-compute[75176]:     <console type='pty' tty='/dev/pts/5'>
Nov 28 15:41:58 user nova-compute[75176]:       <source path='/dev/pts/5'/>
Nov 28 15:41:58 user nova-compute[75176]:       <log file='/opt/stack/data/nova/instances/e2e25e19-c832-4945-9257-64e6103feb0c/console.log' append='off'/>
Nov 28 15:41:58 user nova-compute[75176]:       <target type='serial' port='0'/>
Nov 28 15:41:58 user nova-compute[75176]:       <alias name='serial0'/>
Nov 28 15:41:58 user nova-compute[75176]:     </console>
Nov 28 15:41:58 user nova-compute[75176]:     <input type='mouse' bus='ps2'>
Nov 28 15:41:58 user nova-compute[75176]:       <alias name='input0'/>
Nov 28 15:41:58 user nova-compute[75176]:     </input>
Nov 28 15:41:58 user nova-compute[75176]:     <input type='keyboard' bus='ps2'>
Nov 28 15:41:58 user nova-compute[75176]:       <alias name='input1'/>
Nov 28 15:41:58 user nova-compute[75176]:     </input>
Nov 28 15:41:58 user nova-compute[75176]:     <graphics type='vnc' port='5905' autoport='yes' listen='0.0.0.0'>
Nov 28 15:41:58 user nova-compute[75176]:       <listen type='address' address='0.0.0.0'/>
Nov 28 15:41:58 user nova-compute[75176]:     </graphics>
Nov 28 15:41:58 user nova-compute[75176]:     <audio id='1' type='none'/>
Nov 28 15:41:58 user nova-compute[75176]:     <video>
Nov 28 15:41:58 user nova-compute[75176]:       <model type='virtio' heads='1' primary='yes'/>
Nov 28 15:41:58 user nova-compute[75176]:       <alias name='video0'/>
Nov 28 15:41:58 user nova-compute[75176]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 28 15:41:58 user nova-compute[75176]:     </video>
Nov 28 15:41:58 user nova-compute[75176]:     <memballoon model='virtio'>
Nov 28 15:41:58 user nova-compute[75176]:       <stats period='10'/>
Nov 28 15:41:58 user nova-compute[75176]:       <alias name='balloon0'/>
Nov 28 15:41:58 user nova-compute[75176]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 28 15:41:58 user nova-compute[75176]:     </memballoon>
Nov 28 15:41:58 user nova-compute[75176]:     <rng model='virtio'>
Nov 28 15:41:58 user nova-compute[75176]:       <backend model='random'>/dev/urandom</backend>
Nov 28 15:41:58 user nova-compute[75176]:       <alias name='rng0'/>
Nov 28 15:41:58 user nova-compute[75176]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 28 15:41:58 user nova-compute[75176]:     </rng>
Nov 28 15:41:58 user nova-compute[75176]:   </devices>
Nov 28 15:41:58 user nova-compute[75176]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 28 15:41:58 user nova-compute[75176]:     <label>libvirt-e2e25e19-c832-4945-9257-64e6103feb0c</label>
Nov 28 15:41:58 user nova-compute[75176]:     <imagelabel>libvirt-e2e25e19-c832-4945-9257-64e6103feb0c</imagelabel>
Nov 28 15:41:58 user nova-compute[75176]:   </seclabel>
Nov 28 15:41:58 user nova-compute[75176]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 28 15:41:58 user nova-compute[75176]:     <label>+64055:+108</label>
Nov 28 15:41:58 user nova-compute[75176]:     <imagelabel>+64055:+108</imagelabel>
Nov 28 15:41:58 user nova-compute[75176]:   </seclabel>
Nov 28 15:41:58 user nova-compute[75176]: </domain>
Nov 28 15:41:58 user nova-compute[75176]:  {{(pid=75176) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 28 15:41:58 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-1d25bad1-7d08-4172-b1ea-9e3f1ad2ebaa tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] Successfully detached device tape5bd47ee-ad from instance e2e25e19-c832-4945-9257-64e6103feb0c from the persistent domain config.
Nov 28 15:41:58 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-1d25bad1-7d08-4172-b1ea-9e3f1ad2ebaa tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] (1/8): Attempting to detach device tape5bd47ee-ad with device alias net1 from instance e2e25e19-c832-4945-9257-64e6103feb0c from the live domain config. {{(pid=75176) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 15:41:58 user nova-compute[75176]: DEBUG nova.virt.libvirt.guest [None req-1d25bad1-7d08-4172-b1ea-9e3f1ad2ebaa tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] detach device xml: <interface type="ethernet">
Nov 28 15:41:58 user nova-compute[75176]:   <mac address="fa:16:3e:be:ab:10"/>
Nov 28 15:41:58 user nova-compute[75176]:   <model type="virtio"/>
Nov 28 15:41:58 user nova-compute[75176]:   <mtu size="1442"/>
Nov 28 15:41:58 user nova-compute[75176]:   <target dev="tape5bd47ee-ad"/>
Nov 28 15:41:58 user nova-compute[75176]: </interface>
Nov 28 15:41:58 user nova-compute[75176]:  {{(pid=75176) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 15:41:58 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:58 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:58 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0c65b96a-0f, bridge=br-int, if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:41:58 user nova-compute[75176]: INFO os_vif [None req-b469a21b-cdfb-4f59-9409-786dfeb47caf tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:71:6f,bridge_name='br-int',has_traffic_filtering=True,id=04db431e-5bc8-4450-9bdd-82369fafba70,network=Network(26bf803a-6aa2-4e87-b407-caee3f8f7d3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04db431e-5b')
Nov 28 15:41:58 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-b469a21b-cdfb-4f59-9409-786dfeb47caf tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T15:39:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1004277851',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1004277851',id=11,image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAt/lLowBIWQygNmvQblLtMAxvEuh2XUt/OTwbCBERVkLqIQ96jTap/pkeH4XObeedowqO0iM5aqRH1Q9ITpqofPFkYQiFnqenRv5cljG1lxFMkS8D9qDEIlxMTWaLsb0A==',key_name='tempest-keypair-1203087070',keypairs=<?>,launch_index=0,launched_at=2023-11-28T15:40:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0108444c01e94416984b083707102c58',ramdisk_id='',reservation_id='r-j3sryyxs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1183582238',owner_user_name='tempest-TaggedBootDevicesTest-1183582238-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T15:40:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8fb5815faed648a1a207c402eafca90e',uuid=b714fb94-fcc7-40ae-b3a9-d8c9a60008f1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0bc36ba8-7fc6-47b2-b7b1-08a445625b46", "address": "fa:16:3e:76:ce:76", "network": {"id": "26bf803a-6aa2-4e87-b407-caee3f8f7d3d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1638676687", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0108444c01e94416984b083707102c58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bc36ba8-7f", "ovs_interfaceid": "0bc36ba8-7fc6-47b2-b7b1-08a445625b46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 15:41:58 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-b469a21b-cdfb-4f59-9409-786dfeb47caf tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Converting VIF {"id": "0bc36ba8-7fc6-47b2-b7b1-08a445625b46", "address": "fa:16:3e:76:ce:76", "network": {"id": "26bf803a-6aa2-4e87-b407-caee3f8f7d3d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1638676687", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0108444c01e94416984b083707102c58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bc36ba8-7f", "ovs_interfaceid": "0bc36ba8-7fc6-47b2-b7b1-08a445625b46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:41:58 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-b469a21b-cdfb-4f59-9409-786dfeb47caf tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:ce:76,bridge_name='br-int',has_traffic_filtering=True,id=0bc36ba8-7fc6-47b2-b7b1-08a445625b46,network=Network(26bf803a-6aa2-4e87-b407-caee3f8f7d3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bc36ba8-7f') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:41:58 user nova-compute[75176]: DEBUG os_vif [None req-b469a21b-cdfb-4f59-9409-786dfeb47caf tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:ce:76,bridge_name='br-int',has_traffic_filtering=True,id=0bc36ba8-7fc6-47b2-b7b1-08a445625b46,network=Network(26bf803a-6aa2-4e87-b407-caee3f8f7d3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bc36ba8-7f') {{(pid=75176) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 15:41:58 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:41:58 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-4c851341-a4c2-4026-b00d-1e1e8ea739d0 tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:41:58 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-4c851341-a4c2-4026-b00d-1e1e8ea739d0 tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:41:58 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:58 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:58 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0bc36ba8-7f, bridge=br-int, if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:41:58 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:41:58 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:58 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:58 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0d2f0aef-14c3-464d-97ca-27ef55e5cdc0) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:41:58 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:58 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:41:58 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:58 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:58 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d39ad5ff-2054-48bd-9fd2-3f4b7bf9d3fa) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:41:58 user nova-compute[75176]: INFO os_vif [None req-585335e7-3eb7-4c3d-9395-77097f973761 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:dc:af,bridge_name='br-int',has_traffic_filtering=True,id=0c65b96a-0fce-4bff-b89c-443cc48f6995,network=Network(6a9822be-add5-4d71-8ef1-1ce105eed6af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c65b96a-0f')
Nov 28 15:41:58 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-585335e7-3eb7-4c3d-9395-77097f973761 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T15:39:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1424070534',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1424070534',id=10,image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPn83B68ew19zNqtC6OrMzgf/bmXCz98qa+rH054zqhA5Gi3ZDmOGiOHPgSu1hkI/yV1KZdhZIiHhrJ1wuOhC1X2w3dTgpgbLguVyd7FUfhz3bRrtdjXABRlYuvBuQRV2A==',key_name='tempest-keypair-1772665281',keypairs=<?>,launch_index=0,launched_at=2023-11-28T15:40:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cfdec2abaf704a1396611ff1bcb96e53',ramdisk_id='',reservation_id='r-0j1w7c0x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1260942437',owner_user_name='tempest-TaggedBootDevicesTest_v242-1260942437-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T15:40:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='97e02c028b814c6993edba6c1caa8afe',uuid=041af768-197b-4c76-a5a1-28e2dc8255bd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2df03152-b1aa-4794-965d-64886ac889ea", "address": "fa:16:3e:7a:2f:2c", "network": {"id": "6a9822be-add5-4d71-8ef1-1ce105eed6af", "bridge": "br-int", "label": "tempest-device-tagging-net2-401277966", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cfdec2abaf704a1396611ff1bcb96e53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2df03152-b1", "ovs_interfaceid": "2df03152-b1aa-4794-965d-64886ac889ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 15:41:58 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-585335e7-3eb7-4c3d-9395-77097f973761 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Converting VIF {"id": "2df03152-b1aa-4794-965d-64886ac889ea", "address": "fa:16:3e:7a:2f:2c", "network": {"id": "6a9822be-add5-4d71-8ef1-1ce105eed6af", "bridge": "br-int", "label": "tempest-device-tagging-net2-401277966", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cfdec2abaf704a1396611ff1bcb96e53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2df03152-b1", "ovs_interfaceid": "2df03152-b1aa-4794-965d-64886ac889ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:41:58 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-585335e7-3eb7-4c3d-9395-77097f973761 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:2f:2c,bridge_name='br-int',has_traffic_filtering=True,id=2df03152-b1aa-4794-965d-64886ac889ea,network=Network(6a9822be-add5-4d71-8ef1-1ce105eed6af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2df03152-b1') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:41:58 user nova-compute[75176]: DEBUG os_vif [None req-585335e7-3eb7-4c3d-9395-77097f973761 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:2f:2c,bridge_name='br-int',has_traffic_filtering=True,id=2df03152-b1aa-4794-965d-64886ac889ea,network=Network(6a9822be-add5-4d71-8ef1-1ce105eed6af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2df03152-b1') {{(pid=75176) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 15:41:58 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:41:58 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:58 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:58 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2df03152-b1, bridge=br-int, if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:41:58 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:58 user nova-compute[75176]: INFO os_vif [None req-b469a21b-cdfb-4f59-9409-786dfeb47caf tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:ce:76,bridge_name='br-int',has_traffic_filtering=True,id=0bc36ba8-7fc6-47b2-b7b1-08a445625b46,network=Network(26bf803a-6aa2-4e87-b407-caee3f8f7d3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bc36ba8-7f')
Nov 28 15:41:58 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-b469a21b-cdfb-4f59-9409-786dfeb47caf tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T15:39:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1004277851',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1004277851',id=11,image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAt/lLowBIWQygNmvQblLtMAxvEuh2XUt/OTwbCBERVkLqIQ96jTap/pkeH4XObeedowqO0iM5aqRH1Q9ITpqofPFkYQiFnqenRv5cljG1lxFMkS8D9qDEIlxMTWaLsb0A==',key_name='tempest-keypair-1203087070',keypairs=<?>,launch_index=0,launched_at=2023-11-28T15:40:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0108444c01e94416984b083707102c58',ramdisk_id='',reservation_id='r-j3sryyxs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1183582238',owner_user_name='tempest-TaggedBootDevicesTest-1183582238-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T15:40:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8fb5815faed648a1a207c402eafca90e',uuid=b714fb94-fcc7-40ae-b3a9-d8c9a60008f1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0c08ccbe-f3de-4aed-b641-8e2b58bd73a0", "address": "fa:16:3e:59:54:f2", "network": {"id": "3936aa29-a691-4362-8bd9-536545b14473", "bridge": "br-int", "label": "tempest-device-tagging-net2-1089118081", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0108444c01e94416984b083707102c58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c08ccbe-f3", "ovs_interfaceid": "0c08ccbe-f3de-4aed-b641-8e2b58bd73a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 15:41:58 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-b469a21b-cdfb-4f59-9409-786dfeb47caf tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Converting VIF {"id": "0c08ccbe-f3de-4aed-b641-8e2b58bd73a0", "address": "fa:16:3e:59:54:f2", "network": {"id": "3936aa29-a691-4362-8bd9-536545b14473", "bridge": "br-int", "label": "tempest-device-tagging-net2-1089118081", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0108444c01e94416984b083707102c58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c08ccbe-f3", "ovs_interfaceid": "0c08ccbe-f3de-4aed-b641-8e2b58bd73a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:41:58 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-b469a21b-cdfb-4f59-9409-786dfeb47caf tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:54:f2,bridge_name='br-int',has_traffic_filtering=True,id=0c08ccbe-f3de-4aed-b641-8e2b58bd73a0,network=Network(3936aa29-a691-4362-8bd9-536545b14473),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c08ccbe-f3') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:41:58 user nova-compute[75176]: DEBUG os_vif [None req-b469a21b-cdfb-4f59-9409-786dfeb47caf tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:54:f2,bridge_name='br-int',has_traffic_filtering=True,id=0c08ccbe-f3de-4aed-b641-8e2b58bd73a0,network=Network(3936aa29-a691-4362-8bd9-536545b14473),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c08ccbe-f3') {{(pid=75176) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 15:41:58 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:41:58 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:58 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:58 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0c08ccbe-f3, bridge=br-int, if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:41:58 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:58 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:41:58 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-1d25bad1-7d08-4172-b1ea-9e3f1ad2ebaa tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] Start waiting for the detach event from libvirt for device tape5bd47ee-ad with device alias net1 for instance e2e25e19-c832-4945-9257-64e6103feb0c {{(pid=75176) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 15:41:58 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:58 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:58 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:58 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:58 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:58 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ef4b8284-5ff7-4fb3-8844-3adda5f60cc6) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:41:58 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:58 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:41:58 user nova-compute[75176]: DEBUG nova.compute.provider_tree [None req-4c851341-a4c2-4026-b00d-1e1e8ea739d0 tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] Inventory has not changed in ProviderTree for provider: b37848d8-f401-4155-a029-b0ffa09ff85b {{(pid=75176) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 15:41:58 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:58 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:58 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8ab9b48e-85d2-4c0b-b4bd-23a8f4791f80) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:41:58 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-4c851341-a4c2-4026-b00d-1e1e8ea739d0 tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] Inventory has not changed for provider b37848d8-f401-4155-a029-b0ffa09ff85b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75176) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 15:41:58 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:58 user nova-compute[75176]: INFO os_vif [None req-585335e7-3eb7-4c3d-9395-77097f973761 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:2f:2c,bridge_name='br-int',has_traffic_filtering=True,id=2df03152-b1aa-4794-965d-64886ac889ea,network=Network(6a9822be-add5-4d71-8ef1-1ce105eed6af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2df03152-b1')
Nov 28 15:41:58 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:41:58 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-585335e7-3eb7-4c3d-9395-77097f973761 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] calling os-brick to detach iSCSI Volume {{(pid=75176) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 15:41:58 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-585335e7-3eb7-4c3d-9395-77097f973761 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c1b8a00>, {'target_iqn': 'iqn.2010-10.org.openstack:27720cbf-c8ad-486b-845d-cdff5fbc4772', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mkUsIMCG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 15:41:58 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-585335e7-3eb7-4c3d-9395-77097f973761 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 15:41:58 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-585335e7-3eb7-4c3d-9395-77097f973761 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 15:41:58 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-585335e7-3eb7-4c3d-9395-77097f973761 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 15:41:58 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:58 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:41:58 user nova-compute[75176]: INFO os_vif [None req-b469a21b-cdfb-4f59-9409-786dfeb47caf tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:54:f2,bridge_name='br-int',has_traffic_filtering=True,id=0c08ccbe-f3de-4aed-b641-8e2b58bd73a0,network=Network(3936aa29-a691-4362-8bd9-536545b14473),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c08ccbe-f3')
Nov 28 15:41:58 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-b469a21b-cdfb-4f59-9409-786dfeb47caf tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T15:39:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1004277851',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1004277851',id=11,image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAt/lLowBIWQygNmvQblLtMAxvEuh2XUt/OTwbCBERVkLqIQ96jTap/pkeH4XObeedowqO0iM5aqRH1Q9ITpqofPFkYQiFnqenRv5cljG1lxFMkS8D9qDEIlxMTWaLsb0A==',key_name='tempest-keypair-1203087070',keypairs=<?>,launch_index=0,launched_at=2023-11-28T15:40:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0108444c01e94416984b083707102c58',ramdisk_id='',reservation_id='r-j3sryyxs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1183582238',owner_user_name='tempest-TaggedBootDevicesTest-1183582238-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T15:40:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8fb5815faed648a1a207c402eafca90e',uuid=b714fb94-fcc7-40ae-b3a9-d8c9a60008f1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e0b49239-50a0-4864-9e92-22bddcbe7d21", "address": "fa:16:3e:d8:78:24", "network": {"id": "3936aa29-a691-4362-8bd9-536545b14473", "bridge": "br-int", "label": "tempest-device-tagging-net2-1089118081", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0108444c01e94416984b083707102c58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0b49239-50", "ovs_interfaceid": "e0b49239-50a0-4864-9e92-22bddcbe7d21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 15:41:58 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-b469a21b-cdfb-4f59-9409-786dfeb47caf tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Converting VIF {"id": "e0b49239-50a0-4864-9e92-22bddcbe7d21", "address": "fa:16:3e:d8:78:24", "network": {"id": "3936aa29-a691-4362-8bd9-536545b14473", "bridge": "br-int", "label": "tempest-device-tagging-net2-1089118081", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0108444c01e94416984b083707102c58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0b49239-50", "ovs_interfaceid": "e0b49239-50a0-4864-9e92-22bddcbe7d21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:41:58 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-b469a21b-cdfb-4f59-9409-786dfeb47caf tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:78:24,bridge_name='br-int',has_traffic_filtering=True,id=e0b49239-50a0-4864-9e92-22bddcbe7d21,network=Network(3936aa29-a691-4362-8bd9-536545b14473),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0b49239-50') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:41:58 user nova-compute[75176]: DEBUG os_vif [None req-b469a21b-cdfb-4f59-9409-786dfeb47caf tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:78:24,bridge_name='br-int',has_traffic_filtering=True,id=e0b49239-50a0-4864-9e92-22bddcbe7d21,network=Network(3936aa29-a691-4362-8bd9-536545b14473),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0b49239-50') {{(pid=75176) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 15:41:58 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:58 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape0b49239-50, bridge=br-int, if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:41:58 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:58 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-4c851341-a4c2-4026-b00d-1e1e8ea739d0 tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.436s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:41:58 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:41:58 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:58 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.034s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:41:58 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3ac9e75-1455-4b8b-87c3-313739b5da61]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:560d9b0e-d506-4723-8fc3-4068d690d5c8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:763d605d-247d-4484-b7ec-762e36b92abc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:27720cbf-c8ad-486b-845d-cdff5fbc4772\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:81326542-482f-4d50-895c-13c65fe4daf7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:76ea4d3b-7c77-47d0-b48b-ad79886d4f9a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ff70e82d-37da-4392-b25a-e9b80992af80\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6e691257-74a3-4fef-9fd1-67d2ba725039\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:41:58 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:58 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2c92a616-28dd-460d-8f78-9404ac8f7929) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:41:58 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-585335e7-3eb7-4c3d-9395-77097f973761 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 15:41:58 user nova-compute[75176]: No targets found.
Nov 28 15:41:58 user nova-compute[75176]: iSNS:
Nov 28 15:41:58 user nova-compute[75176]: No targets found.
Nov 28 15:41:58 user nova-compute[75176]: STATIC:
Nov 28 15:41:58 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:560d9b0e-d506-4723-8fc3-4068d690d5c8
Nov 28 15:41:58 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:41:58 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:41:58 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:763d605d-247d-4484-b7ec-762e36b92abc
Nov 28 15:41:58 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:41:58 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:41:58 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:27720cbf-c8ad-486b-845d-cdff5fbc4772
Nov 28 15:41:58 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:41:58 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:41:58 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:81326542-482f-4d50-895c-13c65fe4daf7
Nov 28 15:41:58 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:41:58 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:41:58 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:76ea4d3b-7c77-47d0-b48b-ad79886d4f9a
Nov 28 15:41:58 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:41:58 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:41:58 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:ff70e82d-37da-4392-b25a-e9b80992af80
Nov 28 15:41:58 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:41:58 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:41:58 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:6e691257-74a3-4fef-9fd1-67d2ba725039
Nov 28 15:41:58 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:41:58 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:41:58 user nova-compute[75176]: FIRMWARE:
Nov 28 15:41:58 user nova-compute[75176]: No targets found.
Nov 28 15:41:58 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:41:58 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-585335e7-3eb7-4c3d-9395-77097f973761 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 15:41:58 user nova-compute[75176]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 15:41:58 user nova-compute[75176]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75176) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 15:41:58 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-585335e7-3eb7-4c3d-9395-77097f973761 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:27720cbf-c8ad-486b-845d-cdff5fbc4772', 0)] {{(pid=75176) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 15:41:58 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:41:58 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:41:58 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:41:58 user nova-compute[75176]: INFO os_vif [None req-b469a21b-cdfb-4f59-9409-786dfeb47caf tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:78:24,bridge_name='br-int',has_traffic_filtering=True,id=e0b49239-50a0-4864-9e92-22bddcbe7d21,network=Network(3936aa29-a691-4362-8bd9-536545b14473),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0b49239-50')
Nov 28 15:41:58 user nova-compute[75176]: INFO nova.scheduler.client.report [None req-4c851341-a4c2-4026-b00d-1e1e8ea739d0 tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] Deleted allocations for instance 4ed0eb85-e975-446c-8da7-148a4bb36958
Nov 28 15:41:58 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.032s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:41:58 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b04d1a1-b462-4701-a6c6-9bd266022edd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:27720cbf-c8ad-486b-845d-cdff5fbc4772\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:560d9b0e-d506-4723-8fc3-4068d690d5c8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e691257-74a3-4fef-9fd1-67d2ba725039\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:763d605d-247d-4484-b7ec-762e36b92abc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:76ea4d3b-7c77-47d0-b48b-ad79886d4f9a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:81326542-482f-4d50-895c-13c65fe4daf7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ff70e82d-37da-4392-b25a-e9b80992af80\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:41:58 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b469a21b-cdfb-4f59-9409-786dfeb47caf tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] calling os-brick to detach iSCSI Volume {{(pid=75176) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 15:41:58 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-b469a21b-cdfb-4f59-9409-786dfeb47caf tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c1b8a00>, {'target_iqn': 'iqn.2010-10.org.openstack:560d9b0e-d506-4723-8fc3-4068d690d5c8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aYDCJPOv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 15:41:58 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-b469a21b-cdfb-4f59-9409-786dfeb47caf tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 15:41:58 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-b469a21b-cdfb-4f59-9409-786dfeb47caf tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 15:41:58 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:41:58 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:41:58 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[1275350e-dadc-43c2-a925-b755bb051bc8]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff70e82d-37da-4392-b25a-e9b80992af80 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81326542-482f-4d50-895c-13c65fe4daf7 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76ea4d3b-7c77-47d0-b48b-ad79886d4f9a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27720cbf-c8ad-486b-845d-cdff5fbc4772 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:560d9b0e-d506-4723-8fc3-4068d690d5c8 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e691257-74a3-4fef-9fd1-67d2ba725039 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:763d605d-247d-4484-b7ec-762e36b92abc (non-flash)\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:41:58 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-585335e7-3eb7-4c3d-9395-77097f973761 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff70e82d-37da-4392-b25a-e9b80992af80 (non-flash)
Nov 28 15:41:58 user nova-compute[75176]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81326542-482f-4d50-895c-13c65fe4daf7 (non-flash)
Nov 28 15:41:58 user nova-compute[75176]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76ea4d3b-7c77-47d0-b48b-ad79886d4f9a (non-flash)
Nov 28 15:41:58 user nova-compute[75176]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27720cbf-c8ad-486b-845d-cdff5fbc4772 (non-flash)
Nov 28 15:41:58 user nova-compute[75176]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:560d9b0e-d506-4723-8fc3-4068d690d5c8 (non-flash)
Nov 28 15:41:58 user nova-compute[75176]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e691257-74a3-4fef-9fd1-67d2ba725039 (non-flash)
Nov 28 15:41:58 user nova-compute[75176]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:763d605d-247d-4484-b7ec-762e36b92abc (non-flash)
Nov 28 15:41:58 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:41:58 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-585335e7-3eb7-4c3d-9395-77097f973761 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff70e82d-37da-4392-b25a-e9b80992af80 (non-flash)
Nov 28 15:41:58 user nova-compute[75176]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81326542-482f-4d50-895c-13c65fe4daf7 (non-flash)
Nov 28 15:41:58 user nova-compute[75176]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76ea4d3b-7c77-47d0-b48b-ad79886d4f9a (non-flash)
Nov 28 15:41:58 user nova-compute[75176]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27720cbf-c8ad-486b-845d-cdff5fbc4772 (non-flash)
Nov 28 15:41:58 user nova-compute[75176]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:560d9b0e-d506-4723-8fc3-4068d690d5c8 (non-flash)
Nov 28 15:41:58 user nova-compute[75176]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e691257-74a3-4fef-9fd1-67d2ba725039 (non-flash)
Nov 28 15:41:58 user nova-compute[75176]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:763d605d-247d-4484-b7ec-762e36b92abc (non-flash)
Nov 28 15:41:58 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 15:41:58 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-585335e7-3eb7-4c3d-9395-77097f973761 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f464c3a30a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:27720cbf-c8ad-486b-845d-cdff5fbc4772'): ({'sde'}, set())}) {{(pid=75176) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 15:41:58 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-585335e7-3eb7-4c3d-9395-77097f973761 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Removing single pathed devices sde {{(pid=75176) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 15:41:58 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:41:58 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.031s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:41:58 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[703f33c8-1b1c-4463-ba52-00c712b98e07]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:41:58 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:41:58 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:41:58 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[266bd846-c3a7-498f-b75b-601895c2dfa8]: (4, ('ok\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:41:58 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-585335e7-3eb7-4c3d-9395-77097f973761 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Flushing IO for device /dev/sde {{(pid=75176) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 15:41:58 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:41:58 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-4c851341-a4c2-4026-b00d-1e1e8ea739d0 tempest-AttachSCSIVolumeTestJSON-729958549 tempest-AttachSCSIVolumeTestJSON-729958549-project-member] Lock "4ed0eb85-e975-446c-8da7-148a4bb36958" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.453s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:41:58 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.018s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:41:58 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[c114c3a9-16c7-4172-b35b-9cf55bf44886]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:41:58 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-585335e7-3eb7-4c3d-9395-77097f973761 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75176) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 15:41:58 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:41:58 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.056s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:41:58 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[a67a654b-f294-48f7-9736-4bf74151d962]: (4, ('1', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:41:58 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-585335e7-3eb7-4c3d-9395-77097f973761 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75176) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 15:41:58 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-585335e7-3eb7-4c3d-9395-77097f973761 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] SCSI volumes sde have been removed. {{(pid=75176) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 15:41:58 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-585335e7-3eb7-4c3d-9395-77097f973761 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:27720cbf-c8ad-486b-845d-cdff5fbc4772')] {{(pid=75176) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 15:41:58 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27720cbf-c8ad-486b-845d-cdff5fbc4772 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:41:58 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27720cbf-c8ad-486b-845d-cdff5fbc4772 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:41:58 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccd008d0-a269-4cd2-b6cd-ab89c4812b1c]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:41:58 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-585335e7-3eb7-4c3d-9395-77097f973761 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:41:58 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27720cbf-c8ad-486b-845d-cdff5fbc4772 -p 172.16.0.220:3260 --logout {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:41:59 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27720cbf-c8ad-486b-845d-cdff5fbc4772 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:41:59 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[de91c023-565e-49bf-8fc5-fddc3f318ed1]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:27720cbf-c8ad-486b-845d-cdff5fbc4772, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:27720cbf-c8ad-486b-845d-cdff5fbc4772, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:41:59 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-585335e7-3eb7-4c3d-9395-77097f973761 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:27720cbf-c8ad-486b-845d-cdff5fbc4772, portal: 172.16.0.220,3260]
Nov 28 15:41:59 user nova-compute[75176]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:27720cbf-c8ad-486b-845d-cdff5fbc4772, portal: 172.16.0.220,3260] successful.
Nov 28 15:41:59 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:41:59 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27720cbf-c8ad-486b-845d-cdff5fbc4772 -p 172.16.0.220:3260 --op delete {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:41:59 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27720cbf-c8ad-486b-845d-cdff5fbc4772 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:41:59 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[70ac7e0c-9ec1-4a12-806e-619a22aeef44]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:41:59 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-585335e7-3eb7-4c3d-9395-77097f973761 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:41:59 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-585335e7-3eb7-4c3d-9395-77097f973761 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.436s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 15:41:59 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-585335e7-3eb7-4c3d-9395-77097f973761 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] <== disconnect_volume: return (438ms) None {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 15:41:59 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-585335e7-3eb7-4c3d-9395-77097f973761 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] Disconnected iSCSI Volume {{(pid=75176) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 15:41:59 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-b469a21b-cdfb-4f59-9409-786dfeb47caf tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.347s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 15:41:59 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-585335e7-3eb7-4c3d-9395-77097f973761 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] calling os-brick to detach iSCSI Volume {{(pid=75176) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 15:41:59 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-585335e7-3eb7-4c3d-9395-77097f973761 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c1b8a00>, {'target_iqn': 'iqn.2010-10.org.openstack:6e691257-74a3-4fef-9fd1-67d2ba725039', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sbWjatrv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 15:41:59 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-585335e7-3eb7-4c3d-9395-77097f973761 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 15:41:59 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-585335e7-3eb7-4c3d-9395-77097f973761 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 15:41:59 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:41:59 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:41:59 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7b28a4e-4eab-4f9e-96a2-4e5f626f386c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:560d9b0e-d506-4723-8fc3-4068d690d5c8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:763d605d-247d-4484-b7ec-762e36b92abc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:81326542-482f-4d50-895c-13c65fe4daf7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:76ea4d3b-7c77-47d0-b48b-ad79886d4f9a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ff70e82d-37da-4392-b25a-e9b80992af80\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6e691257-74a3-4fef-9fd1-67d2ba725039\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:41:59 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-b469a21b-cdfb-4f59-9409-786dfeb47caf tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 15:41:59 user nova-compute[75176]: No targets found.
Nov 28 15:41:59 user nova-compute[75176]: iSNS:
Nov 28 15:41:59 user nova-compute[75176]: No targets found.
Nov 28 15:41:59 user nova-compute[75176]: STATIC:
Nov 28 15:41:59 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:560d9b0e-d506-4723-8fc3-4068d690d5c8
Nov 28 15:41:59 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:41:59 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:41:59 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:763d605d-247d-4484-b7ec-762e36b92abc
Nov 28 15:41:59 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:41:59 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:41:59 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:81326542-482f-4d50-895c-13c65fe4daf7
Nov 28 15:41:59 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:41:59 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:41:59 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:76ea4d3b-7c77-47d0-b48b-ad79886d4f9a
Nov 28 15:41:59 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:41:59 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:41:59 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:ff70e82d-37da-4392-b25a-e9b80992af80
Nov 28 15:41:59 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:41:59 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:41:59 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:6e691257-74a3-4fef-9fd1-67d2ba725039
Nov 28 15:41:59 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:41:59 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:41:59 user nova-compute[75176]: FIRMWARE:
Nov 28 15:41:59 user nova-compute[75176]: No targets found.
Nov 28 15:41:59 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:41:59 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-b469a21b-cdfb-4f59-9409-786dfeb47caf tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 15:41:59 user nova-compute[75176]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 15:41:59 user nova-compute[75176]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75176) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 15:41:59 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-b469a21b-cdfb-4f59-9409-786dfeb47caf tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:560d9b0e-d506-4723-8fc3-4068d690d5c8', 0)] {{(pid=75176) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 15:41:59 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:41:59 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:41:59 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[afab76d6-8f1b-4c08-8e5a-13b714e91f2e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:560d9b0e-d506-4723-8fc3-4068d690d5c8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e691257-74a3-4fef-9fd1-67d2ba725039\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:763d605d-247d-4484-b7ec-762e36b92abc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:76ea4d3b-7c77-47d0-b48b-ad79886d4f9a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:81326542-482f-4d50-895c-13c65fe4daf7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ff70e82d-37da-4392-b25a-e9b80992af80\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:41:59 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:41:59 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:41:59 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[911a7d7c-d52b-4cb7-a30a-ec509cdd6c1f]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff70e82d-37da-4392-b25a-e9b80992af80 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81326542-482f-4d50-895c-13c65fe4daf7 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76ea4d3b-7c77-47d0-b48b-ad79886d4f9a (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:560d9b0e-d506-4723-8fc3-4068d690d5c8 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e691257-74a3-4fef-9fd1-67d2ba725039 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:763d605d-247d-4484-b7ec-762e36b92abc (non-flash)\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:41:59 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-b469a21b-cdfb-4f59-9409-786dfeb47caf tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff70e82d-37da-4392-b25a-e9b80992af80 (non-flash)
Nov 28 15:41:59 user nova-compute[75176]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81326542-482f-4d50-895c-13c65fe4daf7 (non-flash)
Nov 28 15:41:59 user nova-compute[75176]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76ea4d3b-7c77-47d0-b48b-ad79886d4f9a (non-flash)
Nov 28 15:41:59 user nova-compute[75176]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:560d9b0e-d506-4723-8fc3-4068d690d5c8 (non-flash)
Nov 28 15:41:59 user nova-compute[75176]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e691257-74a3-4fef-9fd1-67d2ba725039 (non-flash)
Nov 28 15:41:59 user nova-compute[75176]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:763d605d-247d-4484-b7ec-762e36b92abc (non-flash)
Nov 28 15:41:59 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:41:59 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-b469a21b-cdfb-4f59-9409-786dfeb47caf tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff70e82d-37da-4392-b25a-e9b80992af80 (non-flash)
Nov 28 15:41:59 user nova-compute[75176]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81326542-482f-4d50-895c-13c65fe4daf7 (non-flash)
Nov 28 15:41:59 user nova-compute[75176]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76ea4d3b-7c77-47d0-b48b-ad79886d4f9a (non-flash)
Nov 28 15:41:59 user nova-compute[75176]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:560d9b0e-d506-4723-8fc3-4068d690d5c8 (non-flash)
Nov 28 15:41:59 user nova-compute[75176]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e691257-74a3-4fef-9fd1-67d2ba725039 (non-flash)
Nov 28 15:41:59 user nova-compute[75176]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:763d605d-247d-4484-b7ec-762e36b92abc (non-flash)
Nov 28 15:41:59 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 15:41:59 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-b469a21b-cdfb-4f59-9409-786dfeb47caf tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f464c1fcd30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:560d9b0e-d506-4723-8fc3-4068d690d5c8'): ({'sdf'}, set())}) {{(pid=75176) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 15:41:59 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-b469a21b-cdfb-4f59-9409-786dfeb47caf tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Removing single pathed devices sdf {{(pid=75176) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 15:41:59 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:41:59 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:41:59 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[58b1e649-dcf3-4e63-9bd5-a5e05ab5211d]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:41:59 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:41:59 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:41:59 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[06dd05c1-2f60-4f38-ae97-816e97963d10]: (4, ('ok\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:41:59 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-b469a21b-cdfb-4f59-9409-786dfeb47caf tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Flushing IO for device /dev/sdf {{(pid=75176) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 15:41:59 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:41:59 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.015s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:41:59 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[55b3ef1a-f5eb-4e2b-a276-772c373dd783]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:41:59 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-b469a21b-cdfb-4f59-9409-786dfeb47caf tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75176) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 15:41:59 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:41:59 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.047s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:41:59 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[56e70626-6b8f-45e3-8599-b3a99e13bd8b]: (4, ('1', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:41:59 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-b469a21b-cdfb-4f59-9409-786dfeb47caf tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75176) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 15:41:59 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-b469a21b-cdfb-4f59-9409-786dfeb47caf tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] SCSI volumes sdf have been removed. {{(pid=75176) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 15:41:59 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-b469a21b-cdfb-4f59-9409-786dfeb47caf tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:560d9b0e-d506-4723-8fc3-4068d690d5c8')] {{(pid=75176) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 15:41:59 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:560d9b0e-d506-4723-8fc3-4068d690d5c8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:41:59 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:560d9b0e-d506-4723-8fc3-4068d690d5c8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:41:59 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c128872-587d-4071-a66b-64062e4d7088]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:41:59 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-b469a21b-cdfb-4f59-9409-786dfeb47caf tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:41:59 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:560d9b0e-d506-4723-8fc3-4068d690d5c8 -p 172.16.0.220:3260 --logout {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:41:59 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:560d9b0e-d506-4723-8fc3-4068d690d5c8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:41:59 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[96066209-b629-48d4-94a3-b8450444b07f]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:560d9b0e-d506-4723-8fc3-4068d690d5c8, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:560d9b0e-d506-4723-8fc3-4068d690d5c8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:41:59 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-b469a21b-cdfb-4f59-9409-786dfeb47caf tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:560d9b0e-d506-4723-8fc3-4068d690d5c8, portal: 172.16.0.220,3260]
Nov 28 15:41:59 user nova-compute[75176]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:560d9b0e-d506-4723-8fc3-4068d690d5c8, portal: 172.16.0.220,3260] successful.
Nov 28 15:41:59 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:41:59 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:560d9b0e-d506-4723-8fc3-4068d690d5c8 -p 172.16.0.220:3260 --op delete {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:41:59 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:560d9b0e-d506-4723-8fc3-4068d690d5c8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:41:59 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2e4fddd-d7da-4783-b4f0-092dc414ce15]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:41:59 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-b469a21b-cdfb-4f59-9409-786dfeb47caf tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:41:59 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-b469a21b-cdfb-4f59-9409-786dfeb47caf tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.332s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 15:41:59 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-b469a21b-cdfb-4f59-9409-786dfeb47caf tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] <== disconnect_volume: return (678ms) None {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 15:41:59 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b469a21b-cdfb-4f59-9409-786dfeb47caf tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] Disconnected iSCSI Volume {{(pid=75176) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 15:41:59 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-585335e7-3eb7-4c3d-9395-77097f973761 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.330s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 15:41:59 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:41:59 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b469a21b-cdfb-4f59-9409-786dfeb47caf tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] calling os-brick to detach iSCSI Volume {{(pid=75176) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 15:41:59 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-b469a21b-cdfb-4f59-9409-786dfeb47caf tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c1b8a00>, {'target_iqn': 'iqn.2010-10.org.openstack:763d605d-247d-4484-b7ec-762e36b92abc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wHMBuZWL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 15:41:59 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-b469a21b-cdfb-4f59-9409-786dfeb47caf tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 15:41:59 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-b469a21b-cdfb-4f59-9409-786dfeb47caf tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 15:41:59 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:41:59 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bfe7be1-583e-4a0d-951f-0ca0c248b6dd]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:763d605d-247d-4484-b7ec-762e36b92abc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:81326542-482f-4d50-895c-13c65fe4daf7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:76ea4d3b-7c77-47d0-b48b-ad79886d4f9a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ff70e82d-37da-4392-b25a-e9b80992af80\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6e691257-74a3-4fef-9fd1-67d2ba725039\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:41:59 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-585335e7-3eb7-4c3d-9395-77097f973761 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 15:41:59 user nova-compute[75176]: No targets found.
Nov 28 15:41:59 user nova-compute[75176]: iSNS:
Nov 28 15:41:59 user nova-compute[75176]: No targets found.
Nov 28 15:41:59 user nova-compute[75176]: STATIC:
Nov 28 15:41:59 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:763d605d-247d-4484-b7ec-762e36b92abc
Nov 28 15:41:59 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:41:59 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:41:59 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:81326542-482f-4d50-895c-13c65fe4daf7
Nov 28 15:41:59 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:41:59 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:41:59 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:76ea4d3b-7c77-47d0-b48b-ad79886d4f9a
Nov 28 15:41:59 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:41:59 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:41:59 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:ff70e82d-37da-4392-b25a-e9b80992af80
Nov 28 15:41:59 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:41:59 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:41:59 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:6e691257-74a3-4fef-9fd1-67d2ba725039
Nov 28 15:41:59 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:41:59 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:41:59 user nova-compute[75176]: FIRMWARE:
Nov 28 15:41:59 user nova-compute[75176]: No targets found.
Nov 28 15:41:59 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:41:59 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-585335e7-3eb7-4c3d-9395-77097f973761 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 15:41:59 user nova-compute[75176]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 15:41:59 user nova-compute[75176]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75176) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 15:41:59 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-585335e7-3eb7-4c3d-9395-77097f973761 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6e691257-74a3-4fef-9fd1-67d2ba725039', 0)] {{(pid=75176) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 15:41:59 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:41:59 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:41:59 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[e74b6329-c80c-4754-84bb-618fbe1f6b63]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e691257-74a3-4fef-9fd1-67d2ba725039\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:763d605d-247d-4484-b7ec-762e36b92abc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:76ea4d3b-7c77-47d0-b48b-ad79886d4f9a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:81326542-482f-4d50-895c-13c65fe4daf7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ff70e82d-37da-4392-b25a-e9b80992af80\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:41:59 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:41:59 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:41:59 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8bf8d16-6c60-4980-a27a-b1f22403a84f]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff70e82d-37da-4392-b25a-e9b80992af80 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81326542-482f-4d50-895c-13c65fe4daf7 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76ea4d3b-7c77-47d0-b48b-ad79886d4f9a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e691257-74a3-4fef-9fd1-67d2ba725039 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:763d605d-247d-4484-b7ec-762e36b92abc (non-flash)\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:41:59 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-585335e7-3eb7-4c3d-9395-77097f973761 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff70e82d-37da-4392-b25a-e9b80992af80 (non-flash)
Nov 28 15:41:59 user nova-compute[75176]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81326542-482f-4d50-895c-13c65fe4daf7 (non-flash)
Nov 28 15:41:59 user nova-compute[75176]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76ea4d3b-7c77-47d0-b48b-ad79886d4f9a (non-flash)
Nov 28 15:41:59 user nova-compute[75176]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e691257-74a3-4fef-9fd1-67d2ba725039 (non-flash)
Nov 28 15:41:59 user nova-compute[75176]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:763d605d-247d-4484-b7ec-762e36b92abc (non-flash)
Nov 28 15:41:59 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:41:59 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-585335e7-3eb7-4c3d-9395-77097f973761 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff70e82d-37da-4392-b25a-e9b80992af80 (non-flash)
Nov 28 15:41:59 user nova-compute[75176]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81326542-482f-4d50-895c-13c65fe4daf7 (non-flash)
Nov 28 15:41:59 user nova-compute[75176]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76ea4d3b-7c77-47d0-b48b-ad79886d4f9a (non-flash)
Nov 28 15:41:59 user nova-compute[75176]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e691257-74a3-4fef-9fd1-67d2ba725039 (non-flash)
Nov 28 15:41:59 user nova-compute[75176]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:763d605d-247d-4484-b7ec-762e36b92abc (non-flash)
Nov 28 15:41:59 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 15:41:59 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-585335e7-3eb7-4c3d-9395-77097f973761 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f464c1fcd30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6e691257-74a3-4fef-9fd1-67d2ba725039'): ({'sdg'}, set())}) {{(pid=75176) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 15:41:59 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-585335e7-3eb7-4c3d-9395-77097f973761 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Removing single pathed devices sdg {{(pid=75176) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 15:41:59 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:41:59 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:41:59 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcb12e60-d615-4724-b4c8-6c87d3443e55]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:41:59 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:41:59 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.021s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:41:59 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[d37b3cbd-116e-41a9-8662-b9db0c3ac339]: (4, ('ok\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:41:59 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-585335e7-3eb7-4c3d-9395-77097f973761 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Flushing IO for device /dev/sdg {{(pid=75176) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 15:41:59 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:41:59 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.015s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:41:59 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4b2a9f5-e09c-45fa-8882-f1ebece3bf5a]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:41:59 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-585335e7-3eb7-4c3d-9395-77097f973761 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75176) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 15:41:59 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:41:59 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.044s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:41:59 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a7e1a3c-90b4-412b-8c18-5b7fbaf8292f]: (4, ('1', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:41:59 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-585335e7-3eb7-4c3d-9395-77097f973761 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75176) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 15:41:59 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-585335e7-3eb7-4c3d-9395-77097f973761 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] SCSI volumes sdg have been removed. {{(pid=75176) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 15:41:59 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-585335e7-3eb7-4c3d-9395-77097f973761 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6e691257-74a3-4fef-9fd1-67d2ba725039')] {{(pid=75176) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 15:41:59 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e691257-74a3-4fef-9fd1-67d2ba725039 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:41:59 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e691257-74a3-4fef-9fd1-67d2ba725039 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:41:59 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[d149f6af-c4de-46fd-9128-af298e06624c]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:41:59 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-585335e7-3eb7-4c3d-9395-77097f973761 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:41:59 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e691257-74a3-4fef-9fd1-67d2ba725039 -p 172.16.0.220:3260 --logout {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:41:59 user nova-compute[75176]: DEBUG nova.compute.manager [req-27db2cf4-0c88-439f-8ddd-8878334973ff req-cbe2e0b6-da2b-4ac9-b38c-f8d2b715fb89 service nova] [instance: 4ed0eb85-e975-446c-8da7-148a4bb36958] Received event network-vif-deleted-9996a5ef-0801-4136-bd1d-fd5372d97e9d {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:41:59 user nova-compute[75176]: DEBUG nova.compute.manager [req-27db2cf4-0c88-439f-8ddd-8878334973ff req-cbe2e0b6-da2b-4ac9-b38c-f8d2b715fb89 service nova] [instance: e2e25e19-c832-4945-9257-64e6103feb0c] Received event network-vif-unplugged-e5bd47ee-addd-42fc-9585-aa5515c145f7 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:41:59 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-27db2cf4-0c88-439f-8ddd-8878334973ff req-cbe2e0b6-da2b-4ac9-b38c-f8d2b715fb89 service nova] Acquiring lock "e2e25e19-c832-4945-9257-64e6103feb0c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:41:59 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-27db2cf4-0c88-439f-8ddd-8878334973ff req-cbe2e0b6-da2b-4ac9-b38c-f8d2b715fb89 service nova] Lock "e2e25e19-c832-4945-9257-64e6103feb0c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:41:59 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-27db2cf4-0c88-439f-8ddd-8878334973ff req-cbe2e0b6-da2b-4ac9-b38c-f8d2b715fb89 service nova] Lock "e2e25e19-c832-4945-9257-64e6103feb0c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:41:59 user nova-compute[75176]: DEBUG nova.compute.manager [req-27db2cf4-0c88-439f-8ddd-8878334973ff req-cbe2e0b6-da2b-4ac9-b38c-f8d2b715fb89 service nova] [instance: e2e25e19-c832-4945-9257-64e6103feb0c] No waiting events found dispatching network-vif-unplugged-e5bd47ee-addd-42fc-9585-aa5515c145f7 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:41:59 user nova-compute[75176]: WARNING nova.compute.manager [req-27db2cf4-0c88-439f-8ddd-8878334973ff req-cbe2e0b6-da2b-4ac9-b38c-f8d2b715fb89 service nova] [instance: e2e25e19-c832-4945-9257-64e6103feb0c] Received unexpected event network-vif-unplugged-e5bd47ee-addd-42fc-9585-aa5515c145f7 for instance with vm_state active and task_state None.
Nov 28 15:41:59 user nova-compute[75176]: DEBUG nova.compute.manager [req-27db2cf4-0c88-439f-8ddd-8878334973ff req-cbe2e0b6-da2b-4ac9-b38c-f8d2b715fb89 service nova] [instance: e2e25e19-c832-4945-9257-64e6103feb0c] Received event network-vif-plugged-e5bd47ee-addd-42fc-9585-aa5515c145f7 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:41:59 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-27db2cf4-0c88-439f-8ddd-8878334973ff req-cbe2e0b6-da2b-4ac9-b38c-f8d2b715fb89 service nova] Acquiring lock "e2e25e19-c832-4945-9257-64e6103feb0c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:41:59 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-27db2cf4-0c88-439f-8ddd-8878334973ff req-cbe2e0b6-da2b-4ac9-b38c-f8d2b715fb89 service nova] Lock "e2e25e19-c832-4945-9257-64e6103feb0c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:41:59 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-27db2cf4-0c88-439f-8ddd-8878334973ff req-cbe2e0b6-da2b-4ac9-b38c-f8d2b715fb89 service nova] Lock "e2e25e19-c832-4945-9257-64e6103feb0c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:41:59 user nova-compute[75176]: DEBUG nova.compute.manager [req-27db2cf4-0c88-439f-8ddd-8878334973ff req-cbe2e0b6-da2b-4ac9-b38c-f8d2b715fb89 service nova] [instance: e2e25e19-c832-4945-9257-64e6103feb0c] No waiting events found dispatching network-vif-plugged-e5bd47ee-addd-42fc-9585-aa5515c145f7 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:41:59 user nova-compute[75176]: WARNING nova.compute.manager [req-27db2cf4-0c88-439f-8ddd-8878334973ff req-cbe2e0b6-da2b-4ac9-b38c-f8d2b715fb89 service nova] [instance: e2e25e19-c832-4945-9257-64e6103feb0c] Received unexpected event network-vif-plugged-e5bd47ee-addd-42fc-9585-aa5515c145f7 for instance with vm_state active and task_state None.
Nov 28 15:41:59 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e691257-74a3-4fef-9fd1-67d2ba725039 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:41:59 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[980f68a4-b04f-4e79-bf36-2bc4ea9f9663]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:6e691257-74a3-4fef-9fd1-67d2ba725039, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:6e691257-74a3-4fef-9fd1-67d2ba725039, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:41:59 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-585335e7-3eb7-4c3d-9395-77097f973761 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:6e691257-74a3-4fef-9fd1-67d2ba725039, portal: 172.16.0.220,3260]
Nov 28 15:41:59 user nova-compute[75176]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:6e691257-74a3-4fef-9fd1-67d2ba725039, portal: 172.16.0.220,3260] successful.
Nov 28 15:41:59 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:41:59 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e691257-74a3-4fef-9fd1-67d2ba725039 -p 172.16.0.220:3260 --op delete {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:41:59 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e691257-74a3-4fef-9fd1-67d2ba725039 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:41:59 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9b70967-c79d-43fe-8f20-0eff22897638]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:41:59 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-585335e7-3eb7-4c3d-9395-77097f973761 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:41:59 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-585335e7-3eb7-4c3d-9395-77097f973761 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.323s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 15:41:59 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-585335e7-3eb7-4c3d-9395-77097f973761 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] <== disconnect_volume: return (653ms) None {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 15:41:59 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-585335e7-3eb7-4c3d-9395-77097f973761 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] Disconnected iSCSI Volume {{(pid=75176) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 15:41:59 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-b469a21b-cdfb-4f59-9409-786dfeb47caf tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.318s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 15:41:59 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:41:59 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-585335e7-3eb7-4c3d-9395-77097f973761 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] calling os-brick to detach iSCSI Volume {{(pid=75176) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 15:41:59 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-585335e7-3eb7-4c3d-9395-77097f973761 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c1b8a00>, {'target_iqn': 'iqn.2010-10.org.openstack:81326542-482f-4d50-895c-13c65fe4daf7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CdovnAPQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 15:41:59 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-585335e7-3eb7-4c3d-9395-77097f973761 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 15:41:59 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-585335e7-3eb7-4c3d-9395-77097f973761 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 15:41:59 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:41:59 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[81bbac36-f740-426e-8563-5fe9a2f7e79c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:763d605d-247d-4484-b7ec-762e36b92abc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:81326542-482f-4d50-895c-13c65fe4daf7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:76ea4d3b-7c77-47d0-b48b-ad79886d4f9a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ff70e82d-37da-4392-b25a-e9b80992af80\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:41:59 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-b469a21b-cdfb-4f59-9409-786dfeb47caf tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 15:41:59 user nova-compute[75176]: No targets found.
Nov 28 15:41:59 user nova-compute[75176]: iSNS:
Nov 28 15:41:59 user nova-compute[75176]: No targets found.
Nov 28 15:41:59 user nova-compute[75176]: STATIC:
Nov 28 15:41:59 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:763d605d-247d-4484-b7ec-762e36b92abc
Nov 28 15:41:59 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:41:59 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:41:59 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:81326542-482f-4d50-895c-13c65fe4daf7
Nov 28 15:41:59 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:41:59 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:41:59 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:76ea4d3b-7c77-47d0-b48b-ad79886d4f9a
Nov 28 15:41:59 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:41:59 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:41:59 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:ff70e82d-37da-4392-b25a-e9b80992af80
Nov 28 15:41:59 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:41:59 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:41:59 user nova-compute[75176]: FIRMWARE:
Nov 28 15:41:59 user nova-compute[75176]: No targets found.
Nov 28 15:41:59 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:41:59 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-b469a21b-cdfb-4f59-9409-786dfeb47caf tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 15:41:59 user nova-compute[75176]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 15:41:59 user nova-compute[75176]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75176) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 15:41:59 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-b469a21b-cdfb-4f59-9409-786dfeb47caf tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:763d605d-247d-4484-b7ec-762e36b92abc', 0)] {{(pid=75176) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 15:41:59 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:41:59 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:41:59 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[af2ae50f-9e8f-4737-8133-ae5cc3179013]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:763d605d-247d-4484-b7ec-762e36b92abc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:76ea4d3b-7c77-47d0-b48b-ad79886d4f9a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:81326542-482f-4d50-895c-13c65fe4daf7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ff70e82d-37da-4392-b25a-e9b80992af80\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:41:59 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:41:59 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:41:59 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[9726108b-a499-4987-a15b-8336d0b8a2d9]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff70e82d-37da-4392-b25a-e9b80992af80 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81326542-482f-4d50-895c-13c65fe4daf7 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76ea4d3b-7c77-47d0-b48b-ad79886d4f9a (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:763d605d-247d-4484-b7ec-762e36b92abc (non-flash)\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:41:59 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-b469a21b-cdfb-4f59-9409-786dfeb47caf tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff70e82d-37da-4392-b25a-e9b80992af80 (non-flash)
Nov 28 15:41:59 user nova-compute[75176]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81326542-482f-4d50-895c-13c65fe4daf7 (non-flash)
Nov 28 15:41:59 user nova-compute[75176]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76ea4d3b-7c77-47d0-b48b-ad79886d4f9a (non-flash)
Nov 28 15:41:59 user nova-compute[75176]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:763d605d-247d-4484-b7ec-762e36b92abc (non-flash)
Nov 28 15:41:59 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:41:59 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-b469a21b-cdfb-4f59-9409-786dfeb47caf tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff70e82d-37da-4392-b25a-e9b80992af80 (non-flash)
Nov 28 15:41:59 user nova-compute[75176]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81326542-482f-4d50-895c-13c65fe4daf7 (non-flash)
Nov 28 15:41:59 user nova-compute[75176]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76ea4d3b-7c77-47d0-b48b-ad79886d4f9a (non-flash)
Nov 28 15:41:59 user nova-compute[75176]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:763d605d-247d-4484-b7ec-762e36b92abc (non-flash)
Nov 28 15:41:59 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 15:41:59 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-b469a21b-cdfb-4f59-9409-786dfeb47caf tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f46508dd510>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:763d605d-247d-4484-b7ec-762e36b92abc'): ({'sdh'}, set())}) {{(pid=75176) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 15:41:59 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-b469a21b-cdfb-4f59-9409-786dfeb47caf tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Removing single pathed devices sdh {{(pid=75176) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 15:41:59 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:41:59 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:41:59 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[790f10a8-6c5b-496c-a8df-80498f974257]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:41:59 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:41:59 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.020s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:41:59 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[93dcee53-8cdc-4b95-9325-18974b6fe0b5]: (4, ('ok\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:41:59 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-b469a21b-cdfb-4f59-9409-786dfeb47caf tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Flushing IO for device /dev/sdh {{(pid=75176) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 15:41:59 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:41:59 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.015s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:41:59 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[777159b5-2e0a-4c67-b1ef-b7acb72edb0d]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:41:59 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-b469a21b-cdfb-4f59-9409-786dfeb47caf tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=75176) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 15:41:59 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:41:59 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.049s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:41:59 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[6081f33a-7b3b-4841-b49b-905413a5298f]: (4, ('1', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:41:59 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-b469a21b-cdfb-4f59-9409-786dfeb47caf tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=75176) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 15:41:59 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-b469a21b-cdfb-4f59-9409-786dfeb47caf tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] SCSI volumes sdh have been removed. {{(pid=75176) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 15:41:59 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-b469a21b-cdfb-4f59-9409-786dfeb47caf tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:763d605d-247d-4484-b7ec-762e36b92abc')] {{(pid=75176) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 15:41:59 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:763d605d-247d-4484-b7ec-762e36b92abc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:41:59 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:763d605d-247d-4484-b7ec-762e36b92abc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:41:59 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[dea7e7fb-c5e0-4357-af47-5d3c887747e1]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:41:59 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-b469a21b-cdfb-4f59-9409-786dfeb47caf tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:41:59 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:763d605d-247d-4484-b7ec-762e36b92abc -p 172.16.0.220:3260 --logout {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:41:59 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-7cdc348f-cb18-4af3-afbd-6e884b995494 tempest-VolumesAssistedSnapshotsTest-1324886908 tempest-VolumesAssistedSnapshotsTest-1324886908-project-admin] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 1d99de1a-8a82-447a-8a18-02e4efd3b3f0 is timed out.
Nov 28 15:41:59 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-7cdc348f-cb18-4af3-afbd-6e884b995494 tempest-VolumesAssistedSnapshotsTest-1324886908 tempest-VolumesAssistedSnapshotsTest-1324886908-project-admin] Successfully detached device vdb from instance 1d99de1a-8a82-447a-8a18-02e4efd3b3f0 from the live domain config.
Nov 28 15:41:59 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7cdc348f-cb18-4af3-afbd-6e884b995494 tempest-VolumesAssistedSnapshotsTest-1324886908 tempest-VolumesAssistedSnapshotsTest-1324886908-project-admin] [instance: 1d99de1a-8a82-447a-8a18-02e4efd3b3f0] calling os-brick to detach iSCSI Volume {{(pid=75176) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 15:41:59 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cdc348f-cb18-4af3-afbd-6e884b995494 tempest-VolumesAssistedSnapshotsTest-1324886908 tempest-VolumesAssistedSnapshotsTest-1324886908-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c1b8a00>, {'target_iqn': 'iqn.2010-10.org.openstack:ff70e82d-37da-4392-b25a-e9b80992af80', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kEKaPUXB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk'}, None), 'kwargs': False}}" {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 15:41:59 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-7cdc348f-cb18-4af3-afbd-6e884b995494 tempest-VolumesAssistedSnapshotsTest-1324886908 tempest-VolumesAssistedSnapshotsTest-1324886908-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 15:41:59 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-7cdc348f-cb18-4af3-afbd-6e884b995494 tempest-VolumesAssistedSnapshotsTest-1324886908 tempest-VolumesAssistedSnapshotsTest-1324886908-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 15:42:00 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:763d605d-247d-4484-b7ec-762e36b92abc -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:42:00 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[284ac7cb-def4-46f8-a06c-e067f3b14aaa]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:763d605d-247d-4484-b7ec-762e36b92abc, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:763d605d-247d-4484-b7ec-762e36b92abc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:42:00 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-b469a21b-cdfb-4f59-9409-786dfeb47caf tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:763d605d-247d-4484-b7ec-762e36b92abc, portal: 172.16.0.220,3260]
Nov 28 15:42:00 user nova-compute[75176]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:763d605d-247d-4484-b7ec-762e36b92abc, portal: 172.16.0.220,3260] successful.
Nov 28 15:42:00 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:42:00 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:763d605d-247d-4484-b7ec-762e36b92abc -p 172.16.0.220:3260 --op delete {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:42:00 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:763d605d-247d-4484-b7ec-762e36b92abc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:42:00 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[16876bd0-92f5-4460-8bb9-476a746e191c]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:42:00 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-b469a21b-cdfb-4f59-9409-786dfeb47caf tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:42:00 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-b469a21b-cdfb-4f59-9409-786dfeb47caf tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.327s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 15:42:00 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-b469a21b-cdfb-4f59-9409-786dfeb47caf tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] <== disconnect_volume: return (646ms) None {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 15:42:00 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b469a21b-cdfb-4f59-9409-786dfeb47caf tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] Disconnected iSCSI Volume {{(pid=75176) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 15:42:00 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-585335e7-3eb7-4c3d-9395-77097f973761 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.326s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 15:42:00 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b469a21b-cdfb-4f59-9409-786dfeb47caf tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] calling os-brick to detach iSCSI Volume {{(pid=75176) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 15:42:00 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-b469a21b-cdfb-4f59-9409-786dfeb47caf tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c1b8a00>, {'target_iqn': 'iqn.2010-10.org.openstack:76ea4d3b-7c77-47d0-b48b-ad79886d4f9a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bJrEVveQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 15:42:00 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-b469a21b-cdfb-4f59-9409-786dfeb47caf tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 15:42:00 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-b469a21b-cdfb-4f59-9409-786dfeb47caf tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 15:42:00 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:42:00 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:42:00 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[97f51ab7-2753-4986-8b1c-f6d038d68775]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:81326542-482f-4d50-895c-13c65fe4daf7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:76ea4d3b-7c77-47d0-b48b-ad79886d4f9a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ff70e82d-37da-4392-b25a-e9b80992af80\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:42:00 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-585335e7-3eb7-4c3d-9395-77097f973761 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 15:42:00 user nova-compute[75176]: No targets found.
Nov 28 15:42:00 user nova-compute[75176]: iSNS:
Nov 28 15:42:00 user nova-compute[75176]: No targets found.
Nov 28 15:42:00 user nova-compute[75176]: STATIC:
Nov 28 15:42:00 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:81326542-482f-4d50-895c-13c65fe4daf7
Nov 28 15:42:00 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:42:00 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:42:00 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:76ea4d3b-7c77-47d0-b48b-ad79886d4f9a
Nov 28 15:42:00 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:42:00 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:42:00 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:ff70e82d-37da-4392-b25a-e9b80992af80
Nov 28 15:42:00 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:42:00 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:42:00 user nova-compute[75176]: FIRMWARE:
Nov 28 15:42:00 user nova-compute[75176]: No targets found.
Nov 28 15:42:00 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:42:00 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-585335e7-3eb7-4c3d-9395-77097f973761 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 15:42:00 user nova-compute[75176]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 15:42:00 user nova-compute[75176]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75176) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 15:42:00 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-585335e7-3eb7-4c3d-9395-77097f973761 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:81326542-482f-4d50-895c-13c65fe4daf7', 0)] {{(pid=75176) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 15:42:00 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:42:00 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:42:00 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[317ff8b8-1ccd-46ca-8d04-857b5344d708]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:76ea4d3b-7c77-47d0-b48b-ad79886d4f9a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:81326542-482f-4d50-895c-13c65fe4daf7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ff70e82d-37da-4392-b25a-e9b80992af80\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:42:00 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:42:00 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:42:00 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[531a2673-674b-46c3-bee5-42cc03f55f06]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff70e82d-37da-4392-b25a-e9b80992af80 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81326542-482f-4d50-895c-13c65fe4daf7 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76ea4d3b-7c77-47d0-b48b-ad79886d4f9a (non-flash)\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:42:00 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-585335e7-3eb7-4c3d-9395-77097f973761 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff70e82d-37da-4392-b25a-e9b80992af80 (non-flash)
Nov 28 15:42:00 user nova-compute[75176]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81326542-482f-4d50-895c-13c65fe4daf7 (non-flash)
Nov 28 15:42:00 user nova-compute[75176]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76ea4d3b-7c77-47d0-b48b-ad79886d4f9a (non-flash)
Nov 28 15:42:00 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:42:00 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-585335e7-3eb7-4c3d-9395-77097f973761 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff70e82d-37da-4392-b25a-e9b80992af80 (non-flash)
Nov 28 15:42:00 user nova-compute[75176]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81326542-482f-4d50-895c-13c65fe4daf7 (non-flash)
Nov 28 15:42:00 user nova-compute[75176]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76ea4d3b-7c77-47d0-b48b-ad79886d4f9a (non-flash)
Nov 28 15:42:00 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 15:42:00 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-585335e7-3eb7-4c3d-9395-77097f973761 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f46508dd510>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:81326542-482f-4d50-895c-13c65fe4daf7'): ({'sdc'}, set())}) {{(pid=75176) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 15:42:00 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-585335e7-3eb7-4c3d-9395-77097f973761 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Removing single pathed devices sdc {{(pid=75176) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 15:42:00 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:42:00 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:42:00 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[717cad7a-a10b-4b7a-b9b6-9c7ba50fe822]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:42:00 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:42:00 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.025s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:42:00 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2a372e2-5f16-4165-8769-75958b9b4e7b]: (4, ('ok\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:42:00 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-585335e7-3eb7-4c3d-9395-77097f973761 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Flushing IO for device /dev/sdc {{(pid=75176) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 15:42:00 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:42:00 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:42:00 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[90679196-c0ed-4b1c-b444-f2495c5f3082]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:42:00 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-585335e7-3eb7-4c3d-9395-77097f973761 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75176) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 15:42:00 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:42:00 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.049s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:42:00 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[3812fe5b-41f0-4eda-b4d1-374e60d37d89]: (4, ('1', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:42:00 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-585335e7-3eb7-4c3d-9395-77097f973761 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75176) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 15:42:00 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-585335e7-3eb7-4c3d-9395-77097f973761 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] SCSI volumes sdc have been removed. {{(pid=75176) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 15:42:00 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-585335e7-3eb7-4c3d-9395-77097f973761 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:81326542-482f-4d50-895c-13c65fe4daf7')] {{(pid=75176) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 15:42:00 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81326542-482f-4d50-895c-13c65fe4daf7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:42:00 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81326542-482f-4d50-895c-13c65fe4daf7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:42:00 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[47ea5542-a207-4166-b5c6-8a3400aa917c]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:42:00 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-585335e7-3eb7-4c3d-9395-77097f973761 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:42:00 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81326542-482f-4d50-895c-13c65fe4daf7 -p 172.16.0.220:3260 --logout {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:42:00 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81326542-482f-4d50-895c-13c65fe4daf7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:42:00 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd202539-9370-4c2f-aaf0-cf71a0b76c3c]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:81326542-482f-4d50-895c-13c65fe4daf7, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:81326542-482f-4d50-895c-13c65fe4daf7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:42:00 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-585335e7-3eb7-4c3d-9395-77097f973761 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:81326542-482f-4d50-895c-13c65fe4daf7, portal: 172.16.0.220,3260]
Nov 28 15:42:00 user nova-compute[75176]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:81326542-482f-4d50-895c-13c65fe4daf7, portal: 172.16.0.220,3260] successful.
Nov 28 15:42:00 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:42:00 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81326542-482f-4d50-895c-13c65fe4daf7 -p 172.16.0.220:3260 --op delete {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:42:00 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81326542-482f-4d50-895c-13c65fe4daf7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:42:00 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bdec2c5-b96d-4adc-9384-4d0466bce692]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:42:00 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-585335e7-3eb7-4c3d-9395-77097f973761 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:42:00 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-585335e7-3eb7-4c3d-9395-77097f973761 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.322s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 15:42:00 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-585335e7-3eb7-4c3d-9395-77097f973761 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] <== disconnect_volume: return (647ms) None {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 15:42:00 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-585335e7-3eb7-4c3d-9395-77097f973761 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] Disconnected iSCSI Volume {{(pid=75176) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 15:42:00 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-585335e7-3eb7-4c3d-9395-77097f973761 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] Deleting instance files /opt/stack/data/nova/instances/041af768-197b-4c76-a5a1-28e2dc8255bd_del
Nov 28 15:42:00 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-585335e7-3eb7-4c3d-9395-77097f973761 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] Deletion of /opt/stack/data/nova/instances/041af768-197b-4c76-a5a1-28e2dc8255bd_del complete
Nov 28 15:42:00 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-7cdc348f-cb18-4af3-afbd-6e884b995494 tempest-VolumesAssistedSnapshotsTest-1324886908 tempest-VolumesAssistedSnapshotsTest-1324886908-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.405s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 15:42:00 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:42:00 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:42:00 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[256c98b5-8115-422f-989a-3e1f8fd8d722]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:76ea4d3b-7c77-47d0-b48b-ad79886d4f9a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ff70e82d-37da-4392-b25a-e9b80992af80\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:42:00 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cdc348f-cb18-4af3-afbd-6e884b995494 tempest-VolumesAssistedSnapshotsTest-1324886908 tempest-VolumesAssistedSnapshotsTest-1324886908-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 15:42:00 user nova-compute[75176]: No targets found.
Nov 28 15:42:00 user nova-compute[75176]: iSNS:
Nov 28 15:42:00 user nova-compute[75176]: No targets found.
Nov 28 15:42:00 user nova-compute[75176]: STATIC:
Nov 28 15:42:00 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:76ea4d3b-7c77-47d0-b48b-ad79886d4f9a
Nov 28 15:42:00 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:42:00 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:42:00 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:ff70e82d-37da-4392-b25a-e9b80992af80
Nov 28 15:42:00 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:42:00 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:42:00 user nova-compute[75176]: FIRMWARE:
Nov 28 15:42:00 user nova-compute[75176]: No targets found.
Nov 28 15:42:00 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:42:00 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cdc348f-cb18-4af3-afbd-6e884b995494 tempest-VolumesAssistedSnapshotsTest-1324886908 tempest-VolumesAssistedSnapshotsTest-1324886908-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 15:42:00 user nova-compute[75176]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 15:42:00 user nova-compute[75176]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75176) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 15:42:00 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cdc348f-cb18-4af3-afbd-6e884b995494 tempest-VolumesAssistedSnapshotsTest-1324886908 tempest-VolumesAssistedSnapshotsTest-1324886908-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ff70e82d-37da-4392-b25a-e9b80992af80', 0)] {{(pid=75176) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 15:42:00 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:42:00 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:42:00 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[81719242-83c0-492a-9346-984fbb3825d6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:76ea4d3b-7c77-47d0-b48b-ad79886d4f9a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ff70e82d-37da-4392-b25a-e9b80992af80\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:42:00 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:42:00 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:42:00 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a9b9ca5-0e26-4535-83e8-03da306d1603]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff70e82d-37da-4392-b25a-e9b80992af80 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76ea4d3b-7c77-47d0-b48b-ad79886d4f9a (non-flash)\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:42:00 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cdc348f-cb18-4af3-afbd-6e884b995494 tempest-VolumesAssistedSnapshotsTest-1324886908 tempest-VolumesAssistedSnapshotsTest-1324886908-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff70e82d-37da-4392-b25a-e9b80992af80 (non-flash)
Nov 28 15:42:00 user nova-compute[75176]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76ea4d3b-7c77-47d0-b48b-ad79886d4f9a (non-flash)
Nov 28 15:42:00 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:42:00 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cdc348f-cb18-4af3-afbd-6e884b995494 tempest-VolumesAssistedSnapshotsTest-1324886908 tempest-VolumesAssistedSnapshotsTest-1324886908-project-admin] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff70e82d-37da-4392-b25a-e9b80992af80 (non-flash)
Nov 28 15:42:00 user nova-compute[75176]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76ea4d3b-7c77-47d0-b48b-ad79886d4f9a (non-flash)
Nov 28 15:42:00 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 15:42:00 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cdc348f-cb18-4af3-afbd-6e884b995494 tempest-VolumesAssistedSnapshotsTest-1324886908 tempest-VolumesAssistedSnapshotsTest-1324886908-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f464c37bb50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ff70e82d-37da-4392-b25a-e9b80992af80'): ({'sdk'}, set())}) {{(pid=75176) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 15:42:00 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-7cdc348f-cb18-4af3-afbd-6e884b995494 tempest-VolumesAssistedSnapshotsTest-1324886908 tempest-VolumesAssistedSnapshotsTest-1324886908-project-admin] Removing single pathed devices sdk {{(pid=75176) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 15:42:00 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:42:00 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:42:00 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dfe930d-530d-421d-8ea2-0e7c0fa2ab30]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:42:00 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdk {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:42:00 user nova-compute[75176]: INFO nova.compute.manager [None req-585335e7-3eb7-4c3d-9395-77097f973761 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] Took 7.65 seconds to destroy the instance on the hypervisor.
Nov 28 15:42:00 user nova-compute[75176]: DEBUG oslo.service.loopingcall [None req-585335e7-3eb7-4c3d-9395-77097f973761 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75176) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 15:42:00 user nova-compute[75176]: DEBUG nova.compute.manager [-] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] Deallocating network for instance {{(pid=75176) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 15:42:00 user nova-compute[75176]: DEBUG nova.network.neutron [-] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] deallocate_for_instance() {{(pid=75176) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 15:42:00 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdk" returned: 0 in 0.021s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:42:00 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[529484d3-c78d-4368-8bdd-952457e67d50]: (4, ('ok\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:42:00 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-7cdc348f-cb18-4af3-afbd-6e884b995494 tempest-VolumesAssistedSnapshotsTest-1324886908 tempest-VolumesAssistedSnapshotsTest-1324886908-project-admin] Flushing IO for device /dev/sdk {{(pid=75176) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 15:42:00 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdk {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:42:00 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdk" returned: 0 in 0.017s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:42:00 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[93a3018f-9d0d-480d-8e89-af471a871508]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:42:00 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-7cdc348f-cb18-4af3-afbd-6e884b995494 tempest-VolumesAssistedSnapshotsTest-1324886908 tempest-VolumesAssistedSnapshotsTest-1324886908-project-admin] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=75176) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 15:42:00 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdk/device/delete {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:42:00 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdk/device/delete" returned: 0 in 0.048s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:42:00 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bd31d6c-52fd-4795-bbd5-12dd3383c9ba]: (4, ('1', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:42:00 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-7cdc348f-cb18-4af3-afbd-6e884b995494 tempest-VolumesAssistedSnapshotsTest-1324886908 tempest-VolumesAssistedSnapshotsTest-1324886908-project-admin] Checking to see if SCSI volumes sdk have been removed. {{(pid=75176) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 15:42:00 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-7cdc348f-cb18-4af3-afbd-6e884b995494 tempest-VolumesAssistedSnapshotsTest-1324886908 tempest-VolumesAssistedSnapshotsTest-1324886908-project-admin] SCSI volumes sdk have been removed. {{(pid=75176) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 15:42:00 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cdc348f-cb18-4af3-afbd-6e884b995494 tempest-VolumesAssistedSnapshotsTest-1324886908 tempest-VolumesAssistedSnapshotsTest-1324886908-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ff70e82d-37da-4392-b25a-e9b80992af80')] {{(pid=75176) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 15:42:00 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff70e82d-37da-4392-b25a-e9b80992af80 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:42:00 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff70e82d-37da-4392-b25a-e9b80992af80 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:42:00 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bf447ce-dc5f-4f41-800c-33a09c4079c4]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:42:00 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cdc348f-cb18-4af3-afbd-6e884b995494 tempest-VolumesAssistedSnapshotsTest-1324886908 tempest-VolumesAssistedSnapshotsTest-1324886908-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:42:00 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff70e82d-37da-4392-b25a-e9b80992af80 -p 172.16.0.220:3260 --logout {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:42:00 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff70e82d-37da-4392-b25a-e9b80992af80 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:42:00 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[06b73be7-c7f9-4658-a7be-7040eb104d2b]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:ff70e82d-37da-4392-b25a-e9b80992af80, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:ff70e82d-37da-4392-b25a-e9b80992af80, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:42:00 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cdc348f-cb18-4af3-afbd-6e884b995494 tempest-VolumesAssistedSnapshotsTest-1324886908 tempest-VolumesAssistedSnapshotsTest-1324886908-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:ff70e82d-37da-4392-b25a-e9b80992af80, portal: 172.16.0.220,3260]
Nov 28 15:42:00 user nova-compute[75176]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:ff70e82d-37da-4392-b25a-e9b80992af80, portal: 172.16.0.220,3260] successful.
Nov 28 15:42:00 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:42:00 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff70e82d-37da-4392-b25a-e9b80992af80 -p 172.16.0.220:3260 --op delete {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:42:00 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff70e82d-37da-4392-b25a-e9b80992af80 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:42:00 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e33183f-bdf7-4cd1-ade2-f14cd50e38ca]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:42:00 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cdc348f-cb18-4af3-afbd-6e884b995494 tempest-VolumesAssistedSnapshotsTest-1324886908 tempest-VolumesAssistedSnapshotsTest-1324886908-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:42:00 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-7cdc348f-cb18-4af3-afbd-6e884b995494 tempest-VolumesAssistedSnapshotsTest-1324886908 tempest-VolumesAssistedSnapshotsTest-1324886908-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.316s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 15:42:00 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cdc348f-cb18-4af3-afbd-6e884b995494 tempest-VolumesAssistedSnapshotsTest-1324886908 tempest-VolumesAssistedSnapshotsTest-1324886908-project-admin] <== disconnect_volume: return (721ms) None {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 15:42:00 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7cdc348f-cb18-4af3-afbd-6e884b995494 tempest-VolumesAssistedSnapshotsTest-1324886908 tempest-VolumesAssistedSnapshotsTest-1324886908-project-admin] [instance: 1d99de1a-8a82-447a-8a18-02e4efd3b3f0] Disconnected iSCSI Volume {{(pid=75176) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 15:42:00 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-b469a21b-cdfb-4f59-9409-786dfeb47caf tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.647s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 15:42:00 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:42:00 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:42:00 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bbe3c09-3100-4040-bf8d-b526ec5ec10f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:76ea4d3b-7c77-47d0-b48b-ad79886d4f9a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:42:00 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-b469a21b-cdfb-4f59-9409-786dfeb47caf tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 15:42:00 user nova-compute[75176]: No targets found.
Nov 28 15:42:00 user nova-compute[75176]: iSNS:
Nov 28 15:42:00 user nova-compute[75176]: No targets found.
Nov 28 15:42:00 user nova-compute[75176]: STATIC:
Nov 28 15:42:00 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:76ea4d3b-7c77-47d0-b48b-ad79886d4f9a
Nov 28 15:42:00 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:42:00 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:42:00 user nova-compute[75176]: FIRMWARE:
Nov 28 15:42:00 user nova-compute[75176]: No targets found.
Nov 28 15:42:00 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:42:00 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-b469a21b-cdfb-4f59-9409-786dfeb47caf tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 15:42:00 user nova-compute[75176]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 15:42:00 user nova-compute[75176]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75176) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 15:42:00 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-b469a21b-cdfb-4f59-9409-786dfeb47caf tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:76ea4d3b-7c77-47d0-b48b-ad79886d4f9a', 0)] {{(pid=75176) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 15:42:00 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:42:00 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:42:00 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[c07c8a63-f596-40d3-9601-65a2b90a039f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:76ea4d3b-7c77-47d0-b48b-ad79886d4f9a\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:42:00 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:42:00 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:42:00 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e0fb514-b34f-437a-ac42-f559f683ce64]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76ea4d3b-7c77-47d0-b48b-ad79886d4f9a (non-flash)\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:42:00 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-b469a21b-cdfb-4f59-9409-786dfeb47caf tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76ea4d3b-7c77-47d0-b48b-ad79886d4f9a (non-flash)
Nov 28 15:42:00 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:42:00 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-b469a21b-cdfb-4f59-9409-786dfeb47caf tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76ea4d3b-7c77-47d0-b48b-ad79886d4f9a (non-flash)
Nov 28 15:42:00 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 15:42:00 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-b469a21b-cdfb-4f59-9409-786dfeb47caf tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f464c1fea70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:76ea4d3b-7c77-47d0-b48b-ad79886d4f9a'): ({'sdd'}, set())}) {{(pid=75176) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 15:42:00 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-b469a21b-cdfb-4f59-9409-786dfeb47caf tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Removing single pathed devices sdd {{(pid=75176) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 15:42:00 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:42:00 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:42:00 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[77b0c460-6a81-4410-8739-e27f9af27a2a]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:42:00 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:42:00 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:42:00 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[b151794e-4e07-486a-b748-12cb5e2ed1af]: (4, ('ok\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:42:00 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-b469a21b-cdfb-4f59-9409-786dfeb47caf tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Flushing IO for device /dev/sdd {{(pid=75176) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 15:42:00 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:42:00 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:42:00 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[94266605-4ca9-4bbc-9964-9dd24c5e0885]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:42:00 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-b469a21b-cdfb-4f59-9409-786dfeb47caf tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75176) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 15:42:00 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:42:00 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.057s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:42:00 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5e71200-0765-43b5-bf8c-56bee85cf390]: (4, ('1', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:42:00 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-b469a21b-cdfb-4f59-9409-786dfeb47caf tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75176) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 15:42:00 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-b469a21b-cdfb-4f59-9409-786dfeb47caf tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] SCSI volumes sdd have been removed. {{(pid=75176) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 15:42:00 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-b469a21b-cdfb-4f59-9409-786dfeb47caf tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:76ea4d3b-7c77-47d0-b48b-ad79886d4f9a')] {{(pid=75176) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 15:42:00 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76ea4d3b-7c77-47d0-b48b-ad79886d4f9a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:42:00 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76ea4d3b-7c77-47d0-b48b-ad79886d4f9a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:42:00 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd84939c-d93e-4e6b-af0c-8ec9c3c8487e]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:42:00 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-b469a21b-cdfb-4f59-9409-786dfeb47caf tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:42:00 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76ea4d3b-7c77-47d0-b48b-ad79886d4f9a -p 172.16.0.220:3260 --logout {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:42:00 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:42:01 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76ea4d3b-7c77-47d0-b48b-ad79886d4f9a -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:42:01 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[53434996-7712-48e1-b1e8-f93a3cd0bb91]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:76ea4d3b-7c77-47d0-b48b-ad79886d4f9a, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:76ea4d3b-7c77-47d0-b48b-ad79886d4f9a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:42:01 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-b469a21b-cdfb-4f59-9409-786dfeb47caf tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:76ea4d3b-7c77-47d0-b48b-ad79886d4f9a, portal: 172.16.0.220,3260]
Nov 28 15:42:01 user nova-compute[75176]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:76ea4d3b-7c77-47d0-b48b-ad79886d4f9a, portal: 172.16.0.220,3260] successful.
Nov 28 15:42:01 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:42:01 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76ea4d3b-7c77-47d0-b48b-ad79886d4f9a -p 172.16.0.220:3260 --op delete {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:42:01 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76ea4d3b-7c77-47d0-b48b-ad79886d4f9a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:42:01 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b08d13f-232a-49ff-abe2-4f6728c63a9d]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:42:01 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-b469a21b-cdfb-4f59-9409-786dfeb47caf tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:42:01 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-b469a21b-cdfb-4f59-9409-786dfeb47caf tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.354s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 15:42:01 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-b469a21b-cdfb-4f59-9409-786dfeb47caf tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] <== disconnect_volume: return (1001ms) None {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 15:42:01 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b469a21b-cdfb-4f59-9409-786dfeb47caf tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] Disconnected iSCSI Volume {{(pid=75176) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 15:42:01 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-b469a21b-cdfb-4f59-9409-786dfeb47caf tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] Deleting instance files /opt/stack/data/nova/instances/b714fb94-fcc7-40ae-b3a9-d8c9a60008f1_del
Nov 28 15:42:01 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-b469a21b-cdfb-4f59-9409-786dfeb47caf tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] Deletion of /opt/stack/data/nova/instances/b714fb94-fcc7-40ae-b3a9-d8c9a60008f1_del complete
Nov 28 15:42:01 user nova-compute[75176]: INFO nova.compute.manager [None req-b469a21b-cdfb-4f59-9409-786dfeb47caf tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] Took 7.08 seconds to destroy the instance on the hypervisor.
Nov 28 15:42:01 user nova-compute[75176]: DEBUG oslo.service.loopingcall [None req-b469a21b-cdfb-4f59-9409-786dfeb47caf tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75176) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 15:42:01 user nova-compute[75176]: DEBUG nova.compute.manager [-] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] Deallocating network for instance {{(pid=75176) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 15:42:01 user nova-compute[75176]: DEBUG nova.network.neutron [-] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] deallocate_for_instance() {{(pid=75176) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 15:42:01 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-c40e5dd9-3bda-442e-8465-b1850c720249 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] [instance: 916b82eb-97e8-411c-a8ea-8c27d101b48e] Creating instance directory {{(pid=75176) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 15:42:01 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-c40e5dd9-3bda-442e-8465-b1850c720249 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] [instance: 916b82eb-97e8-411c-a8ea-8c27d101b48e] Creating image(s)
Nov 28 15:42:01 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-c40e5dd9-3bda-442e-8465-b1850c720249 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] [instance: 916b82eb-97e8-411c-a8ea-8c27d101b48e] Did not create local disks {{(pid=75176) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 28 15:42:01 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-c40e5dd9-3bda-442e-8465-b1850c720249 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] [instance: 916b82eb-97e8-411c-a8ea-8c27d101b48e] Ensure instance console log exists: /opt/stack/data/nova/instances/916b82eb-97e8-411c-a8ea-8c27d101b48e/console.log {{(pid=75176) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 15:42:01 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-c40e5dd9-3bda-442e-8465-b1850c720249 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:42:01 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-c40e5dd9-3bda-442e-8465-b1850c720249 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:42:01 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-c40e5dd9-3bda-442e-8465-b1850c720249 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:42:01 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-c40e5dd9-3bda-442e-8465-b1850c720249 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] [instance: 916b82eb-97e8-411c-a8ea-8c27d101b48e] Start _get_guest_xml network_info=[{"id": "38bef3fc-c841-4db3-b429-8fe94a224783", "address": "fa:16:3e:13:6e:cf", "network": {"id": "dc41c201-1473-486f-abc4-30a09c441826", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2062231487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d68d78d1dd684c2c920ae8e4ce3eaa21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38bef3fc-c8", "ovs_interfaceid": "38bef3fc-c841-4db3-b429-8fe94a224783", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T15:35:12Z,direct_url=<?>,disk_format='qcow2',id=1f41819e-c93f-4dc7-b253-37a27bbbbc74,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1b91c5d0672c4224a48df2e1f92688e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T15:35:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IhQCYfRb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '916b82eb-97e8-411c-a8ea-8c27d101b48e', 'attached_at': '', 'detached_at': '', 'volume_id': 'ec90fb93-901a-43ab-ba96-58f9505953e9', 'serial': 'ec90fb93-901a-43ab-ba96-58f9505953e9'}, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'delete_on_termination': True, 'mount_device': '/dev/vda', 'attachment_id': 'cf4f91b9-5953-4d4d-a876-8cbbed325399', 'volume_type': None} {{(pid=75176) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 15:42:01 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-c40e5dd9-3bda-442e-8465-b1850c720249 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 28 15:42:01 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-c40e5dd9-3bda-442e-8465-b1850c720249 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 28 15:42:01 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-c40e5dd9-3bda-442e-8465-b1850c720249 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75176) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 15:42:01 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-c40e5dd9-3bda-442e-8465-b1850c720249 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] CPU controller missing on host. {{(pid=75176) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 15:42:01 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-c40e5dd9-3bda-442e-8465-b1850c720249 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75176) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 15:42:01 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-c40e5dd9-3bda-442e-8465-b1850c720249 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] CPU controller found on host. {{(pid=75176) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 15:42:01 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-c40e5dd9-3bda-442e-8465-b1850c720249 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75176) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 15:42:01 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-c40e5dd9-3bda-442e-8465-b1850c720249 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T15:35:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T15:35:12Z,direct_url=<?>,disk_format='qcow2',id=1f41819e-c93f-4dc7-b253-37a27bbbbc74,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1b91c5d0672c4224a48df2e1f92688e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T15:35:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 15:42:01 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-c40e5dd9-3bda-442e-8465-b1850c720249 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] Flavor limits 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 15:42:01 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-c40e5dd9-3bda-442e-8465-b1850c720249 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] Image limits 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 15:42:01 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-c40e5dd9-3bda-442e-8465-b1850c720249 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] Flavor pref 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 15:42:01 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-c40e5dd9-3bda-442e-8465-b1850c720249 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] Image pref 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 15:42:01 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-c40e5dd9-3bda-442e-8465-b1850c720249 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 15:42:01 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-c40e5dd9-3bda-442e-8465-b1850c720249 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 15:42:01 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-c40e5dd9-3bda-442e-8465-b1850c720249 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75176) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 15:42:01 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-c40e5dd9-3bda-442e-8465-b1850c720249 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] Got 1 possible topologies {{(pid=75176) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 15:42:01 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-c40e5dd9-3bda-442e-8465-b1850c720249 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 15:42:01 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-c40e5dd9-3bda-442e-8465-b1850c720249 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 15:42:01 user nova-compute[75176]: DEBUG nova.objects.instance [None req-c40e5dd9-3bda-442e-8465-b1850c720249 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] Lazy-loading 'vcpu_model' on Instance uuid 916b82eb-97e8-411c-a8ea-8c27d101b48e {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:42:01 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c40e5dd9-3bda-442e-8465-b1850c720249 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] [instance: 916b82eb-97e8-411c-a8ea-8c27d101b48e] Calling os-brick to attach iSCSI Volume {{(pid=75176) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 15:42:01 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-c40e5dd9-3bda-442e-8465-b1850c720249 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c1b8a00>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IhQCYfRb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 15:42:01 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-c40e5dd9-3bda-442e-8465-b1850c720249 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 28 15:42:01 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-c40e5dd9-3bda-442e-8465-b1850c720249 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 15:42:01 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-c40e5dd9-3bda-442e-8465-b1850c720249 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 15:42:01 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-c40e5dd9-3bda-442e-8465-b1850c720249 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 28 15:42:01 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-c40e5dd9-3bda-442e-8465-b1850c720249 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 15:42:01 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-c40e5dd9-3bda-442e-8465-b1850c720249 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 15:42:01 user nova-compute[75176]: INFO os_brick.initiator.connectors.iscsi [None req-c40e5dd9-3bda-442e-8465-b1850c720249 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 15:42:01 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9 -p 172.16.0.220:3260 {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:42:01 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9 -p 172.16.0.220:3260" returned: 21 in 0.028s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:42:01 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8178f0d-26fc-46b8-8aa3-76e1974efd2e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:42:01 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-c40e5dd9-3bda-442e-8465-b1850c720249 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 15:42:01 user nova-compute[75176]:  {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:42:01 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9 -p 172.16.0.220:3260 --interface default --op new {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:42:01 user nova-compute[75176]: DEBUG nova.objects.instance [None req-7cdc348f-cb18-4af3-afbd-6e884b995494 tempest-VolumesAssistedSnapshotsTest-1324886908 tempest-VolumesAssistedSnapshotsTest-1324886908-project-admin] Lazy-loading 'flavor' on Instance uuid 1d99de1a-8a82-447a-8a18-02e4efd3b3f0 {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:42:01 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:42:01 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[55c3f68d-ed4b-4e58-8620-2cb8af99b64b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9] added\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:42:01 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-c40e5dd9-3bda-442e-8465-b1850c720249 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9] added
Nov 28 15:42:01 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:42:01 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:42:01 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:42:01 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f771a78-59c8-400e-9b53-c023bea12b4c]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:42:01 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-c40e5dd9-3bda-442e-8465-b1850c720249 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:42:01 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:42:01 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7cdc348f-cb18-4af3-afbd-6e884b995494 tempest-VolumesAssistedSnapshotsTest-1324886908 tempest-VolumesAssistedSnapshotsTest-1324886908-project-admin] Lock "1d99de1a-8a82-447a-8a18-02e4efd3b3f0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.197s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:42:01 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:42:01 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[7439f625-a799-481d-8c28-63ca154f7e4c]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:42:01 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-c40e5dd9-3bda-442e-8465-b1850c720249 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:42:01 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IhQCYfRb {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:42:01 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IhQCYfRb" returned: 0 in 0.029s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:42:01 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[569e9e8d-25fb-454f-8e6a-a1a3cd95a835]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:42:01 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-c40e5dd9-3bda-442e-8465-b1850c720249 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IhQCYfRb'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:42:01 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:42:01 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:42:01 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d61c9f5-d790-4051-8d94-2ee13ebefa0f]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:42:01 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-c40e5dd9-3bda-442e-8465-b1850c720249 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:42:01 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:42:01 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:42:01 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[46e5fa75-a028-4c0b-8bae-65d2a230523f]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:42:01 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-c40e5dd9-3bda-442e-8465-b1850c720249 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 28 15:42:01 user nova-compute[75176]:  {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:42:01 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-c40e5dd9-3bda-442e-8465-b1850c720249 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 28 15:42:01 user nova-compute[75176]:  {{(pid=75176) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 15:42:01 user nova-compute[75176]: WARNING os_brick.initiator.connectors.iscsi [None req-c40e5dd9-3bda-442e-8465-b1850c720249 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 28 15:42:01 user nova-compute[75176]: : NotImplementedError
Nov 28 15:42:01 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9 -p 172.16.0.220:3260 --login {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:42:01 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:42:01 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d1e7f01-dd4b-4e02-a2e2-35e1843b460d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:42:01 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-c40e5dd9-3bda-442e-8465-b1850c720249 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9, portal: 172.16.0.220,3260]
Nov 28 15:42:01 user nova-compute[75176]: Login to [iface: default, target: iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9, portal: 172.16.0.220,3260] successful.
Nov 28 15:42:01 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:42:01 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:42:01 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.055s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:42:01 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[42ac6e5f-0466-416b-8b91-f59083f33895]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:42:01 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-c40e5dd9-3bda-442e-8465-b1850c720249 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:42:01 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:42:01 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:42:01 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeaa13d8-aea4-4580-acd6-6a3ad3604cd0]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9 (non-flash)\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:42:01 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-c40e5dd9-3bda-442e-8465-b1850c720249 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9 (non-flash)
Nov 28 15:42:01 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:42:01 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-c40e5dd9-3bda-442e-8465-b1850c720249 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9 (non-flash)
Nov 28 15:42:01 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 15:42:01 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-c40e5dd9-3bda-442e-8465-b1850c720249 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.328s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 15:42:01 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-c40e5dd9-3bda-442e-8465-b1850c720249 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] Connected to 172.16.0.220:3260 {{(pid=75176) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 15:42:01 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-c40e5dd9-3bda-442e-8465-b1850c720249 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] HCTL ('33', '-', '-', 0) found on session 15 with lun 0 {{(pid=75176) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 15:42:01 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-c40e5dd9-3bda-442e-8465-b1850c720249 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75176) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 15:42:01 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:42:01 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:42:01 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca82fc76-9e1a-4f3b-a222-325dec269f31]: (4, ('- - 0', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:42:01 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-c40e5dd9-3bda-442e-8465-b1850c720249 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] Searching for a device in session 15 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75176) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 15:42:01 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-c40e5dd9-3bda-442e-8465-b1850c720249 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IhQCYfRb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75176) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 15:42:02 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-c40e5dd9-3bda-442e-8465-b1850c720249 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.362s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 15:42:02 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-c40e5dd9-3bda-442e-8465-b1850c720249 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] <== connect_volume: return (1365ms) {'type': 'block', 'scsi_wwn': '26533346230373363', 'path': '/dev/sdb'} {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 15:42:02 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c40e5dd9-3bda-442e-8465-b1850c720249 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] [instance: 916b82eb-97e8-411c-a8ea-8c27d101b48e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26533346230373363', 'path': '/dev/sdb'} {{(pid=75176) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 15:42:02 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-c40e5dd9-3bda-442e-8465-b1850c720249 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-28T15:39:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-762836390',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-2102540116',id=8,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCQNBGdiL2UyuS5dM6+KjwbgIJ/vX3p2dH1PNPmJxj5EzppPATyTzrKhi1oHmfMeT/UPJyLXI+eIry/aVtUhrMzZLSlMRjHwwDIb+xEYyhtsdb9ZUumnXRPBTV8py7ZAjw==',key_name='tempest-keypair-1515121820',keypairs=<?>,launch_index=0,launched_at=2023-11-28T15:39:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='d68d78d1dd684c2c920ae8e4ce3eaa21',ramdisk_id='',reservation_id='r-uy5cy6al',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-267222163',owner_user_name='tempest-ServerActionsV293TestJSON-267222163-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T15:41:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aea69806df134eeb946d4ed91bd7152b',uuid=916b82eb-97e8-411c-a8ea-8c27d101b48e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "38bef3fc-c841-4db3-b429-8fe94a224783", "address": "fa:16:3e:13:6e:cf", "network": {"id": "dc41c201-1473-486f-abc4-30a09c441826", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2062231487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d68d78d1dd684c2c920ae8e4ce3eaa21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38bef3fc-c8", "ovs_interfaceid": "38bef3fc-c841-4db3-b429-8fe94a224783", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75176) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 15:42:02 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-c40e5dd9-3bda-442e-8465-b1850c720249 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] Converting VIF {"id": "38bef3fc-c841-4db3-b429-8fe94a224783", "address": "fa:16:3e:13:6e:cf", "network": {"id": "dc41c201-1473-486f-abc4-30a09c441826", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2062231487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d68d78d1dd684c2c920ae8e4ce3eaa21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38bef3fc-c8", "ovs_interfaceid": "38bef3fc-c841-4db3-b429-8fe94a224783", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:42:02 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-c40e5dd9-3bda-442e-8465-b1850c720249 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:13:6e:cf,bridge_name='br-int',has_traffic_filtering=True,id=38bef3fc-c841-4db3-b429-8fe94a224783,network=Network(dc41c201-1473-486f-abc4-30a09c441826),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38bef3fc-c8') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:42:02 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-c40e5dd9-3bda-442e-8465-b1850c720249 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] [instance: 916b82eb-97e8-411c-a8ea-8c27d101b48e] End _get_guest_xml xml=<domain type="kvm">
Nov 28 15:42:02 user nova-compute[75176]:   <uuid>916b82eb-97e8-411c-a8ea-8c27d101b48e</uuid>
Nov 28 15:42:02 user nova-compute[75176]:   <name>instance-00000008</name>
Nov 28 15:42:02 user nova-compute[75176]:   <memory>524288</memory>
Nov 28 15:42:02 user nova-compute[75176]:   <vcpu>1</vcpu>
Nov 28 15:42:02 user nova-compute[75176]:   <metadata>
Nov 28 15:42:02 user nova-compute[75176]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 15:42:02 user nova-compute[75176]:       <nova:package version="0.0.0"/>
Nov 28 15:42:02 user nova-compute[75176]:       <nova:name>tempest-ServerActionsV293TestJSON-server-762836390</nova:name>
Nov 28 15:42:02 user nova-compute[75176]:       <nova:creationTime>2023-11-28 15:42:01</nova:creationTime>
Nov 28 15:42:02 user nova-compute[75176]:       <nova:flavor name="m1.tiny">
Nov 28 15:42:02 user nova-compute[75176]:         <nova:memory>512</nova:memory>
Nov 28 15:42:02 user nova-compute[75176]:         <nova:disk>1</nova:disk>
Nov 28 15:42:02 user nova-compute[75176]:         <nova:swap>0</nova:swap>
Nov 28 15:42:02 user nova-compute[75176]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 15:42:02 user nova-compute[75176]:         <nova:vcpus>1</nova:vcpus>
Nov 28 15:42:02 user nova-compute[75176]:       </nova:flavor>
Nov 28 15:42:02 user nova-compute[75176]:       <nova:owner>
Nov 28 15:42:02 user nova-compute[75176]:         <nova:user uuid="aea69806df134eeb946d4ed91bd7152b">tempest-ServerActionsV293TestJSON-267222163-project-member</nova:user>
Nov 28 15:42:02 user nova-compute[75176]:         <nova:project uuid="d68d78d1dd684c2c920ae8e4ce3eaa21">tempest-ServerActionsV293TestJSON-267222163</nova:project>
Nov 28 15:42:02 user nova-compute[75176]:       </nova:owner>
Nov 28 15:42:02 user nova-compute[75176]:       <nova:ports>
Nov 28 15:42:02 user nova-compute[75176]:         <nova:port uuid="38bef3fc-c841-4db3-b429-8fe94a224783">
Nov 28 15:42:02 user nova-compute[75176]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 28 15:42:02 user nova-compute[75176]:         </nova:port>
Nov 28 15:42:02 user nova-compute[75176]:       </nova:ports>
Nov 28 15:42:02 user nova-compute[75176]:     </nova:instance>
Nov 28 15:42:02 user nova-compute[75176]:   </metadata>
Nov 28 15:42:02 user nova-compute[75176]:   <sysinfo type="smbios">
Nov 28 15:42:02 user nova-compute[75176]:     <system>
Nov 28 15:42:02 user nova-compute[75176]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 15:42:02 user nova-compute[75176]:       <entry name="product">OpenStack Nova</entry>
Nov 28 15:42:02 user nova-compute[75176]:       <entry name="version">0.0.0</entry>
Nov 28 15:42:02 user nova-compute[75176]:       <entry name="serial">916b82eb-97e8-411c-a8ea-8c27d101b48e</entry>
Nov 28 15:42:02 user nova-compute[75176]:       <entry name="uuid">916b82eb-97e8-411c-a8ea-8c27d101b48e</entry>
Nov 28 15:42:02 user nova-compute[75176]:       <entry name="family">Virtual Machine</entry>
Nov 28 15:42:02 user nova-compute[75176]:     </system>
Nov 28 15:42:02 user nova-compute[75176]:   </sysinfo>
Nov 28 15:42:02 user nova-compute[75176]:   <os>
Nov 28 15:42:02 user nova-compute[75176]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 15:42:02 user nova-compute[75176]:     <boot dev="hd"/>
Nov 28 15:42:02 user nova-compute[75176]:     <smbios mode="sysinfo"/>
Nov 28 15:42:02 user nova-compute[75176]:   </os>
Nov 28 15:42:02 user nova-compute[75176]:   <features>
Nov 28 15:42:02 user nova-compute[75176]:     <acpi/>
Nov 28 15:42:02 user nova-compute[75176]:     <apic/>
Nov 28 15:42:02 user nova-compute[75176]:     <vmcoreinfo/>
Nov 28 15:42:02 user nova-compute[75176]:   </features>
Nov 28 15:42:02 user nova-compute[75176]:   <clock offset="utc">
Nov 28 15:42:02 user nova-compute[75176]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 15:42:02 user nova-compute[75176]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 15:42:02 user nova-compute[75176]:     <timer name="hpet" present="no"/>
Nov 28 15:42:02 user nova-compute[75176]:   </clock>
Nov 28 15:42:02 user nova-compute[75176]:   <cpu mode="custom" match="exact">
Nov 28 15:42:02 user nova-compute[75176]:     <model>Nehalem</model>
Nov 28 15:42:02 user nova-compute[75176]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 15:42:02 user nova-compute[75176]:   </cpu>
Nov 28 15:42:02 user nova-compute[75176]:   <devices>
Nov 28 15:42:02 user nova-compute[75176]:     <disk type="block" device="disk">
Nov 28 15:42:02 user nova-compute[75176]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 15:42:02 user nova-compute[75176]:       <source dev="/dev/sdb"/>
Nov 28 15:42:02 user nova-compute[75176]:       <target dev="vda" bus="virtio"/>
Nov 28 15:42:02 user nova-compute[75176]:       <serial>ec90fb93-901a-43ab-ba96-58f9505953e9</serial>
Nov 28 15:42:02 user nova-compute[75176]:     </disk>
Nov 28 15:42:02 user nova-compute[75176]:     <interface type="ethernet">
Nov 28 15:42:02 user nova-compute[75176]:       <mac address="fa:16:3e:13:6e:cf"/>
Nov 28 15:42:02 user nova-compute[75176]:       <model type="virtio"/>
Nov 28 15:42:02 user nova-compute[75176]:       <mtu size="1442"/>
Nov 28 15:42:02 user nova-compute[75176]:       <target dev="tap38bef3fc-c8"/>
Nov 28 15:42:02 user nova-compute[75176]:     </interface>
Nov 28 15:42:02 user nova-compute[75176]:     <serial type="pty">
Nov 28 15:42:02 user nova-compute[75176]:       <log file="/opt/stack/data/nova/instances/916b82eb-97e8-411c-a8ea-8c27d101b48e/console.log" append="off"/>
Nov 28 15:42:02 user nova-compute[75176]:     </serial>
Nov 28 15:42:02 user nova-compute[75176]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 15:42:02 user nova-compute[75176]:     <video>
Nov 28 15:42:02 user nova-compute[75176]:       <model type="virtio"/>
Nov 28 15:42:02 user nova-compute[75176]:     </video>
Nov 28 15:42:02 user nova-compute[75176]:     <rng model="virtio">
Nov 28 15:42:02 user nova-compute[75176]:       <backend model="random">/dev/urandom</backend>
Nov 28 15:42:02 user nova-compute[75176]:     </rng>
Nov 28 15:42:02 user nova-compute[75176]:     <controller type="usb" index="0" model="none"/>
Nov 28 15:42:02 user nova-compute[75176]:     <memballoon model="virtio">
Nov 28 15:42:02 user nova-compute[75176]:       <stats period="10"/>
Nov 28 15:42:02 user nova-compute[75176]:     </memballoon>
Nov 28 15:42:02 user nova-compute[75176]:   </devices>
Nov 28 15:42:02 user nova-compute[75176]: </domain>
Nov 28 15:42:02 user nova-compute[75176]:  {{(pid=75176) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 15:42:02 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-c40e5dd9-3bda-442e-8465-b1850c720249 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-28T15:39:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-762836390',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-2102540116',id=8,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCQNBGdiL2UyuS5dM6+KjwbgIJ/vX3p2dH1PNPmJxj5EzppPATyTzrKhi1oHmfMeT/UPJyLXI+eIry/aVtUhrMzZLSlMRjHwwDIb+xEYyhtsdb9ZUumnXRPBTV8py7ZAjw==',key_name='tempest-keypair-1515121820',keypairs=<?>,launch_index=0,launched_at=2023-11-28T15:39:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='d68d78d1dd684c2c920ae8e4ce3eaa21',ramdisk_id='',reservation_id='r-uy5cy6al',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-267222163',owner_user_name='tempest-ServerActionsV293TestJSON-267222163-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T15:41:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aea69806df134eeb946d4ed91bd7152b',uuid=916b82eb-97e8-411c-a8ea-8c27d101b48e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "38bef3fc-c841-4db3-b429-8fe94a224783", "address": "fa:16:3e:13:6e:cf", "network": {"id": "dc41c201-1473-486f-abc4-30a09c441826", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2062231487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d68d78d1dd684c2c920ae8e4ce3eaa21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38bef3fc-c8", "ovs_interfaceid": "38bef3fc-c841-4db3-b429-8fe94a224783", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 15:42:02 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-c40e5dd9-3bda-442e-8465-b1850c720249 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] Converting VIF {"id": "38bef3fc-c841-4db3-b429-8fe94a224783", "address": "fa:16:3e:13:6e:cf", "network": {"id": "dc41c201-1473-486f-abc4-30a09c441826", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2062231487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d68d78d1dd684c2c920ae8e4ce3eaa21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38bef3fc-c8", "ovs_interfaceid": "38bef3fc-c841-4db3-b429-8fe94a224783", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:42:02 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-c40e5dd9-3bda-442e-8465-b1850c720249 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:13:6e:cf,bridge_name='br-int',has_traffic_filtering=True,id=38bef3fc-c841-4db3-b429-8fe94a224783,network=Network(dc41c201-1473-486f-abc4-30a09c441826),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38bef3fc-c8') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:42:02 user nova-compute[75176]: DEBUG os_vif [None req-c40e5dd9-3bda-442e-8465-b1850c720249 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:13:6e:cf,bridge_name='br-int',has_traffic_filtering=True,id=38bef3fc-c841-4db3-b429-8fe94a224783,network=Network(dc41c201-1473-486f-abc4-30a09c441826),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38bef3fc-c8') {{(pid=75176) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 15:42:02 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:42:02 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:42:02 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 15:42:02 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:42:02 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a7421129-5858-59dc-a331-fe7def718f91', '_type': 'linux-noop'}}, row=False) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:42:02 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:42:02 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:42:02 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:42:02 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:42:02 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap38bef3fc-c8, may_exist=True, interface_attrs={}) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:42:02 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap38bef3fc-c8, col_values=(('qos', UUID('89b15784-710c-44d5-8656-c785cdba14e4')),), if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:42:02 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap38bef3fc-c8, col_values=(('external_ids', {'iface-id': '38bef3fc-c841-4db3-b429-8fe94a224783', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:13:6e:cf', 'vm-uuid': '916b82eb-97e8-411c-a8ea-8c27d101b48e'}),), if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:42:02 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:42:02 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:42:03 user nova-compute[75176]: DEBUG nova.compute.manager [req-786727f4-1680-4ee3-8b7d-be0274805a5b req-3bf1c2e0-c442-4ff7-81c6-ec010ae87e00 service nova] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] Received event network-vif-deleted-0c65b96a-0fce-4bff-b89c-443cc48f6995 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:42:03 user nova-compute[75176]: INFO nova.compute.manager [req-786727f4-1680-4ee3-8b7d-be0274805a5b req-3bf1c2e0-c442-4ff7-81c6-ec010ae87e00 service nova] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] Neutron deleted interface 0c65b96a-0fce-4bff-b89c-443cc48f6995; detaching it from the instance and deleting it from the info cache
Nov 28 15:42:03 user nova-compute[75176]: DEBUG nova.network.neutron [req-786727f4-1680-4ee3-8b7d-be0274805a5b req-3bf1c2e0-c442-4ff7-81c6-ec010ae87e00 service nova] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] Updating instance_info_cache with network_info: [{"id": "99a8dbf9-5502-440a-a03d-cd52337b3009", "address": "fa:16:3e:e2:26:17", "network": {"id": "9fe0d7b7-e9dc-4e03-a401-452fd502c940", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1675540815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfdec2abaf704a1396611ff1bcb96e53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99a8dbf9-55", "ovs_interfaceid": "99a8dbf9-5502-440a-a03d-cd52337b3009", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6c94b138-6202-4fb7-92c7-b3744cd8d19d", "address": "fa:16:3e:09:2f:ed", "network": {"id": "d7dbc9c3-816f-46fb-a3d3-e0e817e15de3", "bridge": "br-int", "label": "tempest-device-tagging-net1-136440967", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfdec2abaf704a1396611ff1bcb96e53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c94b138-62", "ovs_interfaceid": "6c94b138-6202-4fb7-92c7-b3744cd8d19d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0ac967e7-41bc-4751-a2bc-499ffbface15", "address": "fa:16:3e:ce:ed:17", "network": {"id": "d7dbc9c3-816f-46fb-a3d3-e0e817e15de3", "bridge": "br-int", "label": "tempest-device-tagging-net1-136440967", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.48", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfdec2abaf704a1396611ff1bcb96e53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ac967e7-41", "ovs_interfaceid": "0ac967e7-41bc-4751-a2bc-499ffbface15", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3a800e7a-5628-4668-ae3e-d49b537f7a62", "address": "fa:16:3e:e0:28:72", "network": {"id": "d7dbc9c3-816f-46fb-a3d3-e0e817e15de3", "bridge": "br-int", "label": "tempest-device-tagging-net1-136440967", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.25", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfdec2abaf704a1396611ff1bcb96e53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a800e7a-56", "ovs_interfaceid": "3a800e7a-5628-4668-ae3e-d49b537f7a62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d9a60043-45d0-46f1-8d0f-ad1c7b55fa06", "address": "fa:16:3e:5c:fb:31", "network": {"id": "d7dbc9c3-816f-46fb-a3d3-e0e817e15de3", "bridge": "br-int", "label": "tempest-device-tagging-net1-136440967", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.54", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfdec2abaf704a1396611ff1bcb96e53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9a60043-45", "ovs_interfaceid": "d9a60043-45d0-46f1-8d0f-ad1c7b55fa06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2df03152-b1aa-4794-965d-64886ac889ea", "address": "fa:16:3e:7a:2f:2c", "network": {"id": "6a9822be-add5-4d71-8ef1-1ce105eed6af", "bridge": "br-int", "label": "tempest-device-tagging-net2-401277966", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cfdec2abaf704a1396611ff1bcb96e53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2df03152-b1", "ovs_interfaceid": "2df03152-b1aa-4794-965d-64886ac889ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:42:03 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:42:03 user nova-compute[75176]: INFO os_vif [None req-c40e5dd9-3bda-442e-8465-b1850c720249 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:13:6e:cf,bridge_name='br-int',has_traffic_filtering=True,id=38bef3fc-c841-4db3-b429-8fe94a224783,network=Network(dc41c201-1473-486f-abc4-30a09c441826),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38bef3fc-c8')
Nov 28 15:42:03 user nova-compute[75176]: DEBUG nova.compute.manager [req-786727f4-1680-4ee3-8b7d-be0274805a5b req-3bf1c2e0-c442-4ff7-81c6-ec010ae87e00 service nova] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] Detach interface failed, port_id=0c65b96a-0fce-4bff-b89c-443cc48f6995, reason: Instance 041af768-197b-4c76-a5a1-28e2dc8255bd could not be found. {{(pid=75176) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 28 15:42:03 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-c40e5dd9-3bda-442e-8465-b1850c720249 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] No BDM found with device name vda, not building metadata. {{(pid=75176) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 15:42:03 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-c40e5dd9-3bda-442e-8465-b1850c720249 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] No VIF found with MAC fa:16:3e:13:6e:cf, not building metadata {{(pid=75176) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 15:42:03 user nova-compute[75176]: DEBUG nova.compute.manager [req-52ede778-903d-4370-925b-959f6617e8de req-66d1f84f-0ae3-4d2b-930e-dfdaa3befa56 service nova] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] Received event network-vif-deleted-0bc36ba8-7fc6-47b2-b7b1-08a445625b46 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:42:03 user nova-compute[75176]: INFO nova.compute.manager [req-52ede778-903d-4370-925b-959f6617e8de req-66d1f84f-0ae3-4d2b-930e-dfdaa3befa56 service nova] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] Neutron deleted interface 0bc36ba8-7fc6-47b2-b7b1-08a445625b46; detaching it from the instance and deleting it from the info cache
Nov 28 15:42:03 user nova-compute[75176]: DEBUG nova.network.neutron [req-52ede778-903d-4370-925b-959f6617e8de req-66d1f84f-0ae3-4d2b-930e-dfdaa3befa56 service nova] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] Updating instance_info_cache with network_info: [{"id": "da7d30e5-6304-46ec-8d50-336986e6262f", "address": "fa:16:3e:63:83:5b", "network": {"id": "b1277b75-5749-436a-a651-3303fd60d8b4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1047877730-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0108444c01e94416984b083707102c58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda7d30e5-63", "ovs_interfaceid": "da7d30e5-6304-46ec-8d50-336986e6262f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e1ac011f-d965-4d4c-b4c8-aa9bf5201518", "address": "fa:16:3e:7f:e1:ea", "network": {"id": "26bf803a-6aa2-4e87-b407-caee3f8f7d3d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1638676687", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0108444c01e94416984b083707102c58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1ac011f-d9", "ovs_interfaceid": "e1ac011f-d965-4d4c-b4c8-aa9bf5201518", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "61157920-954a-479e-bd66-b0746a7843a7", "address": "fa:16:3e:8f:4f:39", "network": {"id": "26bf803a-6aa2-4e87-b407-caee3f8f7d3d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1638676687", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0108444c01e94416984b083707102c58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61157920-95", "ovs_interfaceid": "61157920-954a-479e-bd66-b0746a7843a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "04db431e-5bc8-4450-9bdd-82369fafba70", "address": "fa:16:3e:15:71:6f", "network": {"id": "26bf803a-6aa2-4e87-b407-caee3f8f7d3d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1638676687", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0108444c01e94416984b083707102c58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04db431e-5b", "ovs_interfaceid": "04db431e-5bc8-4450-9bdd-82369fafba70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0c08ccbe-f3de-4aed-b641-8e2b58bd73a0", "address": "fa:16:3e:59:54:f2", "network": {"id": "3936aa29-a691-4362-8bd9-536545b14473", "bridge": "br-int", "label": "tempest-device-tagging-net2-1089118081", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0108444c01e94416984b083707102c58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c08ccbe-f3", "ovs_interfaceid": "0c08ccbe-f3de-4aed-b641-8e2b58bd73a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e0b49239-50a0-4864-9e92-22bddcbe7d21", "address": "fa:16:3e:d8:78:24", "network": {"id": "3936aa29-a691-4362-8bd9-536545b14473", "bridge": "br-int", "label": "tempest-device-tagging-net2-1089118081", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0108444c01e94416984b083707102c58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0b49239-50", "ovs_interfaceid": "e0b49239-50a0-4864-9e92-22bddcbe7d21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:42:03 user nova-compute[75176]: DEBUG nova.compute.manager [req-52ede778-903d-4370-925b-959f6617e8de req-66d1f84f-0ae3-4d2b-930e-dfdaa3befa56 service nova] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] Detach interface failed, port_id=0bc36ba8-7fc6-47b2-b7b1-08a445625b46, reason: Instance b714fb94-fcc7-40ae-b3a9-d8c9a60008f1 could not be found. {{(pid=75176) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 28 15:42:04 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:42:04 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:42:04 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:42:04 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:42:04 user nova-compute[75176]: DEBUG nova.compute.manager [req-6d774866-7230-41c9-9f5b-dc7fdbba7b3e req-bb3f95fa-3818-4d2c-883c-460f900cd35f service nova] [instance: 916b82eb-97e8-411c-a8ea-8c27d101b48e] Received event network-vif-plugged-38bef3fc-c841-4db3-b429-8fe94a224783 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:42:04 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-6d774866-7230-41c9-9f5b-dc7fdbba7b3e req-bb3f95fa-3818-4d2c-883c-460f900cd35f service nova] Acquiring lock "916b82eb-97e8-411c-a8ea-8c27d101b48e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:42:04 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-6d774866-7230-41c9-9f5b-dc7fdbba7b3e req-bb3f95fa-3818-4d2c-883c-460f900cd35f service nova] Lock "916b82eb-97e8-411c-a8ea-8c27d101b48e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:42:04 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-6d774866-7230-41c9-9f5b-dc7fdbba7b3e req-bb3f95fa-3818-4d2c-883c-460f900cd35f service nova] Lock "916b82eb-97e8-411c-a8ea-8c27d101b48e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:42:04 user nova-compute[75176]: DEBUG nova.compute.manager [req-6d774866-7230-41c9-9f5b-dc7fdbba7b3e req-bb3f95fa-3818-4d2c-883c-460f900cd35f service nova] [instance: 916b82eb-97e8-411c-a8ea-8c27d101b48e] No waiting events found dispatching network-vif-plugged-38bef3fc-c841-4db3-b429-8fe94a224783 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:42:04 user nova-compute[75176]: WARNING nova.compute.manager [req-6d774866-7230-41c9-9f5b-dc7fdbba7b3e req-bb3f95fa-3818-4d2c-883c-460f900cd35f service nova] [instance: 916b82eb-97e8-411c-a8ea-8c27d101b48e] Received unexpected event network-vif-plugged-38bef3fc-c841-4db3-b429-8fe94a224783 for instance with vm_state active and task_state rebuild_spawning.
Nov 28 15:42:05 user nova-compute[75176]: DEBUG nova.network.neutron [-] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] Updating instance_info_cache with network_info: [] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:42:05 user nova-compute[75176]: DEBUG nova.compute.manager [req-a5f134c7-b48f-468d-add3-49f63ea00b44 req-d2ed112e-509e-4c0d-9e91-6ea2b01394bd service nova] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] Received event network-vif-deleted-2df03152-b1aa-4794-965d-64886ac889ea {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:42:05 user nova-compute[75176]: INFO nova.compute.manager [req-a5f134c7-b48f-468d-add3-49f63ea00b44 req-d2ed112e-509e-4c0d-9e91-6ea2b01394bd service nova] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] Neutron deleted interface 2df03152-b1aa-4794-965d-64886ac889ea; detaching it from the instance and deleting it from the info cache
Nov 28 15:42:05 user nova-compute[75176]: DEBUG nova.network.neutron [req-a5f134c7-b48f-468d-add3-49f63ea00b44 req-d2ed112e-509e-4c0d-9e91-6ea2b01394bd service nova] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] Updating instance_info_cache with network_info: [{"id": "99a8dbf9-5502-440a-a03d-cd52337b3009", "address": "fa:16:3e:e2:26:17", "network": {"id": "9fe0d7b7-e9dc-4e03-a401-452fd502c940", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1675540815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfdec2abaf704a1396611ff1bcb96e53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99a8dbf9-55", "ovs_interfaceid": "99a8dbf9-5502-440a-a03d-cd52337b3009", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6c94b138-6202-4fb7-92c7-b3744cd8d19d", "address": "fa:16:3e:09:2f:ed", "network": {"id": "d7dbc9c3-816f-46fb-a3d3-e0e817e15de3", "bridge": "br-int", "label": "tempest-device-tagging-net1-136440967", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfdec2abaf704a1396611ff1bcb96e53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c94b138-62", "ovs_interfaceid": "6c94b138-6202-4fb7-92c7-b3744cd8d19d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0ac967e7-41bc-4751-a2bc-499ffbface15", "address": "fa:16:3e:ce:ed:17", "network": {"id": "d7dbc9c3-816f-46fb-a3d3-e0e817e15de3", "bridge": "br-int", "label": "tempest-device-tagging-net1-136440967", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.48", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfdec2abaf704a1396611ff1bcb96e53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ac967e7-41", "ovs_interfaceid": "0ac967e7-41bc-4751-a2bc-499ffbface15", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3a800e7a-5628-4668-ae3e-d49b537f7a62", "address": "fa:16:3e:e0:28:72", "network": {"id": "d7dbc9c3-816f-46fb-a3d3-e0e817e15de3", "bridge": "br-int", "label": "tempest-device-tagging-net1-136440967", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.25", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfdec2abaf704a1396611ff1bcb96e53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a800e7a-56", "ovs_interfaceid": "3a800e7a-5628-4668-ae3e-d49b537f7a62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d9a60043-45d0-46f1-8d0f-ad1c7b55fa06", "address": "fa:16:3e:5c:fb:31", "network": {"id": "d7dbc9c3-816f-46fb-a3d3-e0e817e15de3", "bridge": "br-int", "label": "tempest-device-tagging-net1-136440967", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.54", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfdec2abaf704a1396611ff1bcb96e53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9a60043-45", "ovs_interfaceid": "d9a60043-45d0-46f1-8d0f-ad1c7b55fa06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:42:05 user nova-compute[75176]: INFO nova.compute.manager [-] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] Took 4.64 seconds to deallocate network for instance.
Nov 28 15:42:05 user nova-compute[75176]: DEBUG nova.compute.manager [req-a5f134c7-b48f-468d-add3-49f63ea00b44 req-d2ed112e-509e-4c0d-9e91-6ea2b01394bd service nova] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] Detach interface failed, port_id=2df03152-b1aa-4794-965d-64886ac889ea, reason: Instance 041af768-197b-4c76-a5a1-28e2dc8255bd could not be found. {{(pid=75176) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 28 15:42:05 user nova-compute[75176]: DEBUG nova.compute.manager [req-a5f134c7-b48f-468d-add3-49f63ea00b44 req-d2ed112e-509e-4c0d-9e91-6ea2b01394bd service nova] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] Received event network-vif-deleted-d9a60043-45d0-46f1-8d0f-ad1c7b55fa06 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:42:05 user nova-compute[75176]: INFO nova.compute.manager [req-a5f134c7-b48f-468d-add3-49f63ea00b44 req-d2ed112e-509e-4c0d-9e91-6ea2b01394bd service nova] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] Neutron deleted interface d9a60043-45d0-46f1-8d0f-ad1c7b55fa06; detaching it from the instance and deleting it from the info cache
Nov 28 15:42:05 user nova-compute[75176]: DEBUG nova.network.neutron [req-a5f134c7-b48f-468d-add3-49f63ea00b44 req-d2ed112e-509e-4c0d-9e91-6ea2b01394bd service nova] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] Updating instance_info_cache with network_info: [{"id": "99a8dbf9-5502-440a-a03d-cd52337b3009", "address": "fa:16:3e:e2:26:17", "network": {"id": "9fe0d7b7-e9dc-4e03-a401-452fd502c940", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1675540815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfdec2abaf704a1396611ff1bcb96e53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99a8dbf9-55", "ovs_interfaceid": "99a8dbf9-5502-440a-a03d-cd52337b3009", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6c94b138-6202-4fb7-92c7-b3744cd8d19d", "address": "fa:16:3e:09:2f:ed", "network": {"id": "d7dbc9c3-816f-46fb-a3d3-e0e817e15de3", "bridge": "br-int", "label": "tempest-device-tagging-net1-136440967", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfdec2abaf704a1396611ff1bcb96e53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c94b138-62", "ovs_interfaceid": "6c94b138-6202-4fb7-92c7-b3744cd8d19d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0ac967e7-41bc-4751-a2bc-499ffbface15", "address": "fa:16:3e:ce:ed:17", "network": {"id": "d7dbc9c3-816f-46fb-a3d3-e0e817e15de3", "bridge": "br-int", "label": "tempest-device-tagging-net1-136440967", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.48", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfdec2abaf704a1396611ff1bcb96e53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ac967e7-41", "ovs_interfaceid": "0ac967e7-41bc-4751-a2bc-499ffbface15", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3a800e7a-5628-4668-ae3e-d49b537f7a62", "address": "fa:16:3e:e0:28:72", "network": {"id": "d7dbc9c3-816f-46fb-a3d3-e0e817e15de3", "bridge": "br-int", "label": "tempest-device-tagging-net1-136440967", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.25", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfdec2abaf704a1396611ff1bcb96e53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a800e7a-56", "ovs_interfaceid": "3a800e7a-5628-4668-ae3e-d49b537f7a62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:42:05 user nova-compute[75176]: DEBUG nova.compute.manager [req-a5f134c7-b48f-468d-add3-49f63ea00b44 req-d2ed112e-509e-4c0d-9e91-6ea2b01394bd service nova] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] Detach interface failed, port_id=d9a60043-45d0-46f1-8d0f-ad1c7b55fa06, reason: Instance 041af768-197b-4c76-a5a1-28e2dc8255bd could not be found. {{(pid=75176) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 28 15:42:05 user nova-compute[75176]: DEBUG nova.compute.manager [req-a5f134c7-b48f-468d-add3-49f63ea00b44 req-d2ed112e-509e-4c0d-9e91-6ea2b01394bd service nova] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] Received event network-vif-deleted-99a8dbf9-5502-440a-a03d-cd52337b3009 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:42:05 user nova-compute[75176]: INFO nova.compute.manager [req-a5f134c7-b48f-468d-add3-49f63ea00b44 req-d2ed112e-509e-4c0d-9e91-6ea2b01394bd service nova] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] Neutron deleted interface 99a8dbf9-5502-440a-a03d-cd52337b3009; detaching it from the instance and deleting it from the info cache
Nov 28 15:42:05 user nova-compute[75176]: DEBUG nova.network.neutron [req-a5f134c7-b48f-468d-add3-49f63ea00b44 req-d2ed112e-509e-4c0d-9e91-6ea2b01394bd service nova] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] Updating instance_info_cache with network_info: [{"id": "6c94b138-6202-4fb7-92c7-b3744cd8d19d", "address": "fa:16:3e:09:2f:ed", "network": {"id": "d7dbc9c3-816f-46fb-a3d3-e0e817e15de3", "bridge": "br-int", "label": "tempest-device-tagging-net1-136440967", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfdec2abaf704a1396611ff1bcb96e53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c94b138-62", "ovs_interfaceid": "6c94b138-6202-4fb7-92c7-b3744cd8d19d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0ac967e7-41bc-4751-a2bc-499ffbface15", "address": "fa:16:3e:ce:ed:17", "network": {"id": "d7dbc9c3-816f-46fb-a3d3-e0e817e15de3", "bridge": "br-int", "label": "tempest-device-tagging-net1-136440967", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.48", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfdec2abaf704a1396611ff1bcb96e53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ac967e7-41", "ovs_interfaceid": "0ac967e7-41bc-4751-a2bc-499ffbface15", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3a800e7a-5628-4668-ae3e-d49b537f7a62", "address": "fa:16:3e:e0:28:72", "network": {"id": "d7dbc9c3-816f-46fb-a3d3-e0e817e15de3", "bridge": "br-int", "label": "tempest-device-tagging-net1-136440967", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.25", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfdec2abaf704a1396611ff1bcb96e53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a800e7a-56", "ovs_interfaceid": "3a800e7a-5628-4668-ae3e-d49b537f7a62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:42:05 user nova-compute[75176]: DEBUG nova.compute.manager [req-a5f134c7-b48f-468d-add3-49f63ea00b44 req-d2ed112e-509e-4c0d-9e91-6ea2b01394bd service nova] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] Detach interface failed, port_id=99a8dbf9-5502-440a-a03d-cd52337b3009, reason: Instance 041af768-197b-4c76-a5a1-28e2dc8255bd could not be found. {{(pid=75176) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 28 15:42:05 user nova-compute[75176]: DEBUG nova.compute.manager [req-a5f134c7-b48f-468d-add3-49f63ea00b44 req-d2ed112e-509e-4c0d-9e91-6ea2b01394bd service nova] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] Received event network-vif-deleted-3a800e7a-5628-4668-ae3e-d49b537f7a62 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:42:05 user nova-compute[75176]: INFO nova.compute.manager [req-a5f134c7-b48f-468d-add3-49f63ea00b44 req-d2ed112e-509e-4c0d-9e91-6ea2b01394bd service nova] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] Neutron deleted interface 3a800e7a-5628-4668-ae3e-d49b537f7a62; detaching it from the instance and deleting it from the info cache
Nov 28 15:42:05 user nova-compute[75176]: DEBUG nova.network.neutron [req-a5f134c7-b48f-468d-add3-49f63ea00b44 req-d2ed112e-509e-4c0d-9e91-6ea2b01394bd service nova] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] Updating instance_info_cache with network_info: [{"id": "6c94b138-6202-4fb7-92c7-b3744cd8d19d", "address": "fa:16:3e:09:2f:ed", "network": {"id": "d7dbc9c3-816f-46fb-a3d3-e0e817e15de3", "bridge": "br-int", "label": "tempest-device-tagging-net1-136440967", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfdec2abaf704a1396611ff1bcb96e53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c94b138-62", "ovs_interfaceid": "6c94b138-6202-4fb7-92c7-b3744cd8d19d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0ac967e7-41bc-4751-a2bc-499ffbface15", "address": "fa:16:3e:ce:ed:17", "network": {"id": "d7dbc9c3-816f-46fb-a3d3-e0e817e15de3", "bridge": "br-int", "label": "tempest-device-tagging-net1-136440967", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.48", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfdec2abaf704a1396611ff1bcb96e53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ac967e7-41", "ovs_interfaceid": "0ac967e7-41bc-4751-a2bc-499ffbface15", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:42:05 user nova-compute[75176]: DEBUG nova.compute.manager [req-a5f134c7-b48f-468d-add3-49f63ea00b44 req-d2ed112e-509e-4c0d-9e91-6ea2b01394bd service nova] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] Detach interface failed, port_id=3a800e7a-5628-4668-ae3e-d49b537f7a62, reason: Instance 041af768-197b-4c76-a5a1-28e2dc8255bd could not be found. {{(pid=75176) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 28 15:42:05 user nova-compute[75176]: DEBUG nova.compute.manager [req-73836fe9-f4d2-42cd-9339-b6c6565352ed req-36e793ec-8d11-44e6-a27e-cd55c063f7f0 service nova] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] Received event network-vif-deleted-0c08ccbe-f3de-4aed-b641-8e2b58bd73a0 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:42:05 user nova-compute[75176]: INFO nova.compute.manager [req-73836fe9-f4d2-42cd-9339-b6c6565352ed req-36e793ec-8d11-44e6-a27e-cd55c063f7f0 service nova] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] Neutron deleted interface 0c08ccbe-f3de-4aed-b641-8e2b58bd73a0; detaching it from the instance and deleting it from the info cache
Nov 28 15:42:05 user nova-compute[75176]: DEBUG nova.network.neutron [req-73836fe9-f4d2-42cd-9339-b6c6565352ed req-36e793ec-8d11-44e6-a27e-cd55c063f7f0 service nova] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] Updating instance_info_cache with network_info: [{"id": "da7d30e5-6304-46ec-8d50-336986e6262f", "address": "fa:16:3e:63:83:5b", "network": {"id": "b1277b75-5749-436a-a651-3303fd60d8b4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1047877730-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0108444c01e94416984b083707102c58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda7d30e5-63", "ovs_interfaceid": "da7d30e5-6304-46ec-8d50-336986e6262f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e1ac011f-d965-4d4c-b4c8-aa9bf5201518", "address": "fa:16:3e:7f:e1:ea", "network": {"id": "26bf803a-6aa2-4e87-b407-caee3f8f7d3d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1638676687", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0108444c01e94416984b083707102c58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1ac011f-d9", "ovs_interfaceid": "e1ac011f-d965-4d4c-b4c8-aa9bf5201518", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "61157920-954a-479e-bd66-b0746a7843a7", "address": "fa:16:3e:8f:4f:39", "network": {"id": "26bf803a-6aa2-4e87-b407-caee3f8f7d3d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1638676687", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0108444c01e94416984b083707102c58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61157920-95", "ovs_interfaceid": "61157920-954a-479e-bd66-b0746a7843a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "04db431e-5bc8-4450-9bdd-82369fafba70", "address": "fa:16:3e:15:71:6f", "network": {"id": "26bf803a-6aa2-4e87-b407-caee3f8f7d3d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1638676687", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0108444c01e94416984b083707102c58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04db431e-5b", "ovs_interfaceid": "04db431e-5bc8-4450-9bdd-82369fafba70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e0b49239-50a0-4864-9e92-22bddcbe7d21", "address": "fa:16:3e:d8:78:24", "network": {"id": "3936aa29-a691-4362-8bd9-536545b14473", "bridge": "br-int", "label": "tempest-device-tagging-net2-1089118081", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0108444c01e94416984b083707102c58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0b49239-50", "ovs_interfaceid": "e0b49239-50a0-4864-9e92-22bddcbe7d21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:42:05 user nova-compute[75176]: DEBUG nova.compute.manager [req-73836fe9-f4d2-42cd-9339-b6c6565352ed req-36e793ec-8d11-44e6-a27e-cd55c063f7f0 service nova] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] Detach interface failed, port_id=0c08ccbe-f3de-4aed-b641-8e2b58bd73a0, reason: Instance b714fb94-fcc7-40ae-b3a9-d8c9a60008f1 could not be found. {{(pid=75176) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 28 15:42:05 user nova-compute[75176]: DEBUG nova.compute.manager [req-73836fe9-f4d2-42cd-9339-b6c6565352ed req-36e793ec-8d11-44e6-a27e-cd55c063f7f0 service nova] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] Received event network-vif-deleted-04db431e-5bc8-4450-9bdd-82369fafba70 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:42:05 user nova-compute[75176]: INFO nova.compute.manager [req-73836fe9-f4d2-42cd-9339-b6c6565352ed req-36e793ec-8d11-44e6-a27e-cd55c063f7f0 service nova] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] Neutron deleted interface 04db431e-5bc8-4450-9bdd-82369fafba70; detaching it from the instance and deleting it from the info cache
Nov 28 15:42:05 user nova-compute[75176]: DEBUG nova.network.neutron [req-73836fe9-f4d2-42cd-9339-b6c6565352ed req-36e793ec-8d11-44e6-a27e-cd55c063f7f0 service nova] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] Updating instance_info_cache with network_info: [{"id": "da7d30e5-6304-46ec-8d50-336986e6262f", "address": "fa:16:3e:63:83:5b", "network": {"id": "b1277b75-5749-436a-a651-3303fd60d8b4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1047877730-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0108444c01e94416984b083707102c58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda7d30e5-63", "ovs_interfaceid": "da7d30e5-6304-46ec-8d50-336986e6262f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e1ac011f-d965-4d4c-b4c8-aa9bf5201518", "address": "fa:16:3e:7f:e1:ea", "network": {"id": "26bf803a-6aa2-4e87-b407-caee3f8f7d3d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1638676687", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0108444c01e94416984b083707102c58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1ac011f-d9", "ovs_interfaceid": "e1ac011f-d965-4d4c-b4c8-aa9bf5201518", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "61157920-954a-479e-bd66-b0746a7843a7", "address": "fa:16:3e:8f:4f:39", "network": {"id": "26bf803a-6aa2-4e87-b407-caee3f8f7d3d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1638676687", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0108444c01e94416984b083707102c58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61157920-95", "ovs_interfaceid": "61157920-954a-479e-bd66-b0746a7843a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e0b49239-50a0-4864-9e92-22bddcbe7d21", "address": "fa:16:3e:d8:78:24", "network": {"id": "3936aa29-a691-4362-8bd9-536545b14473", "bridge": "br-int", "label": "tempest-device-tagging-net2-1089118081", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0108444c01e94416984b083707102c58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0b49239-50", "ovs_interfaceid": "e0b49239-50a0-4864-9e92-22bddcbe7d21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:42:05 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:42:05 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:42:05 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:42:05 user nova-compute[75176]: DEBUG nova.compute.manager [req-73836fe9-f4d2-42cd-9339-b6c6565352ed req-36e793ec-8d11-44e6-a27e-cd55c063f7f0 service nova] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] Detach interface failed, port_id=04db431e-5bc8-4450-9bdd-82369fafba70, reason: Instance b714fb94-fcc7-40ae-b3a9-d8c9a60008f1 could not be found. {{(pid=75176) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 28 15:42:05 user nova-compute[75176]: DEBUG nova.compute.manager [req-73836fe9-f4d2-42cd-9339-b6c6565352ed req-36e793ec-8d11-44e6-a27e-cd55c063f7f0 service nova] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] Received event network-vif-deleted-da7d30e5-6304-46ec-8d50-336986e6262f {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:42:05 user nova-compute[75176]: INFO nova.compute.manager [req-73836fe9-f4d2-42cd-9339-b6c6565352ed req-36e793ec-8d11-44e6-a27e-cd55c063f7f0 service nova] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] Neutron deleted interface da7d30e5-6304-46ec-8d50-336986e6262f; detaching it from the instance and deleting it from the info cache
Nov 28 15:42:05 user nova-compute[75176]: DEBUG nova.network.neutron [req-73836fe9-f4d2-42cd-9339-b6c6565352ed req-36e793ec-8d11-44e6-a27e-cd55c063f7f0 service nova] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] Updating instance_info_cache with network_info: [{"id": "e1ac011f-d965-4d4c-b4c8-aa9bf5201518", "address": "fa:16:3e:7f:e1:ea", "network": {"id": "26bf803a-6aa2-4e87-b407-caee3f8f7d3d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1638676687", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0108444c01e94416984b083707102c58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1ac011f-d9", "ovs_interfaceid": "e1ac011f-d965-4d4c-b4c8-aa9bf5201518", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "61157920-954a-479e-bd66-b0746a7843a7", "address": "fa:16:3e:8f:4f:39", "network": {"id": "26bf803a-6aa2-4e87-b407-caee3f8f7d3d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1638676687", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0108444c01e94416984b083707102c58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61157920-95", "ovs_interfaceid": "61157920-954a-479e-bd66-b0746a7843a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e0b49239-50a0-4864-9e92-22bddcbe7d21", "address": "fa:16:3e:d8:78:24", "network": {"id": "3936aa29-a691-4362-8bd9-536545b14473", "bridge": "br-int", "label": "tempest-device-tagging-net2-1089118081", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0108444c01e94416984b083707102c58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0b49239-50", "ovs_interfaceid": "e0b49239-50a0-4864-9e92-22bddcbe7d21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:42:05 user nova-compute[75176]: DEBUG nova.compute.manager [req-73836fe9-f4d2-42cd-9339-b6c6565352ed req-36e793ec-8d11-44e6-a27e-cd55c063f7f0 service nova] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] Detach interface failed, port_id=da7d30e5-6304-46ec-8d50-336986e6262f, reason: Instance b714fb94-fcc7-40ae-b3a9-d8c9a60008f1 could not be found. {{(pid=75176) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 28 15:42:05 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:42:05 user nova-compute[75176]: DEBUG nova.network.neutron [-] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] Updating instance_info_cache with network_info: [] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:42:05 user nova-compute[75176]: INFO nova.compute.manager [-] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] Took 4.70 seconds to deallocate network for instance.
Nov 28 15:42:06 user nova-compute[75176]: DEBUG nova.compute.manager [req-ee49396f-e8b0-416e-ac91-6be9d8a20aa2 req-4f9dbb37-6250-4019-bab3-ed9b47650c82 service nova] [instance: 916b82eb-97e8-411c-a8ea-8c27d101b48e] Received event network-vif-plugged-38bef3fc-c841-4db3-b429-8fe94a224783 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:42:06 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-ee49396f-e8b0-416e-ac91-6be9d8a20aa2 req-4f9dbb37-6250-4019-bab3-ed9b47650c82 service nova] Acquiring lock "916b82eb-97e8-411c-a8ea-8c27d101b48e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:42:06 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-ee49396f-e8b0-416e-ac91-6be9d8a20aa2 req-4f9dbb37-6250-4019-bab3-ed9b47650c82 service nova] Lock "916b82eb-97e8-411c-a8ea-8c27d101b48e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:42:06 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-ee49396f-e8b0-416e-ac91-6be9d8a20aa2 req-4f9dbb37-6250-4019-bab3-ed9b47650c82 service nova] Lock "916b82eb-97e8-411c-a8ea-8c27d101b48e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:42:06 user nova-compute[75176]: DEBUG nova.compute.manager [req-ee49396f-e8b0-416e-ac91-6be9d8a20aa2 req-4f9dbb37-6250-4019-bab3-ed9b47650c82 service nova] [instance: 916b82eb-97e8-411c-a8ea-8c27d101b48e] No waiting events found dispatching network-vif-plugged-38bef3fc-c841-4db3-b429-8fe94a224783 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:42:06 user nova-compute[75176]: WARNING nova.compute.manager [req-ee49396f-e8b0-416e-ac91-6be9d8a20aa2 req-4f9dbb37-6250-4019-bab3-ed9b47650c82 service nova] [instance: 916b82eb-97e8-411c-a8ea-8c27d101b48e] Received unexpected event network-vif-plugged-38bef3fc-c841-4db3-b429-8fe94a224783 for instance with vm_state active and task_state rebuild_spawning.
Nov 28 15:42:06 user nova-compute[75176]: DEBUG nova.compute.manager [None req-c40e5dd9-3bda-442e-8465-b1850c720249 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] [instance: 916b82eb-97e8-411c-a8ea-8c27d101b48e] Instance event wait completed in 0 seconds for  {{(pid=75176) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 15:42:06 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-c40e5dd9-3bda-442e-8465-b1850c720249 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] [instance: 916b82eb-97e8-411c-a8ea-8c27d101b48e] Guest created on hypervisor {{(pid=75176) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 15:42:06 user nova-compute[75176]: INFO nova.virt.libvirt.driver [-] [instance: 916b82eb-97e8-411c-a8ea-8c27d101b48e] Instance spawned successfully.
Nov 28 15:42:06 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-c40e5dd9-3bda-442e-8465-b1850c720249 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] [instance: 916b82eb-97e8-411c-a8ea-8c27d101b48e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 15:42:06 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-c40e5dd9-3bda-442e-8465-b1850c720249 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] [instance: 916b82eb-97e8-411c-a8ea-8c27d101b48e] Found default for hw_cdrom_bus of ide {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:42:06 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-c40e5dd9-3bda-442e-8465-b1850c720249 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] [instance: 916b82eb-97e8-411c-a8ea-8c27d101b48e] Found default for hw_disk_bus of virtio {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:42:06 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-c40e5dd9-3bda-442e-8465-b1850c720249 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] [instance: 916b82eb-97e8-411c-a8ea-8c27d101b48e] Found default for hw_input_bus of None {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:42:06 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-c40e5dd9-3bda-442e-8465-b1850c720249 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] [instance: 916b82eb-97e8-411c-a8ea-8c27d101b48e] Found default for hw_pointer_model of None {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:42:06 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-c40e5dd9-3bda-442e-8465-b1850c720249 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] [instance: 916b82eb-97e8-411c-a8ea-8c27d101b48e] Found default for hw_video_model of virtio {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:42:06 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-c40e5dd9-3bda-442e-8465-b1850c720249 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] [instance: 916b82eb-97e8-411c-a8ea-8c27d101b48e] Found default for hw_vif_model of virtio {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:42:07 user nova-compute[75176]: DEBUG nova.compute.manager [None req-c40e5dd9-3bda-442e-8465-b1850c720249 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] [instance: 916b82eb-97e8-411c-a8ea-8c27d101b48e] Checking state {{(pid=75176) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 15:42:07 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-c40e5dd9-3bda-442e-8465-b1850c720249 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:42:07 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-c40e5dd9-3bda-442e-8465-b1850c720249 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:42:07 user nova-compute[75176]: DEBUG nova.objects.instance [None req-c40e5dd9-3bda-442e-8465-b1850c720249 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] [instance: 916b82eb-97e8-411c-a8ea-8c27d101b48e] Trying to apply a migration context that does not seem to be set for this instance {{(pid=75176) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 28 15:42:07 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-c40e5dd9-3bda-442e-8465-b1850c720249 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.081s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:42:07 user nova-compute[75176]: DEBUG nova.compute.manager [req-a32ecfda-b783-49e4-95b1-984f19456235 req-5b6a7b66-fde2-4a72-a3c1-cbb77d410dcc service nova] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] Received event network-vif-deleted-e0b49239-50a0-4864-9e92-22bddcbe7d21 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:42:07 user nova-compute[75176]: INFO nova.compute.manager [None req-585335e7-3eb7-4c3d-9395-77097f973761 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] [instance: 041af768-197b-4c76-a5a1-28e2dc8255bd] Took 2.52 seconds to detach 3 volumes for instance.
Nov 28 15:42:07 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:42:07 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-585335e7-3eb7-4c3d-9395-77097f973761 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:42:07 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-585335e7-3eb7-4c3d-9395-77097f973761 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:42:07 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:42:08 user nova-compute[75176]: DEBUG nova.compute.provider_tree [None req-585335e7-3eb7-4c3d-9395-77097f973761 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Inventory has not changed in ProviderTree for provider: b37848d8-f401-4155-a029-b0ffa09ff85b {{(pid=75176) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 15:42:08 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-585335e7-3eb7-4c3d-9395-77097f973761 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Inventory has not changed for provider b37848d8-f401-4155-a029-b0ffa09ff85b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75176) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 15:42:08 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-585335e7-3eb7-4c3d-9395-77097f973761 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.364s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:42:08 user nova-compute[75176]: INFO nova.scheduler.client.report [None req-585335e7-3eb7-4c3d-9395-77097f973761 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Deleted allocations for instance 041af768-197b-4c76-a5a1-28e2dc8255bd
Nov 28 15:42:08 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-585335e7-3eb7-4c3d-9395-77097f973761 tempest-TaggedBootDevicesTest_v242-1260942437 tempest-TaggedBootDevicesTest_v242-1260942437-project-member] Lock "041af768-197b-4c76-a5a1-28e2dc8255bd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 15.421s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:42:08 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:42:08 user nova-compute[75176]: INFO nova.compute.manager [None req-b469a21b-cdfb-4f59-9409-786dfeb47caf tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] [instance: b714fb94-fcc7-40ae-b3a9-d8c9a60008f1] Took 2.77 seconds to detach 3 volumes for instance.
Nov 28 15:42:08 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-b469a21b-cdfb-4f59-9409-786dfeb47caf tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:42:08 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-b469a21b-cdfb-4f59-9409-786dfeb47caf tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:42:09 user nova-compute[75176]: DEBUG nova.compute.provider_tree [None req-b469a21b-cdfb-4f59-9409-786dfeb47caf tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Inventory has not changed in ProviderTree for provider: b37848d8-f401-4155-a029-b0ffa09ff85b {{(pid=75176) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 15:42:09 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-b469a21b-cdfb-4f59-9409-786dfeb47caf tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Inventory has not changed for provider b37848d8-f401-4155-a029-b0ffa09ff85b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75176) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 15:42:09 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-b469a21b-cdfb-4f59-9409-786dfeb47caf tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.475s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:42:09 user nova-compute[75176]: INFO nova.scheduler.client.report [None req-b469a21b-cdfb-4f59-9409-786dfeb47caf tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Deleted allocations for instance b714fb94-fcc7-40ae-b3a9-d8c9a60008f1
Nov 28 15:42:09 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-b469a21b-cdfb-4f59-9409-786dfeb47caf tempest-TaggedBootDevicesTest-1183582238 tempest-TaggedBootDevicesTest-1183582238-project-member] Lock "b714fb94-fcc7-40ae-b3a9-d8c9a60008f1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 15.243s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:42:09 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:42:12 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-9a8ca7b8-4413-43c8-85b1-9ac4138b14af tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Acquiring lock "402e779e-f507-49f1-a0d8-31ab0d23fbcd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:42:12 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-9a8ca7b8-4413-43c8-85b1-9ac4138b14af tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Lock "402e779e-f507-49f1-a0d8-31ab0d23fbcd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:42:12 user nova-compute[75176]: DEBUG nova.compute.manager [None req-9a8ca7b8-4413-43c8-85b1-9ac4138b14af tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] [instance: 402e779e-f507-49f1-a0d8-31ab0d23fbcd] Starting instance... {{(pid=75176) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 15:42:12 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-9a8ca7b8-4413-43c8-85b1-9ac4138b14af tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:42:12 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-9a8ca7b8-4413-43c8-85b1-9ac4138b14af tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:42:12 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-9a8ca7b8-4413-43c8-85b1-9ac4138b14af tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75176) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 15:42:12 user nova-compute[75176]: INFO nova.compute.claims [None req-9a8ca7b8-4413-43c8-85b1-9ac4138b14af tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] [instance: 402e779e-f507-49f1-a0d8-31ab0d23fbcd] Claim successful on node user
Nov 28 15:42:12 user nova-compute[75176]: DEBUG nova.compute.provider_tree [None req-9a8ca7b8-4413-43c8-85b1-9ac4138b14af tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Inventory has not changed in ProviderTree for provider: b37848d8-f401-4155-a029-b0ffa09ff85b {{(pid=75176) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 15:42:12 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-9a8ca7b8-4413-43c8-85b1-9ac4138b14af tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Inventory has not changed for provider b37848d8-f401-4155-a029-b0ffa09ff85b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75176) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 15:42:12 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-9a8ca7b8-4413-43c8-85b1-9ac4138b14af tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.417s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:42:12 user nova-compute[75176]: DEBUG nova.compute.manager [None req-9a8ca7b8-4413-43c8-85b1-9ac4138b14af tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] [instance: 402e779e-f507-49f1-a0d8-31ab0d23fbcd] Start building networks asynchronously for instance. {{(pid=75176) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 15:42:12 user nova-compute[75176]: DEBUG nova.compute.manager [None req-9a8ca7b8-4413-43c8-85b1-9ac4138b14af tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] [instance: 402e779e-f507-49f1-a0d8-31ab0d23fbcd] Allocating IP information in the background. {{(pid=75176) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 15:42:12 user nova-compute[75176]: DEBUG nova.network.neutron [None req-9a8ca7b8-4413-43c8-85b1-9ac4138b14af tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] [instance: 402e779e-f507-49f1-a0d8-31ab0d23fbcd] allocate_for_instance() {{(pid=75176) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 15:42:12 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-9a8ca7b8-4413-43c8-85b1-9ac4138b14af tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] [instance: 402e779e-f507-49f1-a0d8-31ab0d23fbcd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 15:42:12 user nova-compute[75176]: DEBUG nova.compute.manager [None req-9a8ca7b8-4413-43c8-85b1-9ac4138b14af tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] [instance: 402e779e-f507-49f1-a0d8-31ab0d23fbcd] Start building block device mappings for instance. {{(pid=75176) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 15:42:12 user nova-compute[75176]: DEBUG nova.policy [None req-9a8ca7b8-4413-43c8-85b1-9ac4138b14af tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f9a745552d974e05a9e0befc68eb7f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a194f81f7e104be7940d1d05f71bbad9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75176) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 15:42:12 user nova-compute[75176]: DEBUG nova.compute.manager [None req-9a8ca7b8-4413-43c8-85b1-9ac4138b14af tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] [instance: 402e779e-f507-49f1-a0d8-31ab0d23fbcd] Start spawning the instance on the hypervisor. {{(pid=75176) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 15:42:12 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-9a8ca7b8-4413-43c8-85b1-9ac4138b14af tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] [instance: 402e779e-f507-49f1-a0d8-31ab0d23fbcd] Creating instance directory {{(pid=75176) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 15:42:12 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-9a8ca7b8-4413-43c8-85b1-9ac4138b14af tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] [instance: 402e779e-f507-49f1-a0d8-31ab0d23fbcd] Creating image(s)
Nov 28 15:42:12 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-9a8ca7b8-4413-43c8-85b1-9ac4138b14af tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Acquiring lock "/opt/stack/data/nova/instances/402e779e-f507-49f1-a0d8-31ab0d23fbcd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:42:12 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-9a8ca7b8-4413-43c8-85b1-9ac4138b14af tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Lock "/opt/stack/data/nova/instances/402e779e-f507-49f1-a0d8-31ab0d23fbcd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:42:12 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-9a8ca7b8-4413-43c8-85b1-9ac4138b14af tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Lock "/opt/stack/data/nova/instances/402e779e-f507-49f1-a0d8-31ab0d23fbcd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:42:12 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-9a8ca7b8-4413-43c8-85b1-9ac4138b14af tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:42:13 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:42:13 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-9a8ca7b8-4413-43c8-85b1-9ac4138b14af tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json" returned: 0 in 0.191s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:42:13 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-9a8ca7b8-4413-43c8-85b1-9ac4138b14af tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Acquiring lock "5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:42:13 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-9a8ca7b8-4413-43c8-85b1-9ac4138b14af tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Lock "5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:42:13 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-9a8ca7b8-4413-43c8-85b1-9ac4138b14af tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:42:13 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-9a8ca7b8-4413-43c8-85b1-9ac4138b14af tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json" returned: 0 in 0.174s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:42:13 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-9a8ca7b8-4413-43c8-85b1-9ac4138b14af tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2,backing_fmt=raw /opt/stack/data/nova/instances/402e779e-f507-49f1-a0d8-31ab0d23fbcd/disk 1073741824 {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:42:13 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-9a8ca7b8-4413-43c8-85b1-9ac4138b14af tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2,backing_fmt=raw /opt/stack/data/nova/instances/402e779e-f507-49f1-a0d8-31ab0d23fbcd/disk 1073741824" returned: 0 in 0.057s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:42:13 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-9a8ca7b8-4413-43c8-85b1-9ac4138b14af tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Lock "5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.238s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:42:13 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-9a8ca7b8-4413-43c8-85b1-9ac4138b14af tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:42:13 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:42:13 user nova-compute[75176]: DEBUG nova.network.neutron [None req-9a8ca7b8-4413-43c8-85b1-9ac4138b14af tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] [instance: 402e779e-f507-49f1-a0d8-31ab0d23fbcd] Successfully created port: 2de2e1eb-51fe-4259-bb8a-20c50e87b4ce {{(pid=75176) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 15:42:13 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-9a8ca7b8-4413-43c8-85b1-9ac4138b14af tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json" returned: 0 in 0.211s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:42:13 user nova-compute[75176]: DEBUG nova.virt.disk.api [None req-9a8ca7b8-4413-43c8-85b1-9ac4138b14af tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Checking if we can resize image /opt/stack/data/nova/instances/402e779e-f507-49f1-a0d8-31ab0d23fbcd/disk. size=1073741824 {{(pid=75176) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 15:42:13 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-9a8ca7b8-4413-43c8-85b1-9ac4138b14af tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/402e779e-f507-49f1-a0d8-31ab0d23fbcd/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:42:13 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-9a8ca7b8-4413-43c8-85b1-9ac4138b14af tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/402e779e-f507-49f1-a0d8-31ab0d23fbcd/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:42:13 user nova-compute[75176]: DEBUG nova.virt.disk.api [None req-9a8ca7b8-4413-43c8-85b1-9ac4138b14af tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Cannot resize image /opt/stack/data/nova/instances/402e779e-f507-49f1-a0d8-31ab0d23fbcd/disk to a smaller size. {{(pid=75176) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 15:42:13 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-9a8ca7b8-4413-43c8-85b1-9ac4138b14af tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] [instance: 402e779e-f507-49f1-a0d8-31ab0d23fbcd] Created local disks {{(pid=75176) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 15:42:13 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-9a8ca7b8-4413-43c8-85b1-9ac4138b14af tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] [instance: 402e779e-f507-49f1-a0d8-31ab0d23fbcd] Ensure instance console log exists: /opt/stack/data/nova/instances/402e779e-f507-49f1-a0d8-31ab0d23fbcd/console.log {{(pid=75176) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 15:42:13 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-9a8ca7b8-4413-43c8-85b1-9ac4138b14af tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:42:13 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-9a8ca7b8-4413-43c8-85b1-9ac4138b14af tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:42:13 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-9a8ca7b8-4413-43c8-85b1-9ac4138b14af tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:42:14 user nova-compute[75176]: DEBUG nova.network.neutron [None req-9a8ca7b8-4413-43c8-85b1-9ac4138b14af tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] [instance: 402e779e-f507-49f1-a0d8-31ab0d23fbcd] Successfully updated port: 2de2e1eb-51fe-4259-bb8a-20c50e87b4ce {{(pid=75176) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 15:42:14 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-9a8ca7b8-4413-43c8-85b1-9ac4138b14af tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Acquiring lock "refresh_cache-402e779e-f507-49f1-a0d8-31ab0d23fbcd" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:42:14 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-9a8ca7b8-4413-43c8-85b1-9ac4138b14af tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Acquired lock "refresh_cache-402e779e-f507-49f1-a0d8-31ab0d23fbcd" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:42:14 user nova-compute[75176]: DEBUG nova.network.neutron [None req-9a8ca7b8-4413-43c8-85b1-9ac4138b14af tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] [instance: 402e779e-f507-49f1-a0d8-31ab0d23fbcd] Building network info cache for instance {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 15:42:14 user nova-compute[75176]: DEBUG nova.compute.manager [req-9b0da6b4-9e7b-4afd-a07f-82b8c0b3313c req-5828d061-38f4-4141-afa7-f1a1deafb228 service nova] [instance: 402e779e-f507-49f1-a0d8-31ab0d23fbcd] Received event network-changed-2de2e1eb-51fe-4259-bb8a-20c50e87b4ce {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:42:14 user nova-compute[75176]: DEBUG nova.compute.manager [req-9b0da6b4-9e7b-4afd-a07f-82b8c0b3313c req-5828d061-38f4-4141-afa7-f1a1deafb228 service nova] [instance: 402e779e-f507-49f1-a0d8-31ab0d23fbcd] Refreshing instance network info cache due to event network-changed-2de2e1eb-51fe-4259-bb8a-20c50e87b4ce. {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 15:42:14 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-9b0da6b4-9e7b-4afd-a07f-82b8c0b3313c req-5828d061-38f4-4141-afa7-f1a1deafb228 service nova] Acquiring lock "refresh_cache-402e779e-f507-49f1-a0d8-31ab0d23fbcd" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:42:14 user nova-compute[75176]: DEBUG nova.network.neutron [None req-9a8ca7b8-4413-43c8-85b1-9ac4138b14af tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] [instance: 402e779e-f507-49f1-a0d8-31ab0d23fbcd] Instance cache missing network info. {{(pid=75176) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 15:42:14 user nova-compute[75176]: DEBUG nova.network.neutron [None req-9a8ca7b8-4413-43c8-85b1-9ac4138b14af tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] [instance: 402e779e-f507-49f1-a0d8-31ab0d23fbcd] Updating instance_info_cache with network_info: [{"id": "2de2e1eb-51fe-4259-bb8a-20c50e87b4ce", "address": "fa:16:3e:c4:29:df", "network": {"id": "7ab60343-57be-427d-9037-6ecf0eaf5de0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1508138843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a194f81f7e104be7940d1d05f71bbad9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2de2e1eb-51", "ovs_interfaceid": "2de2e1eb-51fe-4259-bb8a-20c50e87b4ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:42:14 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-9a8ca7b8-4413-43c8-85b1-9ac4138b14af tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Releasing lock "refresh_cache-402e779e-f507-49f1-a0d8-31ab0d23fbcd" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:42:14 user nova-compute[75176]: DEBUG nova.compute.manager [None req-9a8ca7b8-4413-43c8-85b1-9ac4138b14af tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] [instance: 402e779e-f507-49f1-a0d8-31ab0d23fbcd] Instance network_info: |[{"id": "2de2e1eb-51fe-4259-bb8a-20c50e87b4ce", "address": "fa:16:3e:c4:29:df", "network": {"id": "7ab60343-57be-427d-9037-6ecf0eaf5de0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1508138843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a194f81f7e104be7940d1d05f71bbad9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2de2e1eb-51", "ovs_interfaceid": "2de2e1eb-51fe-4259-bb8a-20c50e87b4ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75176) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 15:42:14 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-9b0da6b4-9e7b-4afd-a07f-82b8c0b3313c req-5828d061-38f4-4141-afa7-f1a1deafb228 service nova] Acquired lock "refresh_cache-402e779e-f507-49f1-a0d8-31ab0d23fbcd" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:42:14 user nova-compute[75176]: DEBUG nova.network.neutron [req-9b0da6b4-9e7b-4afd-a07f-82b8c0b3313c req-5828d061-38f4-4141-afa7-f1a1deafb228 service nova] [instance: 402e779e-f507-49f1-a0d8-31ab0d23fbcd] Refreshing network info cache for port 2de2e1eb-51fe-4259-bb8a-20c50e87b4ce {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 15:42:14 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-9a8ca7b8-4413-43c8-85b1-9ac4138b14af tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] [instance: 402e779e-f507-49f1-a0d8-31ab0d23fbcd] Start _get_guest_xml network_info=[{"id": "2de2e1eb-51fe-4259-bb8a-20c50e87b4ce", "address": "fa:16:3e:c4:29:df", "network": {"id": "7ab60343-57be-427d-9037-6ecf0eaf5de0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1508138843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a194f81f7e104be7940d1d05f71bbad9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2de2e1eb-51", "ovs_interfaceid": "2de2e1eb-51fe-4259-bb8a-20c50e87b4ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T15:35:12Z,direct_url=<?>,disk_format='qcow2',id=1f41819e-c93f-4dc7-b253-37a27bbbbc74,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1b91c5d0672c4224a48df2e1f92688e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T15:35:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'size': 0, 'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'image_id': '1f41819e-c93f-4dc7-b253-37a27bbbbc74'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75176) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 15:42:14 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-9a8ca7b8-4413-43c8-85b1-9ac4138b14af tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 15:42:14 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-9a8ca7b8-4413-43c8-85b1-9ac4138b14af tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 15:42:14 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-9a8ca7b8-4413-43c8-85b1-9ac4138b14af tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75176) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 15:42:14 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-9a8ca7b8-4413-43c8-85b1-9ac4138b14af tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] CPU controller missing on host. {{(pid=75176) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 15:42:14 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-9a8ca7b8-4413-43c8-85b1-9ac4138b14af tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75176) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 15:42:14 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-9a8ca7b8-4413-43c8-85b1-9ac4138b14af tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] CPU controller found on host. {{(pid=75176) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 15:42:14 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-9a8ca7b8-4413-43c8-85b1-9ac4138b14af tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75176) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 15:42:14 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-9a8ca7b8-4413-43c8-85b1-9ac4138b14af tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T15:35:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T15:35:12Z,direct_url=<?>,disk_format='qcow2',id=1f41819e-c93f-4dc7-b253-37a27bbbbc74,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1b91c5d0672c4224a48df2e1f92688e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T15:35:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 15:42:14 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-9a8ca7b8-4413-43c8-85b1-9ac4138b14af tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Flavor limits 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 15:42:14 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-9a8ca7b8-4413-43c8-85b1-9ac4138b14af tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Image limits 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 15:42:14 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-9a8ca7b8-4413-43c8-85b1-9ac4138b14af tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Flavor pref 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 15:42:14 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-9a8ca7b8-4413-43c8-85b1-9ac4138b14af tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Image pref 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 15:42:14 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-9a8ca7b8-4413-43c8-85b1-9ac4138b14af tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 15:42:14 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-9a8ca7b8-4413-43c8-85b1-9ac4138b14af tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 15:42:14 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-9a8ca7b8-4413-43c8-85b1-9ac4138b14af tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75176) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 15:42:14 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-9a8ca7b8-4413-43c8-85b1-9ac4138b14af tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Got 1 possible topologies {{(pid=75176) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 15:42:14 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-9a8ca7b8-4413-43c8-85b1-9ac4138b14af tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 15:42:14 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-9a8ca7b8-4413-43c8-85b1-9ac4138b14af tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 15:42:14 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-9a8ca7b8-4413-43c8-85b1-9ac4138b14af tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T15:42:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1989419547',display_name='tempest-AttachVolumeNegativeTest-server-1989419547',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1989419547',id=13,image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDFFWjldyHtbmkwknmcPcPg3lFhol4yQjd0aGcLhl8u/bcASG+kJTHf5jG/jfYqtoq04tUjwJE1sE6H7GDR3xBjF+nxszd0qVv51R7jnyv4CEJMXYm+f8JML2UmVvpu+mA==',key_name='tempest-keypair-1933077131',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a194f81f7e104be7940d1d05f71bbad9',ramdisk_id='',reservation_id='r-0k0fuqwb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1403590572',owner_user_name='tempest-AttachVolumeNegativeTest-1403590572-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T15:42:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f9a745552d974e05a9e0befc68eb7f6e',uuid=402e779e-f507-49f1-a0d8-31ab0d23fbcd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2de2e1eb-51fe-4259-bb8a-20c50e87b4ce", "address": "fa:16:3e:c4:29:df", "network": {"id": "7ab60343-57be-427d-9037-6ecf0eaf5de0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1508138843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a194f81f7e104be7940d1d05f71bbad9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2de2e1eb-51", "ovs_interfaceid": "2de2e1eb-51fe-4259-bb8a-20c50e87b4ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75176) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 15:42:14 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-9a8ca7b8-4413-43c8-85b1-9ac4138b14af tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Converting VIF {"id": "2de2e1eb-51fe-4259-bb8a-20c50e87b4ce", "address": "fa:16:3e:c4:29:df", "network": {"id": "7ab60343-57be-427d-9037-6ecf0eaf5de0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1508138843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a194f81f7e104be7940d1d05f71bbad9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2de2e1eb-51", "ovs_interfaceid": "2de2e1eb-51fe-4259-bb8a-20c50e87b4ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:42:14 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-9a8ca7b8-4413-43c8-85b1-9ac4138b14af tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:29:df,bridge_name='br-int',has_traffic_filtering=True,id=2de2e1eb-51fe-4259-bb8a-20c50e87b4ce,network=Network(7ab60343-57be-427d-9037-6ecf0eaf5de0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2de2e1eb-51') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:42:14 user nova-compute[75176]: DEBUG nova.objects.instance [None req-9a8ca7b8-4413-43c8-85b1-9ac4138b14af tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Lazy-loading 'pci_devices' on Instance uuid 402e779e-f507-49f1-a0d8-31ab0d23fbcd {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:42:14 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-9a8ca7b8-4413-43c8-85b1-9ac4138b14af tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] [instance: 402e779e-f507-49f1-a0d8-31ab0d23fbcd] End _get_guest_xml xml=<domain type="kvm">
Nov 28 15:42:14 user nova-compute[75176]:   <uuid>402e779e-f507-49f1-a0d8-31ab0d23fbcd</uuid>
Nov 28 15:42:14 user nova-compute[75176]:   <name>instance-0000000d</name>
Nov 28 15:42:14 user nova-compute[75176]:   <memory>524288</memory>
Nov 28 15:42:14 user nova-compute[75176]:   <vcpu>1</vcpu>
Nov 28 15:42:14 user nova-compute[75176]:   <metadata>
Nov 28 15:42:14 user nova-compute[75176]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 15:42:14 user nova-compute[75176]:       <nova:package version="0.0.0"/>
Nov 28 15:42:14 user nova-compute[75176]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1989419547</nova:name>
Nov 28 15:42:14 user nova-compute[75176]:       <nova:creationTime>2023-11-28 15:42:14</nova:creationTime>
Nov 28 15:42:14 user nova-compute[75176]:       <nova:flavor name="m1.tiny">
Nov 28 15:42:14 user nova-compute[75176]:         <nova:memory>512</nova:memory>
Nov 28 15:42:14 user nova-compute[75176]:         <nova:disk>1</nova:disk>
Nov 28 15:42:14 user nova-compute[75176]:         <nova:swap>0</nova:swap>
Nov 28 15:42:14 user nova-compute[75176]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 15:42:14 user nova-compute[75176]:         <nova:vcpus>1</nova:vcpus>
Nov 28 15:42:14 user nova-compute[75176]:       </nova:flavor>
Nov 28 15:42:14 user nova-compute[75176]:       <nova:owner>
Nov 28 15:42:14 user nova-compute[75176]:         <nova:user uuid="f9a745552d974e05a9e0befc68eb7f6e">tempest-AttachVolumeNegativeTest-1403590572-project-member</nova:user>
Nov 28 15:42:14 user nova-compute[75176]:         <nova:project uuid="a194f81f7e104be7940d1d05f71bbad9">tempest-AttachVolumeNegativeTest-1403590572</nova:project>
Nov 28 15:42:14 user nova-compute[75176]:       </nova:owner>
Nov 28 15:42:14 user nova-compute[75176]:       <nova:root type="image" uuid="1f41819e-c93f-4dc7-b253-37a27bbbbc74"/>
Nov 28 15:42:14 user nova-compute[75176]:       <nova:ports>
Nov 28 15:42:14 user nova-compute[75176]:         <nova:port uuid="2de2e1eb-51fe-4259-bb8a-20c50e87b4ce">
Nov 28 15:42:14 user nova-compute[75176]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 28 15:42:14 user nova-compute[75176]:         </nova:port>
Nov 28 15:42:14 user nova-compute[75176]:       </nova:ports>
Nov 28 15:42:14 user nova-compute[75176]:     </nova:instance>
Nov 28 15:42:14 user nova-compute[75176]:   </metadata>
Nov 28 15:42:14 user nova-compute[75176]:   <sysinfo type="smbios">
Nov 28 15:42:14 user nova-compute[75176]:     <system>
Nov 28 15:42:14 user nova-compute[75176]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 15:42:14 user nova-compute[75176]:       <entry name="product">OpenStack Nova</entry>
Nov 28 15:42:14 user nova-compute[75176]:       <entry name="version">0.0.0</entry>
Nov 28 15:42:14 user nova-compute[75176]:       <entry name="serial">402e779e-f507-49f1-a0d8-31ab0d23fbcd</entry>
Nov 28 15:42:14 user nova-compute[75176]:       <entry name="uuid">402e779e-f507-49f1-a0d8-31ab0d23fbcd</entry>
Nov 28 15:42:14 user nova-compute[75176]:       <entry name="family">Virtual Machine</entry>
Nov 28 15:42:14 user nova-compute[75176]:     </system>
Nov 28 15:42:14 user nova-compute[75176]:   </sysinfo>
Nov 28 15:42:14 user nova-compute[75176]:   <os>
Nov 28 15:42:14 user nova-compute[75176]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 15:42:14 user nova-compute[75176]:     <boot dev="hd"/>
Nov 28 15:42:14 user nova-compute[75176]:     <smbios mode="sysinfo"/>
Nov 28 15:42:14 user nova-compute[75176]:   </os>
Nov 28 15:42:14 user nova-compute[75176]:   <features>
Nov 28 15:42:14 user nova-compute[75176]:     <acpi/>
Nov 28 15:42:14 user nova-compute[75176]:     <apic/>
Nov 28 15:42:14 user nova-compute[75176]:     <vmcoreinfo/>
Nov 28 15:42:14 user nova-compute[75176]:   </features>
Nov 28 15:42:14 user nova-compute[75176]:   <clock offset="utc">
Nov 28 15:42:14 user nova-compute[75176]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 15:42:14 user nova-compute[75176]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 15:42:14 user nova-compute[75176]:     <timer name="hpet" present="no"/>
Nov 28 15:42:14 user nova-compute[75176]:   </clock>
Nov 28 15:42:14 user nova-compute[75176]:   <cpu mode="custom" match="exact">
Nov 28 15:42:14 user nova-compute[75176]:     <model>Nehalem</model>
Nov 28 15:42:14 user nova-compute[75176]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 15:42:14 user nova-compute[75176]:   </cpu>
Nov 28 15:42:14 user nova-compute[75176]:   <devices>
Nov 28 15:42:14 user nova-compute[75176]:     <disk type="file" device="disk">
Nov 28 15:42:14 user nova-compute[75176]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 15:42:14 user nova-compute[75176]:       <source file="/opt/stack/data/nova/instances/402e779e-f507-49f1-a0d8-31ab0d23fbcd/disk"/>
Nov 28 15:42:14 user nova-compute[75176]:       <target dev="vda" bus="virtio"/>
Nov 28 15:42:14 user nova-compute[75176]:     </disk>
Nov 28 15:42:14 user nova-compute[75176]:     <interface type="ethernet">
Nov 28 15:42:14 user nova-compute[75176]:       <mac address="fa:16:3e:c4:29:df"/>
Nov 28 15:42:14 user nova-compute[75176]:       <model type="virtio"/>
Nov 28 15:42:14 user nova-compute[75176]:       <mtu size="1442"/>
Nov 28 15:42:14 user nova-compute[75176]:       <target dev="tap2de2e1eb-51"/>
Nov 28 15:42:14 user nova-compute[75176]:     </interface>
Nov 28 15:42:14 user nova-compute[75176]:     <serial type="pty">
Nov 28 15:42:14 user nova-compute[75176]:       <log file="/opt/stack/data/nova/instances/402e779e-f507-49f1-a0d8-31ab0d23fbcd/console.log" append="off"/>
Nov 28 15:42:14 user nova-compute[75176]:     </serial>
Nov 28 15:42:14 user nova-compute[75176]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 15:42:14 user nova-compute[75176]:     <video>
Nov 28 15:42:14 user nova-compute[75176]:       <model type="virtio"/>
Nov 28 15:42:14 user nova-compute[75176]:     </video>
Nov 28 15:42:14 user nova-compute[75176]:     <rng model="virtio">
Nov 28 15:42:14 user nova-compute[75176]:       <backend model="random">/dev/urandom</backend>
Nov 28 15:42:14 user nova-compute[75176]:     </rng>
Nov 28 15:42:14 user nova-compute[75176]:     <controller type="usb" index="0" model="none"/>
Nov 28 15:42:14 user nova-compute[75176]:     <memballoon model="virtio">
Nov 28 15:42:14 user nova-compute[75176]:       <stats period="10"/>
Nov 28 15:42:14 user nova-compute[75176]:     </memballoon>
Nov 28 15:42:14 user nova-compute[75176]:   </devices>
Nov 28 15:42:14 user nova-compute[75176]: </domain>
Nov 28 15:42:14 user nova-compute[75176]:  {{(pid=75176) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 15:42:14 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-9a8ca7b8-4413-43c8-85b1-9ac4138b14af tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T15:42:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1989419547',display_name='tempest-AttachVolumeNegativeTest-server-1989419547',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1989419547',id=13,image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDFFWjldyHtbmkwknmcPcPg3lFhol4yQjd0aGcLhl8u/bcASG+kJTHf5jG/jfYqtoq04tUjwJE1sE6H7GDR3xBjF+nxszd0qVv51R7jnyv4CEJMXYm+f8JML2UmVvpu+mA==',key_name='tempest-keypair-1933077131',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a194f81f7e104be7940d1d05f71bbad9',ramdisk_id='',reservation_id='r-0k0fuqwb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1403590572',owner_user_name='tempest-AttachVolumeNegativeTest-1403590572-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T15:42:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f9a745552d974e05a9e0befc68eb7f6e',uuid=402e779e-f507-49f1-a0d8-31ab0d23fbcd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2de2e1eb-51fe-4259-bb8a-20c50e87b4ce", "address": "fa:16:3e:c4:29:df", "network": {"id": "7ab60343-57be-427d-9037-6ecf0eaf5de0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1508138843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a194f81f7e104be7940d1d05f71bbad9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2de2e1eb-51", "ovs_interfaceid": "2de2e1eb-51fe-4259-bb8a-20c50e87b4ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 15:42:14 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-9a8ca7b8-4413-43c8-85b1-9ac4138b14af tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Converting VIF {"id": "2de2e1eb-51fe-4259-bb8a-20c50e87b4ce", "address": "fa:16:3e:c4:29:df", "network": {"id": "7ab60343-57be-427d-9037-6ecf0eaf5de0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1508138843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a194f81f7e104be7940d1d05f71bbad9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2de2e1eb-51", "ovs_interfaceid": "2de2e1eb-51fe-4259-bb8a-20c50e87b4ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:42:14 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-9a8ca7b8-4413-43c8-85b1-9ac4138b14af tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:29:df,bridge_name='br-int',has_traffic_filtering=True,id=2de2e1eb-51fe-4259-bb8a-20c50e87b4ce,network=Network(7ab60343-57be-427d-9037-6ecf0eaf5de0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2de2e1eb-51') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:42:14 user nova-compute[75176]: DEBUG os_vif [None req-9a8ca7b8-4413-43c8-85b1-9ac4138b14af tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:29:df,bridge_name='br-int',has_traffic_filtering=True,id=2de2e1eb-51fe-4259-bb8a-20c50e87b4ce,network=Network(7ab60343-57be-427d-9037-6ecf0eaf5de0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2de2e1eb-51') {{(pid=75176) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 15:42:14 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:42:14 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:42:14 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 15:42:14 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:42:14 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9be520a8-31a2-569c-b63a-0776e1b9a55a', '_type': 'linux-noop'}}, row=False) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:42:14 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:42:14 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:42:14 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:42:14 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:42:14 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2de2e1eb-51, may_exist=True, interface_attrs={}) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:42:14 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2de2e1eb-51, col_values=(('qos', UUID('f4d25aa5-6132-45ee-bda9-748e2a83de3a')),), if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:42:14 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2de2e1eb-51, col_values=(('external_ids', {'iface-id': '2de2e1eb-51fe-4259-bb8a-20c50e87b4ce', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c4:29:df', 'vm-uuid': '402e779e-f507-49f1-a0d8-31ab0d23fbcd'}),), if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:42:14 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:42:14 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:42:14 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:42:14 user nova-compute[75176]: INFO os_vif [None req-9a8ca7b8-4413-43c8-85b1-9ac4138b14af tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:29:df,bridge_name='br-int',has_traffic_filtering=True,id=2de2e1eb-51fe-4259-bb8a-20c50e87b4ce,network=Network(7ab60343-57be-427d-9037-6ecf0eaf5de0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2de2e1eb-51')
Nov 28 15:42:14 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-9a8ca7b8-4413-43c8-85b1-9ac4138b14af tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] No BDM found with device name vda, not building metadata. {{(pid=75176) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 15:42:14 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-9a8ca7b8-4413-43c8-85b1-9ac4138b14af tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] No VIF found with MAC fa:16:3e:c4:29:df, not building metadata {{(pid=75176) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 15:42:15 user nova-compute[75176]: DEBUG nova.network.neutron [req-9b0da6b4-9e7b-4afd-a07f-82b8c0b3313c req-5828d061-38f4-4141-afa7-f1a1deafb228 service nova] [instance: 402e779e-f507-49f1-a0d8-31ab0d23fbcd] Updated VIF entry in instance network info cache for port 2de2e1eb-51fe-4259-bb8a-20c50e87b4ce. {{(pid=75176) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 15:42:15 user nova-compute[75176]: DEBUG nova.network.neutron [req-9b0da6b4-9e7b-4afd-a07f-82b8c0b3313c req-5828d061-38f4-4141-afa7-f1a1deafb228 service nova] [instance: 402e779e-f507-49f1-a0d8-31ab0d23fbcd] Updating instance_info_cache with network_info: [{"id": "2de2e1eb-51fe-4259-bb8a-20c50e87b4ce", "address": "fa:16:3e:c4:29:df", "network": {"id": "7ab60343-57be-427d-9037-6ecf0eaf5de0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1508138843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a194f81f7e104be7940d1d05f71bbad9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2de2e1eb-51", "ovs_interfaceid": "2de2e1eb-51fe-4259-bb8a-20c50e87b4ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:42:15 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-9b0da6b4-9e7b-4afd-a07f-82b8c0b3313c req-5828d061-38f4-4141-afa7-f1a1deafb228 service nova] Releasing lock "refresh_cache-402e779e-f507-49f1-a0d8-31ab0d23fbcd" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:42:15 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:42:15 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:42:15 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:42:15 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:42:16 user nova-compute[75176]: DEBUG nova.compute.manager [req-fc4f9dfa-d1fc-49cb-8526-cc95970d6ecc req-d14c24c3-98f2-4c49-b3ba-6e627ac7bedd service nova] [instance: 402e779e-f507-49f1-a0d8-31ab0d23fbcd] Received event network-vif-plugged-2de2e1eb-51fe-4259-bb8a-20c50e87b4ce {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:42:16 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-fc4f9dfa-d1fc-49cb-8526-cc95970d6ecc req-d14c24c3-98f2-4c49-b3ba-6e627ac7bedd service nova] Acquiring lock "402e779e-f507-49f1-a0d8-31ab0d23fbcd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:42:16 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-fc4f9dfa-d1fc-49cb-8526-cc95970d6ecc req-d14c24c3-98f2-4c49-b3ba-6e627ac7bedd service nova] Lock "402e779e-f507-49f1-a0d8-31ab0d23fbcd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:42:16 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-fc4f9dfa-d1fc-49cb-8526-cc95970d6ecc req-d14c24c3-98f2-4c49-b3ba-6e627ac7bedd service nova] Lock "402e779e-f507-49f1-a0d8-31ab0d23fbcd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:42:16 user nova-compute[75176]: DEBUG nova.compute.manager [req-fc4f9dfa-d1fc-49cb-8526-cc95970d6ecc req-d14c24c3-98f2-4c49-b3ba-6e627ac7bedd service nova] [instance: 402e779e-f507-49f1-a0d8-31ab0d23fbcd] No waiting events found dispatching network-vif-plugged-2de2e1eb-51fe-4259-bb8a-20c50e87b4ce {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:42:16 user nova-compute[75176]: WARNING nova.compute.manager [req-fc4f9dfa-d1fc-49cb-8526-cc95970d6ecc req-d14c24c3-98f2-4c49-b3ba-6e627ac7bedd service nova] [instance: 402e779e-f507-49f1-a0d8-31ab0d23fbcd] Received unexpected event network-vif-plugged-2de2e1eb-51fe-4259-bb8a-20c50e87b4ce for instance with vm_state building and task_state spawning.
Nov 28 15:42:16 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:42:16 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:42:16 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:42:16 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:42:16 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:42:17 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-800b39ab-a4d7-45a9-914e-0d23f3197a9d tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] Acquiring lock "9dcbbf59-600f-4309-abd3-e8e4c7731c0b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:42:17 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-800b39ab-a4d7-45a9-914e-0d23f3197a9d tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] Lock "9dcbbf59-600f-4309-abd3-e8e4c7731c0b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:42:17 user nova-compute[75176]: DEBUG nova.compute.manager [None req-800b39ab-a4d7-45a9-914e-0d23f3197a9d tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] [instance: 9dcbbf59-600f-4309-abd3-e8e4c7731c0b] Starting instance... {{(pid=75176) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 15:42:18 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-800b39ab-a4d7-45a9-914e-0d23f3197a9d tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:42:18 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-800b39ab-a4d7-45a9-914e-0d23f3197a9d tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:42:18 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-800b39ab-a4d7-45a9-914e-0d23f3197a9d tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75176) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 15:42:18 user nova-compute[75176]: INFO nova.compute.claims [None req-800b39ab-a4d7-45a9-914e-0d23f3197a9d tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] [instance: 9dcbbf59-600f-4309-abd3-e8e4c7731c0b] Claim successful on node user
Nov 28 15:42:18 user nova-compute[75176]: DEBUG nova.compute.manager [None req-9a8ca7b8-4413-43c8-85b1-9ac4138b14af tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] [instance: 402e779e-f507-49f1-a0d8-31ab0d23fbcd] Instance event wait completed in 0 seconds for  {{(pid=75176) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 15:42:18 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-9a8ca7b8-4413-43c8-85b1-9ac4138b14af tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] [instance: 402e779e-f507-49f1-a0d8-31ab0d23fbcd] Guest created on hypervisor {{(pid=75176) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 15:42:18 user nova-compute[75176]: INFO nova.virt.libvirt.driver [-] [instance: 402e779e-f507-49f1-a0d8-31ab0d23fbcd] Instance spawned successfully.
Nov 28 15:42:18 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-9a8ca7b8-4413-43c8-85b1-9ac4138b14af tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] [instance: 402e779e-f507-49f1-a0d8-31ab0d23fbcd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 15:42:18 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-9a8ca7b8-4413-43c8-85b1-9ac4138b14af tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] [instance: 402e779e-f507-49f1-a0d8-31ab0d23fbcd] Found default for hw_cdrom_bus of ide {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:42:18 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-9a8ca7b8-4413-43c8-85b1-9ac4138b14af tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] [instance: 402e779e-f507-49f1-a0d8-31ab0d23fbcd] Found default for hw_disk_bus of virtio {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:42:18 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-9a8ca7b8-4413-43c8-85b1-9ac4138b14af tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] [instance: 402e779e-f507-49f1-a0d8-31ab0d23fbcd] Found default for hw_input_bus of None {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:42:18 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-9a8ca7b8-4413-43c8-85b1-9ac4138b14af tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] [instance: 402e779e-f507-49f1-a0d8-31ab0d23fbcd] Found default for hw_pointer_model of None {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:42:18 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-9a8ca7b8-4413-43c8-85b1-9ac4138b14af tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] [instance: 402e779e-f507-49f1-a0d8-31ab0d23fbcd] Found default for hw_video_model of virtio {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:42:18 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-9a8ca7b8-4413-43c8-85b1-9ac4138b14af tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] [instance: 402e779e-f507-49f1-a0d8-31ab0d23fbcd] Found default for hw_vif_model of virtio {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:42:18 user nova-compute[75176]: INFO nova.compute.manager [None req-9a8ca7b8-4413-43c8-85b1-9ac4138b14af tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] [instance: 402e779e-f507-49f1-a0d8-31ab0d23fbcd] Took 5.24 seconds to spawn the instance on the hypervisor.
Nov 28 15:42:18 user nova-compute[75176]: DEBUG nova.compute.manager [None req-9a8ca7b8-4413-43c8-85b1-9ac4138b14af tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] [instance: 402e779e-f507-49f1-a0d8-31ab0d23fbcd] Checking state {{(pid=75176) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 15:42:18 user nova-compute[75176]: DEBUG nova.compute.manager [req-dad5b153-b655-4216-a985-6a4693b205a8 req-d76f5d94-c3c3-42e4-b24f-86e55a7e0dc0 service nova] [instance: 402e779e-f507-49f1-a0d8-31ab0d23fbcd] Received event network-vif-plugged-2de2e1eb-51fe-4259-bb8a-20c50e87b4ce {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:42:18 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-dad5b153-b655-4216-a985-6a4693b205a8 req-d76f5d94-c3c3-42e4-b24f-86e55a7e0dc0 service nova] Acquiring lock "402e779e-f507-49f1-a0d8-31ab0d23fbcd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:42:18 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-dad5b153-b655-4216-a985-6a4693b205a8 req-d76f5d94-c3c3-42e4-b24f-86e55a7e0dc0 service nova] Lock "402e779e-f507-49f1-a0d8-31ab0d23fbcd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:42:18 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-dad5b153-b655-4216-a985-6a4693b205a8 req-d76f5d94-c3c3-42e4-b24f-86e55a7e0dc0 service nova] Lock "402e779e-f507-49f1-a0d8-31ab0d23fbcd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:42:18 user nova-compute[75176]: DEBUG nova.compute.manager [req-dad5b153-b655-4216-a985-6a4693b205a8 req-d76f5d94-c3c3-42e4-b24f-86e55a7e0dc0 service nova] [instance: 402e779e-f507-49f1-a0d8-31ab0d23fbcd] No waiting events found dispatching network-vif-plugged-2de2e1eb-51fe-4259-bb8a-20c50e87b4ce {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:42:18 user nova-compute[75176]: WARNING nova.compute.manager [req-dad5b153-b655-4216-a985-6a4693b205a8 req-d76f5d94-c3c3-42e4-b24f-86e55a7e0dc0 service nova] [instance: 402e779e-f507-49f1-a0d8-31ab0d23fbcd] Received unexpected event network-vif-plugged-2de2e1eb-51fe-4259-bb8a-20c50e87b4ce for instance with vm_state building and task_state spawning.
Nov 28 15:42:18 user nova-compute[75176]: INFO nova.compute.manager [None req-9a8ca7b8-4413-43c8-85b1-9ac4138b14af tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] [instance: 402e779e-f507-49f1-a0d8-31ab0d23fbcd] Took 6.01 seconds to build instance.
Nov 28 15:42:18 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-9a8ca7b8-4413-43c8-85b1-9ac4138b14af tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Lock "402e779e-f507-49f1-a0d8-31ab0d23fbcd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.104s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:42:18 user nova-compute[75176]: DEBUG nova.compute.provider_tree [None req-800b39ab-a4d7-45a9-914e-0d23f3197a9d tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] Inventory has not changed in ProviderTree for provider: b37848d8-f401-4155-a029-b0ffa09ff85b {{(pid=75176) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 15:42:18 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-800b39ab-a4d7-45a9-914e-0d23f3197a9d tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] Inventory has not changed for provider b37848d8-f401-4155-a029-b0ffa09ff85b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75176) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 15:42:18 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-1d25bad1-7d08-4172-b1ea-9e3f1ad2ebaa tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] Waiting for libvirt event about the detach of device tape5bd47ee-ad with device alias net1 from instance e2e25e19-c832-4945-9257-64e6103feb0c is timed out.
Nov 28 15:42:18 user nova-compute[75176]: DEBUG nova.virt.libvirt.guest [None req-1d25bad1-7d08-4172-b1ea-9e3f1ad2ebaa tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:be:ab:10"/><model type="virtio"/><mtu size="1442"/><target dev="tape5bd47ee-ad"/></interface> {{(pid=75176) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 28 15:42:18 user nova-compute[75176]: DEBUG nova.virt.libvirt.guest [None req-1d25bad1-7d08-4172-b1ea-9e3f1ad2ebaa tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:be:ab:10"/><model type="virtio"/><mtu size="1442"/><target dev="tape5bd47ee-ad"/></interface>not found in domain: <domain type='kvm' id='6'>
Nov 28 15:42:18 user nova-compute[75176]:   <name>instance-00000006</name>
Nov 28 15:42:18 user nova-compute[75176]:   <uuid>e2e25e19-c832-4945-9257-64e6103feb0c</uuid>
Nov 28 15:42:18 user nova-compute[75176]:   <metadata>
Nov 28 15:42:18 user nova-compute[75176]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 15:42:18 user nova-compute[75176]:   <nova:package version="0.0.0"/>
Nov 28 15:42:18 user nova-compute[75176]:   <nova:name>tempest-device-tagging-server-1735788857</nova:name>
Nov 28 15:42:18 user nova-compute[75176]:   <nova:creationTime>2023-11-28 15:41:20</nova:creationTime>
Nov 28 15:42:18 user nova-compute[75176]:   <nova:flavor name="m1.tiny">
Nov 28 15:42:18 user nova-compute[75176]:     <nova:memory>512</nova:memory>
Nov 28 15:42:18 user nova-compute[75176]:     <nova:disk>1</nova:disk>
Nov 28 15:42:18 user nova-compute[75176]:     <nova:swap>0</nova:swap>
Nov 28 15:42:18 user nova-compute[75176]:     <nova:ephemeral>0</nova:ephemeral>
Nov 28 15:42:18 user nova-compute[75176]:     <nova:vcpus>1</nova:vcpus>
Nov 28 15:42:18 user nova-compute[75176]:   </nova:flavor>
Nov 28 15:42:18 user nova-compute[75176]:   <nova:owner>
Nov 28 15:42:18 user nova-compute[75176]:     <nova:user uuid="5b8c4eae6ef14fa2b416c67f86e85971">tempest-TaggedAttachmentsTest-231716548-project-member</nova:user>
Nov 28 15:42:18 user nova-compute[75176]:     <nova:project uuid="2ca8d4f7f4934dbdbd6ba92f51fba4b6">tempest-TaggedAttachmentsTest-231716548</nova:project>
Nov 28 15:42:18 user nova-compute[75176]:   </nova:owner>
Nov 28 15:42:18 user nova-compute[75176]:   <nova:root type="image" uuid="1f41819e-c93f-4dc7-b253-37a27bbbbc74"/>
Nov 28 15:42:18 user nova-compute[75176]:   <nova:ports>
Nov 28 15:42:18 user nova-compute[75176]:     <nova:port uuid="05efa912-30d1-4474-a2eb-7d88fa0813e7">
Nov 28 15:42:18 user nova-compute[75176]:       <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 28 15:42:18 user nova-compute[75176]:     </nova:port>
Nov 28 15:42:18 user nova-compute[75176]:     <nova:port uuid="e5bd47ee-addd-42fc-9585-aa5515c145f7">
Nov 28 15:42:18 user nova-compute[75176]:       <nova:ip type="fixed" address="10.10.10.153" ipVersion="4"/>
Nov 28 15:42:18 user nova-compute[75176]:     </nova:port>
Nov 28 15:42:18 user nova-compute[75176]:   </nova:ports>
Nov 28 15:42:18 user nova-compute[75176]: </nova:instance>
Nov 28 15:42:18 user nova-compute[75176]:   </metadata>
Nov 28 15:42:18 user nova-compute[75176]:   <memory unit='KiB'>524288</memory>
Nov 28 15:42:18 user nova-compute[75176]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 28 15:42:18 user nova-compute[75176]:   <vcpu placement='static'>1</vcpu>
Nov 28 15:42:18 user nova-compute[75176]:   <resource>
Nov 28 15:42:18 user nova-compute[75176]:     <partition>/machine</partition>
Nov 28 15:42:18 user nova-compute[75176]:   </resource>
Nov 28 15:42:18 user nova-compute[75176]:   <sysinfo type='smbios'>
Nov 28 15:42:18 user nova-compute[75176]:     <system>
Nov 28 15:42:18 user nova-compute[75176]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 28 15:42:18 user nova-compute[75176]:       <entry name='product'>OpenStack Nova</entry>
Nov 28 15:42:18 user nova-compute[75176]:       <entry name='version'>0.0.0</entry>
Nov 28 15:42:18 user nova-compute[75176]:       <entry name='serial'>e2e25e19-c832-4945-9257-64e6103feb0c</entry>
Nov 28 15:42:18 user nova-compute[75176]:       <entry name='uuid'>e2e25e19-c832-4945-9257-64e6103feb0c</entry>
Nov 28 15:42:18 user nova-compute[75176]:       <entry name='family'>Virtual Machine</entry>
Nov 28 15:42:18 user nova-compute[75176]:     </system>
Nov 28 15:42:18 user nova-compute[75176]:   </sysinfo>
Nov 28 15:42:18 user nova-compute[75176]:   <os>
Nov 28 15:42:18 user nova-compute[75176]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 28 15:42:18 user nova-compute[75176]:     <boot dev='hd'/>
Nov 28 15:42:18 user nova-compute[75176]:     <smbios mode='sysinfo'/>
Nov 28 15:42:18 user nova-compute[75176]:   </os>
Nov 28 15:42:18 user nova-compute[75176]:   <features>
Nov 28 15:42:18 user nova-compute[75176]:     <acpi/>
Nov 28 15:42:18 user nova-compute[75176]:     <apic/>
Nov 28 15:42:18 user nova-compute[75176]:     <vmcoreinfo state='on'/>
Nov 28 15:42:18 user nova-compute[75176]:   </features>
Nov 28 15:42:18 user nova-compute[75176]:   <cpu mode='custom' match='exact' check='full'>
Nov 28 15:42:18 user nova-compute[75176]:     <model fallback='forbid'>Nehalem</model>
Nov 28 15:42:18 user nova-compute[75176]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 28 15:42:18 user nova-compute[75176]:     <feature policy='require' name='vme'/>
Nov 28 15:42:18 user nova-compute[75176]:     <feature policy='require' name='x2apic'/>
Nov 28 15:42:18 user nova-compute[75176]:     <feature policy='require' name='hypervisor'/>
Nov 28 15:42:18 user nova-compute[75176]:   </cpu>
Nov 28 15:42:18 user nova-compute[75176]:   <clock offset='utc'>
Nov 28 15:42:18 user nova-compute[75176]:     <timer name='pit' tickpolicy='delay'/>
Nov 28 15:42:18 user nova-compute[75176]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 28 15:42:18 user nova-compute[75176]:     <timer name='hpet' present='no'/>
Nov 28 15:42:18 user nova-compute[75176]:   </clock>
Nov 28 15:42:18 user nova-compute[75176]:   <on_poweroff>destroy</on_poweroff>
Nov 28 15:42:18 user nova-compute[75176]:   <on_reboot>restart</on_reboot>
Nov 28 15:42:18 user nova-compute[75176]:   <on_crash>destroy</on_crash>
Nov 28 15:42:18 user nova-compute[75176]:   <devices>
Nov 28 15:42:18 user nova-compute[75176]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 28 15:42:18 user nova-compute[75176]:     <disk type='file' device='disk'>
Nov 28 15:42:18 user nova-compute[75176]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 28 15:42:18 user nova-compute[75176]:       <source file='/opt/stack/data/nova/instances/e2e25e19-c832-4945-9257-64e6103feb0c/disk' index='2'/>
Nov 28 15:42:18 user nova-compute[75176]:       <backingStore type='file' index='3'>
Nov 28 15:42:18 user nova-compute[75176]:         <format type='raw'/>
Nov 28 15:42:18 user nova-compute[75176]:         <source file='/opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2'/>
Nov 28 15:42:18 user nova-compute[75176]:         <backingStore/>
Nov 28 15:42:18 user nova-compute[75176]:       </backingStore>
Nov 28 15:42:18 user nova-compute[75176]:       <target dev='vda' bus='virtio'/>
Nov 28 15:42:18 user nova-compute[75176]:       <alias name='virtio-disk0'/>
Nov 28 15:42:18 user nova-compute[75176]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 28 15:42:18 user nova-compute[75176]:     </disk>
Nov 28 15:42:18 user nova-compute[75176]:     <disk type='file' device='cdrom'>
Nov 28 15:42:18 user nova-compute[75176]:       <driver name='qemu' type='raw' cache='none'/>
Nov 28 15:42:18 user nova-compute[75176]:       <source file='/opt/stack/data/nova/instances/e2e25e19-c832-4945-9257-64e6103feb0c/disk.config' index='1'/>
Nov 28 15:42:18 user nova-compute[75176]:       <backingStore/>
Nov 28 15:42:18 user nova-compute[75176]:       <target dev='hda' bus='ide'/>
Nov 28 15:42:18 user nova-compute[75176]:       <readonly/>
Nov 28 15:42:18 user nova-compute[75176]:       <alias name='ide0-0-0'/>
Nov 28 15:42:18 user nova-compute[75176]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 28 15:42:18 user nova-compute[75176]:     </disk>
Nov 28 15:42:18 user nova-compute[75176]:     <controller type='usb' index='0' model='none'>
Nov 28 15:42:18 user nova-compute[75176]:       <alias name='usb'/>
Nov 28 15:42:18 user nova-compute[75176]:     </controller>
Nov 28 15:42:18 user nova-compute[75176]:     <controller type='pci' index='0' model='pci-root'>
Nov 28 15:42:18 user nova-compute[75176]:       <alias name='pci.0'/>
Nov 28 15:42:18 user nova-compute[75176]:     </controller>
Nov 28 15:42:18 user nova-compute[75176]:     <controller type='ide' index='0'>
Nov 28 15:42:18 user nova-compute[75176]:       <alias name='ide'/>
Nov 28 15:42:18 user nova-compute[75176]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 28 15:42:18 user nova-compute[75176]:     </controller>
Nov 28 15:42:18 user nova-compute[75176]:     <interface type='ethernet'>
Nov 28 15:42:18 user nova-compute[75176]:       <mac address='fa:16:3e:b8:ab:c4'/>
Nov 28 15:42:18 user nova-compute[75176]:       <target dev='tap05efa912-30'/>
Nov 28 15:42:18 user nova-compute[75176]:       <model type='virtio'/>
Nov 28 15:42:18 user nova-compute[75176]:       <mtu size='1442'/>
Nov 28 15:42:18 user nova-compute[75176]:       <alias name='net0'/>
Nov 28 15:42:18 user nova-compute[75176]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 28 15:42:18 user nova-compute[75176]:     </interface>
Nov 28 15:42:18 user nova-compute[75176]:     <serial type='pty'>
Nov 28 15:42:18 user nova-compute[75176]:       <source path='/dev/pts/5'/>
Nov 28 15:42:18 user nova-compute[75176]:       <log file='/opt/stack/data/nova/instances/e2e25e19-c832-4945-9257-64e6103feb0c/console.log' append='off'/>
Nov 28 15:42:18 user nova-compute[75176]:       <target type='isa-serial' port='0'>
Nov 28 15:42:18 user nova-compute[75176]:         <model name='isa-serial'/>
Nov 28 15:42:18 user nova-compute[75176]:       </target>
Nov 28 15:42:18 user nova-compute[75176]:       <alias name='serial0'/>
Nov 28 15:42:18 user nova-compute[75176]:     </serial>
Nov 28 15:42:18 user nova-compute[75176]:     <console type='pty' tty='/dev/pts/5'>
Nov 28 15:42:18 user nova-compute[75176]:       <source path='/dev/pts/5'/>
Nov 28 15:42:18 user nova-compute[75176]:       <log file='/opt/stack/data/nova/instances/e2e25e19-c832-4945-9257-64e6103feb0c/console.log' append='off'/>
Nov 28 15:42:18 user nova-compute[75176]:       <target type='serial' port='0'/>
Nov 28 15:42:18 user nova-compute[75176]:       <alias name='serial0'/>
Nov 28 15:42:18 user nova-compute[75176]:     </console>
Nov 28 15:42:18 user nova-compute[75176]:     <input type='mouse' bus='ps2'>
Nov 28 15:42:18 user nova-compute[75176]:       <alias name='input0'/>
Nov 28 15:42:18 user nova-compute[75176]:     </input>
Nov 28 15:42:18 user nova-compute[75176]:     <input type='keyboard' bus='ps2'>
Nov 28 15:42:18 user nova-compute[75176]:       <alias name='input1'/>
Nov 28 15:42:18 user nova-compute[75176]:     </input>
Nov 28 15:42:18 user nova-compute[75176]:     <graphics type='vnc' port='5905' autoport='yes' listen='0.0.0.0'>
Nov 28 15:42:18 user nova-compute[75176]:       <listen type='address' address='0.0.0.0'/>
Nov 28 15:42:18 user nova-compute[75176]:     </graphics>
Nov 28 15:42:18 user nova-compute[75176]:     <audio id='1' type='none'/>
Nov 28 15:42:18 user nova-compute[75176]:     <video>
Nov 28 15:42:18 user nova-compute[75176]:       <model type='virtio' heads='1' primary='yes'/>
Nov 28 15:42:18 user nova-compute[75176]:       <alias name='video0'/>
Nov 28 15:42:18 user nova-compute[75176]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 28 15:42:18 user nova-compute[75176]:     </video>
Nov 28 15:42:18 user nova-compute[75176]:     <memballoon model='virtio'>
Nov 28 15:42:18 user nova-compute[75176]:       <stats period='10'/>
Nov 28 15:42:18 user nova-compute[75176]:       <alias name='balloon0'/>
Nov 28 15:42:18 user nova-compute[75176]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 28 15:42:18 user nova-compute[75176]:     </memballoon>
Nov 28 15:42:18 user nova-compute[75176]:     <rng model='virtio'>
Nov 28 15:42:18 user nova-compute[75176]:       <backend model='random'>/dev/urandom</backend>
Nov 28 15:42:18 user nova-compute[75176]:       <alias name='rng0'/>
Nov 28 15:42:18 user nova-compute[75176]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 28 15:42:18 user nova-compute[75176]:     </rng>
Nov 28 15:42:18 user nova-compute[75176]:   </devices>
Nov 28 15:42:18 user nova-compute[75176]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 28 15:42:18 user nova-compute[75176]:     <label>libvirt-e2e25e19-c832-4945-9257-64e6103feb0c</label>
Nov 28 15:42:18 user nova-compute[75176]:     <imagelabel>libvirt-e2e25e19-c832-4945-9257-64e6103feb0c</imagelabel>
Nov 28 15:42:18 user nova-compute[75176]:   </seclabel>
Nov 28 15:42:18 user nova-compute[75176]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 28 15:42:18 user nova-compute[75176]:     <label>+64055:+108</label>
Nov 28 15:42:18 user nova-compute[75176]:     <imagelabel>+64055:+108</imagelabel>
Nov 28 15:42:18 user nova-compute[75176]:   </seclabel>
Nov 28 15:42:18 user nova-compute[75176]: </domain>
Nov 28 15:42:18 user nova-compute[75176]:  {{(pid=75176) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 28 15:42:18 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-1d25bad1-7d08-4172-b1ea-9e3f1ad2ebaa tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] Successfully detached device tape5bd47ee-ad from instance e2e25e19-c832-4945-9257-64e6103feb0c from the live domain config.
Nov 28 15:42:18 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-1d25bad1-7d08-4172-b1ea-9e3f1ad2ebaa tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T15:39:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1735788857',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1735788857',id=6,image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLYd6lLWkEZSf+41ikXMqtG28NM8Q+hVwVe3wmXerHL+M0XqnrZ3u3KddSHLIIe0vvFogrQWiaY5StKzsHvoccjRJn8doyVKS0uym1H0FtgpShdYQ4yF2e0Gu6ZxuZcJSg==',key_name='tempest-keypair-1836481900',keypairs=<?>,launch_index=0,launched_at=2023-11-28T15:39:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2ca8d4f7f4934dbdbd6ba92f51fba4b6',ramdisk_id='',reservation_id='r-62ikbebi',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-231716548',owner_user_name='tempest-TaggedAttachmentsTest-231716548-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T15:39:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5b8c4eae6ef14fa2b416c67f86e85971',uuid=e2e25e19-c832-4945-9257-64e6103feb0c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e5bd47ee-addd-42fc-9585-aa5515c145f7", "address": "fa:16:3e:be:ab:10", "network": {"id": "e04fe3c5-8edf-4a87-bdec-9fd7e9374310", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1938354238", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "2ca8d4f7f4934dbdbd6ba92f51fba4b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5bd47ee-ad", "ovs_interfaceid": "e5bd47ee-addd-42fc-9585-aa5515c145f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 15:42:18 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-1d25bad1-7d08-4172-b1ea-9e3f1ad2ebaa tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] Converting VIF {"id": "e5bd47ee-addd-42fc-9585-aa5515c145f7", "address": "fa:16:3e:be:ab:10", "network": {"id": "e04fe3c5-8edf-4a87-bdec-9fd7e9374310", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1938354238", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "2ca8d4f7f4934dbdbd6ba92f51fba4b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5bd47ee-ad", "ovs_interfaceid": "e5bd47ee-addd-42fc-9585-aa5515c145f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:42:18 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-1d25bad1-7d08-4172-b1ea-9e3f1ad2ebaa tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:ab:10,bridge_name='br-int',has_traffic_filtering=True,id=e5bd47ee-addd-42fc-9585-aa5515c145f7,network=Network(e04fe3c5-8edf-4a87-bdec-9fd7e9374310),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5bd47ee-ad') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:42:18 user nova-compute[75176]: DEBUG os_vif [None req-1d25bad1-7d08-4172-b1ea-9e3f1ad2ebaa tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:ab:10,bridge_name='br-int',has_traffic_filtering=True,id=e5bd47ee-addd-42fc-9585-aa5515c145f7,network=Network(e04fe3c5-8edf-4a87-bdec-9fd7e9374310),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5bd47ee-ad') {{(pid=75176) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 15:42:18 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:42:18 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape5bd47ee-ad, bridge=br-int, if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:42:18 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:42:18 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:42:18 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:42:18 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=18304ea4-13bd-4494-948f-ec4a23a0df61) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:42:18 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:42:18 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:42:18 user nova-compute[75176]: INFO os_vif [None req-1d25bad1-7d08-4172-b1ea-9e3f1ad2ebaa tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:ab:10,bridge_name='br-int',has_traffic_filtering=True,id=e5bd47ee-addd-42fc-9585-aa5515c145f7,network=Network(e04fe3c5-8edf-4a87-bdec-9fd7e9374310),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5bd47ee-ad')
Nov 28 15:42:18 user nova-compute[75176]: DEBUG nova.virt.libvirt.guest [None req-1d25bad1-7d08-4172-b1ea-9e3f1ad2ebaa tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 15:42:18 user nova-compute[75176]:   <nova:package version="0.0.0"/>
Nov 28 15:42:18 user nova-compute[75176]:   <nova:name>tempest-device-tagging-server-1735788857</nova:name>
Nov 28 15:42:18 user nova-compute[75176]:   <nova:creationTime>2023-11-28 15:42:18</nova:creationTime>
Nov 28 15:42:18 user nova-compute[75176]:   <nova:flavor name="m1.tiny">
Nov 28 15:42:18 user nova-compute[75176]:     <nova:memory>512</nova:memory>
Nov 28 15:42:18 user nova-compute[75176]:     <nova:disk>1</nova:disk>
Nov 28 15:42:18 user nova-compute[75176]:     <nova:swap>0</nova:swap>
Nov 28 15:42:18 user nova-compute[75176]:     <nova:ephemeral>0</nova:ephemeral>
Nov 28 15:42:18 user nova-compute[75176]:     <nova:vcpus>1</nova:vcpus>
Nov 28 15:42:18 user nova-compute[75176]:   </nova:flavor>
Nov 28 15:42:18 user nova-compute[75176]:   <nova:owner>
Nov 28 15:42:18 user nova-compute[75176]:     <nova:user uuid="5b8c4eae6ef14fa2b416c67f86e85971">tempest-TaggedAttachmentsTest-231716548-project-member</nova:user>
Nov 28 15:42:18 user nova-compute[75176]:     <nova:project uuid="2ca8d4f7f4934dbdbd6ba92f51fba4b6">tempest-TaggedAttachmentsTest-231716548</nova:project>
Nov 28 15:42:18 user nova-compute[75176]:   </nova:owner>
Nov 28 15:42:18 user nova-compute[75176]:   <nova:root type="image" uuid="1f41819e-c93f-4dc7-b253-37a27bbbbc74"/>
Nov 28 15:42:18 user nova-compute[75176]:   <nova:ports>
Nov 28 15:42:18 user nova-compute[75176]:     <nova:port uuid="05efa912-30d1-4474-a2eb-7d88fa0813e7">
Nov 28 15:42:18 user nova-compute[75176]:       <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 28 15:42:18 user nova-compute[75176]:     </nova:port>
Nov 28 15:42:18 user nova-compute[75176]:   </nova:ports>
Nov 28 15:42:18 user nova-compute[75176]: </nova:instance>
Nov 28 15:42:18 user nova-compute[75176]:  {{(pid=75176) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 28 15:42:18 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-800b39ab-a4d7-45a9-914e-0d23f3197a9d tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.452s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:42:18 user nova-compute[75176]: DEBUG nova.compute.manager [None req-800b39ab-a4d7-45a9-914e-0d23f3197a9d tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] [instance: 9dcbbf59-600f-4309-abd3-e8e4c7731c0b] Start building networks asynchronously for instance. {{(pid=75176) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 15:42:18 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:42:18 user nova-compute[75176]: DEBUG nova.compute.manager [None req-800b39ab-a4d7-45a9-914e-0d23f3197a9d tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] [instance: 9dcbbf59-600f-4309-abd3-e8e4c7731c0b] Allocating IP information in the background. {{(pid=75176) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 15:42:18 user nova-compute[75176]: DEBUG nova.network.neutron [None req-800b39ab-a4d7-45a9-914e-0d23f3197a9d tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] [instance: 9dcbbf59-600f-4309-abd3-e8e4c7731c0b] allocate_for_instance() {{(pid=75176) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 15:42:18 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-800b39ab-a4d7-45a9-914e-0d23f3197a9d tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] [instance: 9dcbbf59-600f-4309-abd3-e8e4c7731c0b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 15:42:18 user nova-compute[75176]: DEBUG nova.compute.manager [None req-800b39ab-a4d7-45a9-914e-0d23f3197a9d tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] [instance: 9dcbbf59-600f-4309-abd3-e8e4c7731c0b] Start building block device mappings for instance. {{(pid=75176) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 15:42:18 user nova-compute[75176]: DEBUG nova.policy [None req-800b39ab-a4d7-45a9-914e-0d23f3197a9d tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b339a055aaf24d25946cc16369bddc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0518c3ca77e4ecebb6ea8fbf6e60219', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75176) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 15:42:18 user nova-compute[75176]: DEBUG nova.compute.manager [None req-800b39ab-a4d7-45a9-914e-0d23f3197a9d tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] [instance: 9dcbbf59-600f-4309-abd3-e8e4c7731c0b] Start spawning the instance on the hypervisor. {{(pid=75176) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 15:42:18 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-800b39ab-a4d7-45a9-914e-0d23f3197a9d tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] [instance: 9dcbbf59-600f-4309-abd3-e8e4c7731c0b] Creating instance directory {{(pid=75176) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 15:42:18 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-800b39ab-a4d7-45a9-914e-0d23f3197a9d tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] [instance: 9dcbbf59-600f-4309-abd3-e8e4c7731c0b] Creating image(s)
Nov 28 15:42:18 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-800b39ab-a4d7-45a9-914e-0d23f3197a9d tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] Acquiring lock "/opt/stack/data/nova/instances/9dcbbf59-600f-4309-abd3-e8e4c7731c0b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:42:18 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-800b39ab-a4d7-45a9-914e-0d23f3197a9d tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] Lock "/opt/stack/data/nova/instances/9dcbbf59-600f-4309-abd3-e8e4c7731c0b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:42:18 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-800b39ab-a4d7-45a9-914e-0d23f3197a9d tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] Lock "/opt/stack/data/nova/instances/9dcbbf59-600f-4309-abd3-e8e4c7731c0b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:42:18 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-800b39ab-a4d7-45a9-914e-0d23f3197a9d tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:42:19 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-800b39ab-a4d7-45a9-914e-0d23f3197a9d tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json" returned: 0 in 0.181s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:42:19 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-800b39ab-a4d7-45a9-914e-0d23f3197a9d tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] Acquiring lock "5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:42:19 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-800b39ab-a4d7-45a9-914e-0d23f3197a9d tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] Lock "5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:42:19 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-800b39ab-a4d7-45a9-914e-0d23f3197a9d tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:42:19 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-1d25bad1-7d08-4172-b1ea-9e3f1ad2ebaa tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] Acquiring lock "refresh_cache-e2e25e19-c832-4945-9257-64e6103feb0c" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:42:19 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-1d25bad1-7d08-4172-b1ea-9e3f1ad2ebaa tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] Acquired lock "refresh_cache-e2e25e19-c832-4945-9257-64e6103feb0c" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:42:19 user nova-compute[75176]: DEBUG nova.network.neutron [None req-1d25bad1-7d08-4172-b1ea-9e3f1ad2ebaa tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] [instance: e2e25e19-c832-4945-9257-64e6103feb0c] Building network info cache for instance {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 15:42:19 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-800b39ab-a4d7-45a9-914e-0d23f3197a9d tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json" returned: 0 in 0.178s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:42:19 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-800b39ab-a4d7-45a9-914e-0d23f3197a9d tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2,backing_fmt=raw /opt/stack/data/nova/instances/9dcbbf59-600f-4309-abd3-e8e4c7731c0b/disk 1073741824 {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:42:19 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-800b39ab-a4d7-45a9-914e-0d23f3197a9d tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2,backing_fmt=raw /opt/stack/data/nova/instances/9dcbbf59-600f-4309-abd3-e8e4c7731c0b/disk 1073741824" returned: 0 in 0.065s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:42:19 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-800b39ab-a4d7-45a9-914e-0d23f3197a9d tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] Lock "5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.249s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:42:19 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-800b39ab-a4d7-45a9-914e-0d23f3197a9d tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:42:19 user nova-compute[75176]: DEBUG nova.network.neutron [None req-800b39ab-a4d7-45a9-914e-0d23f3197a9d tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] [instance: 9dcbbf59-600f-4309-abd3-e8e4c7731c0b] Successfully created port: 94a78e0e-5cb2-4b37-bce6-f529a646fe3a {{(pid=75176) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 15:42:19 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-800b39ab-a4d7-45a9-914e-0d23f3197a9d tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json" returned: 0 in 0.194s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:42:19 user nova-compute[75176]: DEBUG nova.virt.disk.api [None req-800b39ab-a4d7-45a9-914e-0d23f3197a9d tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9dcbbf59-600f-4309-abd3-e8e4c7731c0b/disk. size=1073741824 {{(pid=75176) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 15:42:19 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-800b39ab-a4d7-45a9-914e-0d23f3197a9d tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dcbbf59-600f-4309-abd3-e8e4c7731c0b/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:42:19 user nova-compute[75176]: INFO nova.network.neutron [None req-1d25bad1-7d08-4172-b1ea-9e3f1ad2ebaa tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] [instance: e2e25e19-c832-4945-9257-64e6103feb0c] Port e5bd47ee-addd-42fc-9585-aa5515c145f7 from network info_cache is no longer associated with instance in Neutron. Removing from network info_cache.
Nov 28 15:42:19 user nova-compute[75176]: DEBUG nova.network.neutron [None req-1d25bad1-7d08-4172-b1ea-9e3f1ad2ebaa tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] [instance: e2e25e19-c832-4945-9257-64e6103feb0c] Updating instance_info_cache with network_info: [{"id": "05efa912-30d1-4474-a2eb-7d88fa0813e7", "address": "fa:16:3e:b8:ab:c4", "network": {"id": "8bf6c19c-1190-430d-8e20-bc6439072a45", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-211502152-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ca8d4f7f4934dbdbd6ba92f51fba4b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05efa912-30", "ovs_interfaceid": "05efa912-30d1-4474-a2eb-7d88fa0813e7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:42:19 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-1d25bad1-7d08-4172-b1ea-9e3f1ad2ebaa tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] Releasing lock "refresh_cache-e2e25e19-c832-4945-9257-64e6103feb0c" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:42:19 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-1d25bad1-7d08-4172-b1ea-9e3f1ad2ebaa tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] Lock "interface-e2e25e19-c832-4945-9257-64e6103feb0c-e5bd47ee-addd-42fc-9585-aa5515c145f7" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 21.681s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:42:19 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-800b39ab-a4d7-45a9-914e-0d23f3197a9d tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dcbbf59-600f-4309-abd3-e8e4c7731c0b/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:42:19 user nova-compute[75176]: DEBUG nova.virt.disk.api [None req-800b39ab-a4d7-45a9-914e-0d23f3197a9d tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] Cannot resize image /opt/stack/data/nova/instances/9dcbbf59-600f-4309-abd3-e8e4c7731c0b/disk to a smaller size. {{(pid=75176) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 15:42:19 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-800b39ab-a4d7-45a9-914e-0d23f3197a9d tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] [instance: 9dcbbf59-600f-4309-abd3-e8e4c7731c0b] Created local disks {{(pid=75176) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 15:42:19 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-800b39ab-a4d7-45a9-914e-0d23f3197a9d tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] [instance: 9dcbbf59-600f-4309-abd3-e8e4c7731c0b] Ensure instance console log exists: /opt/stack/data/nova/instances/9dcbbf59-600f-4309-abd3-e8e4c7731c0b/console.log {{(pid=75176) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 15:42:19 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-800b39ab-a4d7-45a9-914e-0d23f3197a9d tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:42:19 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-800b39ab-a4d7-45a9-914e-0d23f3197a9d tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:42:19 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-800b39ab-a4d7-45a9-914e-0d23f3197a9d tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:42:20 user nova-compute[75176]: DEBUG nova.network.neutron [None req-800b39ab-a4d7-45a9-914e-0d23f3197a9d tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] [instance: 9dcbbf59-600f-4309-abd3-e8e4c7731c0b] Successfully updated port: 94a78e0e-5cb2-4b37-bce6-f529a646fe3a {{(pid=75176) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 15:42:20 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-800b39ab-a4d7-45a9-914e-0d23f3197a9d tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] Acquiring lock "refresh_cache-9dcbbf59-600f-4309-abd3-e8e4c7731c0b" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:42:20 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-800b39ab-a4d7-45a9-914e-0d23f3197a9d tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] Acquired lock "refresh_cache-9dcbbf59-600f-4309-abd3-e8e4c7731c0b" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:42:20 user nova-compute[75176]: DEBUG nova.network.neutron [None req-800b39ab-a4d7-45a9-914e-0d23f3197a9d tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] [instance: 9dcbbf59-600f-4309-abd3-e8e4c7731c0b] Building network info cache for instance {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 15:42:20 user nova-compute[75176]: DEBUG nova.compute.manager [req-310ad897-176b-4fd5-8b77-657c8a19975b req-5091b9f6-96cb-45fe-af2e-cd3b930a0e62 service nova] [instance: 9dcbbf59-600f-4309-abd3-e8e4c7731c0b] Received event network-changed-94a78e0e-5cb2-4b37-bce6-f529a646fe3a {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:42:20 user nova-compute[75176]: DEBUG nova.compute.manager [req-310ad897-176b-4fd5-8b77-657c8a19975b req-5091b9f6-96cb-45fe-af2e-cd3b930a0e62 service nova] [instance: 9dcbbf59-600f-4309-abd3-e8e4c7731c0b] Refreshing instance network info cache due to event network-changed-94a78e0e-5cb2-4b37-bce6-f529a646fe3a. {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 15:42:20 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-310ad897-176b-4fd5-8b77-657c8a19975b req-5091b9f6-96cb-45fe-af2e-cd3b930a0e62 service nova] Acquiring lock "refresh_cache-9dcbbf59-600f-4309-abd3-e8e4c7731c0b" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:42:20 user nova-compute[75176]: DEBUG nova.network.neutron [None req-800b39ab-a4d7-45a9-914e-0d23f3197a9d tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] [instance: 9dcbbf59-600f-4309-abd3-e8e4c7731c0b] Instance cache missing network info. {{(pid=75176) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 15:42:20 user nova-compute[75176]: DEBUG nova.compute.manager [req-96d92be9-a997-48d1-8c3e-cf2bbcb0dcaf req-194a4a35-0a94-447b-ae6b-073b11bf0a4d service nova] [instance: e2e25e19-c832-4945-9257-64e6103feb0c] Received event network-vif-deleted-e5bd47ee-addd-42fc-9585-aa5515c145f7 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:42:20 user nova-compute[75176]: DEBUG nova.network.neutron [None req-800b39ab-a4d7-45a9-914e-0d23f3197a9d tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] [instance: 9dcbbf59-600f-4309-abd3-e8e4c7731c0b] Updating instance_info_cache with network_info: [{"id": "94a78e0e-5cb2-4b37-bce6-f529a646fe3a", "address": "fa:16:3e:4b:5e:3e", "network": {"id": "1c357ee9-ff80-4a4b-9fd5-f2f348b36acc", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1869945166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0518c3ca77e4ecebb6ea8fbf6e60219", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94a78e0e-5c", "ovs_interfaceid": "94a78e0e-5cb2-4b37-bce6-f529a646fe3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:42:20 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-800b39ab-a4d7-45a9-914e-0d23f3197a9d tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] Releasing lock "refresh_cache-9dcbbf59-600f-4309-abd3-e8e4c7731c0b" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:42:20 user nova-compute[75176]: DEBUG nova.compute.manager [None req-800b39ab-a4d7-45a9-914e-0d23f3197a9d tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] [instance: 9dcbbf59-600f-4309-abd3-e8e4c7731c0b] Instance network_info: |[{"id": "94a78e0e-5cb2-4b37-bce6-f529a646fe3a", "address": "fa:16:3e:4b:5e:3e", "network": {"id": "1c357ee9-ff80-4a4b-9fd5-f2f348b36acc", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1869945166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0518c3ca77e4ecebb6ea8fbf6e60219", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94a78e0e-5c", "ovs_interfaceid": "94a78e0e-5cb2-4b37-bce6-f529a646fe3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75176) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 15:42:20 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-310ad897-176b-4fd5-8b77-657c8a19975b req-5091b9f6-96cb-45fe-af2e-cd3b930a0e62 service nova] Acquired lock "refresh_cache-9dcbbf59-600f-4309-abd3-e8e4c7731c0b" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:42:20 user nova-compute[75176]: DEBUG nova.network.neutron [req-310ad897-176b-4fd5-8b77-657c8a19975b req-5091b9f6-96cb-45fe-af2e-cd3b930a0e62 service nova] [instance: 9dcbbf59-600f-4309-abd3-e8e4c7731c0b] Refreshing network info cache for port 94a78e0e-5cb2-4b37-bce6-f529a646fe3a {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 15:42:20 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-800b39ab-a4d7-45a9-914e-0d23f3197a9d tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] [instance: 9dcbbf59-600f-4309-abd3-e8e4c7731c0b] Start _get_guest_xml network_info=[{"id": "94a78e0e-5cb2-4b37-bce6-f529a646fe3a", "address": "fa:16:3e:4b:5e:3e", "network": {"id": "1c357ee9-ff80-4a4b-9fd5-f2f348b36acc", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1869945166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0518c3ca77e4ecebb6ea8fbf6e60219", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94a78e0e-5c", "ovs_interfaceid": "94a78e0e-5cb2-4b37-bce6-f529a646fe3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T15:35:12Z,direct_url=<?>,disk_format='qcow2',id=1f41819e-c93f-4dc7-b253-37a27bbbbc74,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1b91c5d0672c4224a48df2e1f92688e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T15:35:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'size': 0, 'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'image_id': '1f41819e-c93f-4dc7-b253-37a27bbbbc74'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75176) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 15:42:20 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-800b39ab-a4d7-45a9-914e-0d23f3197a9d tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 15:42:20 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-800b39ab-a4d7-45a9-914e-0d23f3197a9d tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 15:42:20 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-800b39ab-a4d7-45a9-914e-0d23f3197a9d tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75176) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 15:42:20 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-800b39ab-a4d7-45a9-914e-0d23f3197a9d tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] CPU controller missing on host. {{(pid=75176) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 15:42:20 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-800b39ab-a4d7-45a9-914e-0d23f3197a9d tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75176) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 15:42:20 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-800b39ab-a4d7-45a9-914e-0d23f3197a9d tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] CPU controller found on host. {{(pid=75176) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 15:42:20 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-800b39ab-a4d7-45a9-914e-0d23f3197a9d tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75176) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 15:42:20 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-800b39ab-a4d7-45a9-914e-0d23f3197a9d tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T15:35:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T15:35:12Z,direct_url=<?>,disk_format='qcow2',id=1f41819e-c93f-4dc7-b253-37a27bbbbc74,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1b91c5d0672c4224a48df2e1f92688e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T15:35:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 15:42:20 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-800b39ab-a4d7-45a9-914e-0d23f3197a9d tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] Flavor limits 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 15:42:20 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-800b39ab-a4d7-45a9-914e-0d23f3197a9d tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] Image limits 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 15:42:20 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-800b39ab-a4d7-45a9-914e-0d23f3197a9d tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] Flavor pref 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 15:42:20 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-800b39ab-a4d7-45a9-914e-0d23f3197a9d tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] Image pref 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 15:42:20 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-800b39ab-a4d7-45a9-914e-0d23f3197a9d tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 15:42:20 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-800b39ab-a4d7-45a9-914e-0d23f3197a9d tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 15:42:20 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-800b39ab-a4d7-45a9-914e-0d23f3197a9d tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75176) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 15:42:20 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-800b39ab-a4d7-45a9-914e-0d23f3197a9d tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] Got 1 possible topologies {{(pid=75176) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 15:42:20 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-800b39ab-a4d7-45a9-914e-0d23f3197a9d tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 15:42:20 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-800b39ab-a4d7-45a9-914e-0d23f3197a9d tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 15:42:20 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-800b39ab-a4d7-45a9-914e-0d23f3197a9d tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T15:42:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-910110943',display_name='tempest-VolumesAdminNegativeTest-server-910110943',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-910110943',id=14,image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c0518c3ca77e4ecebb6ea8fbf6e60219',ramdisk_id='',reservation_id='r-z8305m5w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1622644648',owner_user_name='tempest-VolumesAdminNegativeTest-1622644648-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T15:42:19Z,user_data=None,user_id='b339a055aaf24d25946cc16369bddc2f',uuid=9dcbbf59-600f-4309-abd3-e8e4c7731c0b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "94a78e0e-5cb2-4b37-bce6-f529a646fe3a", "address": "fa:16:3e:4b:5e:3e", "network": {"id": "1c357ee9-ff80-4a4b-9fd5-f2f348b36acc", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1869945166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0518c3ca77e4ecebb6ea8fbf6e60219", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94a78e0e-5c", "ovs_interfaceid": "94a78e0e-5cb2-4b37-bce6-f529a646fe3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75176) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 15:42:20 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-800b39ab-a4d7-45a9-914e-0d23f3197a9d tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] Converting VIF {"id": "94a78e0e-5cb2-4b37-bce6-f529a646fe3a", "address": "fa:16:3e:4b:5e:3e", "network": {"id": "1c357ee9-ff80-4a4b-9fd5-f2f348b36acc", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1869945166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0518c3ca77e4ecebb6ea8fbf6e60219", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94a78e0e-5c", "ovs_interfaceid": "94a78e0e-5cb2-4b37-bce6-f529a646fe3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:42:20 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-800b39ab-a4d7-45a9-914e-0d23f3197a9d tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4b:5e:3e,bridge_name='br-int',has_traffic_filtering=True,id=94a78e0e-5cb2-4b37-bce6-f529a646fe3a,network=Network(1c357ee9-ff80-4a4b-9fd5-f2f348b36acc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94a78e0e-5c') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:42:20 user nova-compute[75176]: DEBUG nova.objects.instance [None req-800b39ab-a4d7-45a9-914e-0d23f3197a9d tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] Lazy-loading 'pci_devices' on Instance uuid 9dcbbf59-600f-4309-abd3-e8e4c7731c0b {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:42:20 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-800b39ab-a4d7-45a9-914e-0d23f3197a9d tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] [instance: 9dcbbf59-600f-4309-abd3-e8e4c7731c0b] End _get_guest_xml xml=<domain type="kvm">
Nov 28 15:42:20 user nova-compute[75176]:   <uuid>9dcbbf59-600f-4309-abd3-e8e4c7731c0b</uuid>
Nov 28 15:42:20 user nova-compute[75176]:   <name>instance-0000000e</name>
Nov 28 15:42:20 user nova-compute[75176]:   <memory>524288</memory>
Nov 28 15:42:20 user nova-compute[75176]:   <vcpu>1</vcpu>
Nov 28 15:42:20 user nova-compute[75176]:   <metadata>
Nov 28 15:42:20 user nova-compute[75176]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 15:42:20 user nova-compute[75176]:       <nova:package version="0.0.0"/>
Nov 28 15:42:20 user nova-compute[75176]:       <nova:name>tempest-VolumesAdminNegativeTest-server-910110943</nova:name>
Nov 28 15:42:20 user nova-compute[75176]:       <nova:creationTime>2023-11-28 15:42:20</nova:creationTime>
Nov 28 15:42:20 user nova-compute[75176]:       <nova:flavor name="m1.tiny">
Nov 28 15:42:20 user nova-compute[75176]:         <nova:memory>512</nova:memory>
Nov 28 15:42:20 user nova-compute[75176]:         <nova:disk>1</nova:disk>
Nov 28 15:42:20 user nova-compute[75176]:         <nova:swap>0</nova:swap>
Nov 28 15:42:20 user nova-compute[75176]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 15:42:20 user nova-compute[75176]:         <nova:vcpus>1</nova:vcpus>
Nov 28 15:42:20 user nova-compute[75176]:       </nova:flavor>
Nov 28 15:42:20 user nova-compute[75176]:       <nova:owner>
Nov 28 15:42:20 user nova-compute[75176]:         <nova:user uuid="b339a055aaf24d25946cc16369bddc2f">tempest-VolumesAdminNegativeTest-1622644648-project-member</nova:user>
Nov 28 15:42:20 user nova-compute[75176]:         <nova:project uuid="c0518c3ca77e4ecebb6ea8fbf6e60219">tempest-VolumesAdminNegativeTest-1622644648</nova:project>
Nov 28 15:42:20 user nova-compute[75176]:       </nova:owner>
Nov 28 15:42:20 user nova-compute[75176]:       <nova:root type="image" uuid="1f41819e-c93f-4dc7-b253-37a27bbbbc74"/>
Nov 28 15:42:20 user nova-compute[75176]:       <nova:ports>
Nov 28 15:42:20 user nova-compute[75176]:         <nova:port uuid="94a78e0e-5cb2-4b37-bce6-f529a646fe3a">
Nov 28 15:42:20 user nova-compute[75176]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 28 15:42:20 user nova-compute[75176]:         </nova:port>
Nov 28 15:42:20 user nova-compute[75176]:       </nova:ports>
Nov 28 15:42:20 user nova-compute[75176]:     </nova:instance>
Nov 28 15:42:20 user nova-compute[75176]:   </metadata>
Nov 28 15:42:20 user nova-compute[75176]:   <sysinfo type="smbios">
Nov 28 15:42:20 user nova-compute[75176]:     <system>
Nov 28 15:42:20 user nova-compute[75176]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 15:42:20 user nova-compute[75176]:       <entry name="product">OpenStack Nova</entry>
Nov 28 15:42:20 user nova-compute[75176]:       <entry name="version">0.0.0</entry>
Nov 28 15:42:20 user nova-compute[75176]:       <entry name="serial">9dcbbf59-600f-4309-abd3-e8e4c7731c0b</entry>
Nov 28 15:42:20 user nova-compute[75176]:       <entry name="uuid">9dcbbf59-600f-4309-abd3-e8e4c7731c0b</entry>
Nov 28 15:42:20 user nova-compute[75176]:       <entry name="family">Virtual Machine</entry>
Nov 28 15:42:20 user nova-compute[75176]:     </system>
Nov 28 15:42:20 user nova-compute[75176]:   </sysinfo>
Nov 28 15:42:20 user nova-compute[75176]:   <os>
Nov 28 15:42:20 user nova-compute[75176]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 15:42:20 user nova-compute[75176]:     <boot dev="hd"/>
Nov 28 15:42:20 user nova-compute[75176]:     <smbios mode="sysinfo"/>
Nov 28 15:42:20 user nova-compute[75176]:   </os>
Nov 28 15:42:20 user nova-compute[75176]:   <features>
Nov 28 15:42:20 user nova-compute[75176]:     <acpi/>
Nov 28 15:42:20 user nova-compute[75176]:     <apic/>
Nov 28 15:42:20 user nova-compute[75176]:     <vmcoreinfo/>
Nov 28 15:42:20 user nova-compute[75176]:   </features>
Nov 28 15:42:20 user nova-compute[75176]:   <clock offset="utc">
Nov 28 15:42:20 user nova-compute[75176]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 15:42:20 user nova-compute[75176]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 15:42:20 user nova-compute[75176]:     <timer name="hpet" present="no"/>
Nov 28 15:42:20 user nova-compute[75176]:   </clock>
Nov 28 15:42:20 user nova-compute[75176]:   <cpu mode="custom" match="exact">
Nov 28 15:42:20 user nova-compute[75176]:     <model>Nehalem</model>
Nov 28 15:42:20 user nova-compute[75176]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 15:42:20 user nova-compute[75176]:   </cpu>
Nov 28 15:42:20 user nova-compute[75176]:   <devices>
Nov 28 15:42:20 user nova-compute[75176]:     <disk type="file" device="disk">
Nov 28 15:42:20 user nova-compute[75176]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 15:42:20 user nova-compute[75176]:       <source file="/opt/stack/data/nova/instances/9dcbbf59-600f-4309-abd3-e8e4c7731c0b/disk"/>
Nov 28 15:42:20 user nova-compute[75176]:       <target dev="vda" bus="virtio"/>
Nov 28 15:42:20 user nova-compute[75176]:     </disk>
Nov 28 15:42:20 user nova-compute[75176]:     <interface type="ethernet">
Nov 28 15:42:20 user nova-compute[75176]:       <mac address="fa:16:3e:4b:5e:3e"/>
Nov 28 15:42:20 user nova-compute[75176]:       <model type="virtio"/>
Nov 28 15:42:20 user nova-compute[75176]:       <mtu size="1442"/>
Nov 28 15:42:20 user nova-compute[75176]:       <target dev="tap94a78e0e-5c"/>
Nov 28 15:42:20 user nova-compute[75176]:     </interface>
Nov 28 15:42:20 user nova-compute[75176]:     <serial type="pty">
Nov 28 15:42:20 user nova-compute[75176]:       <log file="/opt/stack/data/nova/instances/9dcbbf59-600f-4309-abd3-e8e4c7731c0b/console.log" append="off"/>
Nov 28 15:42:20 user nova-compute[75176]:     </serial>
Nov 28 15:42:20 user nova-compute[75176]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 15:42:20 user nova-compute[75176]:     <video>
Nov 28 15:42:20 user nova-compute[75176]:       <model type="virtio"/>
Nov 28 15:42:20 user nova-compute[75176]:     </video>
Nov 28 15:42:20 user nova-compute[75176]:     <rng model="virtio">
Nov 28 15:42:20 user nova-compute[75176]:       <backend model="random">/dev/urandom</backend>
Nov 28 15:42:20 user nova-compute[75176]:     </rng>
Nov 28 15:42:20 user nova-compute[75176]:     <controller type="usb" index="0" model="none"/>
Nov 28 15:42:20 user nova-compute[75176]:     <memballoon model="virtio">
Nov 28 15:42:20 user nova-compute[75176]:       <stats period="10"/>
Nov 28 15:42:20 user nova-compute[75176]:     </memballoon>
Nov 28 15:42:20 user nova-compute[75176]:   </devices>
Nov 28 15:42:20 user nova-compute[75176]: </domain>
Nov 28 15:42:20 user nova-compute[75176]:  {{(pid=75176) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 15:42:20 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-800b39ab-a4d7-45a9-914e-0d23f3197a9d tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T15:42:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-910110943',display_name='tempest-VolumesAdminNegativeTest-server-910110943',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-910110943',id=14,image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c0518c3ca77e4ecebb6ea8fbf6e60219',ramdisk_id='',reservation_id='r-z8305m5w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1622644648',owner_user_name='tempest-VolumesAdminNegativeTest-1622644648-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T15:42:19Z,user_data=None,user_id='b339a055aaf24d25946cc16369bddc2f',uuid=9dcbbf59-600f-4309-abd3-e8e4c7731c0b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "94a78e0e-5cb2-4b37-bce6-f529a646fe3a", "address": "fa:16:3e:4b:5e:3e", "network": {"id": "1c357ee9-ff80-4a4b-9fd5-f2f348b36acc", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1869945166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0518c3ca77e4ecebb6ea8fbf6e60219", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94a78e0e-5c", "ovs_interfaceid": "94a78e0e-5cb2-4b37-bce6-f529a646fe3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 15:42:20 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-800b39ab-a4d7-45a9-914e-0d23f3197a9d tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] Converting VIF {"id": "94a78e0e-5cb2-4b37-bce6-f529a646fe3a", "address": "fa:16:3e:4b:5e:3e", "network": {"id": "1c357ee9-ff80-4a4b-9fd5-f2f348b36acc", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1869945166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0518c3ca77e4ecebb6ea8fbf6e60219", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94a78e0e-5c", "ovs_interfaceid": "94a78e0e-5cb2-4b37-bce6-f529a646fe3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:42:20 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-800b39ab-a4d7-45a9-914e-0d23f3197a9d tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4b:5e:3e,bridge_name='br-int',has_traffic_filtering=True,id=94a78e0e-5cb2-4b37-bce6-f529a646fe3a,network=Network(1c357ee9-ff80-4a4b-9fd5-f2f348b36acc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94a78e0e-5c') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:42:20 user nova-compute[75176]: DEBUG os_vif [None req-800b39ab-a4d7-45a9-914e-0d23f3197a9d tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:5e:3e,bridge_name='br-int',has_traffic_filtering=True,id=94a78e0e-5cb2-4b37-bce6-f529a646fe3a,network=Network(1c357ee9-ff80-4a4b-9fd5-f2f348b36acc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94a78e0e-5c') {{(pid=75176) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 15:42:20 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:42:20 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:42:20 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 15:42:20 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:42:20 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4814b484-eca3-58e1-935a-434b7573c726', '_type': 'linux-noop'}}, row=False) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:42:20 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:42:20 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:42:20 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:42:20 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap94a78e0e-5c, may_exist=True, interface_attrs={}) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:42:20 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap94a78e0e-5c, col_values=(('qos', UUID('5e2c0d36-cb9d-482e-b991-da9ef6a41d61')),), if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:42:20 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap94a78e0e-5c, col_values=(('external_ids', {'iface-id': '94a78e0e-5cb2-4b37-bce6-f529a646fe3a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4b:5e:3e', 'vm-uuid': '9dcbbf59-600f-4309-abd3-e8e4c7731c0b'}),), if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:42:20 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:42:20 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:42:20 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:42:20 user nova-compute[75176]: INFO os_vif [None req-800b39ab-a4d7-45a9-914e-0d23f3197a9d tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:5e:3e,bridge_name='br-int',has_traffic_filtering=True,id=94a78e0e-5cb2-4b37-bce6-f529a646fe3a,network=Network(1c357ee9-ff80-4a4b-9fd5-f2f348b36acc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94a78e0e-5c')
Nov 28 15:42:20 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-800b39ab-a4d7-45a9-914e-0d23f3197a9d tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] No BDM found with device name vda, not building metadata. {{(pid=75176) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 15:42:20 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-800b39ab-a4d7-45a9-914e-0d23f3197a9d tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] No VIF found with MAC fa:16:3e:4b:5e:3e, not building metadata {{(pid=75176) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 15:42:20 user nova-compute[75176]: DEBUG nova.network.neutron [req-310ad897-176b-4fd5-8b77-657c8a19975b req-5091b9f6-96cb-45fe-af2e-cd3b930a0e62 service nova] [instance: 9dcbbf59-600f-4309-abd3-e8e4c7731c0b] Updated VIF entry in instance network info cache for port 94a78e0e-5cb2-4b37-bce6-f529a646fe3a. {{(pid=75176) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 15:42:20 user nova-compute[75176]: DEBUG nova.network.neutron [req-310ad897-176b-4fd5-8b77-657c8a19975b req-5091b9f6-96cb-45fe-af2e-cd3b930a0e62 service nova] [instance: 9dcbbf59-600f-4309-abd3-e8e4c7731c0b] Updating instance_info_cache with network_info: [{"id": "94a78e0e-5cb2-4b37-bce6-f529a646fe3a", "address": "fa:16:3e:4b:5e:3e", "network": {"id": "1c357ee9-ff80-4a4b-9fd5-f2f348b36acc", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1869945166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0518c3ca77e4ecebb6ea8fbf6e60219", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94a78e0e-5c", "ovs_interfaceid": "94a78e0e-5cb2-4b37-bce6-f529a646fe3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:42:20 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-310ad897-176b-4fd5-8b77-657c8a19975b req-5091b9f6-96cb-45fe-af2e-cd3b930a0e62 service nova] Releasing lock "refresh_cache-9dcbbf59-600f-4309-abd3-e8e4c7731c0b" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:42:21 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:42:21 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:42:21 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:42:22 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:42:22 user nova-compute[75176]: DEBUG nova.compute.manager [req-2e5f1079-62cb-4017-b2e3-1583a4406812 req-7b93919c-b22b-4012-8877-4c5d7dcb9e0e service nova] [instance: 9dcbbf59-600f-4309-abd3-e8e4c7731c0b] Received event network-vif-plugged-94a78e0e-5cb2-4b37-bce6-f529a646fe3a {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:42:22 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-2e5f1079-62cb-4017-b2e3-1583a4406812 req-7b93919c-b22b-4012-8877-4c5d7dcb9e0e service nova] Acquiring lock "9dcbbf59-600f-4309-abd3-e8e4c7731c0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:42:22 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-2e5f1079-62cb-4017-b2e3-1583a4406812 req-7b93919c-b22b-4012-8877-4c5d7dcb9e0e service nova] Lock "9dcbbf59-600f-4309-abd3-e8e4c7731c0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:42:22 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-2e5f1079-62cb-4017-b2e3-1583a4406812 req-7b93919c-b22b-4012-8877-4c5d7dcb9e0e service nova] Lock "9dcbbf59-600f-4309-abd3-e8e4c7731c0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:42:22 user nova-compute[75176]: DEBUG nova.compute.manager [req-2e5f1079-62cb-4017-b2e3-1583a4406812 req-7b93919c-b22b-4012-8877-4c5d7dcb9e0e service nova] [instance: 9dcbbf59-600f-4309-abd3-e8e4c7731c0b] No waiting events found dispatching network-vif-plugged-94a78e0e-5cb2-4b37-bce6-f529a646fe3a {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:42:22 user nova-compute[75176]: WARNING nova.compute.manager [req-2e5f1079-62cb-4017-b2e3-1583a4406812 req-7b93919c-b22b-4012-8877-4c5d7dcb9e0e service nova] [instance: 9dcbbf59-600f-4309-abd3-e8e4c7731c0b] Received unexpected event network-vif-plugged-94a78e0e-5cb2-4b37-bce6-f529a646fe3a for instance with vm_state building and task_state spawning.
Nov 28 15:42:23 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:42:24 user nova-compute[75176]: DEBUG nova.compute.manager [None req-800b39ab-a4d7-45a9-914e-0d23f3197a9d tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] [instance: 9dcbbf59-600f-4309-abd3-e8e4c7731c0b] Instance event wait completed in 0 seconds for  {{(pid=75176) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 15:42:24 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-800b39ab-a4d7-45a9-914e-0d23f3197a9d tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] [instance: 9dcbbf59-600f-4309-abd3-e8e4c7731c0b] Guest created on hypervisor {{(pid=75176) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 15:42:24 user nova-compute[75176]: INFO nova.virt.libvirt.driver [-] [instance: 9dcbbf59-600f-4309-abd3-e8e4c7731c0b] Instance spawned successfully.
Nov 28 15:42:24 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-800b39ab-a4d7-45a9-914e-0d23f3197a9d tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] [instance: 9dcbbf59-600f-4309-abd3-e8e4c7731c0b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 15:42:24 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-800b39ab-a4d7-45a9-914e-0d23f3197a9d tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] [instance: 9dcbbf59-600f-4309-abd3-e8e4c7731c0b] Found default for hw_cdrom_bus of ide {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:42:24 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-800b39ab-a4d7-45a9-914e-0d23f3197a9d tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] [instance: 9dcbbf59-600f-4309-abd3-e8e4c7731c0b] Found default for hw_disk_bus of virtio {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:42:24 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-800b39ab-a4d7-45a9-914e-0d23f3197a9d tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] [instance: 9dcbbf59-600f-4309-abd3-e8e4c7731c0b] Found default for hw_input_bus of None {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:42:24 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-800b39ab-a4d7-45a9-914e-0d23f3197a9d tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] [instance: 9dcbbf59-600f-4309-abd3-e8e4c7731c0b] Found default for hw_pointer_model of None {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:42:24 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-800b39ab-a4d7-45a9-914e-0d23f3197a9d tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] [instance: 9dcbbf59-600f-4309-abd3-e8e4c7731c0b] Found default for hw_video_model of virtio {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:42:24 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-800b39ab-a4d7-45a9-914e-0d23f3197a9d tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] [instance: 9dcbbf59-600f-4309-abd3-e8e4c7731c0b] Found default for hw_vif_model of virtio {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:42:24 user nova-compute[75176]: INFO nova.compute.manager [None req-800b39ab-a4d7-45a9-914e-0d23f3197a9d tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] [instance: 9dcbbf59-600f-4309-abd3-e8e4c7731c0b] Took 5.29 seconds to spawn the instance on the hypervisor.
Nov 28 15:42:24 user nova-compute[75176]: DEBUG nova.compute.manager [None req-800b39ab-a4d7-45a9-914e-0d23f3197a9d tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] [instance: 9dcbbf59-600f-4309-abd3-e8e4c7731c0b] Checking state {{(pid=75176) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 15:42:24 user nova-compute[75176]: INFO nova.compute.manager [None req-800b39ab-a4d7-45a9-914e-0d23f3197a9d tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] [instance: 9dcbbf59-600f-4309-abd3-e8e4c7731c0b] Took 6.30 seconds to build instance.
Nov 28 15:42:24 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-800b39ab-a4d7-45a9-914e-0d23f3197a9d tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] Lock "9dcbbf59-600f-4309-abd3-e8e4c7731c0b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.392s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:42:24 user nova-compute[75176]: DEBUG nova.compute.manager [req-258b7e02-8d90-4dee-b756-dbad57074dac req-fadb3b5f-b447-4cda-b728-96dc23eeefa0 service nova] [instance: 9dcbbf59-600f-4309-abd3-e8e4c7731c0b] Received event network-vif-plugged-94a78e0e-5cb2-4b37-bce6-f529a646fe3a {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:42:24 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-258b7e02-8d90-4dee-b756-dbad57074dac req-fadb3b5f-b447-4cda-b728-96dc23eeefa0 service nova] Acquiring lock "9dcbbf59-600f-4309-abd3-e8e4c7731c0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:42:24 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-258b7e02-8d90-4dee-b756-dbad57074dac req-fadb3b5f-b447-4cda-b728-96dc23eeefa0 service nova] Lock "9dcbbf59-600f-4309-abd3-e8e4c7731c0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:42:24 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-258b7e02-8d90-4dee-b756-dbad57074dac req-fadb3b5f-b447-4cda-b728-96dc23eeefa0 service nova] Lock "9dcbbf59-600f-4309-abd3-e8e4c7731c0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:42:24 user nova-compute[75176]: DEBUG nova.compute.manager [req-258b7e02-8d90-4dee-b756-dbad57074dac req-fadb3b5f-b447-4cda-b728-96dc23eeefa0 service nova] [instance: 9dcbbf59-600f-4309-abd3-e8e4c7731c0b] No waiting events found dispatching network-vif-plugged-94a78e0e-5cb2-4b37-bce6-f529a646fe3a {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:42:24 user nova-compute[75176]: WARNING nova.compute.manager [req-258b7e02-8d90-4dee-b756-dbad57074dac req-fadb3b5f-b447-4cda-b728-96dc23eeefa0 service nova] [instance: 9dcbbf59-600f-4309-abd3-e8e4c7731c0b] Received unexpected event network-vif-plugged-94a78e0e-5cb2-4b37-bce6-f529a646fe3a for instance with vm_state active and task_state None.
Nov 28 15:42:25 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:42:28 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:42:30 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:42:33 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:42:34 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-fda490e8-bafb-4361-b61e-9ed805496167 tempest-VolumesAssistedSnapshotsTest-1417905593 tempest-VolumesAssistedSnapshotsTest-1417905593-project-member] Acquiring lock "1d99de1a-8a82-447a-8a18-02e4efd3b3f0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:42:34 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-fda490e8-bafb-4361-b61e-9ed805496167 tempest-VolumesAssistedSnapshotsTest-1417905593 tempest-VolumesAssistedSnapshotsTest-1417905593-project-member] Lock "1d99de1a-8a82-447a-8a18-02e4efd3b3f0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:42:34 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-fda490e8-bafb-4361-b61e-9ed805496167 tempest-VolumesAssistedSnapshotsTest-1417905593 tempest-VolumesAssistedSnapshotsTest-1417905593-project-member] Acquiring lock "1d99de1a-8a82-447a-8a18-02e4efd3b3f0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:42:34 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-fda490e8-bafb-4361-b61e-9ed805496167 tempest-VolumesAssistedSnapshotsTest-1417905593 tempest-VolumesAssistedSnapshotsTest-1417905593-project-member] Lock "1d99de1a-8a82-447a-8a18-02e4efd3b3f0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:42:34 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-fda490e8-bafb-4361-b61e-9ed805496167 tempest-VolumesAssistedSnapshotsTest-1417905593 tempest-VolumesAssistedSnapshotsTest-1417905593-project-member] Lock "1d99de1a-8a82-447a-8a18-02e4efd3b3f0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:42:34 user nova-compute[75176]: INFO nova.compute.manager [None req-fda490e8-bafb-4361-b61e-9ed805496167 tempest-VolumesAssistedSnapshotsTest-1417905593 tempest-VolumesAssistedSnapshotsTest-1417905593-project-member] [instance: 1d99de1a-8a82-447a-8a18-02e4efd3b3f0] Terminating instance
Nov 28 15:42:34 user nova-compute[75176]: DEBUG nova.compute.manager [None req-fda490e8-bafb-4361-b61e-9ed805496167 tempest-VolumesAssistedSnapshotsTest-1417905593 tempest-VolumesAssistedSnapshotsTest-1417905593-project-member] [instance: 1d99de1a-8a82-447a-8a18-02e4efd3b3f0] Start destroying the instance on the hypervisor. {{(pid=75176) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 15:42:34 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:42:34 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:42:34 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:42:34 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:42:34 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:42:34 user nova-compute[75176]: DEBUG nova.compute.manager [req-10a2f4ad-ee3c-46f9-9aa3-ac7f1d307977 req-49bbfba9-cff2-43bc-96ee-9486ca83ebd6 service nova] [instance: 1d99de1a-8a82-447a-8a18-02e4efd3b3f0] Received event network-vif-unplugged-ab316a13-f7fd-49e0-b6f7-6aa0cc815eca {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:42:34 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-10a2f4ad-ee3c-46f9-9aa3-ac7f1d307977 req-49bbfba9-cff2-43bc-96ee-9486ca83ebd6 service nova] Acquiring lock "1d99de1a-8a82-447a-8a18-02e4efd3b3f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:42:34 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-10a2f4ad-ee3c-46f9-9aa3-ac7f1d307977 req-49bbfba9-cff2-43bc-96ee-9486ca83ebd6 service nova] Lock "1d99de1a-8a82-447a-8a18-02e4efd3b3f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:42:34 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-10a2f4ad-ee3c-46f9-9aa3-ac7f1d307977 req-49bbfba9-cff2-43bc-96ee-9486ca83ebd6 service nova] Lock "1d99de1a-8a82-447a-8a18-02e4efd3b3f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:42:34 user nova-compute[75176]: DEBUG nova.compute.manager [req-10a2f4ad-ee3c-46f9-9aa3-ac7f1d307977 req-49bbfba9-cff2-43bc-96ee-9486ca83ebd6 service nova] [instance: 1d99de1a-8a82-447a-8a18-02e4efd3b3f0] No waiting events found dispatching network-vif-unplugged-ab316a13-f7fd-49e0-b6f7-6aa0cc815eca {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:42:34 user nova-compute[75176]: DEBUG nova.compute.manager [req-10a2f4ad-ee3c-46f9-9aa3-ac7f1d307977 req-49bbfba9-cff2-43bc-96ee-9486ca83ebd6 service nova] [instance: 1d99de1a-8a82-447a-8a18-02e4efd3b3f0] Received event network-vif-unplugged-ab316a13-f7fd-49e0-b6f7-6aa0cc815eca for instance with task_state deleting. {{(pid=75176) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 15:42:35 user nova-compute[75176]: INFO nova.virt.libvirt.driver [-] [instance: 1d99de1a-8a82-447a-8a18-02e4efd3b3f0] Instance destroyed successfully.
Nov 28 15:42:35 user nova-compute[75176]: DEBUG nova.objects.instance [None req-fda490e8-bafb-4361-b61e-9ed805496167 tempest-VolumesAssistedSnapshotsTest-1417905593 tempest-VolumesAssistedSnapshotsTest-1417905593-project-member] Lazy-loading 'resources' on Instance uuid 1d99de1a-8a82-447a-8a18-02e4efd3b3f0 {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:42:35 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-fda490e8-bafb-4361-b61e-9ed805496167 tempest-VolumesAssistedSnapshotsTest-1417905593 tempest-VolumesAssistedSnapshotsTest-1417905593-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T15:39:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-484194504',display_name='tempest-VolumesAssistedSnapshotsTest-server-484194504',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-484194504',id=9,image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKSgNC2asewx9LWdHcNWDjDRgjOEoSzsRsPdym6E1KUX7KI2Mg71iiy7r7btFMnUGrgjrsBQFw1yD0lNQ4aiC6raZoTaHTViIsAB48vZ/BZOsTR94ZtKL6s2v9Tv3vjnrA==',key_name='tempest-keypair-1335730655',keypairs=<?>,launch_index=0,launched_at=2023-11-28T15:39:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='73137f167a804cddbf7f345f75763c71',ramdisk_id='',reservation_id='r-c72fuk8h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1417905593',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1417905593-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T15:39:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a886368ab6a548c697650bd7690dd009',uuid=1d99de1a-8a82-447a-8a18-02e4efd3b3f0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ab316a13-f7fd-49e0-b6f7-6aa0cc815eca", "address": "fa:16:3e:3c:27:99", "network": {"id": "0ef0c5c2-0325-4d50-8eb3-e72b53c4750c", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-311328630-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73137f167a804cddbf7f345f75763c71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab316a13-f7", "ovs_interfaceid": "ab316a13-f7fd-49e0-b6f7-6aa0cc815eca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 15:42:35 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-fda490e8-bafb-4361-b61e-9ed805496167 tempest-VolumesAssistedSnapshotsTest-1417905593 tempest-VolumesAssistedSnapshotsTest-1417905593-project-member] Converting VIF {"id": "ab316a13-f7fd-49e0-b6f7-6aa0cc815eca", "address": "fa:16:3e:3c:27:99", "network": {"id": "0ef0c5c2-0325-4d50-8eb3-e72b53c4750c", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-311328630-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73137f167a804cddbf7f345f75763c71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab316a13-f7", "ovs_interfaceid": "ab316a13-f7fd-49e0-b6f7-6aa0cc815eca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:42:35 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-fda490e8-bafb-4361-b61e-9ed805496167 tempest-VolumesAssistedSnapshotsTest-1417905593 tempest-VolumesAssistedSnapshotsTest-1417905593-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3c:27:99,bridge_name='br-int',has_traffic_filtering=True,id=ab316a13-f7fd-49e0-b6f7-6aa0cc815eca,network=Network(0ef0c5c2-0325-4d50-8eb3-e72b53c4750c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab316a13-f7') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:42:35 user nova-compute[75176]: DEBUG os_vif [None req-fda490e8-bafb-4361-b61e-9ed805496167 tempest-VolumesAssistedSnapshotsTest-1417905593 tempest-VolumesAssistedSnapshotsTest-1417905593-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3c:27:99,bridge_name='br-int',has_traffic_filtering=True,id=ab316a13-f7fd-49e0-b6f7-6aa0cc815eca,network=Network(0ef0c5c2-0325-4d50-8eb3-e72b53c4750c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab316a13-f7') {{(pid=75176) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 15:42:35 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:42:35 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapab316a13-f7, bridge=br-int, if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:42:35 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:42:35 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:42:35 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:42:35 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=882b293d-a9a0-46f9-ae81-b3b950cfbe8f) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:42:35 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:42:35 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:42:35 user nova-compute[75176]: INFO os_vif [None req-fda490e8-bafb-4361-b61e-9ed805496167 tempest-VolumesAssistedSnapshotsTest-1417905593 tempest-VolumesAssistedSnapshotsTest-1417905593-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3c:27:99,bridge_name='br-int',has_traffic_filtering=True,id=ab316a13-f7fd-49e0-b6f7-6aa0cc815eca,network=Network(0ef0c5c2-0325-4d50-8eb3-e72b53c4750c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab316a13-f7')
Nov 28 15:42:35 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-fda490e8-bafb-4361-b61e-9ed805496167 tempest-VolumesAssistedSnapshotsTest-1417905593 tempest-VolumesAssistedSnapshotsTest-1417905593-project-member] [instance: 1d99de1a-8a82-447a-8a18-02e4efd3b3f0] Deleting instance files /opt/stack/data/nova/instances/1d99de1a-8a82-447a-8a18-02e4efd3b3f0_del
Nov 28 15:42:35 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-fda490e8-bafb-4361-b61e-9ed805496167 tempest-VolumesAssistedSnapshotsTest-1417905593 tempest-VolumesAssistedSnapshotsTest-1417905593-project-member] [instance: 1d99de1a-8a82-447a-8a18-02e4efd3b3f0] Deletion of /opt/stack/data/nova/instances/1d99de1a-8a82-447a-8a18-02e4efd3b3f0_del complete
Nov 28 15:42:35 user nova-compute[75176]: INFO nova.compute.manager [None req-fda490e8-bafb-4361-b61e-9ed805496167 tempest-VolumesAssistedSnapshotsTest-1417905593 tempest-VolumesAssistedSnapshotsTest-1417905593-project-member] [instance: 1d99de1a-8a82-447a-8a18-02e4efd3b3f0] Took 0.94 seconds to destroy the instance on the hypervisor.
Nov 28 15:42:35 user nova-compute[75176]: DEBUG oslo.service.loopingcall [None req-fda490e8-bafb-4361-b61e-9ed805496167 tempest-VolumesAssistedSnapshotsTest-1417905593 tempest-VolumesAssistedSnapshotsTest-1417905593-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75176) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 15:42:35 user nova-compute[75176]: DEBUG nova.compute.manager [-] [instance: 1d99de1a-8a82-447a-8a18-02e4efd3b3f0] Deallocating network for instance {{(pid=75176) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 15:42:35 user nova-compute[75176]: DEBUG nova.network.neutron [-] [instance: 1d99de1a-8a82-447a-8a18-02e4efd3b3f0] deallocate_for_instance() {{(pid=75176) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 15:42:36 user nova-compute[75176]: DEBUG nova.network.neutron [-] [instance: 1d99de1a-8a82-447a-8a18-02e4efd3b3f0] Updating instance_info_cache with network_info: [] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:42:36 user nova-compute[75176]: INFO nova.compute.manager [-] [instance: 1d99de1a-8a82-447a-8a18-02e4efd3b3f0] Took 1.07 seconds to deallocate network for instance.
Nov 28 15:42:36 user nova-compute[75176]: DEBUG nova.compute.manager [req-a8f99286-a475-46b7-bb32-2b41ae59f431 req-71c0b131-df4e-4ed4-81ab-422edbb47291 service nova] [instance: 1d99de1a-8a82-447a-8a18-02e4efd3b3f0] Received event network-vif-deleted-ab316a13-f7fd-49e0-b6f7-6aa0cc815eca {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:42:36 user nova-compute[75176]: INFO nova.compute.manager [req-a8f99286-a475-46b7-bb32-2b41ae59f431 req-71c0b131-df4e-4ed4-81ab-422edbb47291 service nova] [instance: 1d99de1a-8a82-447a-8a18-02e4efd3b3f0] Neutron deleted interface ab316a13-f7fd-49e0-b6f7-6aa0cc815eca; detaching it from the instance and deleting it from the info cache
Nov 28 15:42:36 user nova-compute[75176]: DEBUG nova.network.neutron [req-a8f99286-a475-46b7-bb32-2b41ae59f431 req-71c0b131-df4e-4ed4-81ab-422edbb47291 service nova] [instance: 1d99de1a-8a82-447a-8a18-02e4efd3b3f0] Updating instance_info_cache with network_info: [] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:42:36 user nova-compute[75176]: DEBUG nova.compute.manager [req-a8f99286-a475-46b7-bb32-2b41ae59f431 req-71c0b131-df4e-4ed4-81ab-422edbb47291 service nova] [instance: 1d99de1a-8a82-447a-8a18-02e4efd3b3f0] Detach interface failed, port_id=ab316a13-f7fd-49e0-b6f7-6aa0cc815eca, reason: Instance 1d99de1a-8a82-447a-8a18-02e4efd3b3f0 could not be found. {{(pid=75176) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 28 15:42:36 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-fda490e8-bafb-4361-b61e-9ed805496167 tempest-VolumesAssistedSnapshotsTest-1417905593 tempest-VolumesAssistedSnapshotsTest-1417905593-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:42:36 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-fda490e8-bafb-4361-b61e-9ed805496167 tempest-VolumesAssistedSnapshotsTest-1417905593 tempest-VolumesAssistedSnapshotsTest-1417905593-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:42:36 user nova-compute[75176]: DEBUG nova.compute.manager [req-75f0e06a-a4eb-4c1e-b698-86f270d63462 req-ee8177b9-df91-4221-a230-0522ef5c615c service nova] [instance: 1d99de1a-8a82-447a-8a18-02e4efd3b3f0] Received event network-vif-plugged-ab316a13-f7fd-49e0-b6f7-6aa0cc815eca {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:42:36 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-75f0e06a-a4eb-4c1e-b698-86f270d63462 req-ee8177b9-df91-4221-a230-0522ef5c615c service nova] Acquiring lock "1d99de1a-8a82-447a-8a18-02e4efd3b3f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:42:36 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-75f0e06a-a4eb-4c1e-b698-86f270d63462 req-ee8177b9-df91-4221-a230-0522ef5c615c service nova] Lock "1d99de1a-8a82-447a-8a18-02e4efd3b3f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:42:36 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-75f0e06a-a4eb-4c1e-b698-86f270d63462 req-ee8177b9-df91-4221-a230-0522ef5c615c service nova] Lock "1d99de1a-8a82-447a-8a18-02e4efd3b3f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:42:36 user nova-compute[75176]: DEBUG nova.compute.manager [req-75f0e06a-a4eb-4c1e-b698-86f270d63462 req-ee8177b9-df91-4221-a230-0522ef5c615c service nova] [instance: 1d99de1a-8a82-447a-8a18-02e4efd3b3f0] No waiting events found dispatching network-vif-plugged-ab316a13-f7fd-49e0-b6f7-6aa0cc815eca {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:42:36 user nova-compute[75176]: WARNING nova.compute.manager [req-75f0e06a-a4eb-4c1e-b698-86f270d63462 req-ee8177b9-df91-4221-a230-0522ef5c615c service nova] [instance: 1d99de1a-8a82-447a-8a18-02e4efd3b3f0] Received unexpected event network-vif-plugged-ab316a13-f7fd-49e0-b6f7-6aa0cc815eca for instance with vm_state deleted and task_state None.
Nov 28 15:42:36 user nova-compute[75176]: DEBUG nova.compute.provider_tree [None req-fda490e8-bafb-4361-b61e-9ed805496167 tempest-VolumesAssistedSnapshotsTest-1417905593 tempest-VolumesAssistedSnapshotsTest-1417905593-project-member] Inventory has not changed in ProviderTree for provider: b37848d8-f401-4155-a029-b0ffa09ff85b {{(pid=75176) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 15:42:36 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-fda490e8-bafb-4361-b61e-9ed805496167 tempest-VolumesAssistedSnapshotsTest-1417905593 tempest-VolumesAssistedSnapshotsTest-1417905593-project-member] Inventory has not changed for provider b37848d8-f401-4155-a029-b0ffa09ff85b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75176) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 15:42:36 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-fda490e8-bafb-4361-b61e-9ed805496167 tempest-VolumesAssistedSnapshotsTest-1417905593 tempest-VolumesAssistedSnapshotsTest-1417905593-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.565s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:42:36 user nova-compute[75176]: INFO nova.scheduler.client.report [None req-fda490e8-bafb-4361-b61e-9ed805496167 tempest-VolumesAssistedSnapshotsTest-1417905593 tempest-VolumesAssistedSnapshotsTest-1417905593-project-member] Deleted allocations for instance 1d99de1a-8a82-447a-8a18-02e4efd3b3f0
Nov 28 15:42:37 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-fda490e8-bafb-4361-b61e-9ed805496167 tempest-VolumesAssistedSnapshotsTest-1417905593 tempest-VolumesAssistedSnapshotsTest-1417905593-project-member] Lock "1d99de1a-8a82-447a-8a18-02e4efd3b3f0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.800s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:42:38 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:42:40 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:42:43 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:42:45 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-473e5f48-b5a6-4c2f-9ea4-5c4ef7a68cbd tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] Acquiring lock "6ab0619f-72e5-4975-ade8-53d7c0784d89" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:42:45 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-473e5f48-b5a6-4c2f-9ea4-5c4ef7a68cbd tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] Lock "6ab0619f-72e5-4975-ade8-53d7c0784d89" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:42:45 user nova-compute[75176]: DEBUG nova.objects.instance [None req-473e5f48-b5a6-4c2f-9ea4-5c4ef7a68cbd tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] Lazy-loading 'flavor' on Instance uuid 6ab0619f-72e5-4975-ade8-53d7c0784d89 {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:42:45 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:42:45 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-473e5f48-b5a6-4c2f-9ea4-5c4ef7a68cbd tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] Lock "6ab0619f-72e5-4975-ade8-53d7c0784d89" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.086s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:42:45 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-473e5f48-b5a6-4c2f-9ea4-5c4ef7a68cbd tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] Acquiring lock "6ab0619f-72e5-4975-ade8-53d7c0784d89" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:42:45 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-473e5f48-b5a6-4c2f-9ea4-5c4ef7a68cbd tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] Lock "6ab0619f-72e5-4975-ade8-53d7c0784d89" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:42:45 user nova-compute[75176]: INFO nova.compute.manager [None req-473e5f48-b5a6-4c2f-9ea4-5c4ef7a68cbd tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] [instance: 6ab0619f-72e5-4975-ade8-53d7c0784d89] Attaching volume 2bb22dca-8491-42ef-815f-7b0c0ca4be5a to /dev/vdb
Nov 28 15:42:45 user nova-compute[75176]: DEBUG os_brick.utils [None req-473e5f48-b5a6-4c2f-9ea4-5c4ef7a68cbd tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 15:42:45 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:42:45 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:42:45 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[92244657-13c6-4c8b-a268-09cd88f0d49b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:edc924a949b2\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:42:45 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:42:45 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:42:45 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6fd26b5-02cc-4d7a-89af-db7ef45168b4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:42:45 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:42:45 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:42:45 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[9508e5e1-b532-4035-828f-0decbc9a9d5c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:42:45 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d22f5ef-84bb-473d-9820-b19b70867a0f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:42:45 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-473e5f48-b5a6-4c2f-9ea4-5c4ef7a68cbd tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] Running cmd (subprocess): nvme version {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:42:45 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-473e5f48-b5a6-4c2f-9ea4-5c4ef7a68cbd tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] 'nvme version' failed. Not Retrying. {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 15:42:45 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.nvmeof [None req-473e5f48-b5a6-4c2f-9ea4-5c4ef7a68cbd tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] nvme not present on system {{(pid=75176) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 15:42:45 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:42:45 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 15:42:45 user nova-compute[75176]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 15:42:45 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[1969406f-4ffa-4b5b-80d9-efe6b3826074]: (4, '') {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:42:45 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.lightos [None req-473e5f48-b5a6-4c2f-9ea4-5c4ef7a68cbd tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75176) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 15:42:45 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.lightos [None req-473e5f48-b5a6-4c2f-9ea4-5c4ef7a68cbd tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75176) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 15:42:45 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.lightos [None req-473e5f48-b5a6-4c2f-9ea4-5c4ef7a68cbd tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] LIGHTOS: no hostnqn found. {{(pid=75176) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 15:42:45 user nova-compute[75176]: DEBUG os_brick.utils [None req-473e5f48-b5a6-4c2f-9ea4-5c4ef7a68cbd tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] <== get_connector_properties: return (144ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:edc924a949b2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 15:42:45 user nova-compute[75176]: DEBUG nova.virt.block_device [None req-473e5f48-b5a6-4c2f-9ea4-5c4ef7a68cbd tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] [instance: 6ab0619f-72e5-4975-ade8-53d7c0784d89] Updating existing volume attachment record: 5c218884-b9da-4fa6-9dc4-8837bb23d335 {{(pid=75176) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 15:42:45 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:42:47 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:42:47 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:42:48 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:42:48 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:42:48 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75176) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 15:42:48 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:42:48 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:42:48 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:42:48 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:42:48 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Auditing locally available compute resources for user (node: user) {{(pid=75176) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 15:42:48 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-b92abc4f-9174-4153-84d3-9ae5c64ca0f0 tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Acquiring lock "aa223c49-d254-4727-8a01-873026847b37" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:42:48 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-b92abc4f-9174-4153-84d3-9ae5c64ca0f0 tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Lock "aa223c49-d254-4727-8a01-873026847b37" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:42:48 user nova-compute[75176]: DEBUG nova.objects.instance [None req-b92abc4f-9174-4153-84d3-9ae5c64ca0f0 tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Lazy-loading 'flavor' on Instance uuid aa223c49-d254-4727-8a01-873026847b37 {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:42:48 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-b92abc4f-9174-4153-84d3-9ae5c64ca0f0 tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Lock "aa223c49-d254-4727-8a01-873026847b37" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.089s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:42:48 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2e25e19-c832-4945-9257-64e6103feb0c/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:42:49 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-b92abc4f-9174-4153-84d3-9ae5c64ca0f0 tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Acquiring lock "aa223c49-d254-4727-8a01-873026847b37" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:42:49 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-b92abc4f-9174-4153-84d3-9ae5c64ca0f0 tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Lock "aa223c49-d254-4727-8a01-873026847b37" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:42:49 user nova-compute[75176]: INFO nova.compute.manager [None req-b92abc4f-9174-4153-84d3-9ae5c64ca0f0 tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] [instance: aa223c49-d254-4727-8a01-873026847b37] Attaching volume f61f7c78-66f5-45c5-85ac-2b97ed31a24d to /dev/vdb
Nov 28 15:42:49 user nova-compute[75176]: DEBUG os_brick.utils [None req-b92abc4f-9174-4153-84d3-9ae5c64ca0f0 tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 15:42:49 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:42:49 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-70024ef3-f24a-4627-aed2-73176f575110 tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] Acquiring lock "e2e25e19-c832-4945-9257-64e6103feb0c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:42:49 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-70024ef3-f24a-4627-aed2-73176f575110 tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] Lock "e2e25e19-c832-4945-9257-64e6103feb0c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.004s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:42:49 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-70024ef3-f24a-4627-aed2-73176f575110 tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] Acquiring lock "e2e25e19-c832-4945-9257-64e6103feb0c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:42:49 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-70024ef3-f24a-4627-aed2-73176f575110 tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] Lock "e2e25e19-c832-4945-9257-64e6103feb0c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:42:49 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-70024ef3-f24a-4627-aed2-73176f575110 tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] Lock "e2e25e19-c832-4945-9257-64e6103feb0c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:42:49 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.022s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:42:49 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[46a27b66-e4fa-4881-b8e9-c29551ad1524]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:edc924a949b2\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:42:49 user nova-compute[75176]: INFO nova.compute.manager [None req-70024ef3-f24a-4627-aed2-73176f575110 tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] [instance: e2e25e19-c832-4945-9257-64e6103feb0c] Terminating instance
Nov 28 15:42:49 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:42:49 user nova-compute[75176]: DEBUG nova.compute.manager [None req-70024ef3-f24a-4627-aed2-73176f575110 tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] [instance: e2e25e19-c832-4945-9257-64e6103feb0c] Start destroying the instance on the hypervisor. {{(pid=75176) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 15:42:49 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:42:49 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[09cf1f72-e2bd-4e9c-8c29-603695981b76]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:42:49 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:42:49 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:42:49 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[29ebf02c-d540-49f5-8420-0e28e1c89503]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:42:49 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[39ddc306-1ae1-415a-8bf9-03b12c0a472b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:42:49 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-b92abc4f-9174-4153-84d3-9ae5c64ca0f0 tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Running cmd (subprocess): nvme version {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:42:49 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-b92abc4f-9174-4153-84d3-9ae5c64ca0f0 tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] 'nvme version' failed. Not Retrying. {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 15:42:49 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b92abc4f-9174-4153-84d3-9ae5c64ca0f0 tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] nvme not present on system {{(pid=75176) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 15:42:49 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:42:49 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2e25e19-c832-4945-9257-64e6103feb0c/disk --force-share --output=json" returned: 0 in 0.318s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:42:49 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2e25e19-c832-4945-9257-64e6103feb0c/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:42:49 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:42:49 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:42:49 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 15:42:49 user nova-compute[75176]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 15:42:49 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb064380-55f5-48ae-a718-833393b1d378]: (4, '') {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:42:49 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.lightos [None req-b92abc4f-9174-4153-84d3-9ae5c64ca0f0 tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75176) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 15:42:49 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.lightos [None req-b92abc4f-9174-4153-84d3-9ae5c64ca0f0 tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75176) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 15:42:49 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.lightos [None req-b92abc4f-9174-4153-84d3-9ae5c64ca0f0 tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] LIGHTOS: no hostnqn found. {{(pid=75176) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 15:42:49 user nova-compute[75176]: DEBUG os_brick.utils [None req-b92abc4f-9174-4153-84d3-9ae5c64ca0f0 tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] <== get_connector_properties: return (228ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:edc924a949b2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 15:42:49 user nova-compute[75176]: DEBUG nova.virt.block_device [None req-b92abc4f-9174-4153-84d3-9ae5c64ca0f0 tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] [instance: aa223c49-d254-4727-8a01-873026847b37] Updating existing volume attachment record: abeaae69-a222-4ac1-b2a3-5571d7484cfc {{(pid=75176) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 15:42:49 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:42:49 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2e25e19-c832-4945-9257-64e6103feb0c/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:42:49 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e8507b7-fccf-4196-b589-bf2b74f165ec/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:42:49 user nova-compute[75176]: DEBUG nova.compute.manager [req-232346de-fc9e-4744-b3e5-6aad900f79b0 req-8f23a134-cc33-482d-a662-ab422037bdc0 service nova] [instance: e2e25e19-c832-4945-9257-64e6103feb0c] Received event network-vif-unplugged-05efa912-30d1-4474-a2eb-7d88fa0813e7 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:42:49 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-232346de-fc9e-4744-b3e5-6aad900f79b0 req-8f23a134-cc33-482d-a662-ab422037bdc0 service nova] Acquiring lock "e2e25e19-c832-4945-9257-64e6103feb0c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:42:49 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-232346de-fc9e-4744-b3e5-6aad900f79b0 req-8f23a134-cc33-482d-a662-ab422037bdc0 service nova] Lock "e2e25e19-c832-4945-9257-64e6103feb0c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:42:49 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-232346de-fc9e-4744-b3e5-6aad900f79b0 req-8f23a134-cc33-482d-a662-ab422037bdc0 service nova] Lock "e2e25e19-c832-4945-9257-64e6103feb0c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:42:49 user nova-compute[75176]: DEBUG nova.compute.manager [req-232346de-fc9e-4744-b3e5-6aad900f79b0 req-8f23a134-cc33-482d-a662-ab422037bdc0 service nova] [instance: e2e25e19-c832-4945-9257-64e6103feb0c] No waiting events found dispatching network-vif-unplugged-05efa912-30d1-4474-a2eb-7d88fa0813e7 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:42:49 user nova-compute[75176]: DEBUG nova.compute.manager [req-232346de-fc9e-4744-b3e5-6aad900f79b0 req-8f23a134-cc33-482d-a662-ab422037bdc0 service nova] [instance: e2e25e19-c832-4945-9257-64e6103feb0c] Received event network-vif-unplugged-05efa912-30d1-4474-a2eb-7d88fa0813e7 for instance with task_state deleting. {{(pid=75176) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 15:42:49 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e8507b7-fccf-4196-b589-bf2b74f165ec/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:42:49 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e8507b7-fccf-4196-b589-bf2b74f165ec/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:42:49 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e8507b7-fccf-4196-b589-bf2b74f165ec/disk --force-share --output=json" returned: 0 in 0.267s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:42:50 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dcbbf59-600f-4309-abd3-e8e4c7731c0b/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:42:50 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:42:50 user nova-compute[75176]: INFO nova.virt.libvirt.driver [-] [instance: e2e25e19-c832-4945-9257-64e6103feb0c] Instance destroyed successfully.
Nov 28 15:42:50 user nova-compute[75176]: DEBUG nova.objects.instance [None req-70024ef3-f24a-4627-aed2-73176f575110 tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] Lazy-loading 'resources' on Instance uuid e2e25e19-c832-4945-9257-64e6103feb0c {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:42:50 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-70024ef3-f24a-4627-aed2-73176f575110 tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T15:39:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1735788857',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1735788857',id=6,image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLYd6lLWkEZSf+41ikXMqtG28NM8Q+hVwVe3wmXerHL+M0XqnrZ3u3KddSHLIIe0vvFogrQWiaY5StKzsHvoccjRJn8doyVKS0uym1H0FtgpShdYQ4yF2e0Gu6ZxuZcJSg==',key_name='tempest-keypair-1836481900',keypairs=<?>,launch_index=0,launched_at=2023-11-28T15:39:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2ca8d4f7f4934dbdbd6ba92f51fba4b6',ramdisk_id='',reservation_id='r-62ikbebi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-231716548',owner_user_name='tempest-TaggedAttachmentsTest-231716548-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T15:39:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5b8c4eae6ef14fa2b416c67f86e85971',uuid=e2e25e19-c832-4945-9257-64e6103feb0c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "05efa912-30d1-4474-a2eb-7d88fa0813e7", "address": "fa:16:3e:b8:ab:c4", "network": {"id": "8bf6c19c-1190-430d-8e20-bc6439072a45", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-211502152-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ca8d4f7f4934dbdbd6ba92f51fba4b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05efa912-30", "ovs_interfaceid": "05efa912-30d1-4474-a2eb-7d88fa0813e7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 15:42:50 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-70024ef3-f24a-4627-aed2-73176f575110 tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] Converting VIF {"id": "05efa912-30d1-4474-a2eb-7d88fa0813e7", "address": "fa:16:3e:b8:ab:c4", "network": {"id": "8bf6c19c-1190-430d-8e20-bc6439072a45", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-211502152-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ca8d4f7f4934dbdbd6ba92f51fba4b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05efa912-30", "ovs_interfaceid": "05efa912-30d1-4474-a2eb-7d88fa0813e7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:42:50 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-70024ef3-f24a-4627-aed2-73176f575110 tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b8:ab:c4,bridge_name='br-int',has_traffic_filtering=True,id=05efa912-30d1-4474-a2eb-7d88fa0813e7,network=Network(8bf6c19c-1190-430d-8e20-bc6439072a45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05efa912-30') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:42:50 user nova-compute[75176]: DEBUG os_vif [None req-70024ef3-f24a-4627-aed2-73176f575110 tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b8:ab:c4,bridge_name='br-int',has_traffic_filtering=True,id=05efa912-30d1-4474-a2eb-7d88fa0813e7,network=Network(8bf6c19c-1190-430d-8e20-bc6439072a45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05efa912-30') {{(pid=75176) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 15:42:50 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:42:50 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap05efa912-30, bridge=br-int, if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:42:50 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:42:50 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:42:50 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:42:50 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ac4da4f3-536e-477c-9231-9efef87e95c9) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:42:50 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:42:50 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:42:50 user nova-compute[75176]: INFO os_vif [None req-70024ef3-f24a-4627-aed2-73176f575110 tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b8:ab:c4,bridge_name='br-int',has_traffic_filtering=True,id=05efa912-30d1-4474-a2eb-7d88fa0813e7,network=Network(8bf6c19c-1190-430d-8e20-bc6439072a45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05efa912-30')
Nov 28 15:42:50 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-70024ef3-f24a-4627-aed2-73176f575110 tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] [instance: e2e25e19-c832-4945-9257-64e6103feb0c] Deleting instance files /opt/stack/data/nova/instances/e2e25e19-c832-4945-9257-64e6103feb0c_del
Nov 28 15:42:50 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-70024ef3-f24a-4627-aed2-73176f575110 tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] [instance: e2e25e19-c832-4945-9257-64e6103feb0c] Deletion of /opt/stack/data/nova/instances/e2e25e19-c832-4945-9257-64e6103feb0c_del complete
Nov 28 15:42:50 user nova-compute[75176]: INFO nova.compute.manager [None req-70024ef3-f24a-4627-aed2-73176f575110 tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] [instance: e2e25e19-c832-4945-9257-64e6103feb0c] Took 1.07 seconds to destroy the instance on the hypervisor.
Nov 28 15:42:50 user nova-compute[75176]: DEBUG oslo.service.loopingcall [None req-70024ef3-f24a-4627-aed2-73176f575110 tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75176) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 15:42:50 user nova-compute[75176]: DEBUG nova.compute.manager [-] [instance: e2e25e19-c832-4945-9257-64e6103feb0c] Deallocating network for instance {{(pid=75176) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 15:42:50 user nova-compute[75176]: DEBUG nova.network.neutron [-] [instance: e2e25e19-c832-4945-9257-64e6103feb0c] deallocate_for_instance() {{(pid=75176) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 15:42:50 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dcbbf59-600f-4309-abd3-e8e4c7731c0b/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:42:50 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dcbbf59-600f-4309-abd3-e8e4c7731c0b/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:42:50 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dcbbf59-600f-4309-abd3-e8e4c7731c0b/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:42:50 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b18c889-7694-4edf-8cf2-b9032e60289e/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:42:50 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b18c889-7694-4edf-8cf2-b9032e60289e/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:42:50 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b18c889-7694-4edf-8cf2-b9032e60289e/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:42:50 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b18c889-7694-4edf-8cf2-b9032e60289e/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:42:50 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa223c49-d254-4727-8a01-873026847b37/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:42:51 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa223c49-d254-4727-8a01-873026847b37/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:42:51 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa223c49-d254-4727-8a01-873026847b37/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:42:51 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa223c49-d254-4727-8a01-873026847b37/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:42:51 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ab0619f-72e5-4975-ade8-53d7c0784d89/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:42:51 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ab0619f-72e5-4975-ade8-53d7c0784d89/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:42:51 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ab0619f-72e5-4975-ade8-53d7c0784d89/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:42:51 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ab0619f-72e5-4975-ade8-53d7c0784d89/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:42:51 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47306d53-9ad7-4cae-ba6d-1f65239ef30f/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:42:51 user nova-compute[75176]: DEBUG nova.compute.manager [req-8ab4b6c5-8be2-4b75-a7cf-0aa0660b2e46 req-39e2aafe-29ff-4a57-b329-586f6f5e82f5 service nova] [instance: e2e25e19-c832-4945-9257-64e6103feb0c] Received event network-vif-deleted-05efa912-30d1-4474-a2eb-7d88fa0813e7 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:42:51 user nova-compute[75176]: INFO nova.compute.manager [req-8ab4b6c5-8be2-4b75-a7cf-0aa0660b2e46 req-39e2aafe-29ff-4a57-b329-586f6f5e82f5 service nova] [instance: e2e25e19-c832-4945-9257-64e6103feb0c] Neutron deleted interface 05efa912-30d1-4474-a2eb-7d88fa0813e7; detaching it from the instance and deleting it from the info cache
Nov 28 15:42:51 user nova-compute[75176]: DEBUG nova.network.neutron [req-8ab4b6c5-8be2-4b75-a7cf-0aa0660b2e46 req-39e2aafe-29ff-4a57-b329-586f6f5e82f5 service nova] [instance: e2e25e19-c832-4945-9257-64e6103feb0c] Updating instance_info_cache with network_info: [] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:42:51 user nova-compute[75176]: DEBUG nova.network.neutron [-] [instance: e2e25e19-c832-4945-9257-64e6103feb0c] Updating instance_info_cache with network_info: [] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:42:51 user nova-compute[75176]: INFO nova.compute.manager [-] [instance: e2e25e19-c832-4945-9257-64e6103feb0c] Took 1.62 seconds to deallocate network for instance.
Nov 28 15:42:51 user nova-compute[75176]: DEBUG nova.compute.manager [req-8ab4b6c5-8be2-4b75-a7cf-0aa0660b2e46 req-39e2aafe-29ff-4a57-b329-586f6f5e82f5 service nova] [instance: e2e25e19-c832-4945-9257-64e6103feb0c] Detach interface failed, port_id=05efa912-30d1-4474-a2eb-7d88fa0813e7, reason: Instance e2e25e19-c832-4945-9257-64e6103feb0c could not be found. {{(pid=75176) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 28 15:42:51 user nova-compute[75176]: DEBUG nova.compute.manager [req-bf6e925b-b2dc-40b6-9f90-a1f6499663a8 req-c6402938-ec25-4120-90fa-79b31a69f6f8 service nova] [instance: e2e25e19-c832-4945-9257-64e6103feb0c] Received event network-vif-plugged-05efa912-30d1-4474-a2eb-7d88fa0813e7 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:42:51 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-bf6e925b-b2dc-40b6-9f90-a1f6499663a8 req-c6402938-ec25-4120-90fa-79b31a69f6f8 service nova] Acquiring lock "e2e25e19-c832-4945-9257-64e6103feb0c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:42:51 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-bf6e925b-b2dc-40b6-9f90-a1f6499663a8 req-c6402938-ec25-4120-90fa-79b31a69f6f8 service nova] Lock "e2e25e19-c832-4945-9257-64e6103feb0c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:42:51 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-bf6e925b-b2dc-40b6-9f90-a1f6499663a8 req-c6402938-ec25-4120-90fa-79b31a69f6f8 service nova] Lock "e2e25e19-c832-4945-9257-64e6103feb0c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:42:51 user nova-compute[75176]: DEBUG nova.compute.manager [req-bf6e925b-b2dc-40b6-9f90-a1f6499663a8 req-c6402938-ec25-4120-90fa-79b31a69f6f8 service nova] [instance: e2e25e19-c832-4945-9257-64e6103feb0c] No waiting events found dispatching network-vif-plugged-05efa912-30d1-4474-a2eb-7d88fa0813e7 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:42:51 user nova-compute[75176]: WARNING nova.compute.manager [req-bf6e925b-b2dc-40b6-9f90-a1f6499663a8 req-c6402938-ec25-4120-90fa-79b31a69f6f8 service nova] [instance: e2e25e19-c832-4945-9257-64e6103feb0c] Received unexpected event network-vif-plugged-05efa912-30d1-4474-a2eb-7d88fa0813e7 for instance with vm_state active and task_state deleting.
Nov 28 15:42:51 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-70024ef3-f24a-4627-aed2-73176f575110 tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:42:51 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-70024ef3-f24a-4627-aed2-73176f575110 tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:42:51 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47306d53-9ad7-4cae-ba6d-1f65239ef30f/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:42:51 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47306d53-9ad7-4cae-ba6d-1f65239ef30f/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:42:52 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-149e1479-bd5e-470e-879a-5fdd569a7e48 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Acquiring lock "e02d1e69-5e74-43c3-8546-6044d31145f2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:42:52 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-149e1479-bd5e-470e-879a-5fdd569a7e48 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Lock "e02d1e69-5e74-43c3-8546-6044d31145f2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:42:52 user nova-compute[75176]: DEBUG nova.compute.manager [None req-149e1479-bd5e-470e-879a-5fdd569a7e48 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] [instance: e02d1e69-5e74-43c3-8546-6044d31145f2] Starting instance... {{(pid=75176) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 15:42:52 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47306d53-9ad7-4cae-ba6d-1f65239ef30f/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:42:52 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/402e779e-f507-49f1-a0d8-31ab0d23fbcd/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:42:52 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-149e1479-bd5e-470e-879a-5fdd569a7e48 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:42:52 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/402e779e-f507-49f1-a0d8-31ab0d23fbcd/disk --force-share --output=json" returned: 0 in 0.281s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:42:52 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/402e779e-f507-49f1-a0d8-31ab0d23fbcd/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:42:52 user nova-compute[75176]: DEBUG nova.compute.provider_tree [None req-70024ef3-f24a-4627-aed2-73176f575110 tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] Inventory has not changed in ProviderTree for provider: b37848d8-f401-4155-a029-b0ffa09ff85b {{(pid=75176) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 15:42:52 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/402e779e-f507-49f1-a0d8-31ab0d23fbcd/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:42:52 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-70024ef3-f24a-4627-aed2-73176f575110 tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] Inventory has not changed for provider b37848d8-f401-4155-a029-b0ffa09ff85b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75176) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 15:42:52 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75176) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 15:42:53 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-70024ef3-f24a-4627-aed2-73176f575110 tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.563s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:42:53 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-149e1479-bd5e-470e-879a-5fdd569a7e48 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.983s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:42:53 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-149e1479-bd5e-470e-879a-5fdd569a7e48 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75176) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 15:42:53 user nova-compute[75176]: INFO nova.compute.claims [None req-149e1479-bd5e-470e-879a-5fdd569a7e48 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] [instance: e02d1e69-5e74-43c3-8546-6044d31145f2] Claim successful on node user
Nov 28 15:42:53 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 15:42:53 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 15:42:53 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Hypervisor/Node resource view: name=user free_ram=7656MB free_disk=25.426380157470703GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75176) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 15:42:53 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:42:53 user nova-compute[75176]: INFO nova.scheduler.client.report [None req-70024ef3-f24a-4627-aed2-73176f575110 tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] Deleted allocations for instance e2e25e19-c832-4945-9257-64e6103feb0c
Nov 28 15:42:53 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:42:53 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-70024ef3-f24a-4627-aed2-73176f575110 tempest-TaggedAttachmentsTest-231716548 tempest-TaggedAttachmentsTest-231716548-project-member] Lock "e2e25e19-c832-4945-9257-64e6103feb0c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.508s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:42:53 user nova-compute[75176]: DEBUG nova.compute.provider_tree [None req-149e1479-bd5e-470e-879a-5fdd569a7e48 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Inventory has not changed in ProviderTree for provider: b37848d8-f401-4155-a029-b0ffa09ff85b {{(pid=75176) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 15:42:53 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-149e1479-bd5e-470e-879a-5fdd569a7e48 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Inventory has not changed for provider b37848d8-f401-4155-a029-b0ffa09ff85b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75176) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 15:42:53 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-473e5f48-b5a6-4c2f-9ea4-5c4ef7a68cbd tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] [instance: 6ab0619f-72e5-4975-ade8-53d7c0784d89] Calling os-brick to attach iSCSI Volume {{(pid=75176) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 15:42:53 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-473e5f48-b5a6-4c2f-9ea4-5c4ef7a68cbd tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c1b8a00>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2bb22dca-8491-42ef-815f-7b0c0ca4be5a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UHFXkSYA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 15:42:53 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-473e5f48-b5a6-4c2f-9ea4-5c4ef7a68cbd tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 15:42:53 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-473e5f48-b5a6-4c2f-9ea4-5c4ef7a68cbd tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 15:42:53 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-473e5f48-b5a6-4c2f-9ea4-5c4ef7a68cbd tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 15:42:53 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-473e5f48-b5a6-4c2f-9ea4-5c4ef7a68cbd tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 15:42:53 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-473e5f48-b5a6-4c2f-9ea4-5c4ef7a68cbd tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2bb22dca-8491-42ef-815f-7b0c0ca4be5a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 15:42:53 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-473e5f48-b5a6-4c2f-9ea4-5c4ef7a68cbd tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2bb22dca-8491-42ef-815f-7b0c0ca4be5a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 15:42:53 user nova-compute[75176]: INFO os_brick.initiator.connectors.iscsi [None req-473e5f48-b5a6-4c2f-9ea4-5c4ef7a68cbd tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 15:42:53 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2bb22dca-8491-42ef-815f-7b0c0ca4be5a -p 172.16.0.220:3260 {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:42:53 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-149e1479-bd5e-470e-879a-5fdd569a7e48 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.466s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:42:53 user nova-compute[75176]: DEBUG nova.compute.manager [None req-149e1479-bd5e-470e-879a-5fdd569a7e48 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] [instance: e02d1e69-5e74-43c3-8546-6044d31145f2] Start building networks asynchronously for instance. {{(pid=75176) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 15:42:53 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.454s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:42:54 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2bb22dca-8491-42ef-815f-7b0c0ca4be5a -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:42:54 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[91d08daa-49a4-4a31-9a9d-cd9b74f8b5d2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:42:54 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-473e5f48-b5a6-4c2f-9ea4-5c4ef7a68cbd tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 15:42:54 user nova-compute[75176]:  {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:42:54 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2bb22dca-8491-42ef-815f-7b0c0ca4be5a -p 172.16.0.220:3260 --interface default --op new {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:42:54 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2bb22dca-8491-42ef-815f-7b0c0ca4be5a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:42:54 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[84c70887-0e82-48f9-bb11-27dc25ddc103]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2bb22dca-8491-42ef-815f-7b0c0ca4be5a] added\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:42:54 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-473e5f48-b5a6-4c2f-9ea4-5c4ef7a68cbd tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2bb22dca-8491-42ef-815f-7b0c0ca4be5a] added
Nov 28 15:42:54 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:42:54 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2bb22dca-8491-42ef-815f-7b0c0ca4be5a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:42:54 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:42:54 user nova-compute[75176]: DEBUG nova.compute.manager [None req-149e1479-bd5e-470e-879a-5fdd569a7e48 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] [instance: e02d1e69-5e74-43c3-8546-6044d31145f2] Allocating IP information in the background. {{(pid=75176) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 15:42:54 user nova-compute[75176]: DEBUG nova.network.neutron [None req-149e1479-bd5e-470e-879a-5fdd569a7e48 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] [instance: e02d1e69-5e74-43c3-8546-6044d31145f2] allocate_for_instance() {{(pid=75176) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 15:42:54 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2bb22dca-8491-42ef-815f-7b0c0ca4be5a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.036s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:42:54 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f8b5c8c-b831-436c-b801-fed7da491d39]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:42:54 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-473e5f48-b5a6-4c2f-9ea4-5c4ef7a68cbd tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:42:54 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2bb22dca-8491-42ef-815f-7b0c0ca4be5a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:42:54 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-149e1479-bd5e-470e-879a-5fdd569a7e48 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] [instance: e02d1e69-5e74-43c3-8546-6044d31145f2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 15:42:54 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2bb22dca-8491-42ef-815f-7b0c0ca4be5a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:42:54 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[194254d8-6b49-49f6-8f5b-2c42ed381019]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:42:54 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-473e5f48-b5a6-4c2f-9ea4-5c4ef7a68cbd tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:42:54 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2bb22dca-8491-42ef-815f-7b0c0ca4be5a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UHFXkSYA {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:42:54 user nova-compute[75176]: DEBUG nova.compute.manager [None req-149e1479-bd5e-470e-879a-5fdd569a7e48 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] [instance: e02d1e69-5e74-43c3-8546-6044d31145f2] Start building block device mappings for instance. {{(pid=75176) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 15:42:54 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2bb22dca-8491-42ef-815f-7b0c0ca4be5a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UHFXkSYA" returned: 0 in 0.028s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:42:54 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[5255df77-9dec-4e1e-a59b-b7c11f3cc97a]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:42:54 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-473e5f48-b5a6-4c2f-9ea4-5c4ef7a68cbd tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UHFXkSYA'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:42:54 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2bb22dca-8491-42ef-815f-7b0c0ca4be5a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:42:54 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance 6ab0619f-72e5-4975-ade8-53d7c0784d89 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:42:54 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance aa223c49-d254-4727-8a01-873026847b37 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:42:54 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance 2e8507b7-fccf-4196-b589-bf2b74f165ec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:42:54 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance 5b18c889-7694-4edf-8cf2-b9032e60289e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:42:54 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance 916b82eb-97e8-411c-a8ea-8c27d101b48e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:42:54 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance 47306d53-9ad7-4cae-ba6d-1f65239ef30f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:42:54 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance 402e779e-f507-49f1-a0d8-31ab0d23fbcd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:42:54 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance 9dcbbf59-600f-4309-abd3-e8e4c7731c0b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:42:54 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance e02d1e69-5e74-43c3-8546-6044d31145f2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:42:54 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75176) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 15:42:54 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75176) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 15:42:54 user nova-compute[75176]: DEBUG nova.policy [None req-149e1479-bd5e-470e-879a-5fdd569a7e48 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd028b79a105b485dbb0178c9da162640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3704b38a2bd44cb78c28d3f6d86d9e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75176) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 15:42:54 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2bb22dca-8491-42ef-815f-7b0c0ca4be5a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:42:54 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[159c68fb-a984-44d6-820e-fa31846768eb]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:42:54 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-473e5f48-b5a6-4c2f-9ea4-5c4ef7a68cbd tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:42:54 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:42:54 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:42:54 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[44480c50-4aaa-4dfd-9df9-3818f711552b]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9 (non-flash)\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:42:54 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-473e5f48-b5a6-4c2f-9ea4-5c4ef7a68cbd tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9 (non-flash)
Nov 28 15:42:54 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:42:54 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-473e5f48-b5a6-4c2f-9ea4-5c4ef7a68cbd tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9 (non-flash)
Nov 28 15:42:54 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 15:42:54 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2bb22dca-8491-42ef-815f-7b0c0ca4be5a -p 172.16.0.220:3260 --login {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:42:54 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2bb22dca-8491-42ef-815f-7b0c0ca4be5a -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:42:54 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[3310b836-9234-4bbb-b931-340c13162bcf]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2bb22dca-8491-42ef-815f-7b0c0ca4be5a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2bb22dca-8491-42ef-815f-7b0c0ca4be5a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:42:54 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-473e5f48-b5a6-4c2f-9ea4-5c4ef7a68cbd tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2bb22dca-8491-42ef-815f-7b0c0ca4be5a, portal: 172.16.0.220,3260]
Nov 28 15:42:54 user nova-compute[75176]: Login to [iface: default, target: iqn.2010-10.org.openstack:2bb22dca-8491-42ef-815f-7b0c0ca4be5a, portal: 172.16.0.220,3260] successful.
Nov 28 15:42:54 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:42:54 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2bb22dca-8491-42ef-815f-7b0c0ca4be5a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:42:54 user nova-compute[75176]: DEBUG nova.compute.manager [None req-149e1479-bd5e-470e-879a-5fdd569a7e48 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] [instance: e02d1e69-5e74-43c3-8546-6044d31145f2] Start spawning the instance on the hypervisor. {{(pid=75176) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 15:42:54 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-149e1479-bd5e-470e-879a-5fdd569a7e48 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] [instance: e02d1e69-5e74-43c3-8546-6044d31145f2] Creating instance directory {{(pid=75176) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 15:42:54 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-149e1479-bd5e-470e-879a-5fdd569a7e48 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] [instance: e02d1e69-5e74-43c3-8546-6044d31145f2] Creating image(s)
Nov 28 15:42:54 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-149e1479-bd5e-470e-879a-5fdd569a7e48 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Acquiring lock "/opt/stack/data/nova/instances/e02d1e69-5e74-43c3-8546-6044d31145f2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:42:54 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-149e1479-bd5e-470e-879a-5fdd569a7e48 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Lock "/opt/stack/data/nova/instances/e02d1e69-5e74-43c3-8546-6044d31145f2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:42:54 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-149e1479-bd5e-470e-879a-5fdd569a7e48 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Lock "/opt/stack/data/nova/instances/e02d1e69-5e74-43c3-8546-6044d31145f2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:42:54 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-149e1479-bd5e-470e-879a-5fdd569a7e48 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:42:54 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2bb22dca-8491-42ef-815f-7b0c0ca4be5a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:42:54 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[46b028e7-975e-40d5-b814-1ee472d3b245]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:42:54 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-473e5f48-b5a6-4c2f-9ea4-5c4ef7a68cbd tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:42:54 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:42:54 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:42:54 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[7433e0e4-d7c6-43f1-ac28-b61992205067]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bb22dca-8491-42ef-815f-7b0c0ca4be5a (non-flash)\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:42:54 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-473e5f48-b5a6-4c2f-9ea4-5c4ef7a68cbd tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9 (non-flash)
Nov 28 15:42:54 user nova-compute[75176]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bb22dca-8491-42ef-815f-7b0c0ca4be5a (non-flash)
Nov 28 15:42:54 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:42:54 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-473e5f48-b5a6-4c2f-9ea4-5c4ef7a68cbd tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9 (non-flash)
Nov 28 15:42:54 user nova-compute[75176]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bb22dca-8491-42ef-815f-7b0c0ca4be5a (non-flash)
Nov 28 15:42:54 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 15:42:54 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-473e5f48-b5a6-4c2f-9ea4-5c4ef7a68cbd tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2bb22dca-8491-42ef-815f-7b0c0ca4be5a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.406s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 15:42:54 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-473e5f48-b5a6-4c2f-9ea4-5c4ef7a68cbd tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] Connected to 172.16.0.220:3260 {{(pid=75176) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 15:42:54 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-473e5f48-b5a6-4c2f-9ea4-5c4ef7a68cbd tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] HCTL ('34', '-', '-', 0) found on session 16 with lun 0 {{(pid=75176) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 15:42:54 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-473e5f48-b5a6-4c2f-9ea4-5c4ef7a68cbd tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75176) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 15:42:54 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:42:54 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.027s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:42:54 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dd802f3-9b1e-4a22-a9dc-7c116a44181c]: (4, ('- - 0', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:42:54 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-473e5f48-b5a6-4c2f-9ea4-5c4ef7a68cbd tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] Searching for a device in session 16 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75176) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 15:42:54 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-473e5f48-b5a6-4c2f-9ea4-5c4ef7a68cbd tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:2bb22dca-8491-42ef-815f-7b0c0ca4be5a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UHFXkSYA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75176) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 15:42:54 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-149e1479-bd5e-470e-879a-5fdd569a7e48 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json" returned: 0 in 0.202s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:42:54 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-149e1479-bd5e-470e-879a-5fdd569a7e48 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Acquiring lock "5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:42:54 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-149e1479-bd5e-470e-879a-5fdd569a7e48 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Lock "5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:42:54 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-149e1479-bd5e-470e-879a-5fdd569a7e48 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:42:54 user nova-compute[75176]: DEBUG nova.compute.provider_tree [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Inventory has not changed in ProviderTree for provider: b37848d8-f401-4155-a029-b0ffa09ff85b {{(pid=75176) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 15:42:54 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Inventory has not changed for provider b37848d8-f401-4155-a029-b0ffa09ff85b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75176) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 15:42:54 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Compute_service record updated for user:user {{(pid=75176) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 15:42:54 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.641s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:42:54 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:42:54 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-149e1479-bd5e-470e-879a-5fdd569a7e48 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json" returned: 0 in 0.231s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:42:54 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-149e1479-bd5e-470e-879a-5fdd569a7e48 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2,backing_fmt=raw /opt/stack/data/nova/instances/e02d1e69-5e74-43c3-8546-6044d31145f2/disk 1073741824 {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:42:54 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-149e1479-bd5e-470e-879a-5fdd569a7e48 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2,backing_fmt=raw /opt/stack/data/nova/instances/e02d1e69-5e74-43c3-8546-6044d31145f2/disk 1073741824" returned: 0 in 0.070s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:42:54 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-149e1479-bd5e-470e-879a-5fdd569a7e48 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Lock "5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.305s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:42:54 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-149e1479-bd5e-470e-879a-5fdd569a7e48 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:42:55 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-149e1479-bd5e-470e-879a-5fdd569a7e48 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json" returned: 0 in 0.204s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:42:55 user nova-compute[75176]: DEBUG nova.virt.disk.api [None req-149e1479-bd5e-470e-879a-5fdd569a7e48 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e02d1e69-5e74-43c3-8546-6044d31145f2/disk. size=1073741824 {{(pid=75176) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 15:42:55 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-149e1479-bd5e-470e-879a-5fdd569a7e48 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e02d1e69-5e74-43c3-8546-6044d31145f2/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:42:55 user nova-compute[75176]: DEBUG nova.network.neutron [None req-149e1479-bd5e-470e-879a-5fdd569a7e48 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] [instance: e02d1e69-5e74-43c3-8546-6044d31145f2] Successfully created port: 9a63b660-0280-42b9-868c-dbf0c26ee995 {{(pid=75176) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 15:42:55 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:42:55 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-149e1479-bd5e-470e-879a-5fdd569a7e48 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e02d1e69-5e74-43c3-8546-6044d31145f2/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:42:55 user nova-compute[75176]: DEBUG nova.virt.disk.api [None req-149e1479-bd5e-470e-879a-5fdd569a7e48 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Cannot resize image /opt/stack/data/nova/instances/e02d1e69-5e74-43c3-8546-6044d31145f2/disk to a smaller size. {{(pid=75176) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 15:42:55 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-149e1479-bd5e-470e-879a-5fdd569a7e48 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] [instance: e02d1e69-5e74-43c3-8546-6044d31145f2] Created local disks {{(pid=75176) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 15:42:55 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-149e1479-bd5e-470e-879a-5fdd569a7e48 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] [instance: e02d1e69-5e74-43c3-8546-6044d31145f2] Ensure instance console log exists: /opt/stack/data/nova/instances/e02d1e69-5e74-43c3-8546-6044d31145f2/console.log {{(pid=75176) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 15:42:55 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-149e1479-bd5e-470e-879a-5fdd569a7e48 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:42:55 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-149e1479-bd5e-470e-879a-5fdd569a7e48 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:42:55 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-149e1479-bd5e-470e-879a-5fdd569a7e48 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:42:55 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-473e5f48-b5a6-4c2f-9ea4-5c4ef7a68cbd tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.452s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 15:42:55 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-473e5f48-b5a6-4c2f-9ea4-5c4ef7a68cbd tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] <== connect_volume: return (1454ms) {'type': 'block', 'scsi_wwn': '26338653834333761', 'path': '/dev/sdc'} {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 15:42:55 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-473e5f48-b5a6-4c2f-9ea4-5c4ef7a68cbd tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] [instance: 6ab0619f-72e5-4975-ade8-53d7c0784d89] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26338653834333761', 'path': '/dev/sdc'} {{(pid=75176) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 15:42:55 user nova-compute[75176]: DEBUG nova.objects.instance [None req-473e5f48-b5a6-4c2f-9ea4-5c4ef7a68cbd tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] Lazy-loading 'flavor' on Instance uuid 6ab0619f-72e5-4975-ade8-53d7c0784d89 {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:42:55 user nova-compute[75176]: DEBUG nova.virt.libvirt.guest [None req-473e5f48-b5a6-4c2f-9ea4-5c4ef7a68cbd tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 15:42:55 user nova-compute[75176]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 15:42:55 user nova-compute[75176]:   <source dev="/dev/sdc"/>
Nov 28 15:42:55 user nova-compute[75176]:   <target dev="vdb" bus="virtio"/>
Nov 28 15:42:55 user nova-compute[75176]:   <serial>2bb22dca-8491-42ef-815f-7b0c0ca4be5a</serial>
Nov 28 15:42:55 user nova-compute[75176]: </disk>
Nov 28 15:42:55 user nova-compute[75176]:  {{(pid=75176) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 15:42:55 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:42:55 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:42:55 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:42:55 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Starting heal instance info cache {{(pid=75176) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 15:42:55 user nova-compute[75176]: DEBUG nova.network.neutron [None req-149e1479-bd5e-470e-879a-5fdd569a7e48 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] [instance: e02d1e69-5e74-43c3-8546-6044d31145f2] Successfully updated port: 9a63b660-0280-42b9-868c-dbf0c26ee995 {{(pid=75176) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 15:42:55 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-149e1479-bd5e-470e-879a-5fdd569a7e48 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Acquiring lock "refresh_cache-e02d1e69-5e74-43c3-8546-6044d31145f2" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:42:55 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-149e1479-bd5e-470e-879a-5fdd569a7e48 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Acquired lock "refresh_cache-e02d1e69-5e74-43c3-8546-6044d31145f2" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:42:55 user nova-compute[75176]: DEBUG nova.network.neutron [None req-149e1479-bd5e-470e-879a-5fdd569a7e48 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] [instance: e02d1e69-5e74-43c3-8546-6044d31145f2] Building network info cache for instance {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 15:42:55 user nova-compute[75176]: DEBUG nova.compute.manager [req-5a02d702-0a12-4b91-980f-6ce0bf8526f1 req-23615908-e12c-4af2-a401-6b6fbb7fc52f service nova] [instance: e02d1e69-5e74-43c3-8546-6044d31145f2] Received event network-changed-9a63b660-0280-42b9-868c-dbf0c26ee995 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:42:55 user nova-compute[75176]: DEBUG nova.compute.manager [req-5a02d702-0a12-4b91-980f-6ce0bf8526f1 req-23615908-e12c-4af2-a401-6b6fbb7fc52f service nova] [instance: e02d1e69-5e74-43c3-8546-6044d31145f2] Refreshing instance network info cache due to event network-changed-9a63b660-0280-42b9-868c-dbf0c26ee995. {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 15:42:55 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-5a02d702-0a12-4b91-980f-6ce0bf8526f1 req-23615908-e12c-4af2-a401-6b6fbb7fc52f service nova] Acquiring lock "refresh_cache-e02d1e69-5e74-43c3-8546-6044d31145f2" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:42:55 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquiring lock "refresh_cache-2e8507b7-fccf-4196-b589-bf2b74f165ec" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:42:55 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquired lock "refresh_cache-2e8507b7-fccf-4196-b589-bf2b74f165ec" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:42:55 user nova-compute[75176]: DEBUG nova.network.neutron [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] [instance: 2e8507b7-fccf-4196-b589-bf2b74f165ec] Forcefully refreshing network info cache for instance {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 15:42:55 user nova-compute[75176]: DEBUG nova.network.neutron [None req-149e1479-bd5e-470e-879a-5fdd569a7e48 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] [instance: e02d1e69-5e74-43c3-8546-6044d31145f2] Instance cache missing network info. {{(pid=75176) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 15:42:55 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-473e5f48-b5a6-4c2f-9ea4-5c4ef7a68cbd tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] No BDM found with device name vda, not building metadata. {{(pid=75176) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 15:42:55 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-473e5f48-b5a6-4c2f-9ea4-5c4ef7a68cbd tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75176) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 15:42:55 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-473e5f48-b5a6-4c2f-9ea4-5c4ef7a68cbd tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] No VIF found with MAC fa:16:3e:4d:46:79, not building metadata {{(pid=75176) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 15:42:56 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-473e5f48-b5a6-4c2f-9ea4-5c4ef7a68cbd tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] Lock "6ab0619f-72e5-4975-ade8-53d7c0784d89" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.851s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:42:56 user nova-compute[75176]: DEBUG nova.network.neutron [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] [instance: 2e8507b7-fccf-4196-b589-bf2b74f165ec] Updating instance_info_cache with network_info: [{"id": "3dc67fc3-7fcf-4655-8dbd-22febf2be39e", "address": "fa:16:3e:04:68:53", "network": {"id": "8b63f2d3-0683-4832-abc5-e4c796cf12ab", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-877608435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3704b38a2bd44cb78c28d3f6d86d9e60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dc67fc3-7f", "ovs_interfaceid": "3dc67fc3-7fcf-4655-8dbd-22febf2be39e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:42:56 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Releasing lock "refresh_cache-2e8507b7-fccf-4196-b589-bf2b74f165ec" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:42:56 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] [instance: 2e8507b7-fccf-4196-b589-bf2b74f165ec] Updated the network info_cache for instance {{(pid=75176) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 15:42:56 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:42:56 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:42:56 user nova-compute[75176]: DEBUG nova.network.neutron [None req-149e1479-bd5e-470e-879a-5fdd569a7e48 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] [instance: e02d1e69-5e74-43c3-8546-6044d31145f2] Updating instance_info_cache with network_info: [{"id": "9a63b660-0280-42b9-868c-dbf0c26ee995", "address": "fa:16:3e:ed:a5:68", "network": {"id": "8b63f2d3-0683-4832-abc5-e4c796cf12ab", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-877608435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3704b38a2bd44cb78c28d3f6d86d9e60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a63b660-02", "ovs_interfaceid": "9a63b660-0280-42b9-868c-dbf0c26ee995", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:42:56 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-149e1479-bd5e-470e-879a-5fdd569a7e48 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Releasing lock "refresh_cache-e02d1e69-5e74-43c3-8546-6044d31145f2" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:42:56 user nova-compute[75176]: DEBUG nova.compute.manager [None req-149e1479-bd5e-470e-879a-5fdd569a7e48 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] [instance: e02d1e69-5e74-43c3-8546-6044d31145f2] Instance network_info: |[{"id": "9a63b660-0280-42b9-868c-dbf0c26ee995", "address": "fa:16:3e:ed:a5:68", "network": {"id": "8b63f2d3-0683-4832-abc5-e4c796cf12ab", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-877608435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3704b38a2bd44cb78c28d3f6d86d9e60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a63b660-02", "ovs_interfaceid": "9a63b660-0280-42b9-868c-dbf0c26ee995", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75176) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 15:42:56 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-5a02d702-0a12-4b91-980f-6ce0bf8526f1 req-23615908-e12c-4af2-a401-6b6fbb7fc52f service nova] Acquired lock "refresh_cache-e02d1e69-5e74-43c3-8546-6044d31145f2" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:42:56 user nova-compute[75176]: DEBUG nova.network.neutron [req-5a02d702-0a12-4b91-980f-6ce0bf8526f1 req-23615908-e12c-4af2-a401-6b6fbb7fc52f service nova] [instance: e02d1e69-5e74-43c3-8546-6044d31145f2] Refreshing network info cache for port 9a63b660-0280-42b9-868c-dbf0c26ee995 {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 15:42:56 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-149e1479-bd5e-470e-879a-5fdd569a7e48 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] [instance: e02d1e69-5e74-43c3-8546-6044d31145f2] Start _get_guest_xml network_info=[{"id": "9a63b660-0280-42b9-868c-dbf0c26ee995", "address": "fa:16:3e:ed:a5:68", "network": {"id": "8b63f2d3-0683-4832-abc5-e4c796cf12ab", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-877608435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3704b38a2bd44cb78c28d3f6d86d9e60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a63b660-02", "ovs_interfaceid": "9a63b660-0280-42b9-868c-dbf0c26ee995", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T15:35:12Z,direct_url=<?>,disk_format='qcow2',id=1f41819e-c93f-4dc7-b253-37a27bbbbc74,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1b91c5d0672c4224a48df2e1f92688e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T15:35:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'size': 0, 'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'image_id': '1f41819e-c93f-4dc7-b253-37a27bbbbc74'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75176) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 15:42:56 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-149e1479-bd5e-470e-879a-5fdd569a7e48 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 15:42:56 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-149e1479-bd5e-470e-879a-5fdd569a7e48 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 15:42:56 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-149e1479-bd5e-470e-879a-5fdd569a7e48 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75176) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 15:42:56 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-149e1479-bd5e-470e-879a-5fdd569a7e48 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] CPU controller missing on host. {{(pid=75176) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 15:42:56 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-149e1479-bd5e-470e-879a-5fdd569a7e48 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75176) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 15:42:56 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-149e1479-bd5e-470e-879a-5fdd569a7e48 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] CPU controller found on host. {{(pid=75176) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 15:42:56 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-149e1479-bd5e-470e-879a-5fdd569a7e48 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75176) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 15:42:56 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-149e1479-bd5e-470e-879a-5fdd569a7e48 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T15:35:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T15:35:12Z,direct_url=<?>,disk_format='qcow2',id=1f41819e-c93f-4dc7-b253-37a27bbbbc74,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1b91c5d0672c4224a48df2e1f92688e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T15:35:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 15:42:56 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-149e1479-bd5e-470e-879a-5fdd569a7e48 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Flavor limits 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 15:42:56 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-149e1479-bd5e-470e-879a-5fdd569a7e48 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Image limits 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 15:42:56 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-149e1479-bd5e-470e-879a-5fdd569a7e48 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Flavor pref 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 15:42:56 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-149e1479-bd5e-470e-879a-5fdd569a7e48 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Image pref 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 15:42:56 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-149e1479-bd5e-470e-879a-5fdd569a7e48 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 15:42:56 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-149e1479-bd5e-470e-879a-5fdd569a7e48 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 15:42:56 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-149e1479-bd5e-470e-879a-5fdd569a7e48 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75176) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 15:42:56 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-149e1479-bd5e-470e-879a-5fdd569a7e48 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Got 1 possible topologies {{(pid=75176) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 15:42:56 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-149e1479-bd5e-470e-879a-5fdd569a7e48 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 15:42:56 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-149e1479-bd5e-470e-879a-5fdd569a7e48 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 15:42:56 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-149e1479-bd5e-470e-879a-5fdd569a7e48 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T15:42:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-675567476',display_name='tempest-tempest.common.compute-instance-675567476',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-675567476',id=15,image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGHQgrfEWt8pIfRnhBJ24kFyu29uELDK7Re5fQAvns3FKElXmrGxqyeLKhrovaGXrIG8CV9ozkAnryzObqKasCPi8GMPgqqgdQkjAV0c1Qea28G7qtna2/64n19K46tX/A==',key_name='tempest-keypair-1504939882',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3704b38a2bd44cb78c28d3f6d86d9e60',ramdisk_id='',reservation_id='r-2pd1l9gx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-680502445',owner_user_name='tempest-ServerActionsTestOtherA-680502445-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T15:42:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d028b79a105b485dbb0178c9da162640',uuid=e02d1e69-5e74-43c3-8546-6044d31145f2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9a63b660-0280-42b9-868c-dbf0c26ee995", "address": "fa:16:3e:ed:a5:68", "network": {"id": "8b63f2d3-0683-4832-abc5-e4c796cf12ab", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-877608435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3704b38a2bd44cb78c28d3f6d86d9e60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a63b660-02", "ovs_interfaceid": "9a63b660-0280-42b9-868c-dbf0c26ee995", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75176) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 15:42:56 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-149e1479-bd5e-470e-879a-5fdd569a7e48 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Converting VIF {"id": "9a63b660-0280-42b9-868c-dbf0c26ee995", "address": "fa:16:3e:ed:a5:68", "network": {"id": "8b63f2d3-0683-4832-abc5-e4c796cf12ab", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-877608435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3704b38a2bd44cb78c28d3f6d86d9e60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a63b660-02", "ovs_interfaceid": "9a63b660-0280-42b9-868c-dbf0c26ee995", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:42:56 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-149e1479-bd5e-470e-879a-5fdd569a7e48 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:a5:68,bridge_name='br-int',has_traffic_filtering=True,id=9a63b660-0280-42b9-868c-dbf0c26ee995,network=Network(8b63f2d3-0683-4832-abc5-e4c796cf12ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a63b660-02') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:42:56 user nova-compute[75176]: DEBUG nova.objects.instance [None req-149e1479-bd5e-470e-879a-5fdd569a7e48 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Lazy-loading 'pci_devices' on Instance uuid e02d1e69-5e74-43c3-8546-6044d31145f2 {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:42:56 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-149e1479-bd5e-470e-879a-5fdd569a7e48 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] [instance: e02d1e69-5e74-43c3-8546-6044d31145f2] End _get_guest_xml xml=<domain type="kvm">
Nov 28 15:42:56 user nova-compute[75176]:   <uuid>e02d1e69-5e74-43c3-8546-6044d31145f2</uuid>
Nov 28 15:42:56 user nova-compute[75176]:   <name>instance-0000000f</name>
Nov 28 15:42:56 user nova-compute[75176]:   <memory>524288</memory>
Nov 28 15:42:56 user nova-compute[75176]:   <vcpu>1</vcpu>
Nov 28 15:42:56 user nova-compute[75176]:   <metadata>
Nov 28 15:42:56 user nova-compute[75176]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 15:42:56 user nova-compute[75176]:       <nova:package version="0.0.0"/>
Nov 28 15:42:56 user nova-compute[75176]:       <nova:name>tempest-tempest.common.compute-instance-675567476</nova:name>
Nov 28 15:42:56 user nova-compute[75176]:       <nova:creationTime>2023-11-28 15:42:56</nova:creationTime>
Nov 28 15:42:56 user nova-compute[75176]:       <nova:flavor name="m1.tiny">
Nov 28 15:42:56 user nova-compute[75176]:         <nova:memory>512</nova:memory>
Nov 28 15:42:56 user nova-compute[75176]:         <nova:disk>1</nova:disk>
Nov 28 15:42:56 user nova-compute[75176]:         <nova:swap>0</nova:swap>
Nov 28 15:42:56 user nova-compute[75176]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 15:42:56 user nova-compute[75176]:         <nova:vcpus>1</nova:vcpus>
Nov 28 15:42:56 user nova-compute[75176]:       </nova:flavor>
Nov 28 15:42:56 user nova-compute[75176]:       <nova:owner>
Nov 28 15:42:56 user nova-compute[75176]:         <nova:user uuid="d028b79a105b485dbb0178c9da162640">tempest-ServerActionsTestOtherA-680502445-project-member</nova:user>
Nov 28 15:42:56 user nova-compute[75176]:         <nova:project uuid="3704b38a2bd44cb78c28d3f6d86d9e60">tempest-ServerActionsTestOtherA-680502445</nova:project>
Nov 28 15:42:56 user nova-compute[75176]:       </nova:owner>
Nov 28 15:42:56 user nova-compute[75176]:       <nova:root type="image" uuid="1f41819e-c93f-4dc7-b253-37a27bbbbc74"/>
Nov 28 15:42:56 user nova-compute[75176]:       <nova:ports>
Nov 28 15:42:56 user nova-compute[75176]:         <nova:port uuid="9a63b660-0280-42b9-868c-dbf0c26ee995">
Nov 28 15:42:56 user nova-compute[75176]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 28 15:42:56 user nova-compute[75176]:         </nova:port>
Nov 28 15:42:56 user nova-compute[75176]:       </nova:ports>
Nov 28 15:42:56 user nova-compute[75176]:     </nova:instance>
Nov 28 15:42:56 user nova-compute[75176]:   </metadata>
Nov 28 15:42:56 user nova-compute[75176]:   <sysinfo type="smbios">
Nov 28 15:42:56 user nova-compute[75176]:     <system>
Nov 28 15:42:56 user nova-compute[75176]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 15:42:56 user nova-compute[75176]:       <entry name="product">OpenStack Nova</entry>
Nov 28 15:42:56 user nova-compute[75176]:       <entry name="version">0.0.0</entry>
Nov 28 15:42:56 user nova-compute[75176]:       <entry name="serial">e02d1e69-5e74-43c3-8546-6044d31145f2</entry>
Nov 28 15:42:56 user nova-compute[75176]:       <entry name="uuid">e02d1e69-5e74-43c3-8546-6044d31145f2</entry>
Nov 28 15:42:56 user nova-compute[75176]:       <entry name="family">Virtual Machine</entry>
Nov 28 15:42:56 user nova-compute[75176]:     </system>
Nov 28 15:42:56 user nova-compute[75176]:   </sysinfo>
Nov 28 15:42:56 user nova-compute[75176]:   <os>
Nov 28 15:42:56 user nova-compute[75176]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 15:42:56 user nova-compute[75176]:     <boot dev="hd"/>
Nov 28 15:42:56 user nova-compute[75176]:     <smbios mode="sysinfo"/>
Nov 28 15:42:56 user nova-compute[75176]:   </os>
Nov 28 15:42:56 user nova-compute[75176]:   <features>
Nov 28 15:42:56 user nova-compute[75176]:     <acpi/>
Nov 28 15:42:56 user nova-compute[75176]:     <apic/>
Nov 28 15:42:56 user nova-compute[75176]:     <vmcoreinfo/>
Nov 28 15:42:56 user nova-compute[75176]:   </features>
Nov 28 15:42:56 user nova-compute[75176]:   <clock offset="utc">
Nov 28 15:42:56 user nova-compute[75176]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 15:42:56 user nova-compute[75176]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 15:42:56 user nova-compute[75176]:     <timer name="hpet" present="no"/>
Nov 28 15:42:56 user nova-compute[75176]:   </clock>
Nov 28 15:42:56 user nova-compute[75176]:   <cpu mode="custom" match="exact">
Nov 28 15:42:56 user nova-compute[75176]:     <model>Nehalem</model>
Nov 28 15:42:56 user nova-compute[75176]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 15:42:56 user nova-compute[75176]:   </cpu>
Nov 28 15:42:56 user nova-compute[75176]:   <devices>
Nov 28 15:42:56 user nova-compute[75176]:     <disk type="file" device="disk">
Nov 28 15:42:56 user nova-compute[75176]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 15:42:56 user nova-compute[75176]:       <source file="/opt/stack/data/nova/instances/e02d1e69-5e74-43c3-8546-6044d31145f2/disk"/>
Nov 28 15:42:56 user nova-compute[75176]:       <target dev="vda" bus="virtio"/>
Nov 28 15:42:56 user nova-compute[75176]:     </disk>
Nov 28 15:42:56 user nova-compute[75176]:     <interface type="ethernet">
Nov 28 15:42:56 user nova-compute[75176]:       <mac address="fa:16:3e:ed:a5:68"/>
Nov 28 15:42:56 user nova-compute[75176]:       <model type="virtio"/>
Nov 28 15:42:56 user nova-compute[75176]:       <mtu size="1442"/>
Nov 28 15:42:56 user nova-compute[75176]:       <target dev="tap9a63b660-02"/>
Nov 28 15:42:56 user nova-compute[75176]:     </interface>
Nov 28 15:42:56 user nova-compute[75176]:     <serial type="pty">
Nov 28 15:42:56 user nova-compute[75176]:       <log file="/opt/stack/data/nova/instances/e02d1e69-5e74-43c3-8546-6044d31145f2/console.log" append="off"/>
Nov 28 15:42:56 user nova-compute[75176]:     </serial>
Nov 28 15:42:56 user nova-compute[75176]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 15:42:56 user nova-compute[75176]:     <video>
Nov 28 15:42:56 user nova-compute[75176]:       <model type="virtio"/>
Nov 28 15:42:56 user nova-compute[75176]:     </video>
Nov 28 15:42:56 user nova-compute[75176]:     <rng model="virtio">
Nov 28 15:42:56 user nova-compute[75176]:       <backend model="random">/dev/urandom</backend>
Nov 28 15:42:56 user nova-compute[75176]:     </rng>
Nov 28 15:42:56 user nova-compute[75176]:     <controller type="usb" index="0" model="none"/>
Nov 28 15:42:56 user nova-compute[75176]:     <memballoon model="virtio">
Nov 28 15:42:56 user nova-compute[75176]:       <stats period="10"/>
Nov 28 15:42:56 user nova-compute[75176]:     </memballoon>
Nov 28 15:42:56 user nova-compute[75176]:   </devices>
Nov 28 15:42:56 user nova-compute[75176]: </domain>
Nov 28 15:42:56 user nova-compute[75176]:  {{(pid=75176) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 15:42:56 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-149e1479-bd5e-470e-879a-5fdd569a7e48 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T15:42:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-675567476',display_name='tempest-tempest.common.compute-instance-675567476',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-675567476',id=15,image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGHQgrfEWt8pIfRnhBJ24kFyu29uELDK7Re5fQAvns3FKElXmrGxqyeLKhrovaGXrIG8CV9ozkAnryzObqKasCPi8GMPgqqgdQkjAV0c1Qea28G7qtna2/64n19K46tX/A==',key_name='tempest-keypair-1504939882',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3704b38a2bd44cb78c28d3f6d86d9e60',ramdisk_id='',reservation_id='r-2pd1l9gx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-680502445',owner_user_name='tempest-ServerActionsTestOtherA-680502445-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T15:42:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d028b79a105b485dbb0178c9da162640',uuid=e02d1e69-5e74-43c3-8546-6044d31145f2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9a63b660-0280-42b9-868c-dbf0c26ee995", "address": "fa:16:3e:ed:a5:68", "network": {"id": "8b63f2d3-0683-4832-abc5-e4c796cf12ab", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-877608435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3704b38a2bd44cb78c28d3f6d86d9e60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a63b660-02", "ovs_interfaceid": "9a63b660-0280-42b9-868c-dbf0c26ee995", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 15:42:56 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-149e1479-bd5e-470e-879a-5fdd569a7e48 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Converting VIF {"id": "9a63b660-0280-42b9-868c-dbf0c26ee995", "address": "fa:16:3e:ed:a5:68", "network": {"id": "8b63f2d3-0683-4832-abc5-e4c796cf12ab", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-877608435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3704b38a2bd44cb78c28d3f6d86d9e60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a63b660-02", "ovs_interfaceid": "9a63b660-0280-42b9-868c-dbf0c26ee995", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:42:56 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-149e1479-bd5e-470e-879a-5fdd569a7e48 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:a5:68,bridge_name='br-int',has_traffic_filtering=True,id=9a63b660-0280-42b9-868c-dbf0c26ee995,network=Network(8b63f2d3-0683-4832-abc5-e4c796cf12ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a63b660-02') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:42:56 user nova-compute[75176]: DEBUG os_vif [None req-149e1479-bd5e-470e-879a-5fdd569a7e48 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:a5:68,bridge_name='br-int',has_traffic_filtering=True,id=9a63b660-0280-42b9-868c-dbf0c26ee995,network=Network(8b63f2d3-0683-4832-abc5-e4c796cf12ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a63b660-02') {{(pid=75176) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 15:42:56 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:42:56 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:42:56 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 15:42:56 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:42:56 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '59dd224e-5254-5084-afeb-e95da265db27', '_type': 'linux-noop'}}, row=False) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:42:56 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:42:56 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:42:56 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:42:56 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9a63b660-02, may_exist=True, interface_attrs={}) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:42:56 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9a63b660-02, col_values=(('qos', UUID('28c73d2c-3dd3-415f-b3c3-d675d7131424')),), if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:42:56 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9a63b660-02, col_values=(('external_ids', {'iface-id': '9a63b660-0280-42b9-868c-dbf0c26ee995', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ed:a5:68', 'vm-uuid': 'e02d1e69-5e74-43c3-8546-6044d31145f2'}),), if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:42:56 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:42:56 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:42:56 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:42:56 user nova-compute[75176]: INFO os_vif [None req-149e1479-bd5e-470e-879a-5fdd569a7e48 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:a5:68,bridge_name='br-int',has_traffic_filtering=True,id=9a63b660-0280-42b9-868c-dbf0c26ee995,network=Network(8b63f2d3-0683-4832-abc5-e4c796cf12ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a63b660-02')
Nov 28 15:42:56 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-149e1479-bd5e-470e-879a-5fdd569a7e48 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] No BDM found with device name vda, not building metadata. {{(pid=75176) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 15:42:56 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-149e1479-bd5e-470e-879a-5fdd569a7e48 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] No VIF found with MAC fa:16:3e:ed:a5:68, not building metadata {{(pid=75176) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 15:42:56 user nova-compute[75176]: INFO nova.compute.manager [None req-405e61d5-a252-429c-965e-9f55fce4f3c0 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] [instance: 6ab0619f-72e5-4975-ade8-53d7c0784d89] Rescuing
Nov 28 15:42:56 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-405e61d5-a252-429c-965e-9f55fce4f3c0 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] Acquiring lock "refresh_cache-6ab0619f-72e5-4975-ade8-53d7c0784d89" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:42:56 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-405e61d5-a252-429c-965e-9f55fce4f3c0 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] Acquired lock "refresh_cache-6ab0619f-72e5-4975-ade8-53d7c0784d89" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:42:56 user nova-compute[75176]: DEBUG nova.network.neutron [None req-405e61d5-a252-429c-965e-9f55fce4f3c0 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] [instance: 6ab0619f-72e5-4975-ade8-53d7c0784d89] Building network info cache for instance {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 15:42:57 user nova-compute[75176]: DEBUG nova.network.neutron [req-5a02d702-0a12-4b91-980f-6ce0bf8526f1 req-23615908-e12c-4af2-a401-6b6fbb7fc52f service nova] [instance: e02d1e69-5e74-43c3-8546-6044d31145f2] Updated VIF entry in instance network info cache for port 9a63b660-0280-42b9-868c-dbf0c26ee995. {{(pid=75176) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 15:42:57 user nova-compute[75176]: DEBUG nova.network.neutron [req-5a02d702-0a12-4b91-980f-6ce0bf8526f1 req-23615908-e12c-4af2-a401-6b6fbb7fc52f service nova] [instance: e02d1e69-5e74-43c3-8546-6044d31145f2] Updating instance_info_cache with network_info: [{"id": "9a63b660-0280-42b9-868c-dbf0c26ee995", "address": "fa:16:3e:ed:a5:68", "network": {"id": "8b63f2d3-0683-4832-abc5-e4c796cf12ab", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-877608435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3704b38a2bd44cb78c28d3f6d86d9e60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a63b660-02", "ovs_interfaceid": "9a63b660-0280-42b9-868c-dbf0c26ee995", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:42:57 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-5a02d702-0a12-4b91-980f-6ce0bf8526f1 req-23615908-e12c-4af2-a401-6b6fbb7fc52f service nova] Releasing lock "refresh_cache-e02d1e69-5e74-43c3-8546-6044d31145f2" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:42:57 user nova-compute[75176]: DEBUG nova.network.neutron [None req-405e61d5-a252-429c-965e-9f55fce4f3c0 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] [instance: 6ab0619f-72e5-4975-ade8-53d7c0784d89] Updating instance_info_cache with network_info: [{"id": "63e3a2a2-51d4-4899-806d-c3222f643878", "address": "fa:16:3e:4d:46:79", "network": {"id": "84bcb9a8-0292-4eed-a9eb-2a883619389c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1655598964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fa05294c527426383c66fe58b31c825", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63e3a2a2-51", "ovs_interfaceid": "63e3a2a2-51d4-4899-806d-c3222f643878", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:42:57 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-405e61d5-a252-429c-965e-9f55fce4f3c0 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] Releasing lock "refresh_cache-6ab0619f-72e5-4975-ade8-53d7c0784d89" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:42:57 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:42:57 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:42:57 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:42:57 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:42:58 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:42:58 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:42:58 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:42:58 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:42:58 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b92abc4f-9174-4153-84d3-9ae5c64ca0f0 tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] [instance: aa223c49-d254-4727-8a01-873026847b37] Calling os-brick to attach iSCSI Volume {{(pid=75176) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 15:42:58 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-b92abc4f-9174-4153-84d3-9ae5c64ca0f0 tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c1b8a00>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AVKGrjOB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 15:42:58 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-b92abc4f-9174-4153-84d3-9ae5c64ca0f0 tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 15:42:58 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-b92abc4f-9174-4153-84d3-9ae5c64ca0f0 tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 15:42:58 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-b92abc4f-9174-4153-84d3-9ae5c64ca0f0 tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 15:42:58 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-b92abc4f-9174-4153-84d3-9ae5c64ca0f0 tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 15:42:58 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-b92abc4f-9174-4153-84d3-9ae5c64ca0f0 tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 15:42:58 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-b92abc4f-9174-4153-84d3-9ae5c64ca0f0 tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 15:42:58 user nova-compute[75176]: INFO os_brick.initiator.connectors.iscsi [None req-b92abc4f-9174-4153-84d3-9ae5c64ca0f0 tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 15:42:58 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d -p 172.16.0.220:3260 {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:42:58 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:42:58 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b580653-2dc2-4be2-a25f-a72d459622c4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:42:58 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-b92abc4f-9174-4153-84d3-9ae5c64ca0f0 tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 15:42:58 user nova-compute[75176]:  {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:42:58 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d -p 172.16.0.220:3260 --interface default --op new {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:42:58 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:42:58 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[d07cda67-4041-46cc-9f7a-e5632b82d198]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d] added\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:42:58 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-b92abc4f-9174-4153-84d3-9ae5c64ca0f0 tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d] added
Nov 28 15:42:58 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:42:58 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:42:58 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.036s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:42:58 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[f58c9cf4-80df-4839-8840-21b856f42b25]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:42:58 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-b92abc4f-9174-4153-84d3-9ae5c64ca0f0 tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:42:58 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:42:58 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:42:58 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[61933e5c-e86b-4709-99c1-925f7d03a6da]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:42:58 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-b92abc4f-9174-4153-84d3-9ae5c64ca0f0 tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:42:58 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AVKGrjOB {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:42:58 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AVKGrjOB" returned: 0 in 0.029s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:42:58 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[bda83f00-9105-41b1-b281-15f0775749a5]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:42:58 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-b92abc4f-9174-4153-84d3-9ae5c64ca0f0 tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AVKGrjOB'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:42:58 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:42:58 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.031s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:42:58 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[b37338dd-1162-451b-a8ec-9d3ca1b8a386]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:42:58 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-b92abc4f-9174-4153-84d3-9ae5c64ca0f0 tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:42:58 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:42:58 user nova-compute[75176]: DEBUG nova.compute.manager [req-44ed6cbc-0d6b-478b-83ff-233553526035 req-18aa74f9-3a54-4bf2-8c3b-5c9c92f5152c service nova] [instance: e02d1e69-5e74-43c3-8546-6044d31145f2] Received event network-vif-plugged-9a63b660-0280-42b9-868c-dbf0c26ee995 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:42:58 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-44ed6cbc-0d6b-478b-83ff-233553526035 req-18aa74f9-3a54-4bf2-8c3b-5c9c92f5152c service nova] Acquiring lock "e02d1e69-5e74-43c3-8546-6044d31145f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:42:58 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-44ed6cbc-0d6b-478b-83ff-233553526035 req-18aa74f9-3a54-4bf2-8c3b-5c9c92f5152c service nova] Lock "e02d1e69-5e74-43c3-8546-6044d31145f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:42:58 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-44ed6cbc-0d6b-478b-83ff-233553526035 req-18aa74f9-3a54-4bf2-8c3b-5c9c92f5152c service nova] Lock "e02d1e69-5e74-43c3-8546-6044d31145f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:42:58 user nova-compute[75176]: DEBUG nova.compute.manager [req-44ed6cbc-0d6b-478b-83ff-233553526035 req-18aa74f9-3a54-4bf2-8c3b-5c9c92f5152c service nova] [instance: e02d1e69-5e74-43c3-8546-6044d31145f2] No waiting events found dispatching network-vif-plugged-9a63b660-0280-42b9-868c-dbf0c26ee995 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:42:58 user nova-compute[75176]: WARNING nova.compute.manager [req-44ed6cbc-0d6b-478b-83ff-233553526035 req-18aa74f9-3a54-4bf2-8c3b-5c9c92f5152c service nova] [instance: e02d1e69-5e74-43c3-8546-6044d31145f2] Received unexpected event network-vif-plugged-9a63b660-0280-42b9-868c-dbf0c26ee995 for instance with vm_state building and task_state spawning.
Nov 28 15:42:58 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:42:58 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad22dd1c-16e1-40d3-8521-270e43180d74]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bb22dca-8491-42ef-815f-7b0c0ca4be5a (non-flash)\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:42:58 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-b92abc4f-9174-4153-84d3-9ae5c64ca0f0 tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9 (non-flash)
Nov 28 15:42:58 user nova-compute[75176]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bb22dca-8491-42ef-815f-7b0c0ca4be5a (non-flash)
Nov 28 15:42:58 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:42:58 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-b92abc4f-9174-4153-84d3-9ae5c64ca0f0 tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9 (non-flash)
Nov 28 15:42:58 user nova-compute[75176]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bb22dca-8491-42ef-815f-7b0c0ca4be5a (non-flash)
Nov 28 15:42:58 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 15:42:58 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d -p 172.16.0.220:3260 --login {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:42:58 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:42:58 user nova-compute[75176]: DEBUG nova.compute.manager [req-f6d8c541-39cd-4e60-89a4-4b349a8eece1 req-07144afd-16f1-4f31-bbc5-1f0b1f4831c8 service nova] [instance: 6ab0619f-72e5-4975-ade8-53d7c0784d89] Received event network-vif-unplugged-63e3a2a2-51d4-4899-806d-c3222f643878 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:42:58 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-f6d8c541-39cd-4e60-89a4-4b349a8eece1 req-07144afd-16f1-4f31-bbc5-1f0b1f4831c8 service nova] Acquiring lock "6ab0619f-72e5-4975-ade8-53d7c0784d89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:42:58 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-f6d8c541-39cd-4e60-89a4-4b349a8eece1 req-07144afd-16f1-4f31-bbc5-1f0b1f4831c8 service nova] Lock "6ab0619f-72e5-4975-ade8-53d7c0784d89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:42:58 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-f6d8c541-39cd-4e60-89a4-4b349a8eece1 req-07144afd-16f1-4f31-bbc5-1f0b1f4831c8 service nova] Lock "6ab0619f-72e5-4975-ade8-53d7c0784d89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:42:58 user nova-compute[75176]: DEBUG nova.compute.manager [req-f6d8c541-39cd-4e60-89a4-4b349a8eece1 req-07144afd-16f1-4f31-bbc5-1f0b1f4831c8 service nova] [instance: 6ab0619f-72e5-4975-ade8-53d7c0784d89] No waiting events found dispatching network-vif-unplugged-63e3a2a2-51d4-4899-806d-c3222f643878 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:42:58 user nova-compute[75176]: WARNING nova.compute.manager [req-f6d8c541-39cd-4e60-89a4-4b349a8eece1 req-07144afd-16f1-4f31-bbc5-1f0b1f4831c8 service nova] [instance: 6ab0619f-72e5-4975-ade8-53d7c0784d89] Received unexpected event network-vif-unplugged-63e3a2a2-51d4-4899-806d-c3222f643878 for instance with vm_state active and task_state rescuing.
Nov 28 15:42:58 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:42:58 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:42:58 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d -p 172.16.0.220:3260 --login" returned: 0 in 0.118s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:42:58 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ea45878-9498-4ad8-b400-4c1d5b44d180]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:42:58 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-b92abc4f-9174-4153-84d3-9ae5c64ca0f0 tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d, portal: 172.16.0.220,3260]
Nov 28 15:42:58 user nova-compute[75176]: Login to [iface: default, target: iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d, portal: 172.16.0.220,3260] successful.
Nov 28 15:42:58 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:42:58 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:42:58 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:42:58 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[92231f66-5e4b-4751-8bdb-83151fda16e3]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:42:58 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-b92abc4f-9174-4153-84d3-9ae5c64ca0f0 tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:42:58 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:42:58 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:42:58 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[85b2235d-f657-47dd-8dc3-55c1e63f62a4]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bb22dca-8491-42ef-815f-7b0c0ca4be5a (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d (non-flash)\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:42:58 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-b92abc4f-9174-4153-84d3-9ae5c64ca0f0 tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9 (non-flash)
Nov 28 15:42:58 user nova-compute[75176]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bb22dca-8491-42ef-815f-7b0c0ca4be5a (non-flash)
Nov 28 15:42:58 user nova-compute[75176]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d (non-flash)
Nov 28 15:42:58 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:42:58 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-b92abc4f-9174-4153-84d3-9ae5c64ca0f0 tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9 (non-flash)
Nov 28 15:42:58 user nova-compute[75176]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bb22dca-8491-42ef-815f-7b0c0ca4be5a (non-flash)
Nov 28 15:42:58 user nova-compute[75176]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d (non-flash)
Nov 28 15:42:58 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 15:42:58 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-b92abc4f-9174-4153-84d3-9ae5c64ca0f0 tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.426s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 15:42:58 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-b92abc4f-9174-4153-84d3-9ae5c64ca0f0 tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Connected to 172.16.0.220:3260 {{(pid=75176) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 15:42:58 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-b92abc4f-9174-4153-84d3-9ae5c64ca0f0 tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] HCTL ('35', '-', '-', 0) found on session 17 with lun 0 {{(pid=75176) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 15:42:58 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-b92abc4f-9174-4153-84d3-9ae5c64ca0f0 tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75176) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 15:42:58 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:42:58 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.025s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:42:58 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[de96890e-adf4-4d3e-a5c5-28129f444b33]: (4, ('- - 0', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:42:58 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-b92abc4f-9174-4153-84d3-9ae5c64ca0f0 tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Searching for a device in session 17 and hctl ['35', '*', '*', 0] yield: None {{(pid=75176) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 15:42:58 user nova-compute[75176]: INFO nova.virt.libvirt.driver [-] [instance: 6ab0619f-72e5-4975-ade8-53d7c0784d89] Instance destroyed successfully.
Nov 28 15:42:58 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-405e61d5-a252-429c-965e-9f55fce4f3c0 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] [instance: 6ab0619f-72e5-4975-ade8-53d7c0784d89] Attempting a stable device rescue
Nov 28 15:42:59 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-405e61d5-a252-429c-965e-9f55fce4f3c0 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=75176) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 28 15:42:59 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-405e61d5-a252-429c-965e-9f55fce4f3c0 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] [instance: 6ab0619f-72e5-4975-ade8-53d7c0784d89] Instance directory exists: not creating {{(pid=75176) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 28 15:42:59 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-405e61d5-a252-429c-965e-9f55fce4f3c0 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] [instance: 6ab0619f-72e5-4975-ade8-53d7c0784d89] Creating image(s)
Nov 28 15:42:59 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-405e61d5-a252-429c-965e-9f55fce4f3c0 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] Acquiring lock "/opt/stack/data/nova/instances/6ab0619f-72e5-4975-ade8-53d7c0784d89/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:42:59 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-405e61d5-a252-429c-965e-9f55fce4f3c0 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] Lock "/opt/stack/data/nova/instances/6ab0619f-72e5-4975-ade8-53d7c0784d89/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:42:59 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-405e61d5-a252-429c-965e-9f55fce4f3c0 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] Lock "/opt/stack/data/nova/instances/6ab0619f-72e5-4975-ade8-53d7c0784d89/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:42:59 user nova-compute[75176]: DEBUG nova.objects.instance [None req-405e61d5-a252-429c-965e-9f55fce4f3c0 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] Lazy-loading 'trusted_certs' on Instance uuid 6ab0619f-72e5-4975-ade8-53d7c0784d89 {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:42:59 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-405e61d5-a252-429c-965e-9f55fce4f3c0 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] Acquiring lock "16cc48526cd7fdbfb566de50bca691060eb0cf71" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:42:59 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-405e61d5-a252-429c-965e-9f55fce4f3c0 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] Lock "16cc48526cd7fdbfb566de50bca691060eb0cf71" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:43:00 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-405e61d5-a252-429c-965e-9f55fce4f3c0 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16cc48526cd7fdbfb566de50bca691060eb0cf71.part --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:43:00 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-b92abc4f-9174-4153-84d3-9ae5c64ca0f0 tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Searching for a device in session 17 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75176) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 15:43:00 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-b92abc4f-9174-4153-84d3-9ae5c64ca0f0 tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AVKGrjOB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75176) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 15:43:00 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-b92abc4f-9174-4153-84d3-9ae5c64ca0f0 tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.312s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 15:43:00 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-b92abc4f-9174-4153-84d3-9ae5c64ca0f0 tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] <== connect_volume: return (2314ms) {'type': 'block', 'scsi_wwn': '26236393065326363', 'path': '/dev/sdd'} {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 15:43:00 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b92abc4f-9174-4153-84d3-9ae5c64ca0f0 tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] [instance: aa223c49-d254-4727-8a01-873026847b37] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26236393065326363', 'path': '/dev/sdd'} {{(pid=75176) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 15:43:00 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:43:00 user nova-compute[75176]: DEBUG nova.compute.manager [req-20aacd7f-2784-4cc1-809f-351e5cdfd621 req-1b3dafbd-504e-41e1-abdd-b19df9744547 service nova] [instance: e02d1e69-5e74-43c3-8546-6044d31145f2] Received event network-vif-plugged-9a63b660-0280-42b9-868c-dbf0c26ee995 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:43:00 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-20aacd7f-2784-4cc1-809f-351e5cdfd621 req-1b3dafbd-504e-41e1-abdd-b19df9744547 service nova] Acquiring lock "e02d1e69-5e74-43c3-8546-6044d31145f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:43:00 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-20aacd7f-2784-4cc1-809f-351e5cdfd621 req-1b3dafbd-504e-41e1-abdd-b19df9744547 service nova] Lock "e02d1e69-5e74-43c3-8546-6044d31145f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:43:00 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-20aacd7f-2784-4cc1-809f-351e5cdfd621 req-1b3dafbd-504e-41e1-abdd-b19df9744547 service nova] Lock "e02d1e69-5e74-43c3-8546-6044d31145f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.007s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:43:00 user nova-compute[75176]: DEBUG nova.compute.manager [req-20aacd7f-2784-4cc1-809f-351e5cdfd621 req-1b3dafbd-504e-41e1-abdd-b19df9744547 service nova] [instance: e02d1e69-5e74-43c3-8546-6044d31145f2] No waiting events found dispatching network-vif-plugged-9a63b660-0280-42b9-868c-dbf0c26ee995 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:43:00 user nova-compute[75176]: WARNING nova.compute.manager [req-20aacd7f-2784-4cc1-809f-351e5cdfd621 req-1b3dafbd-504e-41e1-abdd-b19df9744547 service nova] [instance: e02d1e69-5e74-43c3-8546-6044d31145f2] Received unexpected event network-vif-plugged-9a63b660-0280-42b9-868c-dbf0c26ee995 for instance with vm_state building and task_state spawning.
Nov 28 15:43:00 user nova-compute[75176]: DEBUG nova.objects.instance [None req-b92abc4f-9174-4153-84d3-9ae5c64ca0f0 tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Lazy-loading 'flavor' on Instance uuid aa223c49-d254-4727-8a01-873026847b37 {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:43:00 user nova-compute[75176]: DEBUG nova.compute.manager [req-d8d8d30f-f7f4-4d4a-8775-38e3e90a0ff2 req-e900be40-78aa-4f8d-9fee-faeb470ce83a service nova] [instance: 6ab0619f-72e5-4975-ade8-53d7c0784d89] Received event network-vif-plugged-63e3a2a2-51d4-4899-806d-c3222f643878 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:43:00 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-d8d8d30f-f7f4-4d4a-8775-38e3e90a0ff2 req-e900be40-78aa-4f8d-9fee-faeb470ce83a service nova] Acquiring lock "6ab0619f-72e5-4975-ade8-53d7c0784d89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:43:00 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-d8d8d30f-f7f4-4d4a-8775-38e3e90a0ff2 req-e900be40-78aa-4f8d-9fee-faeb470ce83a service nova] Lock "6ab0619f-72e5-4975-ade8-53d7c0784d89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:43:00 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-d8d8d30f-f7f4-4d4a-8775-38e3e90a0ff2 req-e900be40-78aa-4f8d-9fee-faeb470ce83a service nova] Lock "6ab0619f-72e5-4975-ade8-53d7c0784d89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:43:00 user nova-compute[75176]: DEBUG nova.compute.manager [req-d8d8d30f-f7f4-4d4a-8775-38e3e90a0ff2 req-e900be40-78aa-4f8d-9fee-faeb470ce83a service nova] [instance: 6ab0619f-72e5-4975-ade8-53d7c0784d89] No waiting events found dispatching network-vif-plugged-63e3a2a2-51d4-4899-806d-c3222f643878 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:43:00 user nova-compute[75176]: WARNING nova.compute.manager [req-d8d8d30f-f7f4-4d4a-8775-38e3e90a0ff2 req-e900be40-78aa-4f8d-9fee-faeb470ce83a service nova] [instance: 6ab0619f-72e5-4975-ade8-53d7c0784d89] Received unexpected event network-vif-plugged-63e3a2a2-51d4-4899-806d-c3222f643878 for instance with vm_state active and task_state rescuing.
Nov 28 15:43:00 user nova-compute[75176]: DEBUG nova.virt.libvirt.guest [None req-b92abc4f-9174-4153-84d3-9ae5c64ca0f0 tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 15:43:00 user nova-compute[75176]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 15:43:00 user nova-compute[75176]:   <source dev="/dev/sdd"/>
Nov 28 15:43:00 user nova-compute[75176]:   <target dev="vdb" bus="virtio"/>
Nov 28 15:43:00 user nova-compute[75176]:   <serial>f61f7c78-66f5-45c5-85ac-2b97ed31a24d</serial>
Nov 28 15:43:00 user nova-compute[75176]: </disk>
Nov 28 15:43:00 user nova-compute[75176]:  {{(pid=75176) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 15:43:00 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-405e61d5-a252-429c-965e-9f55fce4f3c0 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16cc48526cd7fdbfb566de50bca691060eb0cf71.part --force-share --output=json" returned: 0 in 0.233s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:43:00 user nova-compute[75176]: DEBUG nova.virt.images [None req-405e61d5-a252-429c-965e-9f55fce4f3c0 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] f4b545c4-b5ff-4653-8098-d334ef754b06 was qcow2, converting to raw {{(pid=75176) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 28 15:43:00 user nova-compute[75176]: DEBUG nova.privsep.utils [None req-405e61d5-a252-429c-965e-9f55fce4f3c0 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75176) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 28 15:43:00 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-405e61d5-a252-429c-965e-9f55fce4f3c0 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/16cc48526cd7fdbfb566de50bca691060eb0cf71.part /opt/stack/data/nova/instances/_base/16cc48526cd7fdbfb566de50bca691060eb0cf71.converted {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:43:01 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-b92abc4f-9174-4153-84d3-9ae5c64ca0f0 tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] No BDM found with device name vda, not building metadata. {{(pid=75176) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 15:43:01 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-b92abc4f-9174-4153-84d3-9ae5c64ca0f0 tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75176) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 15:43:01 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-b92abc4f-9174-4153-84d3-9ae5c64ca0f0 tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] No VIF found with MAC fa:16:3e:ea:a6:1b, not building metadata {{(pid=75176) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 15:43:01 user nova-compute[75176]: DEBUG nova.compute.manager [None req-149e1479-bd5e-470e-879a-5fdd569a7e48 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] [instance: e02d1e69-5e74-43c3-8546-6044d31145f2] Instance event wait completed in 0 seconds for  {{(pid=75176) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 15:43:01 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-149e1479-bd5e-470e-879a-5fdd569a7e48 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] [instance: e02d1e69-5e74-43c3-8546-6044d31145f2] Guest created on hypervisor {{(pid=75176) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 15:43:01 user nova-compute[75176]: INFO nova.virt.libvirt.driver [-] [instance: e02d1e69-5e74-43c3-8546-6044d31145f2] Instance spawned successfully.
Nov 28 15:43:01 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-149e1479-bd5e-470e-879a-5fdd569a7e48 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] [instance: e02d1e69-5e74-43c3-8546-6044d31145f2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 15:43:01 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-149e1479-bd5e-470e-879a-5fdd569a7e48 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] [instance: e02d1e69-5e74-43c3-8546-6044d31145f2] Found default for hw_cdrom_bus of ide {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:43:01 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-149e1479-bd5e-470e-879a-5fdd569a7e48 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] [instance: e02d1e69-5e74-43c3-8546-6044d31145f2] Found default for hw_disk_bus of virtio {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:43:01 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-149e1479-bd5e-470e-879a-5fdd569a7e48 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] [instance: e02d1e69-5e74-43c3-8546-6044d31145f2] Found default for hw_input_bus of None {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:43:01 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-149e1479-bd5e-470e-879a-5fdd569a7e48 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] [instance: e02d1e69-5e74-43c3-8546-6044d31145f2] Found default for hw_pointer_model of None {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:43:01 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-149e1479-bd5e-470e-879a-5fdd569a7e48 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] [instance: e02d1e69-5e74-43c3-8546-6044d31145f2] Found default for hw_video_model of virtio {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:43:01 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-149e1479-bd5e-470e-879a-5fdd569a7e48 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] [instance: e02d1e69-5e74-43c3-8546-6044d31145f2] Found default for hw_vif_model of virtio {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:43:01 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-405e61d5-a252-429c-965e-9f55fce4f3c0 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/16cc48526cd7fdbfb566de50bca691060eb0cf71.part /opt/stack/data/nova/instances/_base/16cc48526cd7fdbfb566de50bca691060eb0cf71.converted" returned: 0 in 0.712s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:43:01 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-405e61d5-a252-429c-965e-9f55fce4f3c0 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16cc48526cd7fdbfb566de50bca691060eb0cf71.converted --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:43:01 user nova-compute[75176]: INFO nova.compute.manager [None req-149e1479-bd5e-470e-879a-5fdd569a7e48 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] [instance: e02d1e69-5e74-43c3-8546-6044d31145f2] Took 7.22 seconds to spawn the instance on the hypervisor.
Nov 28 15:43:01 user nova-compute[75176]: DEBUG nova.compute.manager [None req-149e1479-bd5e-470e-879a-5fdd569a7e48 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] [instance: e02d1e69-5e74-43c3-8546-6044d31145f2] Checking state {{(pid=75176) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 15:43:01 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-b92abc4f-9174-4153-84d3-9ae5c64ca0f0 tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Lock "aa223c49-d254-4727-8a01-873026847b37" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.504s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:43:01 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:43:01 user nova-compute[75176]: INFO nova.compute.manager [None req-149e1479-bd5e-470e-879a-5fdd569a7e48 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] [instance: e02d1e69-5e74-43c3-8546-6044d31145f2] Took 9.24 seconds to build instance.
Nov 28 15:43:01 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-149e1479-bd5e-470e-879a-5fdd569a7e48 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Lock "e02d1e69-5e74-43c3-8546-6044d31145f2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.438s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:43:01 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-405e61d5-a252-429c-965e-9f55fce4f3c0 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16cc48526cd7fdbfb566de50bca691060eb0cf71.converted --force-share --output=json" returned: 0 in 0.180s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:43:01 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-405e61d5-a252-429c-965e-9f55fce4f3c0 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] Lock "16cc48526cd7fdbfb566de50bca691060eb0cf71" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.392s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:43:01 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-405e61d5-a252-429c-965e-9f55fce4f3c0 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] Acquiring lock "16cc48526cd7fdbfb566de50bca691060eb0cf71" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:43:01 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-405e61d5-a252-429c-965e-9f55fce4f3c0 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] Lock "16cc48526cd7fdbfb566de50bca691060eb0cf71" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:43:01 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-405e61d5-a252-429c-965e-9f55fce4f3c0 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16cc48526cd7fdbfb566de50bca691060eb0cf71 --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:43:01 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-405e61d5-a252-429c-965e-9f55fce4f3c0 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16cc48526cd7fdbfb566de50bca691060eb0cf71 --force-share --output=json" returned: 0 in 0.214s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:43:01 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-405e61d5-a252-429c-965e-9f55fce4f3c0 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/16cc48526cd7fdbfb566de50bca691060eb0cf71,backing_fmt=raw /opt/stack/data/nova/instances/6ab0619f-72e5-4975-ade8-53d7c0784d89/disk.rescue {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:43:01 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-405e61d5-a252-429c-965e-9f55fce4f3c0 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/16cc48526cd7fdbfb566de50bca691060eb0cf71,backing_fmt=raw /opt/stack/data/nova/instances/6ab0619f-72e5-4975-ade8-53d7c0784d89/disk.rescue" returned: 0 in 0.064s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:43:01 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-405e61d5-a252-429c-965e-9f55fce4f3c0 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] Lock "16cc48526cd7fdbfb566de50bca691060eb0cf71" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.286s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:43:01 user nova-compute[75176]: DEBUG nova.objects.instance [None req-405e61d5-a252-429c-965e-9f55fce4f3c0 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] Lazy-loading 'migration_context' on Instance uuid 6ab0619f-72e5-4975-ade8-53d7c0784d89 {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:43:01 user nova-compute[75176]: DEBUG nova.objects.base [None req-405e61d5-a252-429c-965e-9f55fce4f3c0 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] Object Instance<6ab0619f-72e5-4975-ade8-53d7c0784d89> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75176) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 15:43:01 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-405e61d5-a252-429c-965e-9f55fce4f3c0 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] [instance: 6ab0619f-72e5-4975-ade8-53d7c0784d89] Created local disks {{(pid=75176) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 15:43:01 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-405e61d5-a252-429c-965e-9f55fce4f3c0 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] [instance: 6ab0619f-72e5-4975-ade8-53d7c0784d89] Start _get_guest_xml network_info=[{"id": "63e3a2a2-51d4-4899-806d-c3222f643878", "address": "fa:16:3e:4d:46:79", "network": {"id": "84bcb9a8-0292-4eed-a9eb-2a883619389c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1655598964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1655598964-network", "vif_mac": "fa:16:3e:4d:46:79"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fa05294c527426383c66fe58b31c825", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63e3a2a2-51", "ovs_interfaceid": "63e3a2a2-51d4-4899-806d-c3222f643878", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T15:35:12Z,direct_url=<?>,disk_format='qcow2',id=1f41819e-c93f-4dc7-b253-37a27bbbbc74,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1b91c5d0672c4224a48df2e1f92688e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T15:35:13Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'f4b545c4-b5ff-4653-8098-d334ef754b06', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'size': 0, 'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'image_id': '1f41819e-c93f-4dc7-b253-37a27bbbbc74'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2bb22dca-8491-42ef-815f-7b0c0ca4be5a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UHFXkSYA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '6ab0619f-72e5-4975-ade8-53d7c0784d89', 'attached_at': '', 'detached_at': '', 'volume_id': '2bb22dca-8491-42ef-815f-7b0c0ca4be5a', 'serial': '2bb22dca-8491-42ef-815f-7b0c0ca4be5a'}, 'guest_format': None, 'device_type': 'disk', 'boot_index': None, 'disk_bus': 'virtio', 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'attachment_id': '5c218884-b9da-4fa6-9dc4-8837bb23d335', 'volume_type': None} {{(pid=75176) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 15:43:01 user nova-compute[75176]: DEBUG nova.objects.instance [None req-405e61d5-a252-429c-965e-9f55fce4f3c0 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] Lazy-loading 'resources' on Instance uuid 6ab0619f-72e5-4975-ade8-53d7c0784d89 {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:43:01 user nova-compute[75176]: DEBUG nova.objects.base [None req-405e61d5-a252-429c-965e-9f55fce4f3c0 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] Object Instance<6ab0619f-72e5-4975-ade8-53d7c0784d89> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75176) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 15:43:01 user nova-compute[75176]: DEBUG nova.objects.instance [None req-405e61d5-a252-429c-965e-9f55fce4f3c0 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] Lazy-loading 'numa_topology' on Instance uuid 6ab0619f-72e5-4975-ade8-53d7c0784d89 {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:43:01 user nova-compute[75176]: DEBUG nova.objects.base [None req-405e61d5-a252-429c-965e-9f55fce4f3c0 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] Object Instance<6ab0619f-72e5-4975-ade8-53d7c0784d89> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75176) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 15:43:01 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-405e61d5-a252-429c-965e-9f55fce4f3c0 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 15:43:01 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-405e61d5-a252-429c-965e-9f55fce4f3c0 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 15:43:01 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-405e61d5-a252-429c-965e-9f55fce4f3c0 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75176) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 15:43:01 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-405e61d5-a252-429c-965e-9f55fce4f3c0 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] CPU controller missing on host. {{(pid=75176) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 15:43:02 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-405e61d5-a252-429c-965e-9f55fce4f3c0 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75176) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 15:43:02 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-405e61d5-a252-429c-965e-9f55fce4f3c0 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] CPU controller found on host. {{(pid=75176) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 15:43:02 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-405e61d5-a252-429c-965e-9f55fce4f3c0 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75176) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 15:43:02 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-405e61d5-a252-429c-965e-9f55fce4f3c0 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T15:35:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T15:35:12Z,direct_url=<?>,disk_format='qcow2',id=1f41819e-c93f-4dc7-b253-37a27bbbbc74,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1b91c5d0672c4224a48df2e1f92688e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T15:35:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 15:43:02 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-405e61d5-a252-429c-965e-9f55fce4f3c0 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] Flavor limits 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 15:43:02 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-405e61d5-a252-429c-965e-9f55fce4f3c0 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] Image limits 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 15:43:02 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-405e61d5-a252-429c-965e-9f55fce4f3c0 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] Flavor pref 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 15:43:02 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-405e61d5-a252-429c-965e-9f55fce4f3c0 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] Image pref 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 15:43:02 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-405e61d5-a252-429c-965e-9f55fce4f3c0 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 15:43:02 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-405e61d5-a252-429c-965e-9f55fce4f3c0 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 15:43:02 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-405e61d5-a252-429c-965e-9f55fce4f3c0 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75176) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 15:43:02 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-405e61d5-a252-429c-965e-9f55fce4f3c0 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] Got 1 possible topologies {{(pid=75176) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 15:43:02 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-405e61d5-a252-429c-965e-9f55fce4f3c0 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 15:43:02 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-405e61d5-a252-429c-965e-9f55fce4f3c0 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 15:43:02 user nova-compute[75176]: DEBUG nova.objects.instance [None req-405e61d5-a252-429c-965e-9f55fce4f3c0 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] Lazy-loading 'vcpu_model' on Instance uuid 6ab0619f-72e5-4975-ade8-53d7c0784d89 {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:43:02 user nova-compute[75176]: DEBUG nova.objects.base [None req-405e61d5-a252-429c-965e-9f55fce4f3c0 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] Object Instance<6ab0619f-72e5-4975-ade8-53d7c0784d89> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75176) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 15:43:02 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-405e61d5-a252-429c-965e-9f55fce4f3c0 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] [instance: 6ab0619f-72e5-4975-ade8-53d7c0784d89] Calling os-brick to attach iSCSI Volume {{(pid=75176) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 15:43:02 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-405e61d5-a252-429c-965e-9f55fce4f3c0 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c1b8a00>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2bb22dca-8491-42ef-815f-7b0c0ca4be5a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UHFXkSYA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 15:43:02 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-405e61d5-a252-429c-965e-9f55fce4f3c0 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 15:43:02 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-405e61d5-a252-429c-965e-9f55fce4f3c0 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 15:43:02 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-405e61d5-a252-429c-965e-9f55fce4f3c0 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 15:43:02 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-405e61d5-a252-429c-965e-9f55fce4f3c0 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 15:43:02 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-405e61d5-a252-429c-965e-9f55fce4f3c0 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2bb22dca-8491-42ef-815f-7b0c0ca4be5a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 15:43:02 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-405e61d5-a252-429c-965e-9f55fce4f3c0 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2bb22dca-8491-42ef-815f-7b0c0ca4be5a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 15:43:02 user nova-compute[75176]: INFO os_brick.initiator.connectors.iscsi [None req-405e61d5-a252-429c-965e-9f55fce4f3c0 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 15:43:02 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2bb22dca-8491-42ef-815f-7b0c0ca4be5a -p 172.16.0.220:3260 {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:43:02 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2bb22dca-8491-42ef-815f-7b0c0ca4be5a -p 172.16.0.220:3260" returned: 0 in 0.019s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:43:02 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[d44b1141-10e4-4f80-b8a9-507096c6d66e]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:2bb22dca-8491-42ef-815f-7b0c0ca4be5a\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = UHFXkSYA\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:43:02 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-405e61d5-a252-429c-965e-9f55fce4f3c0 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 28 15:43:02 user nova-compute[75176]: node.name = iqn.2010-10.org.openstack:2bb22dca-8491-42ef-815f-7b0c0ca4be5a
Nov 28 15:43:02 user nova-compute[75176]: node.tpgt = -1
Nov 28 15:43:02 user nova-compute[75176]: node.startup = automatic
Nov 28 15:43:02 user nova-compute[75176]: node.leading_login = No
Nov 28 15:43:02 user nova-compute[75176]: iface.iscsi_ifacename = default
Nov 28 15:43:02 user nova-compute[75176]: iface.net_ifacename = <empty>
Nov 28 15:43:02 user nova-compute[75176]: iface.ipaddress = <empty>
Nov 28 15:43:02 user nova-compute[75176]: iface.prefix_len = 0
Nov 28 15:43:02 user nova-compute[75176]: iface.hwaddress = <empty>
Nov 28 15:43:02 user nova-compute[75176]: iface.transport_name = tcp
Nov 28 15:43:02 user nova-compute[75176]: iface.initiatorname = <empty>
Nov 28 15:43:02 user nova-compute[75176]: iface.state = <empty>
Nov 28 15:43:02 user nova-compute[75176]: iface.vlan_id = 0
Nov 28 15:43:02 user nova-compute[75176]: iface.vlan_priority = 0
Nov 28 15:43:02 user nova-compute[75176]: iface.vlan_state = <empty>
Nov 28 15:43:02 user nova-compute[75176]: iface.iface_num = 0
Nov 28 15:43:02 user nova-compute[75176]: iface.mtu = 0
Nov 28 15:43:02 user nova-compute[75176]: iface.port = 0
Nov 28 15:43:02 user nova-compute[75176]: iface.bootproto = <empty>
Nov 28 15:43:02 user nova-compute[75176]: iface.subnet_mask = <empty>
Nov 28 15:43:02 user nova-compute[75176]: iface.gateway = <empty>
Nov 28 15:43:02 user nova-compute[75176]: iface.dhcp_alt_client_id_state = <empty>
Nov 28 15:43:02 user nova-compute[75176]: iface.dhcp_alt_client_id = <empty>
Nov 28 15:43:02 user nova-compute[75176]: iface.dhcp_dns = <empty>
Nov 28 15:43:02 user nova-compute[75176]: iface.dhcp_learn_iqn = <empty>
Nov 28 15:43:02 user nova-compute[75176]: iface.dhcp_req_vendor_id_state = <empty>
Nov 28 15:43:02 user nova-compute[75176]: iface.dhcp_vendor_id_state = <empty>
Nov 28 15:43:02 user nova-compute[75176]: iface.dhcp_vendor_id = <empty>
Nov 28 15:43:02 user nova-compute[75176]: iface.dhcp_slp_da = <empty>
Nov 28 15:43:02 user nova-compute[75176]: iface.fragmentation = <empty>
Nov 28 15:43:02 user nova-compute[75176]: iface.gratuitous_arp = <empty>
Nov 28 15:43:02 user nova-compute[75176]: iface.incoming_forwarding = <empty>
Nov 28 15:43:02 user nova-compute[75176]: iface.tos_state = <empty>
Nov 28 15:43:02 user nova-compute[75176]: iface.tos = 0
Nov 28 15:43:02 user nova-compute[75176]: iface.ttl = 0
Nov 28 15:43:02 user nova-compute[75176]: iface.delayed_ack = <empty>
Nov 28 15:43:02 user nova-compute[75176]: iface.tcp_nagle = <empty>
Nov 28 15:43:02 user nova-compute[75176]: iface.tcp_wsf_state = <empty>
Nov 28 15:43:02 user nova-compute[75176]: iface.tcp_wsf = 0
Nov 28 15:43:02 user nova-compute[75176]: iface.tcp_timer_scale = 0
Nov 28 15:43:02 user nova-compute[75176]: iface.tcp_timestamp = <empty>
Nov 28 15:43:02 user nova-compute[75176]: iface.redirect = <empty>
Nov 28 15:43:02 user nova-compute[75176]: iface.def_task_mgmt_timeout = 0
Nov 28 15:43:02 user nova-compute[75176]: iface.header_digest = <empty>
Nov 28 15:43:02 user nova-compute[75176]: iface.data_digest = <empty>
Nov 28 15:43:02 user nova-compute[75176]: iface.immediate_data = <empty>
Nov 28 15:43:02 user nova-compute[75176]: iface.initial_r2t = <empty>
Nov 28 15:43:02 user nova-compute[75176]: iface.data_seq_inorder = <empty>
Nov 28 15:43:02 user nova-compute[75176]: iface.data_pdu_inorder = <empty>
Nov 28 15:43:02 user nova-compute[75176]: iface.erl = 0
Nov 28 15:43:02 user nova-compute[75176]: iface.max_receive_data_len = 0
Nov 28 15:43:02 user nova-compute[75176]: iface.first_burst_len = 0
Nov 28 15:43:02 user nova-compute[75176]: iface.max_outstanding_r2t = 0
Nov 28 15:43:02 user nova-compute[75176]: iface.max_burst_len = 0
Nov 28 15:43:02 user nova-compute[75176]: iface.chap_auth = <empty>
Nov 28 15:43:02 user nova-compute[75176]: iface.bidi_chap = <empty>
Nov 28 15:43:02 user nova-compute[75176]: iface.strict_login_compliance = <empty>
Nov 28 15:43:02 user nova-compute[75176]: iface.discovery_auth = <empty>
Nov 28 15:43:02 user nova-compute[75176]: iface.discovery_logout = <empty>
Nov 28 15:43:02 user nova-compute[75176]: node.discovery_address = <empty>
Nov 28 15:43:02 user nova-compute[75176]: node.discovery_port = 0
Nov 28 15:43:02 user nova-compute[75176]: node.discovery_type = static
Nov 28 15:43:02 user nova-compute[75176]: node.session.initial_cmdsn = 0
Nov 28 15:43:02 user nova-compute[75176]: node.session.initial_login_retry_max = 8
Nov 28 15:43:02 user nova-compute[75176]: node.session.xmit_thread_priority = -20
Nov 28 15:43:02 user nova-compute[75176]: node.session.cmds_max = 128
Nov 28 15:43:02 user nova-compute[75176]: node.session.queue_depth = 32
Nov 28 15:43:02 user nova-compute[75176]: node.session.nr_sessions = 1
Nov 28 15:43:02 user nova-compute[75176]: node.session.auth.authmethod = CHAP
Nov 28 15:43:02 user nova-compute[75176]: node.session.auth.username = UHFXkSYA
Nov 28 15:43:02 user nova-compute[75176]: node.session.auth.password = ***
Nov 28 15:43:02 user nova-compute[75176]: node.session.auth.username_in = <empty>
Nov 28 15:43:02 user nova-compute[75176]: node.session.auth.password_in = <empty>
Nov 28 15:43:02 user nova-compute[75176]: node.session.auth.chap_algs = MD5
Nov 28 15:43:02 user nova-compute[75176]: node.session.timeo.replacement_timeout = 120
Nov 28 15:43:02 user nova-compute[75176]: node.session.err_timeo.abort_timeout = 15
Nov 28 15:43:02 user nova-compute[75176]: node.session.err_timeo.lu_reset_timeout = 30
Nov 28 15:43:02 user nova-compute[75176]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 28 15:43:02 user nova-compute[75176]: node.session.err_timeo.host_reset_timeout = 60
Nov 28 15:43:02 user nova-compute[75176]: node.session.iscsi.FastAbort = Yes
Nov 28 15:43:02 user nova-compute[75176]: node.session.iscsi.InitialR2T = No
Nov 28 15:43:02 user nova-compute[75176]: node.session.iscsi.ImmediateData = Yes
Nov 28 15:43:02 user nova-compute[75176]: node.session.iscsi.FirstBurstLength = 262144
Nov 28 15:43:02 user nova-compute[75176]: node.session.iscsi.MaxBurstLength = 16776192
Nov 28 15:43:02 user nova-compute[75176]: node.session.iscsi.DefaultTime2Retain = 0
Nov 28 15:43:02 user nova-compute[75176]: node.session.iscsi.DefaultTime2Wait = 2
Nov 28 15:43:02 user nova-compute[75176]: node.session.iscsi.MaxConnections = 1
Nov 28 15:43:02 user nova-compute[75176]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 28 15:43:02 user nova-compute[75176]: node.session.iscsi.ERL = 0
Nov 28 15:43:02 user nova-compute[75176]: node.session.scan = manual
Nov 28 15:43:02 user nova-compute[75176]: node.session.reopen_max = 0
Nov 28 15:43:02 user nova-compute[75176]: node.conn[0].address = 172.16.0.220
Nov 28 15:43:02 user nova-compute[75176]: node.conn[0].port = 3260
Nov 28 15:43:02 user nova-compute[75176]: node.conn[0].startup = manual
Nov 28 15:43:02 user nova-compute[75176]: node.conn[0].tcp.window_size = 524288
Nov 28 15:43:02 user nova-compute[75176]: node.conn[0].tcp.type_of_service = 0
Nov 28 15:43:02 user nova-compute[75176]: node.conn[0].timeo.logout_timeout = 15
Nov 28 15:43:02 user nova-compute[75176]: node.conn[0].timeo.login_timeout = 15
Nov 28 15:43:02 user nova-compute[75176]: node.conn[0].timeo.auth_timeout = 45
Nov 28 15:43:02 user nova-compute[75176]: node.conn[0].timeo.noop_out_interval = 5
Nov 28 15:43:02 user nova-compute[75176]: node.conn[0].timeo.noop_out_timeout = 5
Nov 28 15:43:02 user nova-compute[75176]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 28 15:43:02 user nova-compute[75176]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 28 15:43:02 user nova-compute[75176]: node.conn[0].iscsi.HeaderDigest = None
Nov 28 15:43:02 user nova-compute[75176]: node.conn[0].iscsi.DataDigest = None
Nov 28 15:43:02 user nova-compute[75176]: node.conn[0].iscsi.IFMarker = No
Nov 28 15:43:02 user nova-compute[75176]: node.conn[0].iscsi.OFMarker = No
Nov 28 15:43:02 user nova-compute[75176]: # END RECORD
Nov 28 15:43:02 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:43:02 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2bb22dca-8491-42ef-815f-7b0c0ca4be5a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:43:02 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2bb22dca-8491-42ef-815f-7b0c0ca4be5a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:43:02 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa898a4f-8e8e-443a-a9d8-6d4815c1388b]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:43:02 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-405e61d5-a252-429c-965e-9f55fce4f3c0 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:43:02 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2bb22dca-8491-42ef-815f-7b0c0ca4be5a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:43:02 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2bb22dca-8491-42ef-815f-7b0c0ca4be5a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:43:02 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[e25e4919-96d4-4ef6-a10a-95d23013c365]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:43:02 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-405e61d5-a252-429c-965e-9f55fce4f3c0 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:43:02 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2bb22dca-8491-42ef-815f-7b0c0ca4be5a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UHFXkSYA {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:43:02 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2bb22dca-8491-42ef-815f-7b0c0ca4be5a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UHFXkSYA" returned: 0 in 0.018s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:43:02 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[107ca45f-a5e9-40f8-aff6-4a8f4c536fe8]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:43:02 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-405e61d5-a252-429c-965e-9f55fce4f3c0 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UHFXkSYA'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:43:02 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2bb22dca-8491-42ef-815f-7b0c0ca4be5a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:43:02 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2bb22dca-8491-42ef-815f-7b0c0ca4be5a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:43:02 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[292734ed-3345-4f29-830f-e174c81915be]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:43:02 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-405e61d5-a252-429c-965e-9f55fce4f3c0 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:43:02 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:43:02 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:43:02 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[fad6845c-1574-4818-83fb-eb0e6b16df09]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bb22dca-8491-42ef-815f-7b0c0ca4be5a (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d (non-flash)\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:43:02 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-405e61d5-a252-429c-965e-9f55fce4f3c0 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9 (non-flash)
Nov 28 15:43:02 user nova-compute[75176]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bb22dca-8491-42ef-815f-7b0c0ca4be5a (non-flash)
Nov 28 15:43:02 user nova-compute[75176]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d (non-flash)
Nov 28 15:43:02 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:43:02 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-405e61d5-a252-429c-965e-9f55fce4f3c0 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9 (non-flash)
Nov 28 15:43:02 user nova-compute[75176]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bb22dca-8491-42ef-815f-7b0c0ca4be5a (non-flash)
Nov 28 15:43:02 user nova-compute[75176]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d (non-flash)
Nov 28 15:43:02 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 15:43:02 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-405e61d5-a252-429c-965e-9f55fce4f3c0 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2bb22dca-8491-42ef-815f-7b0c0ca4be5a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.148s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 15:43:02 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-405e61d5-a252-429c-965e-9f55fce4f3c0 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] Connected to 172.16.0.220:3260 {{(pid=75176) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 15:43:02 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-405e61d5-a252-429c-965e-9f55fce4f3c0 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] HCTL ('34', '0', '0', 0) found on session 16 with lun 0 {{(pid=75176) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 15:43:02 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-405e61d5-a252-429c-965e-9f55fce4f3c0 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=75176) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 15:43:02 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:43:02 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.014s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:43:02 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d13be67-c605-4473-bcea-068e8941d2a6]: (4, ('0 0 0', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:43:02 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-405e61d5-a252-429c-965e-9f55fce4f3c0 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] Searching for a device in session 16 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=75176) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 15:43:02 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-405e61d5-a252-429c-965e-9f55fce4f3c0 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:2bb22dca-8491-42ef-815f-7b0c0ca4be5a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UHFXkSYA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75176) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 15:43:02 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-405e61d5-a252-429c-965e-9f55fce4f3c0 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.175s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 15:43:02 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-405e61d5-a252-429c-965e-9f55fce4f3c0 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] <== connect_volume: return (177ms) {'type': 'block', 'scsi_wwn': '26338653834333761', 'path': '/dev/sdc'} {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 15:43:02 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-405e61d5-a252-429c-965e-9f55fce4f3c0 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] [instance: 6ab0619f-72e5-4975-ade8-53d7c0784d89] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26338653834333761', 'path': '/dev/sdc'} {{(pid=75176) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 15:43:02 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-405e61d5-a252-429c-965e-9f55fce4f3c0 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T15:38:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1718830929',display_name='tempest-ServerStableDeviceRescueTest-server-1718830929',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1718830929',id=2,image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHSzZ12RXOTrDwh+h18L3phcCN5TGehVmYtmaLi1jyqDEQuZz0snJimoDD3Zw/Z6Ti+jmxi9CB36LPtnz2rNWaG62e3brw+uWVt5sHC24uB4mJRin9Q2z7NtWEfLWyBqdQ==',key_name='tempest-keypair-2016976293',keypairs=<?>,launch_index=0,launched_at=2023-11-28T15:39:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8fa05294c527426383c66fe58b31c825',ramdisk_id='',reservation_id='r-qn2vcowb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1490134813',owner_user_name='tempest-ServerStableDeviceRescueTest-1490134813-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T15:41:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fe7af9ff921c4fcba937dd6b3f93318d',uuid=6ab0619f-72e5-4975-ade8-53d7c0784d89,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "63e3a2a2-51d4-4899-806d-c3222f643878", "address": "fa:16:3e:4d:46:79", "network": {"id": "84bcb9a8-0292-4eed-a9eb-2a883619389c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1655598964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1655598964-network", "vif_mac": "fa:16:3e:4d:46:79"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fa05294c527426383c66fe58b31c825", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63e3a2a2-51", "ovs_interfaceid": "63e3a2a2-51d4-4899-806d-c3222f643878", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75176) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 15:43:02 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-405e61d5-a252-429c-965e-9f55fce4f3c0 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] Converting VIF {"id": "63e3a2a2-51d4-4899-806d-c3222f643878", "address": "fa:16:3e:4d:46:79", "network": {"id": "84bcb9a8-0292-4eed-a9eb-2a883619389c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1655598964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1655598964-network", "vif_mac": "fa:16:3e:4d:46:79"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fa05294c527426383c66fe58b31c825", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63e3a2a2-51", "ovs_interfaceid": "63e3a2a2-51d4-4899-806d-c3222f643878", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:43:02 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-405e61d5-a252-429c-965e-9f55fce4f3c0 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4d:46:79,bridge_name='br-int',has_traffic_filtering=True,id=63e3a2a2-51d4-4899-806d-c3222f643878,network=Network(84bcb9a8-0292-4eed-a9eb-2a883619389c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63e3a2a2-51') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:43:02 user nova-compute[75176]: DEBUG nova.objects.instance [None req-405e61d5-a252-429c-965e-9f55fce4f3c0 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] Lazy-loading 'pci_devices' on Instance uuid 6ab0619f-72e5-4975-ade8-53d7c0784d89 {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:43:02 user nova-compute[75176]: DEBUG nova.objects.base [None req-405e61d5-a252-429c-965e-9f55fce4f3c0 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] Object Instance<6ab0619f-72e5-4975-ade8-53d7c0784d89> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75176) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 15:43:02 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-405e61d5-a252-429c-965e-9f55fce4f3c0 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] [instance: 6ab0619f-72e5-4975-ade8-53d7c0784d89] End _get_guest_xml xml=<domain type="kvm">
Nov 28 15:43:02 user nova-compute[75176]:   <uuid>6ab0619f-72e5-4975-ade8-53d7c0784d89</uuid>
Nov 28 15:43:02 user nova-compute[75176]:   <name>instance-00000002</name>
Nov 28 15:43:02 user nova-compute[75176]:   <memory>524288</memory>
Nov 28 15:43:02 user nova-compute[75176]:   <vcpu>1</vcpu>
Nov 28 15:43:02 user nova-compute[75176]:   <metadata>
Nov 28 15:43:02 user nova-compute[75176]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 15:43:02 user nova-compute[75176]:       <nova:package version="0.0.0"/>
Nov 28 15:43:02 user nova-compute[75176]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1718830929</nova:name>
Nov 28 15:43:02 user nova-compute[75176]:       <nova:creationTime>2023-11-28 15:43:01</nova:creationTime>
Nov 28 15:43:02 user nova-compute[75176]:       <nova:flavor name="m1.tiny">
Nov 28 15:43:02 user nova-compute[75176]:         <nova:memory>512</nova:memory>
Nov 28 15:43:02 user nova-compute[75176]:         <nova:disk>1</nova:disk>
Nov 28 15:43:02 user nova-compute[75176]:         <nova:swap>0</nova:swap>
Nov 28 15:43:02 user nova-compute[75176]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 15:43:02 user nova-compute[75176]:         <nova:vcpus>1</nova:vcpus>
Nov 28 15:43:02 user nova-compute[75176]:       </nova:flavor>
Nov 28 15:43:02 user nova-compute[75176]:       <nova:owner>
Nov 28 15:43:02 user nova-compute[75176]:         <nova:user uuid="fe7af9ff921c4fcba937dd6b3f93318d">tempest-ServerStableDeviceRescueTest-1490134813-project-member</nova:user>
Nov 28 15:43:02 user nova-compute[75176]:         <nova:project uuid="8fa05294c527426383c66fe58b31c825">tempest-ServerStableDeviceRescueTest-1490134813</nova:project>
Nov 28 15:43:02 user nova-compute[75176]:       </nova:owner>
Nov 28 15:43:02 user nova-compute[75176]:       <nova:root type="image" uuid="1f41819e-c93f-4dc7-b253-37a27bbbbc74"/>
Nov 28 15:43:02 user nova-compute[75176]:       <nova:ports>
Nov 28 15:43:02 user nova-compute[75176]:         <nova:port uuid="63e3a2a2-51d4-4899-806d-c3222f643878">
Nov 28 15:43:02 user nova-compute[75176]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 28 15:43:02 user nova-compute[75176]:         </nova:port>
Nov 28 15:43:02 user nova-compute[75176]:       </nova:ports>
Nov 28 15:43:02 user nova-compute[75176]:     </nova:instance>
Nov 28 15:43:02 user nova-compute[75176]:   </metadata>
Nov 28 15:43:02 user nova-compute[75176]:   <sysinfo type="smbios">
Nov 28 15:43:02 user nova-compute[75176]:     <system>
Nov 28 15:43:02 user nova-compute[75176]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 15:43:02 user nova-compute[75176]:       <entry name="product">OpenStack Nova</entry>
Nov 28 15:43:02 user nova-compute[75176]:       <entry name="version">0.0.0</entry>
Nov 28 15:43:02 user nova-compute[75176]:       <entry name="serial">6ab0619f-72e5-4975-ade8-53d7c0784d89</entry>
Nov 28 15:43:02 user nova-compute[75176]:       <entry name="uuid">6ab0619f-72e5-4975-ade8-53d7c0784d89</entry>
Nov 28 15:43:02 user nova-compute[75176]:       <entry name="family">Virtual Machine</entry>
Nov 28 15:43:02 user nova-compute[75176]:     </system>
Nov 28 15:43:02 user nova-compute[75176]:   </sysinfo>
Nov 28 15:43:02 user nova-compute[75176]:   <os>
Nov 28 15:43:02 user nova-compute[75176]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 15:43:02 user nova-compute[75176]:     <smbios mode="sysinfo"/>
Nov 28 15:43:02 user nova-compute[75176]:   </os>
Nov 28 15:43:02 user nova-compute[75176]:   <features>
Nov 28 15:43:02 user nova-compute[75176]:     <acpi/>
Nov 28 15:43:02 user nova-compute[75176]:     <apic/>
Nov 28 15:43:02 user nova-compute[75176]:     <vmcoreinfo/>
Nov 28 15:43:02 user nova-compute[75176]:   </features>
Nov 28 15:43:02 user nova-compute[75176]:   <clock offset="utc">
Nov 28 15:43:02 user nova-compute[75176]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 15:43:02 user nova-compute[75176]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 15:43:02 user nova-compute[75176]:     <timer name="hpet" present="no"/>
Nov 28 15:43:02 user nova-compute[75176]:   </clock>
Nov 28 15:43:02 user nova-compute[75176]:   <cpu mode="custom" match="exact">
Nov 28 15:43:02 user nova-compute[75176]:     <model>Nehalem</model>
Nov 28 15:43:02 user nova-compute[75176]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 15:43:02 user nova-compute[75176]:   </cpu>
Nov 28 15:43:02 user nova-compute[75176]:   <devices>
Nov 28 15:43:02 user nova-compute[75176]:     <disk type="file" device="disk">
Nov 28 15:43:02 user nova-compute[75176]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 15:43:02 user nova-compute[75176]:       <source file="/opt/stack/data/nova/instances/6ab0619f-72e5-4975-ade8-53d7c0784d89/disk"/>
Nov 28 15:43:02 user nova-compute[75176]:       <target dev="vda" bus="virtio"/>
Nov 28 15:43:02 user nova-compute[75176]:     </disk>
Nov 28 15:43:02 user nova-compute[75176]:     <disk type="block" device="disk">
Nov 28 15:43:02 user nova-compute[75176]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 15:43:02 user nova-compute[75176]:       <source dev="/dev/sdc"/>
Nov 28 15:43:02 user nova-compute[75176]:       <target dev="vdb" bus="virtio"/>
Nov 28 15:43:02 user nova-compute[75176]:       <serial>2bb22dca-8491-42ef-815f-7b0c0ca4be5a</serial>
Nov 28 15:43:02 user nova-compute[75176]:     </disk>
Nov 28 15:43:02 user nova-compute[75176]:     <disk type="file" device="disk">
Nov 28 15:43:02 user nova-compute[75176]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 15:43:02 user nova-compute[75176]:       <source file="/opt/stack/data/nova/instances/6ab0619f-72e5-4975-ade8-53d7c0784d89/disk.rescue"/>
Nov 28 15:43:02 user nova-compute[75176]:       <target dev="vdc" bus="virtio"/>
Nov 28 15:43:02 user nova-compute[75176]:       <boot order="1"/>
Nov 28 15:43:02 user nova-compute[75176]:     </disk>
Nov 28 15:43:02 user nova-compute[75176]:     <interface type="ethernet">
Nov 28 15:43:02 user nova-compute[75176]:       <mac address="fa:16:3e:4d:46:79"/>
Nov 28 15:43:02 user nova-compute[75176]:       <model type="virtio"/>
Nov 28 15:43:02 user nova-compute[75176]:       <mtu size="1442"/>
Nov 28 15:43:02 user nova-compute[75176]:       <target dev="tap63e3a2a2-51"/>
Nov 28 15:43:02 user nova-compute[75176]:     </interface>
Nov 28 15:43:02 user nova-compute[75176]:     <serial type="pty">
Nov 28 15:43:02 user nova-compute[75176]:       <log file="/opt/stack/data/nova/instances/6ab0619f-72e5-4975-ade8-53d7c0784d89/console.log" append="off"/>
Nov 28 15:43:02 user nova-compute[75176]:     </serial>
Nov 28 15:43:02 user nova-compute[75176]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 15:43:02 user nova-compute[75176]:     <video>
Nov 28 15:43:02 user nova-compute[75176]:       <model type="virtio"/>
Nov 28 15:43:02 user nova-compute[75176]:     </video>
Nov 28 15:43:02 user nova-compute[75176]:     <rng model="virtio">
Nov 28 15:43:02 user nova-compute[75176]:       <backend model="random">/dev/urandom</backend>
Nov 28 15:43:02 user nova-compute[75176]:     </rng>
Nov 28 15:43:02 user nova-compute[75176]:     <controller type="usb" index="0" model="none"/>
Nov 28 15:43:02 user nova-compute[75176]:     <memballoon model="virtio">
Nov 28 15:43:02 user nova-compute[75176]:       <stats period="10"/>
Nov 28 15:43:02 user nova-compute[75176]:     </memballoon>
Nov 28 15:43:02 user nova-compute[75176]:   </devices>
Nov 28 15:43:02 user nova-compute[75176]: </domain>
Nov 28 15:43:02 user nova-compute[75176]:  {{(pid=75176) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 15:43:02 user nova-compute[75176]: INFO nova.virt.libvirt.driver [-] [instance: 6ab0619f-72e5-4975-ade8-53d7c0784d89] Instance destroyed successfully.
Nov 28 15:43:02 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-405e61d5-a252-429c-965e-9f55fce4f3c0 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] No BDM found with device name vda, not building metadata. {{(pid=75176) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 15:43:02 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-405e61d5-a252-429c-965e-9f55fce4f3c0 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75176) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 15:43:02 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-405e61d5-a252-429c-965e-9f55fce4f3c0 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75176) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 15:43:02 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-405e61d5-a252-429c-965e-9f55fce4f3c0 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] No VIF found with MAC fa:16:3e:4d:46:79, not building metadata {{(pid=75176) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 15:43:03 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:43:03 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:43:04 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:43:04 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:43:04 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:43:04 user nova-compute[75176]: DEBUG nova.compute.manager [None req-e200d3b9-7af9-462c-9291-4228d5ba592a tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] [instance: aa223c49-d254-4727-8a01-873026847b37] Stashing vm_state: active {{(pid=75176) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 28 15:43:04 user nova-compute[75176]: DEBUG nova.compute.manager [req-2447dcfe-f9bd-4185-ad43-8439c1517842 req-273e33ca-f2cf-40cf-b0f1-35994cb63e9c service nova] [instance: 6ab0619f-72e5-4975-ade8-53d7c0784d89] Received event network-vif-plugged-63e3a2a2-51d4-4899-806d-c3222f643878 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:43:04 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-2447dcfe-f9bd-4185-ad43-8439c1517842 req-273e33ca-f2cf-40cf-b0f1-35994cb63e9c service nova] Acquiring lock "6ab0619f-72e5-4975-ade8-53d7c0784d89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:43:04 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-2447dcfe-f9bd-4185-ad43-8439c1517842 req-273e33ca-f2cf-40cf-b0f1-35994cb63e9c service nova] Lock "6ab0619f-72e5-4975-ade8-53d7c0784d89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:43:04 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-2447dcfe-f9bd-4185-ad43-8439c1517842 req-273e33ca-f2cf-40cf-b0f1-35994cb63e9c service nova] Lock "6ab0619f-72e5-4975-ade8-53d7c0784d89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:43:04 user nova-compute[75176]: DEBUG nova.compute.manager [req-2447dcfe-f9bd-4185-ad43-8439c1517842 req-273e33ca-f2cf-40cf-b0f1-35994cb63e9c service nova] [instance: 6ab0619f-72e5-4975-ade8-53d7c0784d89] No waiting events found dispatching network-vif-plugged-63e3a2a2-51d4-4899-806d-c3222f643878 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:43:04 user nova-compute[75176]: WARNING nova.compute.manager [req-2447dcfe-f9bd-4185-ad43-8439c1517842 req-273e33ca-f2cf-40cf-b0f1-35994cb63e9c service nova] [instance: 6ab0619f-72e5-4975-ade8-53d7c0784d89] Received unexpected event network-vif-plugged-63e3a2a2-51d4-4899-806d-c3222f643878 for instance with vm_state active and task_state rescuing.
Nov 28 15:43:04 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:43:04 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-e200d3b9-7af9-462c-9291-4228d5ba592a tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:43:04 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-e200d3b9-7af9-462c-9291-4228d5ba592a tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.005s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:43:04 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:43:04 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:43:04 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-e200d3b9-7af9-462c-9291-4228d5ba592a tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75176) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 15:43:04 user nova-compute[75176]: INFO nova.compute.claims [None req-e200d3b9-7af9-462c-9291-4228d5ba592a tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] [instance: aa223c49-d254-4727-8a01-873026847b37] Claim successful on node user
Nov 28 15:43:04 user nova-compute[75176]: INFO nova.compute.resource_tracker [None req-e200d3b9-7af9-462c-9291-4228d5ba592a tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] [instance: aa223c49-d254-4727-8a01-873026847b37] Updating resource usage from migration e7efec7a-a309-4975-ab53-abdcc8046db8
Nov 28 15:43:05 user nova-compute[75176]: DEBUG nova.compute.provider_tree [None req-e200d3b9-7af9-462c-9291-4228d5ba592a tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Inventory has not changed in ProviderTree for provider: b37848d8-f401-4155-a029-b0ffa09ff85b {{(pid=75176) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 15:43:05 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-e200d3b9-7af9-462c-9291-4228d5ba592a tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Inventory has not changed for provider b37848d8-f401-4155-a029-b0ffa09ff85b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75176) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 15:43:05 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-e200d3b9-7af9-462c-9291-4228d5ba592a tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.615s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:43:05 user nova-compute[75176]: INFO nova.compute.manager [None req-e200d3b9-7af9-462c-9291-4228d5ba592a tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] [instance: aa223c49-d254-4727-8a01-873026847b37] Migrating
Nov 28 15:43:05 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-e200d3b9-7af9-462c-9291-4228d5ba592a tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:43:05 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-e200d3b9-7af9-462c-9291-4228d5ba592a tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Acquired lock "compute-rpcapi-router" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:43:05 user nova-compute[75176]: INFO nova.compute.rpcapi [None req-e200d3b9-7af9-462c-9291-4228d5ba592a tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Nov 28 15:43:05 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-e200d3b9-7af9-462c-9291-4228d5ba592a tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Releasing lock "compute-rpcapi-router" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:43:05 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-e200d3b9-7af9-462c-9291-4228d5ba592a tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Acquiring lock "refresh_cache-aa223c49-d254-4727-8a01-873026847b37" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:43:05 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-e200d3b9-7af9-462c-9291-4228d5ba592a tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Acquired lock "refresh_cache-aa223c49-d254-4727-8a01-873026847b37" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:43:05 user nova-compute[75176]: DEBUG nova.network.neutron [None req-e200d3b9-7af9-462c-9291-4228d5ba592a tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] [instance: aa223c49-d254-4727-8a01-873026847b37] Building network info cache for instance {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 15:43:06 user nova-compute[75176]: DEBUG nova.network.neutron [None req-e200d3b9-7af9-462c-9291-4228d5ba592a tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] [instance: aa223c49-d254-4727-8a01-873026847b37] Updating instance_info_cache with network_info: [{"id": "6514aeb6-8ea4-4a27-a54b-32f650c87957", "address": "fa:16:3e:ea:a6:1b", "network": {"id": "51708ad4-dae1-47fc-bd26-aca8c478ca04", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-279988751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c2fe6bf5e4f4bb3b5d50901bfac0b38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6514aeb6-8e", "ovs_interfaceid": "6514aeb6-8ea4-4a27-a54b-32f650c87957", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:43:06 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-e200d3b9-7af9-462c-9291-4228d5ba592a tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Releasing lock "refresh_cache-aa223c49-d254-4727-8a01-873026847b37" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:43:06 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-e200d3b9-7af9-462c-9291-4228d5ba592a tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] [instance: aa223c49-d254-4727-8a01-873026847b37] Starting migrate_disk_and_power_off {{(pid=75176) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11484}}
Nov 28 15:43:06 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:43:06 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:43:06 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:43:06 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:43:06 user nova-compute[75176]: DEBUG nova.compute.manager [req-5e1cfd3b-cf66-425d-9354-5f759cf23355 req-53326d6b-3def-4efa-a8dd-c337e116486f service nova] [instance: 6ab0619f-72e5-4975-ade8-53d7c0784d89] Received event network-vif-plugged-63e3a2a2-51d4-4899-806d-c3222f643878 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:43:06 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-5e1cfd3b-cf66-425d-9354-5f759cf23355 req-53326d6b-3def-4efa-a8dd-c337e116486f service nova] Acquiring lock "6ab0619f-72e5-4975-ade8-53d7c0784d89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:43:06 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-5e1cfd3b-cf66-425d-9354-5f759cf23355 req-53326d6b-3def-4efa-a8dd-c337e116486f service nova] Lock "6ab0619f-72e5-4975-ade8-53d7c0784d89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:43:06 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-5e1cfd3b-cf66-425d-9354-5f759cf23355 req-53326d6b-3def-4efa-a8dd-c337e116486f service nova] Lock "6ab0619f-72e5-4975-ade8-53d7c0784d89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:43:06 user nova-compute[75176]: DEBUG nova.compute.manager [req-5e1cfd3b-cf66-425d-9354-5f759cf23355 req-53326d6b-3def-4efa-a8dd-c337e116486f service nova] [instance: 6ab0619f-72e5-4975-ade8-53d7c0784d89] No waiting events found dispatching network-vif-plugged-63e3a2a2-51d4-4899-806d-c3222f643878 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:43:06 user nova-compute[75176]: WARNING nova.compute.manager [req-5e1cfd3b-cf66-425d-9354-5f759cf23355 req-53326d6b-3def-4efa-a8dd-c337e116486f service nova] [instance: 6ab0619f-72e5-4975-ade8-53d7c0784d89] Received unexpected event network-vif-plugged-63e3a2a2-51d4-4899-806d-c3222f643878 for instance with vm_state active and task_state rescuing.
Nov 28 15:43:06 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:43:06 user nova-compute[75176]: DEBUG nova.compute.manager [None req-405e61d5-a252-429c-965e-9f55fce4f3c0 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] [instance: 6ab0619f-72e5-4975-ade8-53d7c0784d89] Checking state {{(pid=75176) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 15:43:06 user nova-compute[75176]: DEBUG nova.compute.manager [req-5011ecaa-c7b7-44df-9ee0-632ee8dc4f1f req-d9cb4729-9e93-4620-bf62-63da16118c56 service nova] [instance: aa223c49-d254-4727-8a01-873026847b37] Received event network-vif-unplugged-6514aeb6-8ea4-4a27-a54b-32f650c87957 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:43:06 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-5011ecaa-c7b7-44df-9ee0-632ee8dc4f1f req-d9cb4729-9e93-4620-bf62-63da16118c56 service nova] Acquiring lock "aa223c49-d254-4727-8a01-873026847b37-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:43:06 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-5011ecaa-c7b7-44df-9ee0-632ee8dc4f1f req-d9cb4729-9e93-4620-bf62-63da16118c56 service nova] Lock "aa223c49-d254-4727-8a01-873026847b37-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:43:06 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-5011ecaa-c7b7-44df-9ee0-632ee8dc4f1f req-d9cb4729-9e93-4620-bf62-63da16118c56 service nova] Lock "aa223c49-d254-4727-8a01-873026847b37-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:43:06 user nova-compute[75176]: DEBUG nova.compute.manager [req-5011ecaa-c7b7-44df-9ee0-632ee8dc4f1f req-d9cb4729-9e93-4620-bf62-63da16118c56 service nova] [instance: aa223c49-d254-4727-8a01-873026847b37] No waiting events found dispatching network-vif-unplugged-6514aeb6-8ea4-4a27-a54b-32f650c87957 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:43:06 user nova-compute[75176]: WARNING nova.compute.manager [req-5011ecaa-c7b7-44df-9ee0-632ee8dc4f1f req-d9cb4729-9e93-4620-bf62-63da16118c56 service nova] [instance: aa223c49-d254-4727-8a01-873026847b37] Received unexpected event network-vif-unplugged-6514aeb6-8ea4-4a27-a54b-32f650c87957 for instance with vm_state active and task_state resize_migrating.
Nov 28 15:43:07 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:43:07 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:43:07 user nova-compute[75176]: INFO nova.virt.libvirt.driver [-] [instance: aa223c49-d254-4727-8a01-873026847b37] Instance destroyed successfully.
Nov 28 15:43:07 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-e200d3b9-7af9-462c-9291-4228d5ba592a tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T15:39:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-595327070',display_name='tempest-ServerActionsTestOtherB-server-595327070',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-595327070',id=3,image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG46aaldZ31/SMomPHuTDQH3UTedHGSV4iG8fWtpOqqr4Cywzy71R0Ov1C6XRnOo4sYKyOfCcRfklnh+MSVYzyKoTfjcvtFT0nSQtOBIOaQ8vVTuyCcNwyJ0nmpmqFlJng==',key_name='tempest-keypair-1738862822',keypairs=<?>,launch_index=0,launched_at=2023-11-28T15:39:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='4c2fe6bf5e4f4bb3b5d50901bfac0b38',ramdisk_id='',reservation_id='r-k1by7x80',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-935995346',owner_user_name='tempest-ServerActionsTestOtherB-935995346-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T15:43:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='16ea4be4bcb34749b2f444c4694543b1',uuid=aa223c49-d254-4727-8a01-873026847b37,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6514aeb6-8ea4-4a27-a54b-32f650c87957", "address": "fa:16:3e:ea:a6:1b", "network": {"id": "51708ad4-dae1-47fc-bd26-aca8c478ca04", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-279988751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-279988751-network", "vif_mac": "fa:16:3e:ea:a6:1b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c2fe6bf5e4f4bb3b5d50901bfac0b38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6514aeb6-8e", "ovs_interfaceid": "6514aeb6-8ea4-4a27-a54b-32f650c87957", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 15:43:07 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-e200d3b9-7af9-462c-9291-4228d5ba592a tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Converting VIF {"id": "6514aeb6-8ea4-4a27-a54b-32f650c87957", "address": "fa:16:3e:ea:a6:1b", "network": {"id": "51708ad4-dae1-47fc-bd26-aca8c478ca04", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-279988751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-279988751-network", "vif_mac": "fa:16:3e:ea:a6:1b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c2fe6bf5e4f4bb3b5d50901bfac0b38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6514aeb6-8e", "ovs_interfaceid": "6514aeb6-8ea4-4a27-a54b-32f650c87957", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:43:07 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-e200d3b9-7af9-462c-9291-4228d5ba592a tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ea:a6:1b,bridge_name='br-int',has_traffic_filtering=True,id=6514aeb6-8ea4-4a27-a54b-32f650c87957,network=Network(51708ad4-dae1-47fc-bd26-aca8c478ca04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6514aeb6-8e') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:43:07 user nova-compute[75176]: DEBUG os_vif [None req-e200d3b9-7af9-462c-9291-4228d5ba592a tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ea:a6:1b,bridge_name='br-int',has_traffic_filtering=True,id=6514aeb6-8ea4-4a27-a54b-32f650c87957,network=Network(51708ad4-dae1-47fc-bd26-aca8c478ca04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6514aeb6-8e') {{(pid=75176) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 15:43:07 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:43:07 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6514aeb6-8e, bridge=br-int, if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:43:07 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:43:07 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:43:07 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:43:07 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d7cebcaa-9798-4100-a6bc-2812d59948ba) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:43:07 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:43:07 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:43:07 user nova-compute[75176]: INFO os_vif [None req-e200d3b9-7af9-462c-9291-4228d5ba592a tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ea:a6:1b,bridge_name='br-int',has_traffic_filtering=True,id=6514aeb6-8ea4-4a27-a54b-32f650c87957,network=Network(51708ad4-dae1-47fc-bd26-aca8c478ca04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6514aeb6-8e')
Nov 28 15:43:07 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e200d3b9-7af9-462c-9291-4228d5ba592a tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] [instance: aa223c49-d254-4727-8a01-873026847b37] calling os-brick to detach iSCSI Volume {{(pid=75176) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 15:43:07 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-e200d3b9-7af9-462c-9291-4228d5ba592a tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c1b8a00>, {'target_iqn': 'iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AVKGrjOB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 15:43:07 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-e200d3b9-7af9-462c-9291-4228d5ba592a tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 15:43:07 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-e200d3b9-7af9-462c-9291-4228d5ba592a tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 15:43:07 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-e200d3b9-7af9-462c-9291-4228d5ba592a tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 15:43:07 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:43:07 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:43:07 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[1967f48d-5d26-441b-9a5d-ae9b5b447a24]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2bb22dca-8491-42ef-815f-7b0c0ca4be5a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:43:07 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-e200d3b9-7af9-462c-9291-4228d5ba592a tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 15:43:07 user nova-compute[75176]: No targets found.
Nov 28 15:43:07 user nova-compute[75176]: iSNS:
Nov 28 15:43:07 user nova-compute[75176]: No targets found.
Nov 28 15:43:07 user nova-compute[75176]: STATIC:
Nov 28 15:43:07 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:2bb22dca-8491-42ef-815f-7b0c0ca4be5a
Nov 28 15:43:07 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:43:07 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:43:07 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d
Nov 28 15:43:07 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:43:07 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:43:07 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9
Nov 28 15:43:07 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:43:07 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:43:07 user nova-compute[75176]: FIRMWARE:
Nov 28 15:43:07 user nova-compute[75176]: No targets found.
Nov 28 15:43:07 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:43:07 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-e200d3b9-7af9-462c-9291-4228d5ba592a tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 15:43:07 user nova-compute[75176]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 15:43:07 user nova-compute[75176]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75176) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 15:43:07 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-e200d3b9-7af9-462c-9291-4228d5ba592a tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d', 0)] {{(pid=75176) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 15:43:07 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:43:07 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:43:07 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1291c7d-7b96-457b-94cd-b0c715d49b34]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2bb22dca-8491-42ef-815f-7b0c0ca4be5a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:43:07 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:43:07 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:43:07 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4a483c0-59af-4cae-9aac-93ee0edb47a5]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bb22dca-8491-42ef-815f-7b0c0ca4be5a (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d (non-flash)\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:43:07 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-e200d3b9-7af9-462c-9291-4228d5ba592a tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9 (non-flash)
Nov 28 15:43:07 user nova-compute[75176]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bb22dca-8491-42ef-815f-7b0c0ca4be5a (non-flash)
Nov 28 15:43:07 user nova-compute[75176]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d (non-flash)
Nov 28 15:43:07 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:43:07 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-e200d3b9-7af9-462c-9291-4228d5ba592a tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9 (non-flash)
Nov 28 15:43:07 user nova-compute[75176]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bb22dca-8491-42ef-815f-7b0c0ca4be5a (non-flash)
Nov 28 15:43:07 user nova-compute[75176]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d (non-flash)
Nov 28 15:43:07 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 15:43:07 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-e200d3b9-7af9-462c-9291-4228d5ba592a tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f462c68ac20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d'): ({'sdd'}, set())}) {{(pid=75176) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 15:43:07 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-e200d3b9-7af9-462c-9291-4228d5ba592a tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Removing single pathed devices sdd {{(pid=75176) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 15:43:07 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:43:07 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:43:07 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b1f6a23-9247-4b1f-9fce-db87f709bfa5]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:43:07 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:43:07 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:43:07 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa1b1fe2-2107-478f-a1bf-76756d0959f9]: (4, ('ok\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:43:07 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-e200d3b9-7af9-462c-9291-4228d5ba592a tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Flushing IO for device /dev/sdd {{(pid=75176) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 15:43:07 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:43:07 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:43:07 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[67dea0a1-76e6-470d-9a75-062033a8bdb0]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:43:07 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-e200d3b9-7af9-462c-9291-4228d5ba592a tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75176) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 15:43:07 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:43:07 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:43:07 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.072s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:43:07 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[1846f367-ce41-487a-b12f-02b4d0b5579b]: (4, ('1', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:43:07 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-e200d3b9-7af9-462c-9291-4228d5ba592a tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75176) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 15:43:07 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-e200d3b9-7af9-462c-9291-4228d5ba592a tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] SCSI volumes sdd have been removed. {{(pid=75176) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 15:43:07 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-e200d3b9-7af9-462c-9291-4228d5ba592a tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d')] {{(pid=75176) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 15:43:07 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:43:07 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:43:07 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[31d397ac-1570-4ac9-93cb-7535e4fb91be]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:43:07 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-e200d3b9-7af9-462c-9291-4228d5ba592a tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:43:07 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d -p 172.16.0.220:3260 --logout {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:43:07 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:43:07 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[1549e4eb-06fc-47ba-b881-4157245f00ad]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:43:07 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-e200d3b9-7af9-462c-9291-4228d5ba592a tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d, portal: 172.16.0.220,3260]
Nov 28 15:43:07 user nova-compute[75176]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d, portal: 172.16.0.220,3260] successful.
Nov 28 15:43:07 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:43:07 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d -p 172.16.0.220:3260 --op delete {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:43:07 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:43:07 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[b65a7309-9273-4b0c-ba53-3906651fd8ef]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:43:07 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-e200d3b9-7af9-462c-9291-4228d5ba592a tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:43:07 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-e200d3b9-7af9-462c-9291-4228d5ba592a tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.427s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 15:43:07 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-e200d3b9-7af9-462c-9291-4228d5ba592a tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] <== disconnect_volume: return (428ms) None {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 15:43:07 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e200d3b9-7af9-462c-9291-4228d5ba592a tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] [instance: aa223c49-d254-4727-8a01-873026847b37] Disconnected iSCSI Volume {{(pid=75176) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 15:43:07 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-e200d3b9-7af9-462c-9291-4228d5ba592a tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa223c49-d254-4727-8a01-873026847b37/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:43:07 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:43:07 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-e200d3b9-7af9-462c-9291-4228d5ba592a tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa223c49-d254-4727-8a01-873026847b37/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:43:07 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-e200d3b9-7af9-462c-9291-4228d5ba592a tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa223c49-d254-4727-8a01-873026847b37/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:43:08 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-e200d3b9-7af9-462c-9291-4228d5ba592a tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa223c49-d254-4727-8a01-873026847b37/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:43:08 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-e200d3b9-7af9-462c-9291-4228d5ba592a tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75176) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 15:43:08 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-e200d3b9-7af9-462c-9291-4228d5ba592a tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/aa223c49-d254-4727-8a01-873026847b37_resize/disk /opt/stack/data/nova/instances/aa223c49-d254-4727-8a01-873026847b37/disk {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:43:08 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-e200d3b9-7af9-462c-9291-4228d5ba592a tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] CMD "cp -r /opt/stack/data/nova/instances/aa223c49-d254-4727-8a01-873026847b37_resize/disk /opt/stack/data/nova/instances/aa223c49-d254-4727-8a01-873026847b37/disk" returned: 0 in 0.371s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:43:08 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-e200d3b9-7af9-462c-9291-4228d5ba592a tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/aa223c49-d254-4727-8a01-873026847b37_resize/disk.info /opt/stack/data/nova/instances/aa223c49-d254-4727-8a01-873026847b37/disk.info {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:43:08 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-444d0c88-5eaf-4d9a-8f53-99ba09d8da6b tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Acquiring lock "47306d53-9ad7-4cae-ba6d-1f65239ef30f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:43:08 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-444d0c88-5eaf-4d9a-8f53-99ba09d8da6b tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Lock "47306d53-9ad7-4cae-ba6d-1f65239ef30f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.003s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:43:08 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-e200d3b9-7af9-462c-9291-4228d5ba592a tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] CMD "cp -r /opt/stack/data/nova/instances/aa223c49-d254-4727-8a01-873026847b37_resize/disk.info /opt/stack/data/nova/instances/aa223c49-d254-4727-8a01-873026847b37/disk.info" returned: 0 in 0.096s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:43:08 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:43:08 user nova-compute[75176]: DEBUG nova.objects.instance [None req-444d0c88-5eaf-4d9a-8f53-99ba09d8da6b tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Lazy-loading 'flavor' on Instance uuid 47306d53-9ad7-4cae-ba6d-1f65239ef30f {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:43:08 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-444d0c88-5eaf-4d9a-8f53-99ba09d8da6b tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Lock "47306d53-9ad7-4cae-ba6d-1f65239ef30f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.075s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:43:08 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-444d0c88-5eaf-4d9a-8f53-99ba09d8da6b tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Acquiring lock "47306d53-9ad7-4cae-ba6d-1f65239ef30f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:43:08 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-444d0c88-5eaf-4d9a-8f53-99ba09d8da6b tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Lock "47306d53-9ad7-4cae-ba6d-1f65239ef30f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:43:08 user nova-compute[75176]: INFO nova.compute.manager [None req-444d0c88-5eaf-4d9a-8f53-99ba09d8da6b tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] [instance: 47306d53-9ad7-4cae-ba6d-1f65239ef30f] Attaching volume ea228e4f-f9b2-477a-a75f-542bc9d47ec4 to /dev/vdb
Nov 28 15:43:08 user nova-compute[75176]: DEBUG nova.compute.manager [req-1a5a13f2-c5e7-43b4-ba1d-fa3df8be110b req-8c497964-ff78-4c0f-b52e-03604a7532d7 service nova] [instance: aa223c49-d254-4727-8a01-873026847b37] Received event network-vif-plugged-6514aeb6-8ea4-4a27-a54b-32f650c87957 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:43:08 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-1a5a13f2-c5e7-43b4-ba1d-fa3df8be110b req-8c497964-ff78-4c0f-b52e-03604a7532d7 service nova] Acquiring lock "aa223c49-d254-4727-8a01-873026847b37-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:43:08 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-1a5a13f2-c5e7-43b4-ba1d-fa3df8be110b req-8c497964-ff78-4c0f-b52e-03604a7532d7 service nova] Lock "aa223c49-d254-4727-8a01-873026847b37-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:43:08 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-1a5a13f2-c5e7-43b4-ba1d-fa3df8be110b req-8c497964-ff78-4c0f-b52e-03604a7532d7 service nova] Lock "aa223c49-d254-4727-8a01-873026847b37-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:43:08 user nova-compute[75176]: DEBUG nova.compute.manager [req-1a5a13f2-c5e7-43b4-ba1d-fa3df8be110b req-8c497964-ff78-4c0f-b52e-03604a7532d7 service nova] [instance: aa223c49-d254-4727-8a01-873026847b37] No waiting events found dispatching network-vif-plugged-6514aeb6-8ea4-4a27-a54b-32f650c87957 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:43:08 user nova-compute[75176]: WARNING nova.compute.manager [req-1a5a13f2-c5e7-43b4-ba1d-fa3df8be110b req-8c497964-ff78-4c0f-b52e-03604a7532d7 service nova] [instance: aa223c49-d254-4727-8a01-873026847b37] Received unexpected event network-vif-plugged-6514aeb6-8ea4-4a27-a54b-32f650c87957 for instance with vm_state active and task_state resize_migrating.
Nov 28 15:43:08 user nova-compute[75176]: DEBUG os_brick.utils [None req-444d0c88-5eaf-4d9a-8f53-99ba09d8da6b tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 15:43:08 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:43:09 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:43:09 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[b157b847-b9b3-408c-a038-739fb57f2952]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:edc924a949b2\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:43:09 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:43:09 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.027s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:43:09 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[563f950d-7d86-4477-b22e-e994c0b95de2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:43:09 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:43:09 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.031s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:43:09 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f9fba43-026c-4ba8-89c7-6308f7159ed3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:43:09 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1de58b7-dfda-4202-a262-9b01f6929e83]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:43:09 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-444d0c88-5eaf-4d9a-8f53-99ba09d8da6b tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Running cmd (subprocess): nvme version {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:43:09 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-444d0c88-5eaf-4d9a-8f53-99ba09d8da6b tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] 'nvme version' failed. Not Retrying. {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 15:43:09 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.nvmeof [None req-444d0c88-5eaf-4d9a-8f53-99ba09d8da6b tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] nvme not present on system {{(pid=75176) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 15:43:09 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:43:09 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 15:43:09 user nova-compute[75176]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 15:43:09 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[c664ee39-6852-4f34-bfdf-a4d8d0220081]: (4, '') {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:43:09 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.lightos [None req-444d0c88-5eaf-4d9a-8f53-99ba09d8da6b tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75176) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 15:43:09 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.lightos [None req-444d0c88-5eaf-4d9a-8f53-99ba09d8da6b tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75176) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 15:43:09 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.lightos [None req-444d0c88-5eaf-4d9a-8f53-99ba09d8da6b tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] LIGHTOS: no hostnqn found. {{(pid=75176) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 15:43:09 user nova-compute[75176]: DEBUG os_brick.utils [None req-444d0c88-5eaf-4d9a-8f53-99ba09d8da6b tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] <== get_connector_properties: return (184ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:edc924a949b2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 15:43:09 user nova-compute[75176]: DEBUG nova.virt.block_device [None req-444d0c88-5eaf-4d9a-8f53-99ba09d8da6b tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] [instance: 47306d53-9ad7-4cae-ba6d-1f65239ef30f] Updating existing volume attachment record: c3f5e60a-ea22-4d69-b805-98166d6358dd {{(pid=75176) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 15:43:10 user nova-compute[75176]: DEBUG nova.network.neutron [None req-e200d3b9-7af9-462c-9291-4228d5ba592a tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] [instance: aa223c49-d254-4727-8a01-873026847b37] Port 6514aeb6-8ea4-4a27-a54b-32f650c87957 binding to destination host user is already ACTIVE {{(pid=75176) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 28 15:43:10 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-e200d3b9-7af9-462c-9291-4228d5ba592a tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Acquiring lock "aa223c49-d254-4727-8a01-873026847b37-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:43:10 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-e200d3b9-7af9-462c-9291-4228d5ba592a tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Lock "aa223c49-d254-4727-8a01-873026847b37-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:43:10 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-e200d3b9-7af9-462c-9291-4228d5ba592a tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Lock "aa223c49-d254-4727-8a01-873026847b37-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:43:10 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-e200d3b9-7af9-462c-9291-4228d5ba592a tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Acquiring lock "refresh_cache-aa223c49-d254-4727-8a01-873026847b37" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:43:10 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-e200d3b9-7af9-462c-9291-4228d5ba592a tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Acquired lock "refresh_cache-aa223c49-d254-4727-8a01-873026847b37" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:43:10 user nova-compute[75176]: DEBUG nova.network.neutron [None req-e200d3b9-7af9-462c-9291-4228d5ba592a tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] [instance: aa223c49-d254-4727-8a01-873026847b37] Building network info cache for instance {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 15:43:10 user nova-compute[75176]: DEBUG nova.network.neutron [None req-e200d3b9-7af9-462c-9291-4228d5ba592a tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] [instance: aa223c49-d254-4727-8a01-873026847b37] Updating instance_info_cache with network_info: [{"id": "6514aeb6-8ea4-4a27-a54b-32f650c87957", "address": "fa:16:3e:ea:a6:1b", "network": {"id": "51708ad4-dae1-47fc-bd26-aca8c478ca04", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-279988751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c2fe6bf5e4f4bb3b5d50901bfac0b38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6514aeb6-8e", "ovs_interfaceid": "6514aeb6-8ea4-4a27-a54b-32f650c87957", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:43:10 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-e200d3b9-7af9-462c-9291-4228d5ba592a tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Releasing lock "refresh_cache-aa223c49-d254-4727-8a01-873026847b37" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:43:11 user nova-compute[75176]: DEBUG os_brick.utils [None req-e200d3b9-7af9-462c-9291-4228d5ba592a tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 15:43:11 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:43:11 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:43:11 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[7218cc51-2e8b-4b56-845c-8b9350563efe]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:edc924a949b2\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:43:11 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:43:11 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:43:11 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[eccade6a-141a-458a-97a4-f75bda62c002]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:43:11 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:43:11 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:43:11 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[40363e24-7137-469c-aad0-c24127558dad]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:43:11 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a551c55-7890-4e68-96d4-22fc30cf010c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:43:11 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-e200d3b9-7af9-462c-9291-4228d5ba592a tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Running cmd (subprocess): nvme version {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:43:11 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-e200d3b9-7af9-462c-9291-4228d5ba592a tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] 'nvme version' failed. Not Retrying. {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 15:43:11 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e200d3b9-7af9-462c-9291-4228d5ba592a tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] nvme not present on system {{(pid=75176) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 15:43:11 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:43:11 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 15:43:11 user nova-compute[75176]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 15:43:11 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[a38f803d-6d87-4801-95dc-b59ea1b866c5]: (4, '') {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:43:11 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.lightos [None req-e200d3b9-7af9-462c-9291-4228d5ba592a tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75176) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 15:43:11 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.lightos [None req-e200d3b9-7af9-462c-9291-4228d5ba592a tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75176) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 15:43:11 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.lightos [None req-e200d3b9-7af9-462c-9291-4228d5ba592a tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] LIGHTOS: no hostnqn found. {{(pid=75176) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 15:43:11 user nova-compute[75176]: DEBUG os_brick.utils [None req-e200d3b9-7af9-462c-9291-4228d5ba592a tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:edc924a949b2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 15:43:12 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:43:17 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:43:17 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-444d0c88-5eaf-4d9a-8f53-99ba09d8da6b tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] [instance: 47306d53-9ad7-4cae-ba6d-1f65239ef30f] Calling os-brick to attach iSCSI Volume {{(pid=75176) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 15:43:17 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-444d0c88-5eaf-4d9a-8f53-99ba09d8da6b tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c1b8a00>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ea228e4f-f9b2-477a-a75f-542bc9d47ec4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jPmwncDA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 15:43:17 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-444d0c88-5eaf-4d9a-8f53-99ba09d8da6b tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 15:43:17 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-444d0c88-5eaf-4d9a-8f53-99ba09d8da6b tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 15:43:17 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-444d0c88-5eaf-4d9a-8f53-99ba09d8da6b tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 15:43:17 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-444d0c88-5eaf-4d9a-8f53-99ba09d8da6b tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 15:43:17 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-444d0c88-5eaf-4d9a-8f53-99ba09d8da6b tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ea228e4f-f9b2-477a-a75f-542bc9d47ec4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 15:43:17 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-444d0c88-5eaf-4d9a-8f53-99ba09d8da6b tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ea228e4f-f9b2-477a-a75f-542bc9d47ec4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 15:43:17 user nova-compute[75176]: INFO os_brick.initiator.connectors.iscsi [None req-444d0c88-5eaf-4d9a-8f53-99ba09d8da6b tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 15:43:17 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea228e4f-f9b2-477a-a75f-542bc9d47ec4 -p 172.16.0.220:3260 {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:43:17 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea228e4f-f9b2-477a-a75f-542bc9d47ec4 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:43:17 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[51be5c1d-2254-40ae-96f2-a3df4db69825]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:43:17 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-444d0c88-5eaf-4d9a-8f53-99ba09d8da6b tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 15:43:17 user nova-compute[75176]:  {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:43:17 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea228e4f-f9b2-477a-a75f-542bc9d47ec4 -p 172.16.0.220:3260 --interface default --op new {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:43:17 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea228e4f-f9b2-477a-a75f-542bc9d47ec4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:43:17 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[d59d3577-aa2d-43b3-948e-22ad3598277e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ea228e4f-f9b2-477a-a75f-542bc9d47ec4] added\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:43:17 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-444d0c88-5eaf-4d9a-8f53-99ba09d8da6b tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ea228e4f-f9b2-477a-a75f-542bc9d47ec4] added
Nov 28 15:43:17 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:43:17 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea228e4f-f9b2-477a-a75f-542bc9d47ec4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:43:17 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea228e4f-f9b2-477a-a75f-542bc9d47ec4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:43:17 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ca36a48-41a5-4984-a718-ed059b7be02d]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:43:17 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-444d0c88-5eaf-4d9a-8f53-99ba09d8da6b tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:43:17 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea228e4f-f9b2-477a-a75f-542bc9d47ec4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:43:17 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea228e4f-f9b2-477a-a75f-542bc9d47ec4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.031s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:43:17 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4d0a9ed-7f0b-4668-a395-c1650f9f6544]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:43:17 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-444d0c88-5eaf-4d9a-8f53-99ba09d8da6b tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:43:17 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea228e4f-f9b2-477a-a75f-542bc9d47ec4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jPmwncDA {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:43:17 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea228e4f-f9b2-477a-a75f-542bc9d47ec4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jPmwncDA" returned: 0 in 0.024s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:43:17 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9cf8c3f-4e68-422a-ae12-09004c6fc1d8]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:43:17 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-444d0c88-5eaf-4d9a-8f53-99ba09d8da6b tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jPmwncDA'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:43:17 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea228e4f-f9b2-477a-a75f-542bc9d47ec4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:43:17 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea228e4f-f9b2-477a-a75f-542bc9d47ec4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:43:17 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ba74e3e-035a-45ae-bcfa-3deb146b55ff]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:43:17 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-444d0c88-5eaf-4d9a-8f53-99ba09d8da6b tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:43:17 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:43:17 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:43:17 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[96caa253-1fe9-4191-bf59-9a60317b1418]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bb22dca-8491-42ef-815f-7b0c0ca4be5a (non-flash)\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:43:17 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-444d0c88-5eaf-4d9a-8f53-99ba09d8da6b tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9 (non-flash)
Nov 28 15:43:17 user nova-compute[75176]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bb22dca-8491-42ef-815f-7b0c0ca4be5a (non-flash)
Nov 28 15:43:17 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:43:17 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-444d0c88-5eaf-4d9a-8f53-99ba09d8da6b tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9 (non-flash)
Nov 28 15:43:17 user nova-compute[75176]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bb22dca-8491-42ef-815f-7b0c0ca4be5a (non-flash)
Nov 28 15:43:17 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 15:43:17 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea228e4f-f9b2-477a-a75f-542bc9d47ec4 -p 172.16.0.220:3260 --login {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:43:17 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea228e4f-f9b2-477a-a75f-542bc9d47ec4 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:43:17 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5c7968a-d3d1-4765-b727-c6d1f20dfd3b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ea228e4f-f9b2-477a-a75f-542bc9d47ec4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ea228e4f-f9b2-477a-a75f-542bc9d47ec4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:43:17 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-444d0c88-5eaf-4d9a-8f53-99ba09d8da6b tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ea228e4f-f9b2-477a-a75f-542bc9d47ec4, portal: 172.16.0.220,3260]
Nov 28 15:43:17 user nova-compute[75176]: Login to [iface: default, target: iqn.2010-10.org.openstack:ea228e4f-f9b2-477a-a75f-542bc9d47ec4, portal: 172.16.0.220,3260] successful.
Nov 28 15:43:17 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:43:17 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea228e4f-f9b2-477a-a75f-542bc9d47ec4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:43:17 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea228e4f-f9b2-477a-a75f-542bc9d47ec4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:43:17 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[603ed73c-b123-40a6-8cc5-97fcdbe6b78a]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:43:17 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-444d0c88-5eaf-4d9a-8f53-99ba09d8da6b tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:43:17 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:43:17 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:43:17 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b3077c9-88f4-4099-b930-857d0f279bcc]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bb22dca-8491-42ef-815f-7b0c0ca4be5a (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea228e4f-f9b2-477a-a75f-542bc9d47ec4 (non-flash)\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:43:17 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-444d0c88-5eaf-4d9a-8f53-99ba09d8da6b tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9 (non-flash)
Nov 28 15:43:17 user nova-compute[75176]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bb22dca-8491-42ef-815f-7b0c0ca4be5a (non-flash)
Nov 28 15:43:17 user nova-compute[75176]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea228e4f-f9b2-477a-a75f-542bc9d47ec4 (non-flash)
Nov 28 15:43:17 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:43:17 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-444d0c88-5eaf-4d9a-8f53-99ba09d8da6b tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9 (non-flash)
Nov 28 15:43:17 user nova-compute[75176]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bb22dca-8491-42ef-815f-7b0c0ca4be5a (non-flash)
Nov 28 15:43:17 user nova-compute[75176]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea228e4f-f9b2-477a-a75f-542bc9d47ec4 (non-flash)
Nov 28 15:43:17 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 15:43:17 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-444d0c88-5eaf-4d9a-8f53-99ba09d8da6b tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ea228e4f-f9b2-477a-a75f-542bc9d47ec4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.340s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 15:43:17 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-444d0c88-5eaf-4d9a-8f53-99ba09d8da6b tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Connected to 172.16.0.220:3260 {{(pid=75176) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 15:43:17 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-444d0c88-5eaf-4d9a-8f53-99ba09d8da6b tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] HCTL ('35', '-', '-', 0) found on session 18 with lun 0 {{(pid=75176) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 15:43:17 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-444d0c88-5eaf-4d9a-8f53-99ba09d8da6b tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75176) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 15:43:17 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:43:17 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:43:17 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[c22d9a64-1ff9-45f4-987d-e9cbd518ebb3]: (4, ('- - 0', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:43:17 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-444d0c88-5eaf-4d9a-8f53-99ba09d8da6b tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Searching for a device in session 18 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75176) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 15:43:17 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-444d0c88-5eaf-4d9a-8f53-99ba09d8da6b tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:ea228e4f-f9b2-477a-a75f-542bc9d47ec4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jPmwncDA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75176) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 15:43:18 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:43:18 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-444d0c88-5eaf-4d9a-8f53-99ba09d8da6b tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.374s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 15:43:18 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-444d0c88-5eaf-4d9a-8f53-99ba09d8da6b tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] <== connect_volume: return (1376ms) {'type': 'block', 'scsi_wwn': '26637303964643937', 'path': '/dev/sdd'} {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 15:43:18 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-444d0c88-5eaf-4d9a-8f53-99ba09d8da6b tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] [instance: 47306d53-9ad7-4cae-ba6d-1f65239ef30f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26637303964643937', 'path': '/dev/sdd'} {{(pid=75176) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 15:43:18 user nova-compute[75176]: DEBUG nova.objects.instance [None req-444d0c88-5eaf-4d9a-8f53-99ba09d8da6b tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Lazy-loading 'flavor' on Instance uuid 47306d53-9ad7-4cae-ba6d-1f65239ef30f {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:43:18 user nova-compute[75176]: DEBUG nova.virt.libvirt.guest [None req-444d0c88-5eaf-4d9a-8f53-99ba09d8da6b tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 15:43:18 user nova-compute[75176]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 15:43:18 user nova-compute[75176]:   <source dev="/dev/sdd"/>
Nov 28 15:43:18 user nova-compute[75176]:   <target dev="vdb" bus="virtio"/>
Nov 28 15:43:18 user nova-compute[75176]:   <serial>ea228e4f-f9b2-477a-a75f-542bc9d47ec4</serial>
Nov 28 15:43:18 user nova-compute[75176]: </disk>
Nov 28 15:43:18 user nova-compute[75176]:  {{(pid=75176) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 15:43:19 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-444d0c88-5eaf-4d9a-8f53-99ba09d8da6b tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] No BDM found with device name vda, not building metadata. {{(pid=75176) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 15:43:19 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-444d0c88-5eaf-4d9a-8f53-99ba09d8da6b tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75176) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 15:43:19 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-444d0c88-5eaf-4d9a-8f53-99ba09d8da6b tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] No VIF found with MAC fa:16:3e:0b:f3:cf, not building metadata {{(pid=75176) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 15:43:19 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-e200d3b9-7af9-462c-9291-4228d5ba592a tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] [instance: aa223c49-d254-4727-8a01-873026847b37] Starting finish_migration {{(pid=75176) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11671}}
Nov 28 15:43:19 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-e200d3b9-7af9-462c-9291-4228d5ba592a tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] [instance: aa223c49-d254-4727-8a01-873026847b37] Instance directory exists: not creating {{(pid=75176) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 28 15:43:19 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-e200d3b9-7af9-462c-9291-4228d5ba592a tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] [instance: aa223c49-d254-4727-8a01-873026847b37] Creating image(s)
Nov 28 15:43:19 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-e200d3b9-7af9-462c-9291-4228d5ba592a tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:43:19 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-444d0c88-5eaf-4d9a-8f53-99ba09d8da6b tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Lock "47306d53-9ad7-4cae-ba6d-1f65239ef30f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.929s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:43:20 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-e200d3b9-7af9-462c-9291-4228d5ba592a tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json" returned: 0 in 0.227s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:43:20 user nova-compute[75176]: DEBUG nova.virt.disk.api [None req-e200d3b9-7af9-462c-9291-4228d5ba592a tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Checking if we can resize image /opt/stack/data/nova/instances/aa223c49-d254-4727-8a01-873026847b37/disk. size=21474836480 {{(pid=75176) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 15:43:20 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-e200d3b9-7af9-462c-9291-4228d5ba592a tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa223c49-d254-4727-8a01-873026847b37/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:43:20 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-e6d69e73-e4ad-4d4d-b271-055be3fa0733 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] Acquiring lock "916b82eb-97e8-411c-a8ea-8c27d101b48e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:43:20 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-e6d69e73-e4ad-4d4d-b271-055be3fa0733 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] Lock "916b82eb-97e8-411c-a8ea-8c27d101b48e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:43:20 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-e6d69e73-e4ad-4d4d-b271-055be3fa0733 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] Acquiring lock "916b82eb-97e8-411c-a8ea-8c27d101b48e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:43:20 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-e6d69e73-e4ad-4d4d-b271-055be3fa0733 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] Lock "916b82eb-97e8-411c-a8ea-8c27d101b48e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:43:20 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-e6d69e73-e4ad-4d4d-b271-055be3fa0733 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] Lock "916b82eb-97e8-411c-a8ea-8c27d101b48e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:43:20 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-e200d3b9-7af9-462c-9291-4228d5ba592a tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa223c49-d254-4727-8a01-873026847b37/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:43:20 user nova-compute[75176]: INFO nova.compute.manager [None req-e6d69e73-e4ad-4d4d-b271-055be3fa0733 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] [instance: 916b82eb-97e8-411c-a8ea-8c27d101b48e] Terminating instance
Nov 28 15:43:20 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-e200d3b9-7af9-462c-9291-4228d5ba592a tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/aa223c49-d254-4727-8a01-873026847b37/disk 21474836480 {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:43:20 user nova-compute[75176]: DEBUG nova.compute.manager [None req-e6d69e73-e4ad-4d4d-b271-055be3fa0733 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] [instance: 916b82eb-97e8-411c-a8ea-8c27d101b48e] Start destroying the instance on the hypervisor. {{(pid=75176) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 15:43:20 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-e200d3b9-7af9-462c-9291-4228d5ba592a tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/aa223c49-d254-4727-8a01-873026847b37/disk 21474836480" returned: 0 in 0.207s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:43:20 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-e200d3b9-7af9-462c-9291-4228d5ba592a tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] [instance: aa223c49-d254-4727-8a01-873026847b37] Did not create local disks {{(pid=75176) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 28 15:43:20 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-e200d3b9-7af9-462c-9291-4228d5ba592a tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] [instance: aa223c49-d254-4727-8a01-873026847b37] Ensure instance console log exists: /opt/stack/data/nova/instances/aa223c49-d254-4727-8a01-873026847b37/console.log {{(pid=75176) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 15:43:20 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-e200d3b9-7af9-462c-9291-4228d5ba592a tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:43:20 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-e200d3b9-7af9-462c-9291-4228d5ba592a tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:43:20 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-e200d3b9-7af9-462c-9291-4228d5ba592a tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:43:20 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-e200d3b9-7af9-462c-9291-4228d5ba592a tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] [instance: aa223c49-d254-4727-8a01-873026847b37] Start _get_guest_xml network_info=[{"id": "6514aeb6-8ea4-4a27-a54b-32f650c87957", "address": "fa:16:3e:ea:a6:1b", "network": {"id": "51708ad4-dae1-47fc-bd26-aca8c478ca04", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-279988751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-279988751-network", "vif_mac": "fa:16:3e:ea:a6:1b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c2fe6bf5e4f4bb3b5d50901bfac0b38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6514aeb6-8e", "ovs_interfaceid": "6514aeb6-8ea4-4a27-a54b-32f650c87957", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T15:35:12Z,direct_url=<?>,disk_format='qcow2',id=1f41819e-c93f-4dc7-b253-37a27bbbbc74,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1b91c5d0672c4224a48df2e1f92688e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T15:35:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'size': 0, 'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'image_id': '1f41819e-c93f-4dc7-b253-37a27bbbbc74'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AVKGrjOB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'aa223c49-d254-4727-8a01-873026847b37', 'attached_at': '2023-11-28T15:43:19.000000', 'detached_at': '', 'volume_id': 'f61f7c78-66f5-45c5-85ac-2b97ed31a24d', 'serial': 'f61f7c78-66f5-45c5-85ac-2b97ed31a24d'}, 'guest_format': None, 'device_type': 'disk', 'boot_index': None, 'disk_bus': 'virtio', 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'attachment_id': 'f0a8cee8-322d-440c-8fb6-1e2221f4fa0d', 'volume_type': None} {{(pid=75176) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 15:43:20 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:43:20 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-e200d3b9-7af9-462c-9291-4228d5ba592a tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 15:43:20 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-e200d3b9-7af9-462c-9291-4228d5ba592a tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 15:43:20 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-e200d3b9-7af9-462c-9291-4228d5ba592a tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75176) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 15:43:20 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-e200d3b9-7af9-462c-9291-4228d5ba592a tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] CPU controller missing on host. {{(pid=75176) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 15:43:20 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-e200d3b9-7af9-462c-9291-4228d5ba592a tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75176) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 15:43:20 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-e200d3b9-7af9-462c-9291-4228d5ba592a tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] CPU controller found on host. {{(pid=75176) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 15:43:20 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-e200d3b9-7af9-462c-9291-4228d5ba592a tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75176) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 15:43:20 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-e200d3b9-7af9-462c-9291-4228d5ba592a tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T15:35:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T15:35:12Z,direct_url=<?>,disk_format='qcow2',id=1f41819e-c93f-4dc7-b253-37a27bbbbc74,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1b91c5d0672c4224a48df2e1f92688e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T15:35:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 15:43:20 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-e200d3b9-7af9-462c-9291-4228d5ba592a tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Flavor limits 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 15:43:20 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-e200d3b9-7af9-462c-9291-4228d5ba592a tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Image limits 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 15:43:20 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-e200d3b9-7af9-462c-9291-4228d5ba592a tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Flavor pref 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 15:43:20 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-e200d3b9-7af9-462c-9291-4228d5ba592a tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Image pref 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 15:43:20 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-e200d3b9-7af9-462c-9291-4228d5ba592a tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 15:43:20 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-e200d3b9-7af9-462c-9291-4228d5ba592a tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 15:43:20 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-e200d3b9-7af9-462c-9291-4228d5ba592a tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75176) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 15:43:20 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-e200d3b9-7af9-462c-9291-4228d5ba592a tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Got 1 possible topologies {{(pid=75176) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 15:43:20 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-e200d3b9-7af9-462c-9291-4228d5ba592a tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 15:43:20 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-e200d3b9-7af9-462c-9291-4228d5ba592a tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 15:43:20 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e200d3b9-7af9-462c-9291-4228d5ba592a tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] [instance: aa223c49-d254-4727-8a01-873026847b37] Calling os-brick to attach iSCSI Volume {{(pid=75176) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 15:43:20 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-e200d3b9-7af9-462c-9291-4228d5ba592a tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c1b8a00>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AVKGrjOB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 15:43:20 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-e200d3b9-7af9-462c-9291-4228d5ba592a tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 15:43:20 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-e200d3b9-7af9-462c-9291-4228d5ba592a tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 15:43:20 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-e200d3b9-7af9-462c-9291-4228d5ba592a tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 15:43:20 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-e200d3b9-7af9-462c-9291-4228d5ba592a tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 15:43:20 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-e200d3b9-7af9-462c-9291-4228d5ba592a tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 15:43:20 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-e200d3b9-7af9-462c-9291-4228d5ba592a tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 15:43:20 user nova-compute[75176]: INFO os_brick.initiator.connectors.iscsi [None req-e200d3b9-7af9-462c-9291-4228d5ba592a tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 15:43:20 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:43:20 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d -p 172.16.0.220:3260 {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:43:20 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:43:20 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[fde46da0-4e81-4099-b1b9-6c2cf375028a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:43:20 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-e200d3b9-7af9-462c-9291-4228d5ba592a tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 15:43:20 user nova-compute[75176]:  {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:43:20 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d -p 172.16.0.220:3260 --interface default --op new {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:43:20 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:43:20 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:43:20 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[508a699c-b7dc-4c05-b64f-961ff0c81475]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d] added\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:43:20 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-e200d3b9-7af9-462c-9291-4228d5ba592a tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d] added
Nov 28 15:43:20 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:43:20 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:43:20 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:43:20 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb2c8b0f-1961-4633-98ed-09eb5330922d]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:43:20 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-e200d3b9-7af9-462c-9291-4228d5ba592a tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:43:20 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:43:20 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:43:20 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[724247e9-3bfe-4e20-90cc-10a2631c3c4c]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:43:20 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-e200d3b9-7af9-462c-9291-4228d5ba592a tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:43:20 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AVKGrjOB {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:43:20 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AVKGrjOB" returned: 0 in 0.023s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:43:20 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[14589d4f-1e90-4350-8f7e-daa65ff302ee]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:43:20 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-e200d3b9-7af9-462c-9291-4228d5ba592a tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AVKGrjOB'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:43:20 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:43:20 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:43:20 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[37808b12-48b9-42e9-8baf-360c0d756a69]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:43:20 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-e200d3b9-7af9-462c-9291-4228d5ba592a tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:43:20 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:43:20 user nova-compute[75176]: DEBUG nova.compute.manager [req-b1233fd1-88c0-4e6e-9d46-f2eb3b75f02f req-15df0201-6272-43c5-854e-2800c1cd679b service nova] [instance: 916b82eb-97e8-411c-a8ea-8c27d101b48e] Received event network-vif-unplugged-38bef3fc-c841-4db3-b429-8fe94a224783 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:43:20 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-b1233fd1-88c0-4e6e-9d46-f2eb3b75f02f req-15df0201-6272-43c5-854e-2800c1cd679b service nova] Acquiring lock "916b82eb-97e8-411c-a8ea-8c27d101b48e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:43:20 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-b1233fd1-88c0-4e6e-9d46-f2eb3b75f02f req-15df0201-6272-43c5-854e-2800c1cd679b service nova] Lock "916b82eb-97e8-411c-a8ea-8c27d101b48e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:43:20 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-b1233fd1-88c0-4e6e-9d46-f2eb3b75f02f req-15df0201-6272-43c5-854e-2800c1cd679b service nova] Lock "916b82eb-97e8-411c-a8ea-8c27d101b48e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:43:20 user nova-compute[75176]: DEBUG nova.compute.manager [req-b1233fd1-88c0-4e6e-9d46-f2eb3b75f02f req-15df0201-6272-43c5-854e-2800c1cd679b service nova] [instance: 916b82eb-97e8-411c-a8ea-8c27d101b48e] No waiting events found dispatching network-vif-unplugged-38bef3fc-c841-4db3-b429-8fe94a224783 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:43:20 user nova-compute[75176]: DEBUG nova.compute.manager [req-b1233fd1-88c0-4e6e-9d46-f2eb3b75f02f req-15df0201-6272-43c5-854e-2800c1cd679b service nova] [instance: 916b82eb-97e8-411c-a8ea-8c27d101b48e] Received event network-vif-unplugged-38bef3fc-c841-4db3-b429-8fe94a224783 for instance with task_state deleting. {{(pid=75176) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 15:43:20 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:43:20 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[096a7044-7225-4183-b18c-2a5ee22cd5ff]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bb22dca-8491-42ef-815f-7b0c0ca4be5a (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea228e4f-f9b2-477a-a75f-542bc9d47ec4 (non-flash)\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:43:20 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-e200d3b9-7af9-462c-9291-4228d5ba592a tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9 (non-flash)
Nov 28 15:43:20 user nova-compute[75176]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bb22dca-8491-42ef-815f-7b0c0ca4be5a (non-flash)
Nov 28 15:43:20 user nova-compute[75176]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea228e4f-f9b2-477a-a75f-542bc9d47ec4 (non-flash)
Nov 28 15:43:20 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:43:20 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-e200d3b9-7af9-462c-9291-4228d5ba592a tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9 (non-flash)
Nov 28 15:43:20 user nova-compute[75176]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bb22dca-8491-42ef-815f-7b0c0ca4be5a (non-flash)
Nov 28 15:43:20 user nova-compute[75176]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea228e4f-f9b2-477a-a75f-542bc9d47ec4 (non-flash)
Nov 28 15:43:20 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 15:43:20 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d -p 172.16.0.220:3260 --login {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:43:20 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d -p 172.16.0.220:3260 --login" returned: 0 in 0.085s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:43:20 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7600420-e12b-4749-b0fe-f6032d3b7777]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:43:20 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-e200d3b9-7af9-462c-9291-4228d5ba592a tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d, portal: 172.16.0.220,3260]
Nov 28 15:43:20 user nova-compute[75176]: Login to [iface: default, target: iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d, portal: 172.16.0.220,3260] successful.
Nov 28 15:43:20 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:43:20 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:43:20 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:43:20 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[293aab9c-7d40-4f4f-8611-180c13fb23a3]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:43:20 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-e200d3b9-7af9-462c-9291-4228d5ba592a tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:43:20 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:43:20 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:43:20 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddfbd0b5-0a82-402e-be2d-70731beead23]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bb22dca-8491-42ef-815f-7b0c0ca4be5a (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea228e4f-f9b2-477a-a75f-542bc9d47ec4 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d (non-flash)\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:43:20 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-e200d3b9-7af9-462c-9291-4228d5ba592a tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9 (non-flash)
Nov 28 15:43:20 user nova-compute[75176]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bb22dca-8491-42ef-815f-7b0c0ca4be5a (non-flash)
Nov 28 15:43:20 user nova-compute[75176]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea228e4f-f9b2-477a-a75f-542bc9d47ec4 (non-flash)
Nov 28 15:43:20 user nova-compute[75176]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d (non-flash)
Nov 28 15:43:20 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:43:20 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-e200d3b9-7af9-462c-9291-4228d5ba592a tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9 (non-flash)
Nov 28 15:43:20 user nova-compute[75176]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bb22dca-8491-42ef-815f-7b0c0ca4be5a (non-flash)
Nov 28 15:43:20 user nova-compute[75176]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea228e4f-f9b2-477a-a75f-542bc9d47ec4 (non-flash)
Nov 28 15:43:20 user nova-compute[75176]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d (non-flash)
Nov 28 15:43:20 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 15:43:20 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-e200d3b9-7af9-462c-9291-4228d5ba592a tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.381s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 15:43:20 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-e200d3b9-7af9-462c-9291-4228d5ba592a tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Connected to 172.16.0.220:3260 {{(pid=75176) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 15:43:20 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-e200d3b9-7af9-462c-9291-4228d5ba592a tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] HCTL ('36', '-', '-', 0) found on session 19 with lun 0 {{(pid=75176) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 15:43:20 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-e200d3b9-7af9-462c-9291-4228d5ba592a tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75176) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 15:43:20 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:43:20 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.053s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:43:20 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ede71fe-c406-4938-ad14-29684e899ae0]: (4, ('- - 0', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:43:20 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-e200d3b9-7af9-462c-9291-4228d5ba592a tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Searching for a device in session 19 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75176) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 15:43:20 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-e200d3b9-7af9-462c-9291-4228d5ba592a tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AVKGrjOB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75176) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 15:43:21 user nova-compute[75176]: INFO nova.virt.libvirt.driver [-] [instance: 916b82eb-97e8-411c-a8ea-8c27d101b48e] Instance destroyed successfully.
Nov 28 15:43:21 user nova-compute[75176]: DEBUG nova.objects.instance [None req-e6d69e73-e4ad-4d4d-b271-055be3fa0733 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] Lazy-loading 'resources' on Instance uuid 916b82eb-97e8-411c-a8ea-8c27d101b48e {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:43:21 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-e6d69e73-e4ad-4d4d-b271-055be3fa0733 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-28T15:39:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-762836390',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-2102540116',id=8,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCQNBGdiL2UyuS5dM6+KjwbgIJ/vX3p2dH1PNPmJxj5EzppPATyTzrKhi1oHmfMeT/UPJyLXI+eIry/aVtUhrMzZLSlMRjHwwDIb+xEYyhtsdb9ZUumnXRPBTV8py7ZAjw==',key_name='tempest-keypair-1515121820',keypairs=<?>,launch_index=0,launched_at=2023-11-28T15:42:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d68d78d1dd684c2c920ae8e4ce3eaa21',ramdisk_id='',reservation_id='r-uy5cy6al',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-267222163',owner_user_name='tempest-ServerActionsV293TestJSON-267222163-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T15:42:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aea69806df134eeb946d4ed91bd7152b',uuid=916b82eb-97e8-411c-a8ea-8c27d101b48e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "38bef3fc-c841-4db3-b429-8fe94a224783", "address": "fa:16:3e:13:6e:cf", "network": {"id": "dc41c201-1473-486f-abc4-30a09c441826", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2062231487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d68d78d1dd684c2c920ae8e4ce3eaa21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38bef3fc-c8", "ovs_interfaceid": "38bef3fc-c841-4db3-b429-8fe94a224783", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 15:43:21 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-e6d69e73-e4ad-4d4d-b271-055be3fa0733 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] Converting VIF {"id": "38bef3fc-c841-4db3-b429-8fe94a224783", "address": "fa:16:3e:13:6e:cf", "network": {"id": "dc41c201-1473-486f-abc4-30a09c441826", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2062231487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d68d78d1dd684c2c920ae8e4ce3eaa21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38bef3fc-c8", "ovs_interfaceid": "38bef3fc-c841-4db3-b429-8fe94a224783", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:43:21 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-e6d69e73-e4ad-4d4d-b271-055be3fa0733 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:13:6e:cf,bridge_name='br-int',has_traffic_filtering=True,id=38bef3fc-c841-4db3-b429-8fe94a224783,network=Network(dc41c201-1473-486f-abc4-30a09c441826),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38bef3fc-c8') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:43:21 user nova-compute[75176]: DEBUG os_vif [None req-e6d69e73-e4ad-4d4d-b271-055be3fa0733 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:13:6e:cf,bridge_name='br-int',has_traffic_filtering=True,id=38bef3fc-c841-4db3-b429-8fe94a224783,network=Network(dc41c201-1473-486f-abc4-30a09c441826),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38bef3fc-c8') {{(pid=75176) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 15:43:21 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:43:21 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap38bef3fc-c8, bridge=br-int, if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:43:21 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:43:21 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:43:21 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:43:21 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=89b15784-710c-44d5-8656-c785cdba14e4) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:43:21 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:43:21 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:43:21 user nova-compute[75176]: INFO os_vif [None req-e6d69e73-e4ad-4d4d-b271-055be3fa0733 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:13:6e:cf,bridge_name='br-int',has_traffic_filtering=True,id=38bef3fc-c841-4db3-b429-8fe94a224783,network=Network(dc41c201-1473-486f-abc4-30a09c441826),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38bef3fc-c8')
Nov 28 15:43:21 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e6d69e73-e4ad-4d4d-b271-055be3fa0733 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] [instance: 916b82eb-97e8-411c-a8ea-8c27d101b48e] calling os-brick to detach iSCSI Volume {{(pid=75176) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 15:43:21 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6d69e73-e4ad-4d4d-b271-055be3fa0733 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c1b8a00>, {'target_iqn': 'iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IhQCYfRb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 15:43:21 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-e6d69e73-e4ad-4d4d-b271-055be3fa0733 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 15:43:21 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-e6d69e73-e4ad-4d4d-b271-055be3fa0733 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 15:43:21 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-e200d3b9-7af9-462c-9291-4228d5ba592a tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.470s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 15:43:21 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-e200d3b9-7af9-462c-9291-4228d5ba592a tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] <== connect_volume: return (1471ms) {'type': 'block', 'scsi_wwn': '26236393065326363', 'path': '/dev/sde'} {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 15:43:21 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e200d3b9-7af9-462c-9291-4228d5ba592a tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] [instance: aa223c49-d254-4727-8a01-873026847b37] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26236393065326363', 'path': '/dev/sde'} {{(pid=75176) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 15:43:21 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-e6d69e73-e4ad-4d4d-b271-055be3fa0733 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.739s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 15:43:21 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:43:22 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:43:22 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[004c1ea8-e7b2-4df0-ab39-02d04b4ff189]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2bb22dca-8491-42ef-815f-7b0c0ca4be5a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ea228e4f-f9b2-477a-a75f-542bc9d47ec4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:43:22 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-e200d3b9-7af9-462c-9291-4228d5ba592a tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T15:39:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-595327070',display_name='tempest-ServerActionsTestOtherB-server-595327070',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-595327070',id=3,image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG46aaldZ31/SMomPHuTDQH3UTedHGSV4iG8fWtpOqqr4Cywzy71R0Ov1C6XRnOo4sYKyOfCcRfklnh+MSVYzyKoTfjcvtFT0nSQtOBIOaQ8vVTuyCcNwyJ0nmpmqFlJng==',key_name='tempest-keypair-1738862822',keypairs=<?>,launch_index=0,launched_at=2023-11-28T15:39:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='4c2fe6bf5e4f4bb3b5d50901bfac0b38',ramdisk_id='',reservation_id='r-k1by7x80',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-935995346',owner_user_name='tempest-ServerActionsTestOtherB-935995346-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T15:43:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='16ea4be4bcb34749b2f444c4694543b1',uuid=aa223c49-d254-4727-8a01-873026847b37,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6514aeb6-8ea4-4a27-a54b-32f650c87957", "address": "fa:16:3e:ea:a6:1b", "network": {"id": "51708ad4-dae1-47fc-bd26-aca8c478ca04", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-279988751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-279988751-network", "vif_mac": "fa:16:3e:ea:a6:1b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c2fe6bf5e4f4bb3b5d50901bfac0b38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6514aeb6-8e", "ovs_interfaceid": "6514aeb6-8ea4-4a27-a54b-32f650c87957", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75176) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 15:43:22 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-e200d3b9-7af9-462c-9291-4228d5ba592a tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Converting VIF {"id": "6514aeb6-8ea4-4a27-a54b-32f650c87957", "address": "fa:16:3e:ea:a6:1b", "network": {"id": "51708ad4-dae1-47fc-bd26-aca8c478ca04", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-279988751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-279988751-network", "vif_mac": "fa:16:3e:ea:a6:1b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c2fe6bf5e4f4bb3b5d50901bfac0b38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6514aeb6-8e", "ovs_interfaceid": "6514aeb6-8ea4-4a27-a54b-32f650c87957", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:43:22 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-e200d3b9-7af9-462c-9291-4228d5ba592a tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:a6:1b,bridge_name='br-int',has_traffic_filtering=True,id=6514aeb6-8ea4-4a27-a54b-32f650c87957,network=Network(51708ad4-dae1-47fc-bd26-aca8c478ca04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6514aeb6-8e') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:43:22 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-e200d3b9-7af9-462c-9291-4228d5ba592a tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] [instance: aa223c49-d254-4727-8a01-873026847b37] End _get_guest_xml xml=<domain type="kvm">
Nov 28 15:43:22 user nova-compute[75176]:   <uuid>aa223c49-d254-4727-8a01-873026847b37</uuid>
Nov 28 15:43:22 user nova-compute[75176]:   <name>instance-00000003</name>
Nov 28 15:43:22 user nova-compute[75176]:   <memory>2097152</memory>
Nov 28 15:43:22 user nova-compute[75176]:   <vcpu>1</vcpu>
Nov 28 15:43:22 user nova-compute[75176]:   <metadata>
Nov 28 15:43:22 user nova-compute[75176]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 15:43:22 user nova-compute[75176]:       <nova:package version="0.0.0"/>
Nov 28 15:43:22 user nova-compute[75176]:       <nova:name>tempest-ServerActionsTestOtherB-server-595327070</nova:name>
Nov 28 15:43:22 user nova-compute[75176]:       <nova:creationTime>2023-11-28 15:43:20</nova:creationTime>
Nov 28 15:43:22 user nova-compute[75176]:       <nova:flavor name="m1.small">
Nov 28 15:43:22 user nova-compute[75176]:         <nova:memory>2048</nova:memory>
Nov 28 15:43:22 user nova-compute[75176]:         <nova:disk>20</nova:disk>
Nov 28 15:43:22 user nova-compute[75176]:         <nova:swap>0</nova:swap>
Nov 28 15:43:22 user nova-compute[75176]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 15:43:22 user nova-compute[75176]:         <nova:vcpus>1</nova:vcpus>
Nov 28 15:43:22 user nova-compute[75176]:       </nova:flavor>
Nov 28 15:43:22 user nova-compute[75176]:       <nova:owner>
Nov 28 15:43:22 user nova-compute[75176]:         <nova:user uuid="16ea4be4bcb34749b2f444c4694543b1">tempest-ServerActionsTestOtherB-935995346-project-member</nova:user>
Nov 28 15:43:22 user nova-compute[75176]:         <nova:project uuid="4c2fe6bf5e4f4bb3b5d50901bfac0b38">tempest-ServerActionsTestOtherB-935995346</nova:project>
Nov 28 15:43:22 user nova-compute[75176]:       </nova:owner>
Nov 28 15:43:22 user nova-compute[75176]:       <nova:root type="image" uuid="1f41819e-c93f-4dc7-b253-37a27bbbbc74"/>
Nov 28 15:43:22 user nova-compute[75176]:       <nova:ports>
Nov 28 15:43:22 user nova-compute[75176]:         <nova:port uuid="6514aeb6-8ea4-4a27-a54b-32f650c87957">
Nov 28 15:43:22 user nova-compute[75176]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 28 15:43:22 user nova-compute[75176]:         </nova:port>
Nov 28 15:43:22 user nova-compute[75176]:       </nova:ports>
Nov 28 15:43:22 user nova-compute[75176]:     </nova:instance>
Nov 28 15:43:22 user nova-compute[75176]:   </metadata>
Nov 28 15:43:22 user nova-compute[75176]:   <sysinfo type="smbios">
Nov 28 15:43:22 user nova-compute[75176]:     <system>
Nov 28 15:43:22 user nova-compute[75176]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 15:43:22 user nova-compute[75176]:       <entry name="product">OpenStack Nova</entry>
Nov 28 15:43:22 user nova-compute[75176]:       <entry name="version">0.0.0</entry>
Nov 28 15:43:22 user nova-compute[75176]:       <entry name="serial">aa223c49-d254-4727-8a01-873026847b37</entry>
Nov 28 15:43:22 user nova-compute[75176]:       <entry name="uuid">aa223c49-d254-4727-8a01-873026847b37</entry>
Nov 28 15:43:22 user nova-compute[75176]:       <entry name="family">Virtual Machine</entry>
Nov 28 15:43:22 user nova-compute[75176]:     </system>
Nov 28 15:43:22 user nova-compute[75176]:   </sysinfo>
Nov 28 15:43:22 user nova-compute[75176]:   <os>
Nov 28 15:43:22 user nova-compute[75176]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 15:43:22 user nova-compute[75176]:     <boot dev="hd"/>
Nov 28 15:43:22 user nova-compute[75176]:     <smbios mode="sysinfo"/>
Nov 28 15:43:22 user nova-compute[75176]:   </os>
Nov 28 15:43:22 user nova-compute[75176]:   <features>
Nov 28 15:43:22 user nova-compute[75176]:     <acpi/>
Nov 28 15:43:22 user nova-compute[75176]:     <apic/>
Nov 28 15:43:22 user nova-compute[75176]:     <vmcoreinfo/>
Nov 28 15:43:22 user nova-compute[75176]:   </features>
Nov 28 15:43:22 user nova-compute[75176]:   <clock offset="utc">
Nov 28 15:43:22 user nova-compute[75176]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 15:43:22 user nova-compute[75176]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 15:43:22 user nova-compute[75176]:     <timer name="hpet" present="no"/>
Nov 28 15:43:22 user nova-compute[75176]:   </clock>
Nov 28 15:43:22 user nova-compute[75176]:   <cpu mode="custom" match="exact">
Nov 28 15:43:22 user nova-compute[75176]:     <model>Nehalem</model>
Nov 28 15:43:22 user nova-compute[75176]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 15:43:22 user nova-compute[75176]:   </cpu>
Nov 28 15:43:22 user nova-compute[75176]:   <devices>
Nov 28 15:43:22 user nova-compute[75176]:     <disk type="file" device="disk">
Nov 28 15:43:22 user nova-compute[75176]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 15:43:22 user nova-compute[75176]:       <source file="/opt/stack/data/nova/instances/aa223c49-d254-4727-8a01-873026847b37/disk"/>
Nov 28 15:43:22 user nova-compute[75176]:       <target dev="vda" bus="virtio"/>
Nov 28 15:43:22 user nova-compute[75176]:     </disk>
Nov 28 15:43:22 user nova-compute[75176]:     <disk type="block" device="disk">
Nov 28 15:43:22 user nova-compute[75176]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 15:43:22 user nova-compute[75176]:       <source dev="/dev/sde"/>
Nov 28 15:43:22 user nova-compute[75176]:       <target dev="vdb" bus="virtio"/>
Nov 28 15:43:22 user nova-compute[75176]:       <serial>f61f7c78-66f5-45c5-85ac-2b97ed31a24d</serial>
Nov 28 15:43:22 user nova-compute[75176]:     </disk>
Nov 28 15:43:22 user nova-compute[75176]:     <interface type="ethernet">
Nov 28 15:43:22 user nova-compute[75176]:       <mac address="fa:16:3e:ea:a6:1b"/>
Nov 28 15:43:22 user nova-compute[75176]:       <model type="virtio"/>
Nov 28 15:43:22 user nova-compute[75176]:       <mtu size="1442"/>
Nov 28 15:43:22 user nova-compute[75176]:       <target dev="tap6514aeb6-8e"/>
Nov 28 15:43:22 user nova-compute[75176]:     </interface>
Nov 28 15:43:22 user nova-compute[75176]:     <serial type="pty">
Nov 28 15:43:22 user nova-compute[75176]:       <log file="/opt/stack/data/nova/instances/aa223c49-d254-4727-8a01-873026847b37/console.log" append="off"/>
Nov 28 15:43:22 user nova-compute[75176]:     </serial>
Nov 28 15:43:22 user nova-compute[75176]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 15:43:22 user nova-compute[75176]:     <video>
Nov 28 15:43:22 user nova-compute[75176]:       <model type="virtio"/>
Nov 28 15:43:22 user nova-compute[75176]:     </video>
Nov 28 15:43:22 user nova-compute[75176]:     <rng model="virtio">
Nov 28 15:43:22 user nova-compute[75176]:       <backend model="random">/dev/urandom</backend>
Nov 28 15:43:22 user nova-compute[75176]:     </rng>
Nov 28 15:43:22 user nova-compute[75176]:     <controller type="usb" index="0" model="none"/>
Nov 28 15:43:22 user nova-compute[75176]:     <memballoon model="virtio">
Nov 28 15:43:22 user nova-compute[75176]:       <stats period="10"/>
Nov 28 15:43:22 user nova-compute[75176]:     </memballoon>
Nov 28 15:43:22 user nova-compute[75176]:   </devices>
Nov 28 15:43:22 user nova-compute[75176]: </domain>
Nov 28 15:43:22 user nova-compute[75176]:  {{(pid=75176) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 15:43:22 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-e200d3b9-7af9-462c-9291-4228d5ba592a tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T15:39:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-595327070',display_name='tempest-ServerActionsTestOtherB-server-595327070',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-595327070',id=3,image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG46aaldZ31/SMomPHuTDQH3UTedHGSV4iG8fWtpOqqr4Cywzy71R0Ov1C6XRnOo4sYKyOfCcRfklnh+MSVYzyKoTfjcvtFT0nSQtOBIOaQ8vVTuyCcNwyJ0nmpmqFlJng==',key_name='tempest-keypair-1738862822',keypairs=<?>,launch_index=0,launched_at=2023-11-28T15:39:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='4c2fe6bf5e4f4bb3b5d50901bfac0b38',ramdisk_id='',reservation_id='r-k1by7x80',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-935995346',owner_user_name='tempest-ServerActionsTestOtherB-935995346-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T15:43:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='16ea4be4bcb34749b2f444c4694543b1',uuid=aa223c49-d254-4727-8a01-873026847b37,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6514aeb6-8ea4-4a27-a54b-32f650c87957", "address": "fa:16:3e:ea:a6:1b", "network": {"id": "51708ad4-dae1-47fc-bd26-aca8c478ca04", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-279988751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-279988751-network", "vif_mac": "fa:16:3e:ea:a6:1b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c2fe6bf5e4f4bb3b5d50901bfac0b38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6514aeb6-8e", "ovs_interfaceid": "6514aeb6-8ea4-4a27-a54b-32f650c87957", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 15:43:22 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-e200d3b9-7af9-462c-9291-4228d5ba592a tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Converting VIF {"id": "6514aeb6-8ea4-4a27-a54b-32f650c87957", "address": "fa:16:3e:ea:a6:1b", "network": {"id": "51708ad4-dae1-47fc-bd26-aca8c478ca04", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-279988751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-279988751-network", "vif_mac": "fa:16:3e:ea:a6:1b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c2fe6bf5e4f4bb3b5d50901bfac0b38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6514aeb6-8e", "ovs_interfaceid": "6514aeb6-8ea4-4a27-a54b-32f650c87957", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:43:22 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-e200d3b9-7af9-462c-9291-4228d5ba592a tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:a6:1b,bridge_name='br-int',has_traffic_filtering=True,id=6514aeb6-8ea4-4a27-a54b-32f650c87957,network=Network(51708ad4-dae1-47fc-bd26-aca8c478ca04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6514aeb6-8e') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:43:22 user nova-compute[75176]: DEBUG os_vif [None req-e200d3b9-7af9-462c-9291-4228d5ba592a tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:a6:1b,bridge_name='br-int',has_traffic_filtering=True,id=6514aeb6-8ea4-4a27-a54b-32f650c87957,network=Network(51708ad4-dae1-47fc-bd26-aca8c478ca04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6514aeb6-8e') {{(pid=75176) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 15:43:22 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6d69e73-e4ad-4d4d-b271-055be3fa0733 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 15:43:22 user nova-compute[75176]: No targets found.
Nov 28 15:43:22 user nova-compute[75176]: iSNS:
Nov 28 15:43:22 user nova-compute[75176]: No targets found.
Nov 28 15:43:22 user nova-compute[75176]: STATIC:
Nov 28 15:43:22 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:2bb22dca-8491-42ef-815f-7b0c0ca4be5a
Nov 28 15:43:22 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:43:22 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:43:22 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d
Nov 28 15:43:22 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:43:22 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:43:22 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:ea228e4f-f9b2-477a-a75f-542bc9d47ec4
Nov 28 15:43:22 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:43:22 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:43:22 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9
Nov 28 15:43:22 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:43:22 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:43:22 user nova-compute[75176]: FIRMWARE:
Nov 28 15:43:22 user nova-compute[75176]: No targets found.
Nov 28 15:43:22 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:43:22 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6d69e73-e4ad-4d4d-b271-055be3fa0733 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 15:43:22 user nova-compute[75176]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 15:43:22 user nova-compute[75176]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75176) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 15:43:22 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6d69e73-e4ad-4d4d-b271-055be3fa0733 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9', 0)] {{(pid=75176) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 15:43:22 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:43:22 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:43:22 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 15:43:22 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:43:22 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ac9d5460-d148-5be4-9596-97c3f04e5e69', '_type': 'linux-noop'}}, row=False) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:43:22 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:43:22 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:43:22 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:43:22 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:43:22 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6514aeb6-8e, may_exist=True, interface_attrs={}) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:43:22 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6514aeb6-8e, col_values=(('qos', UUID('da20cb73-f0f7-43f8-aad7-1da8a94a6f3c')),), if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:43:22 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6514aeb6-8e, col_values=(('external_ids', {'iface-id': '6514aeb6-8ea4-4a27-a54b-32f650c87957', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ea:a6:1b', 'vm-uuid': 'aa223c49-d254-4727-8a01-873026847b37'}),), if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:43:22 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:43:22 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[25935b3c-3234-4030-a8ff-5cca54642e2c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2bb22dca-8491-42ef-815f-7b0c0ca4be5a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ea228e4f-f9b2-477a-a75f-542bc9d47ec4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:43:22 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:43:22 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:43:22 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:43:22 user nova-compute[75176]: INFO os_vif [None req-e200d3b9-7af9-462c-9291-4228d5ba592a tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:a6:1b,bridge_name='br-int',has_traffic_filtering=True,id=6514aeb6-8ea4-4a27-a54b-32f650c87957,network=Network(51708ad4-dae1-47fc-bd26-aca8c478ca04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6514aeb6-8e')
Nov 28 15:43:22 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:43:22 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[459bbb49-669c-4d89-8180-4aa7fa7f5a68]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bb22dca-8491-42ef-815f-7b0c0ca4be5a (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea228e4f-f9b2-477a-a75f-542bc9d47ec4 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d (non-flash)\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:43:22 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6d69e73-e4ad-4d4d-b271-055be3fa0733 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9 (non-flash)
Nov 28 15:43:22 user nova-compute[75176]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bb22dca-8491-42ef-815f-7b0c0ca4be5a (non-flash)
Nov 28 15:43:22 user nova-compute[75176]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea228e4f-f9b2-477a-a75f-542bc9d47ec4 (non-flash)
Nov 28 15:43:22 user nova-compute[75176]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d (non-flash)
Nov 28 15:43:22 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:43:22 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6d69e73-e4ad-4d4d-b271-055be3fa0733 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9 (non-flash)
Nov 28 15:43:22 user nova-compute[75176]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bb22dca-8491-42ef-815f-7b0c0ca4be5a (non-flash)
Nov 28 15:43:22 user nova-compute[75176]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea228e4f-f9b2-477a-a75f-542bc9d47ec4 (non-flash)
Nov 28 15:43:22 user nova-compute[75176]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d (non-flash)
Nov 28 15:43:22 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 15:43:22 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6d69e73-e4ad-4d4d-b271-055be3fa0733 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f462c68a710>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9'): ({'sdb'}, set())}) {{(pid=75176) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 15:43:22 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-e6d69e73-e4ad-4d4d-b271-055be3fa0733 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] Removing single pathed devices sdb {{(pid=75176) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 15:43:22 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:43:22 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:43:22 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[923fce37-f6d3-49c3-87bd-ec4bd4b1de9f]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:43:22 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:43:22 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-e200d3b9-7af9-462c-9291-4228d5ba592a tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] No BDM found with device name vda, not building metadata. {{(pid=75176) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 15:43:22 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-e200d3b9-7af9-462c-9291-4228d5ba592a tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75176) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 15:43:22 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-e200d3b9-7af9-462c-9291-4228d5ba592a tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] No VIF found with MAC fa:16:3e:ea:a6:1b, not building metadata {{(pid=75176) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 15:43:22 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:43:22 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[48b89f9e-9699-4943-af40-0cb684d4f229]: (4, ('ok\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:43:22 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-e6d69e73-e4ad-4d4d-b271-055be3fa0733 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] Flushing IO for device /dev/sdb {{(pid=75176) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 15:43:22 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:43:22 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:43:22 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[287f3373-bd52-402f-a852-8b1950fca251]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:43:22 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-e6d69e73-e4ad-4d4d-b271-055be3fa0733 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75176) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 15:43:22 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:43:22 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:43:22 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[612ea765-bb86-49f9-9af0-65f5922a8406]: (4, ('1', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:43:22 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-e6d69e73-e4ad-4d4d-b271-055be3fa0733 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75176) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 15:43:22 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-e6d69e73-e4ad-4d4d-b271-055be3fa0733 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] SCSI volumes sdb have been removed. {{(pid=75176) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 15:43:22 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6d69e73-e4ad-4d4d-b271-055be3fa0733 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9')] {{(pid=75176) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 15:43:22 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:43:22 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:43:22 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[c417a650-8ebc-4be1-8671-aa074e4fbd95]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:43:22 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6d69e73-e4ad-4d4d-b271-055be3fa0733 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:43:22 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9 -p 172.16.0.220:3260 --logout {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:43:22 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.118s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:43:22 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ad9e5e3-2f5e-4cb9-8584-e804bf622a83]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:43:22 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6d69e73-e4ad-4d4d-b271-055be3fa0733 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9, portal: 172.16.0.220,3260]
Nov 28 15:43:22 user nova-compute[75176]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9, portal: 172.16.0.220,3260] successful.
Nov 28 15:43:22 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:43:22 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9 -p 172.16.0.220:3260 --op delete {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:43:22 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec90fb93-901a-43ab-ba96-58f9505953e9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:43:22 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[81da0957-c8de-4312-91f8-3be799f85e65]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:43:22 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6d69e73-e4ad-4d4d-b271-055be3fa0733 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:43:22 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-e6d69e73-e4ad-4d4d-b271-055be3fa0733 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.409s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 15:43:22 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6d69e73-e4ad-4d4d-b271-055be3fa0733 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] <== disconnect_volume: return (1148ms) None {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 15:43:22 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e6d69e73-e4ad-4d4d-b271-055be3fa0733 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] [instance: 916b82eb-97e8-411c-a8ea-8c27d101b48e] Disconnected iSCSI Volume {{(pid=75176) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 15:43:22 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-e6d69e73-e4ad-4d4d-b271-055be3fa0733 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] [instance: 916b82eb-97e8-411c-a8ea-8c27d101b48e] Deleting instance files /opt/stack/data/nova/instances/916b82eb-97e8-411c-a8ea-8c27d101b48e_del
Nov 28 15:43:22 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-e6d69e73-e4ad-4d4d-b271-055be3fa0733 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] [instance: 916b82eb-97e8-411c-a8ea-8c27d101b48e] Deletion of /opt/stack/data/nova/instances/916b82eb-97e8-411c-a8ea-8c27d101b48e_del complete
Nov 28 15:43:22 user nova-compute[75176]: INFO nova.compute.manager [None req-e6d69e73-e4ad-4d4d-b271-055be3fa0733 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] [instance: 916b82eb-97e8-411c-a8ea-8c27d101b48e] Took 2.24 seconds to destroy the instance on the hypervisor.
Nov 28 15:43:22 user nova-compute[75176]: DEBUG oslo.service.loopingcall [None req-e6d69e73-e4ad-4d4d-b271-055be3fa0733 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75176) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 15:43:22 user nova-compute[75176]: DEBUG nova.compute.manager [-] [instance: 916b82eb-97e8-411c-a8ea-8c27d101b48e] Deallocating network for instance {{(pid=75176) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 15:43:22 user nova-compute[75176]: DEBUG nova.network.neutron [-] [instance: 916b82eb-97e8-411c-a8ea-8c27d101b48e] deallocate_for_instance() {{(pid=75176) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 15:43:22 user nova-compute[75176]: DEBUG nova.compute.manager [req-17551ec5-d6dc-49a7-af7f-230f806562c0 req-b766f2ad-06b0-4e8b-8bad-e2bf1d52107a service nova] [instance: 916b82eb-97e8-411c-a8ea-8c27d101b48e] Received event network-vif-plugged-38bef3fc-c841-4db3-b429-8fe94a224783 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:43:22 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-17551ec5-d6dc-49a7-af7f-230f806562c0 req-b766f2ad-06b0-4e8b-8bad-e2bf1d52107a service nova] Acquiring lock "916b82eb-97e8-411c-a8ea-8c27d101b48e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:43:22 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-17551ec5-d6dc-49a7-af7f-230f806562c0 req-b766f2ad-06b0-4e8b-8bad-e2bf1d52107a service nova] Lock "916b82eb-97e8-411c-a8ea-8c27d101b48e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:43:22 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-17551ec5-d6dc-49a7-af7f-230f806562c0 req-b766f2ad-06b0-4e8b-8bad-e2bf1d52107a service nova] Lock "916b82eb-97e8-411c-a8ea-8c27d101b48e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:43:22 user nova-compute[75176]: DEBUG nova.compute.manager [req-17551ec5-d6dc-49a7-af7f-230f806562c0 req-b766f2ad-06b0-4e8b-8bad-e2bf1d52107a service nova] [instance: 916b82eb-97e8-411c-a8ea-8c27d101b48e] No waiting events found dispatching network-vif-plugged-38bef3fc-c841-4db3-b429-8fe94a224783 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:43:22 user nova-compute[75176]: WARNING nova.compute.manager [req-17551ec5-d6dc-49a7-af7f-230f806562c0 req-b766f2ad-06b0-4e8b-8bad-e2bf1d52107a service nova] [instance: 916b82eb-97e8-411c-a8ea-8c27d101b48e] Received unexpected event network-vif-plugged-38bef3fc-c841-4db3-b429-8fe94a224783 for instance with vm_state active and task_state deleting.
Nov 28 15:43:23 user nova-compute[75176]: DEBUG nova.network.neutron [-] [instance: 916b82eb-97e8-411c-a8ea-8c27d101b48e] Updating instance_info_cache with network_info: [] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:43:23 user nova-compute[75176]: DEBUG nova.compute.manager [req-5cad9f04-72e3-40ee-9379-1dcb82732a1b req-0456bbd3-a5f3-4dae-9787-d6df32f56208 service nova] [instance: 916b82eb-97e8-411c-a8ea-8c27d101b48e] Received event network-vif-deleted-38bef3fc-c841-4db3-b429-8fe94a224783 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:43:23 user nova-compute[75176]: INFO nova.compute.manager [req-5cad9f04-72e3-40ee-9379-1dcb82732a1b req-0456bbd3-a5f3-4dae-9787-d6df32f56208 service nova] [instance: 916b82eb-97e8-411c-a8ea-8c27d101b48e] Neutron deleted interface 38bef3fc-c841-4db3-b429-8fe94a224783; detaching it from the instance and deleting it from the info cache
Nov 28 15:43:23 user nova-compute[75176]: DEBUG nova.network.neutron [req-5cad9f04-72e3-40ee-9379-1dcb82732a1b req-0456bbd3-a5f3-4dae-9787-d6df32f56208 service nova] [instance: 916b82eb-97e8-411c-a8ea-8c27d101b48e] Updating instance_info_cache with network_info: [] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:43:23 user nova-compute[75176]: INFO nova.compute.manager [-] [instance: 916b82eb-97e8-411c-a8ea-8c27d101b48e] Took 0.82 seconds to deallocate network for instance.
Nov 28 15:43:23 user nova-compute[75176]: DEBUG nova.compute.manager [req-5cad9f04-72e3-40ee-9379-1dcb82732a1b req-0456bbd3-a5f3-4dae-9787-d6df32f56208 service nova] [instance: 916b82eb-97e8-411c-a8ea-8c27d101b48e] Detach interface failed, port_id=38bef3fc-c841-4db3-b429-8fe94a224783, reason: Instance 916b82eb-97e8-411c-a8ea-8c27d101b48e could not be found. {{(pid=75176) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 28 15:43:23 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:43:23 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:43:23 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:43:23 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:43:24 user nova-compute[75176]: INFO nova.compute.manager [None req-e6d69e73-e4ad-4d4d-b271-055be3fa0733 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] [instance: 916b82eb-97e8-411c-a8ea-8c27d101b48e] Took 1.03 seconds to detach 1 volumes for instance.
Nov 28 15:43:24 user nova-compute[75176]: DEBUG nova.compute.manager [None req-e6d69e73-e4ad-4d4d-b271-055be3fa0733 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] [instance: 916b82eb-97e8-411c-a8ea-8c27d101b48e] Deleting volume: ec90fb93-901a-43ab-ba96-58f9505953e9 {{(pid=75176) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 28 15:43:24 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:43:24 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:43:24 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:43:24 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-e6d69e73-e4ad-4d4d-b271-055be3fa0733 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:43:24 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-e6d69e73-e4ad-4d4d-b271-055be3fa0733 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:43:24 user nova-compute[75176]: DEBUG nova.compute.provider_tree [None req-e6d69e73-e4ad-4d4d-b271-055be3fa0733 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] Inventory has not changed in ProviderTree for provider: b37848d8-f401-4155-a029-b0ffa09ff85b {{(pid=75176) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 15:43:24 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-e6d69e73-e4ad-4d4d-b271-055be3fa0733 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] Inventory has not changed for provider b37848d8-f401-4155-a029-b0ffa09ff85b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75176) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 15:43:24 user nova-compute[75176]: DEBUG nova.compute.manager [req-06e28454-949b-468b-ac3d-8bc6e2db7e93 req-ab41fa53-272d-4e85-b9e6-13ba9d7019fc service nova] [instance: aa223c49-d254-4727-8a01-873026847b37] Received event network-vif-plugged-6514aeb6-8ea4-4a27-a54b-32f650c87957 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:43:24 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-06e28454-949b-468b-ac3d-8bc6e2db7e93 req-ab41fa53-272d-4e85-b9e6-13ba9d7019fc service nova] Acquiring lock "aa223c49-d254-4727-8a01-873026847b37-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:43:24 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-06e28454-949b-468b-ac3d-8bc6e2db7e93 req-ab41fa53-272d-4e85-b9e6-13ba9d7019fc service nova] Lock "aa223c49-d254-4727-8a01-873026847b37-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:43:24 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-06e28454-949b-468b-ac3d-8bc6e2db7e93 req-ab41fa53-272d-4e85-b9e6-13ba9d7019fc service nova] Lock "aa223c49-d254-4727-8a01-873026847b37-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:43:24 user nova-compute[75176]: DEBUG nova.compute.manager [req-06e28454-949b-468b-ac3d-8bc6e2db7e93 req-ab41fa53-272d-4e85-b9e6-13ba9d7019fc service nova] [instance: aa223c49-d254-4727-8a01-873026847b37] No waiting events found dispatching network-vif-plugged-6514aeb6-8ea4-4a27-a54b-32f650c87957 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:43:24 user nova-compute[75176]: WARNING nova.compute.manager [req-06e28454-949b-468b-ac3d-8bc6e2db7e93 req-ab41fa53-272d-4e85-b9e6-13ba9d7019fc service nova] [instance: aa223c49-d254-4727-8a01-873026847b37] Received unexpected event network-vif-plugged-6514aeb6-8ea4-4a27-a54b-32f650c87957 for instance with vm_state active and task_state resize_finish.
Nov 28 15:43:24 user nova-compute[75176]: DEBUG nova.compute.manager [req-06e28454-949b-468b-ac3d-8bc6e2db7e93 req-ab41fa53-272d-4e85-b9e6-13ba9d7019fc service nova] [instance: aa223c49-d254-4727-8a01-873026847b37] Received event network-vif-plugged-6514aeb6-8ea4-4a27-a54b-32f650c87957 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:43:24 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-06e28454-949b-468b-ac3d-8bc6e2db7e93 req-ab41fa53-272d-4e85-b9e6-13ba9d7019fc service nova] Acquiring lock "aa223c49-d254-4727-8a01-873026847b37-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:43:24 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-06e28454-949b-468b-ac3d-8bc6e2db7e93 req-ab41fa53-272d-4e85-b9e6-13ba9d7019fc service nova] Lock "aa223c49-d254-4727-8a01-873026847b37-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:43:24 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-06e28454-949b-468b-ac3d-8bc6e2db7e93 req-ab41fa53-272d-4e85-b9e6-13ba9d7019fc service nova] Lock "aa223c49-d254-4727-8a01-873026847b37-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:43:24 user nova-compute[75176]: DEBUG nova.compute.manager [req-06e28454-949b-468b-ac3d-8bc6e2db7e93 req-ab41fa53-272d-4e85-b9e6-13ba9d7019fc service nova] [instance: aa223c49-d254-4727-8a01-873026847b37] No waiting events found dispatching network-vif-plugged-6514aeb6-8ea4-4a27-a54b-32f650c87957 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:43:24 user nova-compute[75176]: WARNING nova.compute.manager [req-06e28454-949b-468b-ac3d-8bc6e2db7e93 req-ab41fa53-272d-4e85-b9e6-13ba9d7019fc service nova] [instance: aa223c49-d254-4727-8a01-873026847b37] Received unexpected event network-vif-plugged-6514aeb6-8ea4-4a27-a54b-32f650c87957 for instance with vm_state active and task_state resize_finish.
Nov 28 15:43:24 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-e6d69e73-e4ad-4d4d-b271-055be3fa0733 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.457s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:43:24 user nova-compute[75176]: INFO nova.scheduler.client.report [None req-e6d69e73-e4ad-4d4d-b271-055be3fa0733 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] Deleted allocations for instance 916b82eb-97e8-411c-a8ea-8c27d101b48e
Nov 28 15:43:25 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-e6d69e73-e4ad-4d4d-b271-055be3fa0733 tempest-ServerActionsV293TestJSON-267222163 tempest-ServerActionsV293TestJSON-267222163-project-member] Lock "916b82eb-97e8-411c-a8ea-8c27d101b48e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.917s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:43:26 user nova-compute[75176]: DEBUG nova.compute.manager [None req-e200d3b9-7af9-462c-9291-4228d5ba592a tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] [instance: aa223c49-d254-4727-8a01-873026847b37] Instance event wait completed in 0 seconds for  {{(pid=75176) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 15:43:26 user nova-compute[75176]: INFO nova.virt.libvirt.driver [-] [instance: aa223c49-d254-4727-8a01-873026847b37] Instance running successfully.
Nov 28 15:43:26 user nova-compute[75176]: DEBUG nova.virt.libvirt.guest [None req-e200d3b9-7af9-462c-9291-4228d5ba592a tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] [instance: aa223c49-d254-4727-8a01-873026847b37] Failed to set time: agent not configured {{(pid=75176) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 28 15:43:26 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-e200d3b9-7af9-462c-9291-4228d5ba592a tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] [instance: aa223c49-d254-4727-8a01-873026847b37] finish_migration finished successfully. {{(pid=75176) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11766}}
Nov 28 15:43:27 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:43:28 user nova-compute[75176]: DEBUG nova.compute.manager [req-0d7c5d0c-8657-4160-84a6-79fd4062821f req-181af92a-a755-43f3-92ea-ea678c1d890b service nova] [instance: 47306d53-9ad7-4cae-ba6d-1f65239ef30f] Received event network-changed-c3d44009-c128-4e98-8594-132ed6c85dbc {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:43:28 user nova-compute[75176]: DEBUG nova.compute.manager [req-0d7c5d0c-8657-4160-84a6-79fd4062821f req-181af92a-a755-43f3-92ea-ea678c1d890b service nova] [instance: 47306d53-9ad7-4cae-ba6d-1f65239ef30f] Refreshing instance network info cache due to event network-changed-c3d44009-c128-4e98-8594-132ed6c85dbc. {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 15:43:28 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-0d7c5d0c-8657-4160-84a6-79fd4062821f req-181af92a-a755-43f3-92ea-ea678c1d890b service nova] Acquiring lock "refresh_cache-47306d53-9ad7-4cae-ba6d-1f65239ef30f" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:43:28 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-0d7c5d0c-8657-4160-84a6-79fd4062821f req-181af92a-a755-43f3-92ea-ea678c1d890b service nova] Acquired lock "refresh_cache-47306d53-9ad7-4cae-ba6d-1f65239ef30f" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:43:28 user nova-compute[75176]: DEBUG nova.network.neutron [req-0d7c5d0c-8657-4160-84a6-79fd4062821f req-181af92a-a755-43f3-92ea-ea678c1d890b service nova] [instance: 47306d53-9ad7-4cae-ba6d-1f65239ef30f] Refreshing network info cache for port c3d44009-c128-4e98-8594-132ed6c85dbc {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 15:43:28 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:43:29 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:43:29 user nova-compute[75176]: DEBUG nova.network.neutron [req-0d7c5d0c-8657-4160-84a6-79fd4062821f req-181af92a-a755-43f3-92ea-ea678c1d890b service nova] [instance: 47306d53-9ad7-4cae-ba6d-1f65239ef30f] Updated VIF entry in instance network info cache for port c3d44009-c128-4e98-8594-132ed6c85dbc. {{(pid=75176) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 15:43:29 user nova-compute[75176]: DEBUG nova.network.neutron [req-0d7c5d0c-8657-4160-84a6-79fd4062821f req-181af92a-a755-43f3-92ea-ea678c1d890b service nova] [instance: 47306d53-9ad7-4cae-ba6d-1f65239ef30f] Updating instance_info_cache with network_info: [{"id": "c3d44009-c128-4e98-8594-132ed6c85dbc", "address": "fa:16:3e:0b:f3:cf", "network": {"id": "b06b85af-96d9-41cb-9ad2-7fc0523761e7", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-850315220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc1dfeef484e4627a0061d9d36fd2b40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3d44009-c1", "ovs_interfaceid": "c3d44009-c128-4e98-8594-132ed6c85dbc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:43:29 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-0d7c5d0c-8657-4160-84a6-79fd4062821f req-181af92a-a755-43f3-92ea-ea678c1d890b service nova] Releasing lock "refresh_cache-47306d53-9ad7-4cae-ba6d-1f65239ef30f" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:43:32 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:43:32 user nova-compute[75176]: DEBUG nova.compute.manager [req-f5588eb7-0695-4231-9d0a-c4c8bdaf26fa req-0c087efb-a7c5-414c-8545-1cf1942c26da service nova] [instance: 47306d53-9ad7-4cae-ba6d-1f65239ef30f] Received event network-changed-c3d44009-c128-4e98-8594-132ed6c85dbc {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:43:32 user nova-compute[75176]: DEBUG nova.compute.manager [req-f5588eb7-0695-4231-9d0a-c4c8bdaf26fa req-0c087efb-a7c5-414c-8545-1cf1942c26da service nova] [instance: 47306d53-9ad7-4cae-ba6d-1f65239ef30f] Refreshing instance network info cache due to event network-changed-c3d44009-c128-4e98-8594-132ed6c85dbc. {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 15:43:32 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-f5588eb7-0695-4231-9d0a-c4c8bdaf26fa req-0c087efb-a7c5-414c-8545-1cf1942c26da service nova] Acquiring lock "refresh_cache-47306d53-9ad7-4cae-ba6d-1f65239ef30f" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:43:32 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-f5588eb7-0695-4231-9d0a-c4c8bdaf26fa req-0c087efb-a7c5-414c-8545-1cf1942c26da service nova] Acquired lock "refresh_cache-47306d53-9ad7-4cae-ba6d-1f65239ef30f" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:43:32 user nova-compute[75176]: DEBUG nova.network.neutron [req-f5588eb7-0695-4231-9d0a-c4c8bdaf26fa req-0c087efb-a7c5-414c-8545-1cf1942c26da service nova] [instance: 47306d53-9ad7-4cae-ba6d-1f65239ef30f] Refreshing network info cache for port c3d44009-c128-4e98-8594-132ed6c85dbc {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 15:43:33 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:43:33 user nova-compute[75176]: DEBUG nova.network.neutron [req-f5588eb7-0695-4231-9d0a-c4c8bdaf26fa req-0c087efb-a7c5-414c-8545-1cf1942c26da service nova] [instance: 47306d53-9ad7-4cae-ba6d-1f65239ef30f] Updated VIF entry in instance network info cache for port c3d44009-c128-4e98-8594-132ed6c85dbc. {{(pid=75176) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 15:43:33 user nova-compute[75176]: DEBUG nova.network.neutron [req-f5588eb7-0695-4231-9d0a-c4c8bdaf26fa req-0c087efb-a7c5-414c-8545-1cf1942c26da service nova] [instance: 47306d53-9ad7-4cae-ba6d-1f65239ef30f] Updating instance_info_cache with network_info: [{"id": "c3d44009-c128-4e98-8594-132ed6c85dbc", "address": "fa:16:3e:0b:f3:cf", "network": {"id": "b06b85af-96d9-41cb-9ad2-7fc0523761e7", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-850315220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc1dfeef484e4627a0061d9d36fd2b40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3d44009-c1", "ovs_interfaceid": "c3d44009-c128-4e98-8594-132ed6c85dbc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:43:33 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-f5588eb7-0695-4231-9d0a-c4c8bdaf26fa req-0c087efb-a7c5-414c-8545-1cf1942c26da service nova] Releasing lock "refresh_cache-47306d53-9ad7-4cae-ba6d-1f65239ef30f" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:43:34 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:43:37 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:43:37 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-1944b45d-2750-4b30-8bee-fdf7e29396ea tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Acquiring lock "47306d53-9ad7-4cae-ba6d-1f65239ef30f" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:43:37 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-1944b45d-2750-4b30-8bee-fdf7e29396ea tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Lock "47306d53-9ad7-4cae-ba6d-1f65239ef30f" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:43:37 user nova-compute[75176]: INFO nova.compute.manager [None req-1944b45d-2750-4b30-8bee-fdf7e29396ea tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] [instance: 47306d53-9ad7-4cae-ba6d-1f65239ef30f] Rebooting instance
Nov 28 15:43:37 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-1944b45d-2750-4b30-8bee-fdf7e29396ea tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Acquiring lock "refresh_cache-47306d53-9ad7-4cae-ba6d-1f65239ef30f" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:43:37 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-1944b45d-2750-4b30-8bee-fdf7e29396ea tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Acquired lock "refresh_cache-47306d53-9ad7-4cae-ba6d-1f65239ef30f" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:43:37 user nova-compute[75176]: DEBUG nova.network.neutron [None req-1944b45d-2750-4b30-8bee-fdf7e29396ea tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] [instance: 47306d53-9ad7-4cae-ba6d-1f65239ef30f] Building network info cache for instance {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 15:43:38 user nova-compute[75176]: DEBUG nova.network.neutron [None req-1944b45d-2750-4b30-8bee-fdf7e29396ea tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] [instance: 47306d53-9ad7-4cae-ba6d-1f65239ef30f] Updating instance_info_cache with network_info: [{"id": "c3d44009-c128-4e98-8594-132ed6c85dbc", "address": "fa:16:3e:0b:f3:cf", "network": {"id": "b06b85af-96d9-41cb-9ad2-7fc0523761e7", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-850315220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc1dfeef484e4627a0061d9d36fd2b40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3d44009-c1", "ovs_interfaceid": "c3d44009-c128-4e98-8594-132ed6c85dbc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:43:38 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-1944b45d-2750-4b30-8bee-fdf7e29396ea tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Releasing lock "refresh_cache-47306d53-9ad7-4cae-ba6d-1f65239ef30f" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:43:38 user nova-compute[75176]: DEBUG nova.compute.manager [None req-1944b45d-2750-4b30-8bee-fdf7e29396ea tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] [instance: 47306d53-9ad7-4cae-ba6d-1f65239ef30f] Checking state {{(pid=75176) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 15:43:38 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:43:38 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:43:38 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:43:38 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:43:38 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:43:38 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:43:38 user nova-compute[75176]: DEBUG nova.compute.manager [req-7cfe03c6-e25a-411b-821a-ca20ca75f8f6 req-5ecb08ef-05d7-45d9-b275-b601f4d3ceae service nova] [instance: 47306d53-9ad7-4cae-ba6d-1f65239ef30f] Received event network-vif-unplugged-c3d44009-c128-4e98-8594-132ed6c85dbc {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:43:38 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-7cfe03c6-e25a-411b-821a-ca20ca75f8f6 req-5ecb08ef-05d7-45d9-b275-b601f4d3ceae service nova] Acquiring lock "47306d53-9ad7-4cae-ba6d-1f65239ef30f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:43:38 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-7cfe03c6-e25a-411b-821a-ca20ca75f8f6 req-5ecb08ef-05d7-45d9-b275-b601f4d3ceae service nova] Lock "47306d53-9ad7-4cae-ba6d-1f65239ef30f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:43:38 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-7cfe03c6-e25a-411b-821a-ca20ca75f8f6 req-5ecb08ef-05d7-45d9-b275-b601f4d3ceae service nova] Lock "47306d53-9ad7-4cae-ba6d-1f65239ef30f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:43:38 user nova-compute[75176]: DEBUG nova.compute.manager [req-7cfe03c6-e25a-411b-821a-ca20ca75f8f6 req-5ecb08ef-05d7-45d9-b275-b601f4d3ceae service nova] [instance: 47306d53-9ad7-4cae-ba6d-1f65239ef30f] No waiting events found dispatching network-vif-unplugged-c3d44009-c128-4e98-8594-132ed6c85dbc {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:43:38 user nova-compute[75176]: WARNING nova.compute.manager [req-7cfe03c6-e25a-411b-821a-ca20ca75f8f6 req-5ecb08ef-05d7-45d9-b275-b601f4d3ceae service nova] [instance: 47306d53-9ad7-4cae-ba6d-1f65239ef30f] Received unexpected event network-vif-unplugged-c3d44009-c128-4e98-8594-132ed6c85dbc for instance with vm_state active and task_state reboot_started_hard.
Nov 28 15:43:39 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:43:39 user nova-compute[75176]: INFO nova.virt.libvirt.driver [-] [instance: 47306d53-9ad7-4cae-ba6d-1f65239ef30f] Instance destroyed successfully.
Nov 28 15:43:39 user nova-compute[75176]: DEBUG nova.objects.instance [None req-1944b45d-2750-4b30-8bee-fdf7e29396ea tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Lazy-loading 'resources' on Instance uuid 47306d53-9ad7-4cae-ba6d-1f65239ef30f {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:43:39 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-1944b45d-2750-4b30-8bee-fdf7e29396ea tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T15:41:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1171264206',display_name='tempest-TestMinimumBasicScenario-server-1171264206',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1171264206',id=12,image_ref='920bce21-95d9-45fe-a682-1abb452c4ccc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK1Yogtu9cHTqj/O0yW5ilhTCHe9GWdz8HcrAmcuCSEjGwLVrrqLCp+oEhqH6U3k5OzpunBE1hBj3JYBdp1D5PZTdSdrxBnMO+7y0Ja6VHcYxZP1f9WjFaePvpMxZeLKXg==',key_name='tempest-TestMinimumBasicScenario-327229554',keypairs=<?>,launch_index=0,launched_at=2023-11-28T15:41:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bc1dfeef484e4627a0061d9d36fd2b40',ramdisk_id='',reservation_id='r-mryylpp6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='920bce21-95d9-45fe-a682-1abb452c4ccc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-438096803',owner_user_name='tempest-TestMinimumBasicScenario-438096803-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T15:43:38Z,user_data=None,user_id='54766bbdce4346c0bd508451478b50aa',uuid=47306d53-9ad7-4cae-ba6d-1f65239ef30f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c3d44009-c128-4e98-8594-132ed6c85dbc", "address": "fa:16:3e:0b:f3:cf", "network": {"id": "b06b85af-96d9-41cb-9ad2-7fc0523761e7", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-850315220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc1dfeef484e4627a0061d9d36fd2b40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3d44009-c1", "ovs_interfaceid": "c3d44009-c128-4e98-8594-132ed6c85dbc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 15:43:39 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-1944b45d-2750-4b30-8bee-fdf7e29396ea tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Converting VIF {"id": "c3d44009-c128-4e98-8594-132ed6c85dbc", "address": "fa:16:3e:0b:f3:cf", "network": {"id": "b06b85af-96d9-41cb-9ad2-7fc0523761e7", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-850315220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc1dfeef484e4627a0061d9d36fd2b40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3d44009-c1", "ovs_interfaceid": "c3d44009-c128-4e98-8594-132ed6c85dbc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:43:39 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-1944b45d-2750-4b30-8bee-fdf7e29396ea tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0b:f3:cf,bridge_name='br-int',has_traffic_filtering=True,id=c3d44009-c128-4e98-8594-132ed6c85dbc,network=Network(b06b85af-96d9-41cb-9ad2-7fc0523761e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3d44009-c1') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:43:39 user nova-compute[75176]: DEBUG os_vif [None req-1944b45d-2750-4b30-8bee-fdf7e29396ea tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0b:f3:cf,bridge_name='br-int',has_traffic_filtering=True,id=c3d44009-c128-4e98-8594-132ed6c85dbc,network=Network(b06b85af-96d9-41cb-9ad2-7fc0523761e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3d44009-c1') {{(pid=75176) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 15:43:39 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:43:39 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc3d44009-c1, bridge=br-int, if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:43:39 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:43:39 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:43:39 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:43:39 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=77270294-5f6a-4788-bfa4-540cab3328e8) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:43:39 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:43:39 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:43:39 user nova-compute[75176]: INFO os_vif [None req-1944b45d-2750-4b30-8bee-fdf7e29396ea tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0b:f3:cf,bridge_name='br-int',has_traffic_filtering=True,id=c3d44009-c128-4e98-8594-132ed6c85dbc,network=Network(b06b85af-96d9-41cb-9ad2-7fc0523761e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3d44009-c1')
Nov 28 15:43:39 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1944b45d-2750-4b30-8bee-fdf7e29396ea tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] [instance: 47306d53-9ad7-4cae-ba6d-1f65239ef30f] calling os-brick to detach iSCSI Volume {{(pid=75176) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 15:43:39 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-1944b45d-2750-4b30-8bee-fdf7e29396ea tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c1b8a00>, {'target_iqn': 'iqn.2010-10.org.openstack:ea228e4f-f9b2-477a-a75f-542bc9d47ec4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jPmwncDA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 15:43:39 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-1944b45d-2750-4b30-8bee-fdf7e29396ea tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 15:43:39 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-1944b45d-2750-4b30-8bee-fdf7e29396ea tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 15:43:39 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-1944b45d-2750-4b30-8bee-fdf7e29396ea tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 15:43:39 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:43:39 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:43:39 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6afa744-28db-42a3-b3d6-50f21c024888]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2bb22dca-8491-42ef-815f-7b0c0ca4be5a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ea228e4f-f9b2-477a-a75f-542bc9d47ec4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:43:39 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-1944b45d-2750-4b30-8bee-fdf7e29396ea tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 15:43:39 user nova-compute[75176]: No targets found.
Nov 28 15:43:39 user nova-compute[75176]: iSNS:
Nov 28 15:43:39 user nova-compute[75176]: No targets found.
Nov 28 15:43:39 user nova-compute[75176]: STATIC:
Nov 28 15:43:39 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:2bb22dca-8491-42ef-815f-7b0c0ca4be5a
Nov 28 15:43:39 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:43:39 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:43:39 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d
Nov 28 15:43:39 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:43:39 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:43:39 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:ea228e4f-f9b2-477a-a75f-542bc9d47ec4
Nov 28 15:43:39 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:43:39 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:43:39 user nova-compute[75176]: FIRMWARE:
Nov 28 15:43:39 user nova-compute[75176]: No targets found.
Nov 28 15:43:39 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:43:39 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-1944b45d-2750-4b30-8bee-fdf7e29396ea tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 15:43:39 user nova-compute[75176]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 15:43:39 user nova-compute[75176]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75176) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 15:43:39 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-1944b45d-2750-4b30-8bee-fdf7e29396ea tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ea228e4f-f9b2-477a-a75f-542bc9d47ec4', 0)] {{(pid=75176) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 15:43:39 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:43:39 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:43:39 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f669e03-e0ba-45eb-8a91-4fa4a4e21bef]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2bb22dca-8491-42ef-815f-7b0c0ca4be5a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ea228e4f-f9b2-477a-a75f-542bc9d47ec4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:43:39 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:43:39 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:43:39 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[623bbf71-e641-4a31-9b86-4990c34a2bb2]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bb22dca-8491-42ef-815f-7b0c0ca4be5a (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea228e4f-f9b2-477a-a75f-542bc9d47ec4 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d (non-flash)\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:43:39 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-1944b45d-2750-4b30-8bee-fdf7e29396ea tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bb22dca-8491-42ef-815f-7b0c0ca4be5a (non-flash)
Nov 28 15:43:39 user nova-compute[75176]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea228e4f-f9b2-477a-a75f-542bc9d47ec4 (non-flash)
Nov 28 15:43:39 user nova-compute[75176]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d (non-flash)
Nov 28 15:43:39 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:43:39 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-1944b45d-2750-4b30-8bee-fdf7e29396ea tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bb22dca-8491-42ef-815f-7b0c0ca4be5a (non-flash)
Nov 28 15:43:39 user nova-compute[75176]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea228e4f-f9b2-477a-a75f-542bc9d47ec4 (non-flash)
Nov 28 15:43:39 user nova-compute[75176]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d (non-flash)
Nov 28 15:43:39 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 15:43:39 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-1944b45d-2750-4b30-8bee-fdf7e29396ea tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f462c641cf0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ea228e4f-f9b2-477a-a75f-542bc9d47ec4'): ({'sdd'}, set())}) {{(pid=75176) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 15:43:39 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-1944b45d-2750-4b30-8bee-fdf7e29396ea tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Removing single pathed devices sdd {{(pid=75176) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 15:43:39 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:43:39 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:43:39 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[612f1440-70df-4105-bafa-aac575b1512c]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:43:39 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:43:39 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.024s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:43:39 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce03206d-7766-43f3-b51b-a75d48b53453]: (4, ('ok\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:43:39 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-1944b45d-2750-4b30-8bee-fdf7e29396ea tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Flushing IO for device /dev/sdd {{(pid=75176) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 15:43:39 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:43:39 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:43:39 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbe0e6c8-0665-42c0-96b6-98c51d2b2158]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:43:39 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-1944b45d-2750-4b30-8bee-fdf7e29396ea tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75176) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 15:43:39 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:43:39 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.038s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:43:39 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[1917c69a-fb8c-4596-8526-c8148278bda8]: (4, ('1', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:43:39 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-1944b45d-2750-4b30-8bee-fdf7e29396ea tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75176) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 15:43:39 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-1944b45d-2750-4b30-8bee-fdf7e29396ea tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] SCSI volumes sdd have been removed. {{(pid=75176) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 15:43:39 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-1944b45d-2750-4b30-8bee-fdf7e29396ea tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ea228e4f-f9b2-477a-a75f-542bc9d47ec4')] {{(pid=75176) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 15:43:39 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea228e4f-f9b2-477a-a75f-542bc9d47ec4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:43:39 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea228e4f-f9b2-477a-a75f-542bc9d47ec4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:43:39 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[5df883dd-184d-4823-8b05-61ae1dbf4332]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:43:39 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-1944b45d-2750-4b30-8bee-fdf7e29396ea tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:43:39 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea228e4f-f9b2-477a-a75f-542bc9d47ec4 -p 172.16.0.220:3260 --logout {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:43:39 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea228e4f-f9b2-477a-a75f-542bc9d47ec4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:43:39 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8757648-5ed4-4c0d-9634-d7bfafdf5e3c]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:ea228e4f-f9b2-477a-a75f-542bc9d47ec4, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:ea228e4f-f9b2-477a-a75f-542bc9d47ec4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:43:39 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-1944b45d-2750-4b30-8bee-fdf7e29396ea tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:ea228e4f-f9b2-477a-a75f-542bc9d47ec4, portal: 172.16.0.220,3260]
Nov 28 15:43:39 user nova-compute[75176]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:ea228e4f-f9b2-477a-a75f-542bc9d47ec4, portal: 172.16.0.220,3260] successful.
Nov 28 15:43:39 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:43:39 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea228e4f-f9b2-477a-a75f-542bc9d47ec4 -p 172.16.0.220:3260 --op delete {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:43:39 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea228e4f-f9b2-477a-a75f-542bc9d47ec4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.040s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:43:39 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[df6b7c06-bae9-4c21-a964-d728ec956aaa]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:43:39 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-1944b45d-2750-4b30-8bee-fdf7e29396ea tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:43:39 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-1944b45d-2750-4b30-8bee-fdf7e29396ea tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.354s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 15:43:39 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-1944b45d-2750-4b30-8bee-fdf7e29396ea tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] <== disconnect_volume: return (356ms) None {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 15:43:39 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1944b45d-2750-4b30-8bee-fdf7e29396ea tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] [instance: 47306d53-9ad7-4cae-ba6d-1f65239ef30f] Disconnected iSCSI Volume {{(pid=75176) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 15:43:39 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-1944b45d-2750-4b30-8bee-fdf7e29396ea tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] [instance: 47306d53-9ad7-4cae-ba6d-1f65239ef30f] Start _get_guest_xml network_info=[{"id": "c3d44009-c128-4e98-8594-132ed6c85dbc", "address": "fa:16:3e:0b:f3:cf", "network": {"id": "b06b85af-96d9-41cb-9ad2-7fc0523761e7", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-850315220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc1dfeef484e4627a0061d9d36fd2b40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3d44009-c1", "ovs_interfaceid": "c3d44009-c128-4e98-8594-132ed6c85dbc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=920bce21-95d9-45fe-a682-1abb452c4ccc,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'size': 0, 'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'image_id': '920bce21-95d9-45fe-a682-1abb452c4ccc'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ea228e4f-f9b2-477a-a75f-542bc9d47ec4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jPmwncDA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '47306d53-9ad7-4cae-ba6d-1f65239ef30f', 'attached_at': '', 'detached_at': '', 'volume_id': 'ea228e4f-f9b2-477a-a75f-542bc9d47ec4', 'serial': 'ea228e4f-f9b2-477a-a75f-542bc9d47ec4'}, 'guest_format': None, 'device_type': 'disk', 'boot_index': None, 'disk_bus': 'virtio', 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'attachment_id': 'c3f5e60a-ea22-4d69-b805-98166d6358dd', 'volume_type': None} {{(pid=75176) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 15:43:39 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-1944b45d-2750-4b30-8bee-fdf7e29396ea tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 15:43:39 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-1944b45d-2750-4b30-8bee-fdf7e29396ea tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 15:43:39 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-1944b45d-2750-4b30-8bee-fdf7e29396ea tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75176) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 15:43:39 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-1944b45d-2750-4b30-8bee-fdf7e29396ea tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] CPU controller missing on host. {{(pid=75176) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 15:43:39 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-1944b45d-2750-4b30-8bee-fdf7e29396ea tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75176) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 15:43:39 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-1944b45d-2750-4b30-8bee-fdf7e29396ea tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] CPU controller found on host. {{(pid=75176) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 15:43:39 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-1944b45d-2750-4b30-8bee-fdf7e29396ea tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75176) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 15:43:39 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-1944b45d-2750-4b30-8bee-fdf7e29396ea tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T15:35:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=920bce21-95d9-45fe-a682-1abb452c4ccc,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 15:43:39 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-1944b45d-2750-4b30-8bee-fdf7e29396ea tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Flavor limits 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 15:43:39 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-1944b45d-2750-4b30-8bee-fdf7e29396ea tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Image limits 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 15:43:39 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-1944b45d-2750-4b30-8bee-fdf7e29396ea tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Flavor pref 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 15:43:39 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-1944b45d-2750-4b30-8bee-fdf7e29396ea tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Image pref 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 15:43:39 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-1944b45d-2750-4b30-8bee-fdf7e29396ea tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 15:43:39 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-1944b45d-2750-4b30-8bee-fdf7e29396ea tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 15:43:39 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-1944b45d-2750-4b30-8bee-fdf7e29396ea tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75176) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 15:43:39 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-1944b45d-2750-4b30-8bee-fdf7e29396ea tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Got 1 possible topologies {{(pid=75176) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 15:43:39 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-1944b45d-2750-4b30-8bee-fdf7e29396ea tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 15:43:39 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-1944b45d-2750-4b30-8bee-fdf7e29396ea tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 15:43:39 user nova-compute[75176]: DEBUG nova.objects.instance [None req-1944b45d-2750-4b30-8bee-fdf7e29396ea tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Lazy-loading 'vcpu_model' on Instance uuid 47306d53-9ad7-4cae-ba6d-1f65239ef30f {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:43:39 user nova-compute[75176]: DEBUG nova.objects.base [None req-1944b45d-2750-4b30-8bee-fdf7e29396ea tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Object Instance<47306d53-9ad7-4cae-ba6d-1f65239ef30f> lazy-loaded attributes: resources,vcpu_model {{(pid=75176) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 15:43:39 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1944b45d-2750-4b30-8bee-fdf7e29396ea tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] [instance: 47306d53-9ad7-4cae-ba6d-1f65239ef30f] Calling os-brick to attach iSCSI Volume {{(pid=75176) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 15:43:39 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-1944b45d-2750-4b30-8bee-fdf7e29396ea tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c1b8a00>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ea228e4f-f9b2-477a-a75f-542bc9d47ec4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jPmwncDA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 15:43:39 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-1944b45d-2750-4b30-8bee-fdf7e29396ea tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 15:43:39 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-1944b45d-2750-4b30-8bee-fdf7e29396ea tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 15:43:39 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-1944b45d-2750-4b30-8bee-fdf7e29396ea tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 15:43:39 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-1944b45d-2750-4b30-8bee-fdf7e29396ea tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 15:43:39 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-1944b45d-2750-4b30-8bee-fdf7e29396ea tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ea228e4f-f9b2-477a-a75f-542bc9d47ec4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 15:43:39 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-1944b45d-2750-4b30-8bee-fdf7e29396ea tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ea228e4f-f9b2-477a-a75f-542bc9d47ec4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 15:43:39 user nova-compute[75176]: INFO os_brick.initiator.connectors.iscsi [None req-1944b45d-2750-4b30-8bee-fdf7e29396ea tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 15:43:39 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea228e4f-f9b2-477a-a75f-542bc9d47ec4 -p 172.16.0.220:3260 {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:43:39 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea228e4f-f9b2-477a-a75f-542bc9d47ec4 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:43:39 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[b935c3c9-0109-4361-887c-f4f215a2ee30]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:43:39 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-1944b45d-2750-4b30-8bee-fdf7e29396ea tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 15:43:39 user nova-compute[75176]:  {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:43:39 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea228e4f-f9b2-477a-a75f-542bc9d47ec4 -p 172.16.0.220:3260 --interface default --op new {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:43:39 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea228e4f-f9b2-477a-a75f-542bc9d47ec4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:43:39 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[453c22bf-3553-4a18-be52-55c317f80be4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ea228e4f-f9b2-477a-a75f-542bc9d47ec4] added\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:43:39 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-1944b45d-2750-4b30-8bee-fdf7e29396ea tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ea228e4f-f9b2-477a-a75f-542bc9d47ec4] added
Nov 28 15:43:39 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:43:39 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea228e4f-f9b2-477a-a75f-542bc9d47ec4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:43:39 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea228e4f-f9b2-477a-a75f-542bc9d47ec4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:43:39 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed28fa6f-79b2-4576-9e98-02f62db8c6a8]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:43:39 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-1944b45d-2750-4b30-8bee-fdf7e29396ea tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:43:39 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea228e4f-f9b2-477a-a75f-542bc9d47ec4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:43:39 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea228e4f-f9b2-477a-a75f-542bc9d47ec4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:43:39 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9b62f32-ed09-42c4-a8e2-e1f14c42afa5]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:43:39 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-1944b45d-2750-4b30-8bee-fdf7e29396ea tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:43:39 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea228e4f-f9b2-477a-a75f-542bc9d47ec4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jPmwncDA {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:43:39 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea228e4f-f9b2-477a-a75f-542bc9d47ec4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jPmwncDA" returned: 0 in 0.023s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:43:39 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[76fcdbfd-70f4-4f5a-a2fe-b824976331a1]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:43:39 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-1944b45d-2750-4b30-8bee-fdf7e29396ea tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jPmwncDA'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:43:39 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea228e4f-f9b2-477a-a75f-542bc9d47ec4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:43:39 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea228e4f-f9b2-477a-a75f-542bc9d47ec4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:43:39 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[8475da52-bb7e-4106-809a-df9018885fc0]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:43:39 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-1944b45d-2750-4b30-8bee-fdf7e29396ea tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:43:39 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:43:39 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:43:39 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc6ac470-a544-47cb-82cc-dc262d6247f2]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bb22dca-8491-42ef-815f-7b0c0ca4be5a (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d (non-flash)\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:43:39 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-1944b45d-2750-4b30-8bee-fdf7e29396ea tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bb22dca-8491-42ef-815f-7b0c0ca4be5a (non-flash)
Nov 28 15:43:39 user nova-compute[75176]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d (non-flash)
Nov 28 15:43:39 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:43:39 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-1944b45d-2750-4b30-8bee-fdf7e29396ea tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bb22dca-8491-42ef-815f-7b0c0ca4be5a (non-flash)
Nov 28 15:43:39 user nova-compute[75176]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d (non-flash)
Nov 28 15:43:39 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 15:43:39 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea228e4f-f9b2-477a-a75f-542bc9d47ec4 -p 172.16.0.220:3260 --login {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:43:40 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea228e4f-f9b2-477a-a75f-542bc9d47ec4 -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:43:40 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc6f69ea-9575-40c2-b2fa-2864430849d5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ea228e4f-f9b2-477a-a75f-542bc9d47ec4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ea228e4f-f9b2-477a-a75f-542bc9d47ec4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:43:40 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-1944b45d-2750-4b30-8bee-fdf7e29396ea tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ea228e4f-f9b2-477a-a75f-542bc9d47ec4, portal: 172.16.0.220,3260]
Nov 28 15:43:40 user nova-compute[75176]: Login to [iface: default, target: iqn.2010-10.org.openstack:ea228e4f-f9b2-477a-a75f-542bc9d47ec4, portal: 172.16.0.220,3260] successful.
Nov 28 15:43:40 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:43:40 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea228e4f-f9b2-477a-a75f-542bc9d47ec4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:43:40 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea228e4f-f9b2-477a-a75f-542bc9d47ec4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.030s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:43:40 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[35e621ee-5272-4fe0-8fae-d5ce4c799602]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:43:40 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-1944b45d-2750-4b30-8bee-fdf7e29396ea tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:43:40 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:43:40 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:43:40 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[63b84bbc-7878-4041-a251-fce9c31d75e0]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bb22dca-8491-42ef-815f-7b0c0ca4be5a (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea228e4f-f9b2-477a-a75f-542bc9d47ec4 (non-flash)\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:43:40 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-1944b45d-2750-4b30-8bee-fdf7e29396ea tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bb22dca-8491-42ef-815f-7b0c0ca4be5a (non-flash)
Nov 28 15:43:40 user nova-compute[75176]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d (non-flash)
Nov 28 15:43:40 user nova-compute[75176]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea228e4f-f9b2-477a-a75f-542bc9d47ec4 (non-flash)
Nov 28 15:43:40 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:43:40 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-1944b45d-2750-4b30-8bee-fdf7e29396ea tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bb22dca-8491-42ef-815f-7b0c0ca4be5a (non-flash)
Nov 28 15:43:40 user nova-compute[75176]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d (non-flash)
Nov 28 15:43:40 user nova-compute[75176]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea228e4f-f9b2-477a-a75f-542bc9d47ec4 (non-flash)
Nov 28 15:43:40 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 15:43:40 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-1944b45d-2750-4b30-8bee-fdf7e29396ea tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ea228e4f-f9b2-477a-a75f-542bc9d47ec4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.343s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 15:43:40 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-1944b45d-2750-4b30-8bee-fdf7e29396ea tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Connected to 172.16.0.220:3260 {{(pid=75176) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 15:43:40 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-1944b45d-2750-4b30-8bee-fdf7e29396ea tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] HCTL ('33', '-', '-', 0) found on session 20 with lun 0 {{(pid=75176) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 15:43:40 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-1944b45d-2750-4b30-8bee-fdf7e29396ea tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75176) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 15:43:40 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:43:40 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:43:40 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d092e39-bd32-4e81-94b7-02956dbeab2e]: (4, ('- - 0', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:43:40 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-1944b45d-2750-4b30-8bee-fdf7e29396ea tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Searching for a device in session 20 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75176) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 15:43:40 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-1944b45d-2750-4b30-8bee-fdf7e29396ea tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:ea228e4f-f9b2-477a-a75f-542bc9d47ec4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jPmwncDA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75176) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 15:43:40 user nova-compute[75176]: DEBUG nova.compute.manager [req-7afca50e-7eb2-467d-9c36-8f71e257441d req-1c22e243-7ecd-4077-b5ff-d3024fe5677e service nova] [instance: 47306d53-9ad7-4cae-ba6d-1f65239ef30f] Received event network-vif-plugged-c3d44009-c128-4e98-8594-132ed6c85dbc {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:43:40 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-7afca50e-7eb2-467d-9c36-8f71e257441d req-1c22e243-7ecd-4077-b5ff-d3024fe5677e service nova] Acquiring lock "47306d53-9ad7-4cae-ba6d-1f65239ef30f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:43:40 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-7afca50e-7eb2-467d-9c36-8f71e257441d req-1c22e243-7ecd-4077-b5ff-d3024fe5677e service nova] Lock "47306d53-9ad7-4cae-ba6d-1f65239ef30f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:43:40 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-7afca50e-7eb2-467d-9c36-8f71e257441d req-1c22e243-7ecd-4077-b5ff-d3024fe5677e service nova] Lock "47306d53-9ad7-4cae-ba6d-1f65239ef30f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:43:40 user nova-compute[75176]: DEBUG nova.compute.manager [req-7afca50e-7eb2-467d-9c36-8f71e257441d req-1c22e243-7ecd-4077-b5ff-d3024fe5677e service nova] [instance: 47306d53-9ad7-4cae-ba6d-1f65239ef30f] No waiting events found dispatching network-vif-plugged-c3d44009-c128-4e98-8594-132ed6c85dbc {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:43:40 user nova-compute[75176]: WARNING nova.compute.manager [req-7afca50e-7eb2-467d-9c36-8f71e257441d req-1c22e243-7ecd-4077-b5ff-d3024fe5677e service nova] [instance: 47306d53-9ad7-4cae-ba6d-1f65239ef30f] Received unexpected event network-vif-plugged-c3d44009-c128-4e98-8594-132ed6c85dbc for instance with vm_state active and task_state reboot_started_hard.
Nov 28 15:43:41 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-1944b45d-2750-4b30-8bee-fdf7e29396ea tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.379s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 15:43:41 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-1944b45d-2750-4b30-8bee-fdf7e29396ea tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] <== connect_volume: return (1380ms) {'type': 'block', 'scsi_wwn': '26637303964643937', 'path': '/dev/sdb'} {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 15:43:41 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1944b45d-2750-4b30-8bee-fdf7e29396ea tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] [instance: 47306d53-9ad7-4cae-ba6d-1f65239ef30f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26637303964643937', 'path': '/dev/sdb'} {{(pid=75176) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 15:43:41 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-1944b45d-2750-4b30-8bee-fdf7e29396ea tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T15:41:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1171264206',display_name='tempest-TestMinimumBasicScenario-server-1171264206',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1171264206',id=12,image_ref='920bce21-95d9-45fe-a682-1abb452c4ccc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK1Yogtu9cHTqj/O0yW5ilhTCHe9GWdz8HcrAmcuCSEjGwLVrrqLCp+oEhqH6U3k5OzpunBE1hBj3JYBdp1D5PZTdSdrxBnMO+7y0Ja6VHcYxZP1f9WjFaePvpMxZeLKXg==',key_name='tempest-TestMinimumBasicScenario-327229554',keypairs=<?>,launch_index=0,launched_at=2023-11-28T15:41:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bc1dfeef484e4627a0061d9d36fd2b40',ramdisk_id='',reservation_id='r-mryylpp6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='920bce21-95d9-45fe-a682-1abb452c4ccc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-438096803',owner_user_name='tempest-TestMinimumBasicScenario-438096803-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T15:43:38Z,user_data=None,user_id='54766bbdce4346c0bd508451478b50aa',uuid=47306d53-9ad7-4cae-ba6d-1f65239ef30f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c3d44009-c128-4e98-8594-132ed6c85dbc", "address": "fa:16:3e:0b:f3:cf", "network": {"id": "b06b85af-96d9-41cb-9ad2-7fc0523761e7", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-850315220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc1dfeef484e4627a0061d9d36fd2b40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3d44009-c1", "ovs_interfaceid": "c3d44009-c128-4e98-8594-132ed6c85dbc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75176) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 15:43:41 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-1944b45d-2750-4b30-8bee-fdf7e29396ea tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Converting VIF {"id": "c3d44009-c128-4e98-8594-132ed6c85dbc", "address": "fa:16:3e:0b:f3:cf", "network": {"id": "b06b85af-96d9-41cb-9ad2-7fc0523761e7", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-850315220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc1dfeef484e4627a0061d9d36fd2b40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3d44009-c1", "ovs_interfaceid": "c3d44009-c128-4e98-8594-132ed6c85dbc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:43:41 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-1944b45d-2750-4b30-8bee-fdf7e29396ea tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0b:f3:cf,bridge_name='br-int',has_traffic_filtering=True,id=c3d44009-c128-4e98-8594-132ed6c85dbc,network=Network(b06b85af-96d9-41cb-9ad2-7fc0523761e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3d44009-c1') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:43:41 user nova-compute[75176]: DEBUG nova.objects.instance [None req-1944b45d-2750-4b30-8bee-fdf7e29396ea tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Lazy-loading 'pci_devices' on Instance uuid 47306d53-9ad7-4cae-ba6d-1f65239ef30f {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:43:41 user nova-compute[75176]: DEBUG nova.objects.base [None req-1944b45d-2750-4b30-8bee-fdf7e29396ea tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Object Instance<47306d53-9ad7-4cae-ba6d-1f65239ef30f> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=75176) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 15:43:41 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-1944b45d-2750-4b30-8bee-fdf7e29396ea tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] [instance: 47306d53-9ad7-4cae-ba6d-1f65239ef30f] End _get_guest_xml xml=<domain type="kvm">
Nov 28 15:43:41 user nova-compute[75176]:   <uuid>47306d53-9ad7-4cae-ba6d-1f65239ef30f</uuid>
Nov 28 15:43:41 user nova-compute[75176]:   <name>instance-0000000c</name>
Nov 28 15:43:41 user nova-compute[75176]:   <memory>524288</memory>
Nov 28 15:43:41 user nova-compute[75176]:   <vcpu>1</vcpu>
Nov 28 15:43:41 user nova-compute[75176]:   <metadata>
Nov 28 15:43:41 user nova-compute[75176]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 15:43:41 user nova-compute[75176]:       <nova:package version="0.0.0"/>
Nov 28 15:43:41 user nova-compute[75176]:       <nova:name>tempest-TestMinimumBasicScenario-server-1171264206</nova:name>
Nov 28 15:43:41 user nova-compute[75176]:       <nova:creationTime>2023-11-28 15:43:39</nova:creationTime>
Nov 28 15:43:41 user nova-compute[75176]:       <nova:flavor name="m1.tiny">
Nov 28 15:43:41 user nova-compute[75176]:         <nova:memory>512</nova:memory>
Nov 28 15:43:41 user nova-compute[75176]:         <nova:disk>1</nova:disk>
Nov 28 15:43:41 user nova-compute[75176]:         <nova:swap>0</nova:swap>
Nov 28 15:43:41 user nova-compute[75176]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 15:43:41 user nova-compute[75176]:         <nova:vcpus>1</nova:vcpus>
Nov 28 15:43:41 user nova-compute[75176]:       </nova:flavor>
Nov 28 15:43:41 user nova-compute[75176]:       <nova:owner>
Nov 28 15:43:41 user nova-compute[75176]:         <nova:user uuid="54766bbdce4346c0bd508451478b50aa">tempest-TestMinimumBasicScenario-438096803-project-member</nova:user>
Nov 28 15:43:41 user nova-compute[75176]:         <nova:project uuid="bc1dfeef484e4627a0061d9d36fd2b40">tempest-TestMinimumBasicScenario-438096803</nova:project>
Nov 28 15:43:41 user nova-compute[75176]:       </nova:owner>
Nov 28 15:43:41 user nova-compute[75176]:       <nova:root type="image" uuid="920bce21-95d9-45fe-a682-1abb452c4ccc"/>
Nov 28 15:43:41 user nova-compute[75176]:       <nova:ports>
Nov 28 15:43:41 user nova-compute[75176]:         <nova:port uuid="c3d44009-c128-4e98-8594-132ed6c85dbc">
Nov 28 15:43:41 user nova-compute[75176]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 28 15:43:41 user nova-compute[75176]:         </nova:port>
Nov 28 15:43:41 user nova-compute[75176]:       </nova:ports>
Nov 28 15:43:41 user nova-compute[75176]:     </nova:instance>
Nov 28 15:43:41 user nova-compute[75176]:   </metadata>
Nov 28 15:43:41 user nova-compute[75176]:   <sysinfo type="smbios">
Nov 28 15:43:41 user nova-compute[75176]:     <system>
Nov 28 15:43:41 user nova-compute[75176]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 15:43:41 user nova-compute[75176]:       <entry name="product">OpenStack Nova</entry>
Nov 28 15:43:41 user nova-compute[75176]:       <entry name="version">0.0.0</entry>
Nov 28 15:43:41 user nova-compute[75176]:       <entry name="serial">47306d53-9ad7-4cae-ba6d-1f65239ef30f</entry>
Nov 28 15:43:41 user nova-compute[75176]:       <entry name="uuid">47306d53-9ad7-4cae-ba6d-1f65239ef30f</entry>
Nov 28 15:43:41 user nova-compute[75176]:       <entry name="family">Virtual Machine</entry>
Nov 28 15:43:41 user nova-compute[75176]:     </system>
Nov 28 15:43:41 user nova-compute[75176]:   </sysinfo>
Nov 28 15:43:41 user nova-compute[75176]:   <os>
Nov 28 15:43:41 user nova-compute[75176]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 15:43:41 user nova-compute[75176]:     <boot dev="hd"/>
Nov 28 15:43:41 user nova-compute[75176]:     <smbios mode="sysinfo"/>
Nov 28 15:43:41 user nova-compute[75176]:   </os>
Nov 28 15:43:41 user nova-compute[75176]:   <features>
Nov 28 15:43:41 user nova-compute[75176]:     <acpi/>
Nov 28 15:43:41 user nova-compute[75176]:     <apic/>
Nov 28 15:43:41 user nova-compute[75176]:     <vmcoreinfo/>
Nov 28 15:43:41 user nova-compute[75176]:   </features>
Nov 28 15:43:41 user nova-compute[75176]:   <clock offset="utc">
Nov 28 15:43:41 user nova-compute[75176]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 15:43:41 user nova-compute[75176]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 15:43:41 user nova-compute[75176]:     <timer name="hpet" present="no"/>
Nov 28 15:43:41 user nova-compute[75176]:   </clock>
Nov 28 15:43:41 user nova-compute[75176]:   <cpu mode="custom" match="exact">
Nov 28 15:43:41 user nova-compute[75176]:     <model>Nehalem</model>
Nov 28 15:43:41 user nova-compute[75176]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 15:43:41 user nova-compute[75176]:   </cpu>
Nov 28 15:43:41 user nova-compute[75176]:   <devices>
Nov 28 15:43:41 user nova-compute[75176]:     <disk type="file" device="disk">
Nov 28 15:43:41 user nova-compute[75176]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 15:43:41 user nova-compute[75176]:       <source file="/opt/stack/data/nova/instances/47306d53-9ad7-4cae-ba6d-1f65239ef30f/disk"/>
Nov 28 15:43:41 user nova-compute[75176]:       <target dev="vda" bus="virtio"/>
Nov 28 15:43:41 user nova-compute[75176]:     </disk>
Nov 28 15:43:41 user nova-compute[75176]:     <disk type="block" device="disk">
Nov 28 15:43:41 user nova-compute[75176]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 15:43:41 user nova-compute[75176]:       <source dev="/dev/sdb"/>
Nov 28 15:43:41 user nova-compute[75176]:       <target dev="vdb" bus="virtio"/>
Nov 28 15:43:41 user nova-compute[75176]:       <serial>ea228e4f-f9b2-477a-a75f-542bc9d47ec4</serial>
Nov 28 15:43:41 user nova-compute[75176]:     </disk>
Nov 28 15:43:41 user nova-compute[75176]:     <interface type="ethernet">
Nov 28 15:43:41 user nova-compute[75176]:       <mac address="fa:16:3e:0b:f3:cf"/>
Nov 28 15:43:41 user nova-compute[75176]:       <model type="virtio"/>
Nov 28 15:43:41 user nova-compute[75176]:       <mtu size="1442"/>
Nov 28 15:43:41 user nova-compute[75176]:       <target dev="tapc3d44009-c1"/>
Nov 28 15:43:41 user nova-compute[75176]:     </interface>
Nov 28 15:43:41 user nova-compute[75176]:     <serial type="pty">
Nov 28 15:43:41 user nova-compute[75176]:       <log file="/opt/stack/data/nova/instances/47306d53-9ad7-4cae-ba6d-1f65239ef30f/console.log" append="off"/>
Nov 28 15:43:41 user nova-compute[75176]:     </serial>
Nov 28 15:43:41 user nova-compute[75176]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 15:43:41 user nova-compute[75176]:     <video>
Nov 28 15:43:41 user nova-compute[75176]:       <model type="virtio"/>
Nov 28 15:43:41 user nova-compute[75176]:     </video>
Nov 28 15:43:41 user nova-compute[75176]:     <rng model="virtio">
Nov 28 15:43:41 user nova-compute[75176]:       <backend model="random">/dev/urandom</backend>
Nov 28 15:43:41 user nova-compute[75176]:     </rng>
Nov 28 15:43:41 user nova-compute[75176]:     <controller type="usb" index="0" model="none"/>
Nov 28 15:43:41 user nova-compute[75176]:     <memballoon model="virtio">
Nov 28 15:43:41 user nova-compute[75176]:       <stats period="10"/>
Nov 28 15:43:41 user nova-compute[75176]:     </memballoon>
Nov 28 15:43:41 user nova-compute[75176]:   </devices>
Nov 28 15:43:41 user nova-compute[75176]: </domain>
Nov 28 15:43:41 user nova-compute[75176]:  {{(pid=75176) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 15:43:41 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-1944b45d-2750-4b30-8bee-fdf7e29396ea tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47306d53-9ad7-4cae-ba6d-1f65239ef30f/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:43:41 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-1944b45d-2750-4b30-8bee-fdf7e29396ea tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47306d53-9ad7-4cae-ba6d-1f65239ef30f/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:43:41 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-1944b45d-2750-4b30-8bee-fdf7e29396ea tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47306d53-9ad7-4cae-ba6d-1f65239ef30f/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:43:41 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-1944b45d-2750-4b30-8bee-fdf7e29396ea tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47306d53-9ad7-4cae-ba6d-1f65239ef30f/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:43:41 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-1944b45d-2750-4b30-8bee-fdf7e29396ea tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75176) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 15:43:41 user nova-compute[75176]: DEBUG nova.objects.instance [None req-1944b45d-2750-4b30-8bee-fdf7e29396ea tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Lazy-loading 'trusted_certs' on Instance uuid 47306d53-9ad7-4cae-ba6d-1f65239ef30f {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:43:41 user nova-compute[75176]: DEBUG nova.objects.base [None req-1944b45d-2750-4b30-8bee-fdf7e29396ea tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Object Instance<47306d53-9ad7-4cae-ba6d-1f65239ef30f> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=75176) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 15:43:41 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-1944b45d-2750-4b30-8bee-fdf7e29396ea tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c801c4a08f51b6bad2df9b91a5eb50e82891ca5 --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:43:41 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-1944b45d-2750-4b30-8bee-fdf7e29396ea tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c801c4a08f51b6bad2df9b91a5eb50e82891ca5 --force-share --output=json" returned: 0 in 0.234s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:43:41 user nova-compute[75176]: DEBUG nova.virt.disk.api [None req-1944b45d-2750-4b30-8bee-fdf7e29396ea tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Checking if we can resize image /opt/stack/data/nova/instances/47306d53-9ad7-4cae-ba6d-1f65239ef30f/disk. size=1073741824 {{(pid=75176) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 15:43:41 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-1944b45d-2750-4b30-8bee-fdf7e29396ea tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47306d53-9ad7-4cae-ba6d-1f65239ef30f/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:43:42 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-1944b45d-2750-4b30-8bee-fdf7e29396ea tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47306d53-9ad7-4cae-ba6d-1f65239ef30f/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:43:42 user nova-compute[75176]: DEBUG nova.virt.disk.api [None req-1944b45d-2750-4b30-8bee-fdf7e29396ea tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Cannot resize image /opt/stack/data/nova/instances/47306d53-9ad7-4cae-ba6d-1f65239ef30f/disk to a smaller size. {{(pid=75176) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 15:43:42 user nova-compute[75176]: DEBUG nova.objects.instance [None req-1944b45d-2750-4b30-8bee-fdf7e29396ea tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Lazy-loading 'migration_context' on Instance uuid 47306d53-9ad7-4cae-ba6d-1f65239ef30f {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:43:42 user nova-compute[75176]: DEBUG nova.objects.base [None req-1944b45d-2750-4b30-8bee-fdf7e29396ea tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Object Instance<47306d53-9ad7-4cae-ba6d-1f65239ef30f> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75176) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 15:43:42 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-1944b45d-2750-4b30-8bee-fdf7e29396ea tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T15:41:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1171264206',display_name='tempest-TestMinimumBasicScenario-server-1171264206',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1171264206',id=12,image_ref='920bce21-95d9-45fe-a682-1abb452c4ccc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK1Yogtu9cHTqj/O0yW5ilhTCHe9GWdz8HcrAmcuCSEjGwLVrrqLCp+oEhqH6U3k5OzpunBE1hBj3JYBdp1D5PZTdSdrxBnMO+7y0Ja6VHcYxZP1f9WjFaePvpMxZeLKXg==',key_name='tempest-TestMinimumBasicScenario-327229554',keypairs=<?>,launch_index=0,launched_at=2023-11-28T15:41:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='bc1dfeef484e4627a0061d9d36fd2b40',ramdisk_id='',reservation_id='r-mryylpp6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='920bce21-95d9-45fe-a682-1abb452c4ccc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-438096803',owner_user_name='tempest-TestMinimumBasicScenario-438096803-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T15:43:38Z,user_data=None,user_id='54766bbdce4346c0bd508451478b50aa',uuid=47306d53-9ad7-4cae-ba6d-1f65239ef30f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c3d44009-c128-4e98-8594-132ed6c85dbc", "address": "fa:16:3e:0b:f3:cf", "network": {"id": "b06b85af-96d9-41cb-9ad2-7fc0523761e7", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-850315220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc1dfeef484e4627a0061d9d36fd2b40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3d44009-c1", "ovs_interfaceid": "c3d44009-c128-4e98-8594-132ed6c85dbc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 15:43:42 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-1944b45d-2750-4b30-8bee-fdf7e29396ea tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Converting VIF {"id": "c3d44009-c128-4e98-8594-132ed6c85dbc", "address": "fa:16:3e:0b:f3:cf", "network": {"id": "b06b85af-96d9-41cb-9ad2-7fc0523761e7", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-850315220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc1dfeef484e4627a0061d9d36fd2b40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3d44009-c1", "ovs_interfaceid": "c3d44009-c128-4e98-8594-132ed6c85dbc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:43:42 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-1944b45d-2750-4b30-8bee-fdf7e29396ea tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0b:f3:cf,bridge_name='br-int',has_traffic_filtering=True,id=c3d44009-c128-4e98-8594-132ed6c85dbc,network=Network(b06b85af-96d9-41cb-9ad2-7fc0523761e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3d44009-c1') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:43:42 user nova-compute[75176]: DEBUG os_vif [None req-1944b45d-2750-4b30-8bee-fdf7e29396ea tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0b:f3:cf,bridge_name='br-int',has_traffic_filtering=True,id=c3d44009-c128-4e98-8594-132ed6c85dbc,network=Network(b06b85af-96d9-41cb-9ad2-7fc0523761e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3d44009-c1') {{(pid=75176) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 15:43:42 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:43:42 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:43:42 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 15:43:42 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:43:42 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '66b7e38d-4666-5612-abc5-a7a11048b458', '_type': 'linux-noop'}}, row=False) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:43:42 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:43:42 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:43:42 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:43:42 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc3d44009-c1, may_exist=True, interface_attrs={}) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:43:42 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc3d44009-c1, col_values=(('qos', UUID('efcd93df-089e-4b3c-835e-5a5a25c4e4b2')),), if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:43:42 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc3d44009-c1, col_values=(('external_ids', {'iface-id': 'c3d44009-c128-4e98-8594-132ed6c85dbc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0b:f3:cf', 'vm-uuid': '47306d53-9ad7-4cae-ba6d-1f65239ef30f'}),), if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:43:42 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:43:42 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:43:42 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:43:42 user nova-compute[75176]: INFO os_vif [None req-1944b45d-2750-4b30-8bee-fdf7e29396ea tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0b:f3:cf,bridge_name='br-int',has_traffic_filtering=True,id=c3d44009-c128-4e98-8594-132ed6c85dbc,network=Network(b06b85af-96d9-41cb-9ad2-7fc0523761e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3d44009-c1')
Nov 28 15:43:43 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:43:43 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:43:43 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:43:43 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:43:44 user nova-compute[75176]: DEBUG nova.compute.manager [req-2aa190ac-21d0-413d-bcc0-cb9b91cde049 req-35c9e40d-1f8a-4673-8abd-3b8f1896b8ea service nova] [instance: 47306d53-9ad7-4cae-ba6d-1f65239ef30f] Received event network-vif-plugged-c3d44009-c128-4e98-8594-132ed6c85dbc {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:43:44 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-2aa190ac-21d0-413d-bcc0-cb9b91cde049 req-35c9e40d-1f8a-4673-8abd-3b8f1896b8ea service nova] Acquiring lock "47306d53-9ad7-4cae-ba6d-1f65239ef30f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:43:44 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-2aa190ac-21d0-413d-bcc0-cb9b91cde049 req-35c9e40d-1f8a-4673-8abd-3b8f1896b8ea service nova] Lock "47306d53-9ad7-4cae-ba6d-1f65239ef30f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:43:44 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-2aa190ac-21d0-413d-bcc0-cb9b91cde049 req-35c9e40d-1f8a-4673-8abd-3b8f1896b8ea service nova] Lock "47306d53-9ad7-4cae-ba6d-1f65239ef30f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:43:44 user nova-compute[75176]: DEBUG nova.compute.manager [req-2aa190ac-21d0-413d-bcc0-cb9b91cde049 req-35c9e40d-1f8a-4673-8abd-3b8f1896b8ea service nova] [instance: 47306d53-9ad7-4cae-ba6d-1f65239ef30f] No waiting events found dispatching network-vif-plugged-c3d44009-c128-4e98-8594-132ed6c85dbc {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:43:44 user nova-compute[75176]: WARNING nova.compute.manager [req-2aa190ac-21d0-413d-bcc0-cb9b91cde049 req-35c9e40d-1f8a-4673-8abd-3b8f1896b8ea service nova] [instance: 47306d53-9ad7-4cae-ba6d-1f65239ef30f] Received unexpected event network-vif-plugged-c3d44009-c128-4e98-8594-132ed6c85dbc for instance with vm_state active and task_state reboot_started_hard.
Nov 28 15:43:44 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:43:44 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:43:44 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:43:44 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:43:46 user nova-compute[75176]: DEBUG nova.compute.manager [None req-1944b45d-2750-4b30-8bee-fdf7e29396ea tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] [instance: 47306d53-9ad7-4cae-ba6d-1f65239ef30f] Instance event wait completed in 0 seconds for  {{(pid=75176) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 15:43:46 user nova-compute[75176]: INFO nova.virt.libvirt.driver [-] [instance: 47306d53-9ad7-4cae-ba6d-1f65239ef30f] Instance rebooted successfully.
Nov 28 15:43:46 user nova-compute[75176]: DEBUG nova.compute.manager [None req-1944b45d-2750-4b30-8bee-fdf7e29396ea tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] [instance: 47306d53-9ad7-4cae-ba6d-1f65239ef30f] Checking state {{(pid=75176) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 15:43:46 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-1944b45d-2750-4b30-8bee-fdf7e29396ea tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Lock "47306d53-9ad7-4cae-ba6d-1f65239ef30f" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 8.744s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:43:46 user nova-compute[75176]: DEBUG nova.compute.manager [req-3585bb79-2566-4386-a542-9b8ec5a0d600 req-8b8ee526-fad8-43ca-a7a1-49bfdde3ca1f service nova] [instance: 47306d53-9ad7-4cae-ba6d-1f65239ef30f] Received event network-vif-plugged-c3d44009-c128-4e98-8594-132ed6c85dbc {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:43:46 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-3585bb79-2566-4386-a542-9b8ec5a0d600 req-8b8ee526-fad8-43ca-a7a1-49bfdde3ca1f service nova] Acquiring lock "47306d53-9ad7-4cae-ba6d-1f65239ef30f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:43:46 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-3585bb79-2566-4386-a542-9b8ec5a0d600 req-8b8ee526-fad8-43ca-a7a1-49bfdde3ca1f service nova] Lock "47306d53-9ad7-4cae-ba6d-1f65239ef30f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:43:46 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-3585bb79-2566-4386-a542-9b8ec5a0d600 req-8b8ee526-fad8-43ca-a7a1-49bfdde3ca1f service nova] Lock "47306d53-9ad7-4cae-ba6d-1f65239ef30f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:43:46 user nova-compute[75176]: DEBUG nova.compute.manager [req-3585bb79-2566-4386-a542-9b8ec5a0d600 req-8b8ee526-fad8-43ca-a7a1-49bfdde3ca1f service nova] [instance: 47306d53-9ad7-4cae-ba6d-1f65239ef30f] No waiting events found dispatching network-vif-plugged-c3d44009-c128-4e98-8594-132ed6c85dbc {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:43:46 user nova-compute[75176]: WARNING nova.compute.manager [req-3585bb79-2566-4386-a542-9b8ec5a0d600 req-8b8ee526-fad8-43ca-a7a1-49bfdde3ca1f service nova] [instance: 47306d53-9ad7-4cae-ba6d-1f65239ef30f] Received unexpected event network-vif-plugged-c3d44009-c128-4e98-8594-132ed6c85dbc for instance with vm_state active and task_state None.
Nov 28 15:43:46 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:43:46 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:43:47 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:43:47 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:43:47 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:43:48 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:43:49 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:43:49 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:43:49 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:43:49 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:43:49 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:43:49 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:43:49 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Auditing locally available compute resources for user (node: user) {{(pid=75176) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 15:43:49 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47306d53-9ad7-4cae-ba6d-1f65239ef30f/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:43:50 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:43:50 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47306d53-9ad7-4cae-ba6d-1f65239ef30f/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:43:50 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47306d53-9ad7-4cae-ba6d-1f65239ef30f/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:43:50 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47306d53-9ad7-4cae-ba6d-1f65239ef30f/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:43:50 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75176) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 15:43:50 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e8507b7-fccf-4196-b589-bf2b74f165ec/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:43:50 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e8507b7-fccf-4196-b589-bf2b74f165ec/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:43:50 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e8507b7-fccf-4196-b589-bf2b74f165ec/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:43:50 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e8507b7-fccf-4196-b589-bf2b74f165ec/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:43:50 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e02d1e69-5e74-43c3-8546-6044d31145f2/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:43:51 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e02d1e69-5e74-43c3-8546-6044d31145f2/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:43:51 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e02d1e69-5e74-43c3-8546-6044d31145f2/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:43:51 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:43:51 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e02d1e69-5e74-43c3-8546-6044d31145f2/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:43:51 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dcbbf59-600f-4309-abd3-e8e4c7731c0b/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:43:51 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dcbbf59-600f-4309-abd3-e8e4c7731c0b/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:43:51 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dcbbf59-600f-4309-abd3-e8e4c7731c0b/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:43:51 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dcbbf59-600f-4309-abd3-e8e4c7731c0b/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:43:51 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b18c889-7694-4edf-8cf2-b9032e60289e/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:43:52 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b18c889-7694-4edf-8cf2-b9032e60289e/disk --force-share --output=json" returned: 0 in 0.260s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:43:52 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b18c889-7694-4edf-8cf2-b9032e60289e/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:43:52 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:43:52 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:43:52 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b18c889-7694-4edf-8cf2-b9032e60289e/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:43:52 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa223c49-d254-4727-8a01-873026847b37/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:43:52 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa223c49-d254-4727-8a01-873026847b37/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:43:52 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa223c49-d254-4727-8a01-873026847b37/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:43:52 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa223c49-d254-4727-8a01-873026847b37/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:43:52 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75176) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 15:43:52 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ab0619f-72e5-4975-ade8-53d7c0784d89/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:43:52 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ab0619f-72e5-4975-ade8-53d7c0784d89/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:43:52 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ab0619f-72e5-4975-ade8-53d7c0784d89/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:43:53 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ab0619f-72e5-4975-ade8-53d7c0784d89/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:43:53 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75176) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 15:43:53 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ab0619f-72e5-4975-ade8-53d7c0784d89/disk.rescue --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:43:53 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ab0619f-72e5-4975-ade8-53d7c0784d89/disk.rescue --force-share --output=json" returned: 0 in 0.255s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:43:53 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ab0619f-72e5-4975-ade8-53d7c0784d89/disk.rescue --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:43:53 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:43:53 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ab0619f-72e5-4975-ade8-53d7c0784d89/disk.rescue --force-share --output=json" returned: 0 in 0.227s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:43:53 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/402e779e-f507-49f1-a0d8-31ab0d23fbcd/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:43:53 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/402e779e-f507-49f1-a0d8-31ab0d23fbcd/disk --force-share --output=json" returned: 0 in 0.262s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:43:53 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/402e779e-f507-49f1-a0d8-31ab0d23fbcd/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:43:54 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/402e779e-f507-49f1-a0d8-31ab0d23fbcd/disk --force-share --output=json" returned: 0 in 0.255s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:43:54 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:43:54 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 15:43:54 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 15:43:54 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Hypervisor/Node resource view: name=user free_ram=7625MB free_disk=25.275318145751953GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75176) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 15:43:54 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:43:54 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:43:54 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Applying migration context for instance aa223c49-d254-4727-8a01-873026847b37 as it has an incoming, in-progress migration e7efec7a-a309-4975-ab53-abdcc8046db8. Migration status is finished {{(pid=75176) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 28 15:43:54 user nova-compute[75176]: INFO nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] [instance: aa223c49-d254-4727-8a01-873026847b37] Updating resource usage from migration e7efec7a-a309-4975-ab53-abdcc8046db8
Nov 28 15:43:54 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance 6ab0619f-72e5-4975-ade8-53d7c0784d89 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:43:54 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance 2e8507b7-fccf-4196-b589-bf2b74f165ec actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:43:54 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance 5b18c889-7694-4edf-8cf2-b9032e60289e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:43:54 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance 47306d53-9ad7-4cae-ba6d-1f65239ef30f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:43:54 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance 402e779e-f507-49f1-a0d8-31ab0d23fbcd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:43:54 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance 9dcbbf59-600f-4309-abd3-e8e4c7731c0b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:43:54 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance e02d1e69-5e74-43c3-8546-6044d31145f2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:43:54 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Migration e7efec7a-a309-4975-ab53-abdcc8046db8 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 28 15:43:54 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance aa223c49-d254-4727-8a01-873026847b37 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:43:54 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75176) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 15:43:54 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=28GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75176) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 15:43:55 user nova-compute[75176]: DEBUG nova.compute.provider_tree [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Inventory has not changed in ProviderTree for provider: b37848d8-f401-4155-a029-b0ffa09ff85b {{(pid=75176) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 15:43:55 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Inventory has not changed for provider b37848d8-f401-4155-a029-b0ffa09ff85b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75176) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 15:43:55 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Compute_service record updated for user:user {{(pid=75176) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 15:43:55 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.570s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:43:55 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:43:56 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:43:56 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:43:56 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Starting heal instance info cache {{(pid=75176) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 15:43:56 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquiring lock "refresh_cache-5b18c889-7694-4edf-8cf2-b9032e60289e" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:43:56 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquired lock "refresh_cache-5b18c889-7694-4edf-8cf2-b9032e60289e" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:43:56 user nova-compute[75176]: DEBUG nova.network.neutron [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] [instance: 5b18c889-7694-4edf-8cf2-b9032e60289e] Forcefully refreshing network info cache for instance {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 15:43:57 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:43:57 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:43:58 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:43:58 user nova-compute[75176]: DEBUG nova.network.neutron [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] [instance: 5b18c889-7694-4edf-8cf2-b9032e60289e] Updating instance_info_cache with network_info: [{"id": "59bc046b-fdaa-432c-97b8-67a208dd399b", "address": "fa:16:3e:e5:e8:01", "network": {"id": "1c357ee9-ff80-4a4b-9fd5-f2f348b36acc", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1869945166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0518c3ca77e4ecebb6ea8fbf6e60219", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59bc046b-fd", "ovs_interfaceid": "59bc046b-fdaa-432c-97b8-67a208dd399b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:43:58 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Releasing lock "refresh_cache-5b18c889-7694-4edf-8cf2-b9032e60289e" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:43:58 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] [instance: 5b18c889-7694-4edf-8cf2-b9032e60289e] Updated the network info_cache for instance {{(pid=75176) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 15:43:58 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:43:58 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:43:58 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75176) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 15:43:58 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:43:59 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:44:00 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-36ce590d-c175-4fef-9135-1ffe19b10859 tempest-VolumesActionsTest-508911516 tempest-VolumesActionsTest-508911516-project-member] Acquiring lock "6739b4fc-063c-454c-8b37-b81c07b7ca1e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:44:00 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-36ce590d-c175-4fef-9135-1ffe19b10859 tempest-VolumesActionsTest-508911516 tempest-VolumesActionsTest-508911516-project-member] Lock "6739b4fc-063c-454c-8b37-b81c07b7ca1e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:44:00 user nova-compute[75176]: DEBUG nova.compute.manager [None req-36ce590d-c175-4fef-9135-1ffe19b10859 tempest-VolumesActionsTest-508911516 tempest-VolumesActionsTest-508911516-project-member] [instance: 6739b4fc-063c-454c-8b37-b81c07b7ca1e] Starting instance... {{(pid=75176) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 15:44:00 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-36ce590d-c175-4fef-9135-1ffe19b10859 tempest-VolumesActionsTest-508911516 tempest-VolumesActionsTest-508911516-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:44:00 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-36ce590d-c175-4fef-9135-1ffe19b10859 tempest-VolumesActionsTest-508911516 tempest-VolumesActionsTest-508911516-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:44:00 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-36ce590d-c175-4fef-9135-1ffe19b10859 tempest-VolumesActionsTest-508911516 tempest-VolumesActionsTest-508911516-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75176) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 15:44:00 user nova-compute[75176]: INFO nova.compute.claims [None req-36ce590d-c175-4fef-9135-1ffe19b10859 tempest-VolumesActionsTest-508911516 tempest-VolumesActionsTest-508911516-project-member] [instance: 6739b4fc-063c-454c-8b37-b81c07b7ca1e] Claim successful on node user
Nov 28 15:44:01 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:44:01 user nova-compute[75176]: DEBUG nova.compute.provider_tree [None req-36ce590d-c175-4fef-9135-1ffe19b10859 tempest-VolumesActionsTest-508911516 tempest-VolumesActionsTest-508911516-project-member] Inventory has not changed in ProviderTree for provider: b37848d8-f401-4155-a029-b0ffa09ff85b {{(pid=75176) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 15:44:01 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-36ce590d-c175-4fef-9135-1ffe19b10859 tempest-VolumesActionsTest-508911516 tempest-VolumesActionsTest-508911516-project-member] Inventory has not changed for provider b37848d8-f401-4155-a029-b0ffa09ff85b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75176) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 15:44:01 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-36ce590d-c175-4fef-9135-1ffe19b10859 tempest-VolumesActionsTest-508911516 tempest-VolumesActionsTest-508911516-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.546s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:44:01 user nova-compute[75176]: DEBUG nova.compute.manager [None req-36ce590d-c175-4fef-9135-1ffe19b10859 tempest-VolumesActionsTest-508911516 tempest-VolumesActionsTest-508911516-project-member] [instance: 6739b4fc-063c-454c-8b37-b81c07b7ca1e] Start building networks asynchronously for instance. {{(pid=75176) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 15:44:01 user nova-compute[75176]: DEBUG nova.compute.manager [None req-36ce590d-c175-4fef-9135-1ffe19b10859 tempest-VolumesActionsTest-508911516 tempest-VolumesActionsTest-508911516-project-member] [instance: 6739b4fc-063c-454c-8b37-b81c07b7ca1e] Allocating IP information in the background. {{(pid=75176) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 15:44:01 user nova-compute[75176]: DEBUG nova.network.neutron [None req-36ce590d-c175-4fef-9135-1ffe19b10859 tempest-VolumesActionsTest-508911516 tempest-VolumesActionsTest-508911516-project-member] [instance: 6739b4fc-063c-454c-8b37-b81c07b7ca1e] allocate_for_instance() {{(pid=75176) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 15:44:01 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-36ce590d-c175-4fef-9135-1ffe19b10859 tempest-VolumesActionsTest-508911516 tempest-VolumesActionsTest-508911516-project-member] [instance: 6739b4fc-063c-454c-8b37-b81c07b7ca1e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 15:44:01 user nova-compute[75176]: DEBUG nova.compute.manager [None req-36ce590d-c175-4fef-9135-1ffe19b10859 tempest-VolumesActionsTest-508911516 tempest-VolumesActionsTest-508911516-project-member] [instance: 6739b4fc-063c-454c-8b37-b81c07b7ca1e] Start building block device mappings for instance. {{(pid=75176) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 15:44:01 user nova-compute[75176]: DEBUG nova.compute.manager [None req-36ce590d-c175-4fef-9135-1ffe19b10859 tempest-VolumesActionsTest-508911516 tempest-VolumesActionsTest-508911516-project-member] [instance: 6739b4fc-063c-454c-8b37-b81c07b7ca1e] Start spawning the instance on the hypervisor. {{(pid=75176) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 15:44:01 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-36ce590d-c175-4fef-9135-1ffe19b10859 tempest-VolumesActionsTest-508911516 tempest-VolumesActionsTest-508911516-project-member] [instance: 6739b4fc-063c-454c-8b37-b81c07b7ca1e] Creating instance directory {{(pid=75176) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 15:44:01 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-36ce590d-c175-4fef-9135-1ffe19b10859 tempest-VolumesActionsTest-508911516 tempest-VolumesActionsTest-508911516-project-member] [instance: 6739b4fc-063c-454c-8b37-b81c07b7ca1e] Creating image(s)
Nov 28 15:44:01 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-36ce590d-c175-4fef-9135-1ffe19b10859 tempest-VolumesActionsTest-508911516 tempest-VolumesActionsTest-508911516-project-member] Acquiring lock "/opt/stack/data/nova/instances/6739b4fc-063c-454c-8b37-b81c07b7ca1e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:44:01 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-36ce590d-c175-4fef-9135-1ffe19b10859 tempest-VolumesActionsTest-508911516 tempest-VolumesActionsTest-508911516-project-member] Lock "/opt/stack/data/nova/instances/6739b4fc-063c-454c-8b37-b81c07b7ca1e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:44:01 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-36ce590d-c175-4fef-9135-1ffe19b10859 tempest-VolumesActionsTest-508911516 tempest-VolumesActionsTest-508911516-project-member] Lock "/opt/stack/data/nova/instances/6739b4fc-063c-454c-8b37-b81c07b7ca1e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.040s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:44:01 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-36ce590d-c175-4fef-9135-1ffe19b10859 tempest-VolumesActionsTest-508911516 tempest-VolumesActionsTest-508911516-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:44:01 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-36ce590d-c175-4fef-9135-1ffe19b10859 tempest-VolumesActionsTest-508911516 tempest-VolumesActionsTest-508911516-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json" returned: 0 in 0.224s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:44:01 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-36ce590d-c175-4fef-9135-1ffe19b10859 tempest-VolumesActionsTest-508911516 tempest-VolumesActionsTest-508911516-project-member] Acquiring lock "5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:44:01 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-36ce590d-c175-4fef-9135-1ffe19b10859 tempest-VolumesActionsTest-508911516 tempest-VolumesActionsTest-508911516-project-member] Lock "5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:44:01 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-36ce590d-c175-4fef-9135-1ffe19b10859 tempest-VolumesActionsTest-508911516 tempest-VolumesActionsTest-508911516-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:44:02 user nova-compute[75176]: DEBUG nova.policy [None req-36ce590d-c175-4fef-9135-1ffe19b10859 tempest-VolumesActionsTest-508911516 tempest-VolumesActionsTest-508911516-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7e9cd48cc7744ab78a1b4452827e59d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47a8c7ab5c34e8bbf187b8e1f0bf9ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75176) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 15:44:02 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:44:02 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-36ce590d-c175-4fef-9135-1ffe19b10859 tempest-VolumesActionsTest-508911516 tempest-VolumesActionsTest-508911516-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json" returned: 0 in 0.233s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:44:02 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-36ce590d-c175-4fef-9135-1ffe19b10859 tempest-VolumesActionsTest-508911516 tempest-VolumesActionsTest-508911516-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2,backing_fmt=raw /opt/stack/data/nova/instances/6739b4fc-063c-454c-8b37-b81c07b7ca1e/disk 1073741824 {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:44:02 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-36ce590d-c175-4fef-9135-1ffe19b10859 tempest-VolumesActionsTest-508911516 tempest-VolumesActionsTest-508911516-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2,backing_fmt=raw /opt/stack/data/nova/instances/6739b4fc-063c-454c-8b37-b81c07b7ca1e/disk 1073741824" returned: 0 in 0.063s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:44:02 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-36ce590d-c175-4fef-9135-1ffe19b10859 tempest-VolumesActionsTest-508911516 tempest-VolumesActionsTest-508911516-project-member] Lock "5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.304s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:44:02 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-36ce590d-c175-4fef-9135-1ffe19b10859 tempest-VolumesActionsTest-508911516 tempest-VolumesActionsTest-508911516-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:44:02 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-36ce590d-c175-4fef-9135-1ffe19b10859 tempest-VolumesActionsTest-508911516 tempest-VolumesActionsTest-508911516-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json" returned: 0 in 0.247s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:44:02 user nova-compute[75176]: DEBUG nova.virt.disk.api [None req-36ce590d-c175-4fef-9135-1ffe19b10859 tempest-VolumesActionsTest-508911516 tempest-VolumesActionsTest-508911516-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6739b4fc-063c-454c-8b37-b81c07b7ca1e/disk. size=1073741824 {{(pid=75176) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 15:44:02 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-36ce590d-c175-4fef-9135-1ffe19b10859 tempest-VolumesActionsTest-508911516 tempest-VolumesActionsTest-508911516-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6739b4fc-063c-454c-8b37-b81c07b7ca1e/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:44:02 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-36ce590d-c175-4fef-9135-1ffe19b10859 tempest-VolumesActionsTest-508911516 tempest-VolumesActionsTest-508911516-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6739b4fc-063c-454c-8b37-b81c07b7ca1e/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:44:02 user nova-compute[75176]: DEBUG nova.virt.disk.api [None req-36ce590d-c175-4fef-9135-1ffe19b10859 tempest-VolumesActionsTest-508911516 tempest-VolumesActionsTest-508911516-project-member] Cannot resize image /opt/stack/data/nova/instances/6739b4fc-063c-454c-8b37-b81c07b7ca1e/disk to a smaller size. {{(pid=75176) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 15:44:02 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-36ce590d-c175-4fef-9135-1ffe19b10859 tempest-VolumesActionsTest-508911516 tempest-VolumesActionsTest-508911516-project-member] [instance: 6739b4fc-063c-454c-8b37-b81c07b7ca1e] Created local disks {{(pid=75176) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 15:44:02 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-36ce590d-c175-4fef-9135-1ffe19b10859 tempest-VolumesActionsTest-508911516 tempest-VolumesActionsTest-508911516-project-member] [instance: 6739b4fc-063c-454c-8b37-b81c07b7ca1e] Ensure instance console log exists: /opt/stack/data/nova/instances/6739b4fc-063c-454c-8b37-b81c07b7ca1e/console.log {{(pid=75176) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 15:44:02 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-36ce590d-c175-4fef-9135-1ffe19b10859 tempest-VolumesActionsTest-508911516 tempest-VolumesActionsTest-508911516-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:44:02 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-36ce590d-c175-4fef-9135-1ffe19b10859 tempest-VolumesActionsTest-508911516 tempest-VolumesActionsTest-508911516-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:44:02 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-36ce590d-c175-4fef-9135-1ffe19b10859 tempest-VolumesActionsTest-508911516 tempest-VolumesActionsTest-508911516-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:44:02 user nova-compute[75176]: DEBUG nova.network.neutron [None req-36ce590d-c175-4fef-9135-1ffe19b10859 tempest-VolumesActionsTest-508911516 tempest-VolumesActionsTest-508911516-project-member] [instance: 6739b4fc-063c-454c-8b37-b81c07b7ca1e] Successfully created port: 9fb61fd8-c11e-41e5-a9f4-b6787f858f01 {{(pid=75176) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 15:44:03 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:44:03 user nova-compute[75176]: DEBUG nova.network.neutron [None req-36ce590d-c175-4fef-9135-1ffe19b10859 tempest-VolumesActionsTest-508911516 tempest-VolumesActionsTest-508911516-project-member] [instance: 6739b4fc-063c-454c-8b37-b81c07b7ca1e] Successfully updated port: 9fb61fd8-c11e-41e5-a9f4-b6787f858f01 {{(pid=75176) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 15:44:03 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-36ce590d-c175-4fef-9135-1ffe19b10859 tempest-VolumesActionsTest-508911516 tempest-VolumesActionsTest-508911516-project-member] Acquiring lock "refresh_cache-6739b4fc-063c-454c-8b37-b81c07b7ca1e" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:44:03 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-36ce590d-c175-4fef-9135-1ffe19b10859 tempest-VolumesActionsTest-508911516 tempest-VolumesActionsTest-508911516-project-member] Acquired lock "refresh_cache-6739b4fc-063c-454c-8b37-b81c07b7ca1e" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:44:03 user nova-compute[75176]: DEBUG nova.network.neutron [None req-36ce590d-c175-4fef-9135-1ffe19b10859 tempest-VolumesActionsTest-508911516 tempest-VolumesActionsTest-508911516-project-member] [instance: 6739b4fc-063c-454c-8b37-b81c07b7ca1e] Building network info cache for instance {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 15:44:03 user nova-compute[75176]: DEBUG nova.network.neutron [None req-36ce590d-c175-4fef-9135-1ffe19b10859 tempest-VolumesActionsTest-508911516 tempest-VolumesActionsTest-508911516-project-member] [instance: 6739b4fc-063c-454c-8b37-b81c07b7ca1e] Instance cache missing network info. {{(pid=75176) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 15:44:04 user nova-compute[75176]: DEBUG nova.compute.manager [req-5afae062-bcb8-4e14-8ded-c60e5aaeac74 req-cc7446b1-5931-48ca-a8b8-1e45e823eda2 service nova] [instance: 402e779e-f507-49f1-a0d8-31ab0d23fbcd] Received event network-changed-2de2e1eb-51fe-4259-bb8a-20c50e87b4ce {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:44:04 user nova-compute[75176]: DEBUG nova.compute.manager [req-5afae062-bcb8-4e14-8ded-c60e5aaeac74 req-cc7446b1-5931-48ca-a8b8-1e45e823eda2 service nova] [instance: 402e779e-f507-49f1-a0d8-31ab0d23fbcd] Refreshing instance network info cache due to event network-changed-2de2e1eb-51fe-4259-bb8a-20c50e87b4ce. {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 15:44:04 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-5afae062-bcb8-4e14-8ded-c60e5aaeac74 req-cc7446b1-5931-48ca-a8b8-1e45e823eda2 service nova] Acquiring lock "refresh_cache-402e779e-f507-49f1-a0d8-31ab0d23fbcd" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:44:04 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-5afae062-bcb8-4e14-8ded-c60e5aaeac74 req-cc7446b1-5931-48ca-a8b8-1e45e823eda2 service nova] Acquired lock "refresh_cache-402e779e-f507-49f1-a0d8-31ab0d23fbcd" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:44:04 user nova-compute[75176]: DEBUG nova.network.neutron [req-5afae062-bcb8-4e14-8ded-c60e5aaeac74 req-cc7446b1-5931-48ca-a8b8-1e45e823eda2 service nova] [instance: 402e779e-f507-49f1-a0d8-31ab0d23fbcd] Refreshing network info cache for port 2de2e1eb-51fe-4259-bb8a-20c50e87b4ce {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 15:44:04 user nova-compute[75176]: DEBUG nova.compute.manager [req-f5870f94-73d7-4432-8003-9cabb28c9afd req-17681526-36f2-417e-95a2-3f7c671c3680 service nova] [instance: 6739b4fc-063c-454c-8b37-b81c07b7ca1e] Received event network-changed-9fb61fd8-c11e-41e5-a9f4-b6787f858f01 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:44:04 user nova-compute[75176]: DEBUG nova.compute.manager [req-f5870f94-73d7-4432-8003-9cabb28c9afd req-17681526-36f2-417e-95a2-3f7c671c3680 service nova] [instance: 6739b4fc-063c-454c-8b37-b81c07b7ca1e] Refreshing instance network info cache due to event network-changed-9fb61fd8-c11e-41e5-a9f4-b6787f858f01. {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 15:44:04 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-f5870f94-73d7-4432-8003-9cabb28c9afd req-17681526-36f2-417e-95a2-3f7c671c3680 service nova] Acquiring lock "refresh_cache-6739b4fc-063c-454c-8b37-b81c07b7ca1e" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:44:04 user nova-compute[75176]: DEBUG nova.network.neutron [None req-36ce590d-c175-4fef-9135-1ffe19b10859 tempest-VolumesActionsTest-508911516 tempest-VolumesActionsTest-508911516-project-member] [instance: 6739b4fc-063c-454c-8b37-b81c07b7ca1e] Updating instance_info_cache with network_info: [{"id": "9fb61fd8-c11e-41e5-a9f4-b6787f858f01", "address": "fa:16:3e:dd:90:f5", "network": {"id": "b7bbcb7f-e50f-44f5-a57f-9fca9122f0d5", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1769518035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c47a8c7ab5c34e8bbf187b8e1f0bf9ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fb61fd8-c1", "ovs_interfaceid": "9fb61fd8-c11e-41e5-a9f4-b6787f858f01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:44:04 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-36ce590d-c175-4fef-9135-1ffe19b10859 tempest-VolumesActionsTest-508911516 tempest-VolumesActionsTest-508911516-project-member] Releasing lock "refresh_cache-6739b4fc-063c-454c-8b37-b81c07b7ca1e" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:44:04 user nova-compute[75176]: DEBUG nova.compute.manager [None req-36ce590d-c175-4fef-9135-1ffe19b10859 tempest-VolumesActionsTest-508911516 tempest-VolumesActionsTest-508911516-project-member] [instance: 6739b4fc-063c-454c-8b37-b81c07b7ca1e] Instance network_info: |[{"id": "9fb61fd8-c11e-41e5-a9f4-b6787f858f01", "address": "fa:16:3e:dd:90:f5", "network": {"id": "b7bbcb7f-e50f-44f5-a57f-9fca9122f0d5", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1769518035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c47a8c7ab5c34e8bbf187b8e1f0bf9ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fb61fd8-c1", "ovs_interfaceid": "9fb61fd8-c11e-41e5-a9f4-b6787f858f01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75176) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 15:44:04 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-f5870f94-73d7-4432-8003-9cabb28c9afd req-17681526-36f2-417e-95a2-3f7c671c3680 service nova] Acquired lock "refresh_cache-6739b4fc-063c-454c-8b37-b81c07b7ca1e" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:44:04 user nova-compute[75176]: DEBUG nova.network.neutron [req-f5870f94-73d7-4432-8003-9cabb28c9afd req-17681526-36f2-417e-95a2-3f7c671c3680 service nova] [instance: 6739b4fc-063c-454c-8b37-b81c07b7ca1e] Refreshing network info cache for port 9fb61fd8-c11e-41e5-a9f4-b6787f858f01 {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 15:44:04 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-36ce590d-c175-4fef-9135-1ffe19b10859 tempest-VolumesActionsTest-508911516 tempest-VolumesActionsTest-508911516-project-member] [instance: 6739b4fc-063c-454c-8b37-b81c07b7ca1e] Start _get_guest_xml network_info=[{"id": "9fb61fd8-c11e-41e5-a9f4-b6787f858f01", "address": "fa:16:3e:dd:90:f5", "network": {"id": "b7bbcb7f-e50f-44f5-a57f-9fca9122f0d5", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1769518035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c47a8c7ab5c34e8bbf187b8e1f0bf9ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fb61fd8-c1", "ovs_interfaceid": "9fb61fd8-c11e-41e5-a9f4-b6787f858f01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T15:35:12Z,direct_url=<?>,disk_format='qcow2',id=1f41819e-c93f-4dc7-b253-37a27bbbbc74,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1b91c5d0672c4224a48df2e1f92688e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T15:35:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'size': 0, 'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'image_id': '1f41819e-c93f-4dc7-b253-37a27bbbbc74'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75176) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 15:44:04 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-36ce590d-c175-4fef-9135-1ffe19b10859 tempest-VolumesActionsTest-508911516 tempest-VolumesActionsTest-508911516-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 15:44:04 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-36ce590d-c175-4fef-9135-1ffe19b10859 tempest-VolumesActionsTest-508911516 tempest-VolumesActionsTest-508911516-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 15:44:04 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-36ce590d-c175-4fef-9135-1ffe19b10859 tempest-VolumesActionsTest-508911516 tempest-VolumesActionsTest-508911516-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75176) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 15:44:04 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-36ce590d-c175-4fef-9135-1ffe19b10859 tempest-VolumesActionsTest-508911516 tempest-VolumesActionsTest-508911516-project-member] CPU controller missing on host. {{(pid=75176) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 15:44:04 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-36ce590d-c175-4fef-9135-1ffe19b10859 tempest-VolumesActionsTest-508911516 tempest-VolumesActionsTest-508911516-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75176) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 15:44:04 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-36ce590d-c175-4fef-9135-1ffe19b10859 tempest-VolumesActionsTest-508911516 tempest-VolumesActionsTest-508911516-project-member] CPU controller found on host. {{(pid=75176) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 15:44:04 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-36ce590d-c175-4fef-9135-1ffe19b10859 tempest-VolumesActionsTest-508911516 tempest-VolumesActionsTest-508911516-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75176) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 15:44:04 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-36ce590d-c175-4fef-9135-1ffe19b10859 tempest-VolumesActionsTest-508911516 tempest-VolumesActionsTest-508911516-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T15:35:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T15:35:12Z,direct_url=<?>,disk_format='qcow2',id=1f41819e-c93f-4dc7-b253-37a27bbbbc74,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1b91c5d0672c4224a48df2e1f92688e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T15:35:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 15:44:04 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-36ce590d-c175-4fef-9135-1ffe19b10859 tempest-VolumesActionsTest-508911516 tempest-VolumesActionsTest-508911516-project-member] Flavor limits 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 15:44:04 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-36ce590d-c175-4fef-9135-1ffe19b10859 tempest-VolumesActionsTest-508911516 tempest-VolumesActionsTest-508911516-project-member] Image limits 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 15:44:04 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-36ce590d-c175-4fef-9135-1ffe19b10859 tempest-VolumesActionsTest-508911516 tempest-VolumesActionsTest-508911516-project-member] Flavor pref 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 15:44:04 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-36ce590d-c175-4fef-9135-1ffe19b10859 tempest-VolumesActionsTest-508911516 tempest-VolumesActionsTest-508911516-project-member] Image pref 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 15:44:04 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-36ce590d-c175-4fef-9135-1ffe19b10859 tempest-VolumesActionsTest-508911516 tempest-VolumesActionsTest-508911516-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 15:44:04 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-36ce590d-c175-4fef-9135-1ffe19b10859 tempest-VolumesActionsTest-508911516 tempest-VolumesActionsTest-508911516-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 15:44:04 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-36ce590d-c175-4fef-9135-1ffe19b10859 tempest-VolumesActionsTest-508911516 tempest-VolumesActionsTest-508911516-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75176) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 15:44:04 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-36ce590d-c175-4fef-9135-1ffe19b10859 tempest-VolumesActionsTest-508911516 tempest-VolumesActionsTest-508911516-project-member] Got 1 possible topologies {{(pid=75176) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 15:44:04 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-36ce590d-c175-4fef-9135-1ffe19b10859 tempest-VolumesActionsTest-508911516 tempest-VolumesActionsTest-508911516-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 15:44:04 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-36ce590d-c175-4fef-9135-1ffe19b10859 tempest-VolumesActionsTest-508911516 tempest-VolumesActionsTest-508911516-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 15:44:04 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-36ce590d-c175-4fef-9135-1ffe19b10859 tempest-VolumesActionsTest-508911516 tempest-VolumesActionsTest-508911516-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T15:43:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-75145758',display_name='tempest-VolumesActionsTest-instance-75145758',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-75145758',id=16,image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c47a8c7ab5c34e8bbf187b8e1f0bf9ba',ramdisk_id='',reservation_id='r-y0gz4lmq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-508911516',owner_user_name='tempest-VolumesActionsTest-508911516-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T15:44:02Z,user_data=None,user_id='7e9cd48cc7744ab78a1b4452827e59d9',uuid=6739b4fc-063c-454c-8b37-b81c07b7ca1e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9fb61fd8-c11e-41e5-a9f4-b6787f858f01", "address": "fa:16:3e:dd:90:f5", "network": {"id": "b7bbcb7f-e50f-44f5-a57f-9fca9122f0d5", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1769518035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c47a8c7ab5c34e8bbf187b8e1f0bf9ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fb61fd8-c1", "ovs_interfaceid": "9fb61fd8-c11e-41e5-a9f4-b6787f858f01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75176) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 15:44:04 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-36ce590d-c175-4fef-9135-1ffe19b10859 tempest-VolumesActionsTest-508911516 tempest-VolumesActionsTest-508911516-project-member] Converting VIF {"id": "9fb61fd8-c11e-41e5-a9f4-b6787f858f01", "address": "fa:16:3e:dd:90:f5", "network": {"id": "b7bbcb7f-e50f-44f5-a57f-9fca9122f0d5", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1769518035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c47a8c7ab5c34e8bbf187b8e1f0bf9ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fb61fd8-c1", "ovs_interfaceid": "9fb61fd8-c11e-41e5-a9f4-b6787f858f01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:44:04 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-36ce590d-c175-4fef-9135-1ffe19b10859 tempest-VolumesActionsTest-508911516 tempest-VolumesActionsTest-508911516-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:90:f5,bridge_name='br-int',has_traffic_filtering=True,id=9fb61fd8-c11e-41e5-a9f4-b6787f858f01,network=Network(b7bbcb7f-e50f-44f5-a57f-9fca9122f0d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9fb61fd8-c1') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:44:04 user nova-compute[75176]: DEBUG nova.objects.instance [None req-36ce590d-c175-4fef-9135-1ffe19b10859 tempest-VolumesActionsTest-508911516 tempest-VolumesActionsTest-508911516-project-member] Lazy-loading 'pci_devices' on Instance uuid 6739b4fc-063c-454c-8b37-b81c07b7ca1e {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:44:04 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-36ce590d-c175-4fef-9135-1ffe19b10859 tempest-VolumesActionsTest-508911516 tempest-VolumesActionsTest-508911516-project-member] [instance: 6739b4fc-063c-454c-8b37-b81c07b7ca1e] End _get_guest_xml xml=<domain type="kvm">
Nov 28 15:44:04 user nova-compute[75176]:   <uuid>6739b4fc-063c-454c-8b37-b81c07b7ca1e</uuid>
Nov 28 15:44:04 user nova-compute[75176]:   <name>instance-00000010</name>
Nov 28 15:44:04 user nova-compute[75176]:   <memory>524288</memory>
Nov 28 15:44:04 user nova-compute[75176]:   <vcpu>1</vcpu>
Nov 28 15:44:04 user nova-compute[75176]:   <metadata>
Nov 28 15:44:04 user nova-compute[75176]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 15:44:04 user nova-compute[75176]:       <nova:package version="0.0.0"/>
Nov 28 15:44:04 user nova-compute[75176]:       <nova:name>tempest-VolumesActionsTest-instance-75145758</nova:name>
Nov 28 15:44:04 user nova-compute[75176]:       <nova:creationTime>2023-11-28 15:44:04</nova:creationTime>
Nov 28 15:44:04 user nova-compute[75176]:       <nova:flavor name="m1.tiny">
Nov 28 15:44:04 user nova-compute[75176]:         <nova:memory>512</nova:memory>
Nov 28 15:44:04 user nova-compute[75176]:         <nova:disk>1</nova:disk>
Nov 28 15:44:04 user nova-compute[75176]:         <nova:swap>0</nova:swap>
Nov 28 15:44:04 user nova-compute[75176]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 15:44:04 user nova-compute[75176]:         <nova:vcpus>1</nova:vcpus>
Nov 28 15:44:04 user nova-compute[75176]:       </nova:flavor>
Nov 28 15:44:04 user nova-compute[75176]:       <nova:owner>
Nov 28 15:44:04 user nova-compute[75176]:         <nova:user uuid="7e9cd48cc7744ab78a1b4452827e59d9">tempest-VolumesActionsTest-508911516-project-member</nova:user>
Nov 28 15:44:04 user nova-compute[75176]:         <nova:project uuid="c47a8c7ab5c34e8bbf187b8e1f0bf9ba">tempest-VolumesActionsTest-508911516</nova:project>
Nov 28 15:44:04 user nova-compute[75176]:       </nova:owner>
Nov 28 15:44:04 user nova-compute[75176]:       <nova:root type="image" uuid="1f41819e-c93f-4dc7-b253-37a27bbbbc74"/>
Nov 28 15:44:04 user nova-compute[75176]:       <nova:ports>
Nov 28 15:44:04 user nova-compute[75176]:         <nova:port uuid="9fb61fd8-c11e-41e5-a9f4-b6787f858f01">
Nov 28 15:44:04 user nova-compute[75176]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 28 15:44:04 user nova-compute[75176]:         </nova:port>
Nov 28 15:44:04 user nova-compute[75176]:       </nova:ports>
Nov 28 15:44:04 user nova-compute[75176]:     </nova:instance>
Nov 28 15:44:04 user nova-compute[75176]:   </metadata>
Nov 28 15:44:04 user nova-compute[75176]:   <sysinfo type="smbios">
Nov 28 15:44:04 user nova-compute[75176]:     <system>
Nov 28 15:44:04 user nova-compute[75176]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 15:44:04 user nova-compute[75176]:       <entry name="product">OpenStack Nova</entry>
Nov 28 15:44:04 user nova-compute[75176]:       <entry name="version">0.0.0</entry>
Nov 28 15:44:04 user nova-compute[75176]:       <entry name="serial">6739b4fc-063c-454c-8b37-b81c07b7ca1e</entry>
Nov 28 15:44:04 user nova-compute[75176]:       <entry name="uuid">6739b4fc-063c-454c-8b37-b81c07b7ca1e</entry>
Nov 28 15:44:04 user nova-compute[75176]:       <entry name="family">Virtual Machine</entry>
Nov 28 15:44:04 user nova-compute[75176]:     </system>
Nov 28 15:44:04 user nova-compute[75176]:   </sysinfo>
Nov 28 15:44:04 user nova-compute[75176]:   <os>
Nov 28 15:44:04 user nova-compute[75176]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 15:44:04 user nova-compute[75176]:     <boot dev="hd"/>
Nov 28 15:44:04 user nova-compute[75176]:     <smbios mode="sysinfo"/>
Nov 28 15:44:04 user nova-compute[75176]:   </os>
Nov 28 15:44:04 user nova-compute[75176]:   <features>
Nov 28 15:44:04 user nova-compute[75176]:     <acpi/>
Nov 28 15:44:04 user nova-compute[75176]:     <apic/>
Nov 28 15:44:04 user nova-compute[75176]:     <vmcoreinfo/>
Nov 28 15:44:04 user nova-compute[75176]:   </features>
Nov 28 15:44:04 user nova-compute[75176]:   <clock offset="utc">
Nov 28 15:44:04 user nova-compute[75176]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 15:44:04 user nova-compute[75176]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 15:44:04 user nova-compute[75176]:     <timer name="hpet" present="no"/>
Nov 28 15:44:04 user nova-compute[75176]:   </clock>
Nov 28 15:44:04 user nova-compute[75176]:   <cpu mode="custom" match="exact">
Nov 28 15:44:04 user nova-compute[75176]:     <model>Nehalem</model>
Nov 28 15:44:04 user nova-compute[75176]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 15:44:04 user nova-compute[75176]:   </cpu>
Nov 28 15:44:04 user nova-compute[75176]:   <devices>
Nov 28 15:44:04 user nova-compute[75176]:     <disk type="file" device="disk">
Nov 28 15:44:04 user nova-compute[75176]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 15:44:04 user nova-compute[75176]:       <source file="/opt/stack/data/nova/instances/6739b4fc-063c-454c-8b37-b81c07b7ca1e/disk"/>
Nov 28 15:44:04 user nova-compute[75176]:       <target dev="vda" bus="virtio"/>
Nov 28 15:44:04 user nova-compute[75176]:     </disk>
Nov 28 15:44:04 user nova-compute[75176]:     <interface type="ethernet">
Nov 28 15:44:04 user nova-compute[75176]:       <mac address="fa:16:3e:dd:90:f5"/>
Nov 28 15:44:04 user nova-compute[75176]:       <model type="virtio"/>
Nov 28 15:44:04 user nova-compute[75176]:       <mtu size="1442"/>
Nov 28 15:44:04 user nova-compute[75176]:       <target dev="tap9fb61fd8-c1"/>
Nov 28 15:44:04 user nova-compute[75176]:     </interface>
Nov 28 15:44:04 user nova-compute[75176]:     <serial type="pty">
Nov 28 15:44:04 user nova-compute[75176]:       <log file="/opt/stack/data/nova/instances/6739b4fc-063c-454c-8b37-b81c07b7ca1e/console.log" append="off"/>
Nov 28 15:44:04 user nova-compute[75176]:     </serial>
Nov 28 15:44:04 user nova-compute[75176]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 15:44:04 user nova-compute[75176]:     <video>
Nov 28 15:44:04 user nova-compute[75176]:       <model type="virtio"/>
Nov 28 15:44:04 user nova-compute[75176]:     </video>
Nov 28 15:44:04 user nova-compute[75176]:     <rng model="virtio">
Nov 28 15:44:04 user nova-compute[75176]:       <backend model="random">/dev/urandom</backend>
Nov 28 15:44:04 user nova-compute[75176]:     </rng>
Nov 28 15:44:04 user nova-compute[75176]:     <controller type="usb" index="0" model="none"/>
Nov 28 15:44:04 user nova-compute[75176]:     <memballoon model="virtio">
Nov 28 15:44:04 user nova-compute[75176]:       <stats period="10"/>
Nov 28 15:44:04 user nova-compute[75176]:     </memballoon>
Nov 28 15:44:04 user nova-compute[75176]:   </devices>
Nov 28 15:44:04 user nova-compute[75176]: </domain>
Nov 28 15:44:04 user nova-compute[75176]:  {{(pid=75176) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 15:44:04 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-36ce590d-c175-4fef-9135-1ffe19b10859 tempest-VolumesActionsTest-508911516 tempest-VolumesActionsTest-508911516-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T15:43:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-75145758',display_name='tempest-VolumesActionsTest-instance-75145758',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-75145758',id=16,image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c47a8c7ab5c34e8bbf187b8e1f0bf9ba',ramdisk_id='',reservation_id='r-y0gz4lmq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-508911516',owner_user_name='tempest-VolumesActionsTest-508911516-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T15:44:02Z,user_data=None,user_id='7e9cd48cc7744ab78a1b4452827e59d9',uuid=6739b4fc-063c-454c-8b37-b81c07b7ca1e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9fb61fd8-c11e-41e5-a9f4-b6787f858f01", "address": "fa:16:3e:dd:90:f5", "network": {"id": "b7bbcb7f-e50f-44f5-a57f-9fca9122f0d5", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1769518035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c47a8c7ab5c34e8bbf187b8e1f0bf9ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fb61fd8-c1", "ovs_interfaceid": "9fb61fd8-c11e-41e5-a9f4-b6787f858f01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 15:44:04 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-36ce590d-c175-4fef-9135-1ffe19b10859 tempest-VolumesActionsTest-508911516 tempest-VolumesActionsTest-508911516-project-member] Converting VIF {"id": "9fb61fd8-c11e-41e5-a9f4-b6787f858f01", "address": "fa:16:3e:dd:90:f5", "network": {"id": "b7bbcb7f-e50f-44f5-a57f-9fca9122f0d5", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1769518035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c47a8c7ab5c34e8bbf187b8e1f0bf9ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fb61fd8-c1", "ovs_interfaceid": "9fb61fd8-c11e-41e5-a9f4-b6787f858f01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:44:04 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-36ce590d-c175-4fef-9135-1ffe19b10859 tempest-VolumesActionsTest-508911516 tempest-VolumesActionsTest-508911516-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:90:f5,bridge_name='br-int',has_traffic_filtering=True,id=9fb61fd8-c11e-41e5-a9f4-b6787f858f01,network=Network(b7bbcb7f-e50f-44f5-a57f-9fca9122f0d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9fb61fd8-c1') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:44:04 user nova-compute[75176]: DEBUG os_vif [None req-36ce590d-c175-4fef-9135-1ffe19b10859 tempest-VolumesActionsTest-508911516 tempest-VolumesActionsTest-508911516-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:90:f5,bridge_name='br-int',has_traffic_filtering=True,id=9fb61fd8-c11e-41e5-a9f4-b6787f858f01,network=Network(b7bbcb7f-e50f-44f5-a57f-9fca9122f0d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9fb61fd8-c1') {{(pid=75176) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 15:44:04 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:44:04 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:44:04 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 15:44:04 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:44:04 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b6550b35-dbd2-5955-9ef0-eaa2d5eb14a5', '_type': 'linux-noop'}}, row=False) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:44:04 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:44:04 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:44:04 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:44:04 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9fb61fd8-c1, may_exist=True, interface_attrs={}) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:44:04 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9fb61fd8-c1, col_values=(('qos', UUID('97b5504e-964b-48d5-a2e8-9ebe49aa62fc')),), if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:44:04 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9fb61fd8-c1, col_values=(('external_ids', {'iface-id': '9fb61fd8-c11e-41e5-a9f4-b6787f858f01', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:dd:90:f5', 'vm-uuid': '6739b4fc-063c-454c-8b37-b81c07b7ca1e'}),), if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:44:04 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:44:04 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:44:04 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:44:04 user nova-compute[75176]: INFO os_vif [None req-36ce590d-c175-4fef-9135-1ffe19b10859 tempest-VolumesActionsTest-508911516 tempest-VolumesActionsTest-508911516-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:90:f5,bridge_name='br-int',has_traffic_filtering=True,id=9fb61fd8-c11e-41e5-a9f4-b6787f858f01,network=Network(b7bbcb7f-e50f-44f5-a57f-9fca9122f0d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9fb61fd8-c1')
Nov 28 15:44:04 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-36ce590d-c175-4fef-9135-1ffe19b10859 tempest-VolumesActionsTest-508911516 tempest-VolumesActionsTest-508911516-project-member] No BDM found with device name vda, not building metadata. {{(pid=75176) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 15:44:04 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-36ce590d-c175-4fef-9135-1ffe19b10859 tempest-VolumesActionsTest-508911516 tempest-VolumesActionsTest-508911516-project-member] No VIF found with MAC fa:16:3e:dd:90:f5, not building metadata {{(pid=75176) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 15:44:04 user nova-compute[75176]: DEBUG nova.network.neutron [req-f5870f94-73d7-4432-8003-9cabb28c9afd req-17681526-36f2-417e-95a2-3f7c671c3680 service nova] [instance: 6739b4fc-063c-454c-8b37-b81c07b7ca1e] Updated VIF entry in instance network info cache for port 9fb61fd8-c11e-41e5-a9f4-b6787f858f01. {{(pid=75176) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 15:44:04 user nova-compute[75176]: DEBUG nova.network.neutron [req-f5870f94-73d7-4432-8003-9cabb28c9afd req-17681526-36f2-417e-95a2-3f7c671c3680 service nova] [instance: 6739b4fc-063c-454c-8b37-b81c07b7ca1e] Updating instance_info_cache with network_info: [{"id": "9fb61fd8-c11e-41e5-a9f4-b6787f858f01", "address": "fa:16:3e:dd:90:f5", "network": {"id": "b7bbcb7f-e50f-44f5-a57f-9fca9122f0d5", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1769518035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c47a8c7ab5c34e8bbf187b8e1f0bf9ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fb61fd8-c1", "ovs_interfaceid": "9fb61fd8-c11e-41e5-a9f4-b6787f858f01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:44:04 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-f5870f94-73d7-4432-8003-9cabb28c9afd req-17681526-36f2-417e-95a2-3f7c671c3680 service nova] Releasing lock "refresh_cache-6739b4fc-063c-454c-8b37-b81c07b7ca1e" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:44:04 user nova-compute[75176]: DEBUG nova.network.neutron [req-5afae062-bcb8-4e14-8ded-c60e5aaeac74 req-cc7446b1-5931-48ca-a8b8-1e45e823eda2 service nova] [instance: 402e779e-f507-49f1-a0d8-31ab0d23fbcd] Updated VIF entry in instance network info cache for port 2de2e1eb-51fe-4259-bb8a-20c50e87b4ce. {{(pid=75176) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 15:44:04 user nova-compute[75176]: DEBUG nova.network.neutron [req-5afae062-bcb8-4e14-8ded-c60e5aaeac74 req-cc7446b1-5931-48ca-a8b8-1e45e823eda2 service nova] [instance: 402e779e-f507-49f1-a0d8-31ab0d23fbcd] Updating instance_info_cache with network_info: [{"id": "2de2e1eb-51fe-4259-bb8a-20c50e87b4ce", "address": "fa:16:3e:c4:29:df", "network": {"id": "7ab60343-57be-427d-9037-6ecf0eaf5de0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1508138843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a194f81f7e104be7940d1d05f71bbad9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2de2e1eb-51", "ovs_interfaceid": "2de2e1eb-51fe-4259-bb8a-20c50e87b4ce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:44:04 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-5afae062-bcb8-4e14-8ded-c60e5aaeac74 req-cc7446b1-5931-48ca-a8b8-1e45e823eda2 service nova] Releasing lock "refresh_cache-402e779e-f507-49f1-a0d8-31ab0d23fbcd" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:44:05 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:44:06 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:44:06 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:44:06 user nova-compute[75176]: DEBUG nova.compute.manager [req-8787f43f-7999-4088-86e7-25dd9210332e req-2b3a6b84-5348-41da-8d31-b48e3e5f0472 service nova] [instance: 6739b4fc-063c-454c-8b37-b81c07b7ca1e] Received event network-vif-plugged-9fb61fd8-c11e-41e5-a9f4-b6787f858f01 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:44:06 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-8787f43f-7999-4088-86e7-25dd9210332e req-2b3a6b84-5348-41da-8d31-b48e3e5f0472 service nova] Acquiring lock "6739b4fc-063c-454c-8b37-b81c07b7ca1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:44:06 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-8787f43f-7999-4088-86e7-25dd9210332e req-2b3a6b84-5348-41da-8d31-b48e3e5f0472 service nova] Lock "6739b4fc-063c-454c-8b37-b81c07b7ca1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:44:06 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-8787f43f-7999-4088-86e7-25dd9210332e req-2b3a6b84-5348-41da-8d31-b48e3e5f0472 service nova] Lock "6739b4fc-063c-454c-8b37-b81c07b7ca1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:44:06 user nova-compute[75176]: DEBUG nova.compute.manager [req-8787f43f-7999-4088-86e7-25dd9210332e req-2b3a6b84-5348-41da-8d31-b48e3e5f0472 service nova] [instance: 6739b4fc-063c-454c-8b37-b81c07b7ca1e] No waiting events found dispatching network-vif-plugged-9fb61fd8-c11e-41e5-a9f4-b6787f858f01 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:44:06 user nova-compute[75176]: WARNING nova.compute.manager [req-8787f43f-7999-4088-86e7-25dd9210332e req-2b3a6b84-5348-41da-8d31-b48e3e5f0472 service nova] [instance: 6739b4fc-063c-454c-8b37-b81c07b7ca1e] Received unexpected event network-vif-plugged-9fb61fd8-c11e-41e5-a9f4-b6787f858f01 for instance with vm_state building and task_state spawning.
Nov 28 15:44:06 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-9063e526-3050-4156-8035-907d24fb7945 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Acquiring lock "402e779e-f507-49f1-a0d8-31ab0d23fbcd" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:44:06 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-9063e526-3050-4156-8035-907d24fb7945 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Lock "402e779e-f507-49f1-a0d8-31ab0d23fbcd" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:44:06 user nova-compute[75176]: DEBUG nova.objects.instance [None req-9063e526-3050-4156-8035-907d24fb7945 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Lazy-loading 'flavor' on Instance uuid 402e779e-f507-49f1-a0d8-31ab0d23fbcd {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:44:06 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-9063e526-3050-4156-8035-907d24fb7945 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Lock "402e779e-f507-49f1-a0d8-31ab0d23fbcd" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:44:06 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:44:06 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:44:06 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:44:07 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-9063e526-3050-4156-8035-907d24fb7945 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Acquiring lock "402e779e-f507-49f1-a0d8-31ab0d23fbcd" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:44:07 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-9063e526-3050-4156-8035-907d24fb7945 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Lock "402e779e-f507-49f1-a0d8-31ab0d23fbcd" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:44:07 user nova-compute[75176]: INFO nova.compute.manager [None req-9063e526-3050-4156-8035-907d24fb7945 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] [instance: 402e779e-f507-49f1-a0d8-31ab0d23fbcd] Attaching volume a1f5de5d-be7a-443a-9831-791c8667c09b to /dev/vdb
Nov 28 15:44:07 user nova-compute[75176]: DEBUG os_brick.utils [None req-9063e526-3050-4156-8035-907d24fb7945 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 15:44:07 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:44:07 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:44:07 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[289cba85-f6a4-421b-b8a3-99cae75620bd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:edc924a949b2\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:44:07 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:44:07 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.026s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:44:07 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[a97050ce-9141-4c3e-b762-2653ac542fe1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:44:07 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:44:07 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:44:07 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[6586fe91-208b-4411-b500-0c3758a47a7c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:44:07 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[40b48966-b1ad-4bfd-a040-de4042b0c668]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:44:07 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-9063e526-3050-4156-8035-907d24fb7945 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Running cmd (subprocess): nvme version {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:44:07 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-9063e526-3050-4156-8035-907d24fb7945 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] 'nvme version' failed. Not Retrying. {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 15:44:07 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9063e526-3050-4156-8035-907d24fb7945 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] nvme not present on system {{(pid=75176) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 15:44:07 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:44:07 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 15:44:07 user nova-compute[75176]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 15:44:07 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[06099fd8-66d6-4909-8928-4bf8b44348a1]: (4, '') {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:44:07 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.lightos [None req-9063e526-3050-4156-8035-907d24fb7945 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75176) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 15:44:07 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.lightos [None req-9063e526-3050-4156-8035-907d24fb7945 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75176) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 15:44:07 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.lightos [None req-9063e526-3050-4156-8035-907d24fb7945 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] LIGHTOS: no hostnqn found. {{(pid=75176) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 15:44:07 user nova-compute[75176]: DEBUG os_brick.utils [None req-9063e526-3050-4156-8035-907d24fb7945 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] <== get_connector_properties: return (154ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:edc924a949b2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 15:44:07 user nova-compute[75176]: DEBUG nova.virt.block_device [None req-9063e526-3050-4156-8035-907d24fb7945 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] [instance: 402e779e-f507-49f1-a0d8-31ab0d23fbcd] Updating existing volume attachment record: 9f769f6e-39d9-439d-a704-1ecc32ccc6b5 {{(pid=75176) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 15:44:07 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:44:08 user nova-compute[75176]: DEBUG nova.compute.manager [None req-36ce590d-c175-4fef-9135-1ffe19b10859 tempest-VolumesActionsTest-508911516 tempest-VolumesActionsTest-508911516-project-member] [instance: 6739b4fc-063c-454c-8b37-b81c07b7ca1e] Instance event wait completed in 0 seconds for  {{(pid=75176) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 15:44:08 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-36ce590d-c175-4fef-9135-1ffe19b10859 tempest-VolumesActionsTest-508911516 tempest-VolumesActionsTest-508911516-project-member] [instance: 6739b4fc-063c-454c-8b37-b81c07b7ca1e] Guest created on hypervisor {{(pid=75176) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 15:44:08 user nova-compute[75176]: INFO nova.virt.libvirt.driver [-] [instance: 6739b4fc-063c-454c-8b37-b81c07b7ca1e] Instance spawned successfully.
Nov 28 15:44:08 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-36ce590d-c175-4fef-9135-1ffe19b10859 tempest-VolumesActionsTest-508911516 tempest-VolumesActionsTest-508911516-project-member] [instance: 6739b4fc-063c-454c-8b37-b81c07b7ca1e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 15:44:08 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-36ce590d-c175-4fef-9135-1ffe19b10859 tempest-VolumesActionsTest-508911516 tempest-VolumesActionsTest-508911516-project-member] [instance: 6739b4fc-063c-454c-8b37-b81c07b7ca1e] Found default for hw_cdrom_bus of ide {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:44:08 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-36ce590d-c175-4fef-9135-1ffe19b10859 tempest-VolumesActionsTest-508911516 tempest-VolumesActionsTest-508911516-project-member] [instance: 6739b4fc-063c-454c-8b37-b81c07b7ca1e] Found default for hw_disk_bus of virtio {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:44:08 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-36ce590d-c175-4fef-9135-1ffe19b10859 tempest-VolumesActionsTest-508911516 tempest-VolumesActionsTest-508911516-project-member] [instance: 6739b4fc-063c-454c-8b37-b81c07b7ca1e] Found default for hw_input_bus of None {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:44:08 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-36ce590d-c175-4fef-9135-1ffe19b10859 tempest-VolumesActionsTest-508911516 tempest-VolumesActionsTest-508911516-project-member] [instance: 6739b4fc-063c-454c-8b37-b81c07b7ca1e] Found default for hw_pointer_model of None {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:44:08 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-36ce590d-c175-4fef-9135-1ffe19b10859 tempest-VolumesActionsTest-508911516 tempest-VolumesActionsTest-508911516-project-member] [instance: 6739b4fc-063c-454c-8b37-b81c07b7ca1e] Found default for hw_video_model of virtio {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:44:08 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-36ce590d-c175-4fef-9135-1ffe19b10859 tempest-VolumesActionsTest-508911516 tempest-VolumesActionsTest-508911516-project-member] [instance: 6739b4fc-063c-454c-8b37-b81c07b7ca1e] Found default for hw_vif_model of virtio {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:44:08 user nova-compute[75176]: INFO nova.compute.manager [None req-36ce590d-c175-4fef-9135-1ffe19b10859 tempest-VolumesActionsTest-508911516 tempest-VolumesActionsTest-508911516-project-member] [instance: 6739b4fc-063c-454c-8b37-b81c07b7ca1e] Took 6.93 seconds to spawn the instance on the hypervisor.
Nov 28 15:44:08 user nova-compute[75176]: DEBUG nova.compute.manager [None req-36ce590d-c175-4fef-9135-1ffe19b10859 tempest-VolumesActionsTest-508911516 tempest-VolumesActionsTest-508911516-project-member] [instance: 6739b4fc-063c-454c-8b37-b81c07b7ca1e] Checking state {{(pid=75176) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 15:44:08 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:44:08 user nova-compute[75176]: DEBUG nova.compute.manager [req-fed52628-05b4-425f-9987-beb467e67a77 req-92ab1db0-3a18-4e49-816b-c54e55c5d13e service nova] [instance: 6739b4fc-063c-454c-8b37-b81c07b7ca1e] Received event network-vif-plugged-9fb61fd8-c11e-41e5-a9f4-b6787f858f01 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:44:08 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-fed52628-05b4-425f-9987-beb467e67a77 req-92ab1db0-3a18-4e49-816b-c54e55c5d13e service nova] Acquiring lock "6739b4fc-063c-454c-8b37-b81c07b7ca1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:44:08 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-fed52628-05b4-425f-9987-beb467e67a77 req-92ab1db0-3a18-4e49-816b-c54e55c5d13e service nova] Lock "6739b4fc-063c-454c-8b37-b81c07b7ca1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.009s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:44:08 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-fed52628-05b4-425f-9987-beb467e67a77 req-92ab1db0-3a18-4e49-816b-c54e55c5d13e service nova] Lock "6739b4fc-063c-454c-8b37-b81c07b7ca1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:44:08 user nova-compute[75176]: DEBUG nova.compute.manager [req-fed52628-05b4-425f-9987-beb467e67a77 req-92ab1db0-3a18-4e49-816b-c54e55c5d13e service nova] [instance: 6739b4fc-063c-454c-8b37-b81c07b7ca1e] No waiting events found dispatching network-vif-plugged-9fb61fd8-c11e-41e5-a9f4-b6787f858f01 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:44:08 user nova-compute[75176]: WARNING nova.compute.manager [req-fed52628-05b4-425f-9987-beb467e67a77 req-92ab1db0-3a18-4e49-816b-c54e55c5d13e service nova] [instance: 6739b4fc-063c-454c-8b37-b81c07b7ca1e] Received unexpected event network-vif-plugged-9fb61fd8-c11e-41e5-a9f4-b6787f858f01 for instance with vm_state building and task_state spawning.
Nov 28 15:44:08 user nova-compute[75176]: INFO nova.compute.manager [None req-36ce590d-c175-4fef-9135-1ffe19b10859 tempest-VolumesActionsTest-508911516 tempest-VolumesActionsTest-508911516-project-member] [instance: 6739b4fc-063c-454c-8b37-b81c07b7ca1e] Took 7.98 seconds to build instance.
Nov 28 15:44:08 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-36ce590d-c175-4fef-9135-1ffe19b10859 tempest-VolumesActionsTest-508911516 tempest-VolumesActionsTest-508911516-project-member] Lock "6739b4fc-063c-454c-8b37-b81c07b7ca1e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.163s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:44:09 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:44:10 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:44:11 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-25942222-0fc1-43af-af7a-87581c8372b4 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] Acquiring lock "6b3646e6-512e-4cd6-b3c1-89438c19c408" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:44:11 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-25942222-0fc1-43af-af7a-87581c8372b4 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] Lock "6b3646e6-512e-4cd6-b3c1-89438c19c408" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:44:11 user nova-compute[75176]: DEBUG nova.compute.manager [None req-25942222-0fc1-43af-af7a-87581c8372b4 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] [instance: 6b3646e6-512e-4cd6-b3c1-89438c19c408] Starting instance... {{(pid=75176) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 15:44:11 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-25942222-0fc1-43af-af7a-87581c8372b4 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:44:11 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-25942222-0fc1-43af-af7a-87581c8372b4 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:44:11 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-25942222-0fc1-43af-af7a-87581c8372b4 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75176) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 15:44:11 user nova-compute[75176]: INFO nova.compute.claims [None req-25942222-0fc1-43af-af7a-87581c8372b4 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] [instance: 6b3646e6-512e-4cd6-b3c1-89438c19c408] Claim successful on node user
Nov 28 15:44:11 user nova-compute[75176]: DEBUG nova.compute.provider_tree [None req-25942222-0fc1-43af-af7a-87581c8372b4 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] Inventory has not changed in ProviderTree for provider: b37848d8-f401-4155-a029-b0ffa09ff85b {{(pid=75176) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 15:44:11 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-25942222-0fc1-43af-af7a-87581c8372b4 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] Inventory has not changed for provider b37848d8-f401-4155-a029-b0ffa09ff85b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75176) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 15:44:11 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-25942222-0fc1-43af-af7a-87581c8372b4 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.714s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:44:11 user nova-compute[75176]: DEBUG nova.compute.manager [None req-25942222-0fc1-43af-af7a-87581c8372b4 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] [instance: 6b3646e6-512e-4cd6-b3c1-89438c19c408] Start building networks asynchronously for instance. {{(pid=75176) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 15:44:12 user nova-compute[75176]: DEBUG nova.compute.manager [None req-25942222-0fc1-43af-af7a-87581c8372b4 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] [instance: 6b3646e6-512e-4cd6-b3c1-89438c19c408] Allocating IP information in the background. {{(pid=75176) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 15:44:12 user nova-compute[75176]: DEBUG nova.network.neutron [None req-25942222-0fc1-43af-af7a-87581c8372b4 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] [instance: 6b3646e6-512e-4cd6-b3c1-89438c19c408] allocate_for_instance() {{(pid=75176) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 15:44:12 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-25942222-0fc1-43af-af7a-87581c8372b4 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] [instance: 6b3646e6-512e-4cd6-b3c1-89438c19c408] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 15:44:12 user nova-compute[75176]: DEBUG nova.compute.manager [None req-25942222-0fc1-43af-af7a-87581c8372b4 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] [instance: 6b3646e6-512e-4cd6-b3c1-89438c19c408] Start building block device mappings for instance. {{(pid=75176) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 15:44:12 user nova-compute[75176]: DEBUG nova.policy [None req-25942222-0fc1-43af-af7a-87581c8372b4 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '28d7f43fc5d74a188de770183e44834e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f22e22fdcb403d82a186a635d6b44a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75176) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 15:44:12 user nova-compute[75176]: DEBUG nova.compute.manager [None req-25942222-0fc1-43af-af7a-87581c8372b4 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] [instance: 6b3646e6-512e-4cd6-b3c1-89438c19c408] Start spawning the instance on the hypervisor. {{(pid=75176) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 15:44:12 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-25942222-0fc1-43af-af7a-87581c8372b4 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] [instance: 6b3646e6-512e-4cd6-b3c1-89438c19c408] Creating instance directory {{(pid=75176) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 15:44:12 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-25942222-0fc1-43af-af7a-87581c8372b4 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] [instance: 6b3646e6-512e-4cd6-b3c1-89438c19c408] Creating image(s)
Nov 28 15:44:12 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-25942222-0fc1-43af-af7a-87581c8372b4 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] Acquiring lock "/opt/stack/data/nova/instances/6b3646e6-512e-4cd6-b3c1-89438c19c408/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:44:12 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-25942222-0fc1-43af-af7a-87581c8372b4 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] Lock "/opt/stack/data/nova/instances/6b3646e6-512e-4cd6-b3c1-89438c19c408/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:44:12 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-25942222-0fc1-43af-af7a-87581c8372b4 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] Lock "/opt/stack/data/nova/instances/6b3646e6-512e-4cd6-b3c1-89438c19c408/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:44:12 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-25942222-0fc1-43af-af7a-87581c8372b4 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:44:12 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7e673717-559d-47f4-bb90-a69ab3905f6f tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] Acquiring lock "1e8a6e1b-4f71-494a-8f44-f9643c658021" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:44:12 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7e673717-559d-47f4-bb90-a69ab3905f6f tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] Lock "1e8a6e1b-4f71-494a-8f44-f9643c658021" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:44:12 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-25942222-0fc1-43af-af7a-87581c8372b4 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json" returned: 0 in 0.205s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:44:12 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-25942222-0fc1-43af-af7a-87581c8372b4 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] Acquiring lock "5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:44:12 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-25942222-0fc1-43af-af7a-87581c8372b4 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] Lock "5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:44:12 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-25942222-0fc1-43af-af7a-87581c8372b4 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:44:12 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7e673717-559d-47f4-bb90-a69ab3905f6f tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] [instance: 1e8a6e1b-4f71-494a-8f44-f9643c658021] Starting instance... {{(pid=75176) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 15:44:12 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7e673717-559d-47f4-bb90-a69ab3905f6f tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:44:12 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7e673717-559d-47f4-bb90-a69ab3905f6f tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:44:12 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-25942222-0fc1-43af-af7a-87581c8372b4 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json" returned: 0 in 0.221s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:44:12 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-25942222-0fc1-43af-af7a-87581c8372b4 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2,backing_fmt=raw /opt/stack/data/nova/instances/6b3646e6-512e-4cd6-b3c1-89438c19c408/disk 1073741824 {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:44:12 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-7e673717-559d-47f4-bb90-a69ab3905f6f tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75176) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 15:44:12 user nova-compute[75176]: INFO nova.compute.claims [None req-7e673717-559d-47f4-bb90-a69ab3905f6f tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] [instance: 1e8a6e1b-4f71-494a-8f44-f9643c658021] Claim successful on node user
Nov 28 15:44:12 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-25942222-0fc1-43af-af7a-87581c8372b4 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2,backing_fmt=raw /opt/stack/data/nova/instances/6b3646e6-512e-4cd6-b3c1-89438c19c408/disk 1073741824" returned: 0 in 0.085s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:44:12 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-25942222-0fc1-43af-af7a-87581c8372b4 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] Lock "5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.312s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:44:12 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-25942222-0fc1-43af-af7a-87581c8372b4 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:44:13 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-25942222-0fc1-43af-af7a-87581c8372b4 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json" returned: 0 in 0.216s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:44:13 user nova-compute[75176]: DEBUG nova.virt.disk.api [None req-25942222-0fc1-43af-af7a-87581c8372b4 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6b3646e6-512e-4cd6-b3c1-89438c19c408/disk. size=1073741824 {{(pid=75176) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 15:44:13 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-25942222-0fc1-43af-af7a-87581c8372b4 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b3646e6-512e-4cd6-b3c1-89438c19c408/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:44:13 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-25942222-0fc1-43af-af7a-87581c8372b4 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b3646e6-512e-4cd6-b3c1-89438c19c408/disk --force-share --output=json" returned: 0 in 0.265s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:44:13 user nova-compute[75176]: DEBUG nova.virt.disk.api [None req-25942222-0fc1-43af-af7a-87581c8372b4 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] Cannot resize image /opt/stack/data/nova/instances/6b3646e6-512e-4cd6-b3c1-89438c19c408/disk to a smaller size. {{(pid=75176) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 15:44:13 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-25942222-0fc1-43af-af7a-87581c8372b4 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] [instance: 6b3646e6-512e-4cd6-b3c1-89438c19c408] Created local disks {{(pid=75176) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 15:44:13 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-25942222-0fc1-43af-af7a-87581c8372b4 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] [instance: 6b3646e6-512e-4cd6-b3c1-89438c19c408] Ensure instance console log exists: /opt/stack/data/nova/instances/6b3646e6-512e-4cd6-b3c1-89438c19c408/console.log {{(pid=75176) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 15:44:13 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-25942222-0fc1-43af-af7a-87581c8372b4 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:44:13 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-25942222-0fc1-43af-af7a-87581c8372b4 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:44:13 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-25942222-0fc1-43af-af7a-87581c8372b4 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:44:13 user nova-compute[75176]: DEBUG nova.network.neutron [None req-25942222-0fc1-43af-af7a-87581c8372b4 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] [instance: 6b3646e6-512e-4cd6-b3c1-89438c19c408] Successfully created port: 76888781-ca16-4c3d-99b3-37a902459609 {{(pid=75176) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 15:44:13 user nova-compute[75176]: DEBUG nova.compute.provider_tree [None req-7e673717-559d-47f4-bb90-a69ab3905f6f tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] Inventory has not changed in ProviderTree for provider: b37848d8-f401-4155-a029-b0ffa09ff85b {{(pid=75176) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 15:44:13 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-7e673717-559d-47f4-bb90-a69ab3905f6f tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] Inventory has not changed for provider b37848d8-f401-4155-a029-b0ffa09ff85b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75176) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 15:44:13 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7e673717-559d-47f4-bb90-a69ab3905f6f tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.827s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:44:13 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7e673717-559d-47f4-bb90-a69ab3905f6f tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] [instance: 1e8a6e1b-4f71-494a-8f44-f9643c658021] Start building networks asynchronously for instance. {{(pid=75176) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 15:44:13 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7e673717-559d-47f4-bb90-a69ab3905f6f tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] [instance: 1e8a6e1b-4f71-494a-8f44-f9643c658021] Allocating IP information in the background. {{(pid=75176) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 15:44:13 user nova-compute[75176]: DEBUG nova.network.neutron [None req-7e673717-559d-47f4-bb90-a69ab3905f6f tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] [instance: 1e8a6e1b-4f71-494a-8f44-f9643c658021] allocate_for_instance() {{(pid=75176) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 15:44:13 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:44:13 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-7e673717-559d-47f4-bb90-a69ab3905f6f tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] [instance: 1e8a6e1b-4f71-494a-8f44-f9643c658021] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 15:44:13 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7e673717-559d-47f4-bb90-a69ab3905f6f tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] [instance: 1e8a6e1b-4f71-494a-8f44-f9643c658021] Start building block device mappings for instance. {{(pid=75176) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 15:44:13 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7e673717-559d-47f4-bb90-a69ab3905f6f tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] [instance: 1e8a6e1b-4f71-494a-8f44-f9643c658021] Start spawning the instance on the hypervisor. {{(pid=75176) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 15:44:13 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-7e673717-559d-47f4-bb90-a69ab3905f6f tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] [instance: 1e8a6e1b-4f71-494a-8f44-f9643c658021] Creating instance directory {{(pid=75176) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 15:44:13 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-7e673717-559d-47f4-bb90-a69ab3905f6f tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] [instance: 1e8a6e1b-4f71-494a-8f44-f9643c658021] Creating image(s)
Nov 28 15:44:13 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7e673717-559d-47f4-bb90-a69ab3905f6f tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] Acquiring lock "/opt/stack/data/nova/instances/1e8a6e1b-4f71-494a-8f44-f9643c658021/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:44:13 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7e673717-559d-47f4-bb90-a69ab3905f6f tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] Lock "/opt/stack/data/nova/instances/1e8a6e1b-4f71-494a-8f44-f9643c658021/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:44:13 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7e673717-559d-47f4-bb90-a69ab3905f6f tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] Lock "/opt/stack/data/nova/instances/1e8a6e1b-4f71-494a-8f44-f9643c658021/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:44:13 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7e673717-559d-47f4-bb90-a69ab3905f6f tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:44:13 user nova-compute[75176]: DEBUG nova.policy [None req-7e673717-559d-47f4-bb90-a69ab3905f6f tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8fdbce92609048169853a846340eb9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ce3926a76541f7a32ada5070b10be1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75176) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 15:44:14 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7e673717-559d-47f4-bb90-a69ab3905f6f tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json" returned: 0 in 0.226s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:44:14 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7e673717-559d-47f4-bb90-a69ab3905f6f tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] Acquiring lock "5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:44:14 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7e673717-559d-47f4-bb90-a69ab3905f6f tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] Lock "5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.004s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:44:14 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7e673717-559d-47f4-bb90-a69ab3905f6f tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:44:14 user nova-compute[75176]: DEBUG nova.network.neutron [None req-25942222-0fc1-43af-af7a-87581c8372b4 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] [instance: 6b3646e6-512e-4cd6-b3c1-89438c19c408] Successfully updated port: 76888781-ca16-4c3d-99b3-37a902459609 {{(pid=75176) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 15:44:14 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7e673717-559d-47f4-bb90-a69ab3905f6f tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json" returned: 0 in 0.236s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:44:14 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7e673717-559d-47f4-bb90-a69ab3905f6f tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2,backing_fmt=raw /opt/stack/data/nova/instances/1e8a6e1b-4f71-494a-8f44-f9643c658021/disk 1073741824 {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:44:14 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:44:14 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-25942222-0fc1-43af-af7a-87581c8372b4 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] Acquiring lock "refresh_cache-6b3646e6-512e-4cd6-b3c1-89438c19c408" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:44:14 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-25942222-0fc1-43af-af7a-87581c8372b4 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] Acquired lock "refresh_cache-6b3646e6-512e-4cd6-b3c1-89438c19c408" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:44:14 user nova-compute[75176]: DEBUG nova.network.neutron [None req-25942222-0fc1-43af-af7a-87581c8372b4 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] [instance: 6b3646e6-512e-4cd6-b3c1-89438c19c408] Building network info cache for instance {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 15:44:14 user nova-compute[75176]: DEBUG nova.compute.manager [req-4f09b065-2a9a-4100-aeb4-04280ab58272 req-ee41ea12-fde8-4f1d-8819-519b933b0457 service nova] [instance: 6b3646e6-512e-4cd6-b3c1-89438c19c408] Received event network-changed-76888781-ca16-4c3d-99b3-37a902459609 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:44:14 user nova-compute[75176]: DEBUG nova.compute.manager [req-4f09b065-2a9a-4100-aeb4-04280ab58272 req-ee41ea12-fde8-4f1d-8819-519b933b0457 service nova] [instance: 6b3646e6-512e-4cd6-b3c1-89438c19c408] Refreshing instance network info cache due to event network-changed-76888781-ca16-4c3d-99b3-37a902459609. {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 15:44:14 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-4f09b065-2a9a-4100-aeb4-04280ab58272 req-ee41ea12-fde8-4f1d-8819-519b933b0457 service nova] Acquiring lock "refresh_cache-6b3646e6-512e-4cd6-b3c1-89438c19c408" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:44:14 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7e673717-559d-47f4-bb90-a69ab3905f6f tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2,backing_fmt=raw /opt/stack/data/nova/instances/1e8a6e1b-4f71-494a-8f44-f9643c658021/disk 1073741824" returned: 0 in 0.180s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:44:14 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7e673717-559d-47f4-bb90-a69ab3905f6f tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] Lock "5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.422s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:44:14 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7e673717-559d-47f4-bb90-a69ab3905f6f tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:44:14 user nova-compute[75176]: DEBUG nova.network.neutron [None req-25942222-0fc1-43af-af7a-87581c8372b4 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] [instance: 6b3646e6-512e-4cd6-b3c1-89438c19c408] Instance cache missing network info. {{(pid=75176) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 15:44:14 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7e673717-559d-47f4-bb90-a69ab3905f6f tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json" returned: 0 in 0.195s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:44:14 user nova-compute[75176]: DEBUG nova.virt.disk.api [None req-7e673717-559d-47f4-bb90-a69ab3905f6f tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1e8a6e1b-4f71-494a-8f44-f9643c658021/disk. size=1073741824 {{(pid=75176) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 15:44:14 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7e673717-559d-47f4-bb90-a69ab3905f6f tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e8a6e1b-4f71-494a-8f44-f9643c658021/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:44:14 user nova-compute[75176]: DEBUG nova.network.neutron [None req-25942222-0fc1-43af-af7a-87581c8372b4 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] [instance: 6b3646e6-512e-4cd6-b3c1-89438c19c408] Updating instance_info_cache with network_info: [{"id": "76888781-ca16-4c3d-99b3-37a902459609", "address": "fa:16:3e:42:3e:fc", "network": {"id": "a275bae2-c1ee-445a-adc0-411f99e837e7", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1828472132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39f22e22fdcb403d82a186a635d6b44a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76888781-ca", "ovs_interfaceid": "76888781-ca16-4c3d-99b3-37a902459609", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:44:14 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-25942222-0fc1-43af-af7a-87581c8372b4 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] Releasing lock "refresh_cache-6b3646e6-512e-4cd6-b3c1-89438c19c408" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:44:14 user nova-compute[75176]: DEBUG nova.compute.manager [None req-25942222-0fc1-43af-af7a-87581c8372b4 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] [instance: 6b3646e6-512e-4cd6-b3c1-89438c19c408] Instance network_info: |[{"id": "76888781-ca16-4c3d-99b3-37a902459609", "address": "fa:16:3e:42:3e:fc", "network": {"id": "a275bae2-c1ee-445a-adc0-411f99e837e7", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1828472132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39f22e22fdcb403d82a186a635d6b44a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76888781-ca", "ovs_interfaceid": "76888781-ca16-4c3d-99b3-37a902459609", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75176) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 15:44:14 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-4f09b065-2a9a-4100-aeb4-04280ab58272 req-ee41ea12-fde8-4f1d-8819-519b933b0457 service nova] Acquired lock "refresh_cache-6b3646e6-512e-4cd6-b3c1-89438c19c408" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:44:14 user nova-compute[75176]: DEBUG nova.network.neutron [req-4f09b065-2a9a-4100-aeb4-04280ab58272 req-ee41ea12-fde8-4f1d-8819-519b933b0457 service nova] [instance: 6b3646e6-512e-4cd6-b3c1-89438c19c408] Refreshing network info cache for port 76888781-ca16-4c3d-99b3-37a902459609 {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 15:44:15 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-25942222-0fc1-43af-af7a-87581c8372b4 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] [instance: 6b3646e6-512e-4cd6-b3c1-89438c19c408] Start _get_guest_xml network_info=[{"id": "76888781-ca16-4c3d-99b3-37a902459609", "address": "fa:16:3e:42:3e:fc", "network": {"id": "a275bae2-c1ee-445a-adc0-411f99e837e7", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1828472132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39f22e22fdcb403d82a186a635d6b44a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76888781-ca", "ovs_interfaceid": "76888781-ca16-4c3d-99b3-37a902459609", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T15:35:12Z,direct_url=<?>,disk_format='qcow2',id=1f41819e-c93f-4dc7-b253-37a27bbbbc74,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1b91c5d0672c4224a48df2e1f92688e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T15:35:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'size': 0, 'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'image_id': '1f41819e-c93f-4dc7-b253-37a27bbbbc74'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75176) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 15:44:15 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7e673717-559d-47f4-bb90-a69ab3905f6f tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e8a6e1b-4f71-494a-8f44-f9643c658021/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:44:15 user nova-compute[75176]: DEBUG nova.virt.disk.api [None req-7e673717-559d-47f4-bb90-a69ab3905f6f tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] Cannot resize image /opt/stack/data/nova/instances/1e8a6e1b-4f71-494a-8f44-f9643c658021/disk to a smaller size. {{(pid=75176) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 15:44:15 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-7e673717-559d-47f4-bb90-a69ab3905f6f tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] [instance: 1e8a6e1b-4f71-494a-8f44-f9643c658021] Created local disks {{(pid=75176) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 15:44:15 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-7e673717-559d-47f4-bb90-a69ab3905f6f tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] [instance: 1e8a6e1b-4f71-494a-8f44-f9643c658021] Ensure instance console log exists: /opt/stack/data/nova/instances/1e8a6e1b-4f71-494a-8f44-f9643c658021/console.log {{(pid=75176) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 15:44:15 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7e673717-559d-47f4-bb90-a69ab3905f6f tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:44:15 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7e673717-559d-47f4-bb90-a69ab3905f6f tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:44:15 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7e673717-559d-47f4-bb90-a69ab3905f6f tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:44:15 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-25942222-0fc1-43af-af7a-87581c8372b4 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 15:44:15 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-25942222-0fc1-43af-af7a-87581c8372b4 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 15:44:15 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-25942222-0fc1-43af-af7a-87581c8372b4 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75176) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 15:44:15 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-25942222-0fc1-43af-af7a-87581c8372b4 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] CPU controller missing on host. {{(pid=75176) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 15:44:15 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-25942222-0fc1-43af-af7a-87581c8372b4 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75176) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 15:44:15 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-25942222-0fc1-43af-af7a-87581c8372b4 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] CPU controller found on host. {{(pid=75176) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 15:44:15 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-25942222-0fc1-43af-af7a-87581c8372b4 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75176) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 15:44:15 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-25942222-0fc1-43af-af7a-87581c8372b4 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T15:35:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T15:35:12Z,direct_url=<?>,disk_format='qcow2',id=1f41819e-c93f-4dc7-b253-37a27bbbbc74,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1b91c5d0672c4224a48df2e1f92688e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T15:35:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 15:44:15 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-25942222-0fc1-43af-af7a-87581c8372b4 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] Flavor limits 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 15:44:15 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-25942222-0fc1-43af-af7a-87581c8372b4 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] Image limits 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 15:44:15 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-25942222-0fc1-43af-af7a-87581c8372b4 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] Flavor pref 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 15:44:15 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-25942222-0fc1-43af-af7a-87581c8372b4 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] Image pref 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 15:44:15 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-25942222-0fc1-43af-af7a-87581c8372b4 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 15:44:15 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-25942222-0fc1-43af-af7a-87581c8372b4 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 15:44:15 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-25942222-0fc1-43af-af7a-87581c8372b4 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75176) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 15:44:15 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-25942222-0fc1-43af-af7a-87581c8372b4 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] Got 1 possible topologies {{(pid=75176) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 15:44:15 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-25942222-0fc1-43af-af7a-87581c8372b4 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 15:44:15 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-25942222-0fc1-43af-af7a-87581c8372b4 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 15:44:15 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-25942222-0fc1-43af-af7a-87581c8372b4 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T15:44:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-235438377',display_name='tempest-TestVolumeSwap-server-235438377',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-235438377',id=17,image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCEyJwysEBmzzRqrkvN3FKEcGpwd2ScC2KHWvj0QVsDhczFGBxwnOmUEkqlApiI7qJA2dW6Tg2BRrvRY0JE92XifTxXISgYzRogkfF1oOwDbxLUo24NIkmszfWAI8+cW0g==',key_name='tempest-keypair-738518461',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='39f22e22fdcb403d82a186a635d6b44a',ramdisk_id='',reservation_id='r-a91e9r6e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1198917749',owner_user_name='tempest-TestVolumeSwap-1198917749-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T15:44:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='28d7f43fc5d74a188de770183e44834e',uuid=6b3646e6-512e-4cd6-b3c1-89438c19c408,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "76888781-ca16-4c3d-99b3-37a902459609", "address": "fa:16:3e:42:3e:fc", "network": {"id": "a275bae2-c1ee-445a-adc0-411f99e837e7", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1828472132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39f22e22fdcb403d82a186a635d6b44a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76888781-ca", "ovs_interfaceid": "76888781-ca16-4c3d-99b3-37a902459609", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75176) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 15:44:15 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-25942222-0fc1-43af-af7a-87581c8372b4 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] Converting VIF {"id": "76888781-ca16-4c3d-99b3-37a902459609", "address": "fa:16:3e:42:3e:fc", "network": {"id": "a275bae2-c1ee-445a-adc0-411f99e837e7", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1828472132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39f22e22fdcb403d82a186a635d6b44a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76888781-ca", "ovs_interfaceid": "76888781-ca16-4c3d-99b3-37a902459609", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:44:15 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-25942222-0fc1-43af-af7a-87581c8372b4 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:3e:fc,bridge_name='br-int',has_traffic_filtering=True,id=76888781-ca16-4c3d-99b3-37a902459609,network=Network(a275bae2-c1ee-445a-adc0-411f99e837e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76888781-ca') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:44:15 user nova-compute[75176]: DEBUG nova.objects.instance [None req-25942222-0fc1-43af-af7a-87581c8372b4 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] Lazy-loading 'pci_devices' on Instance uuid 6b3646e6-512e-4cd6-b3c1-89438c19c408 {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:44:15 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-25942222-0fc1-43af-af7a-87581c8372b4 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] [instance: 6b3646e6-512e-4cd6-b3c1-89438c19c408] End _get_guest_xml xml=<domain type="kvm">
Nov 28 15:44:15 user nova-compute[75176]:   <uuid>6b3646e6-512e-4cd6-b3c1-89438c19c408</uuid>
Nov 28 15:44:15 user nova-compute[75176]:   <name>instance-00000011</name>
Nov 28 15:44:15 user nova-compute[75176]:   <memory>524288</memory>
Nov 28 15:44:15 user nova-compute[75176]:   <vcpu>1</vcpu>
Nov 28 15:44:15 user nova-compute[75176]:   <metadata>
Nov 28 15:44:15 user nova-compute[75176]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 15:44:15 user nova-compute[75176]:       <nova:package version="0.0.0"/>
Nov 28 15:44:15 user nova-compute[75176]:       <nova:name>tempest-TestVolumeSwap-server-235438377</nova:name>
Nov 28 15:44:15 user nova-compute[75176]:       <nova:creationTime>2023-11-28 15:44:15</nova:creationTime>
Nov 28 15:44:15 user nova-compute[75176]:       <nova:flavor name="m1.tiny">
Nov 28 15:44:15 user nova-compute[75176]:         <nova:memory>512</nova:memory>
Nov 28 15:44:15 user nova-compute[75176]:         <nova:disk>1</nova:disk>
Nov 28 15:44:15 user nova-compute[75176]:         <nova:swap>0</nova:swap>
Nov 28 15:44:15 user nova-compute[75176]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 15:44:15 user nova-compute[75176]:         <nova:vcpus>1</nova:vcpus>
Nov 28 15:44:15 user nova-compute[75176]:       </nova:flavor>
Nov 28 15:44:15 user nova-compute[75176]:       <nova:owner>
Nov 28 15:44:15 user nova-compute[75176]:         <nova:user uuid="28d7f43fc5d74a188de770183e44834e">tempest-TestVolumeSwap-1198917749-project-member</nova:user>
Nov 28 15:44:15 user nova-compute[75176]:         <nova:project uuid="39f22e22fdcb403d82a186a635d6b44a">tempest-TestVolumeSwap-1198917749</nova:project>
Nov 28 15:44:15 user nova-compute[75176]:       </nova:owner>
Nov 28 15:44:15 user nova-compute[75176]:       <nova:root type="image" uuid="1f41819e-c93f-4dc7-b253-37a27bbbbc74"/>
Nov 28 15:44:15 user nova-compute[75176]:       <nova:ports>
Nov 28 15:44:15 user nova-compute[75176]:         <nova:port uuid="76888781-ca16-4c3d-99b3-37a902459609">
Nov 28 15:44:15 user nova-compute[75176]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 28 15:44:15 user nova-compute[75176]:         </nova:port>
Nov 28 15:44:15 user nova-compute[75176]:       </nova:ports>
Nov 28 15:44:15 user nova-compute[75176]:     </nova:instance>
Nov 28 15:44:15 user nova-compute[75176]:   </metadata>
Nov 28 15:44:15 user nova-compute[75176]:   <sysinfo type="smbios">
Nov 28 15:44:15 user nova-compute[75176]:     <system>
Nov 28 15:44:15 user nova-compute[75176]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 15:44:15 user nova-compute[75176]:       <entry name="product">OpenStack Nova</entry>
Nov 28 15:44:15 user nova-compute[75176]:       <entry name="version">0.0.0</entry>
Nov 28 15:44:15 user nova-compute[75176]:       <entry name="serial">6b3646e6-512e-4cd6-b3c1-89438c19c408</entry>
Nov 28 15:44:15 user nova-compute[75176]:       <entry name="uuid">6b3646e6-512e-4cd6-b3c1-89438c19c408</entry>
Nov 28 15:44:15 user nova-compute[75176]:       <entry name="family">Virtual Machine</entry>
Nov 28 15:44:15 user nova-compute[75176]:     </system>
Nov 28 15:44:15 user nova-compute[75176]:   </sysinfo>
Nov 28 15:44:15 user nova-compute[75176]:   <os>
Nov 28 15:44:15 user nova-compute[75176]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 15:44:15 user nova-compute[75176]:     <boot dev="hd"/>
Nov 28 15:44:15 user nova-compute[75176]:     <smbios mode="sysinfo"/>
Nov 28 15:44:15 user nova-compute[75176]:   </os>
Nov 28 15:44:15 user nova-compute[75176]:   <features>
Nov 28 15:44:15 user nova-compute[75176]:     <acpi/>
Nov 28 15:44:15 user nova-compute[75176]:     <apic/>
Nov 28 15:44:15 user nova-compute[75176]:     <vmcoreinfo/>
Nov 28 15:44:15 user nova-compute[75176]:   </features>
Nov 28 15:44:15 user nova-compute[75176]:   <clock offset="utc">
Nov 28 15:44:15 user nova-compute[75176]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 15:44:15 user nova-compute[75176]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 15:44:15 user nova-compute[75176]:     <timer name="hpet" present="no"/>
Nov 28 15:44:15 user nova-compute[75176]:   </clock>
Nov 28 15:44:15 user nova-compute[75176]:   <cpu mode="custom" match="exact">
Nov 28 15:44:15 user nova-compute[75176]:     <model>Nehalem</model>
Nov 28 15:44:15 user nova-compute[75176]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 15:44:15 user nova-compute[75176]:   </cpu>
Nov 28 15:44:15 user nova-compute[75176]:   <devices>
Nov 28 15:44:15 user nova-compute[75176]:     <disk type="file" device="disk">
Nov 28 15:44:15 user nova-compute[75176]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 15:44:15 user nova-compute[75176]:       <source file="/opt/stack/data/nova/instances/6b3646e6-512e-4cd6-b3c1-89438c19c408/disk"/>
Nov 28 15:44:15 user nova-compute[75176]:       <target dev="vda" bus="virtio"/>
Nov 28 15:44:15 user nova-compute[75176]:     </disk>
Nov 28 15:44:15 user nova-compute[75176]:     <interface type="ethernet">
Nov 28 15:44:15 user nova-compute[75176]:       <mac address="fa:16:3e:42:3e:fc"/>
Nov 28 15:44:15 user nova-compute[75176]:       <model type="virtio"/>
Nov 28 15:44:15 user nova-compute[75176]:       <mtu size="1442"/>
Nov 28 15:44:15 user nova-compute[75176]:       <target dev="tap76888781-ca"/>
Nov 28 15:44:15 user nova-compute[75176]:     </interface>
Nov 28 15:44:15 user nova-compute[75176]:     <serial type="pty">
Nov 28 15:44:15 user nova-compute[75176]:       <log file="/opt/stack/data/nova/instances/6b3646e6-512e-4cd6-b3c1-89438c19c408/console.log" append="off"/>
Nov 28 15:44:15 user nova-compute[75176]:     </serial>
Nov 28 15:44:15 user nova-compute[75176]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 15:44:15 user nova-compute[75176]:     <video>
Nov 28 15:44:15 user nova-compute[75176]:       <model type="virtio"/>
Nov 28 15:44:15 user nova-compute[75176]:     </video>
Nov 28 15:44:15 user nova-compute[75176]:     <rng model="virtio">
Nov 28 15:44:15 user nova-compute[75176]:       <backend model="random">/dev/urandom</backend>
Nov 28 15:44:15 user nova-compute[75176]:     </rng>
Nov 28 15:44:15 user nova-compute[75176]:     <controller type="usb" index="0" model="none"/>
Nov 28 15:44:15 user nova-compute[75176]:     <memballoon model="virtio">
Nov 28 15:44:15 user nova-compute[75176]:       <stats period="10"/>
Nov 28 15:44:15 user nova-compute[75176]:     </memballoon>
Nov 28 15:44:15 user nova-compute[75176]:   </devices>
Nov 28 15:44:15 user nova-compute[75176]: </domain>
Nov 28 15:44:15 user nova-compute[75176]:  {{(pid=75176) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 15:44:15 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-25942222-0fc1-43af-af7a-87581c8372b4 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T15:44:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-235438377',display_name='tempest-TestVolumeSwap-server-235438377',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-235438377',id=17,image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCEyJwysEBmzzRqrkvN3FKEcGpwd2ScC2KHWvj0QVsDhczFGBxwnOmUEkqlApiI7qJA2dW6Tg2BRrvRY0JE92XifTxXISgYzRogkfF1oOwDbxLUo24NIkmszfWAI8+cW0g==',key_name='tempest-keypair-738518461',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='39f22e22fdcb403d82a186a635d6b44a',ramdisk_id='',reservation_id='r-a91e9r6e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1198917749',owner_user_name='tempest-TestVolumeSwap-1198917749-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T15:44:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='28d7f43fc5d74a188de770183e44834e',uuid=6b3646e6-512e-4cd6-b3c1-89438c19c408,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "76888781-ca16-4c3d-99b3-37a902459609", "address": "fa:16:3e:42:3e:fc", "network": {"id": "a275bae2-c1ee-445a-adc0-411f99e837e7", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1828472132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39f22e22fdcb403d82a186a635d6b44a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76888781-ca", "ovs_interfaceid": "76888781-ca16-4c3d-99b3-37a902459609", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 15:44:15 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-25942222-0fc1-43af-af7a-87581c8372b4 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] Converting VIF {"id": "76888781-ca16-4c3d-99b3-37a902459609", "address": "fa:16:3e:42:3e:fc", "network": {"id": "a275bae2-c1ee-445a-adc0-411f99e837e7", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1828472132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39f22e22fdcb403d82a186a635d6b44a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76888781-ca", "ovs_interfaceid": "76888781-ca16-4c3d-99b3-37a902459609", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:44:15 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-25942222-0fc1-43af-af7a-87581c8372b4 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:3e:fc,bridge_name='br-int',has_traffic_filtering=True,id=76888781-ca16-4c3d-99b3-37a902459609,network=Network(a275bae2-c1ee-445a-adc0-411f99e837e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76888781-ca') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:44:15 user nova-compute[75176]: DEBUG os_vif [None req-25942222-0fc1-43af-af7a-87581c8372b4 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:3e:fc,bridge_name='br-int',has_traffic_filtering=True,id=76888781-ca16-4c3d-99b3-37a902459609,network=Network(a275bae2-c1ee-445a-adc0-411f99e837e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76888781-ca') {{(pid=75176) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 15:44:15 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:44:15 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:44:15 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 15:44:15 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:44:15 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '40039906-696a-5d25-9f8a-bc1848a41d76', '_type': 'linux-noop'}}, row=False) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:44:15 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:44:15 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:44:15 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:44:15 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap76888781-ca, may_exist=True, interface_attrs={}) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:44:15 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap76888781-ca, col_values=(('qos', UUID('8c906adc-78e4-4a86-ba2f-05ba1619db34')),), if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:44:15 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap76888781-ca, col_values=(('external_ids', {'iface-id': '76888781-ca16-4c3d-99b3-37a902459609', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:42:3e:fc', 'vm-uuid': '6b3646e6-512e-4cd6-b3c1-89438c19c408'}),), if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:44:15 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:44:15 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:44:15 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:44:15 user nova-compute[75176]: INFO os_vif [None req-25942222-0fc1-43af-af7a-87581c8372b4 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:3e:fc,bridge_name='br-int',has_traffic_filtering=True,id=76888781-ca16-4c3d-99b3-37a902459609,network=Network(a275bae2-c1ee-445a-adc0-411f99e837e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76888781-ca')
Nov 28 15:44:15 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-25942222-0fc1-43af-af7a-87581c8372b4 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] No BDM found with device name vda, not building metadata. {{(pid=75176) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 15:44:15 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-25942222-0fc1-43af-af7a-87581c8372b4 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] No VIF found with MAC fa:16:3e:42:3e:fc, not building metadata {{(pid=75176) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 15:44:15 user nova-compute[75176]: DEBUG nova.network.neutron [None req-7e673717-559d-47f4-bb90-a69ab3905f6f tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] [instance: 1e8a6e1b-4f71-494a-8f44-f9643c658021] Successfully created port: 34bebf25-27db-4839-9184-30d78a0ee582 {{(pid=75176) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 15:44:15 user nova-compute[75176]: DEBUG nova.network.neutron [req-4f09b065-2a9a-4100-aeb4-04280ab58272 req-ee41ea12-fde8-4f1d-8819-519b933b0457 service nova] [instance: 6b3646e6-512e-4cd6-b3c1-89438c19c408] Updated VIF entry in instance network info cache for port 76888781-ca16-4c3d-99b3-37a902459609. {{(pid=75176) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 15:44:15 user nova-compute[75176]: DEBUG nova.network.neutron [req-4f09b065-2a9a-4100-aeb4-04280ab58272 req-ee41ea12-fde8-4f1d-8819-519b933b0457 service nova] [instance: 6b3646e6-512e-4cd6-b3c1-89438c19c408] Updating instance_info_cache with network_info: [{"id": "76888781-ca16-4c3d-99b3-37a902459609", "address": "fa:16:3e:42:3e:fc", "network": {"id": "a275bae2-c1ee-445a-adc0-411f99e837e7", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1828472132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39f22e22fdcb403d82a186a635d6b44a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76888781-ca", "ovs_interfaceid": "76888781-ca16-4c3d-99b3-37a902459609", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:44:15 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-4f09b065-2a9a-4100-aeb4-04280ab58272 req-ee41ea12-fde8-4f1d-8819-519b933b0457 service nova] Releasing lock "refresh_cache-6b3646e6-512e-4cd6-b3c1-89438c19c408" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:44:16 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:44:16 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9063e526-3050-4156-8035-907d24fb7945 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] [instance: 402e779e-f507-49f1-a0d8-31ab0d23fbcd] Calling os-brick to attach iSCSI Volume {{(pid=75176) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 15:44:16 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-9063e526-3050-4156-8035-907d24fb7945 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c1b8a00>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a1f5de5d-be7a-443a-9831-791c8667c09b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GBiQZrUT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 15:44:16 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-9063e526-3050-4156-8035-907d24fb7945 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 15:44:16 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-9063e526-3050-4156-8035-907d24fb7945 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 15:44:16 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-9063e526-3050-4156-8035-907d24fb7945 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 15:44:16 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-9063e526-3050-4156-8035-907d24fb7945 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 15:44:16 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-9063e526-3050-4156-8035-907d24fb7945 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a1f5de5d-be7a-443a-9831-791c8667c09b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 15:44:16 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-9063e526-3050-4156-8035-907d24fb7945 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a1f5de5d-be7a-443a-9831-791c8667c09b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.004s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 15:44:16 user nova-compute[75176]: INFO os_brick.initiator.connectors.iscsi [None req-9063e526-3050-4156-8035-907d24fb7945 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 15:44:16 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1f5de5d-be7a-443a-9831-791c8667c09b -p 172.16.0.220:3260 {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:44:16 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1f5de5d-be7a-443a-9831-791c8667c09b -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:44:16 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[4430a884-ff57-48e4-9cee-c0525ec13a90]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:44:16 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-9063e526-3050-4156-8035-907d24fb7945 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 15:44:16 user nova-compute[75176]:  {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:44:16 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1f5de5d-be7a-443a-9831-791c8667c09b -p 172.16.0.220:3260 --interface default --op new {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:44:16 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1f5de5d-be7a-443a-9831-791c8667c09b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:44:16 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ad40db8-157e-42ca-a730-f65f3f408b28]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a1f5de5d-be7a-443a-9831-791c8667c09b] added\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:44:16 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-9063e526-3050-4156-8035-907d24fb7945 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a1f5de5d-be7a-443a-9831-791c8667c09b] added
Nov 28 15:44:16 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:44:16 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1f5de5d-be7a-443a-9831-791c8667c09b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:44:16 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1f5de5d-be7a-443a-9831-791c8667c09b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.034s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:44:16 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d760318-1e12-4ae2-8145-899a9f56200c]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:44:16 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-9063e526-3050-4156-8035-907d24fb7945 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:44:16 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1f5de5d-be7a-443a-9831-791c8667c09b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:44:16 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1f5de5d-be7a-443a-9831-791c8667c09b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:44:16 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cf1e115-f232-4adc-a1d7-ed05891a1ec2]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:44:16 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-9063e526-3050-4156-8035-907d24fb7945 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:44:16 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1f5de5d-be7a-443a-9831-791c8667c09b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GBiQZrUT {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:44:16 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1f5de5d-be7a-443a-9831-791c8667c09b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GBiQZrUT" returned: 0 in 0.024s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:44:16 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[9579d85f-0fc1-4b0d-9dcb-948fa399f95f]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:44:16 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-9063e526-3050-4156-8035-907d24fb7945 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GBiQZrUT'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:44:16 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1f5de5d-be7a-443a-9831-791c8667c09b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:44:16 user nova-compute[75176]: DEBUG nova.network.neutron [None req-7e673717-559d-47f4-bb90-a69ab3905f6f tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] [instance: 1e8a6e1b-4f71-494a-8f44-f9643c658021] Successfully updated port: 34bebf25-27db-4839-9184-30d78a0ee582 {{(pid=75176) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 15:44:16 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1f5de5d-be7a-443a-9831-791c8667c09b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:44:16 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[36216b6b-15e0-4220-a0b4-508fcd4c21cb]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:44:16 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-9063e526-3050-4156-8035-907d24fb7945 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:44:16 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:44:16 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7e673717-559d-47f4-bb90-a69ab3905f6f tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] Acquiring lock "refresh_cache-1e8a6e1b-4f71-494a-8f44-f9643c658021" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:44:16 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7e673717-559d-47f4-bb90-a69ab3905f6f tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] Acquired lock "refresh_cache-1e8a6e1b-4f71-494a-8f44-f9643c658021" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:44:16 user nova-compute[75176]: DEBUG nova.network.neutron [None req-7e673717-559d-47f4-bb90-a69ab3905f6f tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] [instance: 1e8a6e1b-4f71-494a-8f44-f9643c658021] Building network info cache for instance {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 15:44:16 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:44:16 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8b0cd32-d334-4f7e-a7c7-233283135517]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bb22dca-8491-42ef-815f-7b0c0ca4be5a (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea228e4f-f9b2-477a-a75f-542bc9d47ec4 (non-flash)\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:44:16 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-9063e526-3050-4156-8035-907d24fb7945 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bb22dca-8491-42ef-815f-7b0c0ca4be5a (non-flash)
Nov 28 15:44:16 user nova-compute[75176]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d (non-flash)
Nov 28 15:44:16 user nova-compute[75176]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea228e4f-f9b2-477a-a75f-542bc9d47ec4 (non-flash)
Nov 28 15:44:16 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:44:16 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-9063e526-3050-4156-8035-907d24fb7945 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bb22dca-8491-42ef-815f-7b0c0ca4be5a (non-flash)
Nov 28 15:44:16 user nova-compute[75176]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d (non-flash)
Nov 28 15:44:16 user nova-compute[75176]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea228e4f-f9b2-477a-a75f-542bc9d47ec4 (non-flash)
Nov 28 15:44:16 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 15:44:16 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1f5de5d-be7a-443a-9831-791c8667c09b -p 172.16.0.220:3260 --login {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:44:16 user nova-compute[75176]: DEBUG nova.compute.manager [req-ee40fc26-8a50-498d-9350-fd7632481e3f req-d8fed575-15e6-4134-889e-d654896551de service nova] [instance: 1e8a6e1b-4f71-494a-8f44-f9643c658021] Received event network-changed-34bebf25-27db-4839-9184-30d78a0ee582 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:44:16 user nova-compute[75176]: DEBUG nova.compute.manager [req-ee40fc26-8a50-498d-9350-fd7632481e3f req-d8fed575-15e6-4134-889e-d654896551de service nova] [instance: 1e8a6e1b-4f71-494a-8f44-f9643c658021] Refreshing instance network info cache due to event network-changed-34bebf25-27db-4839-9184-30d78a0ee582. {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 15:44:16 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-ee40fc26-8a50-498d-9350-fd7632481e3f req-d8fed575-15e6-4134-889e-d654896551de service nova] Acquiring lock "refresh_cache-1e8a6e1b-4f71-494a-8f44-f9643c658021" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:44:16 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-cb1cffce-7db7-4a1a-986b-03c7df747c91 tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] Acquiring lock "9dcbbf59-600f-4309-abd3-e8e4c7731c0b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:44:16 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-cb1cffce-7db7-4a1a-986b-03c7df747c91 tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] Lock "9dcbbf59-600f-4309-abd3-e8e4c7731c0b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:44:16 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-cb1cffce-7db7-4a1a-986b-03c7df747c91 tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] Acquiring lock "9dcbbf59-600f-4309-abd3-e8e4c7731c0b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:44:16 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-cb1cffce-7db7-4a1a-986b-03c7df747c91 tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] Lock "9dcbbf59-600f-4309-abd3-e8e4c7731c0b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:44:16 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-cb1cffce-7db7-4a1a-986b-03c7df747c91 tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] Lock "9dcbbf59-600f-4309-abd3-e8e4c7731c0b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:44:16 user nova-compute[75176]: DEBUG nova.network.neutron [None req-7e673717-559d-47f4-bb90-a69ab3905f6f tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] [instance: 1e8a6e1b-4f71-494a-8f44-f9643c658021] Instance cache missing network info. {{(pid=75176) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 15:44:16 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1f5de5d-be7a-443a-9831-791c8667c09b -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:44:16 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[8447f9b9-ad02-45f5-a41d-032c32586237]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a1f5de5d-be7a-443a-9831-791c8667c09b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a1f5de5d-be7a-443a-9831-791c8667c09b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:44:16 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-9063e526-3050-4156-8035-907d24fb7945 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a1f5de5d-be7a-443a-9831-791c8667c09b, portal: 172.16.0.220,3260]
Nov 28 15:44:16 user nova-compute[75176]: Login to [iface: default, target: iqn.2010-10.org.openstack:a1f5de5d-be7a-443a-9831-791c8667c09b, portal: 172.16.0.220,3260] successful.
Nov 28 15:44:16 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:44:16 user nova-compute[75176]: INFO nova.compute.manager [None req-cb1cffce-7db7-4a1a-986b-03c7df747c91 tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] [instance: 9dcbbf59-600f-4309-abd3-e8e4c7731c0b] Terminating instance
Nov 28 15:44:16 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1f5de5d-be7a-443a-9831-791c8667c09b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:44:16 user nova-compute[75176]: DEBUG nova.compute.manager [None req-cb1cffce-7db7-4a1a-986b-03c7df747c91 tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] [instance: 9dcbbf59-600f-4309-abd3-e8e4c7731c0b] Start destroying the instance on the hypervisor. {{(pid=75176) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 15:44:16 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1f5de5d-be7a-443a-9831-791c8667c09b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:44:16 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[af9b4c2c-b034-499f-8568-038c0f52d7b9]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:44:16 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-9063e526-3050-4156-8035-907d24fb7945 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:44:16 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:44:16 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:44:16 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c606f5b-81cc-4c4b-8a30-b08e4cb3f696]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bb22dca-8491-42ef-815f-7b0c0ca4be5a (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea228e4f-f9b2-477a-a75f-542bc9d47ec4 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1f5de5d-be7a-443a-9831-791c8667c09b (non-flash)\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:44:16 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-9063e526-3050-4156-8035-907d24fb7945 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bb22dca-8491-42ef-815f-7b0c0ca4be5a (non-flash)
Nov 28 15:44:16 user nova-compute[75176]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d (non-flash)
Nov 28 15:44:16 user nova-compute[75176]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea228e4f-f9b2-477a-a75f-542bc9d47ec4 (non-flash)
Nov 28 15:44:16 user nova-compute[75176]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1f5de5d-be7a-443a-9831-791c8667c09b (non-flash)
Nov 28 15:44:16 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:44:16 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-9063e526-3050-4156-8035-907d24fb7945 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bb22dca-8491-42ef-815f-7b0c0ca4be5a (non-flash)
Nov 28 15:44:16 user nova-compute[75176]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d (non-flash)
Nov 28 15:44:16 user nova-compute[75176]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea228e4f-f9b2-477a-a75f-542bc9d47ec4 (non-flash)
Nov 28 15:44:16 user nova-compute[75176]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1f5de5d-be7a-443a-9831-791c8667c09b (non-flash)
Nov 28 15:44:16 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 15:44:16 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-9063e526-3050-4156-8035-907d24fb7945 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a1f5de5d-be7a-443a-9831-791c8667c09b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.364s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 15:44:16 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-9063e526-3050-4156-8035-907d24fb7945 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Connected to 172.16.0.220:3260 {{(pid=75176) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 15:44:16 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-9063e526-3050-4156-8035-907d24fb7945 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] HCTL ('35', '-', '-', 0) found on session 21 with lun 0 {{(pid=75176) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 15:44:16 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-9063e526-3050-4156-8035-907d24fb7945 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75176) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 15:44:16 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:44:16 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.027s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:44:16 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[69a4b213-db29-4194-a00d-c5b7c52c8f56]: (4, ('- - 0', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:44:16 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-9063e526-3050-4156-8035-907d24fb7945 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Searching for a device in session 21 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75176) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 15:44:16 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-9063e526-3050-4156-8035-907d24fb7945 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:a1f5de5d-be7a-443a-9831-791c8667c09b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GBiQZrUT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75176) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 15:44:16 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:44:16 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:44:16 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:44:16 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:44:16 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:44:17 user nova-compute[75176]: DEBUG nova.compute.manager [req-2f53bcb5-49ee-4677-a4ed-2dcaf76b1737 req-95bb8569-c984-4908-87da-8047ecacd6dc service nova] [instance: 9dcbbf59-600f-4309-abd3-e8e4c7731c0b] Received event network-vif-unplugged-94a78e0e-5cb2-4b37-bce6-f529a646fe3a {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:44:17 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-2f53bcb5-49ee-4677-a4ed-2dcaf76b1737 req-95bb8569-c984-4908-87da-8047ecacd6dc service nova] Acquiring lock "9dcbbf59-600f-4309-abd3-e8e4c7731c0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:44:17 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-2f53bcb5-49ee-4677-a4ed-2dcaf76b1737 req-95bb8569-c984-4908-87da-8047ecacd6dc service nova] Lock "9dcbbf59-600f-4309-abd3-e8e4c7731c0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:44:17 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-2f53bcb5-49ee-4677-a4ed-2dcaf76b1737 req-95bb8569-c984-4908-87da-8047ecacd6dc service nova] Lock "9dcbbf59-600f-4309-abd3-e8e4c7731c0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:44:17 user nova-compute[75176]: DEBUG nova.compute.manager [req-2f53bcb5-49ee-4677-a4ed-2dcaf76b1737 req-95bb8569-c984-4908-87da-8047ecacd6dc service nova] [instance: 9dcbbf59-600f-4309-abd3-e8e4c7731c0b] No waiting events found dispatching network-vif-unplugged-94a78e0e-5cb2-4b37-bce6-f529a646fe3a {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:44:17 user nova-compute[75176]: DEBUG nova.compute.manager [req-2f53bcb5-49ee-4677-a4ed-2dcaf76b1737 req-95bb8569-c984-4908-87da-8047ecacd6dc service nova] [instance: 9dcbbf59-600f-4309-abd3-e8e4c7731c0b] Received event network-vif-unplugged-94a78e0e-5cb2-4b37-bce6-f529a646fe3a for instance with task_state deleting. {{(pid=75176) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 15:44:17 user nova-compute[75176]: DEBUG nova.network.neutron [None req-7e673717-559d-47f4-bb90-a69ab3905f6f tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] [instance: 1e8a6e1b-4f71-494a-8f44-f9643c658021] Updating instance_info_cache with network_info: [{"id": "34bebf25-27db-4839-9184-30d78a0ee582", "address": "fa:16:3e:90:a9:7c", "network": {"id": "51143aa0-7498-4dfc-8425-9046ee5aa4fc", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-351796020-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13ce3926a76541f7a32ada5070b10be1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34bebf25-27", "ovs_interfaceid": "34bebf25-27db-4839-9184-30d78a0ee582", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:44:17 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7e673717-559d-47f4-bb90-a69ab3905f6f tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] Releasing lock "refresh_cache-1e8a6e1b-4f71-494a-8f44-f9643c658021" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:44:17 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7e673717-559d-47f4-bb90-a69ab3905f6f tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] [instance: 1e8a6e1b-4f71-494a-8f44-f9643c658021] Instance network_info: |[{"id": "34bebf25-27db-4839-9184-30d78a0ee582", "address": "fa:16:3e:90:a9:7c", "network": {"id": "51143aa0-7498-4dfc-8425-9046ee5aa4fc", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-351796020-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13ce3926a76541f7a32ada5070b10be1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34bebf25-27", "ovs_interfaceid": "34bebf25-27db-4839-9184-30d78a0ee582", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75176) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 15:44:17 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-ee40fc26-8a50-498d-9350-fd7632481e3f req-d8fed575-15e6-4134-889e-d654896551de service nova] Acquired lock "refresh_cache-1e8a6e1b-4f71-494a-8f44-f9643c658021" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:44:17 user nova-compute[75176]: DEBUG nova.network.neutron [req-ee40fc26-8a50-498d-9350-fd7632481e3f req-d8fed575-15e6-4134-889e-d654896551de service nova] [instance: 1e8a6e1b-4f71-494a-8f44-f9643c658021] Refreshing network info cache for port 34bebf25-27db-4839-9184-30d78a0ee582 {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 15:44:17 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-7e673717-559d-47f4-bb90-a69ab3905f6f tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] [instance: 1e8a6e1b-4f71-494a-8f44-f9643c658021] Start _get_guest_xml network_info=[{"id": "34bebf25-27db-4839-9184-30d78a0ee582", "address": "fa:16:3e:90:a9:7c", "network": {"id": "51143aa0-7498-4dfc-8425-9046ee5aa4fc", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-351796020-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13ce3926a76541f7a32ada5070b10be1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34bebf25-27", "ovs_interfaceid": "34bebf25-27db-4839-9184-30d78a0ee582", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T15:35:12Z,direct_url=<?>,disk_format='qcow2',id=1f41819e-c93f-4dc7-b253-37a27bbbbc74,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1b91c5d0672c4224a48df2e1f92688e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T15:35:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'size': 0, 'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'image_id': '1f41819e-c93f-4dc7-b253-37a27bbbbc74'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75176) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 15:44:17 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-7e673717-559d-47f4-bb90-a69ab3905f6f tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 15:44:17 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-7e673717-559d-47f4-bb90-a69ab3905f6f tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 15:44:17 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-7e673717-559d-47f4-bb90-a69ab3905f6f tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75176) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 15:44:17 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-7e673717-559d-47f4-bb90-a69ab3905f6f tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] CPU controller missing on host. {{(pid=75176) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 15:44:17 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-7e673717-559d-47f4-bb90-a69ab3905f6f tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75176) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 15:44:17 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-7e673717-559d-47f4-bb90-a69ab3905f6f tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] CPU controller found on host. {{(pid=75176) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 15:44:17 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-7e673717-559d-47f4-bb90-a69ab3905f6f tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75176) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 15:44:17 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-7e673717-559d-47f4-bb90-a69ab3905f6f tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T15:35:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T15:35:12Z,direct_url=<?>,disk_format='qcow2',id=1f41819e-c93f-4dc7-b253-37a27bbbbc74,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1b91c5d0672c4224a48df2e1f92688e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T15:35:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 15:44:17 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-7e673717-559d-47f4-bb90-a69ab3905f6f tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] Flavor limits 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 15:44:17 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-7e673717-559d-47f4-bb90-a69ab3905f6f tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] Image limits 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 15:44:17 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-7e673717-559d-47f4-bb90-a69ab3905f6f tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] Flavor pref 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 15:44:17 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-7e673717-559d-47f4-bb90-a69ab3905f6f tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] Image pref 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 15:44:17 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-7e673717-559d-47f4-bb90-a69ab3905f6f tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 15:44:17 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-7e673717-559d-47f4-bb90-a69ab3905f6f tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 15:44:17 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-7e673717-559d-47f4-bb90-a69ab3905f6f tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75176) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 15:44:17 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-7e673717-559d-47f4-bb90-a69ab3905f6f tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] Got 1 possible topologies {{(pid=75176) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 15:44:17 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-7e673717-559d-47f4-bb90-a69ab3905f6f tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 15:44:17 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-7e673717-559d-47f4-bb90-a69ab3905f6f tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 15:44:17 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-7e673717-559d-47f4-bb90-a69ab3905f6f tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T15:44:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-16302077',display_name='tempest-ServersNegativeTestJSON-server-16302077',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-16302077',id=18,image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='13ce3926a76541f7a32ada5070b10be1',ramdisk_id='',reservation_id='r-po4ou88g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-417711709',owner_user_name='tempest-ServersNegativeTestJSON-417711709-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T15:44:14Z,user_data=None,user_id='8fdbce92609048169853a846340eb9fe',uuid=1e8a6e1b-4f71-494a-8f44-f9643c658021,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "34bebf25-27db-4839-9184-30d78a0ee582", "address": "fa:16:3e:90:a9:7c", "network": {"id": "51143aa0-7498-4dfc-8425-9046ee5aa4fc", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-351796020-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13ce3926a76541f7a32ada5070b10be1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34bebf25-27", "ovs_interfaceid": "34bebf25-27db-4839-9184-30d78a0ee582", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75176) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 15:44:17 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-7e673717-559d-47f4-bb90-a69ab3905f6f tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] Converting VIF {"id": "34bebf25-27db-4839-9184-30d78a0ee582", "address": "fa:16:3e:90:a9:7c", "network": {"id": "51143aa0-7498-4dfc-8425-9046ee5aa4fc", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-351796020-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13ce3926a76541f7a32ada5070b10be1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34bebf25-27", "ovs_interfaceid": "34bebf25-27db-4839-9184-30d78a0ee582", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:44:17 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-7e673717-559d-47f4-bb90-a69ab3905f6f tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:90:a9:7c,bridge_name='br-int',has_traffic_filtering=True,id=34bebf25-27db-4839-9184-30d78a0ee582,network=Network(51143aa0-7498-4dfc-8425-9046ee5aa4fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34bebf25-27') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:44:17 user nova-compute[75176]: DEBUG nova.objects.instance [None req-7e673717-559d-47f4-bb90-a69ab3905f6f tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] Lazy-loading 'pci_devices' on Instance uuid 1e8a6e1b-4f71-494a-8f44-f9643c658021 {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:44:17 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-7e673717-559d-47f4-bb90-a69ab3905f6f tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] [instance: 1e8a6e1b-4f71-494a-8f44-f9643c658021] End _get_guest_xml xml=<domain type="kvm">
Nov 28 15:44:17 user nova-compute[75176]:   <uuid>1e8a6e1b-4f71-494a-8f44-f9643c658021</uuid>
Nov 28 15:44:17 user nova-compute[75176]:   <name>instance-00000012</name>
Nov 28 15:44:17 user nova-compute[75176]:   <memory>524288</memory>
Nov 28 15:44:17 user nova-compute[75176]:   <vcpu>1</vcpu>
Nov 28 15:44:17 user nova-compute[75176]:   <metadata>
Nov 28 15:44:17 user nova-compute[75176]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 15:44:17 user nova-compute[75176]:       <nova:package version="0.0.0"/>
Nov 28 15:44:17 user nova-compute[75176]:       <nova:name>tempest-ServersNegativeTestJSON-server-16302077</nova:name>
Nov 28 15:44:17 user nova-compute[75176]:       <nova:creationTime>2023-11-28 15:44:17</nova:creationTime>
Nov 28 15:44:17 user nova-compute[75176]:       <nova:flavor name="m1.tiny">
Nov 28 15:44:17 user nova-compute[75176]:         <nova:memory>512</nova:memory>
Nov 28 15:44:17 user nova-compute[75176]:         <nova:disk>1</nova:disk>
Nov 28 15:44:17 user nova-compute[75176]:         <nova:swap>0</nova:swap>
Nov 28 15:44:17 user nova-compute[75176]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 15:44:17 user nova-compute[75176]:         <nova:vcpus>1</nova:vcpus>
Nov 28 15:44:17 user nova-compute[75176]:       </nova:flavor>
Nov 28 15:44:17 user nova-compute[75176]:       <nova:owner>
Nov 28 15:44:17 user nova-compute[75176]:         <nova:user uuid="8fdbce92609048169853a846340eb9fe">tempest-ServersNegativeTestJSON-417711709-project-member</nova:user>
Nov 28 15:44:17 user nova-compute[75176]:         <nova:project uuid="13ce3926a76541f7a32ada5070b10be1">tempest-ServersNegativeTestJSON-417711709</nova:project>
Nov 28 15:44:17 user nova-compute[75176]:       </nova:owner>
Nov 28 15:44:17 user nova-compute[75176]:       <nova:root type="image" uuid="1f41819e-c93f-4dc7-b253-37a27bbbbc74"/>
Nov 28 15:44:17 user nova-compute[75176]:       <nova:ports>
Nov 28 15:44:17 user nova-compute[75176]:         <nova:port uuid="34bebf25-27db-4839-9184-30d78a0ee582">
Nov 28 15:44:17 user nova-compute[75176]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 28 15:44:17 user nova-compute[75176]:         </nova:port>
Nov 28 15:44:17 user nova-compute[75176]:       </nova:ports>
Nov 28 15:44:17 user nova-compute[75176]:     </nova:instance>
Nov 28 15:44:17 user nova-compute[75176]:   </metadata>
Nov 28 15:44:17 user nova-compute[75176]:   <sysinfo type="smbios">
Nov 28 15:44:17 user nova-compute[75176]:     <system>
Nov 28 15:44:17 user nova-compute[75176]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 15:44:17 user nova-compute[75176]:       <entry name="product">OpenStack Nova</entry>
Nov 28 15:44:17 user nova-compute[75176]:       <entry name="version">0.0.0</entry>
Nov 28 15:44:17 user nova-compute[75176]:       <entry name="serial">1e8a6e1b-4f71-494a-8f44-f9643c658021</entry>
Nov 28 15:44:17 user nova-compute[75176]:       <entry name="uuid">1e8a6e1b-4f71-494a-8f44-f9643c658021</entry>
Nov 28 15:44:17 user nova-compute[75176]:       <entry name="family">Virtual Machine</entry>
Nov 28 15:44:17 user nova-compute[75176]:     </system>
Nov 28 15:44:17 user nova-compute[75176]:   </sysinfo>
Nov 28 15:44:17 user nova-compute[75176]:   <os>
Nov 28 15:44:17 user nova-compute[75176]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 15:44:17 user nova-compute[75176]:     <boot dev="hd"/>
Nov 28 15:44:17 user nova-compute[75176]:     <smbios mode="sysinfo"/>
Nov 28 15:44:17 user nova-compute[75176]:   </os>
Nov 28 15:44:17 user nova-compute[75176]:   <features>
Nov 28 15:44:17 user nova-compute[75176]:     <acpi/>
Nov 28 15:44:17 user nova-compute[75176]:     <apic/>
Nov 28 15:44:17 user nova-compute[75176]:     <vmcoreinfo/>
Nov 28 15:44:17 user nova-compute[75176]:   </features>
Nov 28 15:44:17 user nova-compute[75176]:   <clock offset="utc">
Nov 28 15:44:17 user nova-compute[75176]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 15:44:17 user nova-compute[75176]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 15:44:17 user nova-compute[75176]:     <timer name="hpet" present="no"/>
Nov 28 15:44:17 user nova-compute[75176]:   </clock>
Nov 28 15:44:17 user nova-compute[75176]:   <cpu mode="custom" match="exact">
Nov 28 15:44:17 user nova-compute[75176]:     <model>Nehalem</model>
Nov 28 15:44:17 user nova-compute[75176]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 15:44:17 user nova-compute[75176]:   </cpu>
Nov 28 15:44:17 user nova-compute[75176]:   <devices>
Nov 28 15:44:17 user nova-compute[75176]:     <disk type="file" device="disk">
Nov 28 15:44:17 user nova-compute[75176]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 15:44:17 user nova-compute[75176]:       <source file="/opt/stack/data/nova/instances/1e8a6e1b-4f71-494a-8f44-f9643c658021/disk"/>
Nov 28 15:44:17 user nova-compute[75176]:       <target dev="vda" bus="virtio"/>
Nov 28 15:44:17 user nova-compute[75176]:     </disk>
Nov 28 15:44:17 user nova-compute[75176]:     <interface type="ethernet">
Nov 28 15:44:17 user nova-compute[75176]:       <mac address="fa:16:3e:90:a9:7c"/>
Nov 28 15:44:17 user nova-compute[75176]:       <model type="virtio"/>
Nov 28 15:44:17 user nova-compute[75176]:       <mtu size="1442"/>
Nov 28 15:44:17 user nova-compute[75176]:       <target dev="tap34bebf25-27"/>
Nov 28 15:44:17 user nova-compute[75176]:     </interface>
Nov 28 15:44:17 user nova-compute[75176]:     <serial type="pty">
Nov 28 15:44:17 user nova-compute[75176]:       <log file="/opt/stack/data/nova/instances/1e8a6e1b-4f71-494a-8f44-f9643c658021/console.log" append="off"/>
Nov 28 15:44:17 user nova-compute[75176]:     </serial>
Nov 28 15:44:17 user nova-compute[75176]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 15:44:17 user nova-compute[75176]:     <video>
Nov 28 15:44:17 user nova-compute[75176]:       <model type="virtio"/>
Nov 28 15:44:17 user nova-compute[75176]:     </video>
Nov 28 15:44:17 user nova-compute[75176]:     <rng model="virtio">
Nov 28 15:44:17 user nova-compute[75176]:       <backend model="random">/dev/urandom</backend>
Nov 28 15:44:17 user nova-compute[75176]:     </rng>
Nov 28 15:44:17 user nova-compute[75176]:     <controller type="usb" index="0" model="none"/>
Nov 28 15:44:17 user nova-compute[75176]:     <memballoon model="virtio">
Nov 28 15:44:17 user nova-compute[75176]:       <stats period="10"/>
Nov 28 15:44:17 user nova-compute[75176]:     </memballoon>
Nov 28 15:44:17 user nova-compute[75176]:   </devices>
Nov 28 15:44:17 user nova-compute[75176]: </domain>
Nov 28 15:44:17 user nova-compute[75176]:  {{(pid=75176) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 15:44:17 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-7e673717-559d-47f4-bb90-a69ab3905f6f tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T15:44:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-16302077',display_name='tempest-ServersNegativeTestJSON-server-16302077',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-16302077',id=18,image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='13ce3926a76541f7a32ada5070b10be1',ramdisk_id='',reservation_id='r-po4ou88g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-417711709',owner_user_name='tempest-ServersNegativeTestJSON-417711709-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T15:44:14Z,user_data=None,user_id='8fdbce92609048169853a846340eb9fe',uuid=1e8a6e1b-4f71-494a-8f44-f9643c658021,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "34bebf25-27db-4839-9184-30d78a0ee582", "address": "fa:16:3e:90:a9:7c", "network": {"id": "51143aa0-7498-4dfc-8425-9046ee5aa4fc", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-351796020-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13ce3926a76541f7a32ada5070b10be1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34bebf25-27", "ovs_interfaceid": "34bebf25-27db-4839-9184-30d78a0ee582", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 15:44:17 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-7e673717-559d-47f4-bb90-a69ab3905f6f tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] Converting VIF {"id": "34bebf25-27db-4839-9184-30d78a0ee582", "address": "fa:16:3e:90:a9:7c", "network": {"id": "51143aa0-7498-4dfc-8425-9046ee5aa4fc", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-351796020-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13ce3926a76541f7a32ada5070b10be1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34bebf25-27", "ovs_interfaceid": "34bebf25-27db-4839-9184-30d78a0ee582", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:44:17 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-7e673717-559d-47f4-bb90-a69ab3905f6f tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:90:a9:7c,bridge_name='br-int',has_traffic_filtering=True,id=34bebf25-27db-4839-9184-30d78a0ee582,network=Network(51143aa0-7498-4dfc-8425-9046ee5aa4fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34bebf25-27') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:44:17 user nova-compute[75176]: DEBUG os_vif [None req-7e673717-559d-47f4-bb90-a69ab3905f6f tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:a9:7c,bridge_name='br-int',has_traffic_filtering=True,id=34bebf25-27db-4839-9184-30d78a0ee582,network=Network(51143aa0-7498-4dfc-8425-9046ee5aa4fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34bebf25-27') {{(pid=75176) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 15:44:17 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:44:17 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:44:17 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 15:44:17 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:44:17 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5d5b2b5c-1a7e-59c4-a10d-320a3a085c90', '_type': 'linux-noop'}}, row=False) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:44:17 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:44:17 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:44:17 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap34bebf25-27, may_exist=True, interface_attrs={}) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:44:17 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap34bebf25-27, col_values=(('qos', UUID('8c049b59-06a1-49df-96ad-90c2c1da2733')),), if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:44:17 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap34bebf25-27, col_values=(('external_ids', {'iface-id': '34bebf25-27db-4839-9184-30d78a0ee582', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:90:a9:7c', 'vm-uuid': '1e8a6e1b-4f71-494a-8f44-f9643c658021'}),), if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:44:17 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:44:17 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:44:17 user nova-compute[75176]: INFO os_vif [None req-7e673717-559d-47f4-bb90-a69ab3905f6f tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:a9:7c,bridge_name='br-int',has_traffic_filtering=True,id=34bebf25-27db-4839-9184-30d78a0ee582,network=Network(51143aa0-7498-4dfc-8425-9046ee5aa4fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34bebf25-27')
Nov 28 15:44:17 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-7e673717-559d-47f4-bb90-a69ab3905f6f tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] No BDM found with device name vda, not building metadata. {{(pid=75176) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 15:44:17 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-7e673717-559d-47f4-bb90-a69ab3905f6f tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] No VIF found with MAC fa:16:3e:90:a9:7c, not building metadata {{(pid=75176) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 15:44:17 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:44:17 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:44:17 user nova-compute[75176]: DEBUG nova.network.neutron [req-ee40fc26-8a50-498d-9350-fd7632481e3f req-d8fed575-15e6-4134-889e-d654896551de service nova] [instance: 1e8a6e1b-4f71-494a-8f44-f9643c658021] Updated VIF entry in instance network info cache for port 34bebf25-27db-4839-9184-30d78a0ee582. {{(pid=75176) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 15:44:17 user nova-compute[75176]: DEBUG nova.network.neutron [req-ee40fc26-8a50-498d-9350-fd7632481e3f req-d8fed575-15e6-4134-889e-d654896551de service nova] [instance: 1e8a6e1b-4f71-494a-8f44-f9643c658021] Updating instance_info_cache with network_info: [{"id": "34bebf25-27db-4839-9184-30d78a0ee582", "address": "fa:16:3e:90:a9:7c", "network": {"id": "51143aa0-7498-4dfc-8425-9046ee5aa4fc", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-351796020-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13ce3926a76541f7a32ada5070b10be1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34bebf25-27", "ovs_interfaceid": "34bebf25-27db-4839-9184-30d78a0ee582", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:44:17 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-ee40fc26-8a50-498d-9350-fd7632481e3f req-d8fed575-15e6-4134-889e-d654896551de service nova] Releasing lock "refresh_cache-1e8a6e1b-4f71-494a-8f44-f9643c658021" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:44:17 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-9063e526-3050-4156-8035-907d24fb7945 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.419s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 15:44:17 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-9063e526-3050-4156-8035-907d24fb7945 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] <== connect_volume: return (1421ms) {'type': 'block', 'scsi_wwn': '26636663661636162', 'path': '/dev/sdd'} {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 15:44:17 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9063e526-3050-4156-8035-907d24fb7945 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] [instance: 402e779e-f507-49f1-a0d8-31ab0d23fbcd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26636663661636162', 'path': '/dev/sdd'} {{(pid=75176) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 15:44:17 user nova-compute[75176]: DEBUG nova.objects.instance [None req-9063e526-3050-4156-8035-907d24fb7945 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Lazy-loading 'flavor' on Instance uuid 402e779e-f507-49f1-a0d8-31ab0d23fbcd {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:44:17 user nova-compute[75176]: DEBUG nova.virt.libvirt.guest [None req-9063e526-3050-4156-8035-907d24fb7945 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 15:44:17 user nova-compute[75176]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 15:44:17 user nova-compute[75176]:   <source dev="/dev/sdd"/>
Nov 28 15:44:17 user nova-compute[75176]:   <target dev="vdb" bus="virtio"/>
Nov 28 15:44:17 user nova-compute[75176]:   <serial>a1f5de5d-be7a-443a-9831-791c8667c09b</serial>
Nov 28 15:44:17 user nova-compute[75176]: </disk>
Nov 28 15:44:17 user nova-compute[75176]:  {{(pid=75176) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 15:44:18 user nova-compute[75176]: INFO nova.virt.libvirt.driver [-] [instance: 9dcbbf59-600f-4309-abd3-e8e4c7731c0b] Instance destroyed successfully.
Nov 28 15:44:18 user nova-compute[75176]: DEBUG nova.objects.instance [None req-cb1cffce-7db7-4a1a-986b-03c7df747c91 tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] Lazy-loading 'resources' on Instance uuid 9dcbbf59-600f-4309-abd3-e8e4c7731c0b {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:44:18 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-cb1cffce-7db7-4a1a-986b-03c7df747c91 tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T15:42:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-910110943',display_name='tempest-VolumesAdminNegativeTest-server-910110943',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-910110943',id=14,image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-28T15:42:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c0518c3ca77e4ecebb6ea8fbf6e60219',ramdisk_id='',reservation_id='r-z8305m5w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1622644648',owner_user_name='tempest-VolumesAdminNegativeTest-1622644648-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T15:42:24Z,user_data=None,user_id='b339a055aaf24d25946cc16369bddc2f',uuid=9dcbbf59-600f-4309-abd3-e8e4c7731c0b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "94a78e0e-5cb2-4b37-bce6-f529a646fe3a", "address": "fa:16:3e:4b:5e:3e", "network": {"id": "1c357ee9-ff80-4a4b-9fd5-f2f348b36acc", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1869945166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0518c3ca77e4ecebb6ea8fbf6e60219", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94a78e0e-5c", "ovs_interfaceid": "94a78e0e-5cb2-4b37-bce6-f529a646fe3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 15:44:18 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-cb1cffce-7db7-4a1a-986b-03c7df747c91 tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] Converting VIF {"id": "94a78e0e-5cb2-4b37-bce6-f529a646fe3a", "address": "fa:16:3e:4b:5e:3e", "network": {"id": "1c357ee9-ff80-4a4b-9fd5-f2f348b36acc", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1869945166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0518c3ca77e4ecebb6ea8fbf6e60219", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94a78e0e-5c", "ovs_interfaceid": "94a78e0e-5cb2-4b37-bce6-f529a646fe3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:44:18 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-cb1cffce-7db7-4a1a-986b-03c7df747c91 tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4b:5e:3e,bridge_name='br-int',has_traffic_filtering=True,id=94a78e0e-5cb2-4b37-bce6-f529a646fe3a,network=Network(1c357ee9-ff80-4a4b-9fd5-f2f348b36acc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94a78e0e-5c') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:44:18 user nova-compute[75176]: DEBUG os_vif [None req-cb1cffce-7db7-4a1a-986b-03c7df747c91 tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:5e:3e,bridge_name='br-int',has_traffic_filtering=True,id=94a78e0e-5cb2-4b37-bce6-f529a646fe3a,network=Network(1c357ee9-ff80-4a4b-9fd5-f2f348b36acc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94a78e0e-5c') {{(pid=75176) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 15:44:18 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:44:18 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap94a78e0e-5c, bridge=br-int, if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:44:18 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:44:18 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:44:18 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:44:18 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:44:18 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5e2c0d36-cb9d-482e-b991-da9ef6a41d61) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:44:18 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:44:18 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:44:18 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:44:18 user nova-compute[75176]: INFO os_vif [None req-cb1cffce-7db7-4a1a-986b-03c7df747c91 tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:5e:3e,bridge_name='br-int',has_traffic_filtering=True,id=94a78e0e-5cb2-4b37-bce6-f529a646fe3a,network=Network(1c357ee9-ff80-4a4b-9fd5-f2f348b36acc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94a78e0e-5c')
Nov 28 15:44:18 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-cb1cffce-7db7-4a1a-986b-03c7df747c91 tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] [instance: 9dcbbf59-600f-4309-abd3-e8e4c7731c0b] Deleting instance files /opt/stack/data/nova/instances/9dcbbf59-600f-4309-abd3-e8e4c7731c0b_del
Nov 28 15:44:18 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-cb1cffce-7db7-4a1a-986b-03c7df747c91 tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] [instance: 9dcbbf59-600f-4309-abd3-e8e4c7731c0b] Deletion of /opt/stack/data/nova/instances/9dcbbf59-600f-4309-abd3-e8e4c7731c0b_del complete
Nov 28 15:44:18 user nova-compute[75176]: INFO nova.compute.manager [None req-cb1cffce-7db7-4a1a-986b-03c7df747c91 tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] [instance: 9dcbbf59-600f-4309-abd3-e8e4c7731c0b] Took 1.62 seconds to destroy the instance on the hypervisor.
Nov 28 15:44:18 user nova-compute[75176]: DEBUG oslo.service.loopingcall [None req-cb1cffce-7db7-4a1a-986b-03c7df747c91 tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75176) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 15:44:18 user nova-compute[75176]: DEBUG nova.compute.manager [-] [instance: 9dcbbf59-600f-4309-abd3-e8e4c7731c0b] Deallocating network for instance {{(pid=75176) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 15:44:18 user nova-compute[75176]: DEBUG nova.network.neutron [-] [instance: 9dcbbf59-600f-4309-abd3-e8e4c7731c0b] deallocate_for_instance() {{(pid=75176) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 15:44:18 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:44:18 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:44:18 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:44:18 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:44:18 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:44:18 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-9063e526-3050-4156-8035-907d24fb7945 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] No BDM found with device name vda, not building metadata. {{(pid=75176) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 15:44:18 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-9063e526-3050-4156-8035-907d24fb7945 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75176) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 15:44:18 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-9063e526-3050-4156-8035-907d24fb7945 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] No VIF found with MAC fa:16:3e:c4:29:df, not building metadata {{(pid=75176) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 15:44:19 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:44:19 user nova-compute[75176]: DEBUG nova.compute.manager [req-dd5dd23d-d8d9-426d-bdf4-e5de31ed0c65 req-6475949c-8e3c-4ae0-8f04-95aad9d3e993 service nova] [instance: 6b3646e6-512e-4cd6-b3c1-89438c19c408] Received event network-vif-plugged-76888781-ca16-4c3d-99b3-37a902459609 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:44:19 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-dd5dd23d-d8d9-426d-bdf4-e5de31ed0c65 req-6475949c-8e3c-4ae0-8f04-95aad9d3e993 service nova] Acquiring lock "6b3646e6-512e-4cd6-b3c1-89438c19c408-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:44:19 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-dd5dd23d-d8d9-426d-bdf4-e5de31ed0c65 req-6475949c-8e3c-4ae0-8f04-95aad9d3e993 service nova] Lock "6b3646e6-512e-4cd6-b3c1-89438c19c408-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:44:19 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-dd5dd23d-d8d9-426d-bdf4-e5de31ed0c65 req-6475949c-8e3c-4ae0-8f04-95aad9d3e993 service nova] Lock "6b3646e6-512e-4cd6-b3c1-89438c19c408-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:44:19 user nova-compute[75176]: DEBUG nova.compute.manager [req-dd5dd23d-d8d9-426d-bdf4-e5de31ed0c65 req-6475949c-8e3c-4ae0-8f04-95aad9d3e993 service nova] [instance: 6b3646e6-512e-4cd6-b3c1-89438c19c408] No waiting events found dispatching network-vif-plugged-76888781-ca16-4c3d-99b3-37a902459609 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:44:19 user nova-compute[75176]: WARNING nova.compute.manager [req-dd5dd23d-d8d9-426d-bdf4-e5de31ed0c65 req-6475949c-8e3c-4ae0-8f04-95aad9d3e993 service nova] [instance: 6b3646e6-512e-4cd6-b3c1-89438c19c408] Received unexpected event network-vif-plugged-76888781-ca16-4c3d-99b3-37a902459609 for instance with vm_state building and task_state spawning.
Nov 28 15:44:19 user nova-compute[75176]: DEBUG nova.compute.manager [req-dd5dd23d-d8d9-426d-bdf4-e5de31ed0c65 req-6475949c-8e3c-4ae0-8f04-95aad9d3e993 service nova] [instance: 6b3646e6-512e-4cd6-b3c1-89438c19c408] Received event network-vif-plugged-76888781-ca16-4c3d-99b3-37a902459609 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:44:19 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-dd5dd23d-d8d9-426d-bdf4-e5de31ed0c65 req-6475949c-8e3c-4ae0-8f04-95aad9d3e993 service nova] Acquiring lock "6b3646e6-512e-4cd6-b3c1-89438c19c408-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:44:19 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-dd5dd23d-d8d9-426d-bdf4-e5de31ed0c65 req-6475949c-8e3c-4ae0-8f04-95aad9d3e993 service nova] Lock "6b3646e6-512e-4cd6-b3c1-89438c19c408-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:44:19 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-dd5dd23d-d8d9-426d-bdf4-e5de31ed0c65 req-6475949c-8e3c-4ae0-8f04-95aad9d3e993 service nova] Lock "6b3646e6-512e-4cd6-b3c1-89438c19c408-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:44:19 user nova-compute[75176]: DEBUG nova.compute.manager [req-dd5dd23d-d8d9-426d-bdf4-e5de31ed0c65 req-6475949c-8e3c-4ae0-8f04-95aad9d3e993 service nova] [instance: 6b3646e6-512e-4cd6-b3c1-89438c19c408] No waiting events found dispatching network-vif-plugged-76888781-ca16-4c3d-99b3-37a902459609 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:44:19 user nova-compute[75176]: WARNING nova.compute.manager [req-dd5dd23d-d8d9-426d-bdf4-e5de31ed0c65 req-6475949c-8e3c-4ae0-8f04-95aad9d3e993 service nova] [instance: 6b3646e6-512e-4cd6-b3c1-89438c19c408] Received unexpected event network-vif-plugged-76888781-ca16-4c3d-99b3-37a902459609 for instance with vm_state building and task_state spawning.
Nov 28 15:44:19 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-9063e526-3050-4156-8035-907d24fb7945 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Lock "402e779e-f507-49f1-a0d8-31ab0d23fbcd" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.123s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:44:19 user nova-compute[75176]: DEBUG nova.compute.manager [req-4062fb2b-01d3-4b42-bd80-eca7c0c18afd req-b9f3cead-7f3d-4a96-9de0-15fa277051c1 service nova] [instance: 9dcbbf59-600f-4309-abd3-e8e4c7731c0b] Received event network-vif-plugged-94a78e0e-5cb2-4b37-bce6-f529a646fe3a {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:44:19 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-4062fb2b-01d3-4b42-bd80-eca7c0c18afd req-b9f3cead-7f3d-4a96-9de0-15fa277051c1 service nova] Acquiring lock "9dcbbf59-600f-4309-abd3-e8e4c7731c0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:44:19 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-4062fb2b-01d3-4b42-bd80-eca7c0c18afd req-b9f3cead-7f3d-4a96-9de0-15fa277051c1 service nova] Lock "9dcbbf59-600f-4309-abd3-e8e4c7731c0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:44:19 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-4062fb2b-01d3-4b42-bd80-eca7c0c18afd req-b9f3cead-7f3d-4a96-9de0-15fa277051c1 service nova] Lock "9dcbbf59-600f-4309-abd3-e8e4c7731c0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:44:19 user nova-compute[75176]: DEBUG nova.compute.manager [req-4062fb2b-01d3-4b42-bd80-eca7c0c18afd req-b9f3cead-7f3d-4a96-9de0-15fa277051c1 service nova] [instance: 9dcbbf59-600f-4309-abd3-e8e4c7731c0b] No waiting events found dispatching network-vif-plugged-94a78e0e-5cb2-4b37-bce6-f529a646fe3a {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:44:19 user nova-compute[75176]: WARNING nova.compute.manager [req-4062fb2b-01d3-4b42-bd80-eca7c0c18afd req-b9f3cead-7f3d-4a96-9de0-15fa277051c1 service nova] [instance: 9dcbbf59-600f-4309-abd3-e8e4c7731c0b] Received unexpected event network-vif-plugged-94a78e0e-5cb2-4b37-bce6-f529a646fe3a for instance with vm_state active and task_state deleting.
Nov 28 15:44:19 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:44:19 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:44:19 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:44:20 user nova-compute[75176]: DEBUG nova.network.neutron [-] [instance: 9dcbbf59-600f-4309-abd3-e8e4c7731c0b] Updating instance_info_cache with network_info: [] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:44:20 user nova-compute[75176]: INFO nova.compute.manager [-] [instance: 9dcbbf59-600f-4309-abd3-e8e4c7731c0b] Took 2.01 seconds to deallocate network for instance.
Nov 28 15:44:20 user nova-compute[75176]: DEBUG nova.compute.manager [req-c34cf7e0-54cb-4490-aba5-fc9f910bab2c req-4f3ce425-d976-4f08-b76d-4915b98abf8f service nova] [instance: 1e8a6e1b-4f71-494a-8f44-f9643c658021] Received event network-vif-plugged-34bebf25-27db-4839-9184-30d78a0ee582 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:44:20 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-c34cf7e0-54cb-4490-aba5-fc9f910bab2c req-4f3ce425-d976-4f08-b76d-4915b98abf8f service nova] Acquiring lock "1e8a6e1b-4f71-494a-8f44-f9643c658021-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:44:20 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-c34cf7e0-54cb-4490-aba5-fc9f910bab2c req-4f3ce425-d976-4f08-b76d-4915b98abf8f service nova] Lock "1e8a6e1b-4f71-494a-8f44-f9643c658021-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:44:20 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-c34cf7e0-54cb-4490-aba5-fc9f910bab2c req-4f3ce425-d976-4f08-b76d-4915b98abf8f service nova] Lock "1e8a6e1b-4f71-494a-8f44-f9643c658021-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:44:20 user nova-compute[75176]: DEBUG nova.compute.manager [req-c34cf7e0-54cb-4490-aba5-fc9f910bab2c req-4f3ce425-d976-4f08-b76d-4915b98abf8f service nova] [instance: 1e8a6e1b-4f71-494a-8f44-f9643c658021] No waiting events found dispatching network-vif-plugged-34bebf25-27db-4839-9184-30d78a0ee582 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:44:20 user nova-compute[75176]: WARNING nova.compute.manager [req-c34cf7e0-54cb-4490-aba5-fc9f910bab2c req-4f3ce425-d976-4f08-b76d-4915b98abf8f service nova] [instance: 1e8a6e1b-4f71-494a-8f44-f9643c658021] Received unexpected event network-vif-plugged-34bebf25-27db-4839-9184-30d78a0ee582 for instance with vm_state building and task_state spawning.
Nov 28 15:44:20 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-cb1cffce-7db7-4a1a-986b-03c7df747c91 tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:44:20 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-cb1cffce-7db7-4a1a-986b-03c7df747c91 tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:44:20 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:44:20 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:44:20 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:44:20 user nova-compute[75176]: DEBUG nova.compute.provider_tree [None req-cb1cffce-7db7-4a1a-986b-03c7df747c91 tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] Inventory has not changed in ProviderTree for provider: b37848d8-f401-4155-a029-b0ffa09ff85b {{(pid=75176) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 15:44:20 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-cb1cffce-7db7-4a1a-986b-03c7df747c91 tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] Inventory has not changed for provider b37848d8-f401-4155-a029-b0ffa09ff85b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75176) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 15:44:20 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-cb1cffce-7db7-4a1a-986b-03c7df747c91 tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.647s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:44:21 user nova-compute[75176]: INFO nova.scheduler.client.report [None req-cb1cffce-7db7-4a1a-986b-03c7df747c91 tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] Deleted allocations for instance 9dcbbf59-600f-4309-abd3-e8e4c7731c0b
Nov 28 15:44:21 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-cb1cffce-7db7-4a1a-986b-03c7df747c91 tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] Lock "9dcbbf59-600f-4309-abd3-e8e4c7731c0b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.628s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:44:21 user nova-compute[75176]: DEBUG nova.compute.manager [req-a22e410a-1d4c-42b1-b2b7-8595602d5189 req-5d8a23a3-5638-41ee-b44c-8f532a6e052d service nova] [instance: 9dcbbf59-600f-4309-abd3-e8e4c7731c0b] Received event network-vif-deleted-94a78e0e-5cb2-4b37-bce6-f529a646fe3a {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:44:21 user nova-compute[75176]: DEBUG nova.compute.manager [None req-25942222-0fc1-43af-af7a-87581c8372b4 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] [instance: 6b3646e6-512e-4cd6-b3c1-89438c19c408] Instance event wait completed in 0 seconds for  {{(pid=75176) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 15:44:21 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-25942222-0fc1-43af-af7a-87581c8372b4 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] [instance: 6b3646e6-512e-4cd6-b3c1-89438c19c408] Guest created on hypervisor {{(pid=75176) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 15:44:21 user nova-compute[75176]: INFO nova.virt.libvirt.driver [-] [instance: 6b3646e6-512e-4cd6-b3c1-89438c19c408] Instance spawned successfully.
Nov 28 15:44:21 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-25942222-0fc1-43af-af7a-87581c8372b4 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] [instance: 6b3646e6-512e-4cd6-b3c1-89438c19c408] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 15:44:21 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-25942222-0fc1-43af-af7a-87581c8372b4 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] [instance: 6b3646e6-512e-4cd6-b3c1-89438c19c408] Found default for hw_cdrom_bus of ide {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:44:21 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-25942222-0fc1-43af-af7a-87581c8372b4 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] [instance: 6b3646e6-512e-4cd6-b3c1-89438c19c408] Found default for hw_disk_bus of virtio {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:44:21 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-25942222-0fc1-43af-af7a-87581c8372b4 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] [instance: 6b3646e6-512e-4cd6-b3c1-89438c19c408] Found default for hw_input_bus of None {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:44:21 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-25942222-0fc1-43af-af7a-87581c8372b4 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] [instance: 6b3646e6-512e-4cd6-b3c1-89438c19c408] Found default for hw_pointer_model of None {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:44:21 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-25942222-0fc1-43af-af7a-87581c8372b4 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] [instance: 6b3646e6-512e-4cd6-b3c1-89438c19c408] Found default for hw_video_model of virtio {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:44:21 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-25942222-0fc1-43af-af7a-87581c8372b4 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] [instance: 6b3646e6-512e-4cd6-b3c1-89438c19c408] Found default for hw_vif_model of virtio {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:44:22 user nova-compute[75176]: INFO nova.compute.manager [None req-25942222-0fc1-43af-af7a-87581c8372b4 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] [instance: 6b3646e6-512e-4cd6-b3c1-89438c19c408] Took 9.73 seconds to spawn the instance on the hypervisor.
Nov 28 15:44:22 user nova-compute[75176]: DEBUG nova.compute.manager [None req-25942222-0fc1-43af-af7a-87581c8372b4 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] [instance: 6b3646e6-512e-4cd6-b3c1-89438c19c408] Checking state {{(pid=75176) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 15:44:22 user nova-compute[75176]: INFO nova.compute.manager [None req-25942222-0fc1-43af-af7a-87581c8372b4 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] [instance: 6b3646e6-512e-4cd6-b3c1-89438c19c408] Took 11.01 seconds to build instance.
Nov 28 15:44:22 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-25942222-0fc1-43af-af7a-87581c8372b4 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] Lock "6b3646e6-512e-4cd6-b3c1-89438c19c408" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.153s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:44:22 user nova-compute[75176]: DEBUG nova.compute.manager [req-6bad2b3d-1f4f-4398-9f77-d94a5bf1c779 req-3686c5bd-a175-4d3a-8dcd-4bd604ce5dd1 service nova] [instance: 1e8a6e1b-4f71-494a-8f44-f9643c658021] Received event network-vif-plugged-34bebf25-27db-4839-9184-30d78a0ee582 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:44:22 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-6bad2b3d-1f4f-4398-9f77-d94a5bf1c779 req-3686c5bd-a175-4d3a-8dcd-4bd604ce5dd1 service nova] Acquiring lock "1e8a6e1b-4f71-494a-8f44-f9643c658021-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:44:22 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-6bad2b3d-1f4f-4398-9f77-d94a5bf1c779 req-3686c5bd-a175-4d3a-8dcd-4bd604ce5dd1 service nova] Lock "1e8a6e1b-4f71-494a-8f44-f9643c658021-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:44:22 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-6bad2b3d-1f4f-4398-9f77-d94a5bf1c779 req-3686c5bd-a175-4d3a-8dcd-4bd604ce5dd1 service nova] Lock "1e8a6e1b-4f71-494a-8f44-f9643c658021-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:44:22 user nova-compute[75176]: DEBUG nova.compute.manager [req-6bad2b3d-1f4f-4398-9f77-d94a5bf1c779 req-3686c5bd-a175-4d3a-8dcd-4bd604ce5dd1 service nova] [instance: 1e8a6e1b-4f71-494a-8f44-f9643c658021] No waiting events found dispatching network-vif-plugged-34bebf25-27db-4839-9184-30d78a0ee582 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:44:22 user nova-compute[75176]: WARNING nova.compute.manager [req-6bad2b3d-1f4f-4398-9f77-d94a5bf1c779 req-3686c5bd-a175-4d3a-8dcd-4bd604ce5dd1 service nova] [instance: 1e8a6e1b-4f71-494a-8f44-f9643c658021] Received unexpected event network-vif-plugged-34bebf25-27db-4839-9184-30d78a0ee582 for instance with vm_state building and task_state spawning.
Nov 28 15:44:22 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7e673717-559d-47f4-bb90-a69ab3905f6f tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] [instance: 1e8a6e1b-4f71-494a-8f44-f9643c658021] Instance event wait completed in 0 seconds for  {{(pid=75176) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 15:44:22 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-7e673717-559d-47f4-bb90-a69ab3905f6f tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] [instance: 1e8a6e1b-4f71-494a-8f44-f9643c658021] Guest created on hypervisor {{(pid=75176) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 15:44:22 user nova-compute[75176]: INFO nova.virt.libvirt.driver [-] [instance: 1e8a6e1b-4f71-494a-8f44-f9643c658021] Instance spawned successfully.
Nov 28 15:44:22 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-7e673717-559d-47f4-bb90-a69ab3905f6f tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] [instance: 1e8a6e1b-4f71-494a-8f44-f9643c658021] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 15:44:22 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-7e673717-559d-47f4-bb90-a69ab3905f6f tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] [instance: 1e8a6e1b-4f71-494a-8f44-f9643c658021] Found default for hw_cdrom_bus of ide {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:44:22 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-7e673717-559d-47f4-bb90-a69ab3905f6f tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] [instance: 1e8a6e1b-4f71-494a-8f44-f9643c658021] Found default for hw_disk_bus of virtio {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:44:22 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-7e673717-559d-47f4-bb90-a69ab3905f6f tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] [instance: 1e8a6e1b-4f71-494a-8f44-f9643c658021] Found default for hw_input_bus of None {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:44:22 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-7e673717-559d-47f4-bb90-a69ab3905f6f tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] [instance: 1e8a6e1b-4f71-494a-8f44-f9643c658021] Found default for hw_pointer_model of None {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:44:22 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-7e673717-559d-47f4-bb90-a69ab3905f6f tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] [instance: 1e8a6e1b-4f71-494a-8f44-f9643c658021] Found default for hw_video_model of virtio {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:44:22 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-7e673717-559d-47f4-bb90-a69ab3905f6f tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] [instance: 1e8a6e1b-4f71-494a-8f44-f9643c658021] Found default for hw_vif_model of virtio {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:44:22 user nova-compute[75176]: INFO nova.compute.manager [None req-7e673717-559d-47f4-bb90-a69ab3905f6f tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] [instance: 1e8a6e1b-4f71-494a-8f44-f9643c658021] Took 8.74 seconds to spawn the instance on the hypervisor.
Nov 28 15:44:22 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7e673717-559d-47f4-bb90-a69ab3905f6f tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] [instance: 1e8a6e1b-4f71-494a-8f44-f9643c658021] Checking state {{(pid=75176) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 15:44:22 user nova-compute[75176]: INFO nova.compute.manager [None req-7e673717-559d-47f4-bb90-a69ab3905f6f tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] [instance: 1e8a6e1b-4f71-494a-8f44-f9643c658021] Took 10.06 seconds to build instance.
Nov 28 15:44:22 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7e673717-559d-47f4-bb90-a69ab3905f6f tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] Lock "1e8a6e1b-4f71-494a-8f44-f9643c658021" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.272s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:44:23 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:44:23 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:44:24 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-78f6fb47-106e-410d-a143-408d701bfeba tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Acquiring lock "6ed37390-f6a6-4cf7-8cab-b818f702083d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:44:24 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-78f6fb47-106e-410d-a143-408d701bfeba tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Lock "6ed37390-f6a6-4cf7-8cab-b818f702083d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:44:24 user nova-compute[75176]: DEBUG nova.compute.manager [None req-78f6fb47-106e-410d-a143-408d701bfeba tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] [instance: 6ed37390-f6a6-4cf7-8cab-b818f702083d] Starting instance... {{(pid=75176) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 15:44:24 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-78f6fb47-106e-410d-a143-408d701bfeba tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:44:24 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-78f6fb47-106e-410d-a143-408d701bfeba tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:44:24 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-78f6fb47-106e-410d-a143-408d701bfeba tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75176) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 15:44:24 user nova-compute[75176]: INFO nova.compute.claims [None req-78f6fb47-106e-410d-a143-408d701bfeba tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] [instance: 6ed37390-f6a6-4cf7-8cab-b818f702083d] Claim successful on node user
Nov 28 15:44:24 user nova-compute[75176]: DEBUG nova.compute.provider_tree [None req-78f6fb47-106e-410d-a143-408d701bfeba tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Inventory has not changed in ProviderTree for provider: b37848d8-f401-4155-a029-b0ffa09ff85b {{(pid=75176) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 15:44:24 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-78f6fb47-106e-410d-a143-408d701bfeba tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Inventory has not changed for provider b37848d8-f401-4155-a029-b0ffa09ff85b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75176) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 15:44:24 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-78f6fb47-106e-410d-a143-408d701bfeba tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.608s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:44:24 user nova-compute[75176]: DEBUG nova.compute.manager [None req-78f6fb47-106e-410d-a143-408d701bfeba tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] [instance: 6ed37390-f6a6-4cf7-8cab-b818f702083d] Start building networks asynchronously for instance. {{(pid=75176) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 15:44:24 user nova-compute[75176]: DEBUG nova.compute.manager [None req-78f6fb47-106e-410d-a143-408d701bfeba tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] [instance: 6ed37390-f6a6-4cf7-8cab-b818f702083d] Allocating IP information in the background. {{(pid=75176) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 15:44:24 user nova-compute[75176]: DEBUG nova.network.neutron [None req-78f6fb47-106e-410d-a143-408d701bfeba tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] [instance: 6ed37390-f6a6-4cf7-8cab-b818f702083d] allocate_for_instance() {{(pid=75176) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 15:44:24 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-78f6fb47-106e-410d-a143-408d701bfeba tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] [instance: 6ed37390-f6a6-4cf7-8cab-b818f702083d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 15:44:25 user nova-compute[75176]: DEBUG nova.compute.manager [None req-78f6fb47-106e-410d-a143-408d701bfeba tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] [instance: 6ed37390-f6a6-4cf7-8cab-b818f702083d] Start building block device mappings for instance. {{(pid=75176) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 15:44:25 user nova-compute[75176]: DEBUG nova.policy [None req-78f6fb47-106e-410d-a143-408d701bfeba tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f9a745552d974e05a9e0befc68eb7f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a194f81f7e104be7940d1d05f71bbad9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75176) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 15:44:25 user nova-compute[75176]: DEBUG nova.compute.manager [None req-78f6fb47-106e-410d-a143-408d701bfeba tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] [instance: 6ed37390-f6a6-4cf7-8cab-b818f702083d] Start spawning the instance on the hypervisor. {{(pid=75176) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 15:44:25 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-78f6fb47-106e-410d-a143-408d701bfeba tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] [instance: 6ed37390-f6a6-4cf7-8cab-b818f702083d] Creating instance directory {{(pid=75176) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 15:44:25 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-78f6fb47-106e-410d-a143-408d701bfeba tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] [instance: 6ed37390-f6a6-4cf7-8cab-b818f702083d] Creating image(s)
Nov 28 15:44:25 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-78f6fb47-106e-410d-a143-408d701bfeba tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Acquiring lock "/opt/stack/data/nova/instances/6ed37390-f6a6-4cf7-8cab-b818f702083d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:44:25 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-78f6fb47-106e-410d-a143-408d701bfeba tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Lock "/opt/stack/data/nova/instances/6ed37390-f6a6-4cf7-8cab-b818f702083d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:44:25 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-78f6fb47-106e-410d-a143-408d701bfeba tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Lock "/opt/stack/data/nova/instances/6ed37390-f6a6-4cf7-8cab-b818f702083d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:44:25 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-78f6fb47-106e-410d-a143-408d701bfeba tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:44:25 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-78f6fb47-106e-410d-a143-408d701bfeba tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json" returned: 0 in 0.235s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:44:25 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-78f6fb47-106e-410d-a143-408d701bfeba tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Acquiring lock "5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:44:25 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-78f6fb47-106e-410d-a143-408d701bfeba tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Lock "5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:44:25 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-78f6fb47-106e-410d-a143-408d701bfeba tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:44:25 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-78f6fb47-106e-410d-a143-408d701bfeba tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json" returned: 0 in 0.211s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:44:25 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-78f6fb47-106e-410d-a143-408d701bfeba tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2,backing_fmt=raw /opt/stack/data/nova/instances/6ed37390-f6a6-4cf7-8cab-b818f702083d/disk 1073741824 {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:44:25 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-78f6fb47-106e-410d-a143-408d701bfeba tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2,backing_fmt=raw /opt/stack/data/nova/instances/6ed37390-f6a6-4cf7-8cab-b818f702083d/disk 1073741824" returned: 0 in 0.055s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:44:25 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-78f6fb47-106e-410d-a143-408d701bfeba tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Lock "5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.273s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:44:25 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-78f6fb47-106e-410d-a143-408d701bfeba tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:44:25 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-78f6fb47-106e-410d-a143-408d701bfeba tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json" returned: 0 in 0.221s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:44:25 user nova-compute[75176]: DEBUG nova.virt.disk.api [None req-78f6fb47-106e-410d-a143-408d701bfeba tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6ed37390-f6a6-4cf7-8cab-b818f702083d/disk. size=1073741824 {{(pid=75176) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 15:44:25 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-78f6fb47-106e-410d-a143-408d701bfeba tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ed37390-f6a6-4cf7-8cab-b818f702083d/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:44:25 user nova-compute[75176]: DEBUG nova.network.neutron [None req-78f6fb47-106e-410d-a143-408d701bfeba tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] [instance: 6ed37390-f6a6-4cf7-8cab-b818f702083d] Successfully created port: 04fa7f72-709c-42c1-be40-0cb4cbe31686 {{(pid=75176) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 15:44:26 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-78f6fb47-106e-410d-a143-408d701bfeba tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ed37390-f6a6-4cf7-8cab-b818f702083d/disk --force-share --output=json" returned: 0 in 0.263s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:44:26 user nova-compute[75176]: DEBUG nova.virt.disk.api [None req-78f6fb47-106e-410d-a143-408d701bfeba tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Cannot resize image /opt/stack/data/nova/instances/6ed37390-f6a6-4cf7-8cab-b818f702083d/disk to a smaller size. {{(pid=75176) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 15:44:26 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-78f6fb47-106e-410d-a143-408d701bfeba tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] [instance: 6ed37390-f6a6-4cf7-8cab-b818f702083d] Created local disks {{(pid=75176) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 15:44:26 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-78f6fb47-106e-410d-a143-408d701bfeba tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] [instance: 6ed37390-f6a6-4cf7-8cab-b818f702083d] Ensure instance console log exists: /opt/stack/data/nova/instances/6ed37390-f6a6-4cf7-8cab-b818f702083d/console.log {{(pid=75176) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 15:44:26 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-78f6fb47-106e-410d-a143-408d701bfeba tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:44:26 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-78f6fb47-106e-410d-a143-408d701bfeba tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:44:26 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-78f6fb47-106e-410d-a143-408d701bfeba tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:44:26 user nova-compute[75176]: DEBUG nova.network.neutron [None req-78f6fb47-106e-410d-a143-408d701bfeba tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] [instance: 6ed37390-f6a6-4cf7-8cab-b818f702083d] Successfully updated port: 04fa7f72-709c-42c1-be40-0cb4cbe31686 {{(pid=75176) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 15:44:26 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-78f6fb47-106e-410d-a143-408d701bfeba tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Acquiring lock "refresh_cache-6ed37390-f6a6-4cf7-8cab-b818f702083d" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:44:26 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-78f6fb47-106e-410d-a143-408d701bfeba tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Acquired lock "refresh_cache-6ed37390-f6a6-4cf7-8cab-b818f702083d" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:44:26 user nova-compute[75176]: DEBUG nova.network.neutron [None req-78f6fb47-106e-410d-a143-408d701bfeba tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] [instance: 6ed37390-f6a6-4cf7-8cab-b818f702083d] Building network info cache for instance {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 15:44:26 user nova-compute[75176]: DEBUG nova.compute.manager [req-0f052c06-7d6d-46db-b47f-2a02895ef786 req-6d8a653d-2df1-4a1d-bcf8-cafb303814ed service nova] [instance: 6ed37390-f6a6-4cf7-8cab-b818f702083d] Received event network-changed-04fa7f72-709c-42c1-be40-0cb4cbe31686 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:44:26 user nova-compute[75176]: DEBUG nova.compute.manager [req-0f052c06-7d6d-46db-b47f-2a02895ef786 req-6d8a653d-2df1-4a1d-bcf8-cafb303814ed service nova] [instance: 6ed37390-f6a6-4cf7-8cab-b818f702083d] Refreshing instance network info cache due to event network-changed-04fa7f72-709c-42c1-be40-0cb4cbe31686. {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 15:44:26 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-0f052c06-7d6d-46db-b47f-2a02895ef786 req-6d8a653d-2df1-4a1d-bcf8-cafb303814ed service nova] Acquiring lock "refresh_cache-6ed37390-f6a6-4cf7-8cab-b818f702083d" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:44:26 user nova-compute[75176]: DEBUG nova.network.neutron [None req-78f6fb47-106e-410d-a143-408d701bfeba tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] [instance: 6ed37390-f6a6-4cf7-8cab-b818f702083d] Instance cache missing network info. {{(pid=75176) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 15:44:27 user nova-compute[75176]: DEBUG nova.network.neutron [None req-78f6fb47-106e-410d-a143-408d701bfeba tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] [instance: 6ed37390-f6a6-4cf7-8cab-b818f702083d] Updating instance_info_cache with network_info: [{"id": "04fa7f72-709c-42c1-be40-0cb4cbe31686", "address": "fa:16:3e:23:3a:a2", "network": {"id": "7ab60343-57be-427d-9037-6ecf0eaf5de0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1508138843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a194f81f7e104be7940d1d05f71bbad9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04fa7f72-70", "ovs_interfaceid": "04fa7f72-709c-42c1-be40-0cb4cbe31686", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:44:27 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-78f6fb47-106e-410d-a143-408d701bfeba tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Releasing lock "refresh_cache-6ed37390-f6a6-4cf7-8cab-b818f702083d" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:44:27 user nova-compute[75176]: DEBUG nova.compute.manager [None req-78f6fb47-106e-410d-a143-408d701bfeba tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] [instance: 6ed37390-f6a6-4cf7-8cab-b818f702083d] Instance network_info: |[{"id": "04fa7f72-709c-42c1-be40-0cb4cbe31686", "address": "fa:16:3e:23:3a:a2", "network": {"id": "7ab60343-57be-427d-9037-6ecf0eaf5de0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1508138843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a194f81f7e104be7940d1d05f71bbad9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04fa7f72-70", "ovs_interfaceid": "04fa7f72-709c-42c1-be40-0cb4cbe31686", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75176) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 15:44:27 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-0f052c06-7d6d-46db-b47f-2a02895ef786 req-6d8a653d-2df1-4a1d-bcf8-cafb303814ed service nova] Acquired lock "refresh_cache-6ed37390-f6a6-4cf7-8cab-b818f702083d" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:44:27 user nova-compute[75176]: DEBUG nova.network.neutron [req-0f052c06-7d6d-46db-b47f-2a02895ef786 req-6d8a653d-2df1-4a1d-bcf8-cafb303814ed service nova] [instance: 6ed37390-f6a6-4cf7-8cab-b818f702083d] Refreshing network info cache for port 04fa7f72-709c-42c1-be40-0cb4cbe31686 {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 15:44:27 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-78f6fb47-106e-410d-a143-408d701bfeba tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] [instance: 6ed37390-f6a6-4cf7-8cab-b818f702083d] Start _get_guest_xml network_info=[{"id": "04fa7f72-709c-42c1-be40-0cb4cbe31686", "address": "fa:16:3e:23:3a:a2", "network": {"id": "7ab60343-57be-427d-9037-6ecf0eaf5de0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1508138843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a194f81f7e104be7940d1d05f71bbad9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04fa7f72-70", "ovs_interfaceid": "04fa7f72-709c-42c1-be40-0cb4cbe31686", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T15:35:12Z,direct_url=<?>,disk_format='qcow2',id=1f41819e-c93f-4dc7-b253-37a27bbbbc74,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1b91c5d0672c4224a48df2e1f92688e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T15:35:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'size': 0, 'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'image_id': '1f41819e-c93f-4dc7-b253-37a27bbbbc74'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75176) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 15:44:27 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-78f6fb47-106e-410d-a143-408d701bfeba tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 15:44:27 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-78f6fb47-106e-410d-a143-408d701bfeba tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 15:44:27 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-78f6fb47-106e-410d-a143-408d701bfeba tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75176) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 15:44:27 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-78f6fb47-106e-410d-a143-408d701bfeba tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] CPU controller missing on host. {{(pid=75176) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 15:44:27 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-78f6fb47-106e-410d-a143-408d701bfeba tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75176) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 15:44:27 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-78f6fb47-106e-410d-a143-408d701bfeba tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] CPU controller found on host. {{(pid=75176) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 15:44:27 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-78f6fb47-106e-410d-a143-408d701bfeba tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75176) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 15:44:27 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-78f6fb47-106e-410d-a143-408d701bfeba tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T15:35:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T15:35:12Z,direct_url=<?>,disk_format='qcow2',id=1f41819e-c93f-4dc7-b253-37a27bbbbc74,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1b91c5d0672c4224a48df2e1f92688e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T15:35:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 15:44:27 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-78f6fb47-106e-410d-a143-408d701bfeba tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Flavor limits 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 15:44:27 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-78f6fb47-106e-410d-a143-408d701bfeba tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Image limits 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 15:44:27 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-78f6fb47-106e-410d-a143-408d701bfeba tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Flavor pref 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 15:44:27 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-78f6fb47-106e-410d-a143-408d701bfeba tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Image pref 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 15:44:27 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-78f6fb47-106e-410d-a143-408d701bfeba tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 15:44:27 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-78f6fb47-106e-410d-a143-408d701bfeba tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 15:44:27 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-78f6fb47-106e-410d-a143-408d701bfeba tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75176) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 15:44:27 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-78f6fb47-106e-410d-a143-408d701bfeba tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Got 1 possible topologies {{(pid=75176) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 15:44:27 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-78f6fb47-106e-410d-a143-408d701bfeba tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 15:44:27 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-78f6fb47-106e-410d-a143-408d701bfeba tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 15:44:27 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-78f6fb47-106e-410d-a143-408d701bfeba tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T15:44:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-274267513',display_name='tempest-AttachVolumeNegativeTest-server-274267513',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-274267513',id=19,image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAkNJbhG7OS8YUjZwKSzzn0etNTTWZ3rJatxfYf5eELR18+aNHYRB8hLBtJDOgC4axsAY2RyUlJPOj1x6r5keWDSSYZQhJQUX63bdyFz9VH/r8/Bb3ijNVg9IdiPL2g1ow==',key_name='tempest-keypair-1692252659',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a194f81f7e104be7940d1d05f71bbad9',ramdisk_id='',reservation_id='r-u9wz9cn3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1403590572',owner_user_name='tempest-AttachVolumeNegativeTest-1403590572-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T15:44:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f9a745552d974e05a9e0befc68eb7f6e',uuid=6ed37390-f6a6-4cf7-8cab-b818f702083d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "04fa7f72-709c-42c1-be40-0cb4cbe31686", "address": "fa:16:3e:23:3a:a2", "network": {"id": "7ab60343-57be-427d-9037-6ecf0eaf5de0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1508138843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a194f81f7e104be7940d1d05f71bbad9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04fa7f72-70", "ovs_interfaceid": "04fa7f72-709c-42c1-be40-0cb4cbe31686", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75176) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 15:44:27 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-78f6fb47-106e-410d-a143-408d701bfeba tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Converting VIF {"id": "04fa7f72-709c-42c1-be40-0cb4cbe31686", "address": "fa:16:3e:23:3a:a2", "network": {"id": "7ab60343-57be-427d-9037-6ecf0eaf5de0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1508138843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a194f81f7e104be7940d1d05f71bbad9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04fa7f72-70", "ovs_interfaceid": "04fa7f72-709c-42c1-be40-0cb4cbe31686", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:44:27 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-78f6fb47-106e-410d-a143-408d701bfeba tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:3a:a2,bridge_name='br-int',has_traffic_filtering=True,id=04fa7f72-709c-42c1-be40-0cb4cbe31686,network=Network(7ab60343-57be-427d-9037-6ecf0eaf5de0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04fa7f72-70') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:44:27 user nova-compute[75176]: DEBUG nova.objects.instance [None req-78f6fb47-106e-410d-a143-408d701bfeba tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Lazy-loading 'pci_devices' on Instance uuid 6ed37390-f6a6-4cf7-8cab-b818f702083d {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:44:27 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-78f6fb47-106e-410d-a143-408d701bfeba tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] [instance: 6ed37390-f6a6-4cf7-8cab-b818f702083d] End _get_guest_xml xml=<domain type="kvm">
Nov 28 15:44:27 user nova-compute[75176]:   <uuid>6ed37390-f6a6-4cf7-8cab-b818f702083d</uuid>
Nov 28 15:44:27 user nova-compute[75176]:   <name>instance-00000013</name>
Nov 28 15:44:27 user nova-compute[75176]:   <memory>524288</memory>
Nov 28 15:44:27 user nova-compute[75176]:   <vcpu>1</vcpu>
Nov 28 15:44:27 user nova-compute[75176]:   <metadata>
Nov 28 15:44:27 user nova-compute[75176]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 15:44:27 user nova-compute[75176]:       <nova:package version="0.0.0"/>
Nov 28 15:44:27 user nova-compute[75176]:       <nova:name>tempest-AttachVolumeNegativeTest-server-274267513</nova:name>
Nov 28 15:44:27 user nova-compute[75176]:       <nova:creationTime>2023-11-28 15:44:27</nova:creationTime>
Nov 28 15:44:27 user nova-compute[75176]:       <nova:flavor name="m1.tiny">
Nov 28 15:44:27 user nova-compute[75176]:         <nova:memory>512</nova:memory>
Nov 28 15:44:27 user nova-compute[75176]:         <nova:disk>1</nova:disk>
Nov 28 15:44:27 user nova-compute[75176]:         <nova:swap>0</nova:swap>
Nov 28 15:44:27 user nova-compute[75176]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 15:44:27 user nova-compute[75176]:         <nova:vcpus>1</nova:vcpus>
Nov 28 15:44:27 user nova-compute[75176]:       </nova:flavor>
Nov 28 15:44:27 user nova-compute[75176]:       <nova:owner>
Nov 28 15:44:27 user nova-compute[75176]:         <nova:user uuid="f9a745552d974e05a9e0befc68eb7f6e">tempest-AttachVolumeNegativeTest-1403590572-project-member</nova:user>
Nov 28 15:44:27 user nova-compute[75176]:         <nova:project uuid="a194f81f7e104be7940d1d05f71bbad9">tempest-AttachVolumeNegativeTest-1403590572</nova:project>
Nov 28 15:44:27 user nova-compute[75176]:       </nova:owner>
Nov 28 15:44:27 user nova-compute[75176]:       <nova:root type="image" uuid="1f41819e-c93f-4dc7-b253-37a27bbbbc74"/>
Nov 28 15:44:27 user nova-compute[75176]:       <nova:ports>
Nov 28 15:44:27 user nova-compute[75176]:         <nova:port uuid="04fa7f72-709c-42c1-be40-0cb4cbe31686">
Nov 28 15:44:27 user nova-compute[75176]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 28 15:44:27 user nova-compute[75176]:         </nova:port>
Nov 28 15:44:27 user nova-compute[75176]:       </nova:ports>
Nov 28 15:44:27 user nova-compute[75176]:     </nova:instance>
Nov 28 15:44:27 user nova-compute[75176]:   </metadata>
Nov 28 15:44:27 user nova-compute[75176]:   <sysinfo type="smbios">
Nov 28 15:44:27 user nova-compute[75176]:     <system>
Nov 28 15:44:27 user nova-compute[75176]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 15:44:27 user nova-compute[75176]:       <entry name="product">OpenStack Nova</entry>
Nov 28 15:44:27 user nova-compute[75176]:       <entry name="version">0.0.0</entry>
Nov 28 15:44:27 user nova-compute[75176]:       <entry name="serial">6ed37390-f6a6-4cf7-8cab-b818f702083d</entry>
Nov 28 15:44:27 user nova-compute[75176]:       <entry name="uuid">6ed37390-f6a6-4cf7-8cab-b818f702083d</entry>
Nov 28 15:44:27 user nova-compute[75176]:       <entry name="family">Virtual Machine</entry>
Nov 28 15:44:27 user nova-compute[75176]:     </system>
Nov 28 15:44:27 user nova-compute[75176]:   </sysinfo>
Nov 28 15:44:27 user nova-compute[75176]:   <os>
Nov 28 15:44:27 user nova-compute[75176]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 15:44:27 user nova-compute[75176]:     <boot dev="hd"/>
Nov 28 15:44:27 user nova-compute[75176]:     <smbios mode="sysinfo"/>
Nov 28 15:44:27 user nova-compute[75176]:   </os>
Nov 28 15:44:27 user nova-compute[75176]:   <features>
Nov 28 15:44:27 user nova-compute[75176]:     <acpi/>
Nov 28 15:44:27 user nova-compute[75176]:     <apic/>
Nov 28 15:44:27 user nova-compute[75176]:     <vmcoreinfo/>
Nov 28 15:44:27 user nova-compute[75176]:   </features>
Nov 28 15:44:27 user nova-compute[75176]:   <clock offset="utc">
Nov 28 15:44:27 user nova-compute[75176]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 15:44:27 user nova-compute[75176]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 15:44:27 user nova-compute[75176]:     <timer name="hpet" present="no"/>
Nov 28 15:44:27 user nova-compute[75176]:   </clock>
Nov 28 15:44:27 user nova-compute[75176]:   <cpu mode="custom" match="exact">
Nov 28 15:44:27 user nova-compute[75176]:     <model>Nehalem</model>
Nov 28 15:44:27 user nova-compute[75176]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 15:44:27 user nova-compute[75176]:   </cpu>
Nov 28 15:44:27 user nova-compute[75176]:   <devices>
Nov 28 15:44:27 user nova-compute[75176]:     <disk type="file" device="disk">
Nov 28 15:44:27 user nova-compute[75176]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 15:44:27 user nova-compute[75176]:       <source file="/opt/stack/data/nova/instances/6ed37390-f6a6-4cf7-8cab-b818f702083d/disk"/>
Nov 28 15:44:27 user nova-compute[75176]:       <target dev="vda" bus="virtio"/>
Nov 28 15:44:27 user nova-compute[75176]:     </disk>
Nov 28 15:44:27 user nova-compute[75176]:     <interface type="ethernet">
Nov 28 15:44:27 user nova-compute[75176]:       <mac address="fa:16:3e:23:3a:a2"/>
Nov 28 15:44:27 user nova-compute[75176]:       <model type="virtio"/>
Nov 28 15:44:27 user nova-compute[75176]:       <mtu size="1442"/>
Nov 28 15:44:27 user nova-compute[75176]:       <target dev="tap04fa7f72-70"/>
Nov 28 15:44:27 user nova-compute[75176]:     </interface>
Nov 28 15:44:27 user nova-compute[75176]:     <serial type="pty">
Nov 28 15:44:27 user nova-compute[75176]:       <log file="/opt/stack/data/nova/instances/6ed37390-f6a6-4cf7-8cab-b818f702083d/console.log" append="off"/>
Nov 28 15:44:27 user nova-compute[75176]:     </serial>
Nov 28 15:44:27 user nova-compute[75176]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 15:44:27 user nova-compute[75176]:     <video>
Nov 28 15:44:27 user nova-compute[75176]:       <model type="virtio"/>
Nov 28 15:44:27 user nova-compute[75176]:     </video>
Nov 28 15:44:27 user nova-compute[75176]:     <rng model="virtio">
Nov 28 15:44:27 user nova-compute[75176]:       <backend model="random">/dev/urandom</backend>
Nov 28 15:44:27 user nova-compute[75176]:     </rng>
Nov 28 15:44:27 user nova-compute[75176]:     <controller type="usb" index="0" model="none"/>
Nov 28 15:44:27 user nova-compute[75176]:     <memballoon model="virtio">
Nov 28 15:44:27 user nova-compute[75176]:       <stats period="10"/>
Nov 28 15:44:27 user nova-compute[75176]:     </memballoon>
Nov 28 15:44:27 user nova-compute[75176]:   </devices>
Nov 28 15:44:27 user nova-compute[75176]: </domain>
Nov 28 15:44:27 user nova-compute[75176]:  {{(pid=75176) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 15:44:27 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-78f6fb47-106e-410d-a143-408d701bfeba tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T15:44:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-274267513',display_name='tempest-AttachVolumeNegativeTest-server-274267513',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-274267513',id=19,image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAkNJbhG7OS8YUjZwKSzzn0etNTTWZ3rJatxfYf5eELR18+aNHYRB8hLBtJDOgC4axsAY2RyUlJPOj1x6r5keWDSSYZQhJQUX63bdyFz9VH/r8/Bb3ijNVg9IdiPL2g1ow==',key_name='tempest-keypair-1692252659',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a194f81f7e104be7940d1d05f71bbad9',ramdisk_id='',reservation_id='r-u9wz9cn3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1403590572',owner_user_name='tempest-AttachVolumeNegativeTest-1403590572-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T15:44:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f9a745552d974e05a9e0befc68eb7f6e',uuid=6ed37390-f6a6-4cf7-8cab-b818f702083d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "04fa7f72-709c-42c1-be40-0cb4cbe31686", "address": "fa:16:3e:23:3a:a2", "network": {"id": "7ab60343-57be-427d-9037-6ecf0eaf5de0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1508138843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a194f81f7e104be7940d1d05f71bbad9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04fa7f72-70", "ovs_interfaceid": "04fa7f72-709c-42c1-be40-0cb4cbe31686", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 15:44:27 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-78f6fb47-106e-410d-a143-408d701bfeba tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Converting VIF {"id": "04fa7f72-709c-42c1-be40-0cb4cbe31686", "address": "fa:16:3e:23:3a:a2", "network": {"id": "7ab60343-57be-427d-9037-6ecf0eaf5de0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1508138843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a194f81f7e104be7940d1d05f71bbad9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04fa7f72-70", "ovs_interfaceid": "04fa7f72-709c-42c1-be40-0cb4cbe31686", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:44:27 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-78f6fb47-106e-410d-a143-408d701bfeba tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:3a:a2,bridge_name='br-int',has_traffic_filtering=True,id=04fa7f72-709c-42c1-be40-0cb4cbe31686,network=Network(7ab60343-57be-427d-9037-6ecf0eaf5de0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04fa7f72-70') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:44:27 user nova-compute[75176]: DEBUG os_vif [None req-78f6fb47-106e-410d-a143-408d701bfeba tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:3a:a2,bridge_name='br-int',has_traffic_filtering=True,id=04fa7f72-709c-42c1-be40-0cb4cbe31686,network=Network(7ab60343-57be-427d-9037-6ecf0eaf5de0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04fa7f72-70') {{(pid=75176) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 15:44:27 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:44:27 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:44:27 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 15:44:27 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:44:27 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7af0fc5b-0954-5501-a05e-42a89d67e6c8', '_type': 'linux-noop'}}, row=False) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:44:27 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:44:27 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:44:27 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap04fa7f72-70, may_exist=True, interface_attrs={}) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:44:27 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap04fa7f72-70, col_values=(('qos', UUID('587a60dd-6e4e-4327-8dbd-74922ebce7b3')),), if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:44:27 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap04fa7f72-70, col_values=(('external_ids', {'iface-id': '04fa7f72-709c-42c1-be40-0cb4cbe31686', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:23:3a:a2', 'vm-uuid': '6ed37390-f6a6-4cf7-8cab-b818f702083d'}),), if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:44:27 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:44:27 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:44:27 user nova-compute[75176]: INFO os_vif [None req-78f6fb47-106e-410d-a143-408d701bfeba tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:3a:a2,bridge_name='br-int',has_traffic_filtering=True,id=04fa7f72-709c-42c1-be40-0cb4cbe31686,network=Network(7ab60343-57be-427d-9037-6ecf0eaf5de0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04fa7f72-70')
Nov 28 15:44:27 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-78f6fb47-106e-410d-a143-408d701bfeba tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] No BDM found with device name vda, not building metadata. {{(pid=75176) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 15:44:27 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-78f6fb47-106e-410d-a143-408d701bfeba tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] No VIF found with MAC fa:16:3e:23:3a:a2, not building metadata {{(pid=75176) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 15:44:27 user nova-compute[75176]: DEBUG nova.network.neutron [req-0f052c06-7d6d-46db-b47f-2a02895ef786 req-6d8a653d-2df1-4a1d-bcf8-cafb303814ed service nova] [instance: 6ed37390-f6a6-4cf7-8cab-b818f702083d] Updated VIF entry in instance network info cache for port 04fa7f72-709c-42c1-be40-0cb4cbe31686. {{(pid=75176) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 15:44:27 user nova-compute[75176]: DEBUG nova.network.neutron [req-0f052c06-7d6d-46db-b47f-2a02895ef786 req-6d8a653d-2df1-4a1d-bcf8-cafb303814ed service nova] [instance: 6ed37390-f6a6-4cf7-8cab-b818f702083d] Updating instance_info_cache with network_info: [{"id": "04fa7f72-709c-42c1-be40-0cb4cbe31686", "address": "fa:16:3e:23:3a:a2", "network": {"id": "7ab60343-57be-427d-9037-6ecf0eaf5de0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1508138843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a194f81f7e104be7940d1d05f71bbad9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04fa7f72-70", "ovs_interfaceid": "04fa7f72-709c-42c1-be40-0cb4cbe31686", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:44:27 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-0f052c06-7d6d-46db-b47f-2a02895ef786 req-6d8a653d-2df1-4a1d-bcf8-cafb303814ed service nova] Releasing lock "refresh_cache-6ed37390-f6a6-4cf7-8cab-b818f702083d" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:44:28 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:44:29 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:44:29 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:44:29 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:44:29 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:44:29 user nova-compute[75176]: DEBUG nova.compute.manager [req-a46abac9-9e5e-4626-8281-ca48991ea4e6 req-0b5fd87e-f8e9-4b9b-a647-a886647f9e4e service nova] [instance: 6ed37390-f6a6-4cf7-8cab-b818f702083d] Received event network-vif-plugged-04fa7f72-709c-42c1-be40-0cb4cbe31686 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:44:29 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-a46abac9-9e5e-4626-8281-ca48991ea4e6 req-0b5fd87e-f8e9-4b9b-a647-a886647f9e4e service nova] Acquiring lock "6ed37390-f6a6-4cf7-8cab-b818f702083d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:44:29 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-a46abac9-9e5e-4626-8281-ca48991ea4e6 req-0b5fd87e-f8e9-4b9b-a647-a886647f9e4e service nova] Lock "6ed37390-f6a6-4cf7-8cab-b818f702083d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:44:29 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-a46abac9-9e5e-4626-8281-ca48991ea4e6 req-0b5fd87e-f8e9-4b9b-a647-a886647f9e4e service nova] Lock "6ed37390-f6a6-4cf7-8cab-b818f702083d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:44:29 user nova-compute[75176]: DEBUG nova.compute.manager [req-a46abac9-9e5e-4626-8281-ca48991ea4e6 req-0b5fd87e-f8e9-4b9b-a647-a886647f9e4e service nova] [instance: 6ed37390-f6a6-4cf7-8cab-b818f702083d] No waiting events found dispatching network-vif-plugged-04fa7f72-709c-42c1-be40-0cb4cbe31686 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:44:29 user nova-compute[75176]: WARNING nova.compute.manager [req-a46abac9-9e5e-4626-8281-ca48991ea4e6 req-0b5fd87e-f8e9-4b9b-a647-a886647f9e4e service nova] [instance: 6ed37390-f6a6-4cf7-8cab-b818f702083d] Received unexpected event network-vif-plugged-04fa7f72-709c-42c1-be40-0cb4cbe31686 for instance with vm_state building and task_state spawning.
Nov 28 15:44:31 user nova-compute[75176]: DEBUG nova.compute.manager [req-119faf7f-9595-47d6-b612-7f982f4fc48c req-e6755770-e88a-4b41-9e95-b822001817b8 service nova] [instance: 6ed37390-f6a6-4cf7-8cab-b818f702083d] Received event network-vif-plugged-04fa7f72-709c-42c1-be40-0cb4cbe31686 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:44:31 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-119faf7f-9595-47d6-b612-7f982f4fc48c req-e6755770-e88a-4b41-9e95-b822001817b8 service nova] Acquiring lock "6ed37390-f6a6-4cf7-8cab-b818f702083d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:44:31 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-119faf7f-9595-47d6-b612-7f982f4fc48c req-e6755770-e88a-4b41-9e95-b822001817b8 service nova] Lock "6ed37390-f6a6-4cf7-8cab-b818f702083d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:44:31 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-119faf7f-9595-47d6-b612-7f982f4fc48c req-e6755770-e88a-4b41-9e95-b822001817b8 service nova] Lock "6ed37390-f6a6-4cf7-8cab-b818f702083d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:44:31 user nova-compute[75176]: DEBUG nova.compute.manager [req-119faf7f-9595-47d6-b612-7f982f4fc48c req-e6755770-e88a-4b41-9e95-b822001817b8 service nova] [instance: 6ed37390-f6a6-4cf7-8cab-b818f702083d] No waiting events found dispatching network-vif-plugged-04fa7f72-709c-42c1-be40-0cb4cbe31686 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:44:31 user nova-compute[75176]: WARNING nova.compute.manager [req-119faf7f-9595-47d6-b612-7f982f4fc48c req-e6755770-e88a-4b41-9e95-b822001817b8 service nova] [instance: 6ed37390-f6a6-4cf7-8cab-b818f702083d] Received unexpected event network-vif-plugged-04fa7f72-709c-42c1-be40-0cb4cbe31686 for instance with vm_state building and task_state spawning.
Nov 28 15:44:31 user nova-compute[75176]: DEBUG nova.compute.manager [None req-78f6fb47-106e-410d-a143-408d701bfeba tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] [instance: 6ed37390-f6a6-4cf7-8cab-b818f702083d] Instance event wait completed in 0 seconds for  {{(pid=75176) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 15:44:31 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-78f6fb47-106e-410d-a143-408d701bfeba tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] [instance: 6ed37390-f6a6-4cf7-8cab-b818f702083d] Guest created on hypervisor {{(pid=75176) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 15:44:31 user nova-compute[75176]: INFO nova.virt.libvirt.driver [-] [instance: 6ed37390-f6a6-4cf7-8cab-b818f702083d] Instance spawned successfully.
Nov 28 15:44:31 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-78f6fb47-106e-410d-a143-408d701bfeba tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] [instance: 6ed37390-f6a6-4cf7-8cab-b818f702083d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 15:44:31 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-78f6fb47-106e-410d-a143-408d701bfeba tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] [instance: 6ed37390-f6a6-4cf7-8cab-b818f702083d] Found default for hw_cdrom_bus of ide {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:44:31 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-78f6fb47-106e-410d-a143-408d701bfeba tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] [instance: 6ed37390-f6a6-4cf7-8cab-b818f702083d] Found default for hw_disk_bus of virtio {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:44:31 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-78f6fb47-106e-410d-a143-408d701bfeba tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] [instance: 6ed37390-f6a6-4cf7-8cab-b818f702083d] Found default for hw_input_bus of None {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:44:31 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-78f6fb47-106e-410d-a143-408d701bfeba tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] [instance: 6ed37390-f6a6-4cf7-8cab-b818f702083d] Found default for hw_pointer_model of None {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:44:31 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-78f6fb47-106e-410d-a143-408d701bfeba tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] [instance: 6ed37390-f6a6-4cf7-8cab-b818f702083d] Found default for hw_video_model of virtio {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:44:31 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-78f6fb47-106e-410d-a143-408d701bfeba tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] [instance: 6ed37390-f6a6-4cf7-8cab-b818f702083d] Found default for hw_vif_model of virtio {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:44:31 user nova-compute[75176]: INFO nova.compute.manager [None req-78f6fb47-106e-410d-a143-408d701bfeba tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] [instance: 6ed37390-f6a6-4cf7-8cab-b818f702083d] Took 6.83 seconds to spawn the instance on the hypervisor.
Nov 28 15:44:31 user nova-compute[75176]: DEBUG nova.compute.manager [None req-78f6fb47-106e-410d-a143-408d701bfeba tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] [instance: 6ed37390-f6a6-4cf7-8cab-b818f702083d] Checking state {{(pid=75176) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 15:44:32 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:44:32 user nova-compute[75176]: INFO nova.compute.manager [None req-78f6fb47-106e-410d-a143-408d701bfeba tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] [instance: 6ed37390-f6a6-4cf7-8cab-b818f702083d] Took 7.99 seconds to build instance.
Nov 28 15:44:32 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-78f6fb47-106e-410d-a143-408d701bfeba tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Lock "6ed37390-f6a6-4cf7-8cab-b818f702083d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.137s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:44:33 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:44:36 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:44:37 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:44:38 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:44:38 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:44:42 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:44:43 user nova-compute[75176]: DEBUG nova.compute.manager [req-6373acc9-a1ff-4567-8558-ccb8832c241d req-3e28e739-2fcd-4fbf-9e58-0e7c5351f61f service nova] [instance: e02d1e69-5e74-43c3-8546-6044d31145f2] Received event network-changed-9a63b660-0280-42b9-868c-dbf0c26ee995 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:44:43 user nova-compute[75176]: DEBUG nova.compute.manager [req-6373acc9-a1ff-4567-8558-ccb8832c241d req-3e28e739-2fcd-4fbf-9e58-0e7c5351f61f service nova] [instance: e02d1e69-5e74-43c3-8546-6044d31145f2] Refreshing instance network info cache due to event network-changed-9a63b660-0280-42b9-868c-dbf0c26ee995. {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 15:44:43 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-6373acc9-a1ff-4567-8558-ccb8832c241d req-3e28e739-2fcd-4fbf-9e58-0e7c5351f61f service nova] Acquiring lock "refresh_cache-e02d1e69-5e74-43c3-8546-6044d31145f2" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:44:43 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-6373acc9-a1ff-4567-8558-ccb8832c241d req-3e28e739-2fcd-4fbf-9e58-0e7c5351f61f service nova] Acquired lock "refresh_cache-e02d1e69-5e74-43c3-8546-6044d31145f2" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:44:43 user nova-compute[75176]: DEBUG nova.network.neutron [req-6373acc9-a1ff-4567-8558-ccb8832c241d req-3e28e739-2fcd-4fbf-9e58-0e7c5351f61f service nova] [instance: e02d1e69-5e74-43c3-8546-6044d31145f2] Refreshing network info cache for port 9a63b660-0280-42b9-868c-dbf0c26ee995 {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 15:44:43 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:44:44 user nova-compute[75176]: DEBUG nova.network.neutron [req-6373acc9-a1ff-4567-8558-ccb8832c241d req-3e28e739-2fcd-4fbf-9e58-0e7c5351f61f service nova] [instance: e02d1e69-5e74-43c3-8546-6044d31145f2] Updated VIF entry in instance network info cache for port 9a63b660-0280-42b9-868c-dbf0c26ee995. {{(pid=75176) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 15:44:44 user nova-compute[75176]: DEBUG nova.network.neutron [req-6373acc9-a1ff-4567-8558-ccb8832c241d req-3e28e739-2fcd-4fbf-9e58-0e7c5351f61f service nova] [instance: e02d1e69-5e74-43c3-8546-6044d31145f2] Updating instance_info_cache with network_info: [{"id": "9a63b660-0280-42b9-868c-dbf0c26ee995", "address": "fa:16:3e:ed:a5:68", "network": {"id": "8b63f2d3-0683-4832-abc5-e4c796cf12ab", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-877608435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3704b38a2bd44cb78c28d3f6d86d9e60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a63b660-02", "ovs_interfaceid": "9a63b660-0280-42b9-868c-dbf0c26ee995", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:44:44 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-6373acc9-a1ff-4567-8558-ccb8832c241d req-3e28e739-2fcd-4fbf-9e58-0e7c5351f61f service nova] Releasing lock "refresh_cache-e02d1e69-5e74-43c3-8546-6044d31145f2" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:44:44 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-0d7ca750-b799-412f-85e0-f05b629a2958 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Acquiring lock "e02d1e69-5e74-43c3-8546-6044d31145f2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:44:44 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-0d7ca750-b799-412f-85e0-f05b629a2958 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Lock "e02d1e69-5e74-43c3-8546-6044d31145f2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:44:44 user nova-compute[75176]: DEBUG nova.objects.instance [None req-0d7ca750-b799-412f-85e0-f05b629a2958 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Lazy-loading 'flavor' on Instance uuid e02d1e69-5e74-43c3-8546-6044d31145f2 {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:44:44 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-0d7ca750-b799-412f-85e0-f05b629a2958 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Lock "e02d1e69-5e74-43c3-8546-6044d31145f2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.066s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:44:44 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-0d7ca750-b799-412f-85e0-f05b629a2958 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Acquiring lock "e02d1e69-5e74-43c3-8546-6044d31145f2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:44:44 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-0d7ca750-b799-412f-85e0-f05b629a2958 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Lock "e02d1e69-5e74-43c3-8546-6044d31145f2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:44:44 user nova-compute[75176]: INFO nova.compute.manager [None req-0d7ca750-b799-412f-85e0-f05b629a2958 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] [instance: e02d1e69-5e74-43c3-8546-6044d31145f2] Attaching volume b424d718-a756-4599-a969-530c2d3c3c24 to /dev/vdb
Nov 28 15:44:44 user nova-compute[75176]: DEBUG os_brick.utils [None req-0d7ca750-b799-412f-85e0-f05b629a2958 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 15:44:44 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:44:44 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:44:44 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9a5efad-a366-4687-aaad-19f96946fb01]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:edc924a949b2\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:44:44 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:44:44 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:44:44 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[082636d7-bbe0-4fea-91e7-53c71d3b59ea]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:44:44 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:44:44 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:44:44 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Cleaning up deleted instances {{(pid=75176) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 28 15:44:44 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:44:44 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[05686479-3a3d-4fbc-b3b9-a36872cb5c07]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:44:44 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[188bc2e3-4df0-46be-bc3b-56521f7763d2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:44:44 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-0d7ca750-b799-412f-85e0-f05b629a2958 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Running cmd (subprocess): nvme version {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:44:44 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-0d7ca750-b799-412f-85e0-f05b629a2958 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] 'nvme version' failed. Not Retrying. {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 15:44:44 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0d7ca750-b799-412f-85e0-f05b629a2958 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] nvme not present on system {{(pid=75176) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 15:44:44 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] There are 0 instances to clean {{(pid=75176) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 28 15:44:44 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:44:44 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 15:44:44 user nova-compute[75176]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 15:44:44 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[45ac192c-a33b-477b-82b4-e1afd3e40ed7]: (4, '') {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:44:44 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.lightos [None req-0d7ca750-b799-412f-85e0-f05b629a2958 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75176) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 15:44:44 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.lightos [None req-0d7ca750-b799-412f-85e0-f05b629a2958 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75176) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 15:44:44 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.lightos [None req-0d7ca750-b799-412f-85e0-f05b629a2958 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] LIGHTOS: no hostnqn found. {{(pid=75176) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 15:44:44 user nova-compute[75176]: DEBUG os_brick.utils [None req-0d7ca750-b799-412f-85e0-f05b629a2958 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:edc924a949b2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 15:44:44 user nova-compute[75176]: DEBUG nova.virt.block_device [None req-0d7ca750-b799-412f-85e0-f05b629a2958 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] [instance: e02d1e69-5e74-43c3-8546-6044d31145f2] Updating existing volume attachment record: ecae2954-a539-4444-acd0-e71b6fad83bc {{(pid=75176) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 15:44:46 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:44:47 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:44:48 user nova-compute[75176]: INFO nova.compute.manager [None req-bcc2015d-ea2a-4107-8bc9-601378f7fb21 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] [instance: 6ab0619f-72e5-4975-ade8-53d7c0784d89] Unrescuing
Nov 28 15:44:48 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-bcc2015d-ea2a-4107-8bc9-601378f7fb21 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] Acquiring lock "refresh_cache-6ab0619f-72e5-4975-ade8-53d7c0784d89" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:44:48 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-bcc2015d-ea2a-4107-8bc9-601378f7fb21 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] Acquired lock "refresh_cache-6ab0619f-72e5-4975-ade8-53d7c0784d89" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:44:48 user nova-compute[75176]: DEBUG nova.network.neutron [None req-bcc2015d-ea2a-4107-8bc9-601378f7fb21 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] [instance: 6ab0619f-72e5-4975-ade8-53d7c0784d89] Building network info cache for instance {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 15:44:48 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:44:49 user nova-compute[75176]: DEBUG nova.network.neutron [None req-bcc2015d-ea2a-4107-8bc9-601378f7fb21 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] [instance: 6ab0619f-72e5-4975-ade8-53d7c0784d89] Updating instance_info_cache with network_info: [{"id": "63e3a2a2-51d4-4899-806d-c3222f643878", "address": "fa:16:3e:4d:46:79", "network": {"id": "84bcb9a8-0292-4eed-a9eb-2a883619389c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1655598964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fa05294c527426383c66fe58b31c825", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63e3a2a2-51", "ovs_interfaceid": "63e3a2a2-51d4-4899-806d-c3222f643878", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:44:49 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-bcc2015d-ea2a-4107-8bc9-601378f7fb21 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] Releasing lock "refresh_cache-6ab0619f-72e5-4975-ade8-53d7c0784d89" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:44:49 user nova-compute[75176]: DEBUG nova.objects.instance [None req-bcc2015d-ea2a-4107-8bc9-601378f7fb21 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] Lazy-loading 'flavor' on Instance uuid 6ab0619f-72e5-4975-ade8-53d7c0784d89 {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:44:49 user nova-compute[75176]: DEBUG nova.compute.manager [req-0289eddd-7b6f-4a81-9a61-c71da7d052c3 req-a761a61c-0d80-44bc-bf91-9a48c01bc1e4 service nova] [instance: 6ab0619f-72e5-4975-ade8-53d7c0784d89] Received event network-changed-63e3a2a2-51d4-4899-806d-c3222f643878 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:44:49 user nova-compute[75176]: DEBUG nova.compute.manager [req-0289eddd-7b6f-4a81-9a61-c71da7d052c3 req-a761a61c-0d80-44bc-bf91-9a48c01bc1e4 service nova] [instance: 6ab0619f-72e5-4975-ade8-53d7c0784d89] Refreshing instance network info cache due to event network-changed-63e3a2a2-51d4-4899-806d-c3222f643878. {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 15:44:49 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-0289eddd-7b6f-4a81-9a61-c71da7d052c3 req-a761a61c-0d80-44bc-bf91-9a48c01bc1e4 service nova] Acquiring lock "refresh_cache-6ab0619f-72e5-4975-ade8-53d7c0784d89" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:44:49 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-0289eddd-7b6f-4a81-9a61-c71da7d052c3 req-a761a61c-0d80-44bc-bf91-9a48c01bc1e4 service nova] Acquired lock "refresh_cache-6ab0619f-72e5-4975-ade8-53d7c0784d89" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:44:49 user nova-compute[75176]: DEBUG nova.network.neutron [req-0289eddd-7b6f-4a81-9a61-c71da7d052c3 req-a761a61c-0d80-44bc-bf91-9a48c01bc1e4 service nova] [instance: 6ab0619f-72e5-4975-ade8-53d7c0784d89] Refreshing network info cache for port 63e3a2a2-51d4-4899-806d-c3222f643878 {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 15:44:49 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:44:49 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:44:49 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:44:49 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:44:49 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:44:49 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:44:49 user nova-compute[75176]: DEBUG nova.compute.manager [req-c5ee2a89-3b5f-4082-8826-9df8a7cca4c3 req-aa07d496-dd40-468e-b35a-290ff4b33048 service nova] [instance: 6ab0619f-72e5-4975-ade8-53d7c0784d89] Received event network-vif-unplugged-63e3a2a2-51d4-4899-806d-c3222f643878 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:44:49 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-c5ee2a89-3b5f-4082-8826-9df8a7cca4c3 req-aa07d496-dd40-468e-b35a-290ff4b33048 service nova] Acquiring lock "6ab0619f-72e5-4975-ade8-53d7c0784d89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:44:49 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-c5ee2a89-3b5f-4082-8826-9df8a7cca4c3 req-aa07d496-dd40-468e-b35a-290ff4b33048 service nova] Lock "6ab0619f-72e5-4975-ade8-53d7c0784d89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:44:49 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-c5ee2a89-3b5f-4082-8826-9df8a7cca4c3 req-aa07d496-dd40-468e-b35a-290ff4b33048 service nova] Lock "6ab0619f-72e5-4975-ade8-53d7c0784d89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:44:49 user nova-compute[75176]: DEBUG nova.compute.manager [req-c5ee2a89-3b5f-4082-8826-9df8a7cca4c3 req-aa07d496-dd40-468e-b35a-290ff4b33048 service nova] [instance: 6ab0619f-72e5-4975-ade8-53d7c0784d89] No waiting events found dispatching network-vif-unplugged-63e3a2a2-51d4-4899-806d-c3222f643878 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:44:49 user nova-compute[75176]: WARNING nova.compute.manager [req-c5ee2a89-3b5f-4082-8826-9df8a7cca4c3 req-aa07d496-dd40-468e-b35a-290ff4b33048 service nova] [instance: 6ab0619f-72e5-4975-ade8-53d7c0784d89] Received unexpected event network-vif-unplugged-63e3a2a2-51d4-4899-806d-c3222f643878 for instance with vm_state rescued and task_state unrescuing.
Nov 28 15:44:50 user nova-compute[75176]: DEBUG nova.network.neutron [req-0289eddd-7b6f-4a81-9a61-c71da7d052c3 req-a761a61c-0d80-44bc-bf91-9a48c01bc1e4 service nova] [instance: 6ab0619f-72e5-4975-ade8-53d7c0784d89] Updated VIF entry in instance network info cache for port 63e3a2a2-51d4-4899-806d-c3222f643878. {{(pid=75176) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 15:44:50 user nova-compute[75176]: DEBUG nova.network.neutron [req-0289eddd-7b6f-4a81-9a61-c71da7d052c3 req-a761a61c-0d80-44bc-bf91-9a48c01bc1e4 service nova] [instance: 6ab0619f-72e5-4975-ade8-53d7c0784d89] Updating instance_info_cache with network_info: [{"id": "63e3a2a2-51d4-4899-806d-c3222f643878", "address": "fa:16:3e:4d:46:79", "network": {"id": "84bcb9a8-0292-4eed-a9eb-2a883619389c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1655598964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fa05294c527426383c66fe58b31c825", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63e3a2a2-51", "ovs_interfaceid": "63e3a2a2-51d4-4899-806d-c3222f643878", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:44:50 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-0289eddd-7b6f-4a81-9a61-c71da7d052c3 req-a761a61c-0d80-44bc-bf91-9a48c01bc1e4 service nova] Releasing lock "refresh_cache-6ab0619f-72e5-4975-ade8-53d7c0784d89" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:44:50 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-2533b91b-acad-441b-a335-11b934f19ede tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Acquiring lock "7b4c281e-5b8d-43b1-8914-572e1341c0a7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:44:50 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-2533b91b-acad-441b-a335-11b934f19ede tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Lock "7b4c281e-5b8d-43b1-8914-572e1341c0a7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:44:50 user nova-compute[75176]: DEBUG nova.compute.manager [None req-2533b91b-acad-441b-a335-11b934f19ede tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] [instance: 7b4c281e-5b8d-43b1-8914-572e1341c0a7] Starting instance... {{(pid=75176) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 15:44:50 user nova-compute[75176]: INFO nova.virt.libvirt.driver [-] [instance: 6ab0619f-72e5-4975-ade8-53d7c0784d89] Instance destroyed successfully.
Nov 28 15:44:50 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-2533b91b-acad-441b-a335-11b934f19ede tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:44:50 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-2533b91b-acad-441b-a335-11b934f19ede tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:44:50 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-2533b91b-acad-441b-a335-11b934f19ede tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75176) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 15:44:50 user nova-compute[75176]: INFO nova.compute.claims [None req-2533b91b-acad-441b-a335-11b934f19ede tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] [instance: 7b4c281e-5b8d-43b1-8914-572e1341c0a7] Claim successful on node user
Nov 28 15:44:50 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:44:50 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:44:50 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:44:50 user nova-compute[75176]: DEBUG nova.compute.provider_tree [None req-2533b91b-acad-441b-a335-11b934f19ede tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Inventory has not changed in ProviderTree for provider: b37848d8-f401-4155-a029-b0ffa09ff85b {{(pid=75176) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 15:44:50 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-2533b91b-acad-441b-a335-11b934f19ede tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Inventory has not changed for provider b37848d8-f401-4155-a029-b0ffa09ff85b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75176) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 15:44:50 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-2533b91b-acad-441b-a335-11b934f19ede tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.554s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:44:50 user nova-compute[75176]: DEBUG nova.compute.manager [None req-2533b91b-acad-441b-a335-11b934f19ede tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] [instance: 7b4c281e-5b8d-43b1-8914-572e1341c0a7] Start building networks asynchronously for instance. {{(pid=75176) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 15:44:50 user nova-compute[75176]: DEBUG nova.compute.manager [None req-2533b91b-acad-441b-a335-11b934f19ede tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] [instance: 7b4c281e-5b8d-43b1-8914-572e1341c0a7] Allocating IP information in the background. {{(pid=75176) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 15:44:50 user nova-compute[75176]: DEBUG nova.network.neutron [None req-2533b91b-acad-441b-a335-11b934f19ede tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] [instance: 7b4c281e-5b8d-43b1-8914-572e1341c0a7] allocate_for_instance() {{(pid=75176) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 15:44:51 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-2533b91b-acad-441b-a335-11b934f19ede tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] [instance: 7b4c281e-5b8d-43b1-8914-572e1341c0a7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 15:44:51 user nova-compute[75176]: DEBUG nova.compute.manager [None req-2533b91b-acad-441b-a335-11b934f19ede tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] [instance: 7b4c281e-5b8d-43b1-8914-572e1341c0a7] Start building block device mappings for instance. {{(pid=75176) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 15:44:51 user nova-compute[75176]: DEBUG nova.policy [None req-2533b91b-acad-441b-a335-11b934f19ede tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd8d2394765354c83942d4eafbb437794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3669019a110245d19a8ac85b5b20d2bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75176) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 15:44:51 user nova-compute[75176]: DEBUG nova.compute.manager [None req-2533b91b-acad-441b-a335-11b934f19ede tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] [instance: 7b4c281e-5b8d-43b1-8914-572e1341c0a7] Start spawning the instance on the hypervisor. {{(pid=75176) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 15:44:51 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-2533b91b-acad-441b-a335-11b934f19ede tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] [instance: 7b4c281e-5b8d-43b1-8914-572e1341c0a7] Creating instance directory {{(pid=75176) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 15:44:51 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-2533b91b-acad-441b-a335-11b934f19ede tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] [instance: 7b4c281e-5b8d-43b1-8914-572e1341c0a7] Creating image(s)
Nov 28 15:44:51 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-2533b91b-acad-441b-a335-11b934f19ede tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Acquiring lock "/opt/stack/data/nova/instances/7b4c281e-5b8d-43b1-8914-572e1341c0a7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:44:51 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-2533b91b-acad-441b-a335-11b934f19ede tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Lock "/opt/stack/data/nova/instances/7b4c281e-5b8d-43b1-8914-572e1341c0a7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:44:51 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-2533b91b-acad-441b-a335-11b934f19ede tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Lock "/opt/stack/data/nova/instances/7b4c281e-5b8d-43b1-8914-572e1341c0a7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:44:51 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-2533b91b-acad-441b-a335-11b934f19ede tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:44:51 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-2533b91b-acad-441b-a335-11b934f19ede tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json" returned: 0 in 0.175s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:44:51 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-2533b91b-acad-441b-a335-11b934f19ede tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Acquiring lock "5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:44:51 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-2533b91b-acad-441b-a335-11b934f19ede tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Lock "5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:44:51 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-2533b91b-acad-441b-a335-11b934f19ede tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:44:51 user nova-compute[75176]: DEBUG nova.compute.manager [req-3f90a544-dd99-4367-bc03-104efb88d021 req-27798cb4-b094-4e53-b34b-0e95c7783563 service nova] [instance: 6ab0619f-72e5-4975-ade8-53d7c0784d89] Received event network-changed-63e3a2a2-51d4-4899-806d-c3222f643878 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:44:51 user nova-compute[75176]: DEBUG nova.compute.manager [req-3f90a544-dd99-4367-bc03-104efb88d021 req-27798cb4-b094-4e53-b34b-0e95c7783563 service nova] [instance: 6ab0619f-72e5-4975-ade8-53d7c0784d89] Refreshing instance network info cache due to event network-changed-63e3a2a2-51d4-4899-806d-c3222f643878. {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 15:44:51 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-3f90a544-dd99-4367-bc03-104efb88d021 req-27798cb4-b094-4e53-b34b-0e95c7783563 service nova] Acquiring lock "refresh_cache-6ab0619f-72e5-4975-ade8-53d7c0784d89" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:44:51 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-3f90a544-dd99-4367-bc03-104efb88d021 req-27798cb4-b094-4e53-b34b-0e95c7783563 service nova] Acquired lock "refresh_cache-6ab0619f-72e5-4975-ade8-53d7c0784d89" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:44:51 user nova-compute[75176]: DEBUG nova.network.neutron [req-3f90a544-dd99-4367-bc03-104efb88d021 req-27798cb4-b094-4e53-b34b-0e95c7783563 service nova] [instance: 6ab0619f-72e5-4975-ade8-53d7c0784d89] Refreshing network info cache for port 63e3a2a2-51d4-4899-806d-c3222f643878 {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 15:44:51 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-2533b91b-acad-441b-a335-11b934f19ede tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json" returned: 0 in 0.197s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:44:51 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-2533b91b-acad-441b-a335-11b934f19ede tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2,backing_fmt=raw /opt/stack/data/nova/instances/7b4c281e-5b8d-43b1-8914-572e1341c0a7/disk 1073741824 {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:44:51 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-2533b91b-acad-441b-a335-11b934f19ede tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2,backing_fmt=raw /opt/stack/data/nova/instances/7b4c281e-5b8d-43b1-8914-572e1341c0a7/disk 1073741824" returned: 0 in 0.057s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:44:51 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-2533b91b-acad-441b-a335-11b934f19ede tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Lock "5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.261s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:44:51 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-2533b91b-acad-441b-a335-11b934f19ede tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:44:51 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:44:51 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:44:51 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:44:51 user nova-compute[75176]: DEBUG nova.network.neutron [None req-2533b91b-acad-441b-a335-11b934f19ede tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] [instance: 7b4c281e-5b8d-43b1-8914-572e1341c0a7] Successfully created port: cfbc5129-eb64-42bb-bec3-cd56a2ec733c {{(pid=75176) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 15:44:51 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:44:51 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:44:51 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:44:51 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Auditing locally available compute resources for user (node: user) {{(pid=75176) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 15:44:51 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:44:51 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:44:51 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:44:51 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:44:51 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-2533b91b-acad-441b-a335-11b934f19ede tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json" returned: 0 in 0.254s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:44:51 user nova-compute[75176]: DEBUG nova.virt.disk.api [None req-2533b91b-acad-441b-a335-11b934f19ede tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7b4c281e-5b8d-43b1-8914-572e1341c0a7/disk. size=1073741824 {{(pid=75176) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 15:44:51 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-2533b91b-acad-441b-a335-11b934f19ede tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b4c281e-5b8d-43b1-8914-572e1341c0a7/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:44:52 user nova-compute[75176]: DEBUG nova.compute.manager [req-7038c3f2-1e38-4cbd-88a0-8b72f5a54607 req-84905a1e-51a8-4d15-a7e3-91d6dbdb2802 service nova] [instance: 6ab0619f-72e5-4975-ade8-53d7c0784d89] Received event network-vif-plugged-63e3a2a2-51d4-4899-806d-c3222f643878 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:44:52 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-7038c3f2-1e38-4cbd-88a0-8b72f5a54607 req-84905a1e-51a8-4d15-a7e3-91d6dbdb2802 service nova] Acquiring lock "6ab0619f-72e5-4975-ade8-53d7c0784d89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:44:52 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-7038c3f2-1e38-4cbd-88a0-8b72f5a54607 req-84905a1e-51a8-4d15-a7e3-91d6dbdb2802 service nova] Lock "6ab0619f-72e5-4975-ade8-53d7c0784d89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:44:52 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-7038c3f2-1e38-4cbd-88a0-8b72f5a54607 req-84905a1e-51a8-4d15-a7e3-91d6dbdb2802 service nova] Lock "6ab0619f-72e5-4975-ade8-53d7c0784d89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:44:52 user nova-compute[75176]: DEBUG nova.compute.manager [req-7038c3f2-1e38-4cbd-88a0-8b72f5a54607 req-84905a1e-51a8-4d15-a7e3-91d6dbdb2802 service nova] [instance: 6ab0619f-72e5-4975-ade8-53d7c0784d89] No waiting events found dispatching network-vif-plugged-63e3a2a2-51d4-4899-806d-c3222f643878 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:44:52 user nova-compute[75176]: WARNING nova.compute.manager [req-7038c3f2-1e38-4cbd-88a0-8b72f5a54607 req-84905a1e-51a8-4d15-a7e3-91d6dbdb2802 service nova] [instance: 6ab0619f-72e5-4975-ade8-53d7c0784d89] Received unexpected event network-vif-plugged-63e3a2a2-51d4-4899-806d-c3222f643878 for instance with vm_state rescued and task_state unrescuing.
Nov 28 15:44:52 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-2533b91b-acad-441b-a335-11b934f19ede tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b4c281e-5b8d-43b1-8914-572e1341c0a7/disk --force-share --output=json" returned: 0 in 0.275s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:44:52 user nova-compute[75176]: DEBUG nova.virt.disk.api [None req-2533b91b-acad-441b-a335-11b934f19ede tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Cannot resize image /opt/stack/data/nova/instances/7b4c281e-5b8d-43b1-8914-572e1341c0a7/disk to a smaller size. {{(pid=75176) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 15:44:52 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-2533b91b-acad-441b-a335-11b934f19ede tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] [instance: 7b4c281e-5b8d-43b1-8914-572e1341c0a7] Created local disks {{(pid=75176) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 15:44:52 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-2533b91b-acad-441b-a335-11b934f19ede tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] [instance: 7b4c281e-5b8d-43b1-8914-572e1341c0a7] Ensure instance console log exists: /opt/stack/data/nova/instances/7b4c281e-5b8d-43b1-8914-572e1341c0a7/console.log {{(pid=75176) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 15:44:52 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-2533b91b-acad-441b-a335-11b934f19ede tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:44:52 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-2533b91b-acad-441b-a335-11b934f19ede tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:44:52 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-2533b91b-acad-441b-a335-11b934f19ede tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:44:52 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:44:52 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ed37390-f6a6-4cf7-8cab-b818f702083d/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:44:52 user nova-compute[75176]: DEBUG nova.network.neutron [None req-2533b91b-acad-441b-a335-11b934f19ede tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] [instance: 7b4c281e-5b8d-43b1-8914-572e1341c0a7] Successfully updated port: cfbc5129-eb64-42bb-bec3-cd56a2ec733c {{(pid=75176) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 15:44:52 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-2533b91b-acad-441b-a335-11b934f19ede tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Acquiring lock "refresh_cache-7b4c281e-5b8d-43b1-8914-572e1341c0a7" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:44:52 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-2533b91b-acad-441b-a335-11b934f19ede tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Acquired lock "refresh_cache-7b4c281e-5b8d-43b1-8914-572e1341c0a7" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:44:52 user nova-compute[75176]: DEBUG nova.network.neutron [None req-2533b91b-acad-441b-a335-11b934f19ede tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] [instance: 7b4c281e-5b8d-43b1-8914-572e1341c0a7] Building network info cache for instance {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 15:44:52 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:44:52 user nova-compute[75176]: DEBUG nova.compute.manager [req-b6781ca4-ced0-4caf-871d-4cd9904901ca req-ebffb1bb-4e5d-476b-84b3-4164740fb967 service nova] [instance: 7b4c281e-5b8d-43b1-8914-572e1341c0a7] Received event network-changed-cfbc5129-eb64-42bb-bec3-cd56a2ec733c {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:44:52 user nova-compute[75176]: DEBUG nova.compute.manager [req-b6781ca4-ced0-4caf-871d-4cd9904901ca req-ebffb1bb-4e5d-476b-84b3-4164740fb967 service nova] [instance: 7b4c281e-5b8d-43b1-8914-572e1341c0a7] Refreshing instance network info cache due to event network-changed-cfbc5129-eb64-42bb-bec3-cd56a2ec733c. {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 15:44:52 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-b6781ca4-ced0-4caf-871d-4cd9904901ca req-ebffb1bb-4e5d-476b-84b3-4164740fb967 service nova] Acquiring lock "refresh_cache-7b4c281e-5b8d-43b1-8914-572e1341c0a7" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:44:52 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:44:52 user nova-compute[75176]: DEBUG nova.network.neutron [None req-2533b91b-acad-441b-a335-11b934f19ede tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] [instance: 7b4c281e-5b8d-43b1-8914-572e1341c0a7] Instance cache missing network info. {{(pid=75176) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 15:44:52 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ed37390-f6a6-4cf7-8cab-b818f702083d/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:44:52 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ed37390-f6a6-4cf7-8cab-b818f702083d/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:44:52 user nova-compute[75176]: DEBUG nova.network.neutron [req-3f90a544-dd99-4367-bc03-104efb88d021 req-27798cb4-b094-4e53-b34b-0e95c7783563 service nova] [instance: 6ab0619f-72e5-4975-ade8-53d7c0784d89] Updated VIF entry in instance network info cache for port 63e3a2a2-51d4-4899-806d-c3222f643878. {{(pid=75176) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 15:44:52 user nova-compute[75176]: DEBUG nova.network.neutron [req-3f90a544-dd99-4367-bc03-104efb88d021 req-27798cb4-b094-4e53-b34b-0e95c7783563 service nova] [instance: 6ab0619f-72e5-4975-ade8-53d7c0784d89] Updating instance_info_cache with network_info: [{"id": "63e3a2a2-51d4-4899-806d-c3222f643878", "address": "fa:16:3e:4d:46:79", "network": {"id": "84bcb9a8-0292-4eed-a9eb-2a883619389c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1655598964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fa05294c527426383c66fe58b31c825", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63e3a2a2-51", "ovs_interfaceid": "63e3a2a2-51d4-4899-806d-c3222f643878", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:44:52 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-3f90a544-dd99-4367-bc03-104efb88d021 req-27798cb4-b094-4e53-b34b-0e95c7783563 service nova] Releasing lock "refresh_cache-6ab0619f-72e5-4975-ade8-53d7c0784d89" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:44:52 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ed37390-f6a6-4cf7-8cab-b818f702083d/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:44:52 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47306d53-9ad7-4cae-ba6d-1f65239ef30f/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:44:52 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d7ca750-b799-412f-85e0-f05b629a2958 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] [instance: e02d1e69-5e74-43c3-8546-6044d31145f2] Calling os-brick to attach iSCSI Volume {{(pid=75176) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 15:44:53 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d7ca750-b799-412f-85e0-f05b629a2958 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c1b8a00>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'grxAmRcs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 15:44:53 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-0d7ca750-b799-412f-85e0-f05b629a2958 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 15:44:53 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-0d7ca750-b799-412f-85e0-f05b629a2958 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 15:44:53 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-0d7ca750-b799-412f-85e0-f05b629a2958 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 15:44:53 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-0d7ca750-b799-412f-85e0-f05b629a2958 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 15:44:53 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-0d7ca750-b799-412f-85e0-f05b629a2958 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 15:44:53 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-0d7ca750-b799-412f-85e0-f05b629a2958 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 15:44:53 user nova-compute[75176]: INFO os_brick.initiator.connectors.iscsi [None req-0d7ca750-b799-412f-85e0-f05b629a2958 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 15:44:53 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:44:53 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24 -p 172.16.0.220:3260 {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:44:53 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:44:53 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdbd441d-69de-4cab-977f-218155bb002a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:44:53 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d7ca750-b799-412f-85e0-f05b629a2958 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 15:44:53 user nova-compute[75176]:  {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:44:53 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24 -p 172.16.0.220:3260 --interface default --op new {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:44:53 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:44:53 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b88c32f-eaf1-4ab5-89b2-89093012545a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24] added\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:44:53 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d7ca750-b799-412f-85e0-f05b629a2958 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24] added
Nov 28 15:44:53 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:44:53 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:44:53 user nova-compute[75176]: DEBUG nova.network.neutron [None req-2533b91b-acad-441b-a335-11b934f19ede tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] [instance: 7b4c281e-5b8d-43b1-8914-572e1341c0a7] Updating instance_info_cache with network_info: [{"id": "cfbc5129-eb64-42bb-bec3-cd56a2ec733c", "address": "fa:16:3e:07:68:e7", "network": {"id": "0478f649-0c69-414b-84c3-3ef4604d6062", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-695624980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3669019a110245d19a8ac85b5b20d2bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfbc5129-eb", "ovs_interfaceid": "cfbc5129-eb64-42bb-bec3-cd56a2ec733c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:44:53 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47306d53-9ad7-4cae-ba6d-1f65239ef30f/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:44:53 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47306d53-9ad7-4cae-ba6d-1f65239ef30f/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:44:53 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:44:53 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb017aad-37df-473c-a3e4-90ca024bd880]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:44:53 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d7ca750-b799-412f-85e0-f05b629a2958 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:44:53 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-2533b91b-acad-441b-a335-11b934f19ede tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Releasing lock "refresh_cache-7b4c281e-5b8d-43b1-8914-572e1341c0a7" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:44:53 user nova-compute[75176]: DEBUG nova.compute.manager [None req-2533b91b-acad-441b-a335-11b934f19ede tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] [instance: 7b4c281e-5b8d-43b1-8914-572e1341c0a7] Instance network_info: |[{"id": "cfbc5129-eb64-42bb-bec3-cd56a2ec733c", "address": "fa:16:3e:07:68:e7", "network": {"id": "0478f649-0c69-414b-84c3-3ef4604d6062", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-695624980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3669019a110245d19a8ac85b5b20d2bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfbc5129-eb", "ovs_interfaceid": "cfbc5129-eb64-42bb-bec3-cd56a2ec733c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75176) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 15:44:53 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:44:53 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-b6781ca4-ced0-4caf-871d-4cd9904901ca req-ebffb1bb-4e5d-476b-84b3-4164740fb967 service nova] Acquired lock "refresh_cache-7b4c281e-5b8d-43b1-8914-572e1341c0a7" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:44:53 user nova-compute[75176]: DEBUG nova.network.neutron [req-b6781ca4-ced0-4caf-871d-4cd9904901ca req-ebffb1bb-4e5d-476b-84b3-4164740fb967 service nova] [instance: 7b4c281e-5b8d-43b1-8914-572e1341c0a7] Refreshing network info cache for port cfbc5129-eb64-42bb-bec3-cd56a2ec733c {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 15:44:53 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-2533b91b-acad-441b-a335-11b934f19ede tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] [instance: 7b4c281e-5b8d-43b1-8914-572e1341c0a7] Start _get_guest_xml network_info=[{"id": "cfbc5129-eb64-42bb-bec3-cd56a2ec733c", "address": "fa:16:3e:07:68:e7", "network": {"id": "0478f649-0c69-414b-84c3-3ef4604d6062", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-695624980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3669019a110245d19a8ac85b5b20d2bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfbc5129-eb", "ovs_interfaceid": "cfbc5129-eb64-42bb-bec3-cd56a2ec733c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T15:35:12Z,direct_url=<?>,disk_format='qcow2',id=1f41819e-c93f-4dc7-b253-37a27bbbbc74,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1b91c5d0672c4224a48df2e1f92688e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T15:35:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'size': 0, 'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'image_id': '1f41819e-c93f-4dc7-b253-37a27bbbbc74'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75176) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 15:44:53 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:44:53 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[b57b78f7-2407-4b96-b819-2f7c0328acf5]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:44:53 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d7ca750-b799-412f-85e0-f05b629a2958 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:44:53 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v grxAmRcs {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:44:53 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v grxAmRcs" returned: 0 in 0.030s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:44:53 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[01ce573b-ac20-41cb-9a9e-9a102350eece]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:44:53 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d7ca750-b799-412f-85e0-f05b629a2958 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'grxAmRcs'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:44:53 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-2533b91b-acad-441b-a335-11b934f19ede tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 15:44:53 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-2533b91b-acad-441b-a335-11b934f19ede tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 15:44:53 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:44:53 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-2533b91b-acad-441b-a335-11b934f19ede tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75176) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 15:44:53 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-2533b91b-acad-441b-a335-11b934f19ede tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] CPU controller missing on host. {{(pid=75176) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 15:44:53 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-2533b91b-acad-441b-a335-11b934f19ede tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75176) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 15:44:53 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-2533b91b-acad-441b-a335-11b934f19ede tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] CPU controller found on host. {{(pid=75176) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 15:44:53 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-2533b91b-acad-441b-a335-11b934f19ede tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75176) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 15:44:53 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-2533b91b-acad-441b-a335-11b934f19ede tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T15:35:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T15:35:12Z,direct_url=<?>,disk_format='qcow2',id=1f41819e-c93f-4dc7-b253-37a27bbbbc74,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1b91c5d0672c4224a48df2e1f92688e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T15:35:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 15:44:53 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-2533b91b-acad-441b-a335-11b934f19ede tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Flavor limits 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 15:44:53 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-2533b91b-acad-441b-a335-11b934f19ede tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Image limits 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 15:44:53 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-2533b91b-acad-441b-a335-11b934f19ede tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Flavor pref 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 15:44:53 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-2533b91b-acad-441b-a335-11b934f19ede tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Image pref 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 15:44:53 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-2533b91b-acad-441b-a335-11b934f19ede tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 15:44:53 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-2533b91b-acad-441b-a335-11b934f19ede tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 15:44:53 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-2533b91b-acad-441b-a335-11b934f19ede tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75176) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 15:44:53 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-2533b91b-acad-441b-a335-11b934f19ede tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Got 1 possible topologies {{(pid=75176) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 15:44:53 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-2533b91b-acad-441b-a335-11b934f19ede tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 15:44:53 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-2533b91b-acad-441b-a335-11b934f19ede tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 15:44:53 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-2533b91b-acad-441b-a335-11b934f19ede tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T15:44:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-119652217',display_name='tempest-VolumesSnapshotTestJSON-instance-119652217',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-119652217',id=20,image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIX98hMVZy4VbyZtEbNYxY5GDZTytWVzAkwts44r99B8WhDU8T4DSEtoo4wnYPgRCrr1ry6NjRSu3tBFP9rpvjFXWaCyWrLMKGh5YZtz9BnbG83OWHcKYL6NLwjmY/UUeg==',key_name='tempest-keypair-63260765',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3669019a110245d19a8ac85b5b20d2bd',ramdisk_id='',reservation_id='r-mcmae38u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-2135242619',owner_user_name='tempest-VolumesSnapshotTestJSON-2135242619-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T15:44:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d8d2394765354c83942d4eafbb437794',uuid=7b4c281e-5b8d-43b1-8914-572e1341c0a7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cfbc5129-eb64-42bb-bec3-cd56a2ec733c", "address": "fa:16:3e:07:68:e7", "network": {"id": "0478f649-0c69-414b-84c3-3ef4604d6062", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-695624980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3669019a110245d19a8ac85b5b20d2bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfbc5129-eb", "ovs_interfaceid": "cfbc5129-eb64-42bb-bec3-cd56a2ec733c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75176) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 15:44:53 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-2533b91b-acad-441b-a335-11b934f19ede tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Converting VIF {"id": "cfbc5129-eb64-42bb-bec3-cd56a2ec733c", "address": "fa:16:3e:07:68:e7", "network": {"id": "0478f649-0c69-414b-84c3-3ef4604d6062", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-695624980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3669019a110245d19a8ac85b5b20d2bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfbc5129-eb", "ovs_interfaceid": "cfbc5129-eb64-42bb-bec3-cd56a2ec733c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:44:53 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-2533b91b-acad-441b-a335-11b934f19ede tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:68:e7,bridge_name='br-int',has_traffic_filtering=True,id=cfbc5129-eb64-42bb-bec3-cd56a2ec733c,network=Network(0478f649-0c69-414b-84c3-3ef4604d6062),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfbc5129-eb') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:44:53 user nova-compute[75176]: DEBUG nova.objects.instance [None req-2533b91b-acad-441b-a335-11b934f19ede tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Lazy-loading 'pci_devices' on Instance uuid 7b4c281e-5b8d-43b1-8914-572e1341c0a7 {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:44:53 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:44:53 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[00fade2e-a6b5-49f6-8898-e6862a780b09]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:44:53 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d7ca750-b799-412f-85e0-f05b629a2958 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:44:53 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47306d53-9ad7-4cae-ba6d-1f65239ef30f/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:44:53 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75176) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 15:44:53 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:44:53 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-2533b91b-acad-441b-a335-11b934f19ede tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] [instance: 7b4c281e-5b8d-43b1-8914-572e1341c0a7] End _get_guest_xml xml=<domain type="kvm">
Nov 28 15:44:53 user nova-compute[75176]:   <uuid>7b4c281e-5b8d-43b1-8914-572e1341c0a7</uuid>
Nov 28 15:44:53 user nova-compute[75176]:   <name>instance-00000014</name>
Nov 28 15:44:53 user nova-compute[75176]:   <memory>524288</memory>
Nov 28 15:44:53 user nova-compute[75176]:   <vcpu>1</vcpu>
Nov 28 15:44:53 user nova-compute[75176]:   <metadata>
Nov 28 15:44:53 user nova-compute[75176]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 15:44:53 user nova-compute[75176]:       <nova:package version="0.0.0"/>
Nov 28 15:44:53 user nova-compute[75176]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-119652217</nova:name>
Nov 28 15:44:53 user nova-compute[75176]:       <nova:creationTime>2023-11-28 15:44:53</nova:creationTime>
Nov 28 15:44:53 user nova-compute[75176]:       <nova:flavor name="m1.tiny">
Nov 28 15:44:53 user nova-compute[75176]:         <nova:memory>512</nova:memory>
Nov 28 15:44:53 user nova-compute[75176]:         <nova:disk>1</nova:disk>
Nov 28 15:44:53 user nova-compute[75176]:         <nova:swap>0</nova:swap>
Nov 28 15:44:53 user nova-compute[75176]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 15:44:53 user nova-compute[75176]:         <nova:vcpus>1</nova:vcpus>
Nov 28 15:44:53 user nova-compute[75176]:       </nova:flavor>
Nov 28 15:44:53 user nova-compute[75176]:       <nova:owner>
Nov 28 15:44:53 user nova-compute[75176]:         <nova:user uuid="d8d2394765354c83942d4eafbb437794">tempest-VolumesSnapshotTestJSON-2135242619-project-member</nova:user>
Nov 28 15:44:53 user nova-compute[75176]:         <nova:project uuid="3669019a110245d19a8ac85b5b20d2bd">tempest-VolumesSnapshotTestJSON-2135242619</nova:project>
Nov 28 15:44:53 user nova-compute[75176]:       </nova:owner>
Nov 28 15:44:53 user nova-compute[75176]:       <nova:root type="image" uuid="1f41819e-c93f-4dc7-b253-37a27bbbbc74"/>
Nov 28 15:44:53 user nova-compute[75176]:       <nova:ports>
Nov 28 15:44:53 user nova-compute[75176]:         <nova:port uuid="cfbc5129-eb64-42bb-bec3-cd56a2ec733c">
Nov 28 15:44:53 user nova-compute[75176]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 28 15:44:53 user nova-compute[75176]:         </nova:port>
Nov 28 15:44:53 user nova-compute[75176]:       </nova:ports>
Nov 28 15:44:53 user nova-compute[75176]:     </nova:instance>
Nov 28 15:44:53 user nova-compute[75176]:   </metadata>
Nov 28 15:44:53 user nova-compute[75176]:   <sysinfo type="smbios">
Nov 28 15:44:53 user nova-compute[75176]:     <system>
Nov 28 15:44:53 user nova-compute[75176]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 15:44:53 user nova-compute[75176]:       <entry name="product">OpenStack Nova</entry>
Nov 28 15:44:53 user nova-compute[75176]:       <entry name="version">0.0.0</entry>
Nov 28 15:44:53 user nova-compute[75176]:       <entry name="serial">7b4c281e-5b8d-43b1-8914-572e1341c0a7</entry>
Nov 28 15:44:53 user nova-compute[75176]:       <entry name="uuid">7b4c281e-5b8d-43b1-8914-572e1341c0a7</entry>
Nov 28 15:44:53 user nova-compute[75176]:       <entry name="family">Virtual Machine</entry>
Nov 28 15:44:53 user nova-compute[75176]:     </system>
Nov 28 15:44:53 user nova-compute[75176]:   </sysinfo>
Nov 28 15:44:53 user nova-compute[75176]:   <os>
Nov 28 15:44:53 user nova-compute[75176]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 15:44:53 user nova-compute[75176]:     <boot dev="hd"/>
Nov 28 15:44:53 user nova-compute[75176]:     <smbios mode="sysinfo"/>
Nov 28 15:44:53 user nova-compute[75176]:   </os>
Nov 28 15:44:53 user nova-compute[75176]:   <features>
Nov 28 15:44:53 user nova-compute[75176]:     <acpi/>
Nov 28 15:44:53 user nova-compute[75176]:     <apic/>
Nov 28 15:44:53 user nova-compute[75176]:     <vmcoreinfo/>
Nov 28 15:44:53 user nova-compute[75176]:   </features>
Nov 28 15:44:53 user nova-compute[75176]:   <clock offset="utc">
Nov 28 15:44:53 user nova-compute[75176]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 15:44:53 user nova-compute[75176]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 15:44:53 user nova-compute[75176]:     <timer name="hpet" present="no"/>
Nov 28 15:44:53 user nova-compute[75176]:   </clock>
Nov 28 15:44:53 user nova-compute[75176]:   <cpu mode="custom" match="exact">
Nov 28 15:44:53 user nova-compute[75176]:     <model>Nehalem</model>
Nov 28 15:44:53 user nova-compute[75176]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 15:44:53 user nova-compute[75176]:   </cpu>
Nov 28 15:44:53 user nova-compute[75176]:   <devices>
Nov 28 15:44:53 user nova-compute[75176]:     <disk type="file" device="disk">
Nov 28 15:44:53 user nova-compute[75176]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 15:44:53 user nova-compute[75176]:       <source file="/opt/stack/data/nova/instances/7b4c281e-5b8d-43b1-8914-572e1341c0a7/disk"/>
Nov 28 15:44:53 user nova-compute[75176]:       <target dev="vda" bus="virtio"/>
Nov 28 15:44:53 user nova-compute[75176]:     </disk>
Nov 28 15:44:53 user nova-compute[75176]:     <interface type="ethernet">
Nov 28 15:44:53 user nova-compute[75176]:       <mac address="fa:16:3e:07:68:e7"/>
Nov 28 15:44:53 user nova-compute[75176]:       <model type="virtio"/>
Nov 28 15:44:53 user nova-compute[75176]:       <mtu size="1442"/>
Nov 28 15:44:53 user nova-compute[75176]:       <target dev="tapcfbc5129-eb"/>
Nov 28 15:44:53 user nova-compute[75176]:     </interface>
Nov 28 15:44:53 user nova-compute[75176]:     <serial type="pty">
Nov 28 15:44:53 user nova-compute[75176]:       <log file="/opt/stack/data/nova/instances/7b4c281e-5b8d-43b1-8914-572e1341c0a7/console.log" append="off"/>
Nov 28 15:44:53 user nova-compute[75176]:     </serial>
Nov 28 15:44:53 user nova-compute[75176]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 15:44:53 user nova-compute[75176]:     <video>
Nov 28 15:44:53 user nova-compute[75176]:       <model type="virtio"/>
Nov 28 15:44:53 user nova-compute[75176]:     </video>
Nov 28 15:44:53 user nova-compute[75176]:     <rng model="virtio">
Nov 28 15:44:53 user nova-compute[75176]:       <backend model="random">/dev/urandom</backend>
Nov 28 15:44:53 user nova-compute[75176]:     </rng>
Nov 28 15:44:53 user nova-compute[75176]:     <controller type="usb" index="0" model="none"/>
Nov 28 15:44:53 user nova-compute[75176]:     <memballoon model="virtio">
Nov 28 15:44:53 user nova-compute[75176]:       <stats period="10"/>
Nov 28 15:44:53 user nova-compute[75176]:     </memballoon>
Nov 28 15:44:53 user nova-compute[75176]:   </devices>
Nov 28 15:44:53 user nova-compute[75176]: </domain>
Nov 28 15:44:53 user nova-compute[75176]:  {{(pid=75176) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 15:44:53 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-2533b91b-acad-441b-a335-11b934f19ede tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T15:44:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-119652217',display_name='tempest-VolumesSnapshotTestJSON-instance-119652217',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-119652217',id=20,image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIX98hMVZy4VbyZtEbNYxY5GDZTytWVzAkwts44r99B8WhDU8T4DSEtoo4wnYPgRCrr1ry6NjRSu3tBFP9rpvjFXWaCyWrLMKGh5YZtz9BnbG83OWHcKYL6NLwjmY/UUeg==',key_name='tempest-keypair-63260765',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3669019a110245d19a8ac85b5b20d2bd',ramdisk_id='',reservation_id='r-mcmae38u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-2135242619',owner_user_name='tempest-VolumesSnapshotTestJSON-2135242619-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T15:44:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d8d2394765354c83942d4eafbb437794',uuid=7b4c281e-5b8d-43b1-8914-572e1341c0a7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cfbc5129-eb64-42bb-bec3-cd56a2ec733c", "address": "fa:16:3e:07:68:e7", "network": {"id": "0478f649-0c69-414b-84c3-3ef4604d6062", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-695624980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3669019a110245d19a8ac85b5b20d2bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfbc5129-eb", "ovs_interfaceid": "cfbc5129-eb64-42bb-bec3-cd56a2ec733c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 15:44:53 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-2533b91b-acad-441b-a335-11b934f19ede tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Converting VIF {"id": "cfbc5129-eb64-42bb-bec3-cd56a2ec733c", "address": "fa:16:3e:07:68:e7", "network": {"id": "0478f649-0c69-414b-84c3-3ef4604d6062", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-695624980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3669019a110245d19a8ac85b5b20d2bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfbc5129-eb", "ovs_interfaceid": "cfbc5129-eb64-42bb-bec3-cd56a2ec733c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:44:53 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-2533b91b-acad-441b-a335-11b934f19ede tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:68:e7,bridge_name='br-int',has_traffic_filtering=True,id=cfbc5129-eb64-42bb-bec3-cd56a2ec733c,network=Network(0478f649-0c69-414b-84c3-3ef4604d6062),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfbc5129-eb') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:44:53 user nova-compute[75176]: DEBUG os_vif [None req-2533b91b-acad-441b-a335-11b934f19ede tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:68:e7,bridge_name='br-int',has_traffic_filtering=True,id=cfbc5129-eb64-42bb-bec3-cd56a2ec733c,network=Network(0478f649-0c69-414b-84c3-3ef4604d6062),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfbc5129-eb') {{(pid=75176) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 15:44:53 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:44:53 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:44:53 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 15:44:53 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:44:53 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1e07200f-2f31-5f1e-8e34-ec432a1fe266', '_type': 'linux-noop'}}, row=False) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:44:53 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:44:53 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:44:53 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b923756-c378-4f2f-82c0-0b91bd433010]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bb22dca-8491-42ef-815f-7b0c0ca4be5a (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea228e4f-f9b2-477a-a75f-542bc9d47ec4 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1f5de5d-be7a-443a-9831-791c8667c09b (non-flash)\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:44:53 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:44:53 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d7ca750-b799-412f-85e0-f05b629a2958 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bb22dca-8491-42ef-815f-7b0c0ca4be5a (non-flash)
Nov 28 15:44:53 user nova-compute[75176]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d (non-flash)
Nov 28 15:44:53 user nova-compute[75176]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea228e4f-f9b2-477a-a75f-542bc9d47ec4 (non-flash)
Nov 28 15:44:53 user nova-compute[75176]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1f5de5d-be7a-443a-9831-791c8667c09b (non-flash)
Nov 28 15:44:53 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:44:53 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d7ca750-b799-412f-85e0-f05b629a2958 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bb22dca-8491-42ef-815f-7b0c0ca4be5a (non-flash)
Nov 28 15:44:53 user nova-compute[75176]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d (non-flash)
Nov 28 15:44:53 user nova-compute[75176]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea228e4f-f9b2-477a-a75f-542bc9d47ec4 (non-flash)
Nov 28 15:44:53 user nova-compute[75176]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1f5de5d-be7a-443a-9831-791c8667c09b (non-flash)
Nov 28 15:44:53 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 15:44:53 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24 -p 172.16.0.220:3260 --login {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:44:53 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e8507b7-fccf-4196-b589-bf2b74f165ec/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:44:53 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:44:53 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcfbc5129-eb, may_exist=True, interface_attrs={}) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:44:53 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcfbc5129-eb, col_values=(('qos', UUID('21016b7b-6fd6-4810-b71b-21e8f15406c9')),), if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:44:53 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcfbc5129-eb, col_values=(('external_ids', {'iface-id': 'cfbc5129-eb64-42bb-bec3-cd56a2ec733c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:07:68:e7', 'vm-uuid': '7b4c281e-5b8d-43b1-8914-572e1341c0a7'}),), if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:44:53 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:44:53 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:44:53 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:44:53 user nova-compute[75176]: INFO os_vif [None req-2533b91b-acad-441b-a335-11b934f19ede tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:68:e7,bridge_name='br-int',has_traffic_filtering=True,id=cfbc5129-eb64-42bb-bec3-cd56a2ec733c,network=Network(0478f649-0c69-414b-84c3-3ef4604d6062),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfbc5129-eb')
Nov 28 15:44:53 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24 -p 172.16.0.220:3260 --login" returned: 0 in 0.104s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:44:53 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[1753767d-87d4-422b-9506-2a4fca434c36]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:44:53 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d7ca750-b799-412f-85e0-f05b629a2958 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24, portal: 172.16.0.220,3260]
Nov 28 15:44:53 user nova-compute[75176]: Login to [iface: default, target: iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24, portal: 172.16.0.220,3260] successful.
Nov 28 15:44:53 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:44:53 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:44:53 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:44:53 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d6f9237-9e74-460e-976c-ed777d3a27df]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:44:53 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d7ca750-b799-412f-85e0-f05b629a2958 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:44:53 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:44:53 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-2533b91b-acad-441b-a335-11b934f19ede tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] No BDM found with device name vda, not building metadata. {{(pid=75176) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 15:44:53 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-2533b91b-acad-441b-a335-11b934f19ede tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] No VIF found with MAC fa:16:3e:07:68:e7, not building metadata {{(pid=75176) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 15:44:53 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:44:53 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[60707c4d-2379-4a95-bfe7-f0fab4d3f250]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bb22dca-8491-42ef-815f-7b0c0ca4be5a (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea228e4f-f9b2-477a-a75f-542bc9d47ec4 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1f5de5d-be7a-443a-9831-791c8667c09b (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24 (non-flash)\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:44:53 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d7ca750-b799-412f-85e0-f05b629a2958 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bb22dca-8491-42ef-815f-7b0c0ca4be5a (non-flash)
Nov 28 15:44:53 user nova-compute[75176]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d (non-flash)
Nov 28 15:44:53 user nova-compute[75176]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea228e4f-f9b2-477a-a75f-542bc9d47ec4 (non-flash)
Nov 28 15:44:53 user nova-compute[75176]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1f5de5d-be7a-443a-9831-791c8667c09b (non-flash)
Nov 28 15:44:53 user nova-compute[75176]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24 (non-flash)
Nov 28 15:44:53 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:44:53 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d7ca750-b799-412f-85e0-f05b629a2958 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bb22dca-8491-42ef-815f-7b0c0ca4be5a (non-flash)
Nov 28 15:44:53 user nova-compute[75176]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d (non-flash)
Nov 28 15:44:53 user nova-compute[75176]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea228e4f-f9b2-477a-a75f-542bc9d47ec4 (non-flash)
Nov 28 15:44:53 user nova-compute[75176]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1f5de5d-be7a-443a-9831-791c8667c09b (non-flash)
Nov 28 15:44:53 user nova-compute[75176]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24 (non-flash)
Nov 28 15:44:53 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 15:44:53 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-0d7ca750-b799-412f-85e0-f05b629a2958 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.558s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 15:44:53 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d7ca750-b799-412f-85e0-f05b629a2958 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Connected to 172.16.0.220:3260 {{(pid=75176) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 15:44:53 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-0d7ca750-b799-412f-85e0-f05b629a2958 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] HCTL ('37', '-', '-', 0) found on session 22 with lun 0 {{(pid=75176) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 15:44:53 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-0d7ca750-b799-412f-85e0-f05b629a2958 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75176) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 15:44:53 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:44:53 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e8507b7-fccf-4196-b589-bf2b74f165ec/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:44:53 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e8507b7-fccf-4196-b589-bf2b74f165ec/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:44:53 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.067s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:44:53 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[012ffcfa-9380-44b9-9dca-bd6678dcc39d]: (4, ('- - 0', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:44:53 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-0d7ca750-b799-412f-85e0-f05b629a2958 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Searching for a device in session 22 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75176) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 15:44:53 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d7ca750-b799-412f-85e0-f05b629a2958 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'grxAmRcs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75176) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 15:44:53 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:44:53 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e8507b7-fccf-4196-b589-bf2b74f165ec/disk --force-share --output=json" returned: 0 in 0.262s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:44:53 user nova-compute[75176]: DEBUG nova.network.neutron [req-b6781ca4-ced0-4caf-871d-4cd9904901ca req-ebffb1bb-4e5d-476b-84b3-4164740fb967 service nova] [instance: 7b4c281e-5b8d-43b1-8914-572e1341c0a7] Updated VIF entry in instance network info cache for port cfbc5129-eb64-42bb-bec3-cd56a2ec733c. {{(pid=75176) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 15:44:53 user nova-compute[75176]: DEBUG nova.network.neutron [req-b6781ca4-ced0-4caf-871d-4cd9904901ca req-ebffb1bb-4e5d-476b-84b3-4164740fb967 service nova] [instance: 7b4c281e-5b8d-43b1-8914-572e1341c0a7] Updating instance_info_cache with network_info: [{"id": "cfbc5129-eb64-42bb-bec3-cd56a2ec733c", "address": "fa:16:3e:07:68:e7", "network": {"id": "0478f649-0c69-414b-84c3-3ef4604d6062", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-695624980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3669019a110245d19a8ac85b5b20d2bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfbc5129-eb", "ovs_interfaceid": "cfbc5129-eb64-42bb-bec3-cd56a2ec733c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:44:53 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e8a6e1b-4f71-494a-8f44-f9643c658021/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:44:53 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-b6781ca4-ced0-4caf-871d-4cd9904901ca req-ebffb1bb-4e5d-476b-84b3-4164740fb967 service nova] Releasing lock "refresh_cache-7b4c281e-5b8d-43b1-8914-572e1341c0a7" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:44:54 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e8a6e1b-4f71-494a-8f44-f9643c658021/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:44:54 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e8a6e1b-4f71-494a-8f44-f9643c658021/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:44:54 user nova-compute[75176]: DEBUG nova.compute.manager [req-0f794343-b7d9-4f08-ab80-257db5bca543 req-33680aea-db61-4335-8550-da351d1c4ec3 service nova] [instance: 6ab0619f-72e5-4975-ade8-53d7c0784d89] Received event network-vif-plugged-63e3a2a2-51d4-4899-806d-c3222f643878 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:44:54 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-0f794343-b7d9-4f08-ab80-257db5bca543 req-33680aea-db61-4335-8550-da351d1c4ec3 service nova] Acquiring lock "6ab0619f-72e5-4975-ade8-53d7c0784d89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:44:54 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-0f794343-b7d9-4f08-ab80-257db5bca543 req-33680aea-db61-4335-8550-da351d1c4ec3 service nova] Lock "6ab0619f-72e5-4975-ade8-53d7c0784d89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:44:54 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-0f794343-b7d9-4f08-ab80-257db5bca543 req-33680aea-db61-4335-8550-da351d1c4ec3 service nova] Lock "6ab0619f-72e5-4975-ade8-53d7c0784d89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:44:54 user nova-compute[75176]: DEBUG nova.compute.manager [req-0f794343-b7d9-4f08-ab80-257db5bca543 req-33680aea-db61-4335-8550-da351d1c4ec3 service nova] [instance: 6ab0619f-72e5-4975-ade8-53d7c0784d89] No waiting events found dispatching network-vif-plugged-63e3a2a2-51d4-4899-806d-c3222f643878 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:44:54 user nova-compute[75176]: WARNING nova.compute.manager [req-0f794343-b7d9-4f08-ab80-257db5bca543 req-33680aea-db61-4335-8550-da351d1c4ec3 service nova] [instance: 6ab0619f-72e5-4975-ade8-53d7c0784d89] Received unexpected event network-vif-plugged-63e3a2a2-51d4-4899-806d-c3222f643878 for instance with vm_state rescued and task_state unrescuing.
Nov 28 15:44:54 user nova-compute[75176]: DEBUG nova.compute.manager [req-0f794343-b7d9-4f08-ab80-257db5bca543 req-33680aea-db61-4335-8550-da351d1c4ec3 service nova] [instance: 6ab0619f-72e5-4975-ade8-53d7c0784d89] Received event network-vif-plugged-63e3a2a2-51d4-4899-806d-c3222f643878 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:44:54 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-0f794343-b7d9-4f08-ab80-257db5bca543 req-33680aea-db61-4335-8550-da351d1c4ec3 service nova] Acquiring lock "6ab0619f-72e5-4975-ade8-53d7c0784d89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:44:54 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-0f794343-b7d9-4f08-ab80-257db5bca543 req-33680aea-db61-4335-8550-da351d1c4ec3 service nova] Lock "6ab0619f-72e5-4975-ade8-53d7c0784d89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:44:54 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-0f794343-b7d9-4f08-ab80-257db5bca543 req-33680aea-db61-4335-8550-da351d1c4ec3 service nova] Lock "6ab0619f-72e5-4975-ade8-53d7c0784d89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:44:54 user nova-compute[75176]: DEBUG nova.compute.manager [req-0f794343-b7d9-4f08-ab80-257db5bca543 req-33680aea-db61-4335-8550-da351d1c4ec3 service nova] [instance: 6ab0619f-72e5-4975-ade8-53d7c0784d89] No waiting events found dispatching network-vif-plugged-63e3a2a2-51d4-4899-806d-c3222f643878 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:44:54 user nova-compute[75176]: WARNING nova.compute.manager [req-0f794343-b7d9-4f08-ab80-257db5bca543 req-33680aea-db61-4335-8550-da351d1c4ec3 service nova] [instance: 6ab0619f-72e5-4975-ade8-53d7c0784d89] Received unexpected event network-vif-plugged-63e3a2a2-51d4-4899-806d-c3222f643878 for instance with vm_state rescued and task_state unrescuing.
Nov 28 15:44:54 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e8a6e1b-4f71-494a-8f44-f9643c658021/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:44:54 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e02d1e69-5e74-43c3-8546-6044d31145f2/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:44:54 user nova-compute[75176]: DEBUG nova.compute.manager [None req-bcc2015d-ea2a-4107-8bc9-601378f7fb21 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] [instance: 6ab0619f-72e5-4975-ade8-53d7c0784d89] Checking state {{(pid=75176) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 15:44:54 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e02d1e69-5e74-43c3-8546-6044d31145f2/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:44:54 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e02d1e69-5e74-43c3-8546-6044d31145f2/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:44:54 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-0d7ca750-b799-412f-85e0-f05b629a2958 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.692s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 15:44:54 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d7ca750-b799-412f-85e0-f05b629a2958 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] <== connect_volume: return (1695ms) {'type': 'block', 'scsi_wwn': '26462356432313838', 'path': '/dev/sdf'} {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 15:44:54 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d7ca750-b799-412f-85e0-f05b629a2958 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] [instance: e02d1e69-5e74-43c3-8546-6044d31145f2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26462356432313838', 'path': '/dev/sdf'} {{(pid=75176) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 15:44:54 user nova-compute[75176]: DEBUG nova.objects.instance [None req-0d7ca750-b799-412f-85e0-f05b629a2958 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Lazy-loading 'flavor' on Instance uuid e02d1e69-5e74-43c3-8546-6044d31145f2 {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:44:54 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:44:54 user nova-compute[75176]: DEBUG nova.virt.libvirt.guest [None req-0d7ca750-b799-412f-85e0-f05b629a2958 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 15:44:54 user nova-compute[75176]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 15:44:54 user nova-compute[75176]:   <source dev="/dev/sdf"/>
Nov 28 15:44:54 user nova-compute[75176]:   <target dev="vdb" bus="virtio"/>
Nov 28 15:44:54 user nova-compute[75176]:   <serial>b424d718-a756-4599-a969-530c2d3c3c24</serial>
Nov 28 15:44:54 user nova-compute[75176]: </disk>
Nov 28 15:44:54 user nova-compute[75176]:  {{(pid=75176) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 15:44:54 user nova-compute[75176]: DEBUG nova.network.neutron [None req-82b3665d-3655-4f5e-bb80-ef0680b6825c tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] [instance: aa223c49-d254-4727-8a01-873026847b37] Port 6514aeb6-8ea4-4a27-a54b-32f650c87957 binding to destination host user is already ACTIVE {{(pid=75176) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 28 15:44:54 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-82b3665d-3655-4f5e-bb80-ef0680b6825c tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Acquiring lock "refresh_cache-aa223c49-d254-4727-8a01-873026847b37" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:44:54 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-82b3665d-3655-4f5e-bb80-ef0680b6825c tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Acquired lock "refresh_cache-aa223c49-d254-4727-8a01-873026847b37" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:44:54 user nova-compute[75176]: DEBUG nova.network.neutron [None req-82b3665d-3655-4f5e-bb80-ef0680b6825c tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] [instance: aa223c49-d254-4727-8a01-873026847b37] Building network info cache for instance {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 15:44:54 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e02d1e69-5e74-43c3-8546-6044d31145f2/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:44:54 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b3646e6-512e-4cd6-b3c1-89438c19c408/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:44:55 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b3646e6-512e-4cd6-b3c1-89438c19c408/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:44:55 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b3646e6-512e-4cd6-b3c1-89438c19c408/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:44:55 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:44:55 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:44:55 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b3646e6-512e-4cd6-b3c1-89438c19c408/disk --force-share --output=json" returned: 0 in 0.251s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:44:55 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b18c889-7694-4edf-8cf2-b9032e60289e/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:44:55 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b18c889-7694-4edf-8cf2-b9032e60289e/disk --force-share --output=json" returned: 0 in 0.277s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:44:55 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b18c889-7694-4edf-8cf2-b9032e60289e/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:44:55 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:44:55 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-0d7ca750-b799-412f-85e0-f05b629a2958 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] No BDM found with device name vda, not building metadata. {{(pid=75176) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 15:44:55 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-0d7ca750-b799-412f-85e0-f05b629a2958 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75176) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 15:44:55 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-0d7ca750-b799-412f-85e0-f05b629a2958 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] No VIF found with MAC fa:16:3e:ed:a5:68, not building metadata {{(pid=75176) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 15:44:55 user nova-compute[75176]: DEBUG nova.compute.manager [req-86563872-bc4b-4dba-a325-9aab9a0a5c79 req-2fb9a1ae-94c3-46c1-bc7b-ba9d7c0eda39 service nova] [instance: 7b4c281e-5b8d-43b1-8914-572e1341c0a7] Received event network-vif-plugged-cfbc5129-eb64-42bb-bec3-cd56a2ec733c {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:44:55 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-86563872-bc4b-4dba-a325-9aab9a0a5c79 req-2fb9a1ae-94c3-46c1-bc7b-ba9d7c0eda39 service nova] Acquiring lock "7b4c281e-5b8d-43b1-8914-572e1341c0a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:44:55 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-86563872-bc4b-4dba-a325-9aab9a0a5c79 req-2fb9a1ae-94c3-46c1-bc7b-ba9d7c0eda39 service nova] Lock "7b4c281e-5b8d-43b1-8914-572e1341c0a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:44:55 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-86563872-bc4b-4dba-a325-9aab9a0a5c79 req-2fb9a1ae-94c3-46c1-bc7b-ba9d7c0eda39 service nova] Lock "7b4c281e-5b8d-43b1-8914-572e1341c0a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:44:55 user nova-compute[75176]: DEBUG nova.compute.manager [req-86563872-bc4b-4dba-a325-9aab9a0a5c79 req-2fb9a1ae-94c3-46c1-bc7b-ba9d7c0eda39 service nova] [instance: 7b4c281e-5b8d-43b1-8914-572e1341c0a7] No waiting events found dispatching network-vif-plugged-cfbc5129-eb64-42bb-bec3-cd56a2ec733c {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:44:55 user nova-compute[75176]: WARNING nova.compute.manager [req-86563872-bc4b-4dba-a325-9aab9a0a5c79 req-2fb9a1ae-94c3-46c1-bc7b-ba9d7c0eda39 service nova] [instance: 7b4c281e-5b8d-43b1-8914-572e1341c0a7] Received unexpected event network-vif-plugged-cfbc5129-eb64-42bb-bec3-cd56a2ec733c for instance with vm_state building and task_state spawning.
Nov 28 15:44:55 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b18c889-7694-4edf-8cf2-b9032e60289e/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:44:55 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa223c49-d254-4727-8a01-873026847b37/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:44:55 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:44:55 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-0d7ca750-b799-412f-85e0-f05b629a2958 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Lock "e02d1e69-5e74-43c3-8546-6044d31145f2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.427s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:44:55 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:44:55 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:44:56 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa223c49-d254-4727-8a01-873026847b37/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:44:56 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa223c49-d254-4727-8a01-873026847b37/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:44:56 user nova-compute[75176]: DEBUG nova.network.neutron [None req-82b3665d-3655-4f5e-bb80-ef0680b6825c tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] [instance: aa223c49-d254-4727-8a01-873026847b37] Updating instance_info_cache with network_info: [{"id": "6514aeb6-8ea4-4a27-a54b-32f650c87957", "address": "fa:16:3e:ea:a6:1b", "network": {"id": "51708ad4-dae1-47fc-bd26-aca8c478ca04", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-279988751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c2fe6bf5e4f4bb3b5d50901bfac0b38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6514aeb6-8e", "ovs_interfaceid": "6514aeb6-8ea4-4a27-a54b-32f650c87957", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:44:56 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-82b3665d-3655-4f5e-bb80-ef0680b6825c tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Releasing lock "refresh_cache-aa223c49-d254-4727-8a01-873026847b37" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:44:56 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-82b3665d-3655-4f5e-bb80-ef0680b6825c tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] [instance: aa223c49-d254-4727-8a01-873026847b37] Creating tmpfile /opt/stack/data/nova/instances/aa223c49-d254-4727-8a01-873026847b37/tmpn_n4eele to verify with other compute node that the instance is on the same shared storage. {{(pid=75176) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9625}}
Nov 28 15:44:56 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa223c49-d254-4727-8a01-873026847b37/disk --force-share --output=json" returned: 0 in 0.255s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:44:56 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75176) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 15:44:56 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ab0619f-72e5-4975-ade8-53d7c0784d89/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:44:56 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:44:56 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:44:56 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:44:56 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:44:56 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ab0619f-72e5-4975-ade8-53d7c0784d89/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:44:56 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ab0619f-72e5-4975-ade8-53d7c0784d89/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:44:56 user nova-compute[75176]: DEBUG nova.compute.manager [req-ec21d983-0a42-4028-b042-5efec9e69c3f req-b44455eb-4b5e-4b11-b179-3429c777f005 service nova] [instance: aa223c49-d254-4727-8a01-873026847b37] Received event network-vif-unplugged-6514aeb6-8ea4-4a27-a54b-32f650c87957 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:44:56 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-ec21d983-0a42-4028-b042-5efec9e69c3f req-b44455eb-4b5e-4b11-b179-3429c777f005 service nova] Acquiring lock "aa223c49-d254-4727-8a01-873026847b37-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:44:56 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-ec21d983-0a42-4028-b042-5efec9e69c3f req-b44455eb-4b5e-4b11-b179-3429c777f005 service nova] Lock "aa223c49-d254-4727-8a01-873026847b37-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:44:56 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-ec21d983-0a42-4028-b042-5efec9e69c3f req-b44455eb-4b5e-4b11-b179-3429c777f005 service nova] Lock "aa223c49-d254-4727-8a01-873026847b37-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:44:56 user nova-compute[75176]: DEBUG nova.compute.manager [req-ec21d983-0a42-4028-b042-5efec9e69c3f req-b44455eb-4b5e-4b11-b179-3429c777f005 service nova] [instance: aa223c49-d254-4727-8a01-873026847b37] No waiting events found dispatching network-vif-unplugged-6514aeb6-8ea4-4a27-a54b-32f650c87957 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:44:56 user nova-compute[75176]: WARNING nova.compute.manager [req-ec21d983-0a42-4028-b042-5efec9e69c3f req-b44455eb-4b5e-4b11-b179-3429c777f005 service nova] [instance: aa223c49-d254-4727-8a01-873026847b37] Received unexpected event network-vif-unplugged-6514aeb6-8ea4-4a27-a54b-32f650c87957 for instance with vm_state resized and task_state resize_reverting.
Nov 28 15:44:56 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ab0619f-72e5-4975-ade8-53d7c0784d89/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:44:56 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75176) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 15:44:56 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6739b4fc-063c-454c-8b37-b81c07b7ca1e/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:44:57 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6739b4fc-063c-454c-8b37-b81c07b7ca1e/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:44:57 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6739b4fc-063c-454c-8b37-b81c07b7ca1e/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:44:57 user nova-compute[75176]: INFO nova.virt.libvirt.driver [-] [instance: aa223c49-d254-4727-8a01-873026847b37] Instance destroyed successfully.
Nov 28 15:44:57 user nova-compute[75176]: DEBUG nova.objects.instance [None req-82b3665d-3655-4f5e-bb80-ef0680b6825c tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Lazy-loading 'resources' on Instance uuid aa223c49-d254-4727-8a01-873026847b37 {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:44:57 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-82b3665d-3655-4f5e-bb80-ef0680b6825c tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T15:39:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-595327070',display_name='tempest-ServerActionsTestOtherB-server-595327070',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-595327070',id=3,image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG46aaldZ31/SMomPHuTDQH3UTedHGSV4iG8fWtpOqqr4Cywzy71R0Ov1C6XRnOo4sYKyOfCcRfklnh+MSVYzyKoTfjcvtFT0nSQtOBIOaQ8vVTuyCcNwyJ0nmpmqFlJng==',key_name='tempest-keypair-1738862822',keypairs=<?>,launch_index=0,launched_at=2023-11-28T15:43:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4c2fe6bf5e4f4bb3b5d50901bfac0b38',ramdisk_id='',reservation_id='r-k1by7x80',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-935995346',owner_user_name='tempest-ServerActionsTestOtherB-935995346-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T15:43:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='16ea4be4bcb34749b2f444c4694543b1',uuid=aa223c49-d254-4727-8a01-873026847b37,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "6514aeb6-8ea4-4a27-a54b-32f650c87957", "address": "fa:16:3e:ea:a6:1b", "network": {"id": "51708ad4-dae1-47fc-bd26-aca8c478ca04", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-279988751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c2fe6bf5e4f4bb3b5d50901bfac0b38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6514aeb6-8e", "ovs_interfaceid": "6514aeb6-8ea4-4a27-a54b-32f650c87957", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 15:44:57 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-82b3665d-3655-4f5e-bb80-ef0680b6825c tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Converting VIF {"id": "6514aeb6-8ea4-4a27-a54b-32f650c87957", "address": "fa:16:3e:ea:a6:1b", "network": {"id": "51708ad4-dae1-47fc-bd26-aca8c478ca04", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-279988751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c2fe6bf5e4f4bb3b5d50901bfac0b38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6514aeb6-8e", "ovs_interfaceid": "6514aeb6-8ea4-4a27-a54b-32f650c87957", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:44:57 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-82b3665d-3655-4f5e-bb80-ef0680b6825c tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ea:a6:1b,bridge_name='br-int',has_traffic_filtering=True,id=6514aeb6-8ea4-4a27-a54b-32f650c87957,network=Network(51708ad4-dae1-47fc-bd26-aca8c478ca04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6514aeb6-8e') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:44:57 user nova-compute[75176]: DEBUG os_vif [None req-82b3665d-3655-4f5e-bb80-ef0680b6825c tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ea:a6:1b,bridge_name='br-int',has_traffic_filtering=True,id=6514aeb6-8ea4-4a27-a54b-32f650c87957,network=Network(51708ad4-dae1-47fc-bd26-aca8c478ca04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6514aeb6-8e') {{(pid=75176) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 15:44:57 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:44:57 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6514aeb6-8e, bridge=br-int, if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:44:57 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:44:57 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6739b4fc-063c-454c-8b37-b81c07b7ca1e/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:44:57 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:44:57 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:44:57 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=da20cb73-f0f7-43f8-aad7-1da8a94a6f3c) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:44:57 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:44:57 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:44:57 user nova-compute[75176]: INFO os_vif [None req-82b3665d-3655-4f5e-bb80-ef0680b6825c tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ea:a6:1b,bridge_name='br-int',has_traffic_filtering=True,id=6514aeb6-8ea4-4a27-a54b-32f650c87957,network=Network(51708ad4-dae1-47fc-bd26-aca8c478ca04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6514aeb6-8e')
Nov 28 15:44:57 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/402e779e-f507-49f1-a0d8-31ab0d23fbcd/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:44:57 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-82b3665d-3655-4f5e-bb80-ef0680b6825c tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] [instance: aa223c49-d254-4727-8a01-873026847b37] calling os-brick to detach iSCSI Volume {{(pid=75176) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 15:44:57 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-82b3665d-3655-4f5e-bb80-ef0680b6825c tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c1b8a00>, {'target_iqn': 'iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AVKGrjOB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 15:44:57 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-82b3665d-3655-4f5e-bb80-ef0680b6825c tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 15:44:57 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-82b3665d-3655-4f5e-bb80-ef0680b6825c tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 15:44:57 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-82b3665d-3655-4f5e-bb80-ef0680b6825c tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.008s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 15:44:57 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:44:57 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.030s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:44:57 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed2b2596-ac1f-49d9-b62e-0708c2a0aeb3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a1f5de5d-be7a-443a-9831-791c8667c09b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2bb22dca-8491-42ef-815f-7b0c0ca4be5a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ea228e4f-f9b2-477a-a75f-542bc9d47ec4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:44:57 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-82b3665d-3655-4f5e-bb80-ef0680b6825c tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 15:44:57 user nova-compute[75176]: No targets found.
Nov 28 15:44:57 user nova-compute[75176]: iSNS:
Nov 28 15:44:57 user nova-compute[75176]: No targets found.
Nov 28 15:44:57 user nova-compute[75176]: STATIC:
Nov 28 15:44:57 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:a1f5de5d-be7a-443a-9831-791c8667c09b
Nov 28 15:44:57 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:44:57 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:44:57 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:2bb22dca-8491-42ef-815f-7b0c0ca4be5a
Nov 28 15:44:57 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:44:57 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:44:57 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d
Nov 28 15:44:57 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:44:57 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:44:57 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24
Nov 28 15:44:57 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:44:57 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:44:57 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:ea228e4f-f9b2-477a-a75f-542bc9d47ec4
Nov 28 15:44:57 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:44:57 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:44:57 user nova-compute[75176]: FIRMWARE:
Nov 28 15:44:57 user nova-compute[75176]: No targets found.
Nov 28 15:44:57 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:44:57 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-82b3665d-3655-4f5e-bb80-ef0680b6825c tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 15:44:57 user nova-compute[75176]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 15:44:57 user nova-compute[75176]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75176) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 15:44:57 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-82b3665d-3655-4f5e-bb80-ef0680b6825c tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d', 0)] {{(pid=75176) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 15:44:57 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:44:57 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.032s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:44:57 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ebbf572-cad0-4892-8d04-bfe641caf11a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2bb22dca-8491-42ef-815f-7b0c0ca4be5a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a1f5de5d-be7a-443a-9831-791c8667c09b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ea228e4f-f9b2-477a-a75f-542bc9d47ec4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:44:57 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:44:57 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:44:57 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[113ad543-a939-48ef-add0-5c3ccfbe80fe]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bb22dca-8491-42ef-815f-7b0c0ca4be5a (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea228e4f-f9b2-477a-a75f-542bc9d47ec4 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1f5de5d-be7a-443a-9831-791c8667c09b (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24 (non-flash)\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:44:57 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-82b3665d-3655-4f5e-bb80-ef0680b6825c tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bb22dca-8491-42ef-815f-7b0c0ca4be5a (non-flash)
Nov 28 15:44:57 user nova-compute[75176]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d (non-flash)
Nov 28 15:44:57 user nova-compute[75176]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea228e4f-f9b2-477a-a75f-542bc9d47ec4 (non-flash)
Nov 28 15:44:57 user nova-compute[75176]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1f5de5d-be7a-443a-9831-791c8667c09b (non-flash)
Nov 28 15:44:57 user nova-compute[75176]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24 (non-flash)
Nov 28 15:44:57 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:44:57 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-82b3665d-3655-4f5e-bb80-ef0680b6825c tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bb22dca-8491-42ef-815f-7b0c0ca4be5a (non-flash)
Nov 28 15:44:57 user nova-compute[75176]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d (non-flash)
Nov 28 15:44:57 user nova-compute[75176]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea228e4f-f9b2-477a-a75f-542bc9d47ec4 (non-flash)
Nov 28 15:44:57 user nova-compute[75176]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1f5de5d-be7a-443a-9831-791c8667c09b (non-flash)
Nov 28 15:44:57 user nova-compute[75176]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24 (non-flash)
Nov 28 15:44:57 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 15:44:57 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-82b3665d-3655-4f5e-bb80-ef0680b6825c tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f464c3a3a30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d'): ({'sde'}, set())}) {{(pid=75176) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 15:44:57 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-82b3665d-3655-4f5e-bb80-ef0680b6825c tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Removing single pathed devices sde {{(pid=75176) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 15:44:57 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:44:57 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:44:57 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fc3be30-5d1f-4c9f-8425-2ac98b8866b1]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:44:57 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:44:57 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/402e779e-f507-49f1-a0d8-31ab0d23fbcd/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:44:57 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/402e779e-f507-49f1-a0d8-31ab0d23fbcd/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:44:57 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.039s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:44:57 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[357fd3aa-a37f-4f91-8871-1fa6eac96680]: (4, ('ok\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:44:57 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-82b3665d-3655-4f5e-bb80-ef0680b6825c tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Flushing IO for device /dev/sde {{(pid=75176) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 15:44:57 user nova-compute[75176]: INFO nova.compute.manager [None req-52b207bb-4007-4944-b983-c4f373a5c717 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] [instance: e02d1e69-5e74-43c3-8546-6044d31145f2] Rebuilding instance
Nov 28 15:44:57 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:44:57 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.022s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:44:57 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a7e3a1d-126e-4a1a-8e7e-dd12008b5da3]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:44:57 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-82b3665d-3655-4f5e-bb80-ef0680b6825c tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75176) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 15:44:57 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:44:57 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.039s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:44:57 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e739b47-9f5c-48db-9127-bae31f54ae95]: (4, ('1', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:44:57 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-82b3665d-3655-4f5e-bb80-ef0680b6825c tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75176) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 15:44:57 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-82b3665d-3655-4f5e-bb80-ef0680b6825c tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] SCSI volumes sde have been removed. {{(pid=75176) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 15:44:57 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-82b3665d-3655-4f5e-bb80-ef0680b6825c tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d')] {{(pid=75176) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 15:44:57 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:44:57 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:44:57 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aea39f8-9378-4f5f-8ded-a6c202f8f97f]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:44:57 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-82b3665d-3655-4f5e-bb80-ef0680b6825c tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:44:57 user nova-compute[75176]: DEBUG nova.compute.manager [None req-52b207bb-4007-4944-b983-c4f373a5c717 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] [instance: e02d1e69-5e74-43c3-8546-6044d31145f2] Checking state {{(pid=75176) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 15:44:57 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d -p 172.16.0.220:3260 --logout {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:44:57 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/402e779e-f507-49f1-a0d8-31ab0d23fbcd/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:44:57 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75176) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 15:44:57 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:44:57 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cd831d3-8bbf-42a1-b40f-6ad7093a6d7b]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:44:57 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-82b3665d-3655-4f5e-bb80-ef0680b6825c tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d, portal: 172.16.0.220,3260]
Nov 28 15:44:57 user nova-compute[75176]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d, portal: 172.16.0.220,3260] successful.
Nov 28 15:44:57 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:44:57 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d -p 172.16.0.220:3260 --op delete {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:44:57 user nova-compute[75176]: DEBUG nova.compute.manager [req-bf7b8262-085a-408f-92bb-b309fc03dd6c req-0a930e65-fdc9-4864-9d95-31b0f6043b41 service nova] [instance: 7b4c281e-5b8d-43b1-8914-572e1341c0a7] Received event network-vif-plugged-cfbc5129-eb64-42bb-bec3-cd56a2ec733c {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:44:57 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-bf7b8262-085a-408f-92bb-b309fc03dd6c req-0a930e65-fdc9-4864-9d95-31b0f6043b41 service nova] Acquiring lock "7b4c281e-5b8d-43b1-8914-572e1341c0a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:44:57 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-bf7b8262-085a-408f-92bb-b309fc03dd6c req-0a930e65-fdc9-4864-9d95-31b0f6043b41 service nova] Lock "7b4c281e-5b8d-43b1-8914-572e1341c0a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:44:57 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-bf7b8262-085a-408f-92bb-b309fc03dd6c req-0a930e65-fdc9-4864-9d95-31b0f6043b41 service nova] Lock "7b4c281e-5b8d-43b1-8914-572e1341c0a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:44:57 user nova-compute[75176]: DEBUG nova.compute.manager [req-bf7b8262-085a-408f-92bb-b309fc03dd6c req-0a930e65-fdc9-4864-9d95-31b0f6043b41 service nova] [instance: 7b4c281e-5b8d-43b1-8914-572e1341c0a7] No waiting events found dispatching network-vif-plugged-cfbc5129-eb64-42bb-bec3-cd56a2ec733c {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:44:57 user nova-compute[75176]: WARNING nova.compute.manager [req-bf7b8262-085a-408f-92bb-b309fc03dd6c req-0a930e65-fdc9-4864-9d95-31b0f6043b41 service nova] [instance: 7b4c281e-5b8d-43b1-8914-572e1341c0a7] Received unexpected event network-vif-plugged-cfbc5129-eb64-42bb-bec3-cd56a2ec733c for instance with vm_state building and task_state spawning.
Nov 28 15:44:58 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:44:58 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e7b535f-8e22-4ea3-92ca-b140f4722b9c]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:44:58 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-82b3665d-3655-4f5e-bb80-ef0680b6825c tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:44:58 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-82b3665d-3655-4f5e-bb80-ef0680b6825c tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 1.268s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 15:44:58 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-82b3665d-3655-4f5e-bb80-ef0680b6825c tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] <== disconnect_volume: return (1276ms) None {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 15:44:58 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-82b3665d-3655-4f5e-bb80-ef0680b6825c tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] [instance: aa223c49-d254-4727-8a01-873026847b37] Disconnected iSCSI Volume {{(pid=75176) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 15:44:58 user nova-compute[75176]: DEBUG nova.compute.manager [None req-2533b91b-acad-441b-a335-11b934f19ede tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] [instance: 7b4c281e-5b8d-43b1-8914-572e1341c0a7] Instance event wait completed in 0 seconds for  {{(pid=75176) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 15:44:58 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-2533b91b-acad-441b-a335-11b934f19ede tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] [instance: 7b4c281e-5b8d-43b1-8914-572e1341c0a7] Guest created on hypervisor {{(pid=75176) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 15:44:58 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 15:44:58 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 15:44:58 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Hypervisor/Node resource view: name=user free_ram=7084MB free_disk=25.15713119506836GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75176) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 15:44:58 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:44:58 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:44:58 user nova-compute[75176]: INFO nova.virt.libvirt.driver [-] [instance: 7b4c281e-5b8d-43b1-8914-572e1341c0a7] Instance spawned successfully.
Nov 28 15:44:58 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-2533b91b-acad-441b-a335-11b934f19ede tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] [instance: 7b4c281e-5b8d-43b1-8914-572e1341c0a7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 15:44:58 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:44:58 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-2533b91b-acad-441b-a335-11b934f19ede tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] [instance: 7b4c281e-5b8d-43b1-8914-572e1341c0a7] Found default for hw_cdrom_bus of ide {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:44:58 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-2533b91b-acad-441b-a335-11b934f19ede tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] [instance: 7b4c281e-5b8d-43b1-8914-572e1341c0a7] Found default for hw_disk_bus of virtio {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:44:58 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-2533b91b-acad-441b-a335-11b934f19ede tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] [instance: 7b4c281e-5b8d-43b1-8914-572e1341c0a7] Found default for hw_input_bus of None {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:44:58 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-2533b91b-acad-441b-a335-11b934f19ede tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] [instance: 7b4c281e-5b8d-43b1-8914-572e1341c0a7] Found default for hw_pointer_model of None {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:44:58 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-2533b91b-acad-441b-a335-11b934f19ede tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] [instance: 7b4c281e-5b8d-43b1-8914-572e1341c0a7] Found default for hw_video_model of virtio {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:44:58 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-2533b91b-acad-441b-a335-11b934f19ede tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] [instance: 7b4c281e-5b8d-43b1-8914-572e1341c0a7] Found default for hw_vif_model of virtio {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:44:58 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:44:58 user nova-compute[75176]: DEBUG nova.compute.manager [req-f3f2337f-83db-4691-8b3d-995850291654 req-1f51a48e-52f2-4d5f-9525-3caee6756ecf service nova] [instance: aa223c49-d254-4727-8a01-873026847b37] Received event network-vif-plugged-6514aeb6-8ea4-4a27-a54b-32f650c87957 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:44:58 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-f3f2337f-83db-4691-8b3d-995850291654 req-1f51a48e-52f2-4d5f-9525-3caee6756ecf service nova] Acquiring lock "aa223c49-d254-4727-8a01-873026847b37-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:44:58 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-f3f2337f-83db-4691-8b3d-995850291654 req-1f51a48e-52f2-4d5f-9525-3caee6756ecf service nova] Lock "aa223c49-d254-4727-8a01-873026847b37-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:44:58 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-f3f2337f-83db-4691-8b3d-995850291654 req-1f51a48e-52f2-4d5f-9525-3caee6756ecf service nova] Lock "aa223c49-d254-4727-8a01-873026847b37-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:44:58 user nova-compute[75176]: DEBUG nova.compute.manager [req-f3f2337f-83db-4691-8b3d-995850291654 req-1f51a48e-52f2-4d5f-9525-3caee6756ecf service nova] [instance: aa223c49-d254-4727-8a01-873026847b37] No waiting events found dispatching network-vif-plugged-6514aeb6-8ea4-4a27-a54b-32f650c87957 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:44:58 user nova-compute[75176]: WARNING nova.compute.manager [req-f3f2337f-83db-4691-8b3d-995850291654 req-1f51a48e-52f2-4d5f-9525-3caee6756ecf service nova] [instance: aa223c49-d254-4727-8a01-873026847b37] Received unexpected event network-vif-plugged-6514aeb6-8ea4-4a27-a54b-32f650c87957 for instance with vm_state resized and task_state resize_reverting.
Nov 28 15:44:58 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Applying migration context for instance aa223c49-d254-4727-8a01-873026847b37 as it has an incoming, in-progress migration e7efec7a-a309-4975-ab53-abdcc8046db8. Migration status is reverting {{(pid=75176) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 28 15:44:58 user nova-compute[75176]: INFO nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] [instance: aa223c49-d254-4727-8a01-873026847b37] Updating resource usage from migration e7efec7a-a309-4975-ab53-abdcc8046db8
Nov 28 15:44:58 user nova-compute[75176]: INFO nova.compute.manager [None req-2533b91b-acad-441b-a335-11b934f19ede tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] [instance: 7b4c281e-5b8d-43b1-8914-572e1341c0a7] Took 7.79 seconds to spawn the instance on the hypervisor.
Nov 28 15:44:58 user nova-compute[75176]: DEBUG nova.compute.manager [None req-2533b91b-acad-441b-a335-11b934f19ede tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] [instance: 7b4c281e-5b8d-43b1-8914-572e1341c0a7] Checking state {{(pid=75176) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 15:44:59 user nova-compute[75176]: INFO nova.compute.manager [None req-2533b91b-acad-441b-a335-11b934f19ede tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] [instance: 7b4c281e-5b8d-43b1-8914-572e1341c0a7] Took 8.73 seconds to build instance.
Nov 28 15:44:59 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-2533b91b-acad-441b-a335-11b934f19ede tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Lock "7b4c281e-5b8d-43b1-8914-572e1341c0a7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.851s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:44:59 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:44:59 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:44:59 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance 6ab0619f-72e5-4975-ade8-53d7c0784d89 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:44:59 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance 2e8507b7-fccf-4196-b589-bf2b74f165ec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:44:59 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance 5b18c889-7694-4edf-8cf2-b9032e60289e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:44:59 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance 47306d53-9ad7-4cae-ba6d-1f65239ef30f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:44:59 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance 402e779e-f507-49f1-a0d8-31ab0d23fbcd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:44:59 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance e02d1e69-5e74-43c3-8546-6044d31145f2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:44:59 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Migration e7efec7a-a309-4975-ab53-abdcc8046db8 is active on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 28 15:44:59 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance aa223c49-d254-4727-8a01-873026847b37 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:44:59 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance 6739b4fc-063c-454c-8b37-b81c07b7ca1e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:44:59 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance 6b3646e6-512e-4cd6-b3c1-89438c19c408 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:44:59 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance 1e8a6e1b-4f71-494a-8f44-f9643c658021 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:44:59 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance 6ed37390-f6a6-4cf7-8cab-b818f702083d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:44:59 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance 7b4c281e-5b8d-43b1-8914-572e1341c0a7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:44:59 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=75176) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 15:44:59 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Final resource view: name=user phys_ram=16011MB used_ram=8704MB phys_disk=40GB used_disk=32GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=75176) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 15:44:59 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:44:59 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:44:59 user nova-compute[75176]: INFO nova.virt.libvirt.driver [-] [instance: e02d1e69-5e74-43c3-8546-6044d31145f2] Instance destroyed successfully.
Nov 28 15:44:59 user nova-compute[75176]: INFO nova.compute.manager [None req-52b207bb-4007-4944-b983-c4f373a5c717 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] [instance: e02d1e69-5e74-43c3-8546-6044d31145f2] Detaching volume b424d718-a756-4599-a969-530c2d3c3c24
Nov 28 15:44:59 user nova-compute[75176]: INFO nova.virt.block_device [None req-52b207bb-4007-4944-b983-c4f373a5c717 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] [instance: e02d1e69-5e74-43c3-8546-6044d31145f2] Attempting to driver detach volume b424d718-a756-4599-a969-530c2d3c3c24 from mountpoint /dev/vdb
Nov 28 15:44:59 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-52b207bb-4007-4944-b983-c4f373a5c717 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Attempting to detach device vdb from instance e02d1e69-5e74-43c3-8546-6044d31145f2 from the persistent domain config. {{(pid=75176) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 15:44:59 user nova-compute[75176]: DEBUG nova.virt.libvirt.guest [None req-52b207bb-4007-4944-b983-c4f373a5c717 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 15:44:59 user nova-compute[75176]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 15:44:59 user nova-compute[75176]:   <source dev="/dev/sdf"/>
Nov 28 15:44:59 user nova-compute[75176]:   <target dev="vdb" bus="virtio"/>
Nov 28 15:44:59 user nova-compute[75176]:   <serial>b424d718-a756-4599-a969-530c2d3c3c24</serial>
Nov 28 15:44:59 user nova-compute[75176]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 15:44:59 user nova-compute[75176]: </disk>
Nov 28 15:44:59 user nova-compute[75176]:  {{(pid=75176) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 15:44:59 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-52b207bb-4007-4944-b983-c4f373a5c717 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Successfully detached device vdb from instance e02d1e69-5e74-43c3-8546-6044d31145f2 from the persistent domain config.
Nov 28 15:44:59 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52b207bb-4007-4944-b983-c4f373a5c717 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] [instance: e02d1e69-5e74-43c3-8546-6044d31145f2] calling os-brick to detach iSCSI Volume {{(pid=75176) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 15:44:59 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b207bb-4007-4944-b983-c4f373a5c717 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c1b8a00>, {'target_iqn': 'iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'grxAmRcs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 15:44:59 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-52b207bb-4007-4944-b983-c4f373a5c717 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 28 15:44:59 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-52b207bb-4007-4944-b983-c4f373a5c717 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 15:44:59 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-52b207bb-4007-4944-b983-c4f373a5c717 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 15:44:59 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:44:59 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.032s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:44:59 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[adc08646-ce1a-442d-90db-e4f72b6dac41]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a1f5de5d-be7a-443a-9831-791c8667c09b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2bb22dca-8491-42ef-815f-7b0c0ca4be5a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ea228e4f-f9b2-477a-a75f-542bc9d47ec4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:44:59 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b207bb-4007-4944-b983-c4f373a5c717 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 15:44:59 user nova-compute[75176]: No targets found.
Nov 28 15:44:59 user nova-compute[75176]: iSNS:
Nov 28 15:44:59 user nova-compute[75176]: No targets found.
Nov 28 15:44:59 user nova-compute[75176]: STATIC:
Nov 28 15:44:59 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:a1f5de5d-be7a-443a-9831-791c8667c09b
Nov 28 15:44:59 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:44:59 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:44:59 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:2bb22dca-8491-42ef-815f-7b0c0ca4be5a
Nov 28 15:44:59 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:44:59 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:44:59 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24
Nov 28 15:44:59 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:44:59 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:44:59 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:ea228e4f-f9b2-477a-a75f-542bc9d47ec4
Nov 28 15:44:59 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:44:59 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:44:59 user nova-compute[75176]: FIRMWARE:
Nov 28 15:44:59 user nova-compute[75176]: No targets found.
Nov 28 15:44:59 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:44:59 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b207bb-4007-4944-b983-c4f373a5c717 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 15:44:59 user nova-compute[75176]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 15:44:59 user nova-compute[75176]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75176) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 15:44:59 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b207bb-4007-4944-b983-c4f373a5c717 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24', 0)] {{(pid=75176) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 15:44:59 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:44:59 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:44:59 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a3411b5-15c8-4898-a087-e8660c5b0808]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2bb22dca-8491-42ef-815f-7b0c0ca4be5a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a1f5de5d-be7a-443a-9831-791c8667c09b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ea228e4f-f9b2-477a-a75f-542bc9d47ec4\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:44:59 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:44:59 user nova-compute[75176]: DEBUG nova.compute.provider_tree [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Inventory has not changed in ProviderTree for provider: b37848d8-f401-4155-a029-b0ffa09ff85b {{(pid=75176) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 15:44:59 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Inventory has not changed for provider b37848d8-f401-4155-a029-b0ffa09ff85b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75176) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 15:44:59 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.042s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:44:59 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ee80d81-0657-4ac1-a47d-e447e094a809]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bb22dca-8491-42ef-815f-7b0c0ca4be5a (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea228e4f-f9b2-477a-a75f-542bc9d47ec4 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1f5de5d-be7a-443a-9831-791c8667c09b (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24 (non-flash)\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:44:59 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b207bb-4007-4944-b983-c4f373a5c717 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bb22dca-8491-42ef-815f-7b0c0ca4be5a (non-flash)
Nov 28 15:44:59 user nova-compute[75176]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea228e4f-f9b2-477a-a75f-542bc9d47ec4 (non-flash)
Nov 28 15:44:59 user nova-compute[75176]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1f5de5d-be7a-443a-9831-791c8667c09b (non-flash)
Nov 28 15:44:59 user nova-compute[75176]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24 (non-flash)
Nov 28 15:44:59 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:44:59 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b207bb-4007-4944-b983-c4f373a5c717 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bb22dca-8491-42ef-815f-7b0c0ca4be5a (non-flash)
Nov 28 15:44:59 user nova-compute[75176]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea228e4f-f9b2-477a-a75f-542bc9d47ec4 (non-flash)
Nov 28 15:44:59 user nova-compute[75176]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1f5de5d-be7a-443a-9831-791c8667c09b (non-flash)
Nov 28 15:44:59 user nova-compute[75176]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24 (non-flash)
Nov 28 15:44:59 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 15:44:59 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b207bb-4007-4944-b983-c4f373a5c717 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f464c1feb00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24'): ({'sdf'}, set())}) {{(pid=75176) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 15:44:59 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-52b207bb-4007-4944-b983-c4f373a5c717 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Removing single pathed devices sdf {{(pid=75176) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 15:44:59 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:44:59 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Compute_service record updated for user:user {{(pid=75176) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 15:44:59 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.283s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:44:59 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:44:59 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75176) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 28 15:44:59 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.030s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:44:59 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e799d18-7a5d-4271-8c08-cb9f41cb0fdf]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:44:59 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:44:59 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:44:59 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-82b3665d-3655-4f5e-bb80-ef0680b6825c tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:44:59 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-82b3665d-3655-4f5e-bb80-ef0680b6825c tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:45:00 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.030s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:45:00 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[86741ed4-5871-4694-b5c6-a4f4544c9b57]: (4, ('ok\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:45:00 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-52b207bb-4007-4944-b983-c4f373a5c717 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Flushing IO for device /dev/sdf {{(pid=75176) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 15:45:00 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:45:00 user nova-compute[75176]: DEBUG nova.objects.instance [None req-82b3665d-3655-4f5e-bb80-ef0680b6825c tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Lazy-loading 'migration_context' on Instance uuid aa223c49-d254-4727-8a01-873026847b37 {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:45:00 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.022s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:45:00 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[2710dd90-9115-4762-8edf-3aeac75421d7]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:45:00 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-52b207bb-4007-4944-b983-c4f373a5c717 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75176) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 15:45:00 user nova-compute[75176]: DEBUG nova.objects.base [None req-82b3665d-3655-4f5e-bb80-ef0680b6825c tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Object Instance<aa223c49-d254-4727-8a01-873026847b37> lazy-loaded attributes: resources,migration_context {{(pid=75176) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 15:45:00 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:45:00 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-82b3665d-3655-4f5e-bb80-ef0680b6825c tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Refreshing inventories for resource provider b37848d8-f401-4155-a029-b0ffa09ff85b {{(pid=75176) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 28 15:45:00 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.047s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:45:00 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[28b0d2f7-2e20-455f-bd53-e4bbc8a32bd6]: (4, ('1', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:45:00 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-52b207bb-4007-4944-b983-c4f373a5c717 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75176) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 15:45:00 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-52b207bb-4007-4944-b983-c4f373a5c717 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] SCSI volumes sdf have been removed. {{(pid=75176) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 15:45:00 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b207bb-4007-4944-b983-c4f373a5c717 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24')] {{(pid=75176) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 15:45:00 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:45:00 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:45:00 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c73b270-879a-4d37-adcd-0c22d7ae0715]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:45:00 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b207bb-4007-4944-b983-c4f373a5c717 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:45:00 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24 -p 172.16.0.220:3260 --logout {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:45:00 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-82b3665d-3655-4f5e-bb80-ef0680b6825c tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Updating ProviderTree inventory for provider b37848d8-f401-4155-a029-b0ffa09ff85b from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75176) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 28 15:45:00 user nova-compute[75176]: DEBUG nova.compute.provider_tree [None req-82b3665d-3655-4f5e-bb80-ef0680b6825c tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Updating inventory in ProviderTree for provider b37848d8-f401-4155-a029-b0ffa09ff85b with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75176) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 28 15:45:00 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-82b3665d-3655-4f5e-bb80-ef0680b6825c tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Refreshing aggregate associations for resource provider b37848d8-f401-4155-a029-b0ffa09ff85b, aggregates: None {{(pid=75176) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 28 15:45:00 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24 -p 172.16.0.220:3260 --logout" returned: 0 in 0.079s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:45:00 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[a51ea6f6-8611-4f8d-ab65-4d62dbf0e58b]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:45:00 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b207bb-4007-4944-b983-c4f373a5c717 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24, portal: 172.16.0.220,3260]
Nov 28 15:45:00 user nova-compute[75176]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24, portal: 172.16.0.220,3260] successful.
Nov 28 15:45:00 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:45:00 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24 -p 172.16.0.220:3260 --op delete {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:45:00 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-82b3665d-3655-4f5e-bb80-ef0680b6825c tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Refreshing trait associations for resource provider b37848d8-f401-4155-a029-b0ffa09ff85b, traits: COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_RESCUE_BFV,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NODE,HW_CPU_X86_SSSE3,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE42,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE2,COMPUTE_ACCELERATORS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VIRTIO {{(pid=75176) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 28 15:45:00 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:45:00 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbe0c9af-b395-4cd5-8245-ab805ac19730]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:45:00 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b207bb-4007-4944-b983-c4f373a5c717 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:45:00 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-52b207bb-4007-4944-b983-c4f373a5c717 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.450s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 15:45:00 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b207bb-4007-4944-b983-c4f373a5c717 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] <== disconnect_volume: return (452ms) None {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 15:45:00 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52b207bb-4007-4944-b983-c4f373a5c717 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] [instance: e02d1e69-5e74-43c3-8546-6044d31145f2] Disconnected iSCSI Volume {{(pid=75176) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 15:45:00 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:45:00 user nova-compute[75176]: DEBUG nova.compute.provider_tree [None req-82b3665d-3655-4f5e-bb80-ef0680b6825c tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Inventory has not changed in ProviderTree for provider: b37848d8-f401-4155-a029-b0ffa09ff85b {{(pid=75176) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 15:45:00 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-82b3665d-3655-4f5e-bb80-ef0680b6825c tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Inventory has not changed for provider b37848d8-f401-4155-a029-b0ffa09ff85b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75176) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 15:45:00 user nova-compute[75176]: DEBUG nova.compute.manager [req-129c9a64-5bd0-4cb1-9c4f-7df37458a555 req-65b5e521-cde7-4e7e-ba41-933f8bd21e74 service nova] [instance: e02d1e69-5e74-43c3-8546-6044d31145f2] Received event network-vif-unplugged-9a63b660-0280-42b9-868c-dbf0c26ee995 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:45:00 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-129c9a64-5bd0-4cb1-9c4f-7df37458a555 req-65b5e521-cde7-4e7e-ba41-933f8bd21e74 service nova] Acquiring lock "e02d1e69-5e74-43c3-8546-6044d31145f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:45:00 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-129c9a64-5bd0-4cb1-9c4f-7df37458a555 req-65b5e521-cde7-4e7e-ba41-933f8bd21e74 service nova] Lock "e02d1e69-5e74-43c3-8546-6044d31145f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:45:00 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-129c9a64-5bd0-4cb1-9c4f-7df37458a555 req-65b5e521-cde7-4e7e-ba41-933f8bd21e74 service nova] Lock "e02d1e69-5e74-43c3-8546-6044d31145f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:45:00 user nova-compute[75176]: DEBUG nova.compute.manager [req-129c9a64-5bd0-4cb1-9c4f-7df37458a555 req-65b5e521-cde7-4e7e-ba41-933f8bd21e74 service nova] [instance: e02d1e69-5e74-43c3-8546-6044d31145f2] No waiting events found dispatching network-vif-unplugged-9a63b660-0280-42b9-868c-dbf0c26ee995 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:45:00 user nova-compute[75176]: WARNING nova.compute.manager [req-129c9a64-5bd0-4cb1-9c4f-7df37458a555 req-65b5e521-cde7-4e7e-ba41-933f8bd21e74 service nova] [instance: e02d1e69-5e74-43c3-8546-6044d31145f2] Received unexpected event network-vif-unplugged-9a63b660-0280-42b9-868c-dbf0c26ee995 for instance with vm_state active and task_state rebuilding.
Nov 28 15:45:00 user nova-compute[75176]: DEBUG nova.compute.manager [req-129c9a64-5bd0-4cb1-9c4f-7df37458a555 req-65b5e521-cde7-4e7e-ba41-933f8bd21e74 service nova] [instance: e02d1e69-5e74-43c3-8546-6044d31145f2] Received event network-vif-plugged-9a63b660-0280-42b9-868c-dbf0c26ee995 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:45:00 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-129c9a64-5bd0-4cb1-9c4f-7df37458a555 req-65b5e521-cde7-4e7e-ba41-933f8bd21e74 service nova] Acquiring lock "e02d1e69-5e74-43c3-8546-6044d31145f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:45:00 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-129c9a64-5bd0-4cb1-9c4f-7df37458a555 req-65b5e521-cde7-4e7e-ba41-933f8bd21e74 service nova] Lock "e02d1e69-5e74-43c3-8546-6044d31145f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:45:00 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-129c9a64-5bd0-4cb1-9c4f-7df37458a555 req-65b5e521-cde7-4e7e-ba41-933f8bd21e74 service nova] Lock "e02d1e69-5e74-43c3-8546-6044d31145f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:45:00 user nova-compute[75176]: DEBUG nova.compute.manager [req-129c9a64-5bd0-4cb1-9c4f-7df37458a555 req-65b5e521-cde7-4e7e-ba41-933f8bd21e74 service nova] [instance: e02d1e69-5e74-43c3-8546-6044d31145f2] No waiting events found dispatching network-vif-plugged-9a63b660-0280-42b9-868c-dbf0c26ee995 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:45:00 user nova-compute[75176]: WARNING nova.compute.manager [req-129c9a64-5bd0-4cb1-9c4f-7df37458a555 req-65b5e521-cde7-4e7e-ba41-933f8bd21e74 service nova] [instance: e02d1e69-5e74-43c3-8546-6044d31145f2] Received unexpected event network-vif-plugged-9a63b660-0280-42b9-868c-dbf0c26ee995 for instance with vm_state active and task_state rebuilding.
Nov 28 15:45:00 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:45:00 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:45:00 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Starting heal instance info cache {{(pid=75176) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 15:45:01 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-82b3665d-3655-4f5e-bb80-ef0680b6825c tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 1.011s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:45:01 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Didn't find any instances for network info cache update. {{(pid=75176) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 28 15:45:01 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:45:01 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75176) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 15:45:01 user nova-compute[75176]: INFO nova.compute.manager [None req-82b3665d-3655-4f5e-bb80-ef0680b6825c tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] [instance: aa223c49-d254-4727-8a01-873026847b37] Swapping old allocation on dict_keys(['b37848d8-f401-4155-a029-b0ffa09ff85b']) held by migration e7efec7a-a309-4975-ab53-abdcc8046db8 for instance
Nov 28 15:45:01 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-82b3665d-3655-4f5e-bb80-ef0680b6825c tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Overwriting current allocation {'allocations': {'b37848d8-f401-4155-a029-b0ffa09ff85b': {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}, 'generation': 24}}, 'project_id': '4c2fe6bf5e4f4bb3b5d50901bfac0b38', 'user_id': '16ea4be4bcb34749b2f444c4694543b1', 'consumer_generation': 1} on consumer aa223c49-d254-4727-8a01-873026847b37 {{(pid=75176) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Nov 28 15:45:01 user nova-compute[75176]: INFO nova.virt.libvirt.driver [-] [instance: e02d1e69-5e74-43c3-8546-6044d31145f2] Instance destroyed successfully.
Nov 28 15:45:01 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-52b207bb-4007-4944-b983-c4f373a5c717 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T15:42:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-675567476',display_name='tempest-ServerActionsTestOtherA-server-1020561533',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-675567476',id=15,image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGHQgrfEWt8pIfRnhBJ24kFyu29uELDK7Re5fQAvns3FKElXmrGxqyeLKhrovaGXrIG8CV9ozkAnryzObqKasCPi8GMPgqqgdQkjAV0c1Qea28G7qtna2/64n19K46tX/A==',key_name='tempest-keypair-1504939882',keypairs=<?>,launch_index=0,launched_at=2023-11-28T15:43:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3704b38a2bd44cb78c28d3f6d86d9e60',ramdisk_id='',reservation_id='r-2pd1l9gx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-680502445',owner_user_name='tempest-ServerActionsTestOtherA-680502445-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T15:44:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d028b79a105b485dbb0178c9da162640',uuid=e02d1e69-5e74-43c3-8546-6044d31145f2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9a63b660-0280-42b9-868c-dbf0c26ee995", "address": "fa:16:3e:ed:a5:68", "network": {"id": "8b63f2d3-0683-4832-abc5-e4c796cf12ab", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-877608435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3704b38a2bd44cb78c28d3f6d86d9e60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a63b660-02", "ovs_interfaceid": "9a63b660-0280-42b9-868c-dbf0c26ee995", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 15:45:01 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-52b207bb-4007-4944-b983-c4f373a5c717 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Converting VIF {"id": "9a63b660-0280-42b9-868c-dbf0c26ee995", "address": "fa:16:3e:ed:a5:68", "network": {"id": "8b63f2d3-0683-4832-abc5-e4c796cf12ab", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-877608435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3704b38a2bd44cb78c28d3f6d86d9e60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a63b660-02", "ovs_interfaceid": "9a63b660-0280-42b9-868c-dbf0c26ee995", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:45:01 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-52b207bb-4007-4944-b983-c4f373a5c717 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ed:a5:68,bridge_name='br-int',has_traffic_filtering=True,id=9a63b660-0280-42b9-868c-dbf0c26ee995,network=Network(8b63f2d3-0683-4832-abc5-e4c796cf12ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a63b660-02') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:45:01 user nova-compute[75176]: DEBUG os_vif [None req-52b207bb-4007-4944-b983-c4f373a5c717 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ed:a5:68,bridge_name='br-int',has_traffic_filtering=True,id=9a63b660-0280-42b9-868c-dbf0c26ee995,network=Network(8b63f2d3-0683-4832-abc5-e4c796cf12ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a63b660-02') {{(pid=75176) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 15:45:01 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:45:01 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9a63b660-02, bridge=br-int, if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:45:01 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:45:01 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:45:01 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:45:01 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=28c73d2c-3dd3-415f-b3c3-d675d7131424) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:45:01 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:45:01 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:45:01 user nova-compute[75176]: INFO os_vif [None req-52b207bb-4007-4944-b983-c4f373a5c717 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ed:a5:68,bridge_name='br-int',has_traffic_filtering=True,id=9a63b660-0280-42b9-868c-dbf0c26ee995,network=Network(8b63f2d3-0683-4832-abc5-e4c796cf12ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a63b660-02')
Nov 28 15:45:01 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52b207bb-4007-4944-b983-c4f373a5c717 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] [instance: e02d1e69-5e74-43c3-8546-6044d31145f2] calling os-brick to detach iSCSI Volume {{(pid=75176) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 15:45:01 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b207bb-4007-4944-b983-c4f373a5c717 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c1b8a00>, {'target_iqn': 'iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'grxAmRcs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 15:45:01 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-52b207bb-4007-4944-b983-c4f373a5c717 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 28 15:45:01 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-52b207bb-4007-4944-b983-c4f373a5c717 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 15:45:01 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-52b207bb-4007-4944-b983-c4f373a5c717 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 15:45:01 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:45:01 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:45:01 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[c48c2d93-9087-44f7-af2d-bde7e6a28551]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a1f5de5d-be7a-443a-9831-791c8667c09b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2bb22dca-8491-42ef-815f-7b0c0ca4be5a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ea228e4f-f9b2-477a-a75f-542bc9d47ec4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:45:01 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b207bb-4007-4944-b983-c4f373a5c717 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 15:45:01 user nova-compute[75176]: No targets found.
Nov 28 15:45:01 user nova-compute[75176]: iSNS:
Nov 28 15:45:01 user nova-compute[75176]: No targets found.
Nov 28 15:45:01 user nova-compute[75176]: STATIC:
Nov 28 15:45:01 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:a1f5de5d-be7a-443a-9831-791c8667c09b
Nov 28 15:45:01 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:45:01 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:45:01 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:2bb22dca-8491-42ef-815f-7b0c0ca4be5a
Nov 28 15:45:01 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:45:01 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:45:01 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:ea228e4f-f9b2-477a-a75f-542bc9d47ec4
Nov 28 15:45:01 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:45:01 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:45:01 user nova-compute[75176]: FIRMWARE:
Nov 28 15:45:01 user nova-compute[75176]: No targets found.
Nov 28 15:45:01 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:45:01 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b207bb-4007-4944-b983-c4f373a5c717 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 15:45:01 user nova-compute[75176]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 15:45:01 user nova-compute[75176]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75176) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 15:45:01 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b207bb-4007-4944-b983-c4f373a5c717 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24', 0)] {{(pid=75176) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 15:45:01 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:45:01 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:45:01 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[35c5839e-ef3c-460e-96be-c51cf96f4a5e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2bb22dca-8491-42ef-815f-7b0c0ca4be5a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a1f5de5d-be7a-443a-9831-791c8667c09b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ea228e4f-f9b2-477a-a75f-542bc9d47ec4\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:45:01 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:45:01 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:45:01 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[c71b69f2-6c47-4f0e-9cd3-3cd20e0a391a]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bb22dca-8491-42ef-815f-7b0c0ca4be5a (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea228e4f-f9b2-477a-a75f-542bc9d47ec4 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1f5de5d-be7a-443a-9831-791c8667c09b (non-flash)\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:45:01 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b207bb-4007-4944-b983-c4f373a5c717 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bb22dca-8491-42ef-815f-7b0c0ca4be5a (non-flash)
Nov 28 15:45:01 user nova-compute[75176]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea228e4f-f9b2-477a-a75f-542bc9d47ec4 (non-flash)
Nov 28 15:45:01 user nova-compute[75176]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1f5de5d-be7a-443a-9831-791c8667c09b (non-flash)
Nov 28 15:45:01 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:45:01 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b207bb-4007-4944-b983-c4f373a5c717 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bb22dca-8491-42ef-815f-7b0c0ca4be5a (non-flash)
Nov 28 15:45:01 user nova-compute[75176]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea228e4f-f9b2-477a-a75f-542bc9d47ec4 (non-flash)
Nov 28 15:45:01 user nova-compute[75176]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1f5de5d-be7a-443a-9831-791c8667c09b (non-flash)
Nov 28 15:45:01 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 15:45:01 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b207bb-4007-4944-b983-c4f373a5c717 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f464c197be0>, {}) {{(pid=75176) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 15:45:01 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b207bb-4007-4944-b983-c4f373a5c717 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Disconnecting from: [] {{(pid=75176) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 15:45:01 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-52b207bb-4007-4944-b983-c4f373a5c717 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.106s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 15:45:01 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b207bb-4007-4944-b983-c4f373a5c717 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] <== disconnect_volume: return (108ms) None {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 15:45:01 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52b207bb-4007-4944-b983-c4f373a5c717 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] [instance: e02d1e69-5e74-43c3-8546-6044d31145f2] Disconnected iSCSI Volume {{(pid=75176) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 15:45:01 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-52b207bb-4007-4944-b983-c4f373a5c717 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] [instance: e02d1e69-5e74-43c3-8546-6044d31145f2] Deleting instance files /opt/stack/data/nova/instances/e02d1e69-5e74-43c3-8546-6044d31145f2_del
Nov 28 15:45:01 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-52b207bb-4007-4944-b983-c4f373a5c717 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] [instance: e02d1e69-5e74-43c3-8546-6044d31145f2] Deletion of /opt/stack/data/nova/instances/e02d1e69-5e74-43c3-8546-6044d31145f2_del complete
Nov 28 15:45:01 user nova-compute[75176]: INFO nova.virt.block_device [None req-52b207bb-4007-4944-b983-c4f373a5c717 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] [instance: e02d1e69-5e74-43c3-8546-6044d31145f2] Booting with volume b424d718-a756-4599-a969-530c2d3c3c24 at /dev/vdb
Nov 28 15:45:01 user nova-compute[75176]: DEBUG os_brick.utils [None req-52b207bb-4007-4944-b983-c4f373a5c717 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 15:45:01 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:45:01 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:45:01 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c676d52-c1d2-43d0-80a0-178f52e0322d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:edc924a949b2\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:45:01 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:45:01 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:45:01 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[049eec8c-a2eb-4603-ad68-2390684d5545]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:45:01 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:45:01 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:45:01 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[c204997b-cafd-4382-88df-30c74d8358a1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:45:01 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb383a33-4123-4191-bf0a-cb2a2778852f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:45:01 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-52b207bb-4007-4944-b983-c4f373a5c717 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Running cmd (subprocess): nvme version {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:45:01 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-52b207bb-4007-4944-b983-c4f373a5c717 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] 'nvme version' failed. Not Retrying. {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 15:45:01 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-82b3665d-3655-4f5e-bb80-ef0680b6825c tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Acquiring lock "refresh_cache-aa223c49-d254-4727-8a01-873026847b37" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:45:01 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-82b3665d-3655-4f5e-bb80-ef0680b6825c tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Acquired lock "refresh_cache-aa223c49-d254-4727-8a01-873026847b37" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:45:01 user nova-compute[75176]: DEBUG nova.network.neutron [None req-82b3665d-3655-4f5e-bb80-ef0680b6825c tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] [instance: aa223c49-d254-4727-8a01-873026847b37] Building network info cache for instance {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 15:45:01 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.nvmeof [None req-52b207bb-4007-4944-b983-c4f373a5c717 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] nvme not present on system {{(pid=75176) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 15:45:01 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:45:01 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 15:45:01 user nova-compute[75176]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 15:45:01 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[45958cdc-37a9-4f03-a5c3-587b38dd9549]: (4, '') {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:45:01 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.lightos [None req-52b207bb-4007-4944-b983-c4f373a5c717 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75176) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 15:45:01 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.lightos [None req-52b207bb-4007-4944-b983-c4f373a5c717 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75176) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 15:45:01 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.lightos [None req-52b207bb-4007-4944-b983-c4f373a5c717 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] LIGHTOS: no hostnqn found. {{(pid=75176) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 15:45:01 user nova-compute[75176]: DEBUG os_brick.utils [None req-52b207bb-4007-4944-b983-c4f373a5c717 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] <== get_connector_properties: return (163ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:edc924a949b2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 15:45:01 user nova-compute[75176]: DEBUG nova.virt.block_device [None req-52b207bb-4007-4944-b983-c4f373a5c717 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] [instance: e02d1e69-5e74-43c3-8546-6044d31145f2] Updating existing volume attachment record: b28179d5-5349-4486-b4a1-1c011f5ce4f7 {{(pid=75176) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 15:45:02 user nova-compute[75176]: DEBUG nova.network.neutron [None req-82b3665d-3655-4f5e-bb80-ef0680b6825c tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] [instance: aa223c49-d254-4727-8a01-873026847b37] Updating instance_info_cache with network_info: [{"id": "6514aeb6-8ea4-4a27-a54b-32f650c87957", "address": "fa:16:3e:ea:a6:1b", "network": {"id": "51708ad4-dae1-47fc-bd26-aca8c478ca04", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-279988751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c2fe6bf5e4f4bb3b5d50901bfac0b38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6514aeb6-8e", "ovs_interfaceid": "6514aeb6-8ea4-4a27-a54b-32f650c87957", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:45:02 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-82b3665d-3655-4f5e-bb80-ef0680b6825c tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Releasing lock "refresh_cache-aa223c49-d254-4727-8a01-873026847b37" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:45:02 user nova-compute[75176]: DEBUG os_brick.utils [None req-82b3665d-3655-4f5e-bb80-ef0680b6825c tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 15:45:02 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:45:02 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:45:02 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bfae827-2356-4584-9fc0-02b2a4826bf9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:edc924a949b2\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:45:02 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:45:02 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:45:02 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[f21dbcf1-340a-47ca-ad66-6fbce00f302a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:45:02 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:45:02 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:45:02 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b0345ea-f242-4e8d-93f9-24e0169b33ef]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:45:02 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[0097c14e-6c1f-40ff-8d34-ab504bd32d11]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:45:02 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-82b3665d-3655-4f5e-bb80-ef0680b6825c tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Running cmd (subprocess): nvme version {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:45:02 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-82b3665d-3655-4f5e-bb80-ef0680b6825c tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] 'nvme version' failed. Not Retrying. {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 15:45:02 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.nvmeof [None req-82b3665d-3655-4f5e-bb80-ef0680b6825c tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] nvme not present on system {{(pid=75176) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 15:45:02 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:45:02 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 15:45:02 user nova-compute[75176]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 15:45:02 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[360b87df-027c-4691-b431-e408464fd98e]: (4, '') {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:45:02 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.lightos [None req-82b3665d-3655-4f5e-bb80-ef0680b6825c tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75176) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 15:45:02 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.lightos [None req-82b3665d-3655-4f5e-bb80-ef0680b6825c tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75176) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 15:45:02 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.lightos [None req-82b3665d-3655-4f5e-bb80-ef0680b6825c tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] LIGHTOS: no hostnqn found. {{(pid=75176) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 15:45:02 user nova-compute[75176]: DEBUG os_brick.utils [None req-82b3665d-3655-4f5e-bb80-ef0680b6825c tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:edc924a949b2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 15:45:03 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:45:03 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:45:06 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:45:08 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:45:10 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-52b207bb-4007-4944-b983-c4f373a5c717 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] [instance: e02d1e69-5e74-43c3-8546-6044d31145f2] Creating instance directory {{(pid=75176) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 15:45:10 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-52b207bb-4007-4944-b983-c4f373a5c717 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] [instance: e02d1e69-5e74-43c3-8546-6044d31145f2] Creating image(s)
Nov 28 15:45:10 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-52b207bb-4007-4944-b983-c4f373a5c717 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Acquiring lock "/opt/stack/data/nova/instances/e02d1e69-5e74-43c3-8546-6044d31145f2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:45:10 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-52b207bb-4007-4944-b983-c4f373a5c717 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Lock "/opt/stack/data/nova/instances/e02d1e69-5e74-43c3-8546-6044d31145f2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:45:10 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-52b207bb-4007-4944-b983-c4f373a5c717 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Lock "/opt/stack/data/nova/instances/e02d1e69-5e74-43c3-8546-6044d31145f2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:45:10 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-52b207bb-4007-4944-b983-c4f373a5c717 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:45:10 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:45:10 user nova-compute[75176]: WARNING nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] While synchronizing instance power states, found 12 instances in the database and 10 instances on the hypervisor.
Nov 28 15:45:10 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Triggering sync for uuid 6ab0619f-72e5-4975-ade8-53d7c0784d89 {{(pid=75176) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 15:45:10 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Triggering sync for uuid aa223c49-d254-4727-8a01-873026847b37 {{(pid=75176) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 15:45:10 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Triggering sync for uuid 2e8507b7-fccf-4196-b589-bf2b74f165ec {{(pid=75176) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 15:45:10 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Triggering sync for uuid 5b18c889-7694-4edf-8cf2-b9032e60289e {{(pid=75176) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 15:45:10 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Triggering sync for uuid 47306d53-9ad7-4cae-ba6d-1f65239ef30f {{(pid=75176) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 15:45:10 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Triggering sync for uuid 402e779e-f507-49f1-a0d8-31ab0d23fbcd {{(pid=75176) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 15:45:10 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Triggering sync for uuid e02d1e69-5e74-43c3-8546-6044d31145f2 {{(pid=75176) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 15:45:10 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Triggering sync for uuid 6739b4fc-063c-454c-8b37-b81c07b7ca1e {{(pid=75176) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 15:45:10 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Triggering sync for uuid 6b3646e6-512e-4cd6-b3c1-89438c19c408 {{(pid=75176) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 15:45:10 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Triggering sync for uuid 1e8a6e1b-4f71-494a-8f44-f9643c658021 {{(pid=75176) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 15:45:10 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Triggering sync for uuid 6ed37390-f6a6-4cf7-8cab-b818f702083d {{(pid=75176) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 15:45:10 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Triggering sync for uuid 7b4c281e-5b8d-43b1-8914-572e1341c0a7 {{(pid=75176) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 15:45:10 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquiring lock "6ab0619f-72e5-4975-ade8-53d7c0784d89" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:45:10 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "6ab0619f-72e5-4975-ade8-53d7c0784d89" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:45:10 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquiring lock "aa223c49-d254-4727-8a01-873026847b37" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:45:10 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "aa223c49-d254-4727-8a01-873026847b37" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:45:10 user nova-compute[75176]: INFO nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] [instance: aa223c49-d254-4727-8a01-873026847b37] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Nov 28 15:45:10 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "aa223c49-d254-4727-8a01-873026847b37" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:45:10 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquiring lock "2e8507b7-fccf-4196-b589-bf2b74f165ec" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:45:10 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "2e8507b7-fccf-4196-b589-bf2b74f165ec" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:45:10 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquiring lock "5b18c889-7694-4edf-8cf2-b9032e60289e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:45:10 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "5b18c889-7694-4edf-8cf2-b9032e60289e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:45:10 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquiring lock "47306d53-9ad7-4cae-ba6d-1f65239ef30f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:45:10 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "47306d53-9ad7-4cae-ba6d-1f65239ef30f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:45:10 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquiring lock "402e779e-f507-49f1-a0d8-31ab0d23fbcd" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:45:10 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "402e779e-f507-49f1-a0d8-31ab0d23fbcd" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:45:10 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquiring lock "e02d1e69-5e74-43c3-8546-6044d31145f2" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:45:10 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "e02d1e69-5e74-43c3-8546-6044d31145f2" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:45:10 user nova-compute[75176]: INFO nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] [instance: e02d1e69-5e74-43c3-8546-6044d31145f2] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Nov 28 15:45:10 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "e02d1e69-5e74-43c3-8546-6044d31145f2" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:45:10 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquiring lock "6739b4fc-063c-454c-8b37-b81c07b7ca1e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:45:10 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "6739b4fc-063c-454c-8b37-b81c07b7ca1e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:45:10 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquiring lock "6b3646e6-512e-4cd6-b3c1-89438c19c408" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:45:10 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "6b3646e6-512e-4cd6-b3c1-89438c19c408" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:45:10 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquiring lock "1e8a6e1b-4f71-494a-8f44-f9643c658021" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:45:10 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "1e8a6e1b-4f71-494a-8f44-f9643c658021" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:45:10 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquiring lock "6ed37390-f6a6-4cf7-8cab-b818f702083d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:45:10 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "6ed37390-f6a6-4cf7-8cab-b818f702083d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:45:10 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquiring lock "7b4c281e-5b8d-43b1-8914-572e1341c0a7" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:45:10 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "7b4c281e-5b8d-43b1-8914-572e1341c0a7" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:45:10 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-52b207bb-4007-4944-b983-c4f373a5c717 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json" returned: 0 in 0.213s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:45:10 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-52b207bb-4007-4944-b983-c4f373a5c717 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Acquiring lock "5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:45:10 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-52b207bb-4007-4944-b983-c4f373a5c717 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Lock "5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:45:10 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-52b207bb-4007-4944-b983-c4f373a5c717 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:45:10 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "6ab0619f-72e5-4975-ade8-53d7c0784d89" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.085s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:45:10 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "5b18c889-7694-4edf-8cf2-b9032e60289e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.084s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:45:10 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "47306d53-9ad7-4cae-ba6d-1f65239ef30f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.089s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:45:10 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "6739b4fc-063c-454c-8b37-b81c07b7ca1e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.118s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:45:10 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "6b3646e6-512e-4cd6-b3c1-89438c19c408" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.134s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:45:10 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "7b4c281e-5b8d-43b1-8914-572e1341c0a7" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.138s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:45:10 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "1e8a6e1b-4f71-494a-8f44-f9643c658021" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.145s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:45:10 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "2e8507b7-fccf-4196-b589-bf2b74f165ec" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.154s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:45:10 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "6ed37390-f6a6-4cf7-8cab-b818f702083d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.170s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:45:10 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "402e779e-f507-49f1-a0d8-31ab0d23fbcd" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.182s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:45:10 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-52b207bb-4007-4944-b983-c4f373a5c717 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json" returned: 0 in 0.208s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:45:10 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-52b207bb-4007-4944-b983-c4f373a5c717 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2,backing_fmt=raw /opt/stack/data/nova/instances/e02d1e69-5e74-43c3-8546-6044d31145f2/disk 1073741824 {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:45:10 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-52b207bb-4007-4944-b983-c4f373a5c717 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2,backing_fmt=raw /opt/stack/data/nova/instances/e02d1e69-5e74-43c3-8546-6044d31145f2/disk 1073741824" returned: 0 in 0.055s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:45:10 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-52b207bb-4007-4944-b983-c4f373a5c717 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Lock "5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.270s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:45:10 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-52b207bb-4007-4944-b983-c4f373a5c717 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:45:10 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-52b207bb-4007-4944-b983-c4f373a5c717 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json" returned: 0 in 0.196s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:45:10 user nova-compute[75176]: DEBUG nova.virt.disk.api [None req-52b207bb-4007-4944-b983-c4f373a5c717 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e02d1e69-5e74-43c3-8546-6044d31145f2/disk. size=1073741824 {{(pid=75176) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 15:45:10 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-52b207bb-4007-4944-b983-c4f373a5c717 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e02d1e69-5e74-43c3-8546-6044d31145f2/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:45:10 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-52b207bb-4007-4944-b983-c4f373a5c717 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e02d1e69-5e74-43c3-8546-6044d31145f2/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:45:10 user nova-compute[75176]: DEBUG nova.virt.disk.api [None req-52b207bb-4007-4944-b983-c4f373a5c717 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Cannot resize image /opt/stack/data/nova/instances/e02d1e69-5e74-43c3-8546-6044d31145f2/disk to a smaller size. {{(pid=75176) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 15:45:10 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-52b207bb-4007-4944-b983-c4f373a5c717 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] [instance: e02d1e69-5e74-43c3-8546-6044d31145f2] Created local disks {{(pid=75176) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 15:45:10 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-52b207bb-4007-4944-b983-c4f373a5c717 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] [instance: e02d1e69-5e74-43c3-8546-6044d31145f2] Ensure instance console log exists: /opt/stack/data/nova/instances/e02d1e69-5e74-43c3-8546-6044d31145f2/console.log {{(pid=75176) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 15:45:10 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-52b207bb-4007-4944-b983-c4f373a5c717 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:45:10 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-52b207bb-4007-4944-b983-c4f373a5c717 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:45:10 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-52b207bb-4007-4944-b983-c4f373a5c717 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:45:10 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-52b207bb-4007-4944-b983-c4f373a5c717 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] [instance: e02d1e69-5e74-43c3-8546-6044d31145f2] Start _get_guest_xml network_info=[{"id": "9a63b660-0280-42b9-868c-dbf0c26ee995", "address": "fa:16:3e:ed:a5:68", "network": {"id": "8b63f2d3-0683-4832-abc5-e4c796cf12ab", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-877608435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3704b38a2bd44cb78c28d3f6d86d9e60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a63b660-02", "ovs_interfaceid": "9a63b660-0280-42b9-868c-dbf0c26ee995", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T15:35:12Z,direct_url=<?>,disk_format='qcow2',id=1f41819e-c93f-4dc7-b253-37a27bbbbc74,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1b91c5d0672c4224a48df2e1f92688e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T15:35:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'size': 0, 'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'image_id': '1f41819e-c93f-4dc7-b253-37a27bbbbc74'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'grxAmRcs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e02d1e69-5e74-43c3-8546-6044d31145f2', 'attached_at': '', 'detached_at': '', 'volume_id': 'b424d718-a756-4599-a969-530c2d3c3c24', 'serial': 'b424d718-a756-4599-a969-530c2d3c3c24'}, 'guest_format': None, 'device_type': 'disk', 'boot_index': None, 'disk_bus': 'virtio', 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'attachment_id': 'b28179d5-5349-4486-b4a1-1c011f5ce4f7', 'volume_type': None} {{(pid=75176) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 15:45:10 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-52b207bb-4007-4944-b983-c4f373a5c717 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 28 15:45:10 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-52b207bb-4007-4944-b983-c4f373a5c717 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 28 15:45:10 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-52b207bb-4007-4944-b983-c4f373a5c717 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75176) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 15:45:10 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-52b207bb-4007-4944-b983-c4f373a5c717 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] CPU controller missing on host. {{(pid=75176) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 15:45:10 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-52b207bb-4007-4944-b983-c4f373a5c717 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75176) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 15:45:11 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-52b207bb-4007-4944-b983-c4f373a5c717 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] CPU controller found on host. {{(pid=75176) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 15:45:11 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-52b207bb-4007-4944-b983-c4f373a5c717 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75176) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 15:45:11 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-52b207bb-4007-4944-b983-c4f373a5c717 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T15:35:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T15:35:12Z,direct_url=<?>,disk_format='qcow2',id=1f41819e-c93f-4dc7-b253-37a27bbbbc74,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1b91c5d0672c4224a48df2e1f92688e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T15:35:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 15:45:11 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-52b207bb-4007-4944-b983-c4f373a5c717 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Flavor limits 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 15:45:11 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-52b207bb-4007-4944-b983-c4f373a5c717 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Image limits 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 15:45:11 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-52b207bb-4007-4944-b983-c4f373a5c717 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Flavor pref 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 15:45:11 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-52b207bb-4007-4944-b983-c4f373a5c717 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Image pref 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 15:45:11 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-52b207bb-4007-4944-b983-c4f373a5c717 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 15:45:11 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-52b207bb-4007-4944-b983-c4f373a5c717 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 15:45:11 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-52b207bb-4007-4944-b983-c4f373a5c717 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75176) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 15:45:11 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-52b207bb-4007-4944-b983-c4f373a5c717 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Got 1 possible topologies {{(pid=75176) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 15:45:11 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-52b207bb-4007-4944-b983-c4f373a5c717 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 15:45:11 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-52b207bb-4007-4944-b983-c4f373a5c717 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 15:45:11 user nova-compute[75176]: DEBUG nova.objects.instance [None req-52b207bb-4007-4944-b983-c4f373a5c717 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Lazy-loading 'vcpu_model' on Instance uuid e02d1e69-5e74-43c3-8546-6044d31145f2 {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:45:11 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52b207bb-4007-4944-b983-c4f373a5c717 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] [instance: e02d1e69-5e74-43c3-8546-6044d31145f2] Calling os-brick to attach iSCSI Volume {{(pid=75176) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 15:45:11 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b207bb-4007-4944-b983-c4f373a5c717 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c1b8a00>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'grxAmRcs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 15:45:11 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-52b207bb-4007-4944-b983-c4f373a5c717 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 28 15:45:11 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-52b207bb-4007-4944-b983-c4f373a5c717 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 15:45:11 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-52b207bb-4007-4944-b983-c4f373a5c717 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 15:45:11 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-52b207bb-4007-4944-b983-c4f373a5c717 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 28 15:45:11 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-52b207bb-4007-4944-b983-c4f373a5c717 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 15:45:11 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-52b207bb-4007-4944-b983-c4f373a5c717 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 15:45:11 user nova-compute[75176]: INFO os_brick.initiator.connectors.iscsi [None req-52b207bb-4007-4944-b983-c4f373a5c717 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 15:45:11 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24 -p 172.16.0.220:3260 {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:45:11 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:45:11 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b147f5e-7fa6-4004-ac9a-9da26df43b8d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:45:11 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b207bb-4007-4944-b983-c4f373a5c717 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 15:45:11 user nova-compute[75176]:  {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:45:11 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24 -p 172.16.0.220:3260 --interface default --op new {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:45:11 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:45:11 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d93462f-ce88-4d12-8f35-50c6b891c6c9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24] added\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:45:11 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b207bb-4007-4944-b983-c4f373a5c717 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24] added
Nov 28 15:45:11 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:45:11 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:45:11 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:45:11 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[50a67cb1-66d2-4416-bbb6-93fd0bd9990b]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:45:11 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b207bb-4007-4944-b983-c4f373a5c717 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:45:11 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:45:11 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:45:11 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[27962b3a-4a46-4cd2-973b-48b6458e9ae4]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:45:11 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b207bb-4007-4944-b983-c4f373a5c717 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:45:11 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v grxAmRcs {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:45:11 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v grxAmRcs" returned: 0 in 0.026s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:45:11 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-82b3665d-3655-4f5e-bb80-ef0680b6825c tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] [instance: aa223c49-d254-4727-8a01-873026847b37] Starting finish_revert_migration {{(pid=75176) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11816}}
Nov 28 15:45:11 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[128ec21f-9f27-4923-b713-87a98f480614]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:45:11 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b207bb-4007-4944-b983-c4f373a5c717 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'grxAmRcs'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:45:11 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-82b3665d-3655-4f5e-bb80-ef0680b6825c tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] [instance: aa223c49-d254-4727-8a01-873026847b37] Start _get_guest_xml network_info=[{"id": "6514aeb6-8ea4-4a27-a54b-32f650c87957", "address": "fa:16:3e:ea:a6:1b", "network": {"id": "51708ad4-dae1-47fc-bd26-aca8c478ca04", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-279988751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c2fe6bf5e4f4bb3b5d50901bfac0b38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6514aeb6-8e", "ovs_interfaceid": "6514aeb6-8ea4-4a27-a54b-32f650c87957", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=1f41819e-c93f-4dc7-b253-37a27bbbbc74,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'size': 0, 'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'image_id': '1f41819e-c93f-4dc7-b253-37a27bbbbc74'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AVKGrjOB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'aa223c49-d254-4727-8a01-873026847b37', 'attached_at': '2023-11-28T15:45:11.000000', 'detached_at': '', 'volume_id': 'f61f7c78-66f5-45c5-85ac-2b97ed31a24d', 'serial': 'f61f7c78-66f5-45c5-85ac-2b97ed31a24d'}, 'guest_format': None, 'device_type': 'disk', 'boot_index': None, 'disk_bus': 'virtio', 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'attachment_id': '9b4260b5-94d5-46ea-9cd5-3dc4b4bcf324', 'volume_type': None} {{(pid=75176) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 15:45:11 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:45:11 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-82b3665d-3655-4f5e-bb80-ef0680b6825c tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 15:45:11 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-82b3665d-3655-4f5e-bb80-ef0680b6825c tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 15:45:11 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-82b3665d-3655-4f5e-bb80-ef0680b6825c tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75176) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 15:45:11 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-82b3665d-3655-4f5e-bb80-ef0680b6825c tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] CPU controller missing on host. {{(pid=75176) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 15:45:11 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:45:11 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[89121759-a334-4d14-a225-a2f7a9804770]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:45:11 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b207bb-4007-4944-b983-c4f373a5c717 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:45:11 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-82b3665d-3655-4f5e-bb80-ef0680b6825c tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75176) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 15:45:11 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-82b3665d-3655-4f5e-bb80-ef0680b6825c tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] CPU controller found on host. {{(pid=75176) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 15:45:11 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-82b3665d-3655-4f5e-bb80-ef0680b6825c tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75176) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 15:45:11 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-82b3665d-3655-4f5e-bb80-ef0680b6825c tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T15:35:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=1f41819e-c93f-4dc7-b253-37a27bbbbc74,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 15:45:11 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-82b3665d-3655-4f5e-bb80-ef0680b6825c tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Flavor limits 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 15:45:11 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-82b3665d-3655-4f5e-bb80-ef0680b6825c tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Image limits 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 15:45:11 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-82b3665d-3655-4f5e-bb80-ef0680b6825c tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Flavor pref 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 15:45:11 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-82b3665d-3655-4f5e-bb80-ef0680b6825c tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Image pref 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 15:45:11 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-82b3665d-3655-4f5e-bb80-ef0680b6825c tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 15:45:11 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-82b3665d-3655-4f5e-bb80-ef0680b6825c tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 15:45:11 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-82b3665d-3655-4f5e-bb80-ef0680b6825c tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75176) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 15:45:11 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-82b3665d-3655-4f5e-bb80-ef0680b6825c tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Got 1 possible topologies {{(pid=75176) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 15:45:11 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-82b3665d-3655-4f5e-bb80-ef0680b6825c tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 15:45:11 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-82b3665d-3655-4f5e-bb80-ef0680b6825c tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 15:45:11 user nova-compute[75176]: DEBUG nova.objects.instance [None req-82b3665d-3655-4f5e-bb80-ef0680b6825c tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Lazy-loading 'vcpu_model' on Instance uuid aa223c49-d254-4727-8a01-873026847b37 {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:45:11 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:45:11 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-82b3665d-3655-4f5e-bb80-ef0680b6825c tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] [instance: aa223c49-d254-4727-8a01-873026847b37] Calling os-brick to attach iSCSI Volume {{(pid=75176) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 15:45:11 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-82b3665d-3655-4f5e-bb80-ef0680b6825c tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c1b8a00>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AVKGrjOB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 15:45:11 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-82b3665d-3655-4f5e-bb80-ef0680b6825c tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 15:45:11 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-82b3665d-3655-4f5e-bb80-ef0680b6825c tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 15:45:11 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:45:11 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[970372bb-9c92-413c-be52-940992f38453]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bb22dca-8491-42ef-815f-7b0c0ca4be5a (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea228e4f-f9b2-477a-a75f-542bc9d47ec4 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1f5de5d-be7a-443a-9831-791c8667c09b (non-flash)\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:45:11 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b207bb-4007-4944-b983-c4f373a5c717 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bb22dca-8491-42ef-815f-7b0c0ca4be5a (non-flash)
Nov 28 15:45:11 user nova-compute[75176]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea228e4f-f9b2-477a-a75f-542bc9d47ec4 (non-flash)
Nov 28 15:45:11 user nova-compute[75176]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1f5de5d-be7a-443a-9831-791c8667c09b (non-flash)
Nov 28 15:45:11 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:45:11 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b207bb-4007-4944-b983-c4f373a5c717 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bb22dca-8491-42ef-815f-7b0c0ca4be5a (non-flash)
Nov 28 15:45:11 user nova-compute[75176]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea228e4f-f9b2-477a-a75f-542bc9d47ec4 (non-flash)
Nov 28 15:45:11 user nova-compute[75176]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1f5de5d-be7a-443a-9831-791c8667c09b (non-flash)
Nov 28 15:45:11 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 15:45:11 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24 -p 172.16.0.220:3260 --login {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:45:11 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:45:11 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24 -p 172.16.0.220:3260 --login" returned: 0 in 0.088s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:45:11 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4e375a8-d5df-4248-b369-bd3f031de229]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:45:11 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b207bb-4007-4944-b983-c4f373a5c717 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24, portal: 172.16.0.220,3260]
Nov 28 15:45:11 user nova-compute[75176]: Login to [iface: default, target: iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24, portal: 172.16.0.220,3260] successful.
Nov 28 15:45:11 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:45:11 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:45:11 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:45:11 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[77f67cef-a2ce-46e5-9a42-a9887991b9bb]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:45:11 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b207bb-4007-4944-b983-c4f373a5c717 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:45:11 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:45:11 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:45:11 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a70f747-5764-4197-ae05-99302ec02d9c]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bb22dca-8491-42ef-815f-7b0c0ca4be5a (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea228e4f-f9b2-477a-a75f-542bc9d47ec4 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1f5de5d-be7a-443a-9831-791c8667c09b (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24 (non-flash)\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:45:11 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b207bb-4007-4944-b983-c4f373a5c717 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bb22dca-8491-42ef-815f-7b0c0ca4be5a (non-flash)
Nov 28 15:45:11 user nova-compute[75176]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea228e4f-f9b2-477a-a75f-542bc9d47ec4 (non-flash)
Nov 28 15:45:11 user nova-compute[75176]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1f5de5d-be7a-443a-9831-791c8667c09b (non-flash)
Nov 28 15:45:11 user nova-compute[75176]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24 (non-flash)
Nov 28 15:45:11 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:45:11 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b207bb-4007-4944-b983-c4f373a5c717 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bb22dca-8491-42ef-815f-7b0c0ca4be5a (non-flash)
Nov 28 15:45:11 user nova-compute[75176]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea228e4f-f9b2-477a-a75f-542bc9d47ec4 (non-flash)
Nov 28 15:45:11 user nova-compute[75176]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1f5de5d-be7a-443a-9831-791c8667c09b (non-flash)
Nov 28 15:45:11 user nova-compute[75176]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24 (non-flash)
Nov 28 15:45:11 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 15:45:11 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-52b207bb-4007-4944-b983-c4f373a5c717 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.430s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 15:45:11 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b207bb-4007-4944-b983-c4f373a5c717 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Connected to 172.16.0.220:3260 {{(pid=75176) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 15:45:11 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-52b207bb-4007-4944-b983-c4f373a5c717 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] HCTL ('36', '-', '-', 0) found on session 23 with lun 0 {{(pid=75176) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 15:45:11 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-52b207bb-4007-4944-b983-c4f373a5c717 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75176) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 15:45:11 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:45:11 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.021s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:45:11 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[43a7b6da-76d0-47da-8326-1f512c64ab10]: (4, ('- - 0', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:45:11 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-52b207bb-4007-4944-b983-c4f373a5c717 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Searching for a device in session 23 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75176) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 15:45:11 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b207bb-4007-4944-b983-c4f373a5c717 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'grxAmRcs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75176) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 15:45:12 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-52b207bb-4007-4944-b983-c4f373a5c717 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.467s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 15:45:12 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b207bb-4007-4944-b983-c4f373a5c717 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] <== connect_volume: return (1469ms) {'type': 'block', 'scsi_wwn': '26462356432313838', 'path': '/dev/sde'} {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 15:45:12 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52b207bb-4007-4944-b983-c4f373a5c717 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] [instance: e02d1e69-5e74-43c3-8546-6044d31145f2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26462356432313838', 'path': '/dev/sde'} {{(pid=75176) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 15:45:12 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-82b3665d-3655-4f5e-bb80-ef0680b6825c tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.197s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 15:45:12 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-82b3665d-3655-4f5e-bb80-ef0680b6825c tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 15:45:12 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-82b3665d-3655-4f5e-bb80-ef0680b6825c tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 15:45:12 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-82b3665d-3655-4f5e-bb80-ef0680b6825c tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 15:45:12 user nova-compute[75176]: INFO os_brick.initiator.connectors.iscsi [None req-82b3665d-3655-4f5e-bb80-ef0680b6825c tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 15:45:12 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d -p 172.16.0.220:3260 {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:45:12 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:45:12 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[060835ff-6fbb-475a-ac4c-aca86a8cd635]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:45:12 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-82b3665d-3655-4f5e-bb80-ef0680b6825c tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 15:45:12 user nova-compute[75176]:  {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:45:12 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d -p 172.16.0.220:3260 --interface default --op new {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:45:12 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-52b207bb-4007-4944-b983-c4f373a5c717 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-28T15:42:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-675567476',display_name='tempest-ServerActionsTestOtherA-server-1020561533',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-675567476',id=15,image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGHQgrfEWt8pIfRnhBJ24kFyu29uELDK7Re5fQAvns3FKElXmrGxqyeLKhrovaGXrIG8CV9ozkAnryzObqKasCPi8GMPgqqgdQkjAV0c1Qea28G7qtna2/64n19K46tX/A==',key_name='tempest-keypair-1504939882',keypairs=<?>,launch_index=0,launched_at=2023-11-28T15:43:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3704b38a2bd44cb78c28d3f6d86d9e60',ramdisk_id='',reservation_id='r-2pd1l9gx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-680502445',owner_user_name='tempest-ServerActionsTestOtherA-680502445-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T15:45:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d028b79a105b485dbb0178c9da162640',uuid=e02d1e69-5e74-43c3-8546-6044d31145f2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9a63b660-0280-42b9-868c-dbf0c26ee995", "address": "fa:16:3e:ed:a5:68", "network": {"id": "8b63f2d3-0683-4832-abc5-e4c796cf12ab", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-877608435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3704b38a2bd44cb78c28d3f6d86d9e60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a63b660-02", "ovs_interfaceid": "9a63b660-0280-42b9-868c-dbf0c26ee995", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75176) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 15:45:12 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-52b207bb-4007-4944-b983-c4f373a5c717 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Converting VIF {"id": "9a63b660-0280-42b9-868c-dbf0c26ee995", "address": "fa:16:3e:ed:a5:68", "network": {"id": "8b63f2d3-0683-4832-abc5-e4c796cf12ab", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-877608435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3704b38a2bd44cb78c28d3f6d86d9e60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a63b660-02", "ovs_interfaceid": "9a63b660-0280-42b9-868c-dbf0c26ee995", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:45:12 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-52b207bb-4007-4944-b983-c4f373a5c717 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ed:a5:68,bridge_name='br-int',has_traffic_filtering=True,id=9a63b660-0280-42b9-868c-dbf0c26ee995,network=Network(8b63f2d3-0683-4832-abc5-e4c796cf12ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a63b660-02') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:45:12 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-52b207bb-4007-4944-b983-c4f373a5c717 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] [instance: e02d1e69-5e74-43c3-8546-6044d31145f2] End _get_guest_xml xml=<domain type="kvm">
Nov 28 15:45:12 user nova-compute[75176]:   <uuid>e02d1e69-5e74-43c3-8546-6044d31145f2</uuid>
Nov 28 15:45:12 user nova-compute[75176]:   <name>instance-0000000f</name>
Nov 28 15:45:12 user nova-compute[75176]:   <memory>524288</memory>
Nov 28 15:45:12 user nova-compute[75176]:   <vcpu>1</vcpu>
Nov 28 15:45:12 user nova-compute[75176]:   <metadata>
Nov 28 15:45:12 user nova-compute[75176]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 15:45:12 user nova-compute[75176]:       <nova:package version="0.0.0"/>
Nov 28 15:45:12 user nova-compute[75176]:       <nova:name>tempest-ServerActionsTestOtherA-server-1020561533</nova:name>
Nov 28 15:45:12 user nova-compute[75176]:       <nova:creationTime>2023-11-28 15:45:10</nova:creationTime>
Nov 28 15:45:12 user nova-compute[75176]:       <nova:flavor name="m1.tiny">
Nov 28 15:45:12 user nova-compute[75176]:         <nova:memory>512</nova:memory>
Nov 28 15:45:12 user nova-compute[75176]:         <nova:disk>1</nova:disk>
Nov 28 15:45:12 user nova-compute[75176]:         <nova:swap>0</nova:swap>
Nov 28 15:45:12 user nova-compute[75176]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 15:45:12 user nova-compute[75176]:         <nova:vcpus>1</nova:vcpus>
Nov 28 15:45:12 user nova-compute[75176]:       </nova:flavor>
Nov 28 15:45:12 user nova-compute[75176]:       <nova:owner>
Nov 28 15:45:12 user nova-compute[75176]:         <nova:user uuid="d028b79a105b485dbb0178c9da162640">tempest-ServerActionsTestOtherA-680502445-project-member</nova:user>
Nov 28 15:45:12 user nova-compute[75176]:         <nova:project uuid="3704b38a2bd44cb78c28d3f6d86d9e60">tempest-ServerActionsTestOtherA-680502445</nova:project>
Nov 28 15:45:12 user nova-compute[75176]:       </nova:owner>
Nov 28 15:45:12 user nova-compute[75176]:       <nova:root type="image" uuid="1f41819e-c93f-4dc7-b253-37a27bbbbc74"/>
Nov 28 15:45:12 user nova-compute[75176]:       <nova:ports>
Nov 28 15:45:12 user nova-compute[75176]:         <nova:port uuid="9a63b660-0280-42b9-868c-dbf0c26ee995">
Nov 28 15:45:12 user nova-compute[75176]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 28 15:45:12 user nova-compute[75176]:         </nova:port>
Nov 28 15:45:12 user nova-compute[75176]:       </nova:ports>
Nov 28 15:45:12 user nova-compute[75176]:     </nova:instance>
Nov 28 15:45:12 user nova-compute[75176]:   </metadata>
Nov 28 15:45:12 user nova-compute[75176]:   <sysinfo type="smbios">
Nov 28 15:45:12 user nova-compute[75176]:     <system>
Nov 28 15:45:12 user nova-compute[75176]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 15:45:12 user nova-compute[75176]:       <entry name="product">OpenStack Nova</entry>
Nov 28 15:45:12 user nova-compute[75176]:       <entry name="version">0.0.0</entry>
Nov 28 15:45:12 user nova-compute[75176]:       <entry name="serial">e02d1e69-5e74-43c3-8546-6044d31145f2</entry>
Nov 28 15:45:12 user nova-compute[75176]:       <entry name="uuid">e02d1e69-5e74-43c3-8546-6044d31145f2</entry>
Nov 28 15:45:12 user nova-compute[75176]:       <entry name="family">Virtual Machine</entry>
Nov 28 15:45:12 user nova-compute[75176]:     </system>
Nov 28 15:45:12 user nova-compute[75176]:   </sysinfo>
Nov 28 15:45:12 user nova-compute[75176]:   <os>
Nov 28 15:45:12 user nova-compute[75176]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 15:45:12 user nova-compute[75176]:     <boot dev="hd"/>
Nov 28 15:45:12 user nova-compute[75176]:     <smbios mode="sysinfo"/>
Nov 28 15:45:12 user nova-compute[75176]:   </os>
Nov 28 15:45:12 user nova-compute[75176]:   <features>
Nov 28 15:45:12 user nova-compute[75176]:     <acpi/>
Nov 28 15:45:12 user nova-compute[75176]:     <apic/>
Nov 28 15:45:12 user nova-compute[75176]:     <vmcoreinfo/>
Nov 28 15:45:12 user nova-compute[75176]:   </features>
Nov 28 15:45:12 user nova-compute[75176]:   <clock offset="utc">
Nov 28 15:45:12 user nova-compute[75176]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 15:45:12 user nova-compute[75176]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 15:45:12 user nova-compute[75176]:     <timer name="hpet" present="no"/>
Nov 28 15:45:12 user nova-compute[75176]:   </clock>
Nov 28 15:45:12 user nova-compute[75176]:   <cpu mode="custom" match="exact">
Nov 28 15:45:12 user nova-compute[75176]:     <model>Nehalem</model>
Nov 28 15:45:12 user nova-compute[75176]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 15:45:12 user nova-compute[75176]:   </cpu>
Nov 28 15:45:12 user nova-compute[75176]:   <devices>
Nov 28 15:45:12 user nova-compute[75176]:     <disk type="file" device="disk">
Nov 28 15:45:12 user nova-compute[75176]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 15:45:12 user nova-compute[75176]:       <source file="/opt/stack/data/nova/instances/e02d1e69-5e74-43c3-8546-6044d31145f2/disk"/>
Nov 28 15:45:12 user nova-compute[75176]:       <target dev="vda" bus="virtio"/>
Nov 28 15:45:12 user nova-compute[75176]:     </disk>
Nov 28 15:45:12 user nova-compute[75176]:     <disk type="block" device="disk">
Nov 28 15:45:12 user nova-compute[75176]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 15:45:12 user nova-compute[75176]:       <source dev="/dev/sde"/>
Nov 28 15:45:12 user nova-compute[75176]:       <target dev="vdb" bus="virtio"/>
Nov 28 15:45:12 user nova-compute[75176]:       <serial>b424d718-a756-4599-a969-530c2d3c3c24</serial>
Nov 28 15:45:12 user nova-compute[75176]:     </disk>
Nov 28 15:45:12 user nova-compute[75176]:     <interface type="ethernet">
Nov 28 15:45:12 user nova-compute[75176]:       <mac address="fa:16:3e:ed:a5:68"/>
Nov 28 15:45:12 user nova-compute[75176]:       <model type="virtio"/>
Nov 28 15:45:12 user nova-compute[75176]:       <mtu size="1442"/>
Nov 28 15:45:12 user nova-compute[75176]:       <target dev="tap9a63b660-02"/>
Nov 28 15:45:12 user nova-compute[75176]:     </interface>
Nov 28 15:45:12 user nova-compute[75176]:     <serial type="pty">
Nov 28 15:45:12 user nova-compute[75176]:       <log file="/opt/stack/data/nova/instances/e02d1e69-5e74-43c3-8546-6044d31145f2/console.log" append="off"/>
Nov 28 15:45:12 user nova-compute[75176]:     </serial>
Nov 28 15:45:12 user nova-compute[75176]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 15:45:12 user nova-compute[75176]:     <video>
Nov 28 15:45:12 user nova-compute[75176]:       <model type="virtio"/>
Nov 28 15:45:12 user nova-compute[75176]:     </video>
Nov 28 15:45:12 user nova-compute[75176]:     <rng model="virtio">
Nov 28 15:45:12 user nova-compute[75176]:       <backend model="random">/dev/urandom</backend>
Nov 28 15:45:12 user nova-compute[75176]:     </rng>
Nov 28 15:45:12 user nova-compute[75176]:     <controller type="usb" index="0" model="none"/>
Nov 28 15:45:12 user nova-compute[75176]:     <memballoon model="virtio">
Nov 28 15:45:12 user nova-compute[75176]:       <stats period="10"/>
Nov 28 15:45:12 user nova-compute[75176]:     </memballoon>
Nov 28 15:45:12 user nova-compute[75176]:   </devices>
Nov 28 15:45:12 user nova-compute[75176]: </domain>
Nov 28 15:45:12 user nova-compute[75176]:  {{(pid=75176) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 15:45:12 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-52b207bb-4007-4944-b983-c4f373a5c717 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-28T15:42:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-675567476',display_name='tempest-ServerActionsTestOtherA-server-1020561533',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-675567476',id=15,image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGHQgrfEWt8pIfRnhBJ24kFyu29uELDK7Re5fQAvns3FKElXmrGxqyeLKhrovaGXrIG8CV9ozkAnryzObqKasCPi8GMPgqqgdQkjAV0c1Qea28G7qtna2/64n19K46tX/A==',key_name='tempest-keypair-1504939882',keypairs=<?>,launch_index=0,launched_at=2023-11-28T15:43:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3704b38a2bd44cb78c28d3f6d86d9e60',ramdisk_id='',reservation_id='r-2pd1l9gx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-680502445',owner_user_name='tempest-ServerActionsTestOtherA-680502445-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T15:45:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d028b79a105b485dbb0178c9da162640',uuid=e02d1e69-5e74-43c3-8546-6044d31145f2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9a63b660-0280-42b9-868c-dbf0c26ee995", "address": "fa:16:3e:ed:a5:68", "network": {"id": "8b63f2d3-0683-4832-abc5-e4c796cf12ab", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-877608435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3704b38a2bd44cb78c28d3f6d86d9e60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a63b660-02", "ovs_interfaceid": "9a63b660-0280-42b9-868c-dbf0c26ee995", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 15:45:12 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-52b207bb-4007-4944-b983-c4f373a5c717 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Converting VIF {"id": "9a63b660-0280-42b9-868c-dbf0c26ee995", "address": "fa:16:3e:ed:a5:68", "network": {"id": "8b63f2d3-0683-4832-abc5-e4c796cf12ab", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-877608435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3704b38a2bd44cb78c28d3f6d86d9e60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a63b660-02", "ovs_interfaceid": "9a63b660-0280-42b9-868c-dbf0c26ee995", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:45:12 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-52b207bb-4007-4944-b983-c4f373a5c717 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ed:a5:68,bridge_name='br-int',has_traffic_filtering=True,id=9a63b660-0280-42b9-868c-dbf0c26ee995,network=Network(8b63f2d3-0683-4832-abc5-e4c796cf12ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a63b660-02') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:45:12 user nova-compute[75176]: DEBUG os_vif [None req-52b207bb-4007-4944-b983-c4f373a5c717 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ed:a5:68,bridge_name='br-int',has_traffic_filtering=True,id=9a63b660-0280-42b9-868c-dbf0c26ee995,network=Network(8b63f2d3-0683-4832-abc5-e4c796cf12ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a63b660-02') {{(pid=75176) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 15:45:12 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:45:12 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:45:12 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 15:45:12 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:45:12 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '59dd224e-5254-5084-afeb-e95da265db27', '_type': 'linux-noop'}}, row=False) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:45:12 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:45:12 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[446dcecd-3548-4756-832c-9a9e11861fbb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d] added\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:45:12 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-82b3665d-3655-4f5e-bb80-ef0680b6825c tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d] added
Nov 28 15:45:12 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:45:12 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:45:12 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:45:12 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:45:12 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:45:12 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9a63b660-02, may_exist=True, interface_attrs={}) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:45:12 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9a63b660-02, col_values=(('qos', UUID('0c2e2d58-3b64-4f9b-88bb-50ded33eff41')),), if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:45:12 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9a63b660-02, col_values=(('external_ids', {'iface-id': '9a63b660-0280-42b9-868c-dbf0c26ee995', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ed:a5:68', 'vm-uuid': 'e02d1e69-5e74-43c3-8546-6044d31145f2'}),), if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:45:12 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:45:12 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:45:12 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:45:12 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[d604ce90-4c28-4090-afc8-a1a949825e7d]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:45:12 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-82b3665d-3655-4f5e-bb80-ef0680b6825c tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:45:12 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:45:12 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:45:12 user nova-compute[75176]: INFO os_vif [None req-52b207bb-4007-4944-b983-c4f373a5c717 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ed:a5:68,bridge_name='br-int',has_traffic_filtering=True,id=9a63b660-0280-42b9-868c-dbf0c26ee995,network=Network(8b63f2d3-0683-4832-abc5-e4c796cf12ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a63b660-02')
Nov 28 15:45:12 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:45:12 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[17485559-cd23-4924-8971-0ea690f5fc82]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:45:12 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-82b3665d-3655-4f5e-bb80-ef0680b6825c tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:45:12 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AVKGrjOB {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:45:12 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AVKGrjOB" returned: 0 in 0.025s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:45:12 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[84aa8fef-c899-444c-ac56-97cffc230d8b]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:45:12 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-82b3665d-3655-4f5e-bb80-ef0680b6825c tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AVKGrjOB'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:45:12 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:45:12 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-52b207bb-4007-4944-b983-c4f373a5c717 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] No BDM found with device name vda, not building metadata. {{(pid=75176) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 15:45:12 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-52b207bb-4007-4944-b983-c4f373a5c717 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75176) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 15:45:12 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-52b207bb-4007-4944-b983-c4f373a5c717 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] No VIF found with MAC fa:16:3e:ed:a5:68, not building metadata {{(pid=75176) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 15:45:12 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:45:12 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6887eff-7934-45fa-a92f-bda9d49195a7]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:45:12 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-82b3665d-3655-4f5e-bb80-ef0680b6825c tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:45:12 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:45:12 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:45:12 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c1c2fe6-97b2-44c8-90b4-4387c5cc8676]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bb22dca-8491-42ef-815f-7b0c0ca4be5a (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea228e4f-f9b2-477a-a75f-542bc9d47ec4 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1f5de5d-be7a-443a-9831-791c8667c09b (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24 (non-flash)\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:45:12 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-82b3665d-3655-4f5e-bb80-ef0680b6825c tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bb22dca-8491-42ef-815f-7b0c0ca4be5a (non-flash)
Nov 28 15:45:12 user nova-compute[75176]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea228e4f-f9b2-477a-a75f-542bc9d47ec4 (non-flash)
Nov 28 15:45:12 user nova-compute[75176]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1f5de5d-be7a-443a-9831-791c8667c09b (non-flash)
Nov 28 15:45:12 user nova-compute[75176]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24 (non-flash)
Nov 28 15:45:12 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:45:12 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-82b3665d-3655-4f5e-bb80-ef0680b6825c tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bb22dca-8491-42ef-815f-7b0c0ca4be5a (non-flash)
Nov 28 15:45:12 user nova-compute[75176]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea228e4f-f9b2-477a-a75f-542bc9d47ec4 (non-flash)
Nov 28 15:45:12 user nova-compute[75176]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1f5de5d-be7a-443a-9831-791c8667c09b (non-flash)
Nov 28 15:45:12 user nova-compute[75176]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24 (non-flash)
Nov 28 15:45:12 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 15:45:12 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d -p 172.16.0.220:3260 --login {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:45:12 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d -p 172.16.0.220:3260 --login" returned: 0 in 0.131s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:45:12 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[26a9570f-1b7e-4faf-9ef6-0d67c4a30d8f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:45:12 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-82b3665d-3655-4f5e-bb80-ef0680b6825c tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d, portal: 172.16.0.220,3260]
Nov 28 15:45:12 user nova-compute[75176]: Login to [iface: default, target: iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d, portal: 172.16.0.220,3260] successful.
Nov 28 15:45:12 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:45:12 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:45:12 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:45:12 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a9e4411-19c9-4420-88b8-3a280f68620b]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:45:12 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-82b3665d-3655-4f5e-bb80-ef0680b6825c tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:45:12 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:45:12 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:45:12 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fd7a752-3e19-4477-857e-6cca8967a551]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bb22dca-8491-42ef-815f-7b0c0ca4be5a (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea228e4f-f9b2-477a-a75f-542bc9d47ec4 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1f5de5d-be7a-443a-9831-791c8667c09b (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d (non-flash)\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:45:12 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-82b3665d-3655-4f5e-bb80-ef0680b6825c tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bb22dca-8491-42ef-815f-7b0c0ca4be5a (non-flash)
Nov 28 15:45:12 user nova-compute[75176]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea228e4f-f9b2-477a-a75f-542bc9d47ec4 (non-flash)
Nov 28 15:45:12 user nova-compute[75176]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1f5de5d-be7a-443a-9831-791c8667c09b (non-flash)
Nov 28 15:45:12 user nova-compute[75176]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24 (non-flash)
Nov 28 15:45:12 user nova-compute[75176]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d (non-flash)
Nov 28 15:45:12 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:45:12 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-82b3665d-3655-4f5e-bb80-ef0680b6825c tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bb22dca-8491-42ef-815f-7b0c0ca4be5a (non-flash)
Nov 28 15:45:12 user nova-compute[75176]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea228e4f-f9b2-477a-a75f-542bc9d47ec4 (non-flash)
Nov 28 15:45:12 user nova-compute[75176]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1f5de5d-be7a-443a-9831-791c8667c09b (non-flash)
Nov 28 15:45:12 user nova-compute[75176]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24 (non-flash)
Nov 28 15:45:12 user nova-compute[75176]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d (non-flash)
Nov 28 15:45:12 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 15:45:12 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-82b3665d-3655-4f5e-bb80-ef0680b6825c tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.417s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 15:45:12 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-82b3665d-3655-4f5e-bb80-ef0680b6825c tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Connected to 172.16.0.220:3260 {{(pid=75176) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 15:45:12 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-82b3665d-3655-4f5e-bb80-ef0680b6825c tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] HCTL ('37', '-', '-', 0) found on session 24 with lun 0 {{(pid=75176) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 15:45:12 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-82b3665d-3655-4f5e-bb80-ef0680b6825c tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75176) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 15:45:12 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:45:12 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.019s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:45:12 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[f16fbf86-c7b0-471d-a6ac-8049a3685e5b]: (4, ('- - 0', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:45:12 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-82b3665d-3655-4f5e-bb80-ef0680b6825c tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Searching for a device in session 24 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75176) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 15:45:13 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-82b3665d-3655-4f5e-bb80-ef0680b6825c tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AVKGrjOB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75176) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 15:45:13 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-049970df-7a83-47f2-bb2f-81c4e6331bed tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] Acquiring lock "5b18c889-7694-4edf-8cf2-b9032e60289e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:45:13 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-049970df-7a83-47f2-bb2f-81c4e6331bed tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] Lock "5b18c889-7694-4edf-8cf2-b9032e60289e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:45:13 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-049970df-7a83-47f2-bb2f-81c4e6331bed tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] Acquiring lock "5b18c889-7694-4edf-8cf2-b9032e60289e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:45:13 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-049970df-7a83-47f2-bb2f-81c4e6331bed tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] Lock "5b18c889-7694-4edf-8cf2-b9032e60289e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:45:13 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-049970df-7a83-47f2-bb2f-81c4e6331bed tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] Lock "5b18c889-7694-4edf-8cf2-b9032e60289e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:45:13 user nova-compute[75176]: INFO nova.compute.manager [None req-049970df-7a83-47f2-bb2f-81c4e6331bed tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] [instance: 5b18c889-7694-4edf-8cf2-b9032e60289e] Terminating instance
Nov 28 15:45:13 user nova-compute[75176]: DEBUG nova.compute.manager [None req-049970df-7a83-47f2-bb2f-81c4e6331bed tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] [instance: 5b18c889-7694-4edf-8cf2-b9032e60289e] Start destroying the instance on the hypervisor. {{(pid=75176) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 15:45:13 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:45:13 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:45:13 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:45:13 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:45:14 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-82b3665d-3655-4f5e-bb80-ef0680b6825c tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.456s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 15:45:14 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-82b3665d-3655-4f5e-bb80-ef0680b6825c tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] <== connect_volume: return (2654ms) {'type': 'block', 'scsi_wwn': '26236393065326363', 'path': '/dev/sdf'} {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 15:45:14 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-82b3665d-3655-4f5e-bb80-ef0680b6825c tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] [instance: aa223c49-d254-4727-8a01-873026847b37] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26236393065326363', 'path': '/dev/sdf'} {{(pid=75176) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 15:45:14 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:45:14 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-82b3665d-3655-4f5e-bb80-ef0680b6825c tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T15:39:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-595327070',display_name='tempest-ServerActionsTestOtherB-server-595327070',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-595327070',id=3,image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG46aaldZ31/SMomPHuTDQH3UTedHGSV4iG8fWtpOqqr4Cywzy71R0Ov1C6XRnOo4sYKyOfCcRfklnh+MSVYzyKoTfjcvtFT0nSQtOBIOaQ8vVTuyCcNwyJ0nmpmqFlJng==',key_name='tempest-keypair-1738862822',keypairs=<?>,launch_index=0,launched_at=2023-11-28T15:43:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='4c2fe6bf5e4f4bb3b5d50901bfac0b38',ramdisk_id='',reservation_id='r-k1by7x80',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-935995346',owner_user_name='tempest-ServerActionsTestOtherB-935995346-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T15:44:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='16ea4be4bcb34749b2f444c4694543b1',uuid=aa223c49-d254-4727-8a01-873026847b37,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "6514aeb6-8ea4-4a27-a54b-32f650c87957", "address": "fa:16:3e:ea:a6:1b", "network": {"id": "51708ad4-dae1-47fc-bd26-aca8c478ca04", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-279988751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c2fe6bf5e4f4bb3b5d50901bfac0b38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6514aeb6-8e", "ovs_interfaceid": "6514aeb6-8ea4-4a27-a54b-32f650c87957", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75176) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 15:45:14 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-82b3665d-3655-4f5e-bb80-ef0680b6825c tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Converting VIF {"id": "6514aeb6-8ea4-4a27-a54b-32f650c87957", "address": "fa:16:3e:ea:a6:1b", "network": {"id": "51708ad4-dae1-47fc-bd26-aca8c478ca04", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-279988751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c2fe6bf5e4f4bb3b5d50901bfac0b38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6514aeb6-8e", "ovs_interfaceid": "6514aeb6-8ea4-4a27-a54b-32f650c87957", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:45:14 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-82b3665d-3655-4f5e-bb80-ef0680b6825c tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:a6:1b,bridge_name='br-int',has_traffic_filtering=True,id=6514aeb6-8ea4-4a27-a54b-32f650c87957,network=Network(51708ad4-dae1-47fc-bd26-aca8c478ca04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6514aeb6-8e') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:45:14 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-82b3665d-3655-4f5e-bb80-ef0680b6825c tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] [instance: aa223c49-d254-4727-8a01-873026847b37] End _get_guest_xml xml=<domain type="kvm">
Nov 28 15:45:14 user nova-compute[75176]:   <uuid>aa223c49-d254-4727-8a01-873026847b37</uuid>
Nov 28 15:45:14 user nova-compute[75176]:   <name>instance-00000003</name>
Nov 28 15:45:14 user nova-compute[75176]:   <memory>524288</memory>
Nov 28 15:45:14 user nova-compute[75176]:   <vcpu>1</vcpu>
Nov 28 15:45:14 user nova-compute[75176]:   <metadata>
Nov 28 15:45:14 user nova-compute[75176]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 15:45:14 user nova-compute[75176]:       <nova:package version="0.0.0"/>
Nov 28 15:45:14 user nova-compute[75176]:       <nova:name>tempest-ServerActionsTestOtherB-server-595327070</nova:name>
Nov 28 15:45:14 user nova-compute[75176]:       <nova:creationTime>2023-11-28 15:45:11</nova:creationTime>
Nov 28 15:45:14 user nova-compute[75176]:       <nova:flavor name="m1.tiny">
Nov 28 15:45:14 user nova-compute[75176]:         <nova:memory>512</nova:memory>
Nov 28 15:45:14 user nova-compute[75176]:         <nova:disk>1</nova:disk>
Nov 28 15:45:14 user nova-compute[75176]:         <nova:swap>0</nova:swap>
Nov 28 15:45:14 user nova-compute[75176]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 15:45:14 user nova-compute[75176]:         <nova:vcpus>1</nova:vcpus>
Nov 28 15:45:14 user nova-compute[75176]:       </nova:flavor>
Nov 28 15:45:14 user nova-compute[75176]:       <nova:owner>
Nov 28 15:45:14 user nova-compute[75176]:         <nova:user uuid="16ea4be4bcb34749b2f444c4694543b1">tempest-ServerActionsTestOtherB-935995346-project-member</nova:user>
Nov 28 15:45:14 user nova-compute[75176]:         <nova:project uuid="4c2fe6bf5e4f4bb3b5d50901bfac0b38">tempest-ServerActionsTestOtherB-935995346</nova:project>
Nov 28 15:45:14 user nova-compute[75176]:       </nova:owner>
Nov 28 15:45:14 user nova-compute[75176]:       <nova:root type="image" uuid="1f41819e-c93f-4dc7-b253-37a27bbbbc74"/>
Nov 28 15:45:14 user nova-compute[75176]:       <nova:ports>
Nov 28 15:45:14 user nova-compute[75176]:         <nova:port uuid="6514aeb6-8ea4-4a27-a54b-32f650c87957">
Nov 28 15:45:14 user nova-compute[75176]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 28 15:45:14 user nova-compute[75176]:         </nova:port>
Nov 28 15:45:14 user nova-compute[75176]:       </nova:ports>
Nov 28 15:45:14 user nova-compute[75176]:     </nova:instance>
Nov 28 15:45:14 user nova-compute[75176]:   </metadata>
Nov 28 15:45:14 user nova-compute[75176]:   <sysinfo type="smbios">
Nov 28 15:45:14 user nova-compute[75176]:     <system>
Nov 28 15:45:14 user nova-compute[75176]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 15:45:14 user nova-compute[75176]:       <entry name="product">OpenStack Nova</entry>
Nov 28 15:45:14 user nova-compute[75176]:       <entry name="version">0.0.0</entry>
Nov 28 15:45:14 user nova-compute[75176]:       <entry name="serial">aa223c49-d254-4727-8a01-873026847b37</entry>
Nov 28 15:45:14 user nova-compute[75176]:       <entry name="uuid">aa223c49-d254-4727-8a01-873026847b37</entry>
Nov 28 15:45:14 user nova-compute[75176]:       <entry name="family">Virtual Machine</entry>
Nov 28 15:45:14 user nova-compute[75176]:     </system>
Nov 28 15:45:14 user nova-compute[75176]:   </sysinfo>
Nov 28 15:45:14 user nova-compute[75176]:   <os>
Nov 28 15:45:14 user nova-compute[75176]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 15:45:14 user nova-compute[75176]:     <boot dev="hd"/>
Nov 28 15:45:14 user nova-compute[75176]:     <smbios mode="sysinfo"/>
Nov 28 15:45:14 user nova-compute[75176]:   </os>
Nov 28 15:45:14 user nova-compute[75176]:   <features>
Nov 28 15:45:14 user nova-compute[75176]:     <acpi/>
Nov 28 15:45:14 user nova-compute[75176]:     <apic/>
Nov 28 15:45:14 user nova-compute[75176]:     <vmcoreinfo/>
Nov 28 15:45:14 user nova-compute[75176]:   </features>
Nov 28 15:45:14 user nova-compute[75176]:   <clock offset="utc">
Nov 28 15:45:14 user nova-compute[75176]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 15:45:14 user nova-compute[75176]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 15:45:14 user nova-compute[75176]:     <timer name="hpet" present="no"/>
Nov 28 15:45:14 user nova-compute[75176]:   </clock>
Nov 28 15:45:14 user nova-compute[75176]:   <cpu mode="custom" match="exact">
Nov 28 15:45:14 user nova-compute[75176]:     <model>Nehalem</model>
Nov 28 15:45:14 user nova-compute[75176]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 15:45:14 user nova-compute[75176]:   </cpu>
Nov 28 15:45:14 user nova-compute[75176]:   <devices>
Nov 28 15:45:14 user nova-compute[75176]:     <disk type="file" device="disk">
Nov 28 15:45:14 user nova-compute[75176]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 15:45:14 user nova-compute[75176]:       <source file="/opt/stack/data/nova/instances/aa223c49-d254-4727-8a01-873026847b37/disk"/>
Nov 28 15:45:14 user nova-compute[75176]:       <target dev="vda" bus="virtio"/>
Nov 28 15:45:14 user nova-compute[75176]:     </disk>
Nov 28 15:45:14 user nova-compute[75176]:     <disk type="block" device="disk">
Nov 28 15:45:14 user nova-compute[75176]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 15:45:14 user nova-compute[75176]:       <source dev="/dev/sdf"/>
Nov 28 15:45:14 user nova-compute[75176]:       <target dev="vdb" bus="virtio"/>
Nov 28 15:45:14 user nova-compute[75176]:       <serial>f61f7c78-66f5-45c5-85ac-2b97ed31a24d</serial>
Nov 28 15:45:14 user nova-compute[75176]:     </disk>
Nov 28 15:45:14 user nova-compute[75176]:     <interface type="ethernet">
Nov 28 15:45:14 user nova-compute[75176]:       <mac address="fa:16:3e:ea:a6:1b"/>
Nov 28 15:45:14 user nova-compute[75176]:       <model type="virtio"/>
Nov 28 15:45:14 user nova-compute[75176]:       <mtu size="1442"/>
Nov 28 15:45:14 user nova-compute[75176]:       <target dev="tap6514aeb6-8e"/>
Nov 28 15:45:14 user nova-compute[75176]:     </interface>
Nov 28 15:45:14 user nova-compute[75176]:     <serial type="pty">
Nov 28 15:45:14 user nova-compute[75176]:       <log file="/opt/stack/data/nova/instances/aa223c49-d254-4727-8a01-873026847b37/console.log" append="off"/>
Nov 28 15:45:14 user nova-compute[75176]:     </serial>
Nov 28 15:45:14 user nova-compute[75176]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 15:45:14 user nova-compute[75176]:     <video>
Nov 28 15:45:14 user nova-compute[75176]:       <model type="virtio"/>
Nov 28 15:45:14 user nova-compute[75176]:     </video>
Nov 28 15:45:14 user nova-compute[75176]:     <rng model="virtio">
Nov 28 15:45:14 user nova-compute[75176]:       <backend model="random">/dev/urandom</backend>
Nov 28 15:45:14 user nova-compute[75176]:     </rng>
Nov 28 15:45:14 user nova-compute[75176]:     <controller type="usb" index="0" model="none"/>
Nov 28 15:45:14 user nova-compute[75176]:     <memballoon model="virtio">
Nov 28 15:45:14 user nova-compute[75176]:       <stats period="10"/>
Nov 28 15:45:14 user nova-compute[75176]:     </memballoon>
Nov 28 15:45:14 user nova-compute[75176]:   </devices>
Nov 28 15:45:14 user nova-compute[75176]: </domain>
Nov 28 15:45:14 user nova-compute[75176]:  {{(pid=75176) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 15:45:14 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-82b3665d-3655-4f5e-bb80-ef0680b6825c tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T15:39:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-595327070',display_name='tempest-ServerActionsTestOtherB-server-595327070',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-595327070',id=3,image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG46aaldZ31/SMomPHuTDQH3UTedHGSV4iG8fWtpOqqr4Cywzy71R0Ov1C6XRnOo4sYKyOfCcRfklnh+MSVYzyKoTfjcvtFT0nSQtOBIOaQ8vVTuyCcNwyJ0nmpmqFlJng==',key_name='tempest-keypair-1738862822',keypairs=<?>,launch_index=0,launched_at=2023-11-28T15:43:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='4c2fe6bf5e4f4bb3b5d50901bfac0b38',ramdisk_id='',reservation_id='r-k1by7x80',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-935995346',owner_user_name='tempest-ServerActionsTestOtherB-935995346-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T15:44:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='16ea4be4bcb34749b2f444c4694543b1',uuid=aa223c49-d254-4727-8a01-873026847b37,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "6514aeb6-8ea4-4a27-a54b-32f650c87957", "address": "fa:16:3e:ea:a6:1b", "network": {"id": "51708ad4-dae1-47fc-bd26-aca8c478ca04", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-279988751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c2fe6bf5e4f4bb3b5d50901bfac0b38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6514aeb6-8e", "ovs_interfaceid": "6514aeb6-8ea4-4a27-a54b-32f650c87957", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 15:45:14 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-82b3665d-3655-4f5e-bb80-ef0680b6825c tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Converting VIF {"id": "6514aeb6-8ea4-4a27-a54b-32f650c87957", "address": "fa:16:3e:ea:a6:1b", "network": {"id": "51708ad4-dae1-47fc-bd26-aca8c478ca04", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-279988751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c2fe6bf5e4f4bb3b5d50901bfac0b38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6514aeb6-8e", "ovs_interfaceid": "6514aeb6-8ea4-4a27-a54b-32f650c87957", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:45:14 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-82b3665d-3655-4f5e-bb80-ef0680b6825c tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:a6:1b,bridge_name='br-int',has_traffic_filtering=True,id=6514aeb6-8ea4-4a27-a54b-32f650c87957,network=Network(51708ad4-dae1-47fc-bd26-aca8c478ca04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6514aeb6-8e') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:45:14 user nova-compute[75176]: DEBUG os_vif [None req-82b3665d-3655-4f5e-bb80-ef0680b6825c tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:a6:1b,bridge_name='br-int',has_traffic_filtering=True,id=6514aeb6-8ea4-4a27-a54b-32f650c87957,network=Network(51708ad4-dae1-47fc-bd26-aca8c478ca04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6514aeb6-8e') {{(pid=75176) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 15:45:14 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:45:14 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:45:14 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 15:45:14 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:45:14 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ac9d5460-d148-5be4-9596-97c3f04e5e69', '_type': 'linux-noop'}}, row=False) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:45:14 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:45:14 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:45:14 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:45:14 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:45:14 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6514aeb6-8e, may_exist=True, interface_attrs={}) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:45:14 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6514aeb6-8e, col_values=(('qos', UUID('980b0bd5-1abf-4445-900a-eb54186686de')),), if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:45:14 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6514aeb6-8e, col_values=(('external_ids', {'iface-id': '6514aeb6-8ea4-4a27-a54b-32f650c87957', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ea:a6:1b', 'vm-uuid': 'aa223c49-d254-4727-8a01-873026847b37'}),), if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:45:14 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:45:14 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:45:14 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:45:14 user nova-compute[75176]: INFO os_vif [None req-82b3665d-3655-4f5e-bb80-ef0680b6825c tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:a6:1b,bridge_name='br-int',has_traffic_filtering=True,id=6514aeb6-8ea4-4a27-a54b-32f650c87957,network=Network(51708ad4-dae1-47fc-bd26-aca8c478ca04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6514aeb6-8e')
Nov 28 15:45:14 user nova-compute[75176]: DEBUG nova.compute.manager [req-14fe1a99-6e88-4239-add6-ea2fe75a26bc req-b02ad42d-7d80-48f6-b248-a9a4dcd1e851 service nova] [instance: 5b18c889-7694-4edf-8cf2-b9032e60289e] Received event network-vif-unplugged-59bc046b-fdaa-432c-97b8-67a208dd399b {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:45:14 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-14fe1a99-6e88-4239-add6-ea2fe75a26bc req-b02ad42d-7d80-48f6-b248-a9a4dcd1e851 service nova] Acquiring lock "5b18c889-7694-4edf-8cf2-b9032e60289e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:45:14 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-14fe1a99-6e88-4239-add6-ea2fe75a26bc req-b02ad42d-7d80-48f6-b248-a9a4dcd1e851 service nova] Lock "5b18c889-7694-4edf-8cf2-b9032e60289e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:45:14 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-14fe1a99-6e88-4239-add6-ea2fe75a26bc req-b02ad42d-7d80-48f6-b248-a9a4dcd1e851 service nova] Lock "5b18c889-7694-4edf-8cf2-b9032e60289e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:45:14 user nova-compute[75176]: DEBUG nova.compute.manager [req-14fe1a99-6e88-4239-add6-ea2fe75a26bc req-b02ad42d-7d80-48f6-b248-a9a4dcd1e851 service nova] [instance: 5b18c889-7694-4edf-8cf2-b9032e60289e] No waiting events found dispatching network-vif-unplugged-59bc046b-fdaa-432c-97b8-67a208dd399b {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:45:14 user nova-compute[75176]: DEBUG nova.compute.manager [req-14fe1a99-6e88-4239-add6-ea2fe75a26bc req-b02ad42d-7d80-48f6-b248-a9a4dcd1e851 service nova] [instance: 5b18c889-7694-4edf-8cf2-b9032e60289e] Received event network-vif-unplugged-59bc046b-fdaa-432c-97b8-67a208dd399b for instance with task_state deleting. {{(pid=75176) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 15:45:14 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:45:14 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:45:14 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:45:14 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:45:14 user nova-compute[75176]: DEBUG nova.compute.manager [req-3e86240c-3501-4ff2-a818-89ba9bc397ff req-05465fb8-015d-4ce1-ae04-8bdb78b45982 service nova] [instance: e02d1e69-5e74-43c3-8546-6044d31145f2] Received event network-vif-plugged-9a63b660-0280-42b9-868c-dbf0c26ee995 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:45:14 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-3e86240c-3501-4ff2-a818-89ba9bc397ff req-05465fb8-015d-4ce1-ae04-8bdb78b45982 service nova] Acquiring lock "e02d1e69-5e74-43c3-8546-6044d31145f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:45:14 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-3e86240c-3501-4ff2-a818-89ba9bc397ff req-05465fb8-015d-4ce1-ae04-8bdb78b45982 service nova] Lock "e02d1e69-5e74-43c3-8546-6044d31145f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:45:14 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-3e86240c-3501-4ff2-a818-89ba9bc397ff req-05465fb8-015d-4ce1-ae04-8bdb78b45982 service nova] Lock "e02d1e69-5e74-43c3-8546-6044d31145f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:45:14 user nova-compute[75176]: DEBUG nova.compute.manager [req-3e86240c-3501-4ff2-a818-89ba9bc397ff req-05465fb8-015d-4ce1-ae04-8bdb78b45982 service nova] [instance: e02d1e69-5e74-43c3-8546-6044d31145f2] No waiting events found dispatching network-vif-plugged-9a63b660-0280-42b9-868c-dbf0c26ee995 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:45:14 user nova-compute[75176]: WARNING nova.compute.manager [req-3e86240c-3501-4ff2-a818-89ba9bc397ff req-05465fb8-015d-4ce1-ae04-8bdb78b45982 service nova] [instance: e02d1e69-5e74-43c3-8546-6044d31145f2] Received unexpected event network-vif-plugged-9a63b660-0280-42b9-868c-dbf0c26ee995 for instance with vm_state active and task_state rebuild_spawning.
Nov 28 15:45:14 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:45:14 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:45:15 user nova-compute[75176]: INFO nova.virt.libvirt.driver [-] [instance: 5b18c889-7694-4edf-8cf2-b9032e60289e] Instance destroyed successfully.
Nov 28 15:45:15 user nova-compute[75176]: DEBUG nova.objects.instance [None req-049970df-7a83-47f2-bb2f-81c4e6331bed tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] Lazy-loading 'resources' on Instance uuid 5b18c889-7694-4edf-8cf2-b9032e60289e {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:45:15 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-049970df-7a83-47f2-bb2f-81c4e6331bed tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T15:39:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-2015797286',display_name='tempest-VolumesAdminNegativeTest-server-2015797286',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-2015797286',id=5,image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOvlvdx2rwcOZt7MZwoXcbKUeFdZ3U5p4MG2H2cUXYwmWIRtskZVrUKpwCBkkVdVAP/wON/TgO+zoxwLCK4zd98ZDPVUy0lGCfZjd7+hfeGGIDCzfBDCoWEUl1VpKZVBIQ==',key_name='tempest-keypair-1593476277',keypairs=<?>,launch_index=0,launched_at=2023-11-28T15:39:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c0518c3ca77e4ecebb6ea8fbf6e60219',ramdisk_id='',reservation_id='r-ibby1f0s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1622644648',owner_user_name='tempest-VolumesAdminNegativeTest-1622644648-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T15:39:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b339a055aaf24d25946cc16369bddc2f',uuid=5b18c889-7694-4edf-8cf2-b9032e60289e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "59bc046b-fdaa-432c-97b8-67a208dd399b", "address": "fa:16:3e:e5:e8:01", "network": {"id": "1c357ee9-ff80-4a4b-9fd5-f2f348b36acc", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1869945166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0518c3ca77e4ecebb6ea8fbf6e60219", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59bc046b-fd", "ovs_interfaceid": "59bc046b-fdaa-432c-97b8-67a208dd399b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 15:45:15 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-049970df-7a83-47f2-bb2f-81c4e6331bed tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] Converting VIF {"id": "59bc046b-fdaa-432c-97b8-67a208dd399b", "address": "fa:16:3e:e5:e8:01", "network": {"id": "1c357ee9-ff80-4a4b-9fd5-f2f348b36acc", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1869945166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0518c3ca77e4ecebb6ea8fbf6e60219", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59bc046b-fd", "ovs_interfaceid": "59bc046b-fdaa-432c-97b8-67a208dd399b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:45:15 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-049970df-7a83-47f2-bb2f-81c4e6331bed tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e5:e8:01,bridge_name='br-int',has_traffic_filtering=True,id=59bc046b-fdaa-432c-97b8-67a208dd399b,network=Network(1c357ee9-ff80-4a4b-9fd5-f2f348b36acc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59bc046b-fd') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:45:15 user nova-compute[75176]: DEBUG os_vif [None req-049970df-7a83-47f2-bb2f-81c4e6331bed tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e5:e8:01,bridge_name='br-int',has_traffic_filtering=True,id=59bc046b-fdaa-432c-97b8-67a208dd399b,network=Network(1c357ee9-ff80-4a4b-9fd5-f2f348b36acc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59bc046b-fd') {{(pid=75176) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 15:45:15 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:45:15 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap59bc046b-fd, bridge=br-int, if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:45:15 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:45:15 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:45:15 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:45:15 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:45:15 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=15eb7097-a145-4d15-8b3e-cac0edc090a9) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:45:15 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:45:15 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:45:15 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:45:15 user nova-compute[75176]: INFO os_vif [None req-049970df-7a83-47f2-bb2f-81c4e6331bed tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e5:e8:01,bridge_name='br-int',has_traffic_filtering=True,id=59bc046b-fdaa-432c-97b8-67a208dd399b,network=Network(1c357ee9-ff80-4a4b-9fd5-f2f348b36acc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59bc046b-fd')
Nov 28 15:45:15 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-049970df-7a83-47f2-bb2f-81c4e6331bed tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] [instance: 5b18c889-7694-4edf-8cf2-b9032e60289e] Deleting instance files /opt/stack/data/nova/instances/5b18c889-7694-4edf-8cf2-b9032e60289e_del
Nov 28 15:45:15 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-049970df-7a83-47f2-bb2f-81c4e6331bed tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] [instance: 5b18c889-7694-4edf-8cf2-b9032e60289e] Deletion of /opt/stack/data/nova/instances/5b18c889-7694-4edf-8cf2-b9032e60289e_del complete
Nov 28 15:45:15 user nova-compute[75176]: INFO nova.compute.manager [None req-049970df-7a83-47f2-bb2f-81c4e6331bed tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] [instance: 5b18c889-7694-4edf-8cf2-b9032e60289e] Took 2.07 seconds to destroy the instance on the hypervisor.
Nov 28 15:45:15 user nova-compute[75176]: DEBUG oslo.service.loopingcall [None req-049970df-7a83-47f2-bb2f-81c4e6331bed tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75176) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 15:45:15 user nova-compute[75176]: DEBUG nova.compute.manager [-] [instance: 5b18c889-7694-4edf-8cf2-b9032e60289e] Deallocating network for instance {{(pid=75176) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 15:45:15 user nova-compute[75176]: DEBUG nova.network.neutron [-] [instance: 5b18c889-7694-4edf-8cf2-b9032e60289e] deallocate_for_instance() {{(pid=75176) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 15:45:16 user nova-compute[75176]: DEBUG nova.compute.manager [req-82284b43-cf58-4fd0-bac6-ba1116989586 req-1f33c9fd-afce-482b-b1e4-87e760777573 service nova] [instance: 5b18c889-7694-4edf-8cf2-b9032e60289e] Received event network-vif-plugged-59bc046b-fdaa-432c-97b8-67a208dd399b {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:45:16 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-82284b43-cf58-4fd0-bac6-ba1116989586 req-1f33c9fd-afce-482b-b1e4-87e760777573 service nova] Acquiring lock "5b18c889-7694-4edf-8cf2-b9032e60289e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:45:16 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-82284b43-cf58-4fd0-bac6-ba1116989586 req-1f33c9fd-afce-482b-b1e4-87e760777573 service nova] Lock "5b18c889-7694-4edf-8cf2-b9032e60289e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:45:16 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-82284b43-cf58-4fd0-bac6-ba1116989586 req-1f33c9fd-afce-482b-b1e4-87e760777573 service nova] Lock "5b18c889-7694-4edf-8cf2-b9032e60289e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:45:16 user nova-compute[75176]: DEBUG nova.compute.manager [req-82284b43-cf58-4fd0-bac6-ba1116989586 req-1f33c9fd-afce-482b-b1e4-87e760777573 service nova] [instance: 5b18c889-7694-4edf-8cf2-b9032e60289e] No waiting events found dispatching network-vif-plugged-59bc046b-fdaa-432c-97b8-67a208dd399b {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:45:16 user nova-compute[75176]: WARNING nova.compute.manager [req-82284b43-cf58-4fd0-bac6-ba1116989586 req-1f33c9fd-afce-482b-b1e4-87e760777573 service nova] [instance: 5b18c889-7694-4edf-8cf2-b9032e60289e] Received unexpected event network-vif-plugged-59bc046b-fdaa-432c-97b8-67a208dd399b for instance with vm_state active and task_state deleting.
Nov 28 15:45:16 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:45:16 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:45:16 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:45:16 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:45:16 user nova-compute[75176]: DEBUG nova.network.neutron [-] [instance: 5b18c889-7694-4edf-8cf2-b9032e60289e] Updating instance_info_cache with network_info: [] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:45:16 user nova-compute[75176]: INFO nova.compute.manager [-] [instance: 5b18c889-7694-4edf-8cf2-b9032e60289e] Took 0.86 seconds to deallocate network for instance.
Nov 28 15:45:16 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-049970df-7a83-47f2-bb2f-81c4e6331bed tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:45:16 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-049970df-7a83-47f2-bb2f-81c4e6331bed tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:45:16 user nova-compute[75176]: DEBUG nova.compute.manager [req-7678065d-403c-4194-9a51-53dc601234b5 req-8f6af2e6-3881-4871-8304-3c47d1eec566 service nova] [instance: e02d1e69-5e74-43c3-8546-6044d31145f2] Received event network-vif-plugged-9a63b660-0280-42b9-868c-dbf0c26ee995 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:45:16 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-7678065d-403c-4194-9a51-53dc601234b5 req-8f6af2e6-3881-4871-8304-3c47d1eec566 service nova] Acquiring lock "e02d1e69-5e74-43c3-8546-6044d31145f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:45:16 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-7678065d-403c-4194-9a51-53dc601234b5 req-8f6af2e6-3881-4871-8304-3c47d1eec566 service nova] Lock "e02d1e69-5e74-43c3-8546-6044d31145f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:45:16 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-7678065d-403c-4194-9a51-53dc601234b5 req-8f6af2e6-3881-4871-8304-3c47d1eec566 service nova] Lock "e02d1e69-5e74-43c3-8546-6044d31145f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:45:16 user nova-compute[75176]: DEBUG nova.compute.manager [req-7678065d-403c-4194-9a51-53dc601234b5 req-8f6af2e6-3881-4871-8304-3c47d1eec566 service nova] [instance: e02d1e69-5e74-43c3-8546-6044d31145f2] No waiting events found dispatching network-vif-plugged-9a63b660-0280-42b9-868c-dbf0c26ee995 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:45:16 user nova-compute[75176]: WARNING nova.compute.manager [req-7678065d-403c-4194-9a51-53dc601234b5 req-8f6af2e6-3881-4871-8304-3c47d1eec566 service nova] [instance: e02d1e69-5e74-43c3-8546-6044d31145f2] Received unexpected event network-vif-plugged-9a63b660-0280-42b9-868c-dbf0c26ee995 for instance with vm_state active and task_state rebuild_spawning.
Nov 28 15:45:17 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:45:17 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:45:17 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:45:17 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:45:18 user nova-compute[75176]: DEBUG nova.compute.manager [req-c7bb0f8f-57d7-41cb-8854-74c6ecc12c4e req-3b69f1cb-5be5-427b-a33f-d64c35b6176e service nova] [instance: 5b18c889-7694-4edf-8cf2-b9032e60289e] Received event network-vif-deleted-59bc046b-fdaa-432c-97b8-67a208dd399b {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:45:18 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-23d07bfb-af23-4440-933d-c461e998d086 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Acquiring lock "87037584-a853-4693-bb23-598772ec83c5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:45:18 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-23d07bfb-af23-4440-933d-c461e998d086 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Lock "87037584-a853-4693-bb23-598772ec83c5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:45:18 user nova-compute[75176]: DEBUG nova.compute.manager [None req-23d07bfb-af23-4440-933d-c461e998d086 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: 87037584-a853-4693-bb23-598772ec83c5] Starting instance... {{(pid=75176) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 15:45:18 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-23d07bfb-af23-4440-933d-c461e998d086 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:45:18 user nova-compute[75176]: DEBUG nova.compute.manager [None req-52b207bb-4007-4944-b983-c4f373a5c717 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] [instance: e02d1e69-5e74-43c3-8546-6044d31145f2] Instance event wait completed in 0 seconds for  {{(pid=75176) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 15:45:18 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-52b207bb-4007-4944-b983-c4f373a5c717 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] [instance: e02d1e69-5e74-43c3-8546-6044d31145f2] Guest created on hypervisor {{(pid=75176) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 15:45:18 user nova-compute[75176]: DEBUG nova.compute.provider_tree [None req-049970df-7a83-47f2-bb2f-81c4e6331bed tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] Inventory has not changed in ProviderTree for provider: b37848d8-f401-4155-a029-b0ffa09ff85b {{(pid=75176) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 15:45:18 user nova-compute[75176]: INFO nova.virt.libvirt.driver [-] [instance: e02d1e69-5e74-43c3-8546-6044d31145f2] Instance spawned successfully.
Nov 28 15:45:18 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-52b207bb-4007-4944-b983-c4f373a5c717 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] [instance: e02d1e69-5e74-43c3-8546-6044d31145f2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 15:45:18 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-049970df-7a83-47f2-bb2f-81c4e6331bed tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] Inventory has not changed for provider b37848d8-f401-4155-a029-b0ffa09ff85b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75176) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 15:45:18 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-52b207bb-4007-4944-b983-c4f373a5c717 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] [instance: e02d1e69-5e74-43c3-8546-6044d31145f2] Found default for hw_cdrom_bus of ide {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:45:18 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-52b207bb-4007-4944-b983-c4f373a5c717 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] [instance: e02d1e69-5e74-43c3-8546-6044d31145f2] Found default for hw_disk_bus of virtio {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:45:18 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-52b207bb-4007-4944-b983-c4f373a5c717 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] [instance: e02d1e69-5e74-43c3-8546-6044d31145f2] Found default for hw_input_bus of None {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:45:18 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-52b207bb-4007-4944-b983-c4f373a5c717 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] [instance: e02d1e69-5e74-43c3-8546-6044d31145f2] Found default for hw_pointer_model of None {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:45:18 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-52b207bb-4007-4944-b983-c4f373a5c717 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] [instance: e02d1e69-5e74-43c3-8546-6044d31145f2] Found default for hw_video_model of virtio {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:45:18 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-52b207bb-4007-4944-b983-c4f373a5c717 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] [instance: e02d1e69-5e74-43c3-8546-6044d31145f2] Found default for hw_vif_model of virtio {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:45:18 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-049970df-7a83-47f2-bb2f-81c4e6331bed tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.984s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:45:18 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-23d07bfb-af23-4440-933d-c461e998d086 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.149s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:45:18 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-23d07bfb-af23-4440-933d-c461e998d086 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75176) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 15:45:18 user nova-compute[75176]: INFO nova.compute.claims [None req-23d07bfb-af23-4440-933d-c461e998d086 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: 87037584-a853-4693-bb23-598772ec83c5] Claim successful on node user
Nov 28 15:45:18 user nova-compute[75176]: INFO nova.scheduler.client.report [None req-049970df-7a83-47f2-bb2f-81c4e6331bed tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] Deleted allocations for instance 5b18c889-7694-4edf-8cf2-b9032e60289e
Nov 28 15:45:18 user nova-compute[75176]: DEBUG nova.compute.manager [None req-82b3665d-3655-4f5e-bb80-ef0680b6825c tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] [instance: aa223c49-d254-4727-8a01-873026847b37] Instance event wait completed in 0 seconds for  {{(pid=75176) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 15:45:18 user nova-compute[75176]: DEBUG nova.compute.manager [None req-52b207bb-4007-4944-b983-c4f373a5c717 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] [instance: e02d1e69-5e74-43c3-8546-6044d31145f2] Checking state {{(pid=75176) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 15:45:18 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:45:18 user nova-compute[75176]: INFO nova.virt.libvirt.driver [-] [instance: aa223c49-d254-4727-8a01-873026847b37] Instance running successfully.
Nov 28 15:45:18 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-82b3665d-3655-4f5e-bb80-ef0680b6825c tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] [instance: aa223c49-d254-4727-8a01-873026847b37] finish_revert_migration finished successfully. {{(pid=75176) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11860}}
Nov 28 15:45:18 user nova-compute[75176]: DEBUG nova.compute.manager [req-a5186d85-9e23-4e6a-a08d-c106ec91e468 req-e9a82d31-0692-4eb7-a7cc-67e3d7b6707d service nova] [instance: aa223c49-d254-4727-8a01-873026847b37] Received event network-vif-plugged-6514aeb6-8ea4-4a27-a54b-32f650c87957 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:45:18 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-a5186d85-9e23-4e6a-a08d-c106ec91e468 req-e9a82d31-0692-4eb7-a7cc-67e3d7b6707d service nova] Acquiring lock "aa223c49-d254-4727-8a01-873026847b37-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:45:18 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-a5186d85-9e23-4e6a-a08d-c106ec91e468 req-e9a82d31-0692-4eb7-a7cc-67e3d7b6707d service nova] Lock "aa223c49-d254-4727-8a01-873026847b37-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:45:18 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-a5186d85-9e23-4e6a-a08d-c106ec91e468 req-e9a82d31-0692-4eb7-a7cc-67e3d7b6707d service nova] Lock "aa223c49-d254-4727-8a01-873026847b37-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:45:18 user nova-compute[75176]: DEBUG nova.compute.manager [req-a5186d85-9e23-4e6a-a08d-c106ec91e468 req-e9a82d31-0692-4eb7-a7cc-67e3d7b6707d service nova] [instance: aa223c49-d254-4727-8a01-873026847b37] No waiting events found dispatching network-vif-plugged-6514aeb6-8ea4-4a27-a54b-32f650c87957 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:45:18 user nova-compute[75176]: WARNING nova.compute.manager [req-a5186d85-9e23-4e6a-a08d-c106ec91e468 req-e9a82d31-0692-4eb7-a7cc-67e3d7b6707d service nova] [instance: aa223c49-d254-4727-8a01-873026847b37] Received unexpected event network-vif-plugged-6514aeb6-8ea4-4a27-a54b-32f650c87957 for instance with vm_state resized and task_state resize_reverting.
Nov 28 15:45:18 user nova-compute[75176]: DEBUG nova.compute.manager [req-a5186d85-9e23-4e6a-a08d-c106ec91e468 req-e9a82d31-0692-4eb7-a7cc-67e3d7b6707d service nova] [instance: aa223c49-d254-4727-8a01-873026847b37] Received event network-vif-plugged-6514aeb6-8ea4-4a27-a54b-32f650c87957 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:45:18 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-a5186d85-9e23-4e6a-a08d-c106ec91e468 req-e9a82d31-0692-4eb7-a7cc-67e3d7b6707d service nova] Acquiring lock "aa223c49-d254-4727-8a01-873026847b37-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:45:18 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-a5186d85-9e23-4e6a-a08d-c106ec91e468 req-e9a82d31-0692-4eb7-a7cc-67e3d7b6707d service nova] Lock "aa223c49-d254-4727-8a01-873026847b37-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:45:18 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-a5186d85-9e23-4e6a-a08d-c106ec91e468 req-e9a82d31-0692-4eb7-a7cc-67e3d7b6707d service nova] Lock "aa223c49-d254-4727-8a01-873026847b37-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:45:18 user nova-compute[75176]: DEBUG nova.compute.manager [req-a5186d85-9e23-4e6a-a08d-c106ec91e468 req-e9a82d31-0692-4eb7-a7cc-67e3d7b6707d service nova] [instance: aa223c49-d254-4727-8a01-873026847b37] No waiting events found dispatching network-vif-plugged-6514aeb6-8ea4-4a27-a54b-32f650c87957 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:45:18 user nova-compute[75176]: WARNING nova.compute.manager [req-a5186d85-9e23-4e6a-a08d-c106ec91e468 req-e9a82d31-0692-4eb7-a7cc-67e3d7b6707d service nova] [instance: aa223c49-d254-4727-8a01-873026847b37] Received unexpected event network-vif-plugged-6514aeb6-8ea4-4a27-a54b-32f650c87957 for instance with vm_state resized and task_state resize_reverting.
Nov 28 15:45:18 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-049970df-7a83-47f2-bb2f-81c4e6331bed tempest-VolumesAdminNegativeTest-1622644648 tempest-VolumesAdminNegativeTest-1622644648-project-member] Lock "5b18c889-7694-4edf-8cf2-b9032e60289e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.212s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:45:18 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-52b207bb-4007-4944-b983-c4f373a5c717 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:45:19 user nova-compute[75176]: INFO nova.compute.manager [None req-82b3665d-3655-4f5e-bb80-ef0680b6825c tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] [instance: aa223c49-d254-4727-8a01-873026847b37] Updating instance to original state: 'active'
Nov 28 15:45:19 user nova-compute[75176]: DEBUG nova.compute.provider_tree [None req-23d07bfb-af23-4440-933d-c461e998d086 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Inventory has not changed in ProviderTree for provider: b37848d8-f401-4155-a029-b0ffa09ff85b {{(pid=75176) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 15:45:19 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-23d07bfb-af23-4440-933d-c461e998d086 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Inventory has not changed for provider b37848d8-f401-4155-a029-b0ffa09ff85b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75176) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 15:45:19 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-23d07bfb-af23-4440-933d-c461e998d086 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.705s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:45:19 user nova-compute[75176]: DEBUG nova.compute.manager [None req-23d07bfb-af23-4440-933d-c461e998d086 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: 87037584-a853-4693-bb23-598772ec83c5] Start building networks asynchronously for instance. {{(pid=75176) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 15:45:19 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-52b207bb-4007-4944-b983-c4f373a5c717 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.496s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:45:19 user nova-compute[75176]: DEBUG nova.objects.instance [None req-52b207bb-4007-4944-b983-c4f373a5c717 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] [instance: e02d1e69-5e74-43c3-8546-6044d31145f2] Trying to apply a migration context that does not seem to be set for this instance {{(pid=75176) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 28 15:45:19 user nova-compute[75176]: DEBUG nova.compute.manager [None req-23d07bfb-af23-4440-933d-c461e998d086 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: 87037584-a853-4693-bb23-598772ec83c5] Allocating IP information in the background. {{(pid=75176) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 15:45:19 user nova-compute[75176]: DEBUG nova.network.neutron [None req-23d07bfb-af23-4440-933d-c461e998d086 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: 87037584-a853-4693-bb23-598772ec83c5] allocate_for_instance() {{(pid=75176) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 15:45:19 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-23d07bfb-af23-4440-933d-c461e998d086 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: 87037584-a853-4693-bb23-598772ec83c5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 15:45:19 user nova-compute[75176]: DEBUG nova.compute.manager [None req-23d07bfb-af23-4440-933d-c461e998d086 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: 87037584-a853-4693-bb23-598772ec83c5] Start building block device mappings for instance. {{(pid=75176) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 15:45:19 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-52b207bb-4007-4944-b983-c4f373a5c717 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.113s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:45:19 user nova-compute[75176]: DEBUG nova.policy [None req-23d07bfb-af23-4440-933d-c461e998d086 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '081bf84d24194b81be4e0a6638db9b66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c7783cc16049208421204910982c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75176) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 15:45:19 user nova-compute[75176]: INFO nova.virt.block_device [None req-23d07bfb-af23-4440-933d-c461e998d086 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: 87037584-a853-4693-bb23-598772ec83c5] Booting with volume snapshot b947b8fa-e8c1-4d76-9d7f-24decb03496f at /dev/vda
Nov 28 15:45:20 user nova-compute[75176]: DEBUG nova.network.neutron [None req-23d07bfb-af23-4440-933d-c461e998d086 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: 87037584-a853-4693-bb23-598772ec83c5] Successfully created port: 472865a9-bbc1-4a5c-9907-a1163abb4f8a {{(pid=75176) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 15:45:20 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:45:21 user nova-compute[75176]: DEBUG nova.network.neutron [None req-23d07bfb-af23-4440-933d-c461e998d086 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: 87037584-a853-4693-bb23-598772ec83c5] Successfully updated port: 472865a9-bbc1-4a5c-9907-a1163abb4f8a {{(pid=75176) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 15:45:21 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-23d07bfb-af23-4440-933d-c461e998d086 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Acquiring lock "refresh_cache-87037584-a853-4693-bb23-598772ec83c5" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:45:21 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-23d07bfb-af23-4440-933d-c461e998d086 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Acquired lock "refresh_cache-87037584-a853-4693-bb23-598772ec83c5" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:45:21 user nova-compute[75176]: DEBUG nova.network.neutron [None req-23d07bfb-af23-4440-933d-c461e998d086 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: 87037584-a853-4693-bb23-598772ec83c5] Building network info cache for instance {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 15:45:21 user nova-compute[75176]: DEBUG nova.compute.manager [req-18875d69-07e9-481e-8e8b-b07285d14aff req-acbb231a-cb77-4b0a-b4f3-635df6d78a30 service nova] [instance: 87037584-a853-4693-bb23-598772ec83c5] Received event network-changed-472865a9-bbc1-4a5c-9907-a1163abb4f8a {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:45:21 user nova-compute[75176]: DEBUG nova.compute.manager [req-18875d69-07e9-481e-8e8b-b07285d14aff req-acbb231a-cb77-4b0a-b4f3-635df6d78a30 service nova] [instance: 87037584-a853-4693-bb23-598772ec83c5] Refreshing instance network info cache due to event network-changed-472865a9-bbc1-4a5c-9907-a1163abb4f8a. {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 15:45:21 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-18875d69-07e9-481e-8e8b-b07285d14aff req-acbb231a-cb77-4b0a-b4f3-635df6d78a30 service nova] Acquiring lock "refresh_cache-87037584-a853-4693-bb23-598772ec83c5" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:45:21 user nova-compute[75176]: DEBUG nova.network.neutron [None req-23d07bfb-af23-4440-933d-c461e998d086 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: 87037584-a853-4693-bb23-598772ec83c5] Instance cache missing network info. {{(pid=75176) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 15:45:21 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-a32151f2-bece-437d-912e-9be7f38fde10 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] Acquiring lock "6ab0619f-72e5-4975-ade8-53d7c0784d89" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:45:21 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-a32151f2-bece-437d-912e-9be7f38fde10 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] Lock "6ab0619f-72e5-4975-ade8-53d7c0784d89" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:45:21 user nova-compute[75176]: INFO nova.compute.manager [None req-a32151f2-bece-437d-912e-9be7f38fde10 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] [instance: 6ab0619f-72e5-4975-ade8-53d7c0784d89] Detaching volume 2bb22dca-8491-42ef-815f-7b0c0ca4be5a
Nov 28 15:45:21 user nova-compute[75176]: INFO nova.virt.block_device [None req-a32151f2-bece-437d-912e-9be7f38fde10 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] [instance: 6ab0619f-72e5-4975-ade8-53d7c0784d89] Attempting to driver detach volume 2bb22dca-8491-42ef-815f-7b0c0ca4be5a from mountpoint /dev/vdb
Nov 28 15:45:21 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-a32151f2-bece-437d-912e-9be7f38fde10 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] Attempting to detach device vdb from instance 6ab0619f-72e5-4975-ade8-53d7c0784d89 from the persistent domain config. {{(pid=75176) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 15:45:21 user nova-compute[75176]: DEBUG nova.virt.libvirt.guest [None req-a32151f2-bece-437d-912e-9be7f38fde10 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 15:45:21 user nova-compute[75176]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 15:45:21 user nova-compute[75176]:   <source dev="/dev/sdc"/>
Nov 28 15:45:21 user nova-compute[75176]:   <target dev="vdb" bus="virtio"/>
Nov 28 15:45:21 user nova-compute[75176]:   <serial>2bb22dca-8491-42ef-815f-7b0c0ca4be5a</serial>
Nov 28 15:45:21 user nova-compute[75176]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 15:45:21 user nova-compute[75176]: </disk>
Nov 28 15:45:21 user nova-compute[75176]:  {{(pid=75176) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 15:45:21 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-a32151f2-bece-437d-912e-9be7f38fde10 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] Successfully detached device vdb from instance 6ab0619f-72e5-4975-ade8-53d7c0784d89 from the persistent domain config.
Nov 28 15:45:21 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-a32151f2-bece-437d-912e-9be7f38fde10 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6ab0619f-72e5-4975-ade8-53d7c0784d89 from the live domain config. {{(pid=75176) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 15:45:21 user nova-compute[75176]: DEBUG nova.virt.libvirt.guest [None req-a32151f2-bece-437d-912e-9be7f38fde10 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 15:45:21 user nova-compute[75176]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 15:45:21 user nova-compute[75176]:   <source dev="/dev/sdc"/>
Nov 28 15:45:21 user nova-compute[75176]:   <target dev="vdb" bus="virtio"/>
Nov 28 15:45:21 user nova-compute[75176]:   <serial>2bb22dca-8491-42ef-815f-7b0c0ca4be5a</serial>
Nov 28 15:45:21 user nova-compute[75176]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 15:45:21 user nova-compute[75176]: </disk>
Nov 28 15:45:21 user nova-compute[75176]:  {{(pid=75176) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 15:45:21 user nova-compute[75176]: DEBUG nova.network.neutron [None req-23d07bfb-af23-4440-933d-c461e998d086 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: 87037584-a853-4693-bb23-598772ec83c5] Updating instance_info_cache with network_info: [{"id": "472865a9-bbc1-4a5c-9907-a1163abb4f8a", "address": "fa:16:3e:13:7e:bd", "network": {"id": "5ec264ad-3459-468c-bdbf-c6a4ef016951", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1574289626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07c7783cc16049208421204910982c79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap472865a9-bb", "ovs_interfaceid": "472865a9-bbc1-4a5c-9907-a1163abb4f8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:45:21 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-23d07bfb-af23-4440-933d-c461e998d086 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Releasing lock "refresh_cache-87037584-a853-4693-bb23-598772ec83c5" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:45:21 user nova-compute[75176]: DEBUG nova.compute.manager [None req-23d07bfb-af23-4440-933d-c461e998d086 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: 87037584-a853-4693-bb23-598772ec83c5] Instance network_info: |[{"id": "472865a9-bbc1-4a5c-9907-a1163abb4f8a", "address": "fa:16:3e:13:7e:bd", "network": {"id": "5ec264ad-3459-468c-bdbf-c6a4ef016951", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1574289626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07c7783cc16049208421204910982c79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap472865a9-bb", "ovs_interfaceid": "472865a9-bbc1-4a5c-9907-a1163abb4f8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75176) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 15:45:21 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-18875d69-07e9-481e-8e8b-b07285d14aff req-acbb231a-cb77-4b0a-b4f3-635df6d78a30 service nova] Acquired lock "refresh_cache-87037584-a853-4693-bb23-598772ec83c5" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:45:21 user nova-compute[75176]: DEBUG nova.network.neutron [req-18875d69-07e9-481e-8e8b-b07285d14aff req-acbb231a-cb77-4b0a-b4f3-635df6d78a30 service nova] [instance: 87037584-a853-4693-bb23-598772ec83c5] Refreshing network info cache for port 472865a9-bbc1-4a5c-9907-a1163abb4f8a {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 15:45:22 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-a32151f2-bece-437d-912e-9be7f38fde10 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6ab0619f-72e5-4975-ade8-53d7c0784d89 {{(pid=75176) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 15:45:22 user nova-compute[75176]: DEBUG nova.network.neutron [req-18875d69-07e9-481e-8e8b-b07285d14aff req-acbb231a-cb77-4b0a-b4f3-635df6d78a30 service nova] [instance: 87037584-a853-4693-bb23-598772ec83c5] Updated VIF entry in instance network info cache for port 472865a9-bbc1-4a5c-9907-a1163abb4f8a. {{(pid=75176) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 15:45:22 user nova-compute[75176]: DEBUG nova.network.neutron [req-18875d69-07e9-481e-8e8b-b07285d14aff req-acbb231a-cb77-4b0a-b4f3-635df6d78a30 service nova] [instance: 87037584-a853-4693-bb23-598772ec83c5] Updating instance_info_cache with network_info: [{"id": "472865a9-bbc1-4a5c-9907-a1163abb4f8a", "address": "fa:16:3e:13:7e:bd", "network": {"id": "5ec264ad-3459-468c-bdbf-c6a4ef016951", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1574289626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07c7783cc16049208421204910982c79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap472865a9-bb", "ovs_interfaceid": "472865a9-bbc1-4a5c-9907-a1163abb4f8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:45:22 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-18875d69-07e9-481e-8e8b-b07285d14aff req-acbb231a-cb77-4b0a-b4f3-635df6d78a30 service nova] Releasing lock "refresh_cache-87037584-a853-4693-bb23-598772ec83c5" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:45:23 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:45:25 user nova-compute[75176]: DEBUG os_brick.utils [None req-23d07bfb-af23-4440-933d-c461e998d086 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 15:45:25 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:45:25 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:45:25 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[26a72c88-aeb6-4a1d-9049-965bd256483b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:edc924a949b2\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:45:25 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:45:25 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:45:25 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[1965dadb-0846-45cf-9177-5bd530eeead2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:45:25 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:45:25 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:45:25 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[0040f0ed-a706-44ec-8bb6-441c63631839]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:45:25 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5f67b14-b997-4833-b9c2-774248211d0c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:45:25 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-23d07bfb-af23-4440-933d-c461e998d086 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Running cmd (subprocess): nvme version {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:45:25 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-23d07bfb-af23-4440-933d-c461e998d086 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] 'nvme version' failed. Not Retrying. {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 15:45:25 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:45:25 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.nvmeof [None req-23d07bfb-af23-4440-933d-c461e998d086 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] nvme not present on system {{(pid=75176) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 15:45:25 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:45:25 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 15:45:25 user nova-compute[75176]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 15:45:25 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a22ecb3-e566-409d-819a-61514553dc3b]: (4, '') {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:45:25 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.lightos [None req-23d07bfb-af23-4440-933d-c461e998d086 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75176) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 15:45:25 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.lightos [None req-23d07bfb-af23-4440-933d-c461e998d086 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75176) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 15:45:25 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.lightos [None req-23d07bfb-af23-4440-933d-c461e998d086 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] LIGHTOS: no hostnqn found. {{(pid=75176) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 15:45:25 user nova-compute[75176]: DEBUG os_brick.utils [None req-23d07bfb-af23-4440-933d-c461e998d086 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:edc924a949b2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 15:45:25 user nova-compute[75176]: DEBUG nova.virt.block_device [None req-23d07bfb-af23-4440-933d-c461e998d086 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: 87037584-a853-4693-bb23-598772ec83c5] Updating existing volume attachment record: f990a3e2-edb2-44d1-a9f0-8c05955c0f3f {{(pid=75176) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 15:45:28 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:45:29 user nova-compute[75176]: DEBUG nova.compute.manager [req-5b3fe42e-c754-445d-8fcb-446c268d6188 req-6f0071b4-fd56-4577-8843-3e906ba731d4 service nova] [instance: 47306d53-9ad7-4cae-ba6d-1f65239ef30f] Received event network-changed-c3d44009-c128-4e98-8594-132ed6c85dbc {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:45:29 user nova-compute[75176]: DEBUG nova.compute.manager [req-5b3fe42e-c754-445d-8fcb-446c268d6188 req-6f0071b4-fd56-4577-8843-3e906ba731d4 service nova] [instance: 47306d53-9ad7-4cae-ba6d-1f65239ef30f] Refreshing instance network info cache due to event network-changed-c3d44009-c128-4e98-8594-132ed6c85dbc. {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 15:45:29 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-5b3fe42e-c754-445d-8fcb-446c268d6188 req-6f0071b4-fd56-4577-8843-3e906ba731d4 service nova] Acquiring lock "refresh_cache-47306d53-9ad7-4cae-ba6d-1f65239ef30f" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:45:29 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-5b3fe42e-c754-445d-8fcb-446c268d6188 req-6f0071b4-fd56-4577-8843-3e906ba731d4 service nova] Acquired lock "refresh_cache-47306d53-9ad7-4cae-ba6d-1f65239ef30f" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:45:29 user nova-compute[75176]: DEBUG nova.network.neutron [req-5b3fe42e-c754-445d-8fcb-446c268d6188 req-6f0071b4-fd56-4577-8843-3e906ba731d4 service nova] [instance: 47306d53-9ad7-4cae-ba6d-1f65239ef30f] Refreshing network info cache for port c3d44009-c128-4e98-8594-132ed6c85dbc {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 15:45:30 user nova-compute[75176]: DEBUG nova.network.neutron [req-5b3fe42e-c754-445d-8fcb-446c268d6188 req-6f0071b4-fd56-4577-8843-3e906ba731d4 service nova] [instance: 47306d53-9ad7-4cae-ba6d-1f65239ef30f] Updated VIF entry in instance network info cache for port c3d44009-c128-4e98-8594-132ed6c85dbc. {{(pid=75176) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 15:45:30 user nova-compute[75176]: DEBUG nova.network.neutron [req-5b3fe42e-c754-445d-8fcb-446c268d6188 req-6f0071b4-fd56-4577-8843-3e906ba731d4 service nova] [instance: 47306d53-9ad7-4cae-ba6d-1f65239ef30f] Updating instance_info_cache with network_info: [{"id": "c3d44009-c128-4e98-8594-132ed6c85dbc", "address": "fa:16:3e:0b:f3:cf", "network": {"id": "b06b85af-96d9-41cb-9ad2-7fc0523761e7", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-850315220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc1dfeef484e4627a0061d9d36fd2b40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3d44009-c1", "ovs_interfaceid": "c3d44009-c128-4e98-8594-132ed6c85dbc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:45:30 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-5b3fe42e-c754-445d-8fcb-446c268d6188 req-6f0071b4-fd56-4577-8843-3e906ba731d4 service nova] Releasing lock "refresh_cache-47306d53-9ad7-4cae-ba6d-1f65239ef30f" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:45:30 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:45:31 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-bf8139ae-2321-4d83-9b41-a4599fc4436f tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Acquiring lock "47306d53-9ad7-4cae-ba6d-1f65239ef30f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:45:31 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-bf8139ae-2321-4d83-9b41-a4599fc4436f tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Lock "47306d53-9ad7-4cae-ba6d-1f65239ef30f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:45:31 user nova-compute[75176]: INFO nova.compute.manager [None req-bf8139ae-2321-4d83-9b41-a4599fc4436f tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] [instance: 47306d53-9ad7-4cae-ba6d-1f65239ef30f] Detaching volume ea228e4f-f9b2-477a-a75f-542bc9d47ec4
Nov 28 15:45:31 user nova-compute[75176]: INFO nova.virt.block_device [None req-bf8139ae-2321-4d83-9b41-a4599fc4436f tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] [instance: 47306d53-9ad7-4cae-ba6d-1f65239ef30f] Attempting to driver detach volume ea228e4f-f9b2-477a-a75f-542bc9d47ec4 from mountpoint /dev/vdb
Nov 28 15:45:31 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-bf8139ae-2321-4d83-9b41-a4599fc4436f tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Attempting to detach device vdb from instance 47306d53-9ad7-4cae-ba6d-1f65239ef30f from the persistent domain config. {{(pid=75176) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 15:45:31 user nova-compute[75176]: DEBUG nova.virt.libvirt.guest [None req-bf8139ae-2321-4d83-9b41-a4599fc4436f tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 15:45:31 user nova-compute[75176]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 15:45:31 user nova-compute[75176]:   <source dev="/dev/sdb"/>
Nov 28 15:45:31 user nova-compute[75176]:   <target dev="vdb" bus="virtio"/>
Nov 28 15:45:31 user nova-compute[75176]:   <serial>ea228e4f-f9b2-477a-a75f-542bc9d47ec4</serial>
Nov 28 15:45:31 user nova-compute[75176]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 28 15:45:31 user nova-compute[75176]: </disk>
Nov 28 15:45:31 user nova-compute[75176]:  {{(pid=75176) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 15:45:31 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-bf8139ae-2321-4d83-9b41-a4599fc4436f tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Successfully detached device vdb from instance 47306d53-9ad7-4cae-ba6d-1f65239ef30f from the persistent domain config.
Nov 28 15:45:31 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-bf8139ae-2321-4d83-9b41-a4599fc4436f tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 47306d53-9ad7-4cae-ba6d-1f65239ef30f from the live domain config. {{(pid=75176) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 15:45:31 user nova-compute[75176]: DEBUG nova.virt.libvirt.guest [None req-bf8139ae-2321-4d83-9b41-a4599fc4436f tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 15:45:31 user nova-compute[75176]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 15:45:31 user nova-compute[75176]:   <source dev="/dev/sdb"/>
Nov 28 15:45:31 user nova-compute[75176]:   <target dev="vdb" bus="virtio"/>
Nov 28 15:45:31 user nova-compute[75176]:   <serial>ea228e4f-f9b2-477a-a75f-542bc9d47ec4</serial>
Nov 28 15:45:31 user nova-compute[75176]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 28 15:45:31 user nova-compute[75176]: </disk>
Nov 28 15:45:31 user nova-compute[75176]:  {{(pid=75176) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 15:45:31 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-bf8139ae-2321-4d83-9b41-a4599fc4436f tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 47306d53-9ad7-4cae-ba6d-1f65239ef30f {{(pid=75176) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 15:45:31 user nova-compute[75176]: DEBUG nova.compute.manager [req-2cbdb420-3894-4f4c-bf9a-0ff4ecff62ae req-47334793-a58b-4ddd-b81f-347990cffd31 service nova] [instance: 47306d53-9ad7-4cae-ba6d-1f65239ef30f] Received event network-changed-c3d44009-c128-4e98-8594-132ed6c85dbc {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:45:31 user nova-compute[75176]: DEBUG nova.compute.manager [req-2cbdb420-3894-4f4c-bf9a-0ff4ecff62ae req-47334793-a58b-4ddd-b81f-347990cffd31 service nova] [instance: 47306d53-9ad7-4cae-ba6d-1f65239ef30f] Refreshing instance network info cache due to event network-changed-c3d44009-c128-4e98-8594-132ed6c85dbc. {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 15:45:31 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-2cbdb420-3894-4f4c-bf9a-0ff4ecff62ae req-47334793-a58b-4ddd-b81f-347990cffd31 service nova] Acquiring lock "refresh_cache-47306d53-9ad7-4cae-ba6d-1f65239ef30f" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:45:31 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-2cbdb420-3894-4f4c-bf9a-0ff4ecff62ae req-47334793-a58b-4ddd-b81f-347990cffd31 service nova] Acquired lock "refresh_cache-47306d53-9ad7-4cae-ba6d-1f65239ef30f" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:45:31 user nova-compute[75176]: DEBUG nova.network.neutron [req-2cbdb420-3894-4f4c-bf9a-0ff4ecff62ae req-47334793-a58b-4ddd-b81f-347990cffd31 service nova] [instance: 47306d53-9ad7-4cae-ba6d-1f65239ef30f] Refreshing network info cache for port c3d44009-c128-4e98-8594-132ed6c85dbc {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 15:45:32 user nova-compute[75176]: DEBUG nova.network.neutron [req-2cbdb420-3894-4f4c-bf9a-0ff4ecff62ae req-47334793-a58b-4ddd-b81f-347990cffd31 service nova] [instance: 47306d53-9ad7-4cae-ba6d-1f65239ef30f] Updated VIF entry in instance network info cache for port c3d44009-c128-4e98-8594-132ed6c85dbc. {{(pid=75176) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 15:45:32 user nova-compute[75176]: DEBUG nova.network.neutron [req-2cbdb420-3894-4f4c-bf9a-0ff4ecff62ae req-47334793-a58b-4ddd-b81f-347990cffd31 service nova] [instance: 47306d53-9ad7-4cae-ba6d-1f65239ef30f] Updating instance_info_cache with network_info: [{"id": "c3d44009-c128-4e98-8594-132ed6c85dbc", "address": "fa:16:3e:0b:f3:cf", "network": {"id": "b06b85af-96d9-41cb-9ad2-7fc0523761e7", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-850315220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc1dfeef484e4627a0061d9d36fd2b40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3d44009-c1", "ovs_interfaceid": "c3d44009-c128-4e98-8594-132ed6c85dbc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:45:32 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-2cbdb420-3894-4f4c-bf9a-0ff4ecff62ae req-47334793-a58b-4ddd-b81f-347990cffd31 service nova] Releasing lock "refresh_cache-47306d53-9ad7-4cae-ba6d-1f65239ef30f" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:45:33 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:45:34 user nova-compute[75176]: DEBUG nova.compute.manager [None req-23d07bfb-af23-4440-933d-c461e998d086 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: 87037584-a853-4693-bb23-598772ec83c5] Start spawning the instance on the hypervisor. {{(pid=75176) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 15:45:34 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-23d07bfb-af23-4440-933d-c461e998d086 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: 87037584-a853-4693-bb23-598772ec83c5] Creating instance directory {{(pid=75176) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 15:45:34 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-23d07bfb-af23-4440-933d-c461e998d086 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: 87037584-a853-4693-bb23-598772ec83c5] Creating image(s)
Nov 28 15:45:34 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-23d07bfb-af23-4440-933d-c461e998d086 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: 87037584-a853-4693-bb23-598772ec83c5] Did not create local disks {{(pid=75176) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 28 15:45:34 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-23d07bfb-af23-4440-933d-c461e998d086 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: 87037584-a853-4693-bb23-598772ec83c5] Ensure instance console log exists: /opt/stack/data/nova/instances/87037584-a853-4693-bb23-598772ec83c5/console.log {{(pid=75176) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 15:45:34 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-23d07bfb-af23-4440-933d-c461e998d086 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:45:34 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-23d07bfb-af23-4440-933d-c461e998d086 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:45:34 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-23d07bfb-af23-4440-933d-c461e998d086 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:45:34 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-23d07bfb-af23-4440-933d-c461e998d086 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: 87037584-a853-4693-bb23-598772ec83c5] Start _get_guest_xml network_info=[{"id": "472865a9-bbc1-4a5c-9907-a1163abb4f8a", "address": "fa:16:3e:13:7e:bd", "network": {"id": "5ec264ad-3459-468c-bdbf-c6a4ef016951", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1574289626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07c7783cc16049208421204910982c79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap472865a9-bb", "ovs_interfaceid": "472865a9-bbc1-4a5c-9907-a1163abb4f8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:69f59c18-c5e6-4afe-a74b-afe6d64d4e49', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pQUyFIPa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '87037584-a853-4693-bb23-598772ec83c5', 'attached_at': '', 'detached_at': '', 'volume_id': '69f59c18-c5e6-4afe-a74b-afe6d64d4e49', 'serial': '69f59c18-c5e6-4afe-a74b-afe6d64d4e49'}, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'delete_on_termination': True, 'mount_device': '/dev/vda', 'attachment_id': 'f990a3e2-edb2-44d1-a9f0-8c05955c0f3f', 'volume_type': None} {{(pid=75176) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 15:45:34 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-23d07bfb-af23-4440-933d-c461e998d086 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 15:45:34 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-23d07bfb-af23-4440-933d-c461e998d086 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 15:45:34 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-23d07bfb-af23-4440-933d-c461e998d086 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75176) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 15:45:34 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-23d07bfb-af23-4440-933d-c461e998d086 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] CPU controller missing on host. {{(pid=75176) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 15:45:34 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-23d07bfb-af23-4440-933d-c461e998d086 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75176) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 15:45:34 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-23d07bfb-af23-4440-933d-c461e998d086 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] CPU controller found on host. {{(pid=75176) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 15:45:34 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-23d07bfb-af23-4440-933d-c461e998d086 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75176) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 15:45:34 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-23d07bfb-af23-4440-933d-c461e998d086 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T15:35:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 15:45:34 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-23d07bfb-af23-4440-933d-c461e998d086 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Flavor limits 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 15:45:34 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-23d07bfb-af23-4440-933d-c461e998d086 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Image limits 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 15:45:34 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-23d07bfb-af23-4440-933d-c461e998d086 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Flavor pref 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 15:45:34 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-23d07bfb-af23-4440-933d-c461e998d086 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Image pref 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 15:45:34 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-23d07bfb-af23-4440-933d-c461e998d086 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 15:45:34 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-23d07bfb-af23-4440-933d-c461e998d086 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 15:45:34 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-23d07bfb-af23-4440-933d-c461e998d086 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75176) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 15:45:34 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-23d07bfb-af23-4440-933d-c461e998d086 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Got 1 possible topologies {{(pid=75176) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 15:45:34 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-23d07bfb-af23-4440-933d-c461e998d086 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 15:45:34 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-23d07bfb-af23-4440-933d-c461e998d086 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 15:45:34 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-23d07bfb-af23-4440-933d-c461e998d086 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: 87037584-a853-4693-bb23-598772ec83c5] Calling os-brick to attach iSCSI Volume {{(pid=75176) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 15:45:34 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-23d07bfb-af23-4440-933d-c461e998d086 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c1b8a00>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:69f59c18-c5e6-4afe-a74b-afe6d64d4e49', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pQUyFIPa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 15:45:34 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-23d07bfb-af23-4440-933d-c461e998d086 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 15:45:34 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-23d07bfb-af23-4440-933d-c461e998d086 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 15:45:34 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-23d07bfb-af23-4440-933d-c461e998d086 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 15:45:34 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-23d07bfb-af23-4440-933d-c461e998d086 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 15:45:34 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-23d07bfb-af23-4440-933d-c461e998d086 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:69f59c18-c5e6-4afe-a74b-afe6d64d4e49" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 15:45:34 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-23d07bfb-af23-4440-933d-c461e998d086 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:69f59c18-c5e6-4afe-a74b-afe6d64d4e49" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.017s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 15:45:34 user nova-compute[75176]: INFO os_brick.initiator.connectors.iscsi [None req-23d07bfb-af23-4440-933d-c461e998d086 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 15:45:34 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69f59c18-c5e6-4afe-a74b-afe6d64d4e49 -p 172.16.0.220:3260 {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:45:34 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69f59c18-c5e6-4afe-a74b-afe6d64d4e49 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:45:34 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7dad7a7-5e43-4dc9-af46-a0197bb525db]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:45:34 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-23d07bfb-af23-4440-933d-c461e998d086 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 15:45:34 user nova-compute[75176]:  {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:45:34 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69f59c18-c5e6-4afe-a74b-afe6d64d4e49 -p 172.16.0.220:3260 --interface default --op new {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:45:34 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69f59c18-c5e6-4afe-a74b-afe6d64d4e49 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:45:34 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[468b0bb5-df1a-4543-9cff-8fef01decb25]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:69f59c18-c5e6-4afe-a74b-afe6d64d4e49] added\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:45:34 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-23d07bfb-af23-4440-933d-c461e998d086 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:69f59c18-c5e6-4afe-a74b-afe6d64d4e49] added
Nov 28 15:45:34 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:45:34 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69f59c18-c5e6-4afe-a74b-afe6d64d4e49 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:45:34 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69f59c18-c5e6-4afe-a74b-afe6d64d4e49 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:45:34 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f41dfc0-1efd-4278-b31e-7a68f8a6728c]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:45:34 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-23d07bfb-af23-4440-933d-c461e998d086 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:45:34 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69f59c18-c5e6-4afe-a74b-afe6d64d4e49 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:45:34 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69f59c18-c5e6-4afe-a74b-afe6d64d4e49 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:45:34 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[726e68ab-9079-42f1-8296-a764520f89e2]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:45:34 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-23d07bfb-af23-4440-933d-c461e998d086 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:45:34 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69f59c18-c5e6-4afe-a74b-afe6d64d4e49 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pQUyFIPa {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:45:34 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69f59c18-c5e6-4afe-a74b-afe6d64d4e49 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pQUyFIPa" returned: 0 in 0.019s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:45:34 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dee71ae-2086-4152-92af-e2accfb50e54]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:45:34 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-23d07bfb-af23-4440-933d-c461e998d086 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pQUyFIPa'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:45:34 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69f59c18-c5e6-4afe-a74b-afe6d64d4e49 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:45:34 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69f59c18-c5e6-4afe-a74b-afe6d64d4e49 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:45:34 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[66dcc817-e123-4ca1-b3a4-3fdc987a7f72]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:45:34 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-23d07bfb-af23-4440-933d-c461e998d086 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:45:34 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:45:34 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:45:34 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[f06ab45d-a3a2-4d21-9af7-419c1bdfae5f]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bb22dca-8491-42ef-815f-7b0c0ca4be5a (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea228e4f-f9b2-477a-a75f-542bc9d47ec4 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1f5de5d-be7a-443a-9831-791c8667c09b (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d (non-flash)\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:45:34 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-23d07bfb-af23-4440-933d-c461e998d086 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bb22dca-8491-42ef-815f-7b0c0ca4be5a (non-flash)
Nov 28 15:45:34 user nova-compute[75176]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea228e4f-f9b2-477a-a75f-542bc9d47ec4 (non-flash)
Nov 28 15:45:34 user nova-compute[75176]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1f5de5d-be7a-443a-9831-791c8667c09b (non-flash)
Nov 28 15:45:34 user nova-compute[75176]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24 (non-flash)
Nov 28 15:45:34 user nova-compute[75176]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d (non-flash)
Nov 28 15:45:34 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:45:34 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-23d07bfb-af23-4440-933d-c461e998d086 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bb22dca-8491-42ef-815f-7b0c0ca4be5a (non-flash)
Nov 28 15:45:34 user nova-compute[75176]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea228e4f-f9b2-477a-a75f-542bc9d47ec4 (non-flash)
Nov 28 15:45:34 user nova-compute[75176]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1f5de5d-be7a-443a-9831-791c8667c09b (non-flash)
Nov 28 15:45:34 user nova-compute[75176]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24 (non-flash)
Nov 28 15:45:34 user nova-compute[75176]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d (non-flash)
Nov 28 15:45:34 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 15:45:34 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69f59c18-c5e6-4afe-a74b-afe6d64d4e49 -p 172.16.0.220:3260 --login {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:45:34 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69f59c18-c5e6-4afe-a74b-afe6d64d4e49 -p 172.16.0.220:3260 --login" returned: 0 in 0.095s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:45:34 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4637914-a48b-4929-84f4-2d6749a4ad37]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:69f59c18-c5e6-4afe-a74b-afe6d64d4e49, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:69f59c18-c5e6-4afe-a74b-afe6d64d4e49, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:45:34 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-23d07bfb-af23-4440-933d-c461e998d086 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:69f59c18-c5e6-4afe-a74b-afe6d64d4e49, portal: 172.16.0.220,3260]
Nov 28 15:45:34 user nova-compute[75176]: Login to [iface: default, target: iqn.2010-10.org.openstack:69f59c18-c5e6-4afe-a74b-afe6d64d4e49, portal: 172.16.0.220,3260] successful.
Nov 28 15:45:34 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:45:34 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69f59c18-c5e6-4afe-a74b-afe6d64d4e49 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:45:34 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69f59c18-c5e6-4afe-a74b-afe6d64d4e49 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:45:34 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5aa30a9-5e59-449b-a9b2-cb5c6ec6a8d3]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:45:34 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-23d07bfb-af23-4440-933d-c461e998d086 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:45:34 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:45:34 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:45:34 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ae84485-012c-48a3-8e0d-88ff1df6ee78]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bb22dca-8491-42ef-815f-7b0c0ca4be5a (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea228e4f-f9b2-477a-a75f-542bc9d47ec4 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1f5de5d-be7a-443a-9831-791c8667c09b (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69f59c18-c5e6-4afe-a74b-afe6d64d4e49 (non-flash)\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:45:34 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-23d07bfb-af23-4440-933d-c461e998d086 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bb22dca-8491-42ef-815f-7b0c0ca4be5a (non-flash)
Nov 28 15:45:34 user nova-compute[75176]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea228e4f-f9b2-477a-a75f-542bc9d47ec4 (non-flash)
Nov 28 15:45:34 user nova-compute[75176]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1f5de5d-be7a-443a-9831-791c8667c09b (non-flash)
Nov 28 15:45:34 user nova-compute[75176]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24 (non-flash)
Nov 28 15:45:34 user nova-compute[75176]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d (non-flash)
Nov 28 15:45:34 user nova-compute[75176]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69f59c18-c5e6-4afe-a74b-afe6d64d4e49 (non-flash)
Nov 28 15:45:34 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:45:34 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-23d07bfb-af23-4440-933d-c461e998d086 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bb22dca-8491-42ef-815f-7b0c0ca4be5a (non-flash)
Nov 28 15:45:34 user nova-compute[75176]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea228e4f-f9b2-477a-a75f-542bc9d47ec4 (non-flash)
Nov 28 15:45:34 user nova-compute[75176]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1f5de5d-be7a-443a-9831-791c8667c09b (non-flash)
Nov 28 15:45:34 user nova-compute[75176]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24 (non-flash)
Nov 28 15:45:34 user nova-compute[75176]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d (non-flash)
Nov 28 15:45:34 user nova-compute[75176]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69f59c18-c5e6-4afe-a74b-afe6d64d4e49 (non-flash)
Nov 28 15:45:34 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 15:45:34 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-23d07bfb-af23-4440-933d-c461e998d086 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:69f59c18-c5e6-4afe-a74b-afe6d64d4e49" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.358s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 15:45:34 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-23d07bfb-af23-4440-933d-c461e998d086 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Connected to 172.16.0.220:3260 {{(pid=75176) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 15:45:34 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-23d07bfb-af23-4440-933d-c461e998d086 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] HCTL ('38', '-', '-', 0) found on session 25 with lun 0 {{(pid=75176) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 15:45:34 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-23d07bfb-af23-4440-933d-c461e998d086 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75176) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 15:45:34 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:45:34 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.018s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:45:34 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[07cfba76-68b4-447c-a101-1ad60d9a6b43]: (4, ('- - 0', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:45:34 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-23d07bfb-af23-4440-933d-c461e998d086 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Searching for a device in session 25 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75176) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 15:45:34 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-23d07bfb-af23-4440-933d-c461e998d086 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:69f59c18-c5e6-4afe-a74b-afe6d64d4e49', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pQUyFIPa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75176) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 15:45:35 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:45:35 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-23d07bfb-af23-4440-933d-c461e998d086 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.410s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 15:45:35 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-23d07bfb-af23-4440-933d-c461e998d086 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] <== connect_volume: return (1411ms) {'type': 'block', 'scsi_wwn': '26463343132336435', 'path': '/dev/sdg'} {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 15:45:35 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-23d07bfb-af23-4440-933d-c461e998d086 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: 87037584-a853-4693-bb23-598772ec83c5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26463343132336435', 'path': '/dev/sdg'} {{(pid=75176) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 15:45:35 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-23d07bfb-af23-4440-933d-c461e998d086 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T15:45:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-788398439',display_name='tempest-TestVolumeBootPattern-server-788398439',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-788398439',id=21,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='07c7783cc16049208421204910982c79',ramdisk_id='',reservation_id='r-kw5xlibd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1695196118',owner_user_name='tempest-TestVolumeBootPattern-1695196118-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T15:45:20Z,user_data=None,user_id='081bf84d24194b81be4e0a6638db9b66',uuid=87037584-a853-4693-bb23-598772ec83c5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "472865a9-bbc1-4a5c-9907-a1163abb4f8a", "address": "fa:16:3e:13:7e:bd", "network": {"id": "5ec264ad-3459-468c-bdbf-c6a4ef016951", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1574289626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07c7783cc16049208421204910982c79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap472865a9-bb", "ovs_interfaceid": "472865a9-bbc1-4a5c-9907-a1163abb4f8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75176) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 15:45:35 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-23d07bfb-af23-4440-933d-c461e998d086 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Converting VIF {"id": "472865a9-bbc1-4a5c-9907-a1163abb4f8a", "address": "fa:16:3e:13:7e:bd", "network": {"id": "5ec264ad-3459-468c-bdbf-c6a4ef016951", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1574289626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07c7783cc16049208421204910982c79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap472865a9-bb", "ovs_interfaceid": "472865a9-bbc1-4a5c-9907-a1163abb4f8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:45:35 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-23d07bfb-af23-4440-933d-c461e998d086 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:7e:bd,bridge_name='br-int',has_traffic_filtering=True,id=472865a9-bbc1-4a5c-9907-a1163abb4f8a,network=Network(5ec264ad-3459-468c-bdbf-c6a4ef016951),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap472865a9-bb') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:45:35 user nova-compute[75176]: DEBUG nova.objects.instance [None req-23d07bfb-af23-4440-933d-c461e998d086 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Lazy-loading 'pci_devices' on Instance uuid 87037584-a853-4693-bb23-598772ec83c5 {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:45:35 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-23d07bfb-af23-4440-933d-c461e998d086 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: 87037584-a853-4693-bb23-598772ec83c5] End _get_guest_xml xml=<domain type="kvm">
Nov 28 15:45:35 user nova-compute[75176]:   <uuid>87037584-a853-4693-bb23-598772ec83c5</uuid>
Nov 28 15:45:35 user nova-compute[75176]:   <name>instance-00000015</name>
Nov 28 15:45:35 user nova-compute[75176]:   <memory>524288</memory>
Nov 28 15:45:35 user nova-compute[75176]:   <vcpu>1</vcpu>
Nov 28 15:45:35 user nova-compute[75176]:   <metadata>
Nov 28 15:45:35 user nova-compute[75176]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 15:45:35 user nova-compute[75176]:       <nova:package version="0.0.0"/>
Nov 28 15:45:35 user nova-compute[75176]:       <nova:name>tempest-TestVolumeBootPattern-server-788398439</nova:name>
Nov 28 15:45:35 user nova-compute[75176]:       <nova:creationTime>2023-11-28 15:45:34</nova:creationTime>
Nov 28 15:45:35 user nova-compute[75176]:       <nova:flavor name="m1.tiny">
Nov 28 15:45:35 user nova-compute[75176]:         <nova:memory>512</nova:memory>
Nov 28 15:45:35 user nova-compute[75176]:         <nova:disk>1</nova:disk>
Nov 28 15:45:35 user nova-compute[75176]:         <nova:swap>0</nova:swap>
Nov 28 15:45:35 user nova-compute[75176]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 15:45:35 user nova-compute[75176]:         <nova:vcpus>1</nova:vcpus>
Nov 28 15:45:35 user nova-compute[75176]:       </nova:flavor>
Nov 28 15:45:35 user nova-compute[75176]:       <nova:owner>
Nov 28 15:45:35 user nova-compute[75176]:         <nova:user uuid="081bf84d24194b81be4e0a6638db9b66">tempest-TestVolumeBootPattern-1695196118-project-member</nova:user>
Nov 28 15:45:35 user nova-compute[75176]:         <nova:project uuid="07c7783cc16049208421204910982c79">tempest-TestVolumeBootPattern-1695196118</nova:project>
Nov 28 15:45:35 user nova-compute[75176]:       </nova:owner>
Nov 28 15:45:35 user nova-compute[75176]:       <nova:ports>
Nov 28 15:45:35 user nova-compute[75176]:         <nova:port uuid="472865a9-bbc1-4a5c-9907-a1163abb4f8a">
Nov 28 15:45:35 user nova-compute[75176]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 28 15:45:35 user nova-compute[75176]:         </nova:port>
Nov 28 15:45:35 user nova-compute[75176]:       </nova:ports>
Nov 28 15:45:35 user nova-compute[75176]:     </nova:instance>
Nov 28 15:45:35 user nova-compute[75176]:   </metadata>
Nov 28 15:45:35 user nova-compute[75176]:   <sysinfo type="smbios">
Nov 28 15:45:35 user nova-compute[75176]:     <system>
Nov 28 15:45:35 user nova-compute[75176]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 15:45:35 user nova-compute[75176]:       <entry name="product">OpenStack Nova</entry>
Nov 28 15:45:35 user nova-compute[75176]:       <entry name="version">0.0.0</entry>
Nov 28 15:45:35 user nova-compute[75176]:       <entry name="serial">87037584-a853-4693-bb23-598772ec83c5</entry>
Nov 28 15:45:35 user nova-compute[75176]:       <entry name="uuid">87037584-a853-4693-bb23-598772ec83c5</entry>
Nov 28 15:45:35 user nova-compute[75176]:       <entry name="family">Virtual Machine</entry>
Nov 28 15:45:35 user nova-compute[75176]:     </system>
Nov 28 15:45:35 user nova-compute[75176]:   </sysinfo>
Nov 28 15:45:35 user nova-compute[75176]:   <os>
Nov 28 15:45:35 user nova-compute[75176]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 15:45:35 user nova-compute[75176]:     <boot dev="hd"/>
Nov 28 15:45:35 user nova-compute[75176]:     <smbios mode="sysinfo"/>
Nov 28 15:45:35 user nova-compute[75176]:   </os>
Nov 28 15:45:35 user nova-compute[75176]:   <features>
Nov 28 15:45:35 user nova-compute[75176]:     <acpi/>
Nov 28 15:45:35 user nova-compute[75176]:     <apic/>
Nov 28 15:45:35 user nova-compute[75176]:     <vmcoreinfo/>
Nov 28 15:45:35 user nova-compute[75176]:   </features>
Nov 28 15:45:35 user nova-compute[75176]:   <clock offset="utc">
Nov 28 15:45:35 user nova-compute[75176]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 15:45:35 user nova-compute[75176]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 15:45:35 user nova-compute[75176]:     <timer name="hpet" present="no"/>
Nov 28 15:45:35 user nova-compute[75176]:   </clock>
Nov 28 15:45:35 user nova-compute[75176]:   <cpu mode="custom" match="exact">
Nov 28 15:45:35 user nova-compute[75176]:     <model>Nehalem</model>
Nov 28 15:45:35 user nova-compute[75176]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 15:45:35 user nova-compute[75176]:   </cpu>
Nov 28 15:45:35 user nova-compute[75176]:   <devices>
Nov 28 15:45:35 user nova-compute[75176]:     <disk type="block" device="disk">
Nov 28 15:45:35 user nova-compute[75176]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 15:45:35 user nova-compute[75176]:       <source dev="/dev/sdg"/>
Nov 28 15:45:35 user nova-compute[75176]:       <target dev="vda" bus="virtio"/>
Nov 28 15:45:35 user nova-compute[75176]:       <serial>69f59c18-c5e6-4afe-a74b-afe6d64d4e49</serial>
Nov 28 15:45:35 user nova-compute[75176]:     </disk>
Nov 28 15:45:35 user nova-compute[75176]:     <interface type="ethernet">
Nov 28 15:45:35 user nova-compute[75176]:       <mac address="fa:16:3e:13:7e:bd"/>
Nov 28 15:45:35 user nova-compute[75176]:       <model type="virtio"/>
Nov 28 15:45:35 user nova-compute[75176]:       <mtu size="1442"/>
Nov 28 15:45:35 user nova-compute[75176]:       <target dev="tap472865a9-bb"/>
Nov 28 15:45:35 user nova-compute[75176]:     </interface>
Nov 28 15:45:35 user nova-compute[75176]:     <serial type="pty">
Nov 28 15:45:35 user nova-compute[75176]:       <log file="/opt/stack/data/nova/instances/87037584-a853-4693-bb23-598772ec83c5/console.log" append="off"/>
Nov 28 15:45:35 user nova-compute[75176]:     </serial>
Nov 28 15:45:35 user nova-compute[75176]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 15:45:35 user nova-compute[75176]:     <video>
Nov 28 15:45:35 user nova-compute[75176]:       <model type="virtio"/>
Nov 28 15:45:35 user nova-compute[75176]:     </video>
Nov 28 15:45:35 user nova-compute[75176]:     <rng model="virtio">
Nov 28 15:45:35 user nova-compute[75176]:       <backend model="random">/dev/urandom</backend>
Nov 28 15:45:35 user nova-compute[75176]:     </rng>
Nov 28 15:45:35 user nova-compute[75176]:     <controller type="usb" index="0" model="none"/>
Nov 28 15:45:35 user nova-compute[75176]:     <memballoon model="virtio">
Nov 28 15:45:35 user nova-compute[75176]:       <stats period="10"/>
Nov 28 15:45:35 user nova-compute[75176]:     </memballoon>
Nov 28 15:45:35 user nova-compute[75176]:   </devices>
Nov 28 15:45:35 user nova-compute[75176]: </domain>
Nov 28 15:45:35 user nova-compute[75176]:  {{(pid=75176) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 15:45:35 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-23d07bfb-af23-4440-933d-c461e998d086 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T15:45:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-788398439',display_name='tempest-TestVolumeBootPattern-server-788398439',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-788398439',id=21,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='07c7783cc16049208421204910982c79',ramdisk_id='',reservation_id='r-kw5xlibd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1695196118',owner_user_name='tempest-TestVolumeBootPattern-1695196118-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T15:45:20Z,user_data=None,user_id='081bf84d24194b81be4e0a6638db9b66',uuid=87037584-a853-4693-bb23-598772ec83c5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "472865a9-bbc1-4a5c-9907-a1163abb4f8a", "address": "fa:16:3e:13:7e:bd", "network": {"id": "5ec264ad-3459-468c-bdbf-c6a4ef016951", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1574289626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07c7783cc16049208421204910982c79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap472865a9-bb", "ovs_interfaceid": "472865a9-bbc1-4a5c-9907-a1163abb4f8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 15:45:35 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-23d07bfb-af23-4440-933d-c461e998d086 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Converting VIF {"id": "472865a9-bbc1-4a5c-9907-a1163abb4f8a", "address": "fa:16:3e:13:7e:bd", "network": {"id": "5ec264ad-3459-468c-bdbf-c6a4ef016951", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1574289626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07c7783cc16049208421204910982c79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap472865a9-bb", "ovs_interfaceid": "472865a9-bbc1-4a5c-9907-a1163abb4f8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:45:35 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-23d07bfb-af23-4440-933d-c461e998d086 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:7e:bd,bridge_name='br-int',has_traffic_filtering=True,id=472865a9-bbc1-4a5c-9907-a1163abb4f8a,network=Network(5ec264ad-3459-468c-bdbf-c6a4ef016951),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap472865a9-bb') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:45:35 user nova-compute[75176]: DEBUG os_vif [None req-23d07bfb-af23-4440-933d-c461e998d086 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:7e:bd,bridge_name='br-int',has_traffic_filtering=True,id=472865a9-bbc1-4a5c-9907-a1163abb4f8a,network=Network(5ec264ad-3459-468c-bdbf-c6a4ef016951),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap472865a9-bb') {{(pid=75176) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 15:45:35 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:45:35 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:45:35 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 15:45:35 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:45:35 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f8e2d2d0-592c-5084-bd64-f1ce34bdf023', '_type': 'linux-noop'}}, row=False) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:45:35 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:45:35 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:45:35 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap472865a9-bb, may_exist=True, interface_attrs={}) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:45:35 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap472865a9-bb, col_values=(('qos', UUID('bc175098-8104-4ff2-a548-92bd43b0ebfe')),), if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:45:35 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap472865a9-bb, col_values=(('external_ids', {'iface-id': '472865a9-bbc1-4a5c-9907-a1163abb4f8a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:13:7e:bd', 'vm-uuid': '87037584-a853-4693-bb23-598772ec83c5'}),), if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:45:35 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:45:35 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:45:35 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:45:35 user nova-compute[75176]: INFO os_vif [None req-23d07bfb-af23-4440-933d-c461e998d086 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:7e:bd,bridge_name='br-int',has_traffic_filtering=True,id=472865a9-bbc1-4a5c-9907-a1163abb4f8a,network=Network(5ec264ad-3459-468c-bdbf-c6a4ef016951),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap472865a9-bb')
Nov 28 15:45:36 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-23d07bfb-af23-4440-933d-c461e998d086 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] No BDM found with device name vda, not building metadata. {{(pid=75176) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 15:45:36 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-23d07bfb-af23-4440-933d-c461e998d086 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] No VIF found with MAC fa:16:3e:13:7e:bd, not building metadata {{(pid=75176) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 15:45:37 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:45:37 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:45:37 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:45:37 user nova-compute[75176]: DEBUG nova.compute.manager [req-b271c0f2-b499-4996-9186-87ed2a95e219 req-49847f12-aeb2-4b39-9aec-0175b286cb00 service nova] [instance: 87037584-a853-4693-bb23-598772ec83c5] Received event network-vif-plugged-472865a9-bbc1-4a5c-9907-a1163abb4f8a {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:45:37 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-b271c0f2-b499-4996-9186-87ed2a95e219 req-49847f12-aeb2-4b39-9aec-0175b286cb00 service nova] Acquiring lock "87037584-a853-4693-bb23-598772ec83c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:45:37 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-b271c0f2-b499-4996-9186-87ed2a95e219 req-49847f12-aeb2-4b39-9aec-0175b286cb00 service nova] Lock "87037584-a853-4693-bb23-598772ec83c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:45:37 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-b271c0f2-b499-4996-9186-87ed2a95e219 req-49847f12-aeb2-4b39-9aec-0175b286cb00 service nova] Lock "87037584-a853-4693-bb23-598772ec83c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:45:37 user nova-compute[75176]: DEBUG nova.compute.manager [req-b271c0f2-b499-4996-9186-87ed2a95e219 req-49847f12-aeb2-4b39-9aec-0175b286cb00 service nova] [instance: 87037584-a853-4693-bb23-598772ec83c5] No waiting events found dispatching network-vif-plugged-472865a9-bbc1-4a5c-9907-a1163abb4f8a {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:45:37 user nova-compute[75176]: WARNING nova.compute.manager [req-b271c0f2-b499-4996-9186-87ed2a95e219 req-49847f12-aeb2-4b39-9aec-0175b286cb00 service nova] [instance: 87037584-a853-4693-bb23-598772ec83c5] Received unexpected event network-vif-plugged-472865a9-bbc1-4a5c-9907-a1163abb4f8a for instance with vm_state building and task_state spawning.
Nov 28 15:45:37 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:45:37 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:45:37 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:45:37 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:45:38 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:45:39 user nova-compute[75176]: DEBUG nova.compute.manager [None req-23d07bfb-af23-4440-933d-c461e998d086 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: 87037584-a853-4693-bb23-598772ec83c5] Instance event wait completed in 0 seconds for  {{(pid=75176) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 15:45:39 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-23d07bfb-af23-4440-933d-c461e998d086 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: 87037584-a853-4693-bb23-598772ec83c5] Guest created on hypervisor {{(pid=75176) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 15:45:39 user nova-compute[75176]: INFO nova.virt.libvirt.driver [-] [instance: 87037584-a853-4693-bb23-598772ec83c5] Instance spawned successfully.
Nov 28 15:45:39 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-23d07bfb-af23-4440-933d-c461e998d086 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: 87037584-a853-4693-bb23-598772ec83c5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 15:45:39 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-23d07bfb-af23-4440-933d-c461e998d086 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: 87037584-a853-4693-bb23-598772ec83c5] Found default for hw_cdrom_bus of ide {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:45:39 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-23d07bfb-af23-4440-933d-c461e998d086 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: 87037584-a853-4693-bb23-598772ec83c5] Found default for hw_disk_bus of virtio {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:45:39 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-23d07bfb-af23-4440-933d-c461e998d086 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: 87037584-a853-4693-bb23-598772ec83c5] Found default for hw_input_bus of None {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:45:39 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-23d07bfb-af23-4440-933d-c461e998d086 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: 87037584-a853-4693-bb23-598772ec83c5] Found default for hw_pointer_model of None {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:45:39 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-23d07bfb-af23-4440-933d-c461e998d086 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: 87037584-a853-4693-bb23-598772ec83c5] Found default for hw_video_model of virtio {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:45:39 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-23d07bfb-af23-4440-933d-c461e998d086 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: 87037584-a853-4693-bb23-598772ec83c5] Found default for hw_vif_model of virtio {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:45:39 user nova-compute[75176]: INFO nova.compute.manager [None req-23d07bfb-af23-4440-933d-c461e998d086 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: 87037584-a853-4693-bb23-598772ec83c5] Took 5.06 seconds to spawn the instance on the hypervisor.
Nov 28 15:45:39 user nova-compute[75176]: DEBUG nova.compute.manager [None req-23d07bfb-af23-4440-933d-c461e998d086 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: 87037584-a853-4693-bb23-598772ec83c5] Checking state {{(pid=75176) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 15:45:39 user nova-compute[75176]: DEBUG nova.compute.manager [req-ec65366b-0712-48f6-ad95-f6649101213b req-19a07019-e0a9-4f49-a814-9a4a4ac9b144 service nova] [instance: 87037584-a853-4693-bb23-598772ec83c5] Received event network-vif-plugged-472865a9-bbc1-4a5c-9907-a1163abb4f8a {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:45:39 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-ec65366b-0712-48f6-ad95-f6649101213b req-19a07019-e0a9-4f49-a814-9a4a4ac9b144 service nova] Acquiring lock "87037584-a853-4693-bb23-598772ec83c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:45:39 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-ec65366b-0712-48f6-ad95-f6649101213b req-19a07019-e0a9-4f49-a814-9a4a4ac9b144 service nova] Lock "87037584-a853-4693-bb23-598772ec83c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:45:39 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-ec65366b-0712-48f6-ad95-f6649101213b req-19a07019-e0a9-4f49-a814-9a4a4ac9b144 service nova] Lock "87037584-a853-4693-bb23-598772ec83c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:45:39 user nova-compute[75176]: DEBUG nova.compute.manager [req-ec65366b-0712-48f6-ad95-f6649101213b req-19a07019-e0a9-4f49-a814-9a4a4ac9b144 service nova] [instance: 87037584-a853-4693-bb23-598772ec83c5] No waiting events found dispatching network-vif-plugged-472865a9-bbc1-4a5c-9907-a1163abb4f8a {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:45:39 user nova-compute[75176]: WARNING nova.compute.manager [req-ec65366b-0712-48f6-ad95-f6649101213b req-19a07019-e0a9-4f49-a814-9a4a4ac9b144 service nova] [instance: 87037584-a853-4693-bb23-598772ec83c5] Received unexpected event network-vif-plugged-472865a9-bbc1-4a5c-9907-a1163abb4f8a for instance with vm_state building and task_state spawning.
Nov 28 15:45:39 user nova-compute[75176]: INFO nova.compute.manager [None req-23d07bfb-af23-4440-933d-c461e998d086 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: 87037584-a853-4693-bb23-598772ec83c5] Took 21.02 seconds to build instance.
Nov 28 15:45:39 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-23d07bfb-af23-4440-933d-c461e998d086 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Lock "87037584-a853-4693-bb23-598772ec83c5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.117s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:45:40 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:45:42 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-a32151f2-bece-437d-912e-9be7f38fde10 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 6ab0619f-72e5-4975-ade8-53d7c0784d89 is timed out.
Nov 28 15:45:42 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-a32151f2-bece-437d-912e-9be7f38fde10 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] Successfully detached device vdb from instance 6ab0619f-72e5-4975-ade8-53d7c0784d89 from the live domain config.
Nov 28 15:45:42 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a32151f2-bece-437d-912e-9be7f38fde10 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] [instance: 6ab0619f-72e5-4975-ade8-53d7c0784d89] calling os-brick to detach iSCSI Volume {{(pid=75176) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 15:45:42 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-a32151f2-bece-437d-912e-9be7f38fde10 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c1b8a00>, {'target_iqn': 'iqn.2010-10.org.openstack:2bb22dca-8491-42ef-815f-7b0c0ca4be5a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UHFXkSYA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 15:45:42 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-a32151f2-bece-437d-912e-9be7f38fde10 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 15:45:42 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-a32151f2-bece-437d-912e-9be7f38fde10 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 15:45:42 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-a32151f2-bece-437d-912e-9be7f38fde10 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 15:45:42 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:45:42 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:45:42 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[57609ff4-cf34-4802-ad6e-d17bbb8799ac]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a1f5de5d-be7a-443a-9831-791c8667c09b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2bb22dca-8491-42ef-815f-7b0c0ca4be5a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:69f59c18-c5e6-4afe-a74b-afe6d64d4e49\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ea228e4f-f9b2-477a-a75f-542bc9d47ec4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:45:42 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-a32151f2-bece-437d-912e-9be7f38fde10 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 15:45:42 user nova-compute[75176]: No targets found.
Nov 28 15:45:42 user nova-compute[75176]: iSNS:
Nov 28 15:45:42 user nova-compute[75176]: No targets found.
Nov 28 15:45:42 user nova-compute[75176]: STATIC:
Nov 28 15:45:42 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:a1f5de5d-be7a-443a-9831-791c8667c09b
Nov 28 15:45:42 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:45:42 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:45:42 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:2bb22dca-8491-42ef-815f-7b0c0ca4be5a
Nov 28 15:45:42 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:45:42 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:45:42 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d
Nov 28 15:45:42 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:45:42 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:45:42 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:69f59c18-c5e6-4afe-a74b-afe6d64d4e49
Nov 28 15:45:42 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:45:42 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:45:42 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24
Nov 28 15:45:42 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:45:42 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:45:42 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:ea228e4f-f9b2-477a-a75f-542bc9d47ec4
Nov 28 15:45:42 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:45:42 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:45:42 user nova-compute[75176]: FIRMWARE:
Nov 28 15:45:42 user nova-compute[75176]: No targets found.
Nov 28 15:45:42 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:45:42 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-a32151f2-bece-437d-912e-9be7f38fde10 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 15:45:42 user nova-compute[75176]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 15:45:42 user nova-compute[75176]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75176) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 15:45:42 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-a32151f2-bece-437d-912e-9be7f38fde10 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2bb22dca-8491-42ef-815f-7b0c0ca4be5a', 0)] {{(pid=75176) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 15:45:42 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:45:42 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:45:42 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8720545-b9b2-4d73-b730-05f774bf58a6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2bb22dca-8491-42ef-815f-7b0c0ca4be5a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:69f59c18-c5e6-4afe-a74b-afe6d64d4e49\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a1f5de5d-be7a-443a-9831-791c8667c09b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ea228e4f-f9b2-477a-a75f-542bc9d47ec4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:45:42 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:45:42 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.064s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:45:42 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[261861cc-4ce7-4da7-93c8-4325f4bb1c5e]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bb22dca-8491-42ef-815f-7b0c0ca4be5a (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea228e4f-f9b2-477a-a75f-542bc9d47ec4 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1f5de5d-be7a-443a-9831-791c8667c09b (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69f59c18-c5e6-4afe-a74b-afe6d64d4e49 (non-flash)\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:45:42 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-a32151f2-bece-437d-912e-9be7f38fde10 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bb22dca-8491-42ef-815f-7b0c0ca4be5a (non-flash)
Nov 28 15:45:42 user nova-compute[75176]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea228e4f-f9b2-477a-a75f-542bc9d47ec4 (non-flash)
Nov 28 15:45:42 user nova-compute[75176]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1f5de5d-be7a-443a-9831-791c8667c09b (non-flash)
Nov 28 15:45:42 user nova-compute[75176]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24 (non-flash)
Nov 28 15:45:42 user nova-compute[75176]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d (non-flash)
Nov 28 15:45:42 user nova-compute[75176]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69f59c18-c5e6-4afe-a74b-afe6d64d4e49 (non-flash)
Nov 28 15:45:42 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:45:42 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-a32151f2-bece-437d-912e-9be7f38fde10 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bb22dca-8491-42ef-815f-7b0c0ca4be5a (non-flash)
Nov 28 15:45:42 user nova-compute[75176]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea228e4f-f9b2-477a-a75f-542bc9d47ec4 (non-flash)
Nov 28 15:45:42 user nova-compute[75176]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1f5de5d-be7a-443a-9831-791c8667c09b (non-flash)
Nov 28 15:45:42 user nova-compute[75176]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24 (non-flash)
Nov 28 15:45:42 user nova-compute[75176]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d (non-flash)
Nov 28 15:45:42 user nova-compute[75176]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69f59c18-c5e6-4afe-a74b-afe6d64d4e49 (non-flash)
Nov 28 15:45:42 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 15:45:42 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-a32151f2-bece-437d-912e-9be7f38fde10 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f464c316200>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2bb22dca-8491-42ef-815f-7b0c0ca4be5a'): ({'sdc'}, set())}) {{(pid=75176) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 15:45:42 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-a32151f2-bece-437d-912e-9be7f38fde10 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] Removing single pathed devices sdc {{(pid=75176) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 15:45:42 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:45:42 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:45:42 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f20ae8d-8722-486c-87f3-00900c9faf6b]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:45:42 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:45:42 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:45:42 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[66dc4711-fe58-4f66-a8ed-504bda8e70e0]: (4, ('ok\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:45:42 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-a32151f2-bece-437d-912e-9be7f38fde10 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] Flushing IO for device /dev/sdc {{(pid=75176) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 15:45:42 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:45:42 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:45:42 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[80924876-d156-4725-9110-c72b1a792dbd]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:45:42 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-a32151f2-bece-437d-912e-9be7f38fde10 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75176) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 15:45:42 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:45:42 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.044s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:45:42 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[426e8eaf-e228-4a88-b449-61773eb8bf82]: (4, ('1', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:45:42 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-a32151f2-bece-437d-912e-9be7f38fde10 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75176) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 15:45:42 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-a32151f2-bece-437d-912e-9be7f38fde10 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] SCSI volumes sdc have been removed. {{(pid=75176) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 15:45:42 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-a32151f2-bece-437d-912e-9be7f38fde10 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2bb22dca-8491-42ef-815f-7b0c0ca4be5a')] {{(pid=75176) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 15:45:42 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2bb22dca-8491-42ef-815f-7b0c0ca4be5a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:45:42 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2bb22dca-8491-42ef-815f-7b0c0ca4be5a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:45:42 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc42e83b-8cd0-46b6-9ec7-a4eb76b73caf]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:45:42 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-a32151f2-bece-437d-912e-9be7f38fde10 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:45:42 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2bb22dca-8491-42ef-815f-7b0c0ca4be5a -p 172.16.0.220:3260 --logout {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:45:42 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2bb22dca-8491-42ef-815f-7b0c0ca4be5a -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:45:42 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[20ea40e4-d2eb-4cad-9243-9022f2b28bda]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:2bb22dca-8491-42ef-815f-7b0c0ca4be5a, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:2bb22dca-8491-42ef-815f-7b0c0ca4be5a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:45:42 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-a32151f2-bece-437d-912e-9be7f38fde10 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:2bb22dca-8491-42ef-815f-7b0c0ca4be5a, portal: 172.16.0.220,3260]
Nov 28 15:45:42 user nova-compute[75176]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:2bb22dca-8491-42ef-815f-7b0c0ca4be5a, portal: 172.16.0.220,3260] successful.
Nov 28 15:45:42 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:45:42 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2bb22dca-8491-42ef-815f-7b0c0ca4be5a -p 172.16.0.220:3260 --op delete {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:45:42 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2bb22dca-8491-42ef-815f-7b0c0ca4be5a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:45:42 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[47d77f86-c2b1-49ca-beac-d4e47cc0f677]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:45:42 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-a32151f2-bece-437d-912e-9be7f38fde10 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:45:42 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-a32151f2-bece-437d-912e-9be7f38fde10 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.368s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 15:45:42 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-a32151f2-bece-437d-912e-9be7f38fde10 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] <== disconnect_volume: return (369ms) None {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 15:45:42 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a32151f2-bece-437d-912e-9be7f38fde10 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] [instance: 6ab0619f-72e5-4975-ade8-53d7c0784d89] Disconnected iSCSI Volume {{(pid=75176) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 15:45:43 user nova-compute[75176]: DEBUG nova.objects.instance [None req-a32151f2-bece-437d-912e-9be7f38fde10 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] Lazy-loading 'flavor' on Instance uuid 6ab0619f-72e5-4975-ade8-53d7c0784d89 {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:45:43 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-a32151f2-bece-437d-912e-9be7f38fde10 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] Lock "6ab0619f-72e5-4975-ade8-53d7c0784d89" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.917s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:45:43 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:45:45 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:45:46 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:45:48 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:45:50 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:45:50 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:45:51 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:45:51 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:45:51 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:45:51 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-bf8139ae-2321-4d83-9b41-a4599fc4436f tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 47306d53-9ad7-4cae-ba6d-1f65239ef30f is timed out.
Nov 28 15:45:51 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-bf8139ae-2321-4d83-9b41-a4599fc4436f tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Successfully detached device vdb from instance 47306d53-9ad7-4cae-ba6d-1f65239ef30f from the live domain config.
Nov 28 15:45:51 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf8139ae-2321-4d83-9b41-a4599fc4436f tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] [instance: 47306d53-9ad7-4cae-ba6d-1f65239ef30f] calling os-brick to detach iSCSI Volume {{(pid=75176) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 15:45:51 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf8139ae-2321-4d83-9b41-a4599fc4436f tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c1b8a00>, {'target_iqn': 'iqn.2010-10.org.openstack:ea228e4f-f9b2-477a-a75f-542bc9d47ec4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jPmwncDA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 15:45:51 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-bf8139ae-2321-4d83-9b41-a4599fc4436f tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 15:45:51 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-bf8139ae-2321-4d83-9b41-a4599fc4436f tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 15:45:51 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-bf8139ae-2321-4d83-9b41-a4599fc4436f tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 15:45:51 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:45:51 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:45:51 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[f074a029-88c6-4768-8ed3-98899ef947c9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a1f5de5d-be7a-443a-9831-791c8667c09b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:69f59c18-c5e6-4afe-a74b-afe6d64d4e49\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ea228e4f-f9b2-477a-a75f-542bc9d47ec4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:45:51 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf8139ae-2321-4d83-9b41-a4599fc4436f tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 15:45:51 user nova-compute[75176]: No targets found.
Nov 28 15:45:51 user nova-compute[75176]: iSNS:
Nov 28 15:45:51 user nova-compute[75176]: No targets found.
Nov 28 15:45:51 user nova-compute[75176]: STATIC:
Nov 28 15:45:51 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:a1f5de5d-be7a-443a-9831-791c8667c09b
Nov 28 15:45:51 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:45:51 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:45:51 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d
Nov 28 15:45:51 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:45:51 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:45:51 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:69f59c18-c5e6-4afe-a74b-afe6d64d4e49
Nov 28 15:45:51 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:45:51 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:45:51 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24
Nov 28 15:45:51 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:45:51 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:45:51 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:ea228e4f-f9b2-477a-a75f-542bc9d47ec4
Nov 28 15:45:51 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:45:51 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:45:51 user nova-compute[75176]: FIRMWARE:
Nov 28 15:45:51 user nova-compute[75176]: No targets found.
Nov 28 15:45:51 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:45:51 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf8139ae-2321-4d83-9b41-a4599fc4436f tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 15:45:51 user nova-compute[75176]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 15:45:51 user nova-compute[75176]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75176) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 15:45:51 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf8139ae-2321-4d83-9b41-a4599fc4436f tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ea228e4f-f9b2-477a-a75f-542bc9d47ec4', 0)] {{(pid=75176) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 15:45:51 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:45:51 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:45:51 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5674384-95df-433d-bce4-17fa87f21054]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:69f59c18-c5e6-4afe-a74b-afe6d64d4e49\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a1f5de5d-be7a-443a-9831-791c8667c09b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ea228e4f-f9b2-477a-a75f-542bc9d47ec4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:45:51 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:45:51 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:45:51 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e4eee24-e447-4aa3-a457-d2bea6875e21]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea228e4f-f9b2-477a-a75f-542bc9d47ec4 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1f5de5d-be7a-443a-9831-791c8667c09b (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69f59c18-c5e6-4afe-a74b-afe6d64d4e49 (non-flash)\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:45:51 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf8139ae-2321-4d83-9b41-a4599fc4436f tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea228e4f-f9b2-477a-a75f-542bc9d47ec4 (non-flash)
Nov 28 15:45:51 user nova-compute[75176]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1f5de5d-be7a-443a-9831-791c8667c09b (non-flash)
Nov 28 15:45:51 user nova-compute[75176]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24 (non-flash)
Nov 28 15:45:51 user nova-compute[75176]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d (non-flash)
Nov 28 15:45:51 user nova-compute[75176]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69f59c18-c5e6-4afe-a74b-afe6d64d4e49 (non-flash)
Nov 28 15:45:51 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:45:51 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf8139ae-2321-4d83-9b41-a4599fc4436f tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea228e4f-f9b2-477a-a75f-542bc9d47ec4 (non-flash)
Nov 28 15:45:51 user nova-compute[75176]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1f5de5d-be7a-443a-9831-791c8667c09b (non-flash)
Nov 28 15:45:51 user nova-compute[75176]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24 (non-flash)
Nov 28 15:45:51 user nova-compute[75176]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d (non-flash)
Nov 28 15:45:51 user nova-compute[75176]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69f59c18-c5e6-4afe-a74b-afe6d64d4e49 (non-flash)
Nov 28 15:45:51 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 15:45:51 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf8139ae-2321-4d83-9b41-a4599fc4436f tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f464c3a3250>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ea228e4f-f9b2-477a-a75f-542bc9d47ec4'): ({'sdb'}, set())}) {{(pid=75176) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 15:45:51 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-bf8139ae-2321-4d83-9b41-a4599fc4436f tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Removing single pathed devices sdb {{(pid=75176) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 15:45:51 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:45:52 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:45:52 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[f046bf55-fc4d-45ac-b7c2-7023faa11c07]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:45:52 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:45:52 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:45:52 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[c012f80d-9533-448c-8315-fa4a4875a291]: (4, ('ok\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:45:52 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-bf8139ae-2321-4d83-9b41-a4599fc4436f tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Flushing IO for device /dev/sdb {{(pid=75176) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 15:45:52 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:45:52 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:45:52 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[68d634a2-5b5b-49b9-a5b7-8d88914b9720]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:45:52 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-bf8139ae-2321-4d83-9b41-a4599fc4436f tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75176) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 15:45:52 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:45:52 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:45:52 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4782908-2281-475d-907e-02864979f042]: (4, ('1', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:45:52 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-bf8139ae-2321-4d83-9b41-a4599fc4436f tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75176) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 15:45:52 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-bf8139ae-2321-4d83-9b41-a4599fc4436f tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] SCSI volumes sdb have been removed. {{(pid=75176) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 15:45:52 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf8139ae-2321-4d83-9b41-a4599fc4436f tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ea228e4f-f9b2-477a-a75f-542bc9d47ec4')] {{(pid=75176) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 15:45:52 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea228e4f-f9b2-477a-a75f-542bc9d47ec4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:45:52 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea228e4f-f9b2-477a-a75f-542bc9d47ec4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:45:52 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[f16ef4d4-7043-4ab8-b2e6-867d9d90f46d]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:45:52 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf8139ae-2321-4d83-9b41-a4599fc4436f tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:45:52 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea228e4f-f9b2-477a-a75f-542bc9d47ec4 -p 172.16.0.220:3260 --logout {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:45:52 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea228e4f-f9b2-477a-a75f-542bc9d47ec4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:45:52 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e138904-25e5-45fc-9cd9-eacd62e4eddd]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:ea228e4f-f9b2-477a-a75f-542bc9d47ec4, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:ea228e4f-f9b2-477a-a75f-542bc9d47ec4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:45:52 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf8139ae-2321-4d83-9b41-a4599fc4436f tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:ea228e4f-f9b2-477a-a75f-542bc9d47ec4, portal: 172.16.0.220,3260]
Nov 28 15:45:52 user nova-compute[75176]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:ea228e4f-f9b2-477a-a75f-542bc9d47ec4, portal: 172.16.0.220,3260] successful.
Nov 28 15:45:52 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:45:52 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea228e4f-f9b2-477a-a75f-542bc9d47ec4 -p 172.16.0.220:3260 --op delete {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:45:52 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea228e4f-f9b2-477a-a75f-542bc9d47ec4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:45:52 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[eef3b1f4-8e25-4f4c-a7f3-ec4eb03e7679]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:45:52 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf8139ae-2321-4d83-9b41-a4599fc4436f tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:45:52 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-bf8139ae-2321-4d83-9b41-a4599fc4436f tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.362s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 15:45:52 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf8139ae-2321-4d83-9b41-a4599fc4436f tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] <== disconnect_volume: return (363ms) None {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 15:45:52 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf8139ae-2321-4d83-9b41-a4599fc4436f tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] [instance: 47306d53-9ad7-4cae-ba6d-1f65239ef30f] Disconnected iSCSI Volume {{(pid=75176) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 15:45:52 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:45:52 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:45:52 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:45:52 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:45:52 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Auditing locally available compute resources for user (node: user) {{(pid=75176) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 15:45:52 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ed37390-f6a6-4cf7-8cab-b818f702083d/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:45:53 user nova-compute[75176]: DEBUG nova.objects.instance [None req-bf8139ae-2321-4d83-9b41-a4599fc4436f tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Lazy-loading 'flavor' on Instance uuid 47306d53-9ad7-4cae-ba6d-1f65239ef30f {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:45:53 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-bf8139ae-2321-4d83-9b41-a4599fc4436f tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Lock "47306d53-9ad7-4cae-ba6d-1f65239ef30f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.086s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:45:53 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ed37390-f6a6-4cf7-8cab-b818f702083d/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:45:53 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ed37390-f6a6-4cf7-8cab-b818f702083d/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:45:53 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ed37390-f6a6-4cf7-8cab-b818f702083d/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:45:53 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47306d53-9ad7-4cae-ba6d-1f65239ef30f/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:45:53 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47306d53-9ad7-4cae-ba6d-1f65239ef30f/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:45:53 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47306d53-9ad7-4cae-ba6d-1f65239ef30f/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:45:53 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47306d53-9ad7-4cae-ba6d-1f65239ef30f/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:45:53 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e8507b7-fccf-4196-b589-bf2b74f165ec/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:45:53 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:45:53 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e8507b7-fccf-4196-b589-bf2b74f165ec/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:45:53 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e8507b7-fccf-4196-b589-bf2b74f165ec/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:45:54 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e8507b7-fccf-4196-b589-bf2b74f165ec/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:45:54 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e8a6e1b-4f71-494a-8f44-f9643c658021/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:45:54 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e8a6e1b-4f71-494a-8f44-f9643c658021/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:45:54 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e8a6e1b-4f71-494a-8f44-f9643c658021/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:45:54 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e8a6e1b-4f71-494a-8f44-f9643c658021/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:45:54 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e02d1e69-5e74-43c3-8546-6044d31145f2/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:45:54 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e02d1e69-5e74-43c3-8546-6044d31145f2/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:45:54 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e02d1e69-5e74-43c3-8546-6044d31145f2/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:45:55 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e02d1e69-5e74-43c3-8546-6044d31145f2/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:45:55 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75176) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 15:45:55 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b3646e6-512e-4cd6-b3c1-89438c19c408/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:45:55 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b3646e6-512e-4cd6-b3c1-89438c19c408/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:45:55 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b3646e6-512e-4cd6-b3c1-89438c19c408/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:45:55 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b3646e6-512e-4cd6-b3c1-89438c19c408/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:45:55 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=75176) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 15:45:55 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa223c49-d254-4727-8a01-873026847b37/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:45:55 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa223c49-d254-4727-8a01-873026847b37/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:45:55 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa223c49-d254-4727-8a01-873026847b37/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:45:55 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa223c49-d254-4727-8a01-873026847b37/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:45:55 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75176) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 15:45:55 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ab0619f-72e5-4975-ade8-53d7c0784d89/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:45:55 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:45:56 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ab0619f-72e5-4975-ade8-53d7c0784d89/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:45:56 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ab0619f-72e5-4975-ade8-53d7c0784d89/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:45:56 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ab0619f-72e5-4975-ade8-53d7c0784d89/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:45:56 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6739b4fc-063c-454c-8b37-b81c07b7ca1e/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:45:56 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6739b4fc-063c-454c-8b37-b81c07b7ca1e/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:45:56 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6739b4fc-063c-454c-8b37-b81c07b7ca1e/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:45:56 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6739b4fc-063c-454c-8b37-b81c07b7ca1e/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:45:56 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/402e779e-f507-49f1-a0d8-31ab0d23fbcd/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:45:56 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/402e779e-f507-49f1-a0d8-31ab0d23fbcd/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:45:56 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/402e779e-f507-49f1-a0d8-31ab0d23fbcd/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:45:57 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/402e779e-f507-49f1-a0d8-31ab0d23fbcd/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:45:57 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75176) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 15:45:57 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b4c281e-5b8d-43b1-8914-572e1341c0a7/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:45:57 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b4c281e-5b8d-43b1-8914-572e1341c0a7/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:45:57 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b4c281e-5b8d-43b1-8914-572e1341c0a7/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:45:57 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b4c281e-5b8d-43b1-8914-572e1341c0a7/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:45:57 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 15:45:57 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 15:45:57 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Hypervisor/Node resource view: name=user free_ram=6893MB free_disk=25.16814422607422GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75176) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 15:45:57 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:45:57 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:45:58 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance 6ab0619f-72e5-4975-ade8-53d7c0784d89 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:45:58 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance 2e8507b7-fccf-4196-b589-bf2b74f165ec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:45:58 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance 47306d53-9ad7-4cae-ba6d-1f65239ef30f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:45:58 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance 402e779e-f507-49f1-a0d8-31ab0d23fbcd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:45:58 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance e02d1e69-5e74-43c3-8546-6044d31145f2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:45:58 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance 6739b4fc-063c-454c-8b37-b81c07b7ca1e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:45:58 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance 6b3646e6-512e-4cd6-b3c1-89438c19c408 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:45:58 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance 1e8a6e1b-4f71-494a-8f44-f9643c658021 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:45:58 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance 6ed37390-f6a6-4cf7-8cab-b818f702083d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:45:58 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance 7b4c281e-5b8d-43b1-8914-572e1341c0a7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:45:58 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance aa223c49-d254-4727-8a01-873026847b37 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:45:58 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance 87037584-a853-4693-bb23-598772ec83c5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:45:58 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75176) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 15:45:58 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75176) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 15:45:58 user nova-compute[75176]: DEBUG nova.compute.provider_tree [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Inventory has not changed in ProviderTree for provider: b37848d8-f401-4155-a029-b0ffa09ff85b {{(pid=75176) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 15:45:58 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Inventory has not changed for provider b37848d8-f401-4155-a029-b0ffa09ff85b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75176) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 15:45:58 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Compute_service record updated for user:user {{(pid=75176) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 15:45:58 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.561s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:45:58 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:45:58 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-8ec8a8bc-9d80-4495-977d-1ff6b5f443eb tempest-VolumesActionsTest-508911516 tempest-VolumesActionsTest-508911516-project-member] Acquiring lock "6739b4fc-063c-454c-8b37-b81c07b7ca1e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:45:58 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-8ec8a8bc-9d80-4495-977d-1ff6b5f443eb tempest-VolumesActionsTest-508911516 tempest-VolumesActionsTest-508911516-project-member] Lock "6739b4fc-063c-454c-8b37-b81c07b7ca1e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:45:58 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-8ec8a8bc-9d80-4495-977d-1ff6b5f443eb tempest-VolumesActionsTest-508911516 tempest-VolumesActionsTest-508911516-project-member] Acquiring lock "6739b4fc-063c-454c-8b37-b81c07b7ca1e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:45:58 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-8ec8a8bc-9d80-4495-977d-1ff6b5f443eb tempest-VolumesActionsTest-508911516 tempest-VolumesActionsTest-508911516-project-member] Lock "6739b4fc-063c-454c-8b37-b81c07b7ca1e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:45:58 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-8ec8a8bc-9d80-4495-977d-1ff6b5f443eb tempest-VolumesActionsTest-508911516 tempest-VolumesActionsTest-508911516-project-member] Lock "6739b4fc-063c-454c-8b37-b81c07b7ca1e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:45:58 user nova-compute[75176]: INFO nova.compute.manager [None req-8ec8a8bc-9d80-4495-977d-1ff6b5f443eb tempest-VolumesActionsTest-508911516 tempest-VolumesActionsTest-508911516-project-member] [instance: 6739b4fc-063c-454c-8b37-b81c07b7ca1e] Terminating instance
Nov 28 15:45:58 user nova-compute[75176]: DEBUG nova.compute.manager [None req-8ec8a8bc-9d80-4495-977d-1ff6b5f443eb tempest-VolumesActionsTest-508911516 tempest-VolumesActionsTest-508911516-project-member] [instance: 6739b4fc-063c-454c-8b37-b81c07b7ca1e] Start destroying the instance on the hypervisor. {{(pid=75176) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 15:45:58 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:45:59 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:45:59 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:45:59 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:45:59 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:45:59 user nova-compute[75176]: DEBUG nova.compute.manager [req-610347fc-70a9-4e21-803e-5e6734b1c63e req-c474bf3a-6a4f-440d-8d4f-30d923402550 service nova] [instance: 6739b4fc-063c-454c-8b37-b81c07b7ca1e] Received event network-vif-unplugged-9fb61fd8-c11e-41e5-a9f4-b6787f858f01 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:45:59 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-610347fc-70a9-4e21-803e-5e6734b1c63e req-c474bf3a-6a4f-440d-8d4f-30d923402550 service nova] Acquiring lock "6739b4fc-063c-454c-8b37-b81c07b7ca1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:45:59 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-610347fc-70a9-4e21-803e-5e6734b1c63e req-c474bf3a-6a4f-440d-8d4f-30d923402550 service nova] Lock "6739b4fc-063c-454c-8b37-b81c07b7ca1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:45:59 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-610347fc-70a9-4e21-803e-5e6734b1c63e req-c474bf3a-6a4f-440d-8d4f-30d923402550 service nova] Lock "6739b4fc-063c-454c-8b37-b81c07b7ca1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:45:59 user nova-compute[75176]: DEBUG nova.compute.manager [req-610347fc-70a9-4e21-803e-5e6734b1c63e req-c474bf3a-6a4f-440d-8d4f-30d923402550 service nova] [instance: 6739b4fc-063c-454c-8b37-b81c07b7ca1e] No waiting events found dispatching network-vif-unplugged-9fb61fd8-c11e-41e5-a9f4-b6787f858f01 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:45:59 user nova-compute[75176]: DEBUG nova.compute.manager [req-610347fc-70a9-4e21-803e-5e6734b1c63e req-c474bf3a-6a4f-440d-8d4f-30d923402550 service nova] [instance: 6739b4fc-063c-454c-8b37-b81c07b7ca1e] Received event network-vif-unplugged-9fb61fd8-c11e-41e5-a9f4-b6787f858f01 for instance with task_state deleting. {{(pid=75176) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 15:45:59 user nova-compute[75176]: INFO nova.virt.libvirt.driver [-] [instance: 6739b4fc-063c-454c-8b37-b81c07b7ca1e] Instance destroyed successfully.
Nov 28 15:45:59 user nova-compute[75176]: DEBUG nova.objects.instance [None req-8ec8a8bc-9d80-4495-977d-1ff6b5f443eb tempest-VolumesActionsTest-508911516 tempest-VolumesActionsTest-508911516-project-member] Lazy-loading 'resources' on Instance uuid 6739b4fc-063c-454c-8b37-b81c07b7ca1e {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:45:59 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-8ec8a8bc-9d80-4495-977d-1ff6b5f443eb tempest-VolumesActionsTest-508911516 tempest-VolumesActionsTest-508911516-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T15:43:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-75145758',display_name='tempest-VolumesActionsTest-instance-75145758',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-75145758',id=16,image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-28T15:44:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c47a8c7ab5c34e8bbf187b8e1f0bf9ba',ramdisk_id='',reservation_id='r-y0gz4lmq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-508911516',owner_user_name='tempest-VolumesActionsTest-508911516-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T15:44:09Z,user_data=None,user_id='7e9cd48cc7744ab78a1b4452827e59d9',uuid=6739b4fc-063c-454c-8b37-b81c07b7ca1e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9fb61fd8-c11e-41e5-a9f4-b6787f858f01", "address": "fa:16:3e:dd:90:f5", "network": {"id": "b7bbcb7f-e50f-44f5-a57f-9fca9122f0d5", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1769518035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c47a8c7ab5c34e8bbf187b8e1f0bf9ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fb61fd8-c1", "ovs_interfaceid": "9fb61fd8-c11e-41e5-a9f4-b6787f858f01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 15:45:59 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-8ec8a8bc-9d80-4495-977d-1ff6b5f443eb tempest-VolumesActionsTest-508911516 tempest-VolumesActionsTest-508911516-project-member] Converting VIF {"id": "9fb61fd8-c11e-41e5-a9f4-b6787f858f01", "address": "fa:16:3e:dd:90:f5", "network": {"id": "b7bbcb7f-e50f-44f5-a57f-9fca9122f0d5", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1769518035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c47a8c7ab5c34e8bbf187b8e1f0bf9ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fb61fd8-c1", "ovs_interfaceid": "9fb61fd8-c11e-41e5-a9f4-b6787f858f01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:45:59 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-8ec8a8bc-9d80-4495-977d-1ff6b5f443eb tempest-VolumesActionsTest-508911516 tempest-VolumesActionsTest-508911516-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:90:f5,bridge_name='br-int',has_traffic_filtering=True,id=9fb61fd8-c11e-41e5-a9f4-b6787f858f01,network=Network(b7bbcb7f-e50f-44f5-a57f-9fca9122f0d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9fb61fd8-c1') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:45:59 user nova-compute[75176]: DEBUG os_vif [None req-8ec8a8bc-9d80-4495-977d-1ff6b5f443eb tempest-VolumesActionsTest-508911516 tempest-VolumesActionsTest-508911516-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:90:f5,bridge_name='br-int',has_traffic_filtering=True,id=9fb61fd8-c11e-41e5-a9f4-b6787f858f01,network=Network(b7bbcb7f-e50f-44f5-a57f-9fca9122f0d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9fb61fd8-c1') {{(pid=75176) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 15:45:59 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:45:59 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9fb61fd8-c1, bridge=br-int, if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:45:59 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:45:59 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Starting heal instance info cache {{(pid=75176) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 15:45:59 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Rebuilding the list of instances to heal {{(pid=75176) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 15:45:59 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:45:59 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:45:59 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:45:59 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=97b5504e-964b-48d5-a2e8-9ebe49aa62fc) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:45:59 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:45:59 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:45:59 user nova-compute[75176]: INFO os_vif [None req-8ec8a8bc-9d80-4495-977d-1ff6b5f443eb tempest-VolumesActionsTest-508911516 tempest-VolumesActionsTest-508911516-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:90:f5,bridge_name='br-int',has_traffic_filtering=True,id=9fb61fd8-c11e-41e5-a9f4-b6787f858f01,network=Network(b7bbcb7f-e50f-44f5-a57f-9fca9122f0d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9fb61fd8-c1')
Nov 28 15:45:59 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-8ec8a8bc-9d80-4495-977d-1ff6b5f443eb tempest-VolumesActionsTest-508911516 tempest-VolumesActionsTest-508911516-project-member] [instance: 6739b4fc-063c-454c-8b37-b81c07b7ca1e] Deleting instance files /opt/stack/data/nova/instances/6739b4fc-063c-454c-8b37-b81c07b7ca1e_del
Nov 28 15:45:59 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-8ec8a8bc-9d80-4495-977d-1ff6b5f443eb tempest-VolumesActionsTest-508911516 tempest-VolumesActionsTest-508911516-project-member] [instance: 6739b4fc-063c-454c-8b37-b81c07b7ca1e] Deletion of /opt/stack/data/nova/instances/6739b4fc-063c-454c-8b37-b81c07b7ca1e_del complete
Nov 28 15:45:59 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] [instance: 6739b4fc-063c-454c-8b37-b81c07b7ca1e] Skipping network cache update for instance because it is being deleted. {{(pid=75176) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9939}}
Nov 28 15:45:59 user nova-compute[75176]: INFO nova.compute.manager [None req-8ec8a8bc-9d80-4495-977d-1ff6b5f443eb tempest-VolumesActionsTest-508911516 tempest-VolumesActionsTest-508911516-project-member] [instance: 6739b4fc-063c-454c-8b37-b81c07b7ca1e] Took 0.68 seconds to destroy the instance on the hypervisor.
Nov 28 15:45:59 user nova-compute[75176]: DEBUG oslo.service.loopingcall [None req-8ec8a8bc-9d80-4495-977d-1ff6b5f443eb tempest-VolumesActionsTest-508911516 tempest-VolumesActionsTest-508911516-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75176) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 15:45:59 user nova-compute[75176]: DEBUG nova.compute.manager [-] [instance: 6739b4fc-063c-454c-8b37-b81c07b7ca1e] Deallocating network for instance {{(pid=75176) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 15:45:59 user nova-compute[75176]: DEBUG nova.network.neutron [-] [instance: 6739b4fc-063c-454c-8b37-b81c07b7ca1e] deallocate_for_instance() {{(pid=75176) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 15:45:59 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquiring lock "refresh_cache-6ab0619f-72e5-4975-ade8-53d7c0784d89" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:45:59 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquired lock "refresh_cache-6ab0619f-72e5-4975-ade8-53d7c0784d89" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:45:59 user nova-compute[75176]: DEBUG nova.network.neutron [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] [instance: 6ab0619f-72e5-4975-ade8-53d7c0784d89] Forcefully refreshing network info cache for instance {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 15:45:59 user nova-compute[75176]: DEBUG nova.objects.instance [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lazy-loading 'info_cache' on Instance uuid 6ab0619f-72e5-4975-ade8-53d7c0784d89 {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:46:00 user nova-compute[75176]: DEBUG nova.network.neutron [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] [instance: 6ab0619f-72e5-4975-ade8-53d7c0784d89] Updating instance_info_cache with network_info: [{"id": "63e3a2a2-51d4-4899-806d-c3222f643878", "address": "fa:16:3e:4d:46:79", "network": {"id": "84bcb9a8-0292-4eed-a9eb-2a883619389c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1655598964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fa05294c527426383c66fe58b31c825", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63e3a2a2-51", "ovs_interfaceid": "63e3a2a2-51d4-4899-806d-c3222f643878", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:46:00 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Releasing lock "refresh_cache-6ab0619f-72e5-4975-ade8-53d7c0784d89" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:46:00 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] [instance: 6ab0619f-72e5-4975-ade8-53d7c0784d89] Updated the network info_cache for instance {{(pid=75176) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 15:46:00 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:46:00 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:46:00 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75176) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 15:46:00 user nova-compute[75176]: DEBUG nova.network.neutron [-] [instance: 6739b4fc-063c-454c-8b37-b81c07b7ca1e] Updating instance_info_cache with network_info: [] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:46:00 user nova-compute[75176]: INFO nova.compute.manager [-] [instance: 6739b4fc-063c-454c-8b37-b81c07b7ca1e] Took 0.78 seconds to deallocate network for instance.
Nov 28 15:46:00 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-8ec8a8bc-9d80-4495-977d-1ff6b5f443eb tempest-VolumesActionsTest-508911516 tempest-VolumesActionsTest-508911516-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:46:00 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-8ec8a8bc-9d80-4495-977d-1ff6b5f443eb tempest-VolumesActionsTest-508911516 tempest-VolumesActionsTest-508911516-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:46:00 user nova-compute[75176]: DEBUG nova.compute.provider_tree [None req-8ec8a8bc-9d80-4495-977d-1ff6b5f443eb tempest-VolumesActionsTest-508911516 tempest-VolumesActionsTest-508911516-project-member] Inventory has not changed in ProviderTree for provider: b37848d8-f401-4155-a029-b0ffa09ff85b {{(pid=75176) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 15:46:00 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-8ec8a8bc-9d80-4495-977d-1ff6b5f443eb tempest-VolumesActionsTest-508911516 tempest-VolumesActionsTest-508911516-project-member] Inventory has not changed for provider b37848d8-f401-4155-a029-b0ffa09ff85b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75176) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 15:46:00 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-8ec8a8bc-9d80-4495-977d-1ff6b5f443eb tempest-VolumesActionsTest-508911516 tempest-VolumesActionsTest-508911516-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.419s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:46:00 user nova-compute[75176]: INFO nova.scheduler.client.report [None req-8ec8a8bc-9d80-4495-977d-1ff6b5f443eb tempest-VolumesActionsTest-508911516 tempest-VolumesActionsTest-508911516-project-member] Deleted allocations for instance 6739b4fc-063c-454c-8b37-b81c07b7ca1e
Nov 28 15:46:00 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-8ec8a8bc-9d80-4495-977d-1ff6b5f443eb tempest-VolumesActionsTest-508911516 tempest-VolumesActionsTest-508911516-project-member] Lock "6739b4fc-063c-454c-8b37-b81c07b7ca1e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.079s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:46:01 user nova-compute[75176]: DEBUG nova.compute.manager [req-667b7a2c-96f2-48f1-9f69-b92bb5e05c84 req-c9d99566-145e-40ed-a564-b52e6fd26f8d service nova] [instance: 6739b4fc-063c-454c-8b37-b81c07b7ca1e] Received event network-vif-plugged-9fb61fd8-c11e-41e5-a9f4-b6787f858f01 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:46:01 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-667b7a2c-96f2-48f1-9f69-b92bb5e05c84 req-c9d99566-145e-40ed-a564-b52e6fd26f8d service nova] Acquiring lock "6739b4fc-063c-454c-8b37-b81c07b7ca1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:46:01 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-667b7a2c-96f2-48f1-9f69-b92bb5e05c84 req-c9d99566-145e-40ed-a564-b52e6fd26f8d service nova] Lock "6739b4fc-063c-454c-8b37-b81c07b7ca1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:46:01 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-667b7a2c-96f2-48f1-9f69-b92bb5e05c84 req-c9d99566-145e-40ed-a564-b52e6fd26f8d service nova] Lock "6739b4fc-063c-454c-8b37-b81c07b7ca1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:46:01 user nova-compute[75176]: DEBUG nova.compute.manager [req-667b7a2c-96f2-48f1-9f69-b92bb5e05c84 req-c9d99566-145e-40ed-a564-b52e6fd26f8d service nova] [instance: 6739b4fc-063c-454c-8b37-b81c07b7ca1e] No waiting events found dispatching network-vif-plugged-9fb61fd8-c11e-41e5-a9f4-b6787f858f01 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:46:01 user nova-compute[75176]: WARNING nova.compute.manager [req-667b7a2c-96f2-48f1-9f69-b92bb5e05c84 req-c9d99566-145e-40ed-a564-b52e6fd26f8d service nova] [instance: 6739b4fc-063c-454c-8b37-b81c07b7ca1e] Received unexpected event network-vif-plugged-9fb61fd8-c11e-41e5-a9f4-b6787f858f01 for instance with vm_state deleted and task_state None.
Nov 28 15:46:01 user nova-compute[75176]: DEBUG nova.compute.manager [req-667b7a2c-96f2-48f1-9f69-b92bb5e05c84 req-c9d99566-145e-40ed-a564-b52e6fd26f8d service nova] [instance: 6739b4fc-063c-454c-8b37-b81c07b7ca1e] Received event network-vif-deleted-9fb61fd8-c11e-41e5-a9f4-b6787f858f01 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:46:02 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-c165e256-0795-4d3d-82d5-af2526bf6371 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] Acquiring lock "6b3646e6-512e-4cd6-b3c1-89438c19c408" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:46:02 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-c165e256-0795-4d3d-82d5-af2526bf6371 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] Lock "6b3646e6-512e-4cd6-b3c1-89438c19c408" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:46:02 user nova-compute[75176]: DEBUG nova.objects.instance [None req-c165e256-0795-4d3d-82d5-af2526bf6371 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] Lazy-loading 'flavor' on Instance uuid 6b3646e6-512e-4cd6-b3c1-89438c19c408 {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:46:02 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-c165e256-0795-4d3d-82d5-af2526bf6371 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] Lock "6b3646e6-512e-4cd6-b3c1-89438c19c408" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:46:02 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-c165e256-0795-4d3d-82d5-af2526bf6371 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] Acquiring lock "6b3646e6-512e-4cd6-b3c1-89438c19c408" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:46:02 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-c165e256-0795-4d3d-82d5-af2526bf6371 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] Lock "6b3646e6-512e-4cd6-b3c1-89438c19c408" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:46:02 user nova-compute[75176]: INFO nova.compute.manager [None req-c165e256-0795-4d3d-82d5-af2526bf6371 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] [instance: 6b3646e6-512e-4cd6-b3c1-89438c19c408] Attaching volume e7728674-3e10-438c-8fa0-9fc73367663f to /dev/vdb
Nov 28 15:46:02 user nova-compute[75176]: DEBUG os_brick.utils [None req-c165e256-0795-4d3d-82d5-af2526bf6371 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 15:46:02 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:46:02 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:46:02 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e829601-07db-466e-9fc5-ffff64db417f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:edc924a949b2\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:46:02 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:46:02 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:46:02 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9a5986f-2c79-4ebd-848f-de832c5a5044]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:46:02 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:46:02 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:46:02 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[a61b8fc0-cfe6-4885-bb71-f444a430abfb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:46:02 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fbee4bd-f27e-4434-a15a-eda96727387c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:46:02 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-c165e256-0795-4d3d-82d5-af2526bf6371 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] Running cmd (subprocess): nvme version {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:46:02 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-c165e256-0795-4d3d-82d5-af2526bf6371 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] 'nvme version' failed. Not Retrying. {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 15:46:02 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c165e256-0795-4d3d-82d5-af2526bf6371 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] nvme not present on system {{(pid=75176) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 15:46:02 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:46:02 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 15:46:02 user nova-compute[75176]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 15:46:02 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5232fad-b11e-4641-a1f4-4a0788b8650f]: (4, '') {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:46:02 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.lightos [None req-c165e256-0795-4d3d-82d5-af2526bf6371 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75176) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 15:46:02 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.lightos [None req-c165e256-0795-4d3d-82d5-af2526bf6371 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75176) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 15:46:02 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.lightos [None req-c165e256-0795-4d3d-82d5-af2526bf6371 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] LIGHTOS: no hostnqn found. {{(pid=75176) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 15:46:02 user nova-compute[75176]: DEBUG os_brick.utils [None req-c165e256-0795-4d3d-82d5-af2526bf6371 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:edc924a949b2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 15:46:02 user nova-compute[75176]: DEBUG nova.virt.block_device [None req-c165e256-0795-4d3d-82d5-af2526bf6371 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] [instance: 6b3646e6-512e-4cd6-b3c1-89438c19c408] Updating existing volume attachment record: 0a7edb0c-d007-4a12-89cf-8108b9106509 {{(pid=75176) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 15:46:03 user nova-compute[75176]: DEBUG nova.compute.manager [req-2c4bd09e-4d4b-4a9b-ab38-2227946eee41 req-66e72508-c15c-491f-8d8d-75be27abff1a service nova] [instance: 6b3646e6-512e-4cd6-b3c1-89438c19c408] Received event network-changed-76888781-ca16-4c3d-99b3-37a902459609 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:46:03 user nova-compute[75176]: DEBUG nova.compute.manager [req-2c4bd09e-4d4b-4a9b-ab38-2227946eee41 req-66e72508-c15c-491f-8d8d-75be27abff1a service nova] [instance: 6b3646e6-512e-4cd6-b3c1-89438c19c408] Refreshing instance network info cache due to event network-changed-76888781-ca16-4c3d-99b3-37a902459609. {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 15:46:03 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-2c4bd09e-4d4b-4a9b-ab38-2227946eee41 req-66e72508-c15c-491f-8d8d-75be27abff1a service nova] Acquiring lock "refresh_cache-6b3646e6-512e-4cd6-b3c1-89438c19c408" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:46:03 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-2c4bd09e-4d4b-4a9b-ab38-2227946eee41 req-66e72508-c15c-491f-8d8d-75be27abff1a service nova] Acquired lock "refresh_cache-6b3646e6-512e-4cd6-b3c1-89438c19c408" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:46:03 user nova-compute[75176]: DEBUG nova.network.neutron [req-2c4bd09e-4d4b-4a9b-ab38-2227946eee41 req-66e72508-c15c-491f-8d8d-75be27abff1a service nova] [instance: 6b3646e6-512e-4cd6-b3c1-89438c19c408] Refreshing network info cache for port 76888781-ca16-4c3d-99b3-37a902459609 {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 15:46:03 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-44c83a5a-6426-4d14-bf03-2f771b3c0c03 tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] Acquiring lock "bcccc277-0049-41c5-9d8c-7db1d86e1fca" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:46:03 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-44c83a5a-6426-4d14-bf03-2f771b3c0c03 tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] Lock "bcccc277-0049-41c5-9d8c-7db1d86e1fca" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:46:03 user nova-compute[75176]: DEBUG nova.compute.manager [None req-44c83a5a-6426-4d14-bf03-2f771b3c0c03 tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] [instance: bcccc277-0049-41c5-9d8c-7db1d86e1fca] Starting instance... {{(pid=75176) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 15:46:03 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-44c83a5a-6426-4d14-bf03-2f771b3c0c03 tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:46:03 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-44c83a5a-6426-4d14-bf03-2f771b3c0c03 tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:46:03 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-44c83a5a-6426-4d14-bf03-2f771b3c0c03 tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75176) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 15:46:03 user nova-compute[75176]: INFO nova.compute.claims [None req-44c83a5a-6426-4d14-bf03-2f771b3c0c03 tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] [instance: bcccc277-0049-41c5-9d8c-7db1d86e1fca] Claim successful on node user
Nov 28 15:46:03 user nova-compute[75176]: DEBUG nova.network.neutron [req-2c4bd09e-4d4b-4a9b-ab38-2227946eee41 req-66e72508-c15c-491f-8d8d-75be27abff1a service nova] [instance: 6b3646e6-512e-4cd6-b3c1-89438c19c408] Updated VIF entry in instance network info cache for port 76888781-ca16-4c3d-99b3-37a902459609. {{(pid=75176) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 15:46:03 user nova-compute[75176]: DEBUG nova.network.neutron [req-2c4bd09e-4d4b-4a9b-ab38-2227946eee41 req-66e72508-c15c-491f-8d8d-75be27abff1a service nova] [instance: 6b3646e6-512e-4cd6-b3c1-89438c19c408] Updating instance_info_cache with network_info: [{"id": "76888781-ca16-4c3d-99b3-37a902459609", "address": "fa:16:3e:42:3e:fc", "network": {"id": "a275bae2-c1ee-445a-adc0-411f99e837e7", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1828472132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39f22e22fdcb403d82a186a635d6b44a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76888781-ca", "ovs_interfaceid": "76888781-ca16-4c3d-99b3-37a902459609", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:46:03 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:46:03 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-2c4bd09e-4d4b-4a9b-ab38-2227946eee41 req-66e72508-c15c-491f-8d8d-75be27abff1a service nova] Releasing lock "refresh_cache-6b3646e6-512e-4cd6-b3c1-89438c19c408" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:46:04 user nova-compute[75176]: DEBUG nova.compute.provider_tree [None req-44c83a5a-6426-4d14-bf03-2f771b3c0c03 tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] Inventory has not changed in ProviderTree for provider: b37848d8-f401-4155-a029-b0ffa09ff85b {{(pid=75176) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 15:46:04 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-44c83a5a-6426-4d14-bf03-2f771b3c0c03 tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] Inventory has not changed for provider b37848d8-f401-4155-a029-b0ffa09ff85b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75176) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 15:46:04 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-44c83a5a-6426-4d14-bf03-2f771b3c0c03 tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.558s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:46:04 user nova-compute[75176]: DEBUG nova.compute.manager [None req-44c83a5a-6426-4d14-bf03-2f771b3c0c03 tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] [instance: bcccc277-0049-41c5-9d8c-7db1d86e1fca] Start building networks asynchronously for instance. {{(pid=75176) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 15:46:04 user nova-compute[75176]: DEBUG nova.compute.manager [None req-44c83a5a-6426-4d14-bf03-2f771b3c0c03 tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] [instance: bcccc277-0049-41c5-9d8c-7db1d86e1fca] Allocating IP information in the background. {{(pid=75176) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 15:46:04 user nova-compute[75176]: DEBUG nova.network.neutron [None req-44c83a5a-6426-4d14-bf03-2f771b3c0c03 tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] [instance: bcccc277-0049-41c5-9d8c-7db1d86e1fca] allocate_for_instance() {{(pid=75176) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 15:46:04 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-44c83a5a-6426-4d14-bf03-2f771b3c0c03 tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] [instance: bcccc277-0049-41c5-9d8c-7db1d86e1fca] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 15:46:04 user nova-compute[75176]: DEBUG nova.compute.manager [None req-44c83a5a-6426-4d14-bf03-2f771b3c0c03 tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] [instance: bcccc277-0049-41c5-9d8c-7db1d86e1fca] Start building block device mappings for instance. {{(pid=75176) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 15:46:04 user nova-compute[75176]: DEBUG nova.policy [None req-44c83a5a-6426-4d14-bf03-2f771b3c0c03 tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8fdbce92609048169853a846340eb9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ce3926a76541f7a32ada5070b10be1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75176) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 15:46:04 user nova-compute[75176]: DEBUG nova.compute.manager [None req-44c83a5a-6426-4d14-bf03-2f771b3c0c03 tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] [instance: bcccc277-0049-41c5-9d8c-7db1d86e1fca] Start spawning the instance on the hypervisor. {{(pid=75176) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 15:46:04 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-44c83a5a-6426-4d14-bf03-2f771b3c0c03 tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] [instance: bcccc277-0049-41c5-9d8c-7db1d86e1fca] Creating instance directory {{(pid=75176) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 15:46:04 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-44c83a5a-6426-4d14-bf03-2f771b3c0c03 tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] [instance: bcccc277-0049-41c5-9d8c-7db1d86e1fca] Creating image(s)
Nov 28 15:46:04 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-44c83a5a-6426-4d14-bf03-2f771b3c0c03 tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] Acquiring lock "/opt/stack/data/nova/instances/bcccc277-0049-41c5-9d8c-7db1d86e1fca/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:46:04 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-44c83a5a-6426-4d14-bf03-2f771b3c0c03 tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] Lock "/opt/stack/data/nova/instances/bcccc277-0049-41c5-9d8c-7db1d86e1fca/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:46:04 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-44c83a5a-6426-4d14-bf03-2f771b3c0c03 tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] Lock "/opt/stack/data/nova/instances/bcccc277-0049-41c5-9d8c-7db1d86e1fca/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:46:04 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-44c83a5a-6426-4d14-bf03-2f771b3c0c03 tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:46:04 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:46:04 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:46:04 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-44c83a5a-6426-4d14-bf03-2f771b3c0c03 tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json" returned: 0 in 0.196s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:46:04 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-44c83a5a-6426-4d14-bf03-2f771b3c0c03 tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] Acquiring lock "5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:46:04 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-44c83a5a-6426-4d14-bf03-2f771b3c0c03 tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] Lock "5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:46:04 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-44c83a5a-6426-4d14-bf03-2f771b3c0c03 tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:46:04 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-44c83a5a-6426-4d14-bf03-2f771b3c0c03 tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json" returned: 0 in 0.219s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:46:04 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-44c83a5a-6426-4d14-bf03-2f771b3c0c03 tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2,backing_fmt=raw /opt/stack/data/nova/instances/bcccc277-0049-41c5-9d8c-7db1d86e1fca/disk 1073741824 {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:46:04 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-44c83a5a-6426-4d14-bf03-2f771b3c0c03 tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2,backing_fmt=raw /opt/stack/data/nova/instances/bcccc277-0049-41c5-9d8c-7db1d86e1fca/disk 1073741824" returned: 0 in 0.057s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:46:04 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-44c83a5a-6426-4d14-bf03-2f771b3c0c03 tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] Lock "5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.288s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:46:04 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-44c83a5a-6426-4d14-bf03-2f771b3c0c03 tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:46:04 user nova-compute[75176]: DEBUG nova.network.neutron [None req-44c83a5a-6426-4d14-bf03-2f771b3c0c03 tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] [instance: bcccc277-0049-41c5-9d8c-7db1d86e1fca] Successfully created port: 5b8fbb7b-8b59-4923-ae3e-b7567ad90d30 {{(pid=75176) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 15:46:05 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-44c83a5a-6426-4d14-bf03-2f771b3c0c03 tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json" returned: 0 in 0.184s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:46:05 user nova-compute[75176]: DEBUG nova.virt.disk.api [None req-44c83a5a-6426-4d14-bf03-2f771b3c0c03 tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bcccc277-0049-41c5-9d8c-7db1d86e1fca/disk. size=1073741824 {{(pid=75176) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 15:46:05 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-44c83a5a-6426-4d14-bf03-2f771b3c0c03 tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcccc277-0049-41c5-9d8c-7db1d86e1fca/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:46:05 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-44c83a5a-6426-4d14-bf03-2f771b3c0c03 tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcccc277-0049-41c5-9d8c-7db1d86e1fca/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:46:05 user nova-compute[75176]: DEBUG nova.virt.disk.api [None req-44c83a5a-6426-4d14-bf03-2f771b3c0c03 tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] Cannot resize image /opt/stack/data/nova/instances/bcccc277-0049-41c5-9d8c-7db1d86e1fca/disk to a smaller size. {{(pid=75176) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 15:46:05 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-44c83a5a-6426-4d14-bf03-2f771b3c0c03 tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] [instance: bcccc277-0049-41c5-9d8c-7db1d86e1fca] Created local disks {{(pid=75176) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 15:46:05 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-44c83a5a-6426-4d14-bf03-2f771b3c0c03 tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] [instance: bcccc277-0049-41c5-9d8c-7db1d86e1fca] Ensure instance console log exists: /opt/stack/data/nova/instances/bcccc277-0049-41c5-9d8c-7db1d86e1fca/console.log {{(pid=75176) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 15:46:05 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-44c83a5a-6426-4d14-bf03-2f771b3c0c03 tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:46:05 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-44c83a5a-6426-4d14-bf03-2f771b3c0c03 tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:46:05 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-44c83a5a-6426-4d14-bf03-2f771b3c0c03 tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:46:05 user nova-compute[75176]: DEBUG nova.network.neutron [None req-44c83a5a-6426-4d14-bf03-2f771b3c0c03 tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] [instance: bcccc277-0049-41c5-9d8c-7db1d86e1fca] Successfully updated port: 5b8fbb7b-8b59-4923-ae3e-b7567ad90d30 {{(pid=75176) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 15:46:05 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-44c83a5a-6426-4d14-bf03-2f771b3c0c03 tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] Acquiring lock "refresh_cache-bcccc277-0049-41c5-9d8c-7db1d86e1fca" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:46:05 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-44c83a5a-6426-4d14-bf03-2f771b3c0c03 tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] Acquired lock "refresh_cache-bcccc277-0049-41c5-9d8c-7db1d86e1fca" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:46:05 user nova-compute[75176]: DEBUG nova.network.neutron [None req-44c83a5a-6426-4d14-bf03-2f771b3c0c03 tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] [instance: bcccc277-0049-41c5-9d8c-7db1d86e1fca] Building network info cache for instance {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 15:46:05 user nova-compute[75176]: DEBUG nova.compute.manager [req-e88e6ade-3f52-4e5c-8021-07385c5f2ed7 req-9ffdb64c-f375-4c68-8c04-dbdd94ede1e1 service nova] [instance: bcccc277-0049-41c5-9d8c-7db1d86e1fca] Received event network-changed-5b8fbb7b-8b59-4923-ae3e-b7567ad90d30 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:46:05 user nova-compute[75176]: DEBUG nova.compute.manager [req-e88e6ade-3f52-4e5c-8021-07385c5f2ed7 req-9ffdb64c-f375-4c68-8c04-dbdd94ede1e1 service nova] [instance: bcccc277-0049-41c5-9d8c-7db1d86e1fca] Refreshing instance network info cache due to event network-changed-5b8fbb7b-8b59-4923-ae3e-b7567ad90d30. {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 15:46:05 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-e88e6ade-3f52-4e5c-8021-07385c5f2ed7 req-9ffdb64c-f375-4c68-8c04-dbdd94ede1e1 service nova] Acquiring lock "refresh_cache-bcccc277-0049-41c5-9d8c-7db1d86e1fca" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:46:05 user nova-compute[75176]: DEBUG nova.network.neutron [None req-44c83a5a-6426-4d14-bf03-2f771b3c0c03 tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] [instance: bcccc277-0049-41c5-9d8c-7db1d86e1fca] Instance cache missing network info. {{(pid=75176) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 15:46:06 user nova-compute[75176]: DEBUG nova.network.neutron [None req-44c83a5a-6426-4d14-bf03-2f771b3c0c03 tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] [instance: bcccc277-0049-41c5-9d8c-7db1d86e1fca] Updating instance_info_cache with network_info: [{"id": "5b8fbb7b-8b59-4923-ae3e-b7567ad90d30", "address": "fa:16:3e:e8:d8:8e", "network": {"id": "51143aa0-7498-4dfc-8425-9046ee5aa4fc", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-351796020-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13ce3926a76541f7a32ada5070b10be1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b8fbb7b-8b", "ovs_interfaceid": "5b8fbb7b-8b59-4923-ae3e-b7567ad90d30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:46:06 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-44c83a5a-6426-4d14-bf03-2f771b3c0c03 tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] Releasing lock "refresh_cache-bcccc277-0049-41c5-9d8c-7db1d86e1fca" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:46:06 user nova-compute[75176]: DEBUG nova.compute.manager [None req-44c83a5a-6426-4d14-bf03-2f771b3c0c03 tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] [instance: bcccc277-0049-41c5-9d8c-7db1d86e1fca] Instance network_info: |[{"id": "5b8fbb7b-8b59-4923-ae3e-b7567ad90d30", "address": "fa:16:3e:e8:d8:8e", "network": {"id": "51143aa0-7498-4dfc-8425-9046ee5aa4fc", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-351796020-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13ce3926a76541f7a32ada5070b10be1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b8fbb7b-8b", "ovs_interfaceid": "5b8fbb7b-8b59-4923-ae3e-b7567ad90d30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75176) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 15:46:06 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-e88e6ade-3f52-4e5c-8021-07385c5f2ed7 req-9ffdb64c-f375-4c68-8c04-dbdd94ede1e1 service nova] Acquired lock "refresh_cache-bcccc277-0049-41c5-9d8c-7db1d86e1fca" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:46:06 user nova-compute[75176]: DEBUG nova.network.neutron [req-e88e6ade-3f52-4e5c-8021-07385c5f2ed7 req-9ffdb64c-f375-4c68-8c04-dbdd94ede1e1 service nova] [instance: bcccc277-0049-41c5-9d8c-7db1d86e1fca] Refreshing network info cache for port 5b8fbb7b-8b59-4923-ae3e-b7567ad90d30 {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 15:46:06 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-44c83a5a-6426-4d14-bf03-2f771b3c0c03 tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] [instance: bcccc277-0049-41c5-9d8c-7db1d86e1fca] Start _get_guest_xml network_info=[{"id": "5b8fbb7b-8b59-4923-ae3e-b7567ad90d30", "address": "fa:16:3e:e8:d8:8e", "network": {"id": "51143aa0-7498-4dfc-8425-9046ee5aa4fc", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-351796020-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13ce3926a76541f7a32ada5070b10be1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b8fbb7b-8b", "ovs_interfaceid": "5b8fbb7b-8b59-4923-ae3e-b7567ad90d30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T15:35:12Z,direct_url=<?>,disk_format='qcow2',id=1f41819e-c93f-4dc7-b253-37a27bbbbc74,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1b91c5d0672c4224a48df2e1f92688e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T15:35:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'size': 0, 'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'image_id': '1f41819e-c93f-4dc7-b253-37a27bbbbc74'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75176) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 15:46:06 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-44c83a5a-6426-4d14-bf03-2f771b3c0c03 tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 15:46:06 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-44c83a5a-6426-4d14-bf03-2f771b3c0c03 tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 15:46:06 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-44c83a5a-6426-4d14-bf03-2f771b3c0c03 tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75176) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 15:46:06 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-44c83a5a-6426-4d14-bf03-2f771b3c0c03 tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] CPU controller missing on host. {{(pid=75176) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 15:46:06 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-44c83a5a-6426-4d14-bf03-2f771b3c0c03 tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75176) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 15:46:06 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-44c83a5a-6426-4d14-bf03-2f771b3c0c03 tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] CPU controller found on host. {{(pid=75176) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 15:46:06 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-44c83a5a-6426-4d14-bf03-2f771b3c0c03 tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75176) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 15:46:06 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-44c83a5a-6426-4d14-bf03-2f771b3c0c03 tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T15:35:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T15:35:12Z,direct_url=<?>,disk_format='qcow2',id=1f41819e-c93f-4dc7-b253-37a27bbbbc74,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1b91c5d0672c4224a48df2e1f92688e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T15:35:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 15:46:06 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-44c83a5a-6426-4d14-bf03-2f771b3c0c03 tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] Flavor limits 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 15:46:06 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-44c83a5a-6426-4d14-bf03-2f771b3c0c03 tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] Image limits 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 15:46:06 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-44c83a5a-6426-4d14-bf03-2f771b3c0c03 tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] Flavor pref 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 15:46:06 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-44c83a5a-6426-4d14-bf03-2f771b3c0c03 tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] Image pref 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 15:46:06 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-44c83a5a-6426-4d14-bf03-2f771b3c0c03 tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 15:46:06 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-44c83a5a-6426-4d14-bf03-2f771b3c0c03 tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 15:46:06 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-44c83a5a-6426-4d14-bf03-2f771b3c0c03 tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75176) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 15:46:06 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-44c83a5a-6426-4d14-bf03-2f771b3c0c03 tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] Got 1 possible topologies {{(pid=75176) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 15:46:06 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-44c83a5a-6426-4d14-bf03-2f771b3c0c03 tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 15:46:06 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-44c83a5a-6426-4d14-bf03-2f771b3c0c03 tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 15:46:06 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-44c83a5a-6426-4d14-bf03-2f771b3c0c03 tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T15:46:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-57835384',display_name='tempest-ServersNegativeTestJSON-server-57835384',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-57835384',id=22,image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='13ce3926a76541f7a32ada5070b10be1',ramdisk_id='',reservation_id='r-1blfv0rc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-417711709',owner_user_name='tempest-ServersNegativeTestJSON-417711709-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T15:46:04Z,user_data=None,user_id='8fdbce92609048169853a846340eb9fe',uuid=bcccc277-0049-41c5-9d8c-7db1d86e1fca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5b8fbb7b-8b59-4923-ae3e-b7567ad90d30", "address": "fa:16:3e:e8:d8:8e", "network": {"id": "51143aa0-7498-4dfc-8425-9046ee5aa4fc", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-351796020-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13ce3926a76541f7a32ada5070b10be1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b8fbb7b-8b", "ovs_interfaceid": "5b8fbb7b-8b59-4923-ae3e-b7567ad90d30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75176) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 15:46:06 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-44c83a5a-6426-4d14-bf03-2f771b3c0c03 tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] Converting VIF {"id": "5b8fbb7b-8b59-4923-ae3e-b7567ad90d30", "address": "fa:16:3e:e8:d8:8e", "network": {"id": "51143aa0-7498-4dfc-8425-9046ee5aa4fc", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-351796020-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13ce3926a76541f7a32ada5070b10be1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b8fbb7b-8b", "ovs_interfaceid": "5b8fbb7b-8b59-4923-ae3e-b7567ad90d30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:46:06 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-44c83a5a-6426-4d14-bf03-2f771b3c0c03 tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:d8:8e,bridge_name='br-int',has_traffic_filtering=True,id=5b8fbb7b-8b59-4923-ae3e-b7567ad90d30,network=Network(51143aa0-7498-4dfc-8425-9046ee5aa4fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b8fbb7b-8b') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:46:06 user nova-compute[75176]: DEBUG nova.objects.instance [None req-44c83a5a-6426-4d14-bf03-2f771b3c0c03 tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] Lazy-loading 'pci_devices' on Instance uuid bcccc277-0049-41c5-9d8c-7db1d86e1fca {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:46:06 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-44c83a5a-6426-4d14-bf03-2f771b3c0c03 tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] [instance: bcccc277-0049-41c5-9d8c-7db1d86e1fca] End _get_guest_xml xml=<domain type="kvm">
Nov 28 15:46:06 user nova-compute[75176]:   <uuid>bcccc277-0049-41c5-9d8c-7db1d86e1fca</uuid>
Nov 28 15:46:06 user nova-compute[75176]:   <name>instance-00000016</name>
Nov 28 15:46:06 user nova-compute[75176]:   <memory>524288</memory>
Nov 28 15:46:06 user nova-compute[75176]:   <vcpu>1</vcpu>
Nov 28 15:46:06 user nova-compute[75176]:   <metadata>
Nov 28 15:46:06 user nova-compute[75176]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 15:46:06 user nova-compute[75176]:       <nova:package version="0.0.0"/>
Nov 28 15:46:06 user nova-compute[75176]:       <nova:name>tempest-ServersNegativeTestJSON-server-57835384</nova:name>
Nov 28 15:46:06 user nova-compute[75176]:       <nova:creationTime>2023-11-28 15:46:06</nova:creationTime>
Nov 28 15:46:06 user nova-compute[75176]:       <nova:flavor name="m1.tiny">
Nov 28 15:46:06 user nova-compute[75176]:         <nova:memory>512</nova:memory>
Nov 28 15:46:06 user nova-compute[75176]:         <nova:disk>1</nova:disk>
Nov 28 15:46:06 user nova-compute[75176]:         <nova:swap>0</nova:swap>
Nov 28 15:46:06 user nova-compute[75176]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 15:46:06 user nova-compute[75176]:         <nova:vcpus>1</nova:vcpus>
Nov 28 15:46:06 user nova-compute[75176]:       </nova:flavor>
Nov 28 15:46:06 user nova-compute[75176]:       <nova:owner>
Nov 28 15:46:06 user nova-compute[75176]:         <nova:user uuid="8fdbce92609048169853a846340eb9fe">tempest-ServersNegativeTestJSON-417711709-project-member</nova:user>
Nov 28 15:46:06 user nova-compute[75176]:         <nova:project uuid="13ce3926a76541f7a32ada5070b10be1">tempest-ServersNegativeTestJSON-417711709</nova:project>
Nov 28 15:46:06 user nova-compute[75176]:       </nova:owner>
Nov 28 15:46:06 user nova-compute[75176]:       <nova:root type="image" uuid="1f41819e-c93f-4dc7-b253-37a27bbbbc74"/>
Nov 28 15:46:06 user nova-compute[75176]:       <nova:ports>
Nov 28 15:46:06 user nova-compute[75176]:         <nova:port uuid="5b8fbb7b-8b59-4923-ae3e-b7567ad90d30">
Nov 28 15:46:06 user nova-compute[75176]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 28 15:46:06 user nova-compute[75176]:         </nova:port>
Nov 28 15:46:06 user nova-compute[75176]:       </nova:ports>
Nov 28 15:46:06 user nova-compute[75176]:     </nova:instance>
Nov 28 15:46:06 user nova-compute[75176]:   </metadata>
Nov 28 15:46:06 user nova-compute[75176]:   <sysinfo type="smbios">
Nov 28 15:46:06 user nova-compute[75176]:     <system>
Nov 28 15:46:06 user nova-compute[75176]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 15:46:06 user nova-compute[75176]:       <entry name="product">OpenStack Nova</entry>
Nov 28 15:46:06 user nova-compute[75176]:       <entry name="version">0.0.0</entry>
Nov 28 15:46:06 user nova-compute[75176]:       <entry name="serial">bcccc277-0049-41c5-9d8c-7db1d86e1fca</entry>
Nov 28 15:46:06 user nova-compute[75176]:       <entry name="uuid">bcccc277-0049-41c5-9d8c-7db1d86e1fca</entry>
Nov 28 15:46:06 user nova-compute[75176]:       <entry name="family">Virtual Machine</entry>
Nov 28 15:46:06 user nova-compute[75176]:     </system>
Nov 28 15:46:06 user nova-compute[75176]:   </sysinfo>
Nov 28 15:46:06 user nova-compute[75176]:   <os>
Nov 28 15:46:06 user nova-compute[75176]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 15:46:06 user nova-compute[75176]:     <boot dev="hd"/>
Nov 28 15:46:06 user nova-compute[75176]:     <smbios mode="sysinfo"/>
Nov 28 15:46:06 user nova-compute[75176]:   </os>
Nov 28 15:46:06 user nova-compute[75176]:   <features>
Nov 28 15:46:06 user nova-compute[75176]:     <acpi/>
Nov 28 15:46:06 user nova-compute[75176]:     <apic/>
Nov 28 15:46:06 user nova-compute[75176]:     <vmcoreinfo/>
Nov 28 15:46:06 user nova-compute[75176]:   </features>
Nov 28 15:46:06 user nova-compute[75176]:   <clock offset="utc">
Nov 28 15:46:06 user nova-compute[75176]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 15:46:06 user nova-compute[75176]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 15:46:06 user nova-compute[75176]:     <timer name="hpet" present="no"/>
Nov 28 15:46:06 user nova-compute[75176]:   </clock>
Nov 28 15:46:06 user nova-compute[75176]:   <cpu mode="custom" match="exact">
Nov 28 15:46:06 user nova-compute[75176]:     <model>Nehalem</model>
Nov 28 15:46:06 user nova-compute[75176]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 15:46:06 user nova-compute[75176]:   </cpu>
Nov 28 15:46:06 user nova-compute[75176]:   <devices>
Nov 28 15:46:06 user nova-compute[75176]:     <disk type="file" device="disk">
Nov 28 15:46:06 user nova-compute[75176]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 15:46:06 user nova-compute[75176]:       <source file="/opt/stack/data/nova/instances/bcccc277-0049-41c5-9d8c-7db1d86e1fca/disk"/>
Nov 28 15:46:06 user nova-compute[75176]:       <target dev="vda" bus="virtio"/>
Nov 28 15:46:06 user nova-compute[75176]:     </disk>
Nov 28 15:46:06 user nova-compute[75176]:     <interface type="ethernet">
Nov 28 15:46:06 user nova-compute[75176]:       <mac address="fa:16:3e:e8:d8:8e"/>
Nov 28 15:46:06 user nova-compute[75176]:       <model type="virtio"/>
Nov 28 15:46:06 user nova-compute[75176]:       <mtu size="1442"/>
Nov 28 15:46:06 user nova-compute[75176]:       <target dev="tap5b8fbb7b-8b"/>
Nov 28 15:46:06 user nova-compute[75176]:     </interface>
Nov 28 15:46:06 user nova-compute[75176]:     <serial type="pty">
Nov 28 15:46:06 user nova-compute[75176]:       <log file="/opt/stack/data/nova/instances/bcccc277-0049-41c5-9d8c-7db1d86e1fca/console.log" append="off"/>
Nov 28 15:46:06 user nova-compute[75176]:     </serial>
Nov 28 15:46:06 user nova-compute[75176]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 15:46:06 user nova-compute[75176]:     <video>
Nov 28 15:46:06 user nova-compute[75176]:       <model type="virtio"/>
Nov 28 15:46:06 user nova-compute[75176]:     </video>
Nov 28 15:46:06 user nova-compute[75176]:     <rng model="virtio">
Nov 28 15:46:06 user nova-compute[75176]:       <backend model="random">/dev/urandom</backend>
Nov 28 15:46:06 user nova-compute[75176]:     </rng>
Nov 28 15:46:06 user nova-compute[75176]:     <controller type="usb" index="0" model="none"/>
Nov 28 15:46:06 user nova-compute[75176]:     <memballoon model="virtio">
Nov 28 15:46:06 user nova-compute[75176]:       <stats period="10"/>
Nov 28 15:46:06 user nova-compute[75176]:     </memballoon>
Nov 28 15:46:06 user nova-compute[75176]:   </devices>
Nov 28 15:46:06 user nova-compute[75176]: </domain>
Nov 28 15:46:06 user nova-compute[75176]:  {{(pid=75176) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 15:46:06 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-44c83a5a-6426-4d14-bf03-2f771b3c0c03 tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T15:46:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-57835384',display_name='tempest-ServersNegativeTestJSON-server-57835384',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-57835384',id=22,image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='13ce3926a76541f7a32ada5070b10be1',ramdisk_id='',reservation_id='r-1blfv0rc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-417711709',owner_user_name='tempest-ServersNegativeTestJSON-417711709-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T15:46:04Z,user_data=None,user_id='8fdbce92609048169853a846340eb9fe',uuid=bcccc277-0049-41c5-9d8c-7db1d86e1fca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5b8fbb7b-8b59-4923-ae3e-b7567ad90d30", "address": "fa:16:3e:e8:d8:8e", "network": {"id": "51143aa0-7498-4dfc-8425-9046ee5aa4fc", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-351796020-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13ce3926a76541f7a32ada5070b10be1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b8fbb7b-8b", "ovs_interfaceid": "5b8fbb7b-8b59-4923-ae3e-b7567ad90d30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 15:46:06 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-44c83a5a-6426-4d14-bf03-2f771b3c0c03 tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] Converting VIF {"id": "5b8fbb7b-8b59-4923-ae3e-b7567ad90d30", "address": "fa:16:3e:e8:d8:8e", "network": {"id": "51143aa0-7498-4dfc-8425-9046ee5aa4fc", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-351796020-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13ce3926a76541f7a32ada5070b10be1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b8fbb7b-8b", "ovs_interfaceid": "5b8fbb7b-8b59-4923-ae3e-b7567ad90d30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:46:06 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-44c83a5a-6426-4d14-bf03-2f771b3c0c03 tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:d8:8e,bridge_name='br-int',has_traffic_filtering=True,id=5b8fbb7b-8b59-4923-ae3e-b7567ad90d30,network=Network(51143aa0-7498-4dfc-8425-9046ee5aa4fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b8fbb7b-8b') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:46:06 user nova-compute[75176]: DEBUG os_vif [None req-44c83a5a-6426-4d14-bf03-2f771b3c0c03 tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:d8:8e,bridge_name='br-int',has_traffic_filtering=True,id=5b8fbb7b-8b59-4923-ae3e-b7567ad90d30,network=Network(51143aa0-7498-4dfc-8425-9046ee5aa4fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b8fbb7b-8b') {{(pid=75176) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 15:46:06 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:46:06 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:46:06 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 15:46:06 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:46:06 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ac034350-f3fc-52c5-b329-a44667fc500c', '_type': 'linux-noop'}}, row=False) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:46:06 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:46:06 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:46:06 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:46:06 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5b8fbb7b-8b, may_exist=True, interface_attrs={}) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:46:06 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5b8fbb7b-8b, col_values=(('qos', UUID('2da36aa5-5e91-4c3d-b47a-6cf74621e9fc')),), if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:46:06 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5b8fbb7b-8b, col_values=(('external_ids', {'iface-id': '5b8fbb7b-8b59-4923-ae3e-b7567ad90d30', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e8:d8:8e', 'vm-uuid': 'bcccc277-0049-41c5-9d8c-7db1d86e1fca'}),), if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:46:06 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:46:06 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:46:06 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:46:06 user nova-compute[75176]: INFO os_vif [None req-44c83a5a-6426-4d14-bf03-2f771b3c0c03 tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:d8:8e,bridge_name='br-int',has_traffic_filtering=True,id=5b8fbb7b-8b59-4923-ae3e-b7567ad90d30,network=Network(51143aa0-7498-4dfc-8425-9046ee5aa4fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b8fbb7b-8b')
Nov 28 15:46:06 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-44c83a5a-6426-4d14-bf03-2f771b3c0c03 tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] No BDM found with device name vda, not building metadata. {{(pid=75176) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 15:46:06 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-44c83a5a-6426-4d14-bf03-2f771b3c0c03 tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] No VIF found with MAC fa:16:3e:e8:d8:8e, not building metadata {{(pid=75176) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 15:46:06 user nova-compute[75176]: DEBUG nova.network.neutron [req-e88e6ade-3f52-4e5c-8021-07385c5f2ed7 req-9ffdb64c-f375-4c68-8c04-dbdd94ede1e1 service nova] [instance: bcccc277-0049-41c5-9d8c-7db1d86e1fca] Updated VIF entry in instance network info cache for port 5b8fbb7b-8b59-4923-ae3e-b7567ad90d30. {{(pid=75176) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 15:46:06 user nova-compute[75176]: DEBUG nova.network.neutron [req-e88e6ade-3f52-4e5c-8021-07385c5f2ed7 req-9ffdb64c-f375-4c68-8c04-dbdd94ede1e1 service nova] [instance: bcccc277-0049-41c5-9d8c-7db1d86e1fca] Updating instance_info_cache with network_info: [{"id": "5b8fbb7b-8b59-4923-ae3e-b7567ad90d30", "address": "fa:16:3e:e8:d8:8e", "network": {"id": "51143aa0-7498-4dfc-8425-9046ee5aa4fc", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-351796020-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13ce3926a76541f7a32ada5070b10be1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b8fbb7b-8b", "ovs_interfaceid": "5b8fbb7b-8b59-4923-ae3e-b7567ad90d30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:46:06 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-e88e6ade-3f52-4e5c-8021-07385c5f2ed7 req-9ffdb64c-f375-4c68-8c04-dbdd94ede1e1 service nova] Releasing lock "refresh_cache-bcccc277-0049-41c5-9d8c-7db1d86e1fca" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:46:07 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:46:07 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:46:07 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:46:08 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:46:08 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:46:08 user nova-compute[75176]: DEBUG nova.compute.manager [req-0c175bf4-d924-4396-8082-99e73984ef9d req-419e3d28-3769-42a4-b769-101979340174 service nova] [instance: bcccc277-0049-41c5-9d8c-7db1d86e1fca] Received event network-vif-plugged-5b8fbb7b-8b59-4923-ae3e-b7567ad90d30 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:46:08 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-0c175bf4-d924-4396-8082-99e73984ef9d req-419e3d28-3769-42a4-b769-101979340174 service nova] Acquiring lock "bcccc277-0049-41c5-9d8c-7db1d86e1fca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:46:08 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-0c175bf4-d924-4396-8082-99e73984ef9d req-419e3d28-3769-42a4-b769-101979340174 service nova] Lock "bcccc277-0049-41c5-9d8c-7db1d86e1fca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:46:08 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-0c175bf4-d924-4396-8082-99e73984ef9d req-419e3d28-3769-42a4-b769-101979340174 service nova] Lock "bcccc277-0049-41c5-9d8c-7db1d86e1fca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:46:08 user nova-compute[75176]: DEBUG nova.compute.manager [req-0c175bf4-d924-4396-8082-99e73984ef9d req-419e3d28-3769-42a4-b769-101979340174 service nova] [instance: bcccc277-0049-41c5-9d8c-7db1d86e1fca] No waiting events found dispatching network-vif-plugged-5b8fbb7b-8b59-4923-ae3e-b7567ad90d30 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:46:08 user nova-compute[75176]: WARNING nova.compute.manager [req-0c175bf4-d924-4396-8082-99e73984ef9d req-419e3d28-3769-42a4-b769-101979340174 service nova] [instance: bcccc277-0049-41c5-9d8c-7db1d86e1fca] Received unexpected event network-vif-plugged-5b8fbb7b-8b59-4923-ae3e-b7567ad90d30 for instance with vm_state building and task_state spawning.
Nov 28 15:46:08 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:46:09 user nova-compute[75176]: DEBUG nova.compute.manager [None req-44c83a5a-6426-4d14-bf03-2f771b3c0c03 tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] [instance: bcccc277-0049-41c5-9d8c-7db1d86e1fca] Instance event wait completed in 0 seconds for  {{(pid=75176) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 15:46:09 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-44c83a5a-6426-4d14-bf03-2f771b3c0c03 tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] [instance: bcccc277-0049-41c5-9d8c-7db1d86e1fca] Guest created on hypervisor {{(pid=75176) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 15:46:09 user nova-compute[75176]: INFO nova.virt.libvirt.driver [-] [instance: bcccc277-0049-41c5-9d8c-7db1d86e1fca] Instance spawned successfully.
Nov 28 15:46:09 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-44c83a5a-6426-4d14-bf03-2f771b3c0c03 tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] [instance: bcccc277-0049-41c5-9d8c-7db1d86e1fca] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 15:46:09 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-44c83a5a-6426-4d14-bf03-2f771b3c0c03 tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] [instance: bcccc277-0049-41c5-9d8c-7db1d86e1fca] Found default for hw_cdrom_bus of ide {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:46:09 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-44c83a5a-6426-4d14-bf03-2f771b3c0c03 tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] [instance: bcccc277-0049-41c5-9d8c-7db1d86e1fca] Found default for hw_disk_bus of virtio {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:46:09 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-44c83a5a-6426-4d14-bf03-2f771b3c0c03 tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] [instance: bcccc277-0049-41c5-9d8c-7db1d86e1fca] Found default for hw_input_bus of None {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:46:09 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-44c83a5a-6426-4d14-bf03-2f771b3c0c03 tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] [instance: bcccc277-0049-41c5-9d8c-7db1d86e1fca] Found default for hw_pointer_model of None {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:46:09 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-44c83a5a-6426-4d14-bf03-2f771b3c0c03 tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] [instance: bcccc277-0049-41c5-9d8c-7db1d86e1fca] Found default for hw_video_model of virtio {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:46:09 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-44c83a5a-6426-4d14-bf03-2f771b3c0c03 tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] [instance: bcccc277-0049-41c5-9d8c-7db1d86e1fca] Found default for hw_vif_model of virtio {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:46:09 user nova-compute[75176]: INFO nova.compute.manager [None req-44c83a5a-6426-4d14-bf03-2f771b3c0c03 tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] [instance: bcccc277-0049-41c5-9d8c-7db1d86e1fca] Took 5.56 seconds to spawn the instance on the hypervisor.
Nov 28 15:46:09 user nova-compute[75176]: DEBUG nova.compute.manager [None req-44c83a5a-6426-4d14-bf03-2f771b3c0c03 tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] [instance: bcccc277-0049-41c5-9d8c-7db1d86e1fca] Checking state {{(pid=75176) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 15:46:10 user nova-compute[75176]: DEBUG nova.compute.manager [req-a9f01436-4a43-469c-a5b5-bfca8f8b593f req-84fd529d-ae42-4cf9-9a10-5ae6f0803f61 service nova] [instance: bcccc277-0049-41c5-9d8c-7db1d86e1fca] Received event network-vif-plugged-5b8fbb7b-8b59-4923-ae3e-b7567ad90d30 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:46:10 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-a9f01436-4a43-469c-a5b5-bfca8f8b593f req-84fd529d-ae42-4cf9-9a10-5ae6f0803f61 service nova] Acquiring lock "bcccc277-0049-41c5-9d8c-7db1d86e1fca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:46:10 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-a9f01436-4a43-469c-a5b5-bfca8f8b593f req-84fd529d-ae42-4cf9-9a10-5ae6f0803f61 service nova] Lock "bcccc277-0049-41c5-9d8c-7db1d86e1fca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:46:10 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-a9f01436-4a43-469c-a5b5-bfca8f8b593f req-84fd529d-ae42-4cf9-9a10-5ae6f0803f61 service nova] Lock "bcccc277-0049-41c5-9d8c-7db1d86e1fca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:46:10 user nova-compute[75176]: DEBUG nova.compute.manager [req-a9f01436-4a43-469c-a5b5-bfca8f8b593f req-84fd529d-ae42-4cf9-9a10-5ae6f0803f61 service nova] [instance: bcccc277-0049-41c5-9d8c-7db1d86e1fca] No waiting events found dispatching network-vif-plugged-5b8fbb7b-8b59-4923-ae3e-b7567ad90d30 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:46:10 user nova-compute[75176]: WARNING nova.compute.manager [req-a9f01436-4a43-469c-a5b5-bfca8f8b593f req-84fd529d-ae42-4cf9-9a10-5ae6f0803f61 service nova] [instance: bcccc277-0049-41c5-9d8c-7db1d86e1fca] Received unexpected event network-vif-plugged-5b8fbb7b-8b59-4923-ae3e-b7567ad90d30 for instance with vm_state active and task_state None.
Nov 28 15:46:10 user nova-compute[75176]: INFO nova.compute.manager [None req-44c83a5a-6426-4d14-bf03-2f771b3c0c03 tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] [instance: bcccc277-0049-41c5-9d8c-7db1d86e1fca] Took 6.48 seconds to build instance.
Nov 28 15:46:10 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-44c83a5a-6426-4d14-bf03-2f771b3c0c03 tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] Lock "bcccc277-0049-41c5-9d8c-7db1d86e1fca" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.585s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:46:10 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:46:11 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:46:11 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c165e256-0795-4d3d-82d5-af2526bf6371 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] [instance: 6b3646e6-512e-4cd6-b3c1-89438c19c408] Calling os-brick to attach iSCSI Volume {{(pid=75176) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 15:46:12 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-c165e256-0795-4d3d-82d5-af2526bf6371 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c1b8a00>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e7728674-3e10-438c-8fa0-9fc73367663f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OlvPosBa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 15:46:12 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-c165e256-0795-4d3d-82d5-af2526bf6371 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 15:46:12 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-c165e256-0795-4d3d-82d5-af2526bf6371 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 15:46:12 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-c165e256-0795-4d3d-82d5-af2526bf6371 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 15:46:12 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-c165e256-0795-4d3d-82d5-af2526bf6371 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 15:46:12 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-c165e256-0795-4d3d-82d5-af2526bf6371 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e7728674-3e10-438c-8fa0-9fc73367663f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 15:46:12 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-c165e256-0795-4d3d-82d5-af2526bf6371 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e7728674-3e10-438c-8fa0-9fc73367663f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 15:46:12 user nova-compute[75176]: INFO os_brick.initiator.connectors.iscsi [None req-c165e256-0795-4d3d-82d5-af2526bf6371 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 15:46:12 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7728674-3e10-438c-8fa0-9fc73367663f -p 172.16.0.220:3260 {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:46:12 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7728674-3e10-438c-8fa0-9fc73367663f -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:46:12 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d4aebb5-8f50-42ab-b736-025772737257]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:46:12 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-c165e256-0795-4d3d-82d5-af2526bf6371 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 15:46:12 user nova-compute[75176]:  {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:46:12 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7728674-3e10-438c-8fa0-9fc73367663f -p 172.16.0.220:3260 --interface default --op new {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:46:12 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7728674-3e10-438c-8fa0-9fc73367663f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:46:12 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[8203620a-c70f-46f0-aa0a-036d65db0a76]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e7728674-3e10-438c-8fa0-9fc73367663f] added\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:46:12 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-c165e256-0795-4d3d-82d5-af2526bf6371 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e7728674-3e10-438c-8fa0-9fc73367663f] added
Nov 28 15:46:12 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:46:12 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7728674-3e10-438c-8fa0-9fc73367663f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:46:12 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7728674-3e10-438c-8fa0-9fc73367663f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:46:12 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[1068569f-99f7-422b-8e95-25a7689e8d66]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:46:12 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-c165e256-0795-4d3d-82d5-af2526bf6371 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:46:12 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7728674-3e10-438c-8fa0-9fc73367663f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:46:12 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7728674-3e10-438c-8fa0-9fc73367663f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:46:12 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[61c72d1c-9f2d-4716-a2a8-076032818e52]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:46:12 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-c165e256-0795-4d3d-82d5-af2526bf6371 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:46:12 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7728674-3e10-438c-8fa0-9fc73367663f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OlvPosBa {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:46:12 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7728674-3e10-438c-8fa0-9fc73367663f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OlvPosBa" returned: 0 in 0.021s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:46:12 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[672e9bb8-785e-4107-8a26-52c7b2301900]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:46:12 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-c165e256-0795-4d3d-82d5-af2526bf6371 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OlvPosBa'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:46:12 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7728674-3e10-438c-8fa0-9fc73367663f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:46:12 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7728674-3e10-438c-8fa0-9fc73367663f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:46:12 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdfe1ca5-aa78-4a7c-a9eb-6f228f2ea3fc]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:46:12 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-c165e256-0795-4d3d-82d5-af2526bf6371 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:46:12 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:46:12 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:46:12 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[00eb29e2-8a11-48b4-b43d-dcbb7bd77a76]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1f5de5d-be7a-443a-9831-791c8667c09b (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69f59c18-c5e6-4afe-a74b-afe6d64d4e49 (non-flash)\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:46:12 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-c165e256-0795-4d3d-82d5-af2526bf6371 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1f5de5d-be7a-443a-9831-791c8667c09b (non-flash)
Nov 28 15:46:12 user nova-compute[75176]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24 (non-flash)
Nov 28 15:46:12 user nova-compute[75176]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d (non-flash)
Nov 28 15:46:12 user nova-compute[75176]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69f59c18-c5e6-4afe-a74b-afe6d64d4e49 (non-flash)
Nov 28 15:46:12 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:46:12 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-c165e256-0795-4d3d-82d5-af2526bf6371 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1f5de5d-be7a-443a-9831-791c8667c09b (non-flash)
Nov 28 15:46:12 user nova-compute[75176]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24 (non-flash)
Nov 28 15:46:12 user nova-compute[75176]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d (non-flash)
Nov 28 15:46:12 user nova-compute[75176]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69f59c18-c5e6-4afe-a74b-afe6d64d4e49 (non-flash)
Nov 28 15:46:12 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 15:46:12 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7728674-3e10-438c-8fa0-9fc73367663f -p 172.16.0.220:3260 --login {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:46:12 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-8952f122-14ac-432a-a4e5-a6761acd2754 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] Acquiring lock "6ab0619f-72e5-4975-ade8-53d7c0784d89" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:46:12 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-8952f122-14ac-432a-a4e5-a6761acd2754 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] Lock "6ab0619f-72e5-4975-ade8-53d7c0784d89" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:46:12 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-8952f122-14ac-432a-a4e5-a6761acd2754 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] Acquiring lock "6ab0619f-72e5-4975-ade8-53d7c0784d89-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:46:12 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-8952f122-14ac-432a-a4e5-a6761acd2754 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] Lock "6ab0619f-72e5-4975-ade8-53d7c0784d89-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:46:12 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-8952f122-14ac-432a-a4e5-a6761acd2754 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] Lock "6ab0619f-72e5-4975-ade8-53d7c0784d89-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:46:12 user nova-compute[75176]: INFO nova.compute.manager [None req-8952f122-14ac-432a-a4e5-a6761acd2754 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] [instance: 6ab0619f-72e5-4975-ade8-53d7c0784d89] Terminating instance
Nov 28 15:46:12 user nova-compute[75176]: DEBUG nova.compute.manager [None req-8952f122-14ac-432a-a4e5-a6761acd2754 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] [instance: 6ab0619f-72e5-4975-ade8-53d7c0784d89] Start destroying the instance on the hypervisor. {{(pid=75176) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 15:46:12 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7728674-3e10-438c-8fa0-9fc73367663f -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:46:12 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[3decccc4-4cbe-4a98-9e4a-da1fd2b2f779]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e7728674-3e10-438c-8fa0-9fc73367663f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e7728674-3e10-438c-8fa0-9fc73367663f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:46:12 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-c165e256-0795-4d3d-82d5-af2526bf6371 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e7728674-3e10-438c-8fa0-9fc73367663f, portal: 172.16.0.220,3260]
Nov 28 15:46:12 user nova-compute[75176]: Login to [iface: default, target: iqn.2010-10.org.openstack:e7728674-3e10-438c-8fa0-9fc73367663f, portal: 172.16.0.220,3260] successful.
Nov 28 15:46:12 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:46:12 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7728674-3e10-438c-8fa0-9fc73367663f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:46:12 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7728674-3e10-438c-8fa0-9fc73367663f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:46:12 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b33423c-c3d4-48d1-b15b-9dc4388126ac]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:46:12 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-c165e256-0795-4d3d-82d5-af2526bf6371 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:46:12 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:46:12 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:46:12 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[06300e59-4528-478a-a394-2b23bc8642ac]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1f5de5d-be7a-443a-9831-791c8667c09b (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69f59c18-c5e6-4afe-a74b-afe6d64d4e49 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7728674-3e10-438c-8fa0-9fc73367663f (non-flash)\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:46:12 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-c165e256-0795-4d3d-82d5-af2526bf6371 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1f5de5d-be7a-443a-9831-791c8667c09b (non-flash)
Nov 28 15:46:12 user nova-compute[75176]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24 (non-flash)
Nov 28 15:46:12 user nova-compute[75176]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d (non-flash)
Nov 28 15:46:12 user nova-compute[75176]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69f59c18-c5e6-4afe-a74b-afe6d64d4e49 (non-flash)
Nov 28 15:46:12 user nova-compute[75176]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7728674-3e10-438c-8fa0-9fc73367663f (non-flash)
Nov 28 15:46:12 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:46:12 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-c165e256-0795-4d3d-82d5-af2526bf6371 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1f5de5d-be7a-443a-9831-791c8667c09b (non-flash)
Nov 28 15:46:12 user nova-compute[75176]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24 (non-flash)
Nov 28 15:46:12 user nova-compute[75176]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d (non-flash)
Nov 28 15:46:12 user nova-compute[75176]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69f59c18-c5e6-4afe-a74b-afe6d64d4e49 (non-flash)
Nov 28 15:46:12 user nova-compute[75176]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7728674-3e10-438c-8fa0-9fc73367663f (non-flash)
Nov 28 15:46:12 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 15:46:12 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-c165e256-0795-4d3d-82d5-af2526bf6371 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e7728674-3e10-438c-8fa0-9fc73367663f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.370s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 15:46:12 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-c165e256-0795-4d3d-82d5-af2526bf6371 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] Connected to 172.16.0.220:3260 {{(pid=75176) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 15:46:12 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-c165e256-0795-4d3d-82d5-af2526bf6371 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] HCTL ('33', '-', '-', 0) found on session 26 with lun 0 {{(pid=75176) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 15:46:12 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-c165e256-0795-4d3d-82d5-af2526bf6371 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75176) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 15:46:12 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:46:12 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:46:12 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.029s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:46:12 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b4a2c32-2d77-4198-bb8b-7056871fbfdf]: (4, ('- - 0', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:46:12 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-c165e256-0795-4d3d-82d5-af2526bf6371 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] Searching for a device in session 26 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75176) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 15:46:12 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-c165e256-0795-4d3d-82d5-af2526bf6371 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:e7728674-3e10-438c-8fa0-9fc73367663f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OlvPosBa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75176) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 15:46:12 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:46:12 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:46:12 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:46:12 user nova-compute[75176]: DEBUG nova.compute.manager [req-00a3a3db-3971-49a3-be84-135c5174c659 req-42936450-4337-4ed3-b888-b8af6b8fa782 service nova] [instance: 6ab0619f-72e5-4975-ade8-53d7c0784d89] Received event network-vif-unplugged-63e3a2a2-51d4-4899-806d-c3222f643878 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:46:12 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-00a3a3db-3971-49a3-be84-135c5174c659 req-42936450-4337-4ed3-b888-b8af6b8fa782 service nova] Acquiring lock "6ab0619f-72e5-4975-ade8-53d7c0784d89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:46:12 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-00a3a3db-3971-49a3-be84-135c5174c659 req-42936450-4337-4ed3-b888-b8af6b8fa782 service nova] Lock "6ab0619f-72e5-4975-ade8-53d7c0784d89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:46:12 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-00a3a3db-3971-49a3-be84-135c5174c659 req-42936450-4337-4ed3-b888-b8af6b8fa782 service nova] Lock "6ab0619f-72e5-4975-ade8-53d7c0784d89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:46:12 user nova-compute[75176]: DEBUG nova.compute.manager [req-00a3a3db-3971-49a3-be84-135c5174c659 req-42936450-4337-4ed3-b888-b8af6b8fa782 service nova] [instance: 6ab0619f-72e5-4975-ade8-53d7c0784d89] No waiting events found dispatching network-vif-unplugged-63e3a2a2-51d4-4899-806d-c3222f643878 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:46:12 user nova-compute[75176]: DEBUG nova.compute.manager [req-00a3a3db-3971-49a3-be84-135c5174c659 req-42936450-4337-4ed3-b888-b8af6b8fa782 service nova] [instance: 6ab0619f-72e5-4975-ade8-53d7c0784d89] Received event network-vif-unplugged-63e3a2a2-51d4-4899-806d-c3222f643878 for instance with task_state deleting. {{(pid=75176) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 15:46:13 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:46:13 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:46:13 user nova-compute[75176]: INFO nova.virt.libvirt.driver [-] [instance: 6ab0619f-72e5-4975-ade8-53d7c0784d89] Instance destroyed successfully.
Nov 28 15:46:13 user nova-compute[75176]: DEBUG nova.objects.instance [None req-8952f122-14ac-432a-a4e5-a6761acd2754 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] Lazy-loading 'resources' on Instance uuid 6ab0619f-72e5-4975-ade8-53d7c0784d89 {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:46:13 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-8952f122-14ac-432a-a4e5-a6761acd2754 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T15:38:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1718830929',display_name='tempest-ServerStableDeviceRescueTest-server-1718830929',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1718830929',id=2,image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHSzZ12RXOTrDwh+h18L3phcCN5TGehVmYtmaLi1jyqDEQuZz0snJimoDD3Zw/Z6Ti+jmxi9CB36LPtnz2rNWaG62e3brw+uWVt5sHC24uB4mJRin9Q2z7NtWEfLWyBqdQ==',key_name='tempest-keypair-2016976293',keypairs=<?>,launch_index=0,launched_at=2023-11-28T15:43:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8fa05294c527426383c66fe58b31c825',ramdisk_id='',reservation_id='r-qn2vcowb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1490134813',owner_user_name='tempest-ServerStableDeviceRescueTest-1490134813-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T15:44:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fe7af9ff921c4fcba937dd6b3f93318d',uuid=6ab0619f-72e5-4975-ade8-53d7c0784d89,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "63e3a2a2-51d4-4899-806d-c3222f643878", "address": "fa:16:3e:4d:46:79", "network": {"id": "84bcb9a8-0292-4eed-a9eb-2a883619389c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1655598964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fa05294c527426383c66fe58b31c825", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63e3a2a2-51", "ovs_interfaceid": "63e3a2a2-51d4-4899-806d-c3222f643878", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 15:46:13 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-8952f122-14ac-432a-a4e5-a6761acd2754 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] Converting VIF {"id": "63e3a2a2-51d4-4899-806d-c3222f643878", "address": "fa:16:3e:4d:46:79", "network": {"id": "84bcb9a8-0292-4eed-a9eb-2a883619389c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1655598964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fa05294c527426383c66fe58b31c825", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63e3a2a2-51", "ovs_interfaceid": "63e3a2a2-51d4-4899-806d-c3222f643878", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:46:13 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-8952f122-14ac-432a-a4e5-a6761acd2754 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4d:46:79,bridge_name='br-int',has_traffic_filtering=True,id=63e3a2a2-51d4-4899-806d-c3222f643878,network=Network(84bcb9a8-0292-4eed-a9eb-2a883619389c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63e3a2a2-51') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:46:13 user nova-compute[75176]: DEBUG os_vif [None req-8952f122-14ac-432a-a4e5-a6761acd2754 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4d:46:79,bridge_name='br-int',has_traffic_filtering=True,id=63e3a2a2-51d4-4899-806d-c3222f643878,network=Network(84bcb9a8-0292-4eed-a9eb-2a883619389c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63e3a2a2-51') {{(pid=75176) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 15:46:13 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:46:13 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap63e3a2a2-51, bridge=br-int, if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:46:13 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:46:13 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:46:13 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:46:13 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=912c8e69-876c-454c-9c72-9831d7ded501) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:46:13 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:46:13 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:46:13 user nova-compute[75176]: INFO os_vif [None req-8952f122-14ac-432a-a4e5-a6761acd2754 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4d:46:79,bridge_name='br-int',has_traffic_filtering=True,id=63e3a2a2-51d4-4899-806d-c3222f643878,network=Network(84bcb9a8-0292-4eed-a9eb-2a883619389c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63e3a2a2-51')
Nov 28 15:46:13 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-8952f122-14ac-432a-a4e5-a6761acd2754 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] [instance: 6ab0619f-72e5-4975-ade8-53d7c0784d89] Deleting instance files /opt/stack/data/nova/instances/6ab0619f-72e5-4975-ade8-53d7c0784d89_del
Nov 28 15:46:13 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-8952f122-14ac-432a-a4e5-a6761acd2754 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] [instance: 6ab0619f-72e5-4975-ade8-53d7c0784d89] Deletion of /opt/stack/data/nova/instances/6ab0619f-72e5-4975-ade8-53d7c0784d89_del complete
Nov 28 15:46:13 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-c165e256-0795-4d3d-82d5-af2526bf6371 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.419s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 15:46:13 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-c165e256-0795-4d3d-82d5-af2526bf6371 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] <== connect_volume: return (1421ms) {'type': 'block', 'scsi_wwn': '26362353930386337', 'path': '/dev/sdb'} {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 15:46:13 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c165e256-0795-4d3d-82d5-af2526bf6371 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] [instance: 6b3646e6-512e-4cd6-b3c1-89438c19c408] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26362353930386337', 'path': '/dev/sdb'} {{(pid=75176) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 15:46:13 user nova-compute[75176]: INFO nova.compute.manager [None req-8952f122-14ac-432a-a4e5-a6761acd2754 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] [instance: 6ab0619f-72e5-4975-ade8-53d7c0784d89] Took 1.18 seconds to destroy the instance on the hypervisor.
Nov 28 15:46:13 user nova-compute[75176]: DEBUG oslo.service.loopingcall [None req-8952f122-14ac-432a-a4e5-a6761acd2754 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75176) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 15:46:13 user nova-compute[75176]: DEBUG nova.compute.manager [-] [instance: 6ab0619f-72e5-4975-ade8-53d7c0784d89] Deallocating network for instance {{(pid=75176) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 15:46:13 user nova-compute[75176]: DEBUG nova.network.neutron [-] [instance: 6ab0619f-72e5-4975-ade8-53d7c0784d89] deallocate_for_instance() {{(pid=75176) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 15:46:13 user nova-compute[75176]: DEBUG nova.objects.instance [None req-c165e256-0795-4d3d-82d5-af2526bf6371 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] Lazy-loading 'flavor' on Instance uuid 6b3646e6-512e-4cd6-b3c1-89438c19c408 {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:46:13 user nova-compute[75176]: DEBUG nova.virt.libvirt.guest [None req-c165e256-0795-4d3d-82d5-af2526bf6371 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 15:46:13 user nova-compute[75176]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 15:46:13 user nova-compute[75176]:   <source dev="/dev/sdb"/>
Nov 28 15:46:13 user nova-compute[75176]:   <target dev="vdb" bus="virtio"/>
Nov 28 15:46:13 user nova-compute[75176]:   <serial>e7728674-3e10-438c-8fa0-9fc73367663f</serial>
Nov 28 15:46:13 user nova-compute[75176]: </disk>
Nov 28 15:46:13 user nova-compute[75176]:  {{(pid=75176) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 15:46:13 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:46:13 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-c165e256-0795-4d3d-82d5-af2526bf6371 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] No BDM found with device name vda, not building metadata. {{(pid=75176) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 15:46:13 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-c165e256-0795-4d3d-82d5-af2526bf6371 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75176) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 15:46:13 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-c165e256-0795-4d3d-82d5-af2526bf6371 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] No VIF found with MAC fa:16:3e:42:3e:fc, not building metadata {{(pid=75176) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 15:46:14 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-c165e256-0795-4d3d-82d5-af2526bf6371 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] Lock "6b3646e6-512e-4cd6-b3c1-89438c19c408" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.535s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:46:14 user nova-compute[75176]: DEBUG nova.network.neutron [-] [instance: 6ab0619f-72e5-4975-ade8-53d7c0784d89] Updating instance_info_cache with network_info: [] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:46:14 user nova-compute[75176]: INFO nova.compute.manager [-] [instance: 6ab0619f-72e5-4975-ade8-53d7c0784d89] Took 1.18 seconds to deallocate network for instance.
Nov 28 15:46:14 user nova-compute[75176]: DEBUG nova.compute.manager [req-fa473cdd-4c7c-4885-810c-4f3ab5809686 req-f196e39c-4a49-4326-bee7-c86f3f16753d service nova] [instance: 6ab0619f-72e5-4975-ade8-53d7c0784d89] Received event network-vif-plugged-63e3a2a2-51d4-4899-806d-c3222f643878 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:46:14 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-fa473cdd-4c7c-4885-810c-4f3ab5809686 req-f196e39c-4a49-4326-bee7-c86f3f16753d service nova] Acquiring lock "6ab0619f-72e5-4975-ade8-53d7c0784d89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:46:14 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-fa473cdd-4c7c-4885-810c-4f3ab5809686 req-f196e39c-4a49-4326-bee7-c86f3f16753d service nova] Lock "6ab0619f-72e5-4975-ade8-53d7c0784d89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:46:14 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-fa473cdd-4c7c-4885-810c-4f3ab5809686 req-f196e39c-4a49-4326-bee7-c86f3f16753d service nova] Lock "6ab0619f-72e5-4975-ade8-53d7c0784d89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:46:14 user nova-compute[75176]: DEBUG nova.compute.manager [req-fa473cdd-4c7c-4885-810c-4f3ab5809686 req-f196e39c-4a49-4326-bee7-c86f3f16753d service nova] [instance: 6ab0619f-72e5-4975-ade8-53d7c0784d89] No waiting events found dispatching network-vif-plugged-63e3a2a2-51d4-4899-806d-c3222f643878 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:46:14 user nova-compute[75176]: WARNING nova.compute.manager [req-fa473cdd-4c7c-4885-810c-4f3ab5809686 req-f196e39c-4a49-4326-bee7-c86f3f16753d service nova] [instance: 6ab0619f-72e5-4975-ade8-53d7c0784d89] Received unexpected event network-vif-plugged-63e3a2a2-51d4-4899-806d-c3222f643878 for instance with vm_state active and task_state deleting.
Nov 28 15:46:14 user nova-compute[75176]: DEBUG nova.compute.manager [req-fa473cdd-4c7c-4885-810c-4f3ab5809686 req-f196e39c-4a49-4326-bee7-c86f3f16753d service nova] [instance: 6ab0619f-72e5-4975-ade8-53d7c0784d89] Received event network-vif-deleted-63e3a2a2-51d4-4899-806d-c3222f643878 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:46:14 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-8952f122-14ac-432a-a4e5-a6761acd2754 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:46:14 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-8952f122-14ac-432a-a4e5-a6761acd2754 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:46:15 user nova-compute[75176]: DEBUG nova.compute.manager [req-00feadbd-eb08-4d8f-933b-0e21cf90d4d1 req-033a14c9-458f-4813-b689-7370d944e77d service nova] [instance: 6ed37390-f6a6-4cf7-8cab-b818f702083d] Received event network-changed-04fa7f72-709c-42c1-be40-0cb4cbe31686 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:46:15 user nova-compute[75176]: DEBUG nova.compute.manager [req-00feadbd-eb08-4d8f-933b-0e21cf90d4d1 req-033a14c9-458f-4813-b689-7370d944e77d service nova] [instance: 6ed37390-f6a6-4cf7-8cab-b818f702083d] Refreshing instance network info cache due to event network-changed-04fa7f72-709c-42c1-be40-0cb4cbe31686. {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 15:46:15 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-00feadbd-eb08-4d8f-933b-0e21cf90d4d1 req-033a14c9-458f-4813-b689-7370d944e77d service nova] Acquiring lock "refresh_cache-6ed37390-f6a6-4cf7-8cab-b818f702083d" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:46:15 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-00feadbd-eb08-4d8f-933b-0e21cf90d4d1 req-033a14c9-458f-4813-b689-7370d944e77d service nova] Acquired lock "refresh_cache-6ed37390-f6a6-4cf7-8cab-b818f702083d" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:46:15 user nova-compute[75176]: DEBUG nova.network.neutron [req-00feadbd-eb08-4d8f-933b-0e21cf90d4d1 req-033a14c9-458f-4813-b689-7370d944e77d service nova] [instance: 6ed37390-f6a6-4cf7-8cab-b818f702083d] Refreshing network info cache for port 04fa7f72-709c-42c1-be40-0cb4cbe31686 {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 15:46:15 user nova-compute[75176]: DEBUG nova.compute.provider_tree [None req-8952f122-14ac-432a-a4e5-a6761acd2754 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] Inventory has not changed in ProviderTree for provider: b37848d8-f401-4155-a029-b0ffa09ff85b {{(pid=75176) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 15:46:15 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-8952f122-14ac-432a-a4e5-a6761acd2754 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] Inventory has not changed for provider b37848d8-f401-4155-a029-b0ffa09ff85b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75176) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 15:46:15 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-8952f122-14ac-432a-a4e5-a6761acd2754 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.523s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:46:15 user nova-compute[75176]: INFO nova.scheduler.client.report [None req-8952f122-14ac-432a-a4e5-a6761acd2754 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] Deleted allocations for instance 6ab0619f-72e5-4975-ade8-53d7c0784d89
Nov 28 15:46:15 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-9ff9f3fa-368a-4cfb-af6e-e2878c625c40 tempest-TestVolumeSwap-440541491 tempest-TestVolumeSwap-440541491-project-admin] Acquiring lock "6b3646e6-512e-4cd6-b3c1-89438c19c408" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:46:15 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-9ff9f3fa-368a-4cfb-af6e-e2878c625c40 tempest-TestVolumeSwap-440541491 tempest-TestVolumeSwap-440541491-project-admin] Lock "6b3646e6-512e-4cd6-b3c1-89438c19c408" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:46:15 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-8952f122-14ac-432a-a4e5-a6761acd2754 tempest-ServerStableDeviceRescueTest-1490134813 tempest-ServerStableDeviceRescueTest-1490134813-project-member] Lock "6ab0619f-72e5-4975-ade8-53d7c0784d89" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.146s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:46:15 user nova-compute[75176]: DEBUG os_brick.utils [None req-9ff9f3fa-368a-4cfb-af6e-e2878c625c40 tempest-TestVolumeSwap-440541491 tempest-TestVolumeSwap-440541491-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 15:46:15 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:46:15 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:46:15 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ed75424-7920-493b-992e-665898361969]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:edc924a949b2\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:46:15 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:46:15 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.025s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:46:15 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[329ccdf9-7d46-40fb-9786-a4a603768b61]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:46:15 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:46:15 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:46:15 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ae34f1e-b37b-42dd-a837-ff45893f8dbb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:46:15 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8e78e05-b495-48f0-b8de-8ab72bdbe52f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:46:15 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-9ff9f3fa-368a-4cfb-af6e-e2878c625c40 tempest-TestVolumeSwap-440541491 tempest-TestVolumeSwap-440541491-project-admin] Running cmd (subprocess): nvme version {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:46:15 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-9ff9f3fa-368a-4cfb-af6e-e2878c625c40 tempest-TestVolumeSwap-440541491 tempest-TestVolumeSwap-440541491-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 15:46:15 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9ff9f3fa-368a-4cfb-af6e-e2878c625c40 tempest-TestVolumeSwap-440541491 tempest-TestVolumeSwap-440541491-project-admin] nvme not present on system {{(pid=75176) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 15:46:15 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:46:15 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 15:46:15 user nova-compute[75176]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 15:46:15 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c0507f6-691f-4db7-bfd9-3593a54fbb06]: (4, '') {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:46:15 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.lightos [None req-9ff9f3fa-368a-4cfb-af6e-e2878c625c40 tempest-TestVolumeSwap-440541491 tempest-TestVolumeSwap-440541491-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75176) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 15:46:15 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.lightos [None req-9ff9f3fa-368a-4cfb-af6e-e2878c625c40 tempest-TestVolumeSwap-440541491 tempest-TestVolumeSwap-440541491-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75176) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 15:46:15 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.lightos [None req-9ff9f3fa-368a-4cfb-af6e-e2878c625c40 tempest-TestVolumeSwap-440541491 tempest-TestVolumeSwap-440541491-project-admin] LIGHTOS: no hostnqn found. {{(pid=75176) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 15:46:15 user nova-compute[75176]: DEBUG os_brick.utils [None req-9ff9f3fa-368a-4cfb-af6e-e2878c625c40 tempest-TestVolumeSwap-440541491 tempest-TestVolumeSwap-440541491-project-admin] <== get_connector_properties: return (167ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:edc924a949b2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 15:46:15 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-f448de42-366b-42ff-96c4-5677de052211 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Acquiring lock "6ed37390-f6a6-4cf7-8cab-b818f702083d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:46:15 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-f448de42-366b-42ff-96c4-5677de052211 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Lock "6ed37390-f6a6-4cf7-8cab-b818f702083d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:46:15 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-f448de42-366b-42ff-96c4-5677de052211 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Acquiring lock "6ed37390-f6a6-4cf7-8cab-b818f702083d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:46:15 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-f448de42-366b-42ff-96c4-5677de052211 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Lock "6ed37390-f6a6-4cf7-8cab-b818f702083d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:46:15 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-f448de42-366b-42ff-96c4-5677de052211 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Lock "6ed37390-f6a6-4cf7-8cab-b818f702083d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:46:15 user nova-compute[75176]: INFO nova.compute.manager [None req-f448de42-366b-42ff-96c4-5677de052211 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] [instance: 6ed37390-f6a6-4cf7-8cab-b818f702083d] Terminating instance
Nov 28 15:46:15 user nova-compute[75176]: DEBUG nova.compute.manager [None req-f448de42-366b-42ff-96c4-5677de052211 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] [instance: 6ed37390-f6a6-4cf7-8cab-b818f702083d] Start destroying the instance on the hypervisor. {{(pid=75176) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 15:46:15 user nova-compute[75176]: DEBUG nova.network.neutron [req-00feadbd-eb08-4d8f-933b-0e21cf90d4d1 req-033a14c9-458f-4813-b689-7370d944e77d service nova] [instance: 6ed37390-f6a6-4cf7-8cab-b818f702083d] Updated VIF entry in instance network info cache for port 04fa7f72-709c-42c1-be40-0cb4cbe31686. {{(pid=75176) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 15:46:15 user nova-compute[75176]: DEBUG nova.network.neutron [req-00feadbd-eb08-4d8f-933b-0e21cf90d4d1 req-033a14c9-458f-4813-b689-7370d944e77d service nova] [instance: 6ed37390-f6a6-4cf7-8cab-b818f702083d] Updating instance_info_cache with network_info: [{"id": "04fa7f72-709c-42c1-be40-0cb4cbe31686", "address": "fa:16:3e:23:3a:a2", "network": {"id": "7ab60343-57be-427d-9037-6ecf0eaf5de0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1508138843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a194f81f7e104be7940d1d05f71bbad9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04fa7f72-70", "ovs_interfaceid": "04fa7f72-709c-42c1-be40-0cb4cbe31686", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:46:15 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-00feadbd-eb08-4d8f-933b-0e21cf90d4d1 req-033a14c9-458f-4813-b689-7370d944e77d service nova] Releasing lock "refresh_cache-6ed37390-f6a6-4cf7-8cab-b818f702083d" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:46:15 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:46:15 user nova-compute[75176]: INFO nova.compute.manager [None req-9ff9f3fa-368a-4cfb-af6e-e2878c625c40 tempest-TestVolumeSwap-440541491 tempest-TestVolumeSwap-440541491-project-admin] [instance: 6b3646e6-512e-4cd6-b3c1-89438c19c408] Swapping volume e7728674-3e10-438c-8fa0-9fc73367663f for 070272de-513d-48de-975c-17e6ce9e5007
Nov 28 15:46:15 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:46:16 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:46:16 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:46:16 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:46:16 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:46:16 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:46:16 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:46:16 user nova-compute[75176]: INFO nova.virt.libvirt.driver [-] [instance: 6ed37390-f6a6-4cf7-8cab-b818f702083d] Instance destroyed successfully.
Nov 28 15:46:16 user nova-compute[75176]: DEBUG nova.objects.instance [None req-f448de42-366b-42ff-96c4-5677de052211 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Lazy-loading 'resources' on Instance uuid 6ed37390-f6a6-4cf7-8cab-b818f702083d {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:46:16 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:46:16 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-f448de42-366b-42ff-96c4-5677de052211 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T15:44:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-274267513',display_name='tempest-AttachVolumeNegativeTest-server-274267513',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-274267513',id=19,image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAkNJbhG7OS8YUjZwKSzzn0etNTTWZ3rJatxfYf5eELR18+aNHYRB8hLBtJDOgC4axsAY2RyUlJPOj1x6r5keWDSSYZQhJQUX63bdyFz9VH/r8/Bb3ijNVg9IdiPL2g1ow==',key_name='tempest-keypair-1692252659',keypairs=<?>,launch_index=0,launched_at=2023-11-28T15:44:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a194f81f7e104be7940d1d05f71bbad9',ramdisk_id='',reservation_id='r-u9wz9cn3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1403590572',owner_user_name='tempest-AttachVolumeNegativeTest-1403590572-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T15:44:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f9a745552d974e05a9e0befc68eb7f6e',uuid=6ed37390-f6a6-4cf7-8cab-b818f702083d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "04fa7f72-709c-42c1-be40-0cb4cbe31686", "address": "fa:16:3e:23:3a:a2", "network": {"id": "7ab60343-57be-427d-9037-6ecf0eaf5de0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1508138843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a194f81f7e104be7940d1d05f71bbad9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04fa7f72-70", "ovs_interfaceid": "04fa7f72-709c-42c1-be40-0cb4cbe31686", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 15:46:16 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-f448de42-366b-42ff-96c4-5677de052211 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Converting VIF {"id": "04fa7f72-709c-42c1-be40-0cb4cbe31686", "address": "fa:16:3e:23:3a:a2", "network": {"id": "7ab60343-57be-427d-9037-6ecf0eaf5de0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1508138843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a194f81f7e104be7940d1d05f71bbad9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04fa7f72-70", "ovs_interfaceid": "04fa7f72-709c-42c1-be40-0cb4cbe31686", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:46:16 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-f448de42-366b-42ff-96c4-5677de052211 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:3a:a2,bridge_name='br-int',has_traffic_filtering=True,id=04fa7f72-709c-42c1-be40-0cb4cbe31686,network=Network(7ab60343-57be-427d-9037-6ecf0eaf5de0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04fa7f72-70') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:46:16 user nova-compute[75176]: DEBUG os_vif [None req-f448de42-366b-42ff-96c4-5677de052211 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:3a:a2,bridge_name='br-int',has_traffic_filtering=True,id=04fa7f72-709c-42c1-be40-0cb4cbe31686,network=Network(7ab60343-57be-427d-9037-6ecf0eaf5de0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04fa7f72-70') {{(pid=75176) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 15:46:16 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:46:16 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap04fa7f72-70, bridge=br-int, if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:46:16 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:46:16 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:46:16 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=587a60dd-6e4e-4327-8dbd-74922ebce7b3) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:46:16 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:46:16 user nova-compute[75176]: INFO os_vif [None req-f448de42-366b-42ff-96c4-5677de052211 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:3a:a2,bridge_name='br-int',has_traffic_filtering=True,id=04fa7f72-709c-42c1-be40-0cb4cbe31686,network=Network(7ab60343-57be-427d-9037-6ecf0eaf5de0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04fa7f72-70')
Nov 28 15:46:16 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-f448de42-366b-42ff-96c4-5677de052211 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] [instance: 6ed37390-f6a6-4cf7-8cab-b818f702083d] Deleting instance files /opt/stack/data/nova/instances/6ed37390-f6a6-4cf7-8cab-b818f702083d_del
Nov 28 15:46:16 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-f448de42-366b-42ff-96c4-5677de052211 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] [instance: 6ed37390-f6a6-4cf7-8cab-b818f702083d] Deletion of /opt/stack/data/nova/instances/6ed37390-f6a6-4cf7-8cab-b818f702083d_del complete
Nov 28 15:46:16 user nova-compute[75176]: INFO nova.compute.manager [None req-f448de42-366b-42ff-96c4-5677de052211 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] [instance: 6ed37390-f6a6-4cf7-8cab-b818f702083d] Took 0.94 seconds to destroy the instance on the hypervisor.
Nov 28 15:46:16 user nova-compute[75176]: DEBUG oslo.service.loopingcall [None req-f448de42-366b-42ff-96c4-5677de052211 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75176) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 15:46:16 user nova-compute[75176]: DEBUG nova.compute.manager [-] [instance: 6ed37390-f6a6-4cf7-8cab-b818f702083d] Deallocating network for instance {{(pid=75176) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 15:46:16 user nova-compute[75176]: DEBUG nova.network.neutron [-] [instance: 6ed37390-f6a6-4cf7-8cab-b818f702083d] deallocate_for_instance() {{(pid=75176) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 15:46:16 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:46:16 user nova-compute[75176]: DEBUG nova.compute.manager [req-f638a8ec-ff5c-4e98-bc09-1a2180cd3753 req-6c91cc93-3435-48cc-b55b-6c19622468aa service nova] [instance: 6ed37390-f6a6-4cf7-8cab-b818f702083d] Received event network-vif-unplugged-04fa7f72-709c-42c1-be40-0cb4cbe31686 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:46:16 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-f638a8ec-ff5c-4e98-bc09-1a2180cd3753 req-6c91cc93-3435-48cc-b55b-6c19622468aa service nova] Acquiring lock "6ed37390-f6a6-4cf7-8cab-b818f702083d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:46:16 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-f638a8ec-ff5c-4e98-bc09-1a2180cd3753 req-6c91cc93-3435-48cc-b55b-6c19622468aa service nova] Lock "6ed37390-f6a6-4cf7-8cab-b818f702083d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:46:16 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-f638a8ec-ff5c-4e98-bc09-1a2180cd3753 req-6c91cc93-3435-48cc-b55b-6c19622468aa service nova] Lock "6ed37390-f6a6-4cf7-8cab-b818f702083d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:46:16 user nova-compute[75176]: DEBUG nova.compute.manager [req-f638a8ec-ff5c-4e98-bc09-1a2180cd3753 req-6c91cc93-3435-48cc-b55b-6c19622468aa service nova] [instance: 6ed37390-f6a6-4cf7-8cab-b818f702083d] No waiting events found dispatching network-vif-unplugged-04fa7f72-709c-42c1-be40-0cb4cbe31686 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:46:16 user nova-compute[75176]: DEBUG nova.compute.manager [req-f638a8ec-ff5c-4e98-bc09-1a2180cd3753 req-6c91cc93-3435-48cc-b55b-6c19622468aa service nova] [instance: 6ed37390-f6a6-4cf7-8cab-b818f702083d] Received event network-vif-unplugged-04fa7f72-709c-42c1-be40-0cb4cbe31686 for instance with task_state deleting. {{(pid=75176) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 15:46:16 user nova-compute[75176]: DEBUG nova.compute.manager [req-f638a8ec-ff5c-4e98-bc09-1a2180cd3753 req-6c91cc93-3435-48cc-b55b-6c19622468aa service nova] [instance: 6ed37390-f6a6-4cf7-8cab-b818f702083d] Received event network-vif-plugged-04fa7f72-709c-42c1-be40-0cb4cbe31686 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:46:16 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-f638a8ec-ff5c-4e98-bc09-1a2180cd3753 req-6c91cc93-3435-48cc-b55b-6c19622468aa service nova] Acquiring lock "6ed37390-f6a6-4cf7-8cab-b818f702083d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:46:16 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-f638a8ec-ff5c-4e98-bc09-1a2180cd3753 req-6c91cc93-3435-48cc-b55b-6c19622468aa service nova] Lock "6ed37390-f6a6-4cf7-8cab-b818f702083d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:46:16 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-f638a8ec-ff5c-4e98-bc09-1a2180cd3753 req-6c91cc93-3435-48cc-b55b-6c19622468aa service nova] Lock "6ed37390-f6a6-4cf7-8cab-b818f702083d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:46:16 user nova-compute[75176]: DEBUG nova.compute.manager [req-f638a8ec-ff5c-4e98-bc09-1a2180cd3753 req-6c91cc93-3435-48cc-b55b-6c19622468aa service nova] [instance: 6ed37390-f6a6-4cf7-8cab-b818f702083d] No waiting events found dispatching network-vif-plugged-04fa7f72-709c-42c1-be40-0cb4cbe31686 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:46:16 user nova-compute[75176]: WARNING nova.compute.manager [req-f638a8ec-ff5c-4e98-bc09-1a2180cd3753 req-6c91cc93-3435-48cc-b55b-6c19622468aa service nova] [instance: 6ed37390-f6a6-4cf7-8cab-b818f702083d] Received unexpected event network-vif-plugged-04fa7f72-709c-42c1-be40-0cb4cbe31686 for instance with vm_state active and task_state deleting.
Nov 28 15:46:17 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:46:17 user nova-compute[75176]: DEBUG nova.network.neutron [-] [instance: 6ed37390-f6a6-4cf7-8cab-b818f702083d] Updating instance_info_cache with network_info: [] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:46:17 user nova-compute[75176]: INFO nova.compute.manager [-] [instance: 6ed37390-f6a6-4cf7-8cab-b818f702083d] Took 0.81 seconds to deallocate network for instance.
Nov 28 15:46:17 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-f448de42-366b-42ff-96c4-5677de052211 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:46:17 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-f448de42-366b-42ff-96c4-5677de052211 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:46:17 user nova-compute[75176]: DEBUG nova.compute.provider_tree [None req-f448de42-366b-42ff-96c4-5677de052211 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Inventory has not changed in ProviderTree for provider: b37848d8-f401-4155-a029-b0ffa09ff85b {{(pid=75176) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 15:46:17 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-f448de42-366b-42ff-96c4-5677de052211 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Inventory has not changed for provider b37848d8-f401-4155-a029-b0ffa09ff85b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75176) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 15:46:17 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-f448de42-366b-42ff-96c4-5677de052211 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.377s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:46:17 user nova-compute[75176]: INFO nova.scheduler.client.report [None req-f448de42-366b-42ff-96c4-5677de052211 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Deleted allocations for instance 6ed37390-f6a6-4cf7-8cab-b818f702083d
Nov 28 15:46:17 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-f448de42-366b-42ff-96c4-5677de052211 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Lock "6ed37390-f6a6-4cf7-8cab-b818f702083d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.335s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:46:18 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:46:18 user nova-compute[75176]: DEBUG nova.compute.manager [req-0ad3ac54-edfb-434f-acdc-dddd1d902603 req-2605654e-0ba9-4d25-a955-fbd465457881 service nova] [instance: 6ed37390-f6a6-4cf7-8cab-b818f702083d] Received event network-vif-deleted-04fa7f72-709c-42c1-be40-0cb4cbe31686 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:46:18 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:46:21 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:46:21 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:46:23 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:46:24 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-52f7d927-1c7a-4e53-8488-0f59f3fa6d7b tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Acquiring lock "0e465c9f-e8ab-4a28-bf74-2936a272a0e2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:46:24 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-52f7d927-1c7a-4e53-8488-0f59f3fa6d7b tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Lock "0e465c9f-e8ab-4a28-bf74-2936a272a0e2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:46:24 user nova-compute[75176]: DEBUG nova.compute.manager [None req-52f7d927-1c7a-4e53-8488-0f59f3fa6d7b tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] [instance: 0e465c9f-e8ab-4a28-bf74-2936a272a0e2] Starting instance... {{(pid=75176) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 15:46:24 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-52f7d927-1c7a-4e53-8488-0f59f3fa6d7b tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:46:24 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-52f7d927-1c7a-4e53-8488-0f59f3fa6d7b tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:46:24 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-52f7d927-1c7a-4e53-8488-0f59f3fa6d7b tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75176) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 15:46:24 user nova-compute[75176]: INFO nova.compute.claims [None req-52f7d927-1c7a-4e53-8488-0f59f3fa6d7b tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] [instance: 0e465c9f-e8ab-4a28-bf74-2936a272a0e2] Claim successful on node user
Nov 28 15:46:24 user nova-compute[75176]: DEBUG nova.compute.provider_tree [None req-52f7d927-1c7a-4e53-8488-0f59f3fa6d7b tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Inventory has not changed in ProviderTree for provider: b37848d8-f401-4155-a029-b0ffa09ff85b {{(pid=75176) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 15:46:24 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-52f7d927-1c7a-4e53-8488-0f59f3fa6d7b tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Inventory has not changed for provider b37848d8-f401-4155-a029-b0ffa09ff85b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75176) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 15:46:24 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-52f7d927-1c7a-4e53-8488-0f59f3fa6d7b tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.564s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:46:24 user nova-compute[75176]: DEBUG nova.compute.manager [None req-52f7d927-1c7a-4e53-8488-0f59f3fa6d7b tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] [instance: 0e465c9f-e8ab-4a28-bf74-2936a272a0e2] Start building networks asynchronously for instance. {{(pid=75176) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 15:46:25 user nova-compute[75176]: DEBUG nova.compute.manager [None req-52f7d927-1c7a-4e53-8488-0f59f3fa6d7b tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] [instance: 0e465c9f-e8ab-4a28-bf74-2936a272a0e2] Allocating IP information in the background. {{(pid=75176) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 15:46:25 user nova-compute[75176]: DEBUG nova.network.neutron [None req-52f7d927-1c7a-4e53-8488-0f59f3fa6d7b tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] [instance: 0e465c9f-e8ab-4a28-bf74-2936a272a0e2] allocate_for_instance() {{(pid=75176) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 15:46:25 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-52f7d927-1c7a-4e53-8488-0f59f3fa6d7b tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] [instance: 0e465c9f-e8ab-4a28-bf74-2936a272a0e2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 15:46:25 user nova-compute[75176]: DEBUG nova.compute.manager [None req-52f7d927-1c7a-4e53-8488-0f59f3fa6d7b tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] [instance: 0e465c9f-e8ab-4a28-bf74-2936a272a0e2] Start building block device mappings for instance. {{(pid=75176) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 15:46:25 user nova-compute[75176]: DEBUG nova.policy [None req-52f7d927-1c7a-4e53-8488-0f59f3fa6d7b tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3146d6b1e7324ebaa62ade09f1d1c68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169fdaea89d4431aa6adacdbb76f3546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75176) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 15:46:25 user nova-compute[75176]: DEBUG nova.compute.manager [None req-52f7d927-1c7a-4e53-8488-0f59f3fa6d7b tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] [instance: 0e465c9f-e8ab-4a28-bf74-2936a272a0e2] Start spawning the instance on the hypervisor. {{(pid=75176) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 15:46:25 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-52f7d927-1c7a-4e53-8488-0f59f3fa6d7b tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] [instance: 0e465c9f-e8ab-4a28-bf74-2936a272a0e2] Creating instance directory {{(pid=75176) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 15:46:25 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-52f7d927-1c7a-4e53-8488-0f59f3fa6d7b tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] [instance: 0e465c9f-e8ab-4a28-bf74-2936a272a0e2] Creating image(s)
Nov 28 15:46:25 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-52f7d927-1c7a-4e53-8488-0f59f3fa6d7b tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Acquiring lock "/opt/stack/data/nova/instances/0e465c9f-e8ab-4a28-bf74-2936a272a0e2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:46:25 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-52f7d927-1c7a-4e53-8488-0f59f3fa6d7b tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Lock "/opt/stack/data/nova/instances/0e465c9f-e8ab-4a28-bf74-2936a272a0e2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:46:25 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-52f7d927-1c7a-4e53-8488-0f59f3fa6d7b tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Lock "/opt/stack/data/nova/instances/0e465c9f-e8ab-4a28-bf74-2936a272a0e2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:46:25 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-52f7d927-1c7a-4e53-8488-0f59f3fa6d7b tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:46:25 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-52f7d927-1c7a-4e53-8488-0f59f3fa6d7b tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json" returned: 0 in 0.190s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:46:25 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-52f7d927-1c7a-4e53-8488-0f59f3fa6d7b tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Acquiring lock "5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:46:25 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-52f7d927-1c7a-4e53-8488-0f59f3fa6d7b tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Lock "5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:46:25 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-52f7d927-1c7a-4e53-8488-0f59f3fa6d7b tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:46:25 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-52f7d927-1c7a-4e53-8488-0f59f3fa6d7b tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json" returned: 0 in 0.191s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:46:25 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-52f7d927-1c7a-4e53-8488-0f59f3fa6d7b tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2,backing_fmt=raw /opt/stack/data/nova/instances/0e465c9f-e8ab-4a28-bf74-2936a272a0e2/disk 1073741824 {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:46:25 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-52f7d927-1c7a-4e53-8488-0f59f3fa6d7b tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2,backing_fmt=raw /opt/stack/data/nova/instances/0e465c9f-e8ab-4a28-bf74-2936a272a0e2/disk 1073741824" returned: 0 in 0.063s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:46:25 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-52f7d927-1c7a-4e53-8488-0f59f3fa6d7b tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Lock "5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.263s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:46:25 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-52f7d927-1c7a-4e53-8488-0f59f3fa6d7b tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:46:25 user nova-compute[75176]: DEBUG nova.network.neutron [None req-52f7d927-1c7a-4e53-8488-0f59f3fa6d7b tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] [instance: 0e465c9f-e8ab-4a28-bf74-2936a272a0e2] Successfully created port: 86effed2-558e-4427-82be-761ca28e6d8c {{(pid=75176) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 15:46:25 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-52f7d927-1c7a-4e53-8488-0f59f3fa6d7b tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json" returned: 0 in 0.209s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:46:25 user nova-compute[75176]: DEBUG nova.virt.disk.api [None req-52f7d927-1c7a-4e53-8488-0f59f3fa6d7b tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0e465c9f-e8ab-4a28-bf74-2936a272a0e2/disk. size=1073741824 {{(pid=75176) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 15:46:25 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-52f7d927-1c7a-4e53-8488-0f59f3fa6d7b tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e465c9f-e8ab-4a28-bf74-2936a272a0e2/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:46:26 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-52f7d927-1c7a-4e53-8488-0f59f3fa6d7b tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e465c9f-e8ab-4a28-bf74-2936a272a0e2/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:46:26 user nova-compute[75176]: DEBUG nova.virt.disk.api [None req-52f7d927-1c7a-4e53-8488-0f59f3fa6d7b tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Cannot resize image /opt/stack/data/nova/instances/0e465c9f-e8ab-4a28-bf74-2936a272a0e2/disk to a smaller size. {{(pid=75176) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 15:46:26 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-52f7d927-1c7a-4e53-8488-0f59f3fa6d7b tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] [instance: 0e465c9f-e8ab-4a28-bf74-2936a272a0e2] Created local disks {{(pid=75176) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 15:46:26 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-52f7d927-1c7a-4e53-8488-0f59f3fa6d7b tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] [instance: 0e465c9f-e8ab-4a28-bf74-2936a272a0e2] Ensure instance console log exists: /opt/stack/data/nova/instances/0e465c9f-e8ab-4a28-bf74-2936a272a0e2/console.log {{(pid=75176) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 15:46:26 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-52f7d927-1c7a-4e53-8488-0f59f3fa6d7b tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:46:26 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-52f7d927-1c7a-4e53-8488-0f59f3fa6d7b tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:46:26 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-52f7d927-1c7a-4e53-8488-0f59f3fa6d7b tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:46:26 user nova-compute[75176]: DEBUG nova.network.neutron [None req-52f7d927-1c7a-4e53-8488-0f59f3fa6d7b tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] [instance: 0e465c9f-e8ab-4a28-bf74-2936a272a0e2] Successfully updated port: 86effed2-558e-4427-82be-761ca28e6d8c {{(pid=75176) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 15:46:26 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-52f7d927-1c7a-4e53-8488-0f59f3fa6d7b tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Acquiring lock "refresh_cache-0e465c9f-e8ab-4a28-bf74-2936a272a0e2" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:46:26 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-52f7d927-1c7a-4e53-8488-0f59f3fa6d7b tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Acquired lock "refresh_cache-0e465c9f-e8ab-4a28-bf74-2936a272a0e2" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:46:26 user nova-compute[75176]: DEBUG nova.network.neutron [None req-52f7d927-1c7a-4e53-8488-0f59f3fa6d7b tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] [instance: 0e465c9f-e8ab-4a28-bf74-2936a272a0e2] Building network info cache for instance {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 15:46:26 user nova-compute[75176]: DEBUG nova.compute.manager [req-e8761536-7a7a-46b2-99a9-3ab70987ef4e req-dc8381a3-6c50-4845-8eec-604ad4d19ac8 service nova] [instance: 0e465c9f-e8ab-4a28-bf74-2936a272a0e2] Received event network-changed-86effed2-558e-4427-82be-761ca28e6d8c {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:46:26 user nova-compute[75176]: DEBUG nova.compute.manager [req-e8761536-7a7a-46b2-99a9-3ab70987ef4e req-dc8381a3-6c50-4845-8eec-604ad4d19ac8 service nova] [instance: 0e465c9f-e8ab-4a28-bf74-2936a272a0e2] Refreshing instance network info cache due to event network-changed-86effed2-558e-4427-82be-761ca28e6d8c. {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 15:46:26 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-e8761536-7a7a-46b2-99a9-3ab70987ef4e req-dc8381a3-6c50-4845-8eec-604ad4d19ac8 service nova] Acquiring lock "refresh_cache-0e465c9f-e8ab-4a28-bf74-2936a272a0e2" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:46:26 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:46:26 user nova-compute[75176]: DEBUG nova.network.neutron [None req-52f7d927-1c7a-4e53-8488-0f59f3fa6d7b tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] [instance: 0e465c9f-e8ab-4a28-bf74-2936a272a0e2] Instance cache missing network info. {{(pid=75176) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 15:46:26 user nova-compute[75176]: DEBUG nova.network.neutron [None req-52f7d927-1c7a-4e53-8488-0f59f3fa6d7b tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] [instance: 0e465c9f-e8ab-4a28-bf74-2936a272a0e2] Updating instance_info_cache with network_info: [{"id": "86effed2-558e-4427-82be-761ca28e6d8c", "address": "fa:16:3e:95:66:57", "network": {"id": "5d0ae041-a67d-4a54-bd53-104c4f44209d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-938551772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "169fdaea89d4431aa6adacdbb76f3546", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86effed2-55", "ovs_interfaceid": "86effed2-558e-4427-82be-761ca28e6d8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:46:26 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-52f7d927-1c7a-4e53-8488-0f59f3fa6d7b tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Releasing lock "refresh_cache-0e465c9f-e8ab-4a28-bf74-2936a272a0e2" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:46:26 user nova-compute[75176]: DEBUG nova.compute.manager [None req-52f7d927-1c7a-4e53-8488-0f59f3fa6d7b tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] [instance: 0e465c9f-e8ab-4a28-bf74-2936a272a0e2] Instance network_info: |[{"id": "86effed2-558e-4427-82be-761ca28e6d8c", "address": "fa:16:3e:95:66:57", "network": {"id": "5d0ae041-a67d-4a54-bd53-104c4f44209d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-938551772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "169fdaea89d4431aa6adacdbb76f3546", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86effed2-55", "ovs_interfaceid": "86effed2-558e-4427-82be-761ca28e6d8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75176) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 15:46:26 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-e8761536-7a7a-46b2-99a9-3ab70987ef4e req-dc8381a3-6c50-4845-8eec-604ad4d19ac8 service nova] Acquired lock "refresh_cache-0e465c9f-e8ab-4a28-bf74-2936a272a0e2" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:46:26 user nova-compute[75176]: DEBUG nova.network.neutron [req-e8761536-7a7a-46b2-99a9-3ab70987ef4e req-dc8381a3-6c50-4845-8eec-604ad4d19ac8 service nova] [instance: 0e465c9f-e8ab-4a28-bf74-2936a272a0e2] Refreshing network info cache for port 86effed2-558e-4427-82be-761ca28e6d8c {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 15:46:26 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-52f7d927-1c7a-4e53-8488-0f59f3fa6d7b tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] [instance: 0e465c9f-e8ab-4a28-bf74-2936a272a0e2] Start _get_guest_xml network_info=[{"id": "86effed2-558e-4427-82be-761ca28e6d8c", "address": "fa:16:3e:95:66:57", "network": {"id": "5d0ae041-a67d-4a54-bd53-104c4f44209d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-938551772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "169fdaea89d4431aa6adacdbb76f3546", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86effed2-55", "ovs_interfaceid": "86effed2-558e-4427-82be-761ca28e6d8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T15:35:12Z,direct_url=<?>,disk_format='qcow2',id=1f41819e-c93f-4dc7-b253-37a27bbbbc74,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1b91c5d0672c4224a48df2e1f92688e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T15:35:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'size': 0, 'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'image_id': '1f41819e-c93f-4dc7-b253-37a27bbbbc74'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75176) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 15:46:26 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-52f7d927-1c7a-4e53-8488-0f59f3fa6d7b tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 15:46:26 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-52f7d927-1c7a-4e53-8488-0f59f3fa6d7b tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 15:46:26 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-52f7d927-1c7a-4e53-8488-0f59f3fa6d7b tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75176) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 15:46:26 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-52f7d927-1c7a-4e53-8488-0f59f3fa6d7b tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] CPU controller missing on host. {{(pid=75176) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 15:46:26 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-52f7d927-1c7a-4e53-8488-0f59f3fa6d7b tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75176) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 15:46:26 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-52f7d927-1c7a-4e53-8488-0f59f3fa6d7b tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] CPU controller found on host. {{(pid=75176) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 15:46:26 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-52f7d927-1c7a-4e53-8488-0f59f3fa6d7b tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75176) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 15:46:26 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-52f7d927-1c7a-4e53-8488-0f59f3fa6d7b tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T15:35:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T15:35:12Z,direct_url=<?>,disk_format='qcow2',id=1f41819e-c93f-4dc7-b253-37a27bbbbc74,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1b91c5d0672c4224a48df2e1f92688e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T15:35:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 15:46:26 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-52f7d927-1c7a-4e53-8488-0f59f3fa6d7b tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Flavor limits 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 15:46:26 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-52f7d927-1c7a-4e53-8488-0f59f3fa6d7b tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Image limits 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 15:46:26 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-52f7d927-1c7a-4e53-8488-0f59f3fa6d7b tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Flavor pref 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 15:46:26 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-52f7d927-1c7a-4e53-8488-0f59f3fa6d7b tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Image pref 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 15:46:26 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-52f7d927-1c7a-4e53-8488-0f59f3fa6d7b tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 15:46:26 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-52f7d927-1c7a-4e53-8488-0f59f3fa6d7b tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 15:46:26 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-52f7d927-1c7a-4e53-8488-0f59f3fa6d7b tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75176) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 15:46:26 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-52f7d927-1c7a-4e53-8488-0f59f3fa6d7b tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Got 1 possible topologies {{(pid=75176) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 15:46:26 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-52f7d927-1c7a-4e53-8488-0f59f3fa6d7b tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 15:46:26 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-52f7d927-1c7a-4e53-8488-0f59f3fa6d7b tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 15:46:26 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-52f7d927-1c7a-4e53-8488-0f59f3fa6d7b tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T15:46:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-447740496',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-447740496',id=23,image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF/pYrzcTrtQ3nwooZBOWnAPi4M5mz16IJrnTqwXqwCVaE4JIJYdwHlVPfsp02/e05TmymOA0Zx46jNuNLVfWRTBx9AVrbXibAt/hO6ZnAPzuudKre3uKffG2AkKZrLXTw==',key_name='tempest-keypair-1203625989',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='169fdaea89d4431aa6adacdbb76f3546',ramdisk_id='',reservation_id='r-avjj7pv9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1264107218',owner_user_name='tempest-AttachVolumeShelveTestJSON-1264107218-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T15:46:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3146d6b1e7324ebaa62ade09f1d1c68f',uuid=0e465c9f-e8ab-4a28-bf74-2936a272a0e2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "86effed2-558e-4427-82be-761ca28e6d8c", "address": "fa:16:3e:95:66:57", "network": {"id": "5d0ae041-a67d-4a54-bd53-104c4f44209d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-938551772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "169fdaea89d4431aa6adacdbb76f3546", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86effed2-55", "ovs_interfaceid": "86effed2-558e-4427-82be-761ca28e6d8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75176) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 15:46:26 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-52f7d927-1c7a-4e53-8488-0f59f3fa6d7b tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Converting VIF {"id": "86effed2-558e-4427-82be-761ca28e6d8c", "address": "fa:16:3e:95:66:57", "network": {"id": "5d0ae041-a67d-4a54-bd53-104c4f44209d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-938551772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "169fdaea89d4431aa6adacdbb76f3546", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86effed2-55", "ovs_interfaceid": "86effed2-558e-4427-82be-761ca28e6d8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:46:26 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-52f7d927-1c7a-4e53-8488-0f59f3fa6d7b tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:66:57,bridge_name='br-int',has_traffic_filtering=True,id=86effed2-558e-4427-82be-761ca28e6d8c,network=Network(5d0ae041-a67d-4a54-bd53-104c4f44209d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86effed2-55') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:46:26 user nova-compute[75176]: DEBUG nova.objects.instance [None req-52f7d927-1c7a-4e53-8488-0f59f3fa6d7b tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Lazy-loading 'pci_devices' on Instance uuid 0e465c9f-e8ab-4a28-bf74-2936a272a0e2 {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:46:26 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-52f7d927-1c7a-4e53-8488-0f59f3fa6d7b tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] [instance: 0e465c9f-e8ab-4a28-bf74-2936a272a0e2] End _get_guest_xml xml=<domain type="kvm">
Nov 28 15:46:26 user nova-compute[75176]:   <uuid>0e465c9f-e8ab-4a28-bf74-2936a272a0e2</uuid>
Nov 28 15:46:26 user nova-compute[75176]:   <name>instance-00000017</name>
Nov 28 15:46:26 user nova-compute[75176]:   <memory>524288</memory>
Nov 28 15:46:26 user nova-compute[75176]:   <vcpu>1</vcpu>
Nov 28 15:46:26 user nova-compute[75176]:   <metadata>
Nov 28 15:46:26 user nova-compute[75176]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 15:46:26 user nova-compute[75176]:       <nova:package version="0.0.0"/>
Nov 28 15:46:26 user nova-compute[75176]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-447740496</nova:name>
Nov 28 15:46:26 user nova-compute[75176]:       <nova:creationTime>2023-11-28 15:46:26</nova:creationTime>
Nov 28 15:46:26 user nova-compute[75176]:       <nova:flavor name="m1.tiny">
Nov 28 15:46:26 user nova-compute[75176]:         <nova:memory>512</nova:memory>
Nov 28 15:46:26 user nova-compute[75176]:         <nova:disk>1</nova:disk>
Nov 28 15:46:26 user nova-compute[75176]:         <nova:swap>0</nova:swap>
Nov 28 15:46:26 user nova-compute[75176]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 15:46:26 user nova-compute[75176]:         <nova:vcpus>1</nova:vcpus>
Nov 28 15:46:26 user nova-compute[75176]:       </nova:flavor>
Nov 28 15:46:26 user nova-compute[75176]:       <nova:owner>
Nov 28 15:46:26 user nova-compute[75176]:         <nova:user uuid="3146d6b1e7324ebaa62ade09f1d1c68f">tempest-AttachVolumeShelveTestJSON-1264107218-project-member</nova:user>
Nov 28 15:46:26 user nova-compute[75176]:         <nova:project uuid="169fdaea89d4431aa6adacdbb76f3546">tempest-AttachVolumeShelveTestJSON-1264107218</nova:project>
Nov 28 15:46:26 user nova-compute[75176]:       </nova:owner>
Nov 28 15:46:26 user nova-compute[75176]:       <nova:root type="image" uuid="1f41819e-c93f-4dc7-b253-37a27bbbbc74"/>
Nov 28 15:46:26 user nova-compute[75176]:       <nova:ports>
Nov 28 15:46:26 user nova-compute[75176]:         <nova:port uuid="86effed2-558e-4427-82be-761ca28e6d8c">
Nov 28 15:46:26 user nova-compute[75176]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 28 15:46:26 user nova-compute[75176]:         </nova:port>
Nov 28 15:46:26 user nova-compute[75176]:       </nova:ports>
Nov 28 15:46:26 user nova-compute[75176]:     </nova:instance>
Nov 28 15:46:26 user nova-compute[75176]:   </metadata>
Nov 28 15:46:26 user nova-compute[75176]:   <sysinfo type="smbios">
Nov 28 15:46:26 user nova-compute[75176]:     <system>
Nov 28 15:46:26 user nova-compute[75176]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 15:46:26 user nova-compute[75176]:       <entry name="product">OpenStack Nova</entry>
Nov 28 15:46:26 user nova-compute[75176]:       <entry name="version">0.0.0</entry>
Nov 28 15:46:26 user nova-compute[75176]:       <entry name="serial">0e465c9f-e8ab-4a28-bf74-2936a272a0e2</entry>
Nov 28 15:46:26 user nova-compute[75176]:       <entry name="uuid">0e465c9f-e8ab-4a28-bf74-2936a272a0e2</entry>
Nov 28 15:46:26 user nova-compute[75176]:       <entry name="family">Virtual Machine</entry>
Nov 28 15:46:26 user nova-compute[75176]:     </system>
Nov 28 15:46:26 user nova-compute[75176]:   </sysinfo>
Nov 28 15:46:26 user nova-compute[75176]:   <os>
Nov 28 15:46:26 user nova-compute[75176]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 15:46:26 user nova-compute[75176]:     <boot dev="hd"/>
Nov 28 15:46:26 user nova-compute[75176]:     <smbios mode="sysinfo"/>
Nov 28 15:46:26 user nova-compute[75176]:   </os>
Nov 28 15:46:26 user nova-compute[75176]:   <features>
Nov 28 15:46:26 user nova-compute[75176]:     <acpi/>
Nov 28 15:46:26 user nova-compute[75176]:     <apic/>
Nov 28 15:46:26 user nova-compute[75176]:     <vmcoreinfo/>
Nov 28 15:46:26 user nova-compute[75176]:   </features>
Nov 28 15:46:26 user nova-compute[75176]:   <clock offset="utc">
Nov 28 15:46:26 user nova-compute[75176]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 15:46:26 user nova-compute[75176]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 15:46:26 user nova-compute[75176]:     <timer name="hpet" present="no"/>
Nov 28 15:46:26 user nova-compute[75176]:   </clock>
Nov 28 15:46:26 user nova-compute[75176]:   <cpu mode="custom" match="exact">
Nov 28 15:46:26 user nova-compute[75176]:     <model>Nehalem</model>
Nov 28 15:46:26 user nova-compute[75176]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 15:46:26 user nova-compute[75176]:   </cpu>
Nov 28 15:46:26 user nova-compute[75176]:   <devices>
Nov 28 15:46:26 user nova-compute[75176]:     <disk type="file" device="disk">
Nov 28 15:46:26 user nova-compute[75176]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 15:46:26 user nova-compute[75176]:       <source file="/opt/stack/data/nova/instances/0e465c9f-e8ab-4a28-bf74-2936a272a0e2/disk"/>
Nov 28 15:46:26 user nova-compute[75176]:       <target dev="vda" bus="virtio"/>
Nov 28 15:46:26 user nova-compute[75176]:     </disk>
Nov 28 15:46:26 user nova-compute[75176]:     <interface type="ethernet">
Nov 28 15:46:26 user nova-compute[75176]:       <mac address="fa:16:3e:95:66:57"/>
Nov 28 15:46:26 user nova-compute[75176]:       <model type="virtio"/>
Nov 28 15:46:26 user nova-compute[75176]:       <mtu size="1442"/>
Nov 28 15:46:26 user nova-compute[75176]:       <target dev="tap86effed2-55"/>
Nov 28 15:46:26 user nova-compute[75176]:     </interface>
Nov 28 15:46:26 user nova-compute[75176]:     <serial type="pty">
Nov 28 15:46:26 user nova-compute[75176]:       <log file="/opt/stack/data/nova/instances/0e465c9f-e8ab-4a28-bf74-2936a272a0e2/console.log" append="off"/>
Nov 28 15:46:26 user nova-compute[75176]:     </serial>
Nov 28 15:46:26 user nova-compute[75176]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 15:46:26 user nova-compute[75176]:     <video>
Nov 28 15:46:26 user nova-compute[75176]:       <model type="virtio"/>
Nov 28 15:46:26 user nova-compute[75176]:     </video>
Nov 28 15:46:26 user nova-compute[75176]:     <rng model="virtio">
Nov 28 15:46:26 user nova-compute[75176]:       <backend model="random">/dev/urandom</backend>
Nov 28 15:46:26 user nova-compute[75176]:     </rng>
Nov 28 15:46:26 user nova-compute[75176]:     <controller type="usb" index="0" model="none"/>
Nov 28 15:46:26 user nova-compute[75176]:     <memballoon model="virtio">
Nov 28 15:46:26 user nova-compute[75176]:       <stats period="10"/>
Nov 28 15:46:26 user nova-compute[75176]:     </memballoon>
Nov 28 15:46:26 user nova-compute[75176]:   </devices>
Nov 28 15:46:26 user nova-compute[75176]: </domain>
Nov 28 15:46:26 user nova-compute[75176]:  {{(pid=75176) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 15:46:26 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-52f7d927-1c7a-4e53-8488-0f59f3fa6d7b tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T15:46:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-447740496',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-447740496',id=23,image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF/pYrzcTrtQ3nwooZBOWnAPi4M5mz16IJrnTqwXqwCVaE4JIJYdwHlVPfsp02/e05TmymOA0Zx46jNuNLVfWRTBx9AVrbXibAt/hO6ZnAPzuudKre3uKffG2AkKZrLXTw==',key_name='tempest-keypair-1203625989',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='169fdaea89d4431aa6adacdbb76f3546',ramdisk_id='',reservation_id='r-avjj7pv9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1264107218',owner_user_name='tempest-AttachVolumeShelveTestJSON-1264107218-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T15:46:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3146d6b1e7324ebaa62ade09f1d1c68f',uuid=0e465c9f-e8ab-4a28-bf74-2936a272a0e2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "86effed2-558e-4427-82be-761ca28e6d8c", "address": "fa:16:3e:95:66:57", "network": {"id": "5d0ae041-a67d-4a54-bd53-104c4f44209d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-938551772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "169fdaea89d4431aa6adacdbb76f3546", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86effed2-55", "ovs_interfaceid": "86effed2-558e-4427-82be-761ca28e6d8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 15:46:26 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-52f7d927-1c7a-4e53-8488-0f59f3fa6d7b tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Converting VIF {"id": "86effed2-558e-4427-82be-761ca28e6d8c", "address": "fa:16:3e:95:66:57", "network": {"id": "5d0ae041-a67d-4a54-bd53-104c4f44209d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-938551772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "169fdaea89d4431aa6adacdbb76f3546", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86effed2-55", "ovs_interfaceid": "86effed2-558e-4427-82be-761ca28e6d8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:46:26 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-52f7d927-1c7a-4e53-8488-0f59f3fa6d7b tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:66:57,bridge_name='br-int',has_traffic_filtering=True,id=86effed2-558e-4427-82be-761ca28e6d8c,network=Network(5d0ae041-a67d-4a54-bd53-104c4f44209d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86effed2-55') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:46:26 user nova-compute[75176]: DEBUG os_vif [None req-52f7d927-1c7a-4e53-8488-0f59f3fa6d7b tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:66:57,bridge_name='br-int',has_traffic_filtering=True,id=86effed2-558e-4427-82be-761ca28e6d8c,network=Network(5d0ae041-a67d-4a54-bd53-104c4f44209d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86effed2-55') {{(pid=75176) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 15:46:26 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:46:26 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:46:26 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 15:46:26 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:46:26 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '830667c9-126c-5bd1-9e2c-dab4fa16e8a5', '_type': 'linux-noop'}}, row=False) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:46:26 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:46:26 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:46:26 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:46:26 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap86effed2-55, may_exist=True, interface_attrs={}) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:46:26 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap86effed2-55, col_values=(('qos', UUID('268d4ec1-5250-4277-b0f9-6a7cc6dbc0a3')),), if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:46:26 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap86effed2-55, col_values=(('external_ids', {'iface-id': '86effed2-558e-4427-82be-761ca28e6d8c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:95:66:57', 'vm-uuid': '0e465c9f-e8ab-4a28-bf74-2936a272a0e2'}),), if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:46:26 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:46:26 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:46:26 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:46:26 user nova-compute[75176]: INFO os_vif [None req-52f7d927-1c7a-4e53-8488-0f59f3fa6d7b tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:66:57,bridge_name='br-int',has_traffic_filtering=True,id=86effed2-558e-4427-82be-761ca28e6d8c,network=Network(5d0ae041-a67d-4a54-bd53-104c4f44209d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86effed2-55')
Nov 28 15:46:26 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-52f7d927-1c7a-4e53-8488-0f59f3fa6d7b tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] No BDM found with device name vda, not building metadata. {{(pid=75176) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 15:46:26 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-52f7d927-1c7a-4e53-8488-0f59f3fa6d7b tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] No VIF found with MAC fa:16:3e:95:66:57, not building metadata {{(pid=75176) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 15:46:27 user nova-compute[75176]: DEBUG nova.network.neutron [req-e8761536-7a7a-46b2-99a9-3ab70987ef4e req-dc8381a3-6c50-4845-8eec-604ad4d19ac8 service nova] [instance: 0e465c9f-e8ab-4a28-bf74-2936a272a0e2] Updated VIF entry in instance network info cache for port 86effed2-558e-4427-82be-761ca28e6d8c. {{(pid=75176) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 15:46:27 user nova-compute[75176]: DEBUG nova.network.neutron [req-e8761536-7a7a-46b2-99a9-3ab70987ef4e req-dc8381a3-6c50-4845-8eec-604ad4d19ac8 service nova] [instance: 0e465c9f-e8ab-4a28-bf74-2936a272a0e2] Updating instance_info_cache with network_info: [{"id": "86effed2-558e-4427-82be-761ca28e6d8c", "address": "fa:16:3e:95:66:57", "network": {"id": "5d0ae041-a67d-4a54-bd53-104c4f44209d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-938551772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "169fdaea89d4431aa6adacdbb76f3546", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86effed2-55", "ovs_interfaceid": "86effed2-558e-4427-82be-761ca28e6d8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:46:27 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-e8761536-7a7a-46b2-99a9-3ab70987ef4e req-dc8381a3-6c50-4845-8eec-604ad4d19ac8 service nova] Releasing lock "refresh_cache-0e465c9f-e8ab-4a28-bf74-2936a272a0e2" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:46:27 user nova-compute[75176]: DEBUG nova.compute.manager [None req-9ff9f3fa-368a-4cfb-af6e-e2878c625c40 tempest-TestVolumeSwap-440541491 tempest-TestVolumeSwap-440541491-project-admin] [instance: 6b3646e6-512e-4cd6-b3c1-89438c19c408] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:070272de-513d-48de-975c-17e6ce9e5007', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QgVoNLfF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '6b3646e6-512e-4cd6-b3c1-89438c19c408', 'attached_at': '', 'detached_at': '', 'volume_id': '070272de-513d-48de-975c-17e6ce9e5007', 'serial': '070272de-513d-48de-975c-17e6ce9e5007'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e7728674-3e10-438c-8fa0-9fc73367663f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OlvPosBa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '6b3646e6-512e-4cd6-b3c1-89438c19c408', 'attached_at': '', 'detached_at': '', 'volume_id': 'e7728674-3e10-438c-8fa0-9fc73367663f', 'serial'} {{(pid=75176) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 28 15:46:27 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ff9f3fa-368a-4cfb-af6e-e2878c625c40 tempest-TestVolumeSwap-440541491 tempest-TestVolumeSwap-440541491-project-admin] [instance: 6b3646e6-512e-4cd6-b3c1-89438c19c408] Calling os-brick to attach iSCSI Volume {{(pid=75176) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 15:46:27 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ff9f3fa-368a-4cfb-af6e-e2878c625c40 tempest-TestVolumeSwap-440541491 tempest-TestVolumeSwap-440541491-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c1b8a00>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:070272de-513d-48de-975c-17e6ce9e5007', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QgVoNLfF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 15:46:27 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-9ff9f3fa-368a-4cfb-af6e-e2878c625c40 tempest-TestVolumeSwap-440541491 tempest-TestVolumeSwap-440541491-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 15:46:27 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-9ff9f3fa-368a-4cfb-af6e-e2878c625c40 tempest-TestVolumeSwap-440541491 tempest-TestVolumeSwap-440541491-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 15:46:27 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-9ff9f3fa-368a-4cfb-af6e-e2878c625c40 tempest-TestVolumeSwap-440541491 tempest-TestVolumeSwap-440541491-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 15:46:27 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-9ff9f3fa-368a-4cfb-af6e-e2878c625c40 tempest-TestVolumeSwap-440541491 tempest-TestVolumeSwap-440541491-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 15:46:27 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-9ff9f3fa-368a-4cfb-af6e-e2878c625c40 tempest-TestVolumeSwap-440541491 tempest-TestVolumeSwap-440541491-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:070272de-513d-48de-975c-17e6ce9e5007" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 15:46:27 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-9ff9f3fa-368a-4cfb-af6e-e2878c625c40 tempest-TestVolumeSwap-440541491 tempest-TestVolumeSwap-440541491-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:070272de-513d-48de-975c-17e6ce9e5007" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 15:46:27 user nova-compute[75176]: INFO os_brick.initiator.connectors.iscsi [None req-9ff9f3fa-368a-4cfb-af6e-e2878c625c40 tempest-TestVolumeSwap-440541491 tempest-TestVolumeSwap-440541491-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 15:46:27 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:070272de-513d-48de-975c-17e6ce9e5007 -p 172.16.0.220:3260 {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:46:27 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:070272de-513d-48de-975c-17e6ce9e5007 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:46:27 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[826d26a1-34f5-47bc-ae52-fd0f72753171]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:46:27 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ff9f3fa-368a-4cfb-af6e-e2878c625c40 tempest-TestVolumeSwap-440541491 tempest-TestVolumeSwap-440541491-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 15:46:27 user nova-compute[75176]:  {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:46:27 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:070272de-513d-48de-975c-17e6ce9e5007 -p 172.16.0.220:3260 --interface default --op new {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:46:27 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:070272de-513d-48de-975c-17e6ce9e5007 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:46:27 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[c79a3306-d60f-4c93-9a2f-b72d284956d9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:070272de-513d-48de-975c-17e6ce9e5007] added\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:46:27 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ff9f3fa-368a-4cfb-af6e-e2878c625c40 tempest-TestVolumeSwap-440541491 tempest-TestVolumeSwap-440541491-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:070272de-513d-48de-975c-17e6ce9e5007] added
Nov 28 15:46:27 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:46:27 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:070272de-513d-48de-975c-17e6ce9e5007 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:46:27 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:070272de-513d-48de-975c-17e6ce9e5007 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:46:27 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[b78fa6d8-5d47-49b9-b1ef-749e00b97324]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:46:27 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ff9f3fa-368a-4cfb-af6e-e2878c625c40 tempest-TestVolumeSwap-440541491 tempest-TestVolumeSwap-440541491-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:46:27 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:070272de-513d-48de-975c-17e6ce9e5007 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:46:27 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:070272de-513d-48de-975c-17e6ce9e5007 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:46:27 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[19663341-9487-4c7f-b5a7-b749a615834a]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:46:27 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ff9f3fa-368a-4cfb-af6e-e2878c625c40 tempest-TestVolumeSwap-440541491 tempest-TestVolumeSwap-440541491-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:46:27 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:070272de-513d-48de-975c-17e6ce9e5007 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QgVoNLfF {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:46:27 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:070272de-513d-48de-975c-17e6ce9e5007 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QgVoNLfF" returned: 0 in 0.022s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:46:27 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[c19e4cf0-ede3-4451-9c36-e386e278ec7e]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:46:27 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ff9f3fa-368a-4cfb-af6e-e2878c625c40 tempest-TestVolumeSwap-440541491 tempest-TestVolumeSwap-440541491-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QgVoNLfF'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:46:27 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:070272de-513d-48de-975c-17e6ce9e5007 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:46:27 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:070272de-513d-48de-975c-17e6ce9e5007 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:46:27 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[a86c7998-4d54-4107-9cfc-c63eee8ff581]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:46:27 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ff9f3fa-368a-4cfb-af6e-e2878c625c40 tempest-TestVolumeSwap-440541491 tempest-TestVolumeSwap-440541491-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:46:27 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:46:27 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:46:27 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8c8099f-7e03-47a3-88c0-2a687eee384d]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1f5de5d-be7a-443a-9831-791c8667c09b (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69f59c18-c5e6-4afe-a74b-afe6d64d4e49 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7728674-3e10-438c-8fa0-9fc73367663f (non-flash)\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:46:27 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ff9f3fa-368a-4cfb-af6e-e2878c625c40 tempest-TestVolumeSwap-440541491 tempest-TestVolumeSwap-440541491-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1f5de5d-be7a-443a-9831-791c8667c09b (non-flash)
Nov 28 15:46:27 user nova-compute[75176]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24 (non-flash)
Nov 28 15:46:27 user nova-compute[75176]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d (non-flash)
Nov 28 15:46:27 user nova-compute[75176]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69f59c18-c5e6-4afe-a74b-afe6d64d4e49 (non-flash)
Nov 28 15:46:27 user nova-compute[75176]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7728674-3e10-438c-8fa0-9fc73367663f (non-flash)
Nov 28 15:46:27 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:46:27 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ff9f3fa-368a-4cfb-af6e-e2878c625c40 tempest-TestVolumeSwap-440541491 tempest-TestVolumeSwap-440541491-project-admin] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1f5de5d-be7a-443a-9831-791c8667c09b (non-flash)
Nov 28 15:46:27 user nova-compute[75176]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24 (non-flash)
Nov 28 15:46:27 user nova-compute[75176]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d (non-flash)
Nov 28 15:46:27 user nova-compute[75176]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69f59c18-c5e6-4afe-a74b-afe6d64d4e49 (non-flash)
Nov 28 15:46:27 user nova-compute[75176]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7728674-3e10-438c-8fa0-9fc73367663f (non-flash)
Nov 28 15:46:27 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 15:46:27 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:070272de-513d-48de-975c-17e6ce9e5007 -p 172.16.0.220:3260 --login {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:46:27 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:070272de-513d-48de-975c-17e6ce9e5007 -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:46:27 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[248e5a21-231e-41f8-bd81-1c8a32a9c146]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:070272de-513d-48de-975c-17e6ce9e5007, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:070272de-513d-48de-975c-17e6ce9e5007, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:46:27 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ff9f3fa-368a-4cfb-af6e-e2878c625c40 tempest-TestVolumeSwap-440541491 tempest-TestVolumeSwap-440541491-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:070272de-513d-48de-975c-17e6ce9e5007, portal: 172.16.0.220,3260]
Nov 28 15:46:27 user nova-compute[75176]: Login to [iface: default, target: iqn.2010-10.org.openstack:070272de-513d-48de-975c-17e6ce9e5007, portal: 172.16.0.220,3260] successful.
Nov 28 15:46:27 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:46:27 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:070272de-513d-48de-975c-17e6ce9e5007 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:46:27 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:070272de-513d-48de-975c-17e6ce9e5007 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:46:27 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd388c25-3fdc-458e-a8d2-04745f6b0d51]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:46:27 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ff9f3fa-368a-4cfb-af6e-e2878c625c40 tempest-TestVolumeSwap-440541491 tempest-TestVolumeSwap-440541491-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:46:27 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:46:27 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:46:27 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3fd2f90-d449-457a-9fef-3d1db08c01f3]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1f5de5d-be7a-443a-9831-791c8667c09b (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69f59c18-c5e6-4afe-a74b-afe6d64d4e49 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7728674-3e10-438c-8fa0-9fc73367663f (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:070272de-513d-48de-975c-17e6ce9e5007 (non-flash)\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:46:27 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ff9f3fa-368a-4cfb-af6e-e2878c625c40 tempest-TestVolumeSwap-440541491 tempest-TestVolumeSwap-440541491-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1f5de5d-be7a-443a-9831-791c8667c09b (non-flash)
Nov 28 15:46:27 user nova-compute[75176]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24 (non-flash)
Nov 28 15:46:27 user nova-compute[75176]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d (non-flash)
Nov 28 15:46:27 user nova-compute[75176]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69f59c18-c5e6-4afe-a74b-afe6d64d4e49 (non-flash)
Nov 28 15:46:27 user nova-compute[75176]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7728674-3e10-438c-8fa0-9fc73367663f (non-flash)
Nov 28 15:46:27 user nova-compute[75176]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:070272de-513d-48de-975c-17e6ce9e5007 (non-flash)
Nov 28 15:46:27 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:46:27 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ff9f3fa-368a-4cfb-af6e-e2878c625c40 tempest-TestVolumeSwap-440541491 tempest-TestVolumeSwap-440541491-project-admin] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1f5de5d-be7a-443a-9831-791c8667c09b (non-flash)
Nov 28 15:46:27 user nova-compute[75176]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24 (non-flash)
Nov 28 15:46:27 user nova-compute[75176]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d (non-flash)
Nov 28 15:46:27 user nova-compute[75176]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69f59c18-c5e6-4afe-a74b-afe6d64d4e49 (non-flash)
Nov 28 15:46:27 user nova-compute[75176]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7728674-3e10-438c-8fa0-9fc73367663f (non-flash)
Nov 28 15:46:27 user nova-compute[75176]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:070272de-513d-48de-975c-17e6ce9e5007 (non-flash)
Nov 28 15:46:27 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 15:46:27 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-9ff9f3fa-368a-4cfb-af6e-e2878c625c40 tempest-TestVolumeSwap-440541491 tempest-TestVolumeSwap-440541491-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:070272de-513d-48de-975c-17e6ce9e5007" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.309s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 15:46:27 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ff9f3fa-368a-4cfb-af6e-e2878c625c40 tempest-TestVolumeSwap-440541491 tempest-TestVolumeSwap-440541491-project-admin] Connected to 172.16.0.220:3260 {{(pid=75176) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 15:46:27 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-9ff9f3fa-368a-4cfb-af6e-e2878c625c40 tempest-TestVolumeSwap-440541491 tempest-TestVolumeSwap-440541491-project-admin] HCTL ('34', '-', '-', 0) found on session 27 with lun 0 {{(pid=75176) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 15:46:27 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-9ff9f3fa-368a-4cfb-af6e-e2878c625c40 tempest-TestVolumeSwap-440541491 tempest-TestVolumeSwap-440541491-project-admin] Scanning host 34 c: -, t: -, l: 0) {{(pid=75176) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 15:46:27 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:46:27 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:46:27 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc5dd9fa-52c4-4ae9-949f-e56754286327]: (4, ('- - 0', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:46:27 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-9ff9f3fa-368a-4cfb-af6e-e2878c625c40 tempest-TestVolumeSwap-440541491 tempest-TestVolumeSwap-440541491-project-admin] Searching for a device in session 27 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75176) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 15:46:27 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ff9f3fa-368a-4cfb-af6e-e2878c625c40 tempest-TestVolumeSwap-440541491 tempest-TestVolumeSwap-440541491-project-admin] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:070272de-513d-48de-975c-17e6ce9e5007', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QgVoNLfF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75176) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 15:46:28 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-a866f3fb-2c7c-4d8b-a1fb-744335c6948f tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Acquiring lock "47306d53-9ad7-4cae-ba6d-1f65239ef30f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:46:28 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-a866f3fb-2c7c-4d8b-a1fb-744335c6948f tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Lock "47306d53-9ad7-4cae-ba6d-1f65239ef30f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:46:28 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-a866f3fb-2c7c-4d8b-a1fb-744335c6948f tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Acquiring lock "47306d53-9ad7-4cae-ba6d-1f65239ef30f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:46:28 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-a866f3fb-2c7c-4d8b-a1fb-744335c6948f tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Lock "47306d53-9ad7-4cae-ba6d-1f65239ef30f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:46:28 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-a866f3fb-2c7c-4d8b-a1fb-744335c6948f tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Lock "47306d53-9ad7-4cae-ba6d-1f65239ef30f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:46:28 user nova-compute[75176]: INFO nova.compute.manager [None req-a866f3fb-2c7c-4d8b-a1fb-744335c6948f tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] [instance: 47306d53-9ad7-4cae-ba6d-1f65239ef30f] Terminating instance
Nov 28 15:46:28 user nova-compute[75176]: DEBUG nova.compute.manager [None req-a866f3fb-2c7c-4d8b-a1fb-744335c6948f tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] [instance: 47306d53-9ad7-4cae-ba6d-1f65239ef30f] Start destroying the instance on the hypervisor. {{(pid=75176) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 15:46:28 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:46:28 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:46:28 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:46:28 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:46:28 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:46:28 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:46:28 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:46:28 user nova-compute[75176]: DEBUG nova.compute.manager [req-66420483-32cc-490b-b685-e529813ffb5f req-fe5a1237-2ab1-4d19-86c7-2d9d5b0b7b4c service nova] [instance: 47306d53-9ad7-4cae-ba6d-1f65239ef30f] Received event network-vif-unplugged-c3d44009-c128-4e98-8594-132ed6c85dbc {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:46:28 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-66420483-32cc-490b-b685-e529813ffb5f req-fe5a1237-2ab1-4d19-86c7-2d9d5b0b7b4c service nova] Acquiring lock "47306d53-9ad7-4cae-ba6d-1f65239ef30f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:46:28 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-66420483-32cc-490b-b685-e529813ffb5f req-fe5a1237-2ab1-4d19-86c7-2d9d5b0b7b4c service nova] Lock "47306d53-9ad7-4cae-ba6d-1f65239ef30f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:46:28 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-66420483-32cc-490b-b685-e529813ffb5f req-fe5a1237-2ab1-4d19-86c7-2d9d5b0b7b4c service nova] Lock "47306d53-9ad7-4cae-ba6d-1f65239ef30f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:46:28 user nova-compute[75176]: DEBUG nova.compute.manager [req-66420483-32cc-490b-b685-e529813ffb5f req-fe5a1237-2ab1-4d19-86c7-2d9d5b0b7b4c service nova] [instance: 47306d53-9ad7-4cae-ba6d-1f65239ef30f] No waiting events found dispatching network-vif-unplugged-c3d44009-c128-4e98-8594-132ed6c85dbc {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:46:28 user nova-compute[75176]: DEBUG nova.compute.manager [req-66420483-32cc-490b-b685-e529813ffb5f req-fe5a1237-2ab1-4d19-86c7-2d9d5b0b7b4c service nova] [instance: 47306d53-9ad7-4cae-ba6d-1f65239ef30f] Received event network-vif-unplugged-c3d44009-c128-4e98-8594-132ed6c85dbc for instance with task_state deleting. {{(pid=75176) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 15:46:28 user nova-compute[75176]: DEBUG nova.compute.manager [req-90a96b40-339b-40ad-9663-88f3e1d4dae4 req-b5703cf5-a827-4475-9cb8-4bbaddcf89d2 service nova] [instance: 0e465c9f-e8ab-4a28-bf74-2936a272a0e2] Received event network-vif-plugged-86effed2-558e-4427-82be-761ca28e6d8c {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:46:28 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-90a96b40-339b-40ad-9663-88f3e1d4dae4 req-b5703cf5-a827-4475-9cb8-4bbaddcf89d2 service nova] Acquiring lock "0e465c9f-e8ab-4a28-bf74-2936a272a0e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:46:28 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-90a96b40-339b-40ad-9663-88f3e1d4dae4 req-b5703cf5-a827-4475-9cb8-4bbaddcf89d2 service nova] Lock "0e465c9f-e8ab-4a28-bf74-2936a272a0e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:46:28 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-90a96b40-339b-40ad-9663-88f3e1d4dae4 req-b5703cf5-a827-4475-9cb8-4bbaddcf89d2 service nova] Lock "0e465c9f-e8ab-4a28-bf74-2936a272a0e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:46:28 user nova-compute[75176]: DEBUG nova.compute.manager [req-90a96b40-339b-40ad-9663-88f3e1d4dae4 req-b5703cf5-a827-4475-9cb8-4bbaddcf89d2 service nova] [instance: 0e465c9f-e8ab-4a28-bf74-2936a272a0e2] No waiting events found dispatching network-vif-plugged-86effed2-558e-4427-82be-761ca28e6d8c {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:46:28 user nova-compute[75176]: WARNING nova.compute.manager [req-90a96b40-339b-40ad-9663-88f3e1d4dae4 req-b5703cf5-a827-4475-9cb8-4bbaddcf89d2 service nova] [instance: 0e465c9f-e8ab-4a28-bf74-2936a272a0e2] Received unexpected event network-vif-plugged-86effed2-558e-4427-82be-761ca28e6d8c for instance with vm_state building and task_state spawning.
Nov 28 15:46:28 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-9ff9f3fa-368a-4cfb-af6e-e2878c625c40 tempest-TestVolumeSwap-440541491 tempest-TestVolumeSwap-440541491-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.342s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 15:46:28 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ff9f3fa-368a-4cfb-af6e-e2878c625c40 tempest-TestVolumeSwap-440541491 tempest-TestVolumeSwap-440541491-project-admin] <== connect_volume: return (1343ms) {'type': 'block', 'scsi_wwn': '26164663637373339', 'path': '/dev/sdc'} {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 15:46:28 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ff9f3fa-368a-4cfb-af6e-e2878c625c40 tempest-TestVolumeSwap-440541491 tempest-TestVolumeSwap-440541491-project-admin] [instance: 6b3646e6-512e-4cd6-b3c1-89438c19c408] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26164663637373339', 'path': '/dev/sdc'} {{(pid=75176) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 15:46:28 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:46:28 user nova-compute[75176]: DEBUG nova.objects.instance [None req-9ff9f3fa-368a-4cfb-af6e-e2878c625c40 tempest-TestVolumeSwap-440541491 tempest-TestVolumeSwap-440541491-project-admin] Lazy-loading 'flavor' on Instance uuid 6b3646e6-512e-4cd6-b3c1-89438c19c408 {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:46:29 user nova-compute[75176]: INFO nova.virt.libvirt.driver [-] [instance: 47306d53-9ad7-4cae-ba6d-1f65239ef30f] Instance destroyed successfully.
Nov 28 15:46:29 user nova-compute[75176]: DEBUG nova.objects.instance [None req-a866f3fb-2c7c-4d8b-a1fb-744335c6948f tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Lazy-loading 'resources' on Instance uuid 47306d53-9ad7-4cae-ba6d-1f65239ef30f {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:46:29 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-a866f3fb-2c7c-4d8b-a1fb-744335c6948f tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T15:41:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1171264206',display_name='tempest-TestMinimumBasicScenario-server-1171264206',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1171264206',id=12,image_ref='920bce21-95d9-45fe-a682-1abb452c4ccc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK1Yogtu9cHTqj/O0yW5ilhTCHe9GWdz8HcrAmcuCSEjGwLVrrqLCp+oEhqH6U3k5OzpunBE1hBj3JYBdp1D5PZTdSdrxBnMO+7y0Ja6VHcYxZP1f9WjFaePvpMxZeLKXg==',key_name='tempest-TestMinimumBasicScenario-327229554',keypairs=<?>,launch_index=0,launched_at=2023-11-28T15:41:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bc1dfeef484e4627a0061d9d36fd2b40',ramdisk_id='',reservation_id='r-mryylpp6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='920bce21-95d9-45fe-a682-1abb452c4ccc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-438096803',owner_user_name='tempest-TestMinimumBasicScenario-438096803-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T15:43:46Z,user_data=None,user_id='54766bbdce4346c0bd508451478b50aa',uuid=47306d53-9ad7-4cae-ba6d-1f65239ef30f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c3d44009-c128-4e98-8594-132ed6c85dbc", "address": "fa:16:3e:0b:f3:cf", "network": {"id": "b06b85af-96d9-41cb-9ad2-7fc0523761e7", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-850315220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc1dfeef484e4627a0061d9d36fd2b40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3d44009-c1", "ovs_interfaceid": "c3d44009-c128-4e98-8594-132ed6c85dbc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 15:46:29 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-a866f3fb-2c7c-4d8b-a1fb-744335c6948f tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Converting VIF {"id": "c3d44009-c128-4e98-8594-132ed6c85dbc", "address": "fa:16:3e:0b:f3:cf", "network": {"id": "b06b85af-96d9-41cb-9ad2-7fc0523761e7", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-850315220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc1dfeef484e4627a0061d9d36fd2b40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3d44009-c1", "ovs_interfaceid": "c3d44009-c128-4e98-8594-132ed6c85dbc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:46:29 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-a866f3fb-2c7c-4d8b-a1fb-744335c6948f tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0b:f3:cf,bridge_name='br-int',has_traffic_filtering=True,id=c3d44009-c128-4e98-8594-132ed6c85dbc,network=Network(b06b85af-96d9-41cb-9ad2-7fc0523761e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3d44009-c1') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:46:29 user nova-compute[75176]: DEBUG os_vif [None req-a866f3fb-2c7c-4d8b-a1fb-744335c6948f tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0b:f3:cf,bridge_name='br-int',has_traffic_filtering=True,id=c3d44009-c128-4e98-8594-132ed6c85dbc,network=Network(b06b85af-96d9-41cb-9ad2-7fc0523761e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3d44009-c1') {{(pid=75176) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 15:46:29 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:46:29 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc3d44009-c1, bridge=br-int, if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:46:29 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:46:29 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:46:29 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:46:29 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=efcd93df-089e-4b3c-835e-5a5a25c4e4b2) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:46:29 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:46:29 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:46:29 user nova-compute[75176]: INFO os_vif [None req-a866f3fb-2c7c-4d8b-a1fb-744335c6948f tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0b:f3:cf,bridge_name='br-int',has_traffic_filtering=True,id=c3d44009-c128-4e98-8594-132ed6c85dbc,network=Network(b06b85af-96d9-41cb-9ad2-7fc0523761e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3d44009-c1')
Nov 28 15:46:29 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-a866f3fb-2c7c-4d8b-a1fb-744335c6948f tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] [instance: 47306d53-9ad7-4cae-ba6d-1f65239ef30f] Deleting instance files /opt/stack/data/nova/instances/47306d53-9ad7-4cae-ba6d-1f65239ef30f_del
Nov 28 15:46:29 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-a866f3fb-2c7c-4d8b-a1fb-744335c6948f tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] [instance: 47306d53-9ad7-4cae-ba6d-1f65239ef30f] Deletion of /opt/stack/data/nova/instances/47306d53-9ad7-4cae-ba6d-1f65239ef30f_del complete
Nov 28 15:46:29 user nova-compute[75176]: INFO nova.compute.manager [None req-a866f3fb-2c7c-4d8b-a1fb-744335c6948f tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] [instance: 47306d53-9ad7-4cae-ba6d-1f65239ef30f] Took 1.08 seconds to destroy the instance on the hypervisor.
Nov 28 15:46:29 user nova-compute[75176]: DEBUG oslo.service.loopingcall [None req-a866f3fb-2c7c-4d8b-a1fb-744335c6948f tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75176) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 15:46:29 user nova-compute[75176]: DEBUG nova.compute.manager [-] [instance: 47306d53-9ad7-4cae-ba6d-1f65239ef30f] Deallocating network for instance {{(pid=75176) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 15:46:29 user nova-compute[75176]: DEBUG nova.network.neutron [-] [instance: 47306d53-9ad7-4cae-ba6d-1f65239ef30f] deallocate_for_instance() {{(pid=75176) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 15:46:29 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:46:29 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:46:29 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:46:29 user nova-compute[75176]: DEBUG nova.virt.libvirt.guest [None req-9ff9f3fa-368a-4cfb-af6e-e2878c625c40 tempest-TestVolumeSwap-440541491 tempest-TestVolumeSwap-440541491-project-admin] COPY block job progress, current cursor: 6291456 final cursor: 1073741824 {{(pid=75176) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 15:46:29 user nova-compute[75176]: DEBUG nova.network.neutron [-] [instance: 47306d53-9ad7-4cae-ba6d-1f65239ef30f] Updating instance_info_cache with network_info: [] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:46:29 user nova-compute[75176]: INFO nova.compute.manager [-] [instance: 47306d53-9ad7-4cae-ba6d-1f65239ef30f] Took 0.49 seconds to deallocate network for instance.
Nov 28 15:46:29 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-a866f3fb-2c7c-4d8b-a1fb-744335c6948f tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:46:29 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-a866f3fb-2c7c-4d8b-a1fb-744335c6948f tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:46:30 user nova-compute[75176]: DEBUG nova.virt.libvirt.guest [None req-9ff9f3fa-368a-4cfb-af6e-e2878c625c40 tempest-TestVolumeSwap-440541491 tempest-TestVolumeSwap-440541491-project-admin] COPY block job progress, current cursor: 134217728 final cursor: 1073741824 {{(pid=75176) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 15:46:30 user nova-compute[75176]: DEBUG nova.compute.provider_tree [None req-a866f3fb-2c7c-4d8b-a1fb-744335c6948f tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Inventory has not changed in ProviderTree for provider: b37848d8-f401-4155-a029-b0ffa09ff85b {{(pid=75176) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 15:46:30 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-a866f3fb-2c7c-4d8b-a1fb-744335c6948f tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Inventory has not changed for provider b37848d8-f401-4155-a029-b0ffa09ff85b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75176) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 15:46:30 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-a866f3fb-2c7c-4d8b-a1fb-744335c6948f tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.558s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:46:30 user nova-compute[75176]: INFO nova.scheduler.client.report [None req-a866f3fb-2c7c-4d8b-a1fb-744335c6948f tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Deleted allocations for instance 47306d53-9ad7-4cae-ba6d-1f65239ef30f
Nov 28 15:46:30 user nova-compute[75176]: DEBUG nova.compute.manager [req-6c08eecf-e1ff-4a5f-a573-5927916eb76e req-6fec3bd9-6274-4b9a-992b-c13533b5f968 service nova] [instance: 47306d53-9ad7-4cae-ba6d-1f65239ef30f] Received event network-vif-plugged-c3d44009-c128-4e98-8594-132ed6c85dbc {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:46:30 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-6c08eecf-e1ff-4a5f-a573-5927916eb76e req-6fec3bd9-6274-4b9a-992b-c13533b5f968 service nova] Acquiring lock "47306d53-9ad7-4cae-ba6d-1f65239ef30f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:46:30 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-6c08eecf-e1ff-4a5f-a573-5927916eb76e req-6fec3bd9-6274-4b9a-992b-c13533b5f968 service nova] Lock "47306d53-9ad7-4cae-ba6d-1f65239ef30f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:46:30 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-6c08eecf-e1ff-4a5f-a573-5927916eb76e req-6fec3bd9-6274-4b9a-992b-c13533b5f968 service nova] Lock "47306d53-9ad7-4cae-ba6d-1f65239ef30f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:46:30 user nova-compute[75176]: DEBUG nova.compute.manager [req-6c08eecf-e1ff-4a5f-a573-5927916eb76e req-6fec3bd9-6274-4b9a-992b-c13533b5f968 service nova] [instance: 47306d53-9ad7-4cae-ba6d-1f65239ef30f] No waiting events found dispatching network-vif-plugged-c3d44009-c128-4e98-8594-132ed6c85dbc {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:46:30 user nova-compute[75176]: WARNING nova.compute.manager [req-6c08eecf-e1ff-4a5f-a573-5927916eb76e req-6fec3bd9-6274-4b9a-992b-c13533b5f968 service nova] [instance: 47306d53-9ad7-4cae-ba6d-1f65239ef30f] Received unexpected event network-vif-plugged-c3d44009-c128-4e98-8594-132ed6c85dbc for instance with vm_state deleted and task_state None.
Nov 28 15:46:30 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-a866f3fb-2c7c-4d8b-a1fb-744335c6948f tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Lock "47306d53-9ad7-4cae-ba6d-1f65239ef30f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.458s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:46:30 user nova-compute[75176]: DEBUG nova.virt.libvirt.guest [None req-9ff9f3fa-368a-4cfb-af6e-e2878c625c40 tempest-TestVolumeSwap-440541491 tempest-TestVolumeSwap-440541491-project-admin] COPY block job progress, current cursor: 283115520 final cursor: 1073741824 {{(pid=75176) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 15:46:30 user nova-compute[75176]: DEBUG nova.compute.manager [req-ab7e7d23-2f0f-4907-b69f-6581edfd2bf1 req-69ffdeb7-e3b3-4a9c-8d22-d182c6a16ace service nova] [instance: 0e465c9f-e8ab-4a28-bf74-2936a272a0e2] Received event network-vif-plugged-86effed2-558e-4427-82be-761ca28e6d8c {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:46:30 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-ab7e7d23-2f0f-4907-b69f-6581edfd2bf1 req-69ffdeb7-e3b3-4a9c-8d22-d182c6a16ace service nova] Acquiring lock "0e465c9f-e8ab-4a28-bf74-2936a272a0e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:46:30 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-ab7e7d23-2f0f-4907-b69f-6581edfd2bf1 req-69ffdeb7-e3b3-4a9c-8d22-d182c6a16ace service nova] Lock "0e465c9f-e8ab-4a28-bf74-2936a272a0e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:46:30 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-ab7e7d23-2f0f-4907-b69f-6581edfd2bf1 req-69ffdeb7-e3b3-4a9c-8d22-d182c6a16ace service nova] Lock "0e465c9f-e8ab-4a28-bf74-2936a272a0e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:46:30 user nova-compute[75176]: DEBUG nova.compute.manager [req-ab7e7d23-2f0f-4907-b69f-6581edfd2bf1 req-69ffdeb7-e3b3-4a9c-8d22-d182c6a16ace service nova] [instance: 0e465c9f-e8ab-4a28-bf74-2936a272a0e2] No waiting events found dispatching network-vif-plugged-86effed2-558e-4427-82be-761ca28e6d8c {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:46:30 user nova-compute[75176]: WARNING nova.compute.manager [req-ab7e7d23-2f0f-4907-b69f-6581edfd2bf1 req-69ffdeb7-e3b3-4a9c-8d22-d182c6a16ace service nova] [instance: 0e465c9f-e8ab-4a28-bf74-2936a272a0e2] Received unexpected event network-vif-plugged-86effed2-558e-4427-82be-761ca28e6d8c for instance with vm_state building and task_state spawning.
Nov 28 15:46:30 user nova-compute[75176]: DEBUG nova.compute.manager [req-ab7e7d23-2f0f-4907-b69f-6581edfd2bf1 req-69ffdeb7-e3b3-4a9c-8d22-d182c6a16ace service nova] [instance: 47306d53-9ad7-4cae-ba6d-1f65239ef30f] Received event network-vif-deleted-c3d44009-c128-4e98-8594-132ed6c85dbc {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:46:31 user nova-compute[75176]: DEBUG nova.virt.libvirt.guest [None req-9ff9f3fa-368a-4cfb-af6e-e2878c625c40 tempest-TestVolumeSwap-440541491 tempest-TestVolumeSwap-440541491-project-admin] COPY block job progress, current cursor: 430964736 final cursor: 1073741824 {{(pid=75176) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 15:46:31 user nova-compute[75176]: DEBUG nova.virt.libvirt.guest [None req-9ff9f3fa-368a-4cfb-af6e-e2878c625c40 tempest-TestVolumeSwap-440541491 tempest-TestVolumeSwap-440541491-project-admin] COPY block job progress, current cursor: 588251136 final cursor: 1073741824 {{(pid=75176) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 15:46:31 user nova-compute[75176]: DEBUG nova.compute.manager [None req-52f7d927-1c7a-4e53-8488-0f59f3fa6d7b tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] [instance: 0e465c9f-e8ab-4a28-bf74-2936a272a0e2] Instance event wait completed in 0 seconds for  {{(pid=75176) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 15:46:31 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-52f7d927-1c7a-4e53-8488-0f59f3fa6d7b tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] [instance: 0e465c9f-e8ab-4a28-bf74-2936a272a0e2] Guest created on hypervisor {{(pid=75176) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 15:46:31 user nova-compute[75176]: INFO nova.virt.libvirt.driver [-] [instance: 0e465c9f-e8ab-4a28-bf74-2936a272a0e2] Instance spawned successfully.
Nov 28 15:46:31 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-52f7d927-1c7a-4e53-8488-0f59f3fa6d7b tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] [instance: 0e465c9f-e8ab-4a28-bf74-2936a272a0e2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 15:46:32 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-52f7d927-1c7a-4e53-8488-0f59f3fa6d7b tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] [instance: 0e465c9f-e8ab-4a28-bf74-2936a272a0e2] Found default for hw_cdrom_bus of ide {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:46:32 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-52f7d927-1c7a-4e53-8488-0f59f3fa6d7b tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] [instance: 0e465c9f-e8ab-4a28-bf74-2936a272a0e2] Found default for hw_disk_bus of virtio {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:46:32 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-52f7d927-1c7a-4e53-8488-0f59f3fa6d7b tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] [instance: 0e465c9f-e8ab-4a28-bf74-2936a272a0e2] Found default for hw_input_bus of None {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:46:32 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-52f7d927-1c7a-4e53-8488-0f59f3fa6d7b tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] [instance: 0e465c9f-e8ab-4a28-bf74-2936a272a0e2] Found default for hw_pointer_model of None {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:46:32 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-52f7d927-1c7a-4e53-8488-0f59f3fa6d7b tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] [instance: 0e465c9f-e8ab-4a28-bf74-2936a272a0e2] Found default for hw_video_model of virtio {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:46:32 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-52f7d927-1c7a-4e53-8488-0f59f3fa6d7b tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] [instance: 0e465c9f-e8ab-4a28-bf74-2936a272a0e2] Found default for hw_vif_model of virtio {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:46:32 user nova-compute[75176]: DEBUG nova.virt.libvirt.guest [None req-9ff9f3fa-368a-4cfb-af6e-e2878c625c40 tempest-TestVolumeSwap-440541491 tempest-TestVolumeSwap-440541491-project-admin] COPY block job progress, current cursor: 715128832 final cursor: 1073741824 {{(pid=75176) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 15:46:32 user nova-compute[75176]: INFO nova.compute.manager [None req-52f7d927-1c7a-4e53-8488-0f59f3fa6d7b tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] [instance: 0e465c9f-e8ab-4a28-bf74-2936a272a0e2] Took 6.94 seconds to spawn the instance on the hypervisor.
Nov 28 15:46:32 user nova-compute[75176]: DEBUG nova.compute.manager [None req-52f7d927-1c7a-4e53-8488-0f59f3fa6d7b tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] [instance: 0e465c9f-e8ab-4a28-bf74-2936a272a0e2] Checking state {{(pid=75176) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 15:46:32 user nova-compute[75176]: INFO nova.compute.manager [None req-52f7d927-1c7a-4e53-8488-0f59f3fa6d7b tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] [instance: 0e465c9f-e8ab-4a28-bf74-2936a272a0e2] Took 8.02 seconds to build instance.
Nov 28 15:46:32 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-52f7d927-1c7a-4e53-8488-0f59f3fa6d7b tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Lock "0e465c9f-e8ab-4a28-bf74-2936a272a0e2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.211s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:46:32 user nova-compute[75176]: DEBUG nova.virt.libvirt.guest [None req-9ff9f3fa-368a-4cfb-af6e-e2878c625c40 tempest-TestVolumeSwap-440541491 tempest-TestVolumeSwap-440541491-project-admin] COPY block job progress, current cursor: 860880896 final cursor: 1073741824 {{(pid=75176) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 15:46:33 user nova-compute[75176]: DEBUG nova.virt.libvirt.guest [None req-9ff9f3fa-368a-4cfb-af6e-e2878c625c40 tempest-TestVolumeSwap-440541491 tempest-TestVolumeSwap-440541491-project-admin] COPY block job progress, current cursor: 969932800 final cursor: 1073741824 {{(pid=75176) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 15:46:33 user nova-compute[75176]: DEBUG nova.virt.libvirt.guest [None req-9ff9f3fa-368a-4cfb-af6e-e2878c625c40 tempest-TestVolumeSwap-440541491 tempest-TestVolumeSwap-440541491-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=75176) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 15:46:33 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ff9f3fa-368a-4cfb-af6e-e2878c625c40 tempest-TestVolumeSwap-440541491 tempest-TestVolumeSwap-440541491-project-admin] [instance: 6b3646e6-512e-4cd6-b3c1-89438c19c408] calling os-brick to detach iSCSI Volume {{(pid=75176) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 15:46:33 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ff9f3fa-368a-4cfb-af6e-e2878c625c40 tempest-TestVolumeSwap-440541491 tempest-TestVolumeSwap-440541491-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c1b8a00>, {'target_iqn': 'iqn.2010-10.org.openstack:e7728674-3e10-438c-8fa0-9fc73367663f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OlvPosBa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 15:46:33 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-9ff9f3fa-368a-4cfb-af6e-e2878c625c40 tempest-TestVolumeSwap-440541491 tempest-TestVolumeSwap-440541491-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 15:46:33 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-9ff9f3fa-368a-4cfb-af6e-e2878c625c40 tempest-TestVolumeSwap-440541491 tempest-TestVolumeSwap-440541491-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 15:46:33 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-9ff9f3fa-368a-4cfb-af6e-e2878c625c40 tempest-TestVolumeSwap-440541491 tempest-TestVolumeSwap-440541491-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 15:46:33 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:46:33 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:46:33 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[7859bcc3-1b56-4b01-9e86-b7fa13771eea]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a1f5de5d-be7a-443a-9831-791c8667c09b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:69f59c18-c5e6-4afe-a74b-afe6d64d4e49\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:070272de-513d-48de-975c-17e6ce9e5007\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e7728674-3e10-438c-8fa0-9fc73367663f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:46:33 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ff9f3fa-368a-4cfb-af6e-e2878c625c40 tempest-TestVolumeSwap-440541491 tempest-TestVolumeSwap-440541491-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 15:46:33 user nova-compute[75176]: No targets found.
Nov 28 15:46:33 user nova-compute[75176]: iSNS:
Nov 28 15:46:33 user nova-compute[75176]: No targets found.
Nov 28 15:46:33 user nova-compute[75176]: STATIC:
Nov 28 15:46:33 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:a1f5de5d-be7a-443a-9831-791c8667c09b
Nov 28 15:46:33 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:46:33 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:46:33 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d
Nov 28 15:46:33 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:46:33 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:46:33 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:69f59c18-c5e6-4afe-a74b-afe6d64d4e49
Nov 28 15:46:33 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:46:33 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:46:33 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24
Nov 28 15:46:33 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:46:33 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:46:33 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:070272de-513d-48de-975c-17e6ce9e5007
Nov 28 15:46:33 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:46:33 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:46:33 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:e7728674-3e10-438c-8fa0-9fc73367663f
Nov 28 15:46:33 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:46:33 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:46:33 user nova-compute[75176]: FIRMWARE:
Nov 28 15:46:33 user nova-compute[75176]: No targets found.
Nov 28 15:46:33 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:46:33 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ff9f3fa-368a-4cfb-af6e-e2878c625c40 tempest-TestVolumeSwap-440541491 tempest-TestVolumeSwap-440541491-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 15:46:33 user nova-compute[75176]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 15:46:33 user nova-compute[75176]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75176) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 15:46:33 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ff9f3fa-368a-4cfb-af6e-e2878c625c40 tempest-TestVolumeSwap-440541491 tempest-TestVolumeSwap-440541491-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e7728674-3e10-438c-8fa0-9fc73367663f', 0)] {{(pid=75176) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 15:46:33 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:46:33 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:46:33 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f9eb369-6c33-4dea-b43c-b9eb79b36b34]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:070272de-513d-48de-975c-17e6ce9e5007\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:69f59c18-c5e6-4afe-a74b-afe6d64d4e49\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a1f5de5d-be7a-443a-9831-791c8667c09b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e7728674-3e10-438c-8fa0-9fc73367663f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:46:33 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:46:33 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:46:33 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[b93f8b53-76e0-4e6f-a67f-7b5c0c7841f1]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1f5de5d-be7a-443a-9831-791c8667c09b (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69f59c18-c5e6-4afe-a74b-afe6d64d4e49 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7728674-3e10-438c-8fa0-9fc73367663f (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:070272de-513d-48de-975c-17e6ce9e5007 (non-flash)\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:46:33 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ff9f3fa-368a-4cfb-af6e-e2878c625c40 tempest-TestVolumeSwap-440541491 tempest-TestVolumeSwap-440541491-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1f5de5d-be7a-443a-9831-791c8667c09b (non-flash)
Nov 28 15:46:33 user nova-compute[75176]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24 (non-flash)
Nov 28 15:46:33 user nova-compute[75176]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d (non-flash)
Nov 28 15:46:33 user nova-compute[75176]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69f59c18-c5e6-4afe-a74b-afe6d64d4e49 (non-flash)
Nov 28 15:46:33 user nova-compute[75176]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7728674-3e10-438c-8fa0-9fc73367663f (non-flash)
Nov 28 15:46:33 user nova-compute[75176]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:070272de-513d-48de-975c-17e6ce9e5007 (non-flash)
Nov 28 15:46:33 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:46:33 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ff9f3fa-368a-4cfb-af6e-e2878c625c40 tempest-TestVolumeSwap-440541491 tempest-TestVolumeSwap-440541491-project-admin] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1f5de5d-be7a-443a-9831-791c8667c09b (non-flash)
Nov 28 15:46:33 user nova-compute[75176]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24 (non-flash)
Nov 28 15:46:33 user nova-compute[75176]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d (non-flash)
Nov 28 15:46:33 user nova-compute[75176]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69f59c18-c5e6-4afe-a74b-afe6d64d4e49 (non-flash)
Nov 28 15:46:33 user nova-compute[75176]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7728674-3e10-438c-8fa0-9fc73367663f (non-flash)
Nov 28 15:46:33 user nova-compute[75176]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:070272de-513d-48de-975c-17e6ce9e5007 (non-flash)
Nov 28 15:46:33 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 15:46:33 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ff9f3fa-368a-4cfb-af6e-e2878c625c40 tempest-TestVolumeSwap-440541491 tempest-TestVolumeSwap-440541491-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f464c0d17e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e7728674-3e10-438c-8fa0-9fc73367663f'): ({'sdb'}, set())}) {{(pid=75176) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 15:46:33 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-9ff9f3fa-368a-4cfb-af6e-e2878c625c40 tempest-TestVolumeSwap-440541491 tempest-TestVolumeSwap-440541491-project-admin] Removing single pathed devices sdb {{(pid=75176) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 15:46:33 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:46:33 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:46:33 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[c82baaf1-cb68-4e26-aa17-7feb5afd6e8a]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:46:33 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:46:33 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:46:33 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b93e561-a2c2-463c-be67-8e079ff70f6b]: (4, ('ok\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:46:33 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-9ff9f3fa-368a-4cfb-af6e-e2878c625c40 tempest-TestVolumeSwap-440541491 tempest-TestVolumeSwap-440541491-project-admin] Flushing IO for device /dev/sdb {{(pid=75176) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 15:46:33 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:46:33 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:46:33 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:46:33 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[f990bc3d-dc45-40a3-95d2-c61b8f7cb9e2]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:46:33 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-9ff9f3fa-368a-4cfb-af6e-e2878c625c40 tempest-TestVolumeSwap-440541491 tempest-TestVolumeSwap-440541491-project-admin] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75176) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 15:46:33 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:46:33 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.051s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:46:33 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cfb2919-166c-4e7e-bfa6-c911e7acea2c]: (4, ('1', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:46:33 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-9ff9f3fa-368a-4cfb-af6e-e2878c625c40 tempest-TestVolumeSwap-440541491 tempest-TestVolumeSwap-440541491-project-admin] Checking to see if SCSI volumes sdb have been removed. {{(pid=75176) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 15:46:33 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-9ff9f3fa-368a-4cfb-af6e-e2878c625c40 tempest-TestVolumeSwap-440541491 tempest-TestVolumeSwap-440541491-project-admin] SCSI volumes sdb have been removed. {{(pid=75176) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 15:46:33 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ff9f3fa-368a-4cfb-af6e-e2878c625c40 tempest-TestVolumeSwap-440541491 tempest-TestVolumeSwap-440541491-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e7728674-3e10-438c-8fa0-9fc73367663f')] {{(pid=75176) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 15:46:33 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7728674-3e10-438c-8fa0-9fc73367663f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:46:34 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7728674-3e10-438c-8fa0-9fc73367663f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:46:34 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[cec0df77-208a-4b2e-8697-43f551cbb51e]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:46:34 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ff9f3fa-368a-4cfb-af6e-e2878c625c40 tempest-TestVolumeSwap-440541491 tempest-TestVolumeSwap-440541491-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:46:34 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7728674-3e10-438c-8fa0-9fc73367663f -p 172.16.0.220:3260 --logout {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:46:34 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7728674-3e10-438c-8fa0-9fc73367663f -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:46:34 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[aec7155b-777b-4a7a-8e04-e7f5b166790d]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:e7728674-3e10-438c-8fa0-9fc73367663f, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:e7728674-3e10-438c-8fa0-9fc73367663f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:46:34 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ff9f3fa-368a-4cfb-af6e-e2878c625c40 tempest-TestVolumeSwap-440541491 tempest-TestVolumeSwap-440541491-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:e7728674-3e10-438c-8fa0-9fc73367663f, portal: 172.16.0.220,3260]
Nov 28 15:46:34 user nova-compute[75176]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:e7728674-3e10-438c-8fa0-9fc73367663f, portal: 172.16.0.220,3260] successful.
Nov 28 15:46:34 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:46:34 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7728674-3e10-438c-8fa0-9fc73367663f -p 172.16.0.220:3260 --op delete {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:46:34 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:46:34 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7728674-3e10-438c-8fa0-9fc73367663f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:46:34 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[03771f5d-81d6-4869-99f7-d9f203216dc1]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:46:34 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ff9f3fa-368a-4cfb-af6e-e2878c625c40 tempest-TestVolumeSwap-440541491 tempest-TestVolumeSwap-440541491-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:46:34 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-9ff9f3fa-368a-4cfb-af6e-e2878c625c40 tempest-TestVolumeSwap-440541491 tempest-TestVolumeSwap-440541491-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.362s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 15:46:34 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ff9f3fa-368a-4cfb-af6e-e2878c625c40 tempest-TestVolumeSwap-440541491 tempest-TestVolumeSwap-440541491-project-admin] <== disconnect_volume: return (362ms) None {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 15:46:34 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ff9f3fa-368a-4cfb-af6e-e2878c625c40 tempest-TestVolumeSwap-440541491 tempest-TestVolumeSwap-440541491-project-admin] [instance: 6b3646e6-512e-4cd6-b3c1-89438c19c408] Disconnected iSCSI Volume {{(pid=75176) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 15:46:34 user nova-compute[75176]: DEBUG nova.compute.manager [None req-9ff9f3fa-368a-4cfb-af6e-e2878c625c40 tempest-TestVolumeSwap-440541491 tempest-TestVolumeSwap-440541491-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:070272de-513d-48de-975c-17e6ce9e5007', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QgVoNLfF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '6b3646e6-512e-4cd6-b3c1-89438c19c408', 'attached_at': '', 'detached_at': '', 'volume_id': '070272de-513d-48de-975c-17e6ce9e5007', 'serial'} {{(pid=75176) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 28 15:46:34 user nova-compute[75176]: DEBUG nova.compute.manager [None req-9ff9f3fa-368a-4cfb-af6e-e2878c625c40 tempest-TestVolumeSwap-440541491 tempest-TestVolumeSwap-440541491-project-admin] [instance: 6b3646e6-512e-4cd6-b3c1-89438c19c408] swap_volume: removing Cinder connection for volume e7728674-3e10-438c-8fa0-9fc73367663f {{(pid=75176) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 28 15:46:35 user nova-compute[75176]: DEBUG nova.compute.manager [None req-9ff9f3fa-368a-4cfb-af6e-e2878c625c40 tempest-TestVolumeSwap-440541491 tempest-TestVolumeSwap-440541491-project-admin] [instance: 6b3646e6-512e-4cd6-b3c1-89438c19c408] swap_volume: Updating volume e7728674-3e10-438c-8fa0-9fc73367663f BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:070272de-513d-48de-975c-17e6ce9e5007", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "QgVoNLfF", "auth_password": "KPUsQj28nxdaVq", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdc", "volume_id": "070272de-513d-48de-975c-17e6ce9e5007"}, "status": "reserved", "instance": "6b3646e6-512e-4cd6-b3c1-89438c19c408", "attached_at": "", "detached_at": "", "volume_id": "070272de-513d-48de-975c-17e6ce9e5007", "serial": "070272de-513d-48de-975c-17e6ce9e5007"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '070272de-513d-48de-975c-17e6ce9e5007', 'no_device': None, 'attachment_id': '475ac7f8-5201-4eeb-9092-640bfba1f962'} {{(pid=75176) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 28 15:46:35 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-9ff9f3fa-368a-4cfb-af6e-e2878c625c40 tempest-TestVolumeSwap-440541491 tempest-TestVolumeSwap-440541491-project-admin] Lock "6b3646e6-512e-4cd6-b3c1-89438c19c408" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 19.712s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:46:36 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-9e9a051d-a4e8-42d4-a4bb-85eb0bf08135 tempest-TestVolumeSwap-440541491 tempest-TestVolumeSwap-440541491-project-admin] Acquiring lock "6b3646e6-512e-4cd6-b3c1-89438c19c408" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:46:36 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-9e9a051d-a4e8-42d4-a4bb-85eb0bf08135 tempest-TestVolumeSwap-440541491 tempest-TestVolumeSwap-440541491-project-admin] Lock "6b3646e6-512e-4cd6-b3c1-89438c19c408" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:46:36 user nova-compute[75176]: DEBUG os_brick.utils [None req-9e9a051d-a4e8-42d4-a4bb-85eb0bf08135 tempest-TestVolumeSwap-440541491 tempest-TestVolumeSwap-440541491-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 15:46:36 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:46:36 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:46:36 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a61f6fb-2c5d-4bb4-a5cd-a8dd88121870]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:edc924a949b2\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:46:36 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:46:36 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:46:36 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[991d1308-5336-4a58-8c55-2bbc9f53bb27]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:46:36 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:46:36 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:46:36 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[62d66611-56b3-491f-818b-76a28c8f750c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:46:36 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[98a6b85b-e78b-4c59-8b86-599912dea6df]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:46:36 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-9e9a051d-a4e8-42d4-a4bb-85eb0bf08135 tempest-TestVolumeSwap-440541491 tempest-TestVolumeSwap-440541491-project-admin] Running cmd (subprocess): nvme version {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:46:36 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-9e9a051d-a4e8-42d4-a4bb-85eb0bf08135 tempest-TestVolumeSwap-440541491 tempest-TestVolumeSwap-440541491-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 15:46:36 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9e9a051d-a4e8-42d4-a4bb-85eb0bf08135 tempest-TestVolumeSwap-440541491 tempest-TestVolumeSwap-440541491-project-admin] nvme not present on system {{(pid=75176) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 15:46:36 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:46:36 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 15:46:36 user nova-compute[75176]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 15:46:36 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[32b799d2-534f-4fb5-951f-863a4cc01ac2]: (4, '') {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:46:36 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.lightos [None req-9e9a051d-a4e8-42d4-a4bb-85eb0bf08135 tempest-TestVolumeSwap-440541491 tempest-TestVolumeSwap-440541491-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75176) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 15:46:36 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.lightos [None req-9e9a051d-a4e8-42d4-a4bb-85eb0bf08135 tempest-TestVolumeSwap-440541491 tempest-TestVolumeSwap-440541491-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75176) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 15:46:36 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.lightos [None req-9e9a051d-a4e8-42d4-a4bb-85eb0bf08135 tempest-TestVolumeSwap-440541491 tempest-TestVolumeSwap-440541491-project-admin] LIGHTOS: no hostnqn found. {{(pid=75176) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 15:46:36 user nova-compute[75176]: DEBUG os_brick.utils [None req-9e9a051d-a4e8-42d4-a4bb-85eb0bf08135 tempest-TestVolumeSwap-440541491 tempest-TestVolumeSwap-440541491-project-admin] <== get_connector_properties: return (145ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:edc924a949b2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 15:46:37 user nova-compute[75176]: INFO nova.compute.manager [None req-9e9a051d-a4e8-42d4-a4bb-85eb0bf08135 tempest-TestVolumeSwap-440541491 tempest-TestVolumeSwap-440541491-project-admin] [instance: 6b3646e6-512e-4cd6-b3c1-89438c19c408] Swapping volume 070272de-513d-48de-975c-17e6ce9e5007 for e7728674-3e10-438c-8fa0-9fc73367663f
Nov 28 15:46:38 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:46:39 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:46:41 user nova-compute[75176]: DEBUG nova.compute.manager [req-8d1ddf90-4666-42f3-9d7b-3f17ac6011c3 req-c43df5c5-e64c-43f4-b0aa-d1500e8aff49 service nova] [instance: 7b4c281e-5b8d-43b1-8914-572e1341c0a7] Received event network-changed-cfbc5129-eb64-42bb-bec3-cd56a2ec733c {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:46:41 user nova-compute[75176]: DEBUG nova.compute.manager [req-8d1ddf90-4666-42f3-9d7b-3f17ac6011c3 req-c43df5c5-e64c-43f4-b0aa-d1500e8aff49 service nova] [instance: 7b4c281e-5b8d-43b1-8914-572e1341c0a7] Refreshing instance network info cache due to event network-changed-cfbc5129-eb64-42bb-bec3-cd56a2ec733c. {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 15:46:41 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-8d1ddf90-4666-42f3-9d7b-3f17ac6011c3 req-c43df5c5-e64c-43f4-b0aa-d1500e8aff49 service nova] Acquiring lock "refresh_cache-7b4c281e-5b8d-43b1-8914-572e1341c0a7" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:46:41 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-8d1ddf90-4666-42f3-9d7b-3f17ac6011c3 req-c43df5c5-e64c-43f4-b0aa-d1500e8aff49 service nova] Acquired lock "refresh_cache-7b4c281e-5b8d-43b1-8914-572e1341c0a7" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:46:41 user nova-compute[75176]: DEBUG nova.network.neutron [req-8d1ddf90-4666-42f3-9d7b-3f17ac6011c3 req-c43df5c5-e64c-43f4-b0aa-d1500e8aff49 service nova] [instance: 7b4c281e-5b8d-43b1-8914-572e1341c0a7] Refreshing network info cache for port cfbc5129-eb64-42bb-bec3-cd56a2ec733c {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 15:46:41 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-6ce9a2c2-4d74-4b6e-9917-2b842a168724 tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Acquiring lock "7b4c281e-5b8d-43b1-8914-572e1341c0a7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:46:41 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-6ce9a2c2-4d74-4b6e-9917-2b842a168724 tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Lock "7b4c281e-5b8d-43b1-8914-572e1341c0a7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:46:41 user nova-compute[75176]: DEBUG nova.objects.instance [None req-6ce9a2c2-4d74-4b6e-9917-2b842a168724 tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Lazy-loading 'flavor' on Instance uuid 7b4c281e-5b8d-43b1-8914-572e1341c0a7 {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:46:41 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-6ce9a2c2-4d74-4b6e-9917-2b842a168724 tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] [instance: 7b4c281e-5b8d-43b1-8914-572e1341c0a7] Ignoring supplied device name: /dev/vdb
Nov 28 15:46:41 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-6ce9a2c2-4d74-4b6e-9917-2b842a168724 tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Lock "7b4c281e-5b8d-43b1-8914-572e1341c0a7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:46:41 user nova-compute[75176]: DEBUG nova.network.neutron [req-8d1ddf90-4666-42f3-9d7b-3f17ac6011c3 req-c43df5c5-e64c-43f4-b0aa-d1500e8aff49 service nova] [instance: 7b4c281e-5b8d-43b1-8914-572e1341c0a7] Updated VIF entry in instance network info cache for port cfbc5129-eb64-42bb-bec3-cd56a2ec733c. {{(pid=75176) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 15:46:41 user nova-compute[75176]: DEBUG nova.network.neutron [req-8d1ddf90-4666-42f3-9d7b-3f17ac6011c3 req-c43df5c5-e64c-43f4-b0aa-d1500e8aff49 service nova] [instance: 7b4c281e-5b8d-43b1-8914-572e1341c0a7] Updating instance_info_cache with network_info: [{"id": "cfbc5129-eb64-42bb-bec3-cd56a2ec733c", "address": "fa:16:3e:07:68:e7", "network": {"id": "0478f649-0c69-414b-84c3-3ef4604d6062", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-695624980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3669019a110245d19a8ac85b5b20d2bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfbc5129-eb", "ovs_interfaceid": "cfbc5129-eb64-42bb-bec3-cd56a2ec733c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:46:41 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-8d1ddf90-4666-42f3-9d7b-3f17ac6011c3 req-c43df5c5-e64c-43f4-b0aa-d1500e8aff49 service nova] Releasing lock "refresh_cache-7b4c281e-5b8d-43b1-8914-572e1341c0a7" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:46:41 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-6ce9a2c2-4d74-4b6e-9917-2b842a168724 tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Acquiring lock "7b4c281e-5b8d-43b1-8914-572e1341c0a7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:46:41 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-6ce9a2c2-4d74-4b6e-9917-2b842a168724 tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Lock "7b4c281e-5b8d-43b1-8914-572e1341c0a7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:46:41 user nova-compute[75176]: INFO nova.compute.manager [None req-6ce9a2c2-4d74-4b6e-9917-2b842a168724 tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] [instance: 7b4c281e-5b8d-43b1-8914-572e1341c0a7] Attaching volume 705191a8-a203-4bbf-93d3-2a4e75a359b9 to /dev/vdb
Nov 28 15:46:41 user nova-compute[75176]: DEBUG os_brick.utils [None req-6ce9a2c2-4d74-4b6e-9917-2b842a168724 tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 15:46:41 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:46:41 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:46:41 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[db307ab8-c2fd-4fd4-84d5-2b0794479339]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:edc924a949b2\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:46:41 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:46:41 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:46:41 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[9def36b4-251e-4575-bc54-cc61b73e0968]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:46:41 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:46:41 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:46:41 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[201c208f-4b2e-405f-bfff-0a82d5ce30d6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:46:41 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[b22873a3-c12e-4fd2-aa3c-f2471ed02f68]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:46:41 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-6ce9a2c2-4d74-4b6e-9917-2b842a168724 tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Running cmd (subprocess): nvme version {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:46:41 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-6ce9a2c2-4d74-4b6e-9917-2b842a168724 tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] 'nvme version' failed. Not Retrying. {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 15:46:41 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6ce9a2c2-4d74-4b6e-9917-2b842a168724 tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] nvme not present on system {{(pid=75176) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 15:46:41 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:46:41 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 15:46:41 user nova-compute[75176]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 15:46:41 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[53be5fbd-df22-42d2-abe7-060591e1451b]: (4, '') {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:46:41 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.lightos [None req-6ce9a2c2-4d74-4b6e-9917-2b842a168724 tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75176) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 15:46:41 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.lightos [None req-6ce9a2c2-4d74-4b6e-9917-2b842a168724 tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75176) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 15:46:41 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.lightos [None req-6ce9a2c2-4d74-4b6e-9917-2b842a168724 tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] LIGHTOS: no hostnqn found. {{(pid=75176) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 15:46:41 user nova-compute[75176]: DEBUG os_brick.utils [None req-6ce9a2c2-4d74-4b6e-9917-2b842a168724 tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:edc924a949b2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 15:46:41 user nova-compute[75176]: DEBUG nova.virt.block_device [None req-6ce9a2c2-4d74-4b6e-9917-2b842a168724 tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] [instance: 7b4c281e-5b8d-43b1-8914-572e1341c0a7] Updating existing volume attachment record: 9cf1f202-a38a-40d6-903d-6d874052a017 {{(pid=75176) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 15:46:43 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:46:44 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:46:44 user nova-compute[75176]: DEBUG nova.compute.manager [None req-9e9a051d-a4e8-42d4-a4bb-85eb0bf08135 tempest-TestVolumeSwap-440541491 tempest-TestVolumeSwap-440541491-project-admin] [instance: 6b3646e6-512e-4cd6-b3c1-89438c19c408] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e7728674-3e10-438c-8fa0-9fc73367663f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OlvPosBa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '6b3646e6-512e-4cd6-b3c1-89438c19c408', 'attached_at': '', 'detached_at': '', 'volume_id': 'e7728674-3e10-438c-8fa0-9fc73367663f', 'serial': 'e7728674-3e10-438c-8fa0-9fc73367663f'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:070272de-513d-48de-975c-17e6ce9e5007', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QgVoNLfF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc', 'volume_id': '070272de-513d-48de-975c-17e6ce9e5007'}, 'status': 'reserved', 'instance': '6b3646e6-512e-4cd6-b3c1-89438c19c408', 'attached_at': '', 'detached_at': '', 'volume_id': '070272de-513d-48de-975c-17e6ce9e5007', 'serial'} {{(pid=75176) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 28 15:46:44 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9e9a051d-a4e8-42d4-a4bb-85eb0bf08135 tempest-TestVolumeSwap-440541491 tempest-TestVolumeSwap-440541491-project-admin] [instance: 6b3646e6-512e-4cd6-b3c1-89438c19c408] Calling os-brick to attach iSCSI Volume {{(pid=75176) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 15:46:44 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e9a051d-a4e8-42d4-a4bb-85eb0bf08135 tempest-TestVolumeSwap-440541491 tempest-TestVolumeSwap-440541491-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c1b8a00>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e7728674-3e10-438c-8fa0-9fc73367663f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OlvPosBa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 15:46:44 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-9e9a051d-a4e8-42d4-a4bb-85eb0bf08135 tempest-TestVolumeSwap-440541491 tempest-TestVolumeSwap-440541491-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 15:46:44 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-9e9a051d-a4e8-42d4-a4bb-85eb0bf08135 tempest-TestVolumeSwap-440541491 tempest-TestVolumeSwap-440541491-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 15:46:44 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-9e9a051d-a4e8-42d4-a4bb-85eb0bf08135 tempest-TestVolumeSwap-440541491 tempest-TestVolumeSwap-440541491-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 15:46:44 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-9e9a051d-a4e8-42d4-a4bb-85eb0bf08135 tempest-TestVolumeSwap-440541491 tempest-TestVolumeSwap-440541491-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 15:46:44 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-9e9a051d-a4e8-42d4-a4bb-85eb0bf08135 tempest-TestVolumeSwap-440541491 tempest-TestVolumeSwap-440541491-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e7728674-3e10-438c-8fa0-9fc73367663f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 15:46:44 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-9e9a051d-a4e8-42d4-a4bb-85eb0bf08135 tempest-TestVolumeSwap-440541491 tempest-TestVolumeSwap-440541491-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e7728674-3e10-438c-8fa0-9fc73367663f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 15:46:44 user nova-compute[75176]: INFO os_brick.initiator.connectors.iscsi [None req-9e9a051d-a4e8-42d4-a4bb-85eb0bf08135 tempest-TestVolumeSwap-440541491 tempest-TestVolumeSwap-440541491-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 15:46:44 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7728674-3e10-438c-8fa0-9fc73367663f -p 172.16.0.220:3260 {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:46:44 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7728674-3e10-438c-8fa0-9fc73367663f -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:46:44 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[dad473fd-0235-4ea5-8185-57889a463c8b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:46:44 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e9a051d-a4e8-42d4-a4bb-85eb0bf08135 tempest-TestVolumeSwap-440541491 tempest-TestVolumeSwap-440541491-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 15:46:44 user nova-compute[75176]:  {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:46:44 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7728674-3e10-438c-8fa0-9fc73367663f -p 172.16.0.220:3260 --interface default --op new {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:46:44 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7728674-3e10-438c-8fa0-9fc73367663f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.031s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:46:44 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[5888b8f2-7eeb-49cd-9335-735d068c3178]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e7728674-3e10-438c-8fa0-9fc73367663f] added\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:46:44 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e9a051d-a4e8-42d4-a4bb-85eb0bf08135 tempest-TestVolumeSwap-440541491 tempest-TestVolumeSwap-440541491-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e7728674-3e10-438c-8fa0-9fc73367663f] added
Nov 28 15:46:44 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:46:44 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7728674-3e10-438c-8fa0-9fc73367663f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:46:44 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7728674-3e10-438c-8fa0-9fc73367663f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:46:44 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[a23d9813-2a21-4237-9d2a-d194b6888cf5]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:46:44 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e9a051d-a4e8-42d4-a4bb-85eb0bf08135 tempest-TestVolumeSwap-440541491 tempest-TestVolumeSwap-440541491-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:46:44 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7728674-3e10-438c-8fa0-9fc73367663f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:46:44 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7728674-3e10-438c-8fa0-9fc73367663f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:46:44 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[c15a72be-d751-467c-862a-9d3d633cc00f]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:46:44 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e9a051d-a4e8-42d4-a4bb-85eb0bf08135 tempest-TestVolumeSwap-440541491 tempest-TestVolumeSwap-440541491-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:46:44 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7728674-3e10-438c-8fa0-9fc73367663f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OlvPosBa {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:46:44 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7728674-3e10-438c-8fa0-9fc73367663f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OlvPosBa" returned: 0 in 0.019s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:46:44 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[e75de268-0381-4bd6-9190-bdc4e2a67dec]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:46:44 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e9a051d-a4e8-42d4-a4bb-85eb0bf08135 tempest-TestVolumeSwap-440541491 tempest-TestVolumeSwap-440541491-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OlvPosBa'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:46:44 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7728674-3e10-438c-8fa0-9fc73367663f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:46:44 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7728674-3e10-438c-8fa0-9fc73367663f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:46:44 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3140c0d-d9bd-40bd-8ba0-eebe3f1892c7]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:46:44 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e9a051d-a4e8-42d4-a4bb-85eb0bf08135 tempest-TestVolumeSwap-440541491 tempest-TestVolumeSwap-440541491-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:46:44 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:46:44 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:46:44 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7de55ab-8baa-413e-bf5d-a2506798f44c]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1f5de5d-be7a-443a-9831-791c8667c09b (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69f59c18-c5e6-4afe-a74b-afe6d64d4e49 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:070272de-513d-48de-975c-17e6ce9e5007 (non-flash)\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:46:44 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e9a051d-a4e8-42d4-a4bb-85eb0bf08135 tempest-TestVolumeSwap-440541491 tempest-TestVolumeSwap-440541491-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1f5de5d-be7a-443a-9831-791c8667c09b (non-flash)
Nov 28 15:46:44 user nova-compute[75176]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24 (non-flash)
Nov 28 15:46:44 user nova-compute[75176]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d (non-flash)
Nov 28 15:46:44 user nova-compute[75176]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69f59c18-c5e6-4afe-a74b-afe6d64d4e49 (non-flash)
Nov 28 15:46:44 user nova-compute[75176]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:070272de-513d-48de-975c-17e6ce9e5007 (non-flash)
Nov 28 15:46:44 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:46:44 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e9a051d-a4e8-42d4-a4bb-85eb0bf08135 tempest-TestVolumeSwap-440541491 tempest-TestVolumeSwap-440541491-project-admin] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1f5de5d-be7a-443a-9831-791c8667c09b (non-flash)
Nov 28 15:46:44 user nova-compute[75176]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24 (non-flash)
Nov 28 15:46:44 user nova-compute[75176]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d (non-flash)
Nov 28 15:46:44 user nova-compute[75176]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69f59c18-c5e6-4afe-a74b-afe6d64d4e49 (non-flash)
Nov 28 15:46:44 user nova-compute[75176]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:070272de-513d-48de-975c-17e6ce9e5007 (non-flash)
Nov 28 15:46:44 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 15:46:44 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7728674-3e10-438c-8fa0-9fc73367663f -p 172.16.0.220:3260 --login {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:46:45 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7728674-3e10-438c-8fa0-9fc73367663f -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:46:45 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cf356a3-252b-4270-b365-72160a652368]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e7728674-3e10-438c-8fa0-9fc73367663f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e7728674-3e10-438c-8fa0-9fc73367663f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:46:45 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e9a051d-a4e8-42d4-a4bb-85eb0bf08135 tempest-TestVolumeSwap-440541491 tempest-TestVolumeSwap-440541491-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e7728674-3e10-438c-8fa0-9fc73367663f, portal: 172.16.0.220,3260]
Nov 28 15:46:45 user nova-compute[75176]: Login to [iface: default, target: iqn.2010-10.org.openstack:e7728674-3e10-438c-8fa0-9fc73367663f, portal: 172.16.0.220,3260] successful.
Nov 28 15:46:45 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:46:45 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7728674-3e10-438c-8fa0-9fc73367663f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:46:45 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7728674-3e10-438c-8fa0-9fc73367663f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.033s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:46:45 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f23b2a9-f027-4971-8481-f9a000083587]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:46:45 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e9a051d-a4e8-42d4-a4bb-85eb0bf08135 tempest-TestVolumeSwap-440541491 tempest-TestVolumeSwap-440541491-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:46:45 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:46:45 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:46:45 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[926b8e8b-01cc-4a7d-bbf0-c836d5283556]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1f5de5d-be7a-443a-9831-791c8667c09b (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69f59c18-c5e6-4afe-a74b-afe6d64d4e49 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:070272de-513d-48de-975c-17e6ce9e5007 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7728674-3e10-438c-8fa0-9fc73367663f (non-flash)\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:46:45 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e9a051d-a4e8-42d4-a4bb-85eb0bf08135 tempest-TestVolumeSwap-440541491 tempest-TestVolumeSwap-440541491-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1f5de5d-be7a-443a-9831-791c8667c09b (non-flash)
Nov 28 15:46:45 user nova-compute[75176]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24 (non-flash)
Nov 28 15:46:45 user nova-compute[75176]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d (non-flash)
Nov 28 15:46:45 user nova-compute[75176]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69f59c18-c5e6-4afe-a74b-afe6d64d4e49 (non-flash)
Nov 28 15:46:45 user nova-compute[75176]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:070272de-513d-48de-975c-17e6ce9e5007 (non-flash)
Nov 28 15:46:45 user nova-compute[75176]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7728674-3e10-438c-8fa0-9fc73367663f (non-flash)
Nov 28 15:46:45 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:46:45 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e9a051d-a4e8-42d4-a4bb-85eb0bf08135 tempest-TestVolumeSwap-440541491 tempest-TestVolumeSwap-440541491-project-admin] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1f5de5d-be7a-443a-9831-791c8667c09b (non-flash)
Nov 28 15:46:45 user nova-compute[75176]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24 (non-flash)
Nov 28 15:46:45 user nova-compute[75176]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d (non-flash)
Nov 28 15:46:45 user nova-compute[75176]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69f59c18-c5e6-4afe-a74b-afe6d64d4e49 (non-flash)
Nov 28 15:46:45 user nova-compute[75176]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:070272de-513d-48de-975c-17e6ce9e5007 (non-flash)
Nov 28 15:46:45 user nova-compute[75176]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7728674-3e10-438c-8fa0-9fc73367663f (non-flash)
Nov 28 15:46:45 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 15:46:45 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-9e9a051d-a4e8-42d4-a4bb-85eb0bf08135 tempest-TestVolumeSwap-440541491 tempest-TestVolumeSwap-440541491-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e7728674-3e10-438c-8fa0-9fc73367663f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.355s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 15:46:45 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e9a051d-a4e8-42d4-a4bb-85eb0bf08135 tempest-TestVolumeSwap-440541491 tempest-TestVolumeSwap-440541491-project-admin] Connected to 172.16.0.220:3260 {{(pid=75176) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 15:46:45 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-9e9a051d-a4e8-42d4-a4bb-85eb0bf08135 tempest-TestVolumeSwap-440541491 tempest-TestVolumeSwap-440541491-project-admin] HCTL ('33', '-', '-', 0) found on session 28 with lun 0 {{(pid=75176) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 15:46:45 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-9e9a051d-a4e8-42d4-a4bb-85eb0bf08135 tempest-TestVolumeSwap-440541491 tempest-TestVolumeSwap-440541491-project-admin] Scanning host 33 c: -, t: -, l: 0) {{(pid=75176) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 15:46:45 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:46:45 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:46:45 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[43b1b7eb-0f24-497e-a1e0-af005cc1014a]: (4, ('- - 0', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:46:45 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-9e9a051d-a4e8-42d4-a4bb-85eb0bf08135 tempest-TestVolumeSwap-440541491 tempest-TestVolumeSwap-440541491-project-admin] Searching for a device in session 28 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75176) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 15:46:45 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e9a051d-a4e8-42d4-a4bb-85eb0bf08135 tempest-TestVolumeSwap-440541491 tempest-TestVolumeSwap-440541491-project-admin] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:e7728674-3e10-438c-8fa0-9fc73367663f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OlvPosBa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75176) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 15:46:46 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-9e9a051d-a4e8-42d4-a4bb-85eb0bf08135 tempest-TestVolumeSwap-440541491 tempest-TestVolumeSwap-440541491-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.401s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 15:46:46 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e9a051d-a4e8-42d4-a4bb-85eb0bf08135 tempest-TestVolumeSwap-440541491 tempest-TestVolumeSwap-440541491-project-admin] <== connect_volume: return (1403ms) {'type': 'block', 'scsi_wwn': '26362353930386337', 'path': '/dev/sdb'} {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 15:46:46 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9e9a051d-a4e8-42d4-a4bb-85eb0bf08135 tempest-TestVolumeSwap-440541491 tempest-TestVolumeSwap-440541491-project-admin] [instance: 6b3646e6-512e-4cd6-b3c1-89438c19c408] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26362353930386337', 'path': '/dev/sdb'} {{(pid=75176) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 15:46:46 user nova-compute[75176]: DEBUG nova.objects.instance [None req-9e9a051d-a4e8-42d4-a4bb-85eb0bf08135 tempest-TestVolumeSwap-440541491 tempest-TestVolumeSwap-440541491-project-admin] Lazy-loading 'flavor' on Instance uuid 6b3646e6-512e-4cd6-b3c1-89438c19c408 {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:46:46 user nova-compute[75176]: DEBUG nova.virt.libvirt.guest [None req-9e9a051d-a4e8-42d4-a4bb-85eb0bf08135 tempest-TestVolumeSwap-440541491 tempest-TestVolumeSwap-440541491-project-admin] COPY block job progress, current cursor: 5242880 final cursor: 1073741824 {{(pid=75176) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 15:46:47 user nova-compute[75176]: DEBUG nova.virt.libvirt.guest [None req-9e9a051d-a4e8-42d4-a4bb-85eb0bf08135 tempest-TestVolumeSwap-440541491 tempest-TestVolumeSwap-440541491-project-admin] COPY block job progress, current cursor: 163577856 final cursor: 1073741824 {{(pid=75176) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 15:46:47 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:46:47 user nova-compute[75176]: DEBUG nova.virt.libvirt.guest [None req-9e9a051d-a4e8-42d4-a4bb-85eb0bf08135 tempest-TestVolumeSwap-440541491 tempest-TestVolumeSwap-440541491-project-admin] COPY block job progress, current cursor: 284164096 final cursor: 1073741824 {{(pid=75176) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 15:46:48 user nova-compute[75176]: DEBUG nova.virt.libvirt.guest [None req-9e9a051d-a4e8-42d4-a4bb-85eb0bf08135 tempest-TestVolumeSwap-440541491 tempest-TestVolumeSwap-440541491-project-admin] COPY block job progress, current cursor: 477102080 final cursor: 1073741824 {{(pid=75176) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 15:46:48 user nova-compute[75176]: DEBUG nova.virt.libvirt.guest [None req-9e9a051d-a4e8-42d4-a4bb-85eb0bf08135 tempest-TestVolumeSwap-440541491 tempest-TestVolumeSwap-440541491-project-admin] COPY block job progress, current cursor: 659554304 final cursor: 1073741824 {{(pid=75176) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 15:46:48 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:46:49 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:46:49 user nova-compute[75176]: DEBUG nova.virt.libvirt.guest [None req-9e9a051d-a4e8-42d4-a4bb-85eb0bf08135 tempest-TestVolumeSwap-440541491 tempest-TestVolumeSwap-440541491-project-admin] COPY block job progress, current cursor: 822083584 final cursor: 1073741824 {{(pid=75176) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 15:46:49 user nova-compute[75176]: DEBUG nova.virt.libvirt.guest [None req-9e9a051d-a4e8-42d4-a4bb-85eb0bf08135 tempest-TestVolumeSwap-440541491 tempest-TestVolumeSwap-440541491-project-admin] COPY block job progress, current cursor: 959447040 final cursor: 1073741824 {{(pid=75176) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 15:46:50 user nova-compute[75176]: DEBUG nova.virt.libvirt.guest [None req-9e9a051d-a4e8-42d4-a4bb-85eb0bf08135 tempest-TestVolumeSwap-440541491 tempest-TestVolumeSwap-440541491-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=75176) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 15:46:50 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9e9a051d-a4e8-42d4-a4bb-85eb0bf08135 tempest-TestVolumeSwap-440541491 tempest-TestVolumeSwap-440541491-project-admin] [instance: 6b3646e6-512e-4cd6-b3c1-89438c19c408] calling os-brick to detach iSCSI Volume {{(pid=75176) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 15:46:50 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e9a051d-a4e8-42d4-a4bb-85eb0bf08135 tempest-TestVolumeSwap-440541491 tempest-TestVolumeSwap-440541491-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c1b8a00>, {'target_iqn': 'iqn.2010-10.org.openstack:070272de-513d-48de-975c-17e6ce9e5007', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QgVoNLfF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc', 'volume_id': '070272de-513d-48de-975c-17e6ce9e5007'}, None), 'kwargs': False}}" {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 15:46:50 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-9e9a051d-a4e8-42d4-a4bb-85eb0bf08135 tempest-TestVolumeSwap-440541491 tempest-TestVolumeSwap-440541491-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 15:46:50 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-9e9a051d-a4e8-42d4-a4bb-85eb0bf08135 tempest-TestVolumeSwap-440541491 tempest-TestVolumeSwap-440541491-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 15:46:50 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-9e9a051d-a4e8-42d4-a4bb-85eb0bf08135 tempest-TestVolumeSwap-440541491 tempest-TestVolumeSwap-440541491-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 15:46:50 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:46:50 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:46:50 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[49aa43ac-dbb5-4777-8d17-575e33780013]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a1f5de5d-be7a-443a-9831-791c8667c09b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:69f59c18-c5e6-4afe-a74b-afe6d64d4e49\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:070272de-513d-48de-975c-17e6ce9e5007\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e7728674-3e10-438c-8fa0-9fc73367663f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:46:50 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e9a051d-a4e8-42d4-a4bb-85eb0bf08135 tempest-TestVolumeSwap-440541491 tempest-TestVolumeSwap-440541491-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 15:46:50 user nova-compute[75176]: No targets found.
Nov 28 15:46:50 user nova-compute[75176]: iSNS:
Nov 28 15:46:50 user nova-compute[75176]: No targets found.
Nov 28 15:46:50 user nova-compute[75176]: STATIC:
Nov 28 15:46:50 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:a1f5de5d-be7a-443a-9831-791c8667c09b
Nov 28 15:46:50 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:46:50 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:46:50 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d
Nov 28 15:46:50 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:46:50 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:46:50 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:69f59c18-c5e6-4afe-a74b-afe6d64d4e49
Nov 28 15:46:50 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:46:50 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:46:50 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24
Nov 28 15:46:50 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:46:50 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:46:50 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:070272de-513d-48de-975c-17e6ce9e5007
Nov 28 15:46:50 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:46:50 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:46:50 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:e7728674-3e10-438c-8fa0-9fc73367663f
Nov 28 15:46:50 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:46:50 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:46:50 user nova-compute[75176]: FIRMWARE:
Nov 28 15:46:50 user nova-compute[75176]: No targets found.
Nov 28 15:46:50 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:46:50 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e9a051d-a4e8-42d4-a4bb-85eb0bf08135 tempest-TestVolumeSwap-440541491 tempest-TestVolumeSwap-440541491-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 15:46:50 user nova-compute[75176]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 15:46:50 user nova-compute[75176]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75176) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 15:46:50 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e9a051d-a4e8-42d4-a4bb-85eb0bf08135 tempest-TestVolumeSwap-440541491 tempest-TestVolumeSwap-440541491-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:070272de-513d-48de-975c-17e6ce9e5007', 0)] {{(pid=75176) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 15:46:50 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:46:50 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:46:50 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e52017f-143a-4786-aacb-5c93f306cd6c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:070272de-513d-48de-975c-17e6ce9e5007\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:69f59c18-c5e6-4afe-a74b-afe6d64d4e49\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a1f5de5d-be7a-443a-9831-791c8667c09b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e7728674-3e10-438c-8fa0-9fc73367663f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:46:50 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:46:50 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:46:50 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c2bea24-b6b7-4413-a5bc-fd5784de8c6e]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1f5de5d-be7a-443a-9831-791c8667c09b (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69f59c18-c5e6-4afe-a74b-afe6d64d4e49 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:070272de-513d-48de-975c-17e6ce9e5007 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7728674-3e10-438c-8fa0-9fc73367663f (non-flash)\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:46:50 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e9a051d-a4e8-42d4-a4bb-85eb0bf08135 tempest-TestVolumeSwap-440541491 tempest-TestVolumeSwap-440541491-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1f5de5d-be7a-443a-9831-791c8667c09b (non-flash)
Nov 28 15:46:50 user nova-compute[75176]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24 (non-flash)
Nov 28 15:46:50 user nova-compute[75176]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d (non-flash)
Nov 28 15:46:50 user nova-compute[75176]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69f59c18-c5e6-4afe-a74b-afe6d64d4e49 (non-flash)
Nov 28 15:46:50 user nova-compute[75176]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:070272de-513d-48de-975c-17e6ce9e5007 (non-flash)
Nov 28 15:46:50 user nova-compute[75176]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7728674-3e10-438c-8fa0-9fc73367663f (non-flash)
Nov 28 15:46:50 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:46:50 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e9a051d-a4e8-42d4-a4bb-85eb0bf08135 tempest-TestVolumeSwap-440541491 tempest-TestVolumeSwap-440541491-project-admin] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1f5de5d-be7a-443a-9831-791c8667c09b (non-flash)
Nov 28 15:46:50 user nova-compute[75176]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24 (non-flash)
Nov 28 15:46:50 user nova-compute[75176]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d (non-flash)
Nov 28 15:46:50 user nova-compute[75176]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69f59c18-c5e6-4afe-a74b-afe6d64d4e49 (non-flash)
Nov 28 15:46:50 user nova-compute[75176]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:070272de-513d-48de-975c-17e6ce9e5007 (non-flash)
Nov 28 15:46:50 user nova-compute[75176]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7728674-3e10-438c-8fa0-9fc73367663f (non-flash)
Nov 28 15:46:50 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 15:46:50 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e9a051d-a4e8-42d4-a4bb-85eb0bf08135 tempest-TestVolumeSwap-440541491 tempest-TestVolumeSwap-440541491-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f462c6af640>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:070272de-513d-48de-975c-17e6ce9e5007'): ({'sdc'}, set())}) {{(pid=75176) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 15:46:50 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-9e9a051d-a4e8-42d4-a4bb-85eb0bf08135 tempest-TestVolumeSwap-440541491 tempest-TestVolumeSwap-440541491-project-admin] Removing single pathed devices sdc {{(pid=75176) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 15:46:50 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:46:50 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:46:50 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[2820fa5a-fb1e-440c-b6bb-e83360a9517f]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:46:50 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:46:50 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:46:50 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[210f5f7c-d687-41be-a443-2973d4295f76]: (4, ('ok\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:46:50 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-9e9a051d-a4e8-42d4-a4bb-85eb0bf08135 tempest-TestVolumeSwap-440541491 tempest-TestVolumeSwap-440541491-project-admin] Flushing IO for device /dev/sdc {{(pid=75176) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 15:46:50 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:46:50 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:46:50 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca31870c-d85d-4f58-ad83-3fa2b2dda22e]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:46:50 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-9e9a051d-a4e8-42d4-a4bb-85eb0bf08135 tempest-TestVolumeSwap-440541491 tempest-TestVolumeSwap-440541491-project-admin] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75176) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 15:46:50 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:46:50 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.042s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:46:50 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[fde4d71a-a4d3-44dc-8e79-ec12742e16a6]: (4, ('1', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:46:50 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-9e9a051d-a4e8-42d4-a4bb-85eb0bf08135 tempest-TestVolumeSwap-440541491 tempest-TestVolumeSwap-440541491-project-admin] Checking to see if SCSI volumes sdc have been removed. {{(pid=75176) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 15:46:50 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-9e9a051d-a4e8-42d4-a4bb-85eb0bf08135 tempest-TestVolumeSwap-440541491 tempest-TestVolumeSwap-440541491-project-admin] SCSI volumes sdc have been removed. {{(pid=75176) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 15:46:50 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e9a051d-a4e8-42d4-a4bb-85eb0bf08135 tempest-TestVolumeSwap-440541491 tempest-TestVolumeSwap-440541491-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:070272de-513d-48de-975c-17e6ce9e5007')] {{(pid=75176) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 15:46:50 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:070272de-513d-48de-975c-17e6ce9e5007 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:46:50 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:46:50 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:070272de-513d-48de-975c-17e6ce9e5007 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:46:50 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[deed4d31-2588-42e9-a943-969ada246185]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:46:50 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e9a051d-a4e8-42d4-a4bb-85eb0bf08135 tempest-TestVolumeSwap-440541491 tempest-TestVolumeSwap-440541491-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:46:50 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:070272de-513d-48de-975c-17e6ce9e5007 -p 172.16.0.220:3260 --logout {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:46:50 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:070272de-513d-48de-975c-17e6ce9e5007 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:46:50 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[6098fa48-dcdb-4f45-9078-1b73193d4efe]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:070272de-513d-48de-975c-17e6ce9e5007, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:070272de-513d-48de-975c-17e6ce9e5007, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:46:50 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e9a051d-a4e8-42d4-a4bb-85eb0bf08135 tempest-TestVolumeSwap-440541491 tempest-TestVolumeSwap-440541491-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:070272de-513d-48de-975c-17e6ce9e5007, portal: 172.16.0.220,3260]
Nov 28 15:46:50 user nova-compute[75176]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:070272de-513d-48de-975c-17e6ce9e5007, portal: 172.16.0.220,3260] successful.
Nov 28 15:46:50 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:46:50 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:070272de-513d-48de-975c-17e6ce9e5007 -p 172.16.0.220:3260 --op delete {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:46:50 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:070272de-513d-48de-975c-17e6ce9e5007 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:46:50 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[70617469-bb89-46a6-ac61-cf1a4ebaddbc]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:46:50 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e9a051d-a4e8-42d4-a4bb-85eb0bf08135 tempest-TestVolumeSwap-440541491 tempest-TestVolumeSwap-440541491-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:46:50 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-9e9a051d-a4e8-42d4-a4bb-85eb0bf08135 tempest-TestVolumeSwap-440541491 tempest-TestVolumeSwap-440541491-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.343s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 15:46:50 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e9a051d-a4e8-42d4-a4bb-85eb0bf08135 tempest-TestVolumeSwap-440541491 tempest-TestVolumeSwap-440541491-project-admin] <== disconnect_volume: return (345ms) None {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 15:46:50 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9e9a051d-a4e8-42d4-a4bb-85eb0bf08135 tempest-TestVolumeSwap-440541491 tempest-TestVolumeSwap-440541491-project-admin] [instance: 6b3646e6-512e-4cd6-b3c1-89438c19c408] Disconnected iSCSI Volume {{(pid=75176) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 15:46:50 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6ce9a2c2-4d74-4b6e-9917-2b842a168724 tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] [instance: 7b4c281e-5b8d-43b1-8914-572e1341c0a7] Calling os-brick to attach iSCSI Volume {{(pid=75176) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 15:46:50 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ce9a2c2-4d74-4b6e-9917-2b842a168724 tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c1b8a00>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:705191a8-a203-4bbf-93d3-2a4e75a359b9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KwdWHJLy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 15:46:50 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-6ce9a2c2-4d74-4b6e-9917-2b842a168724 tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 15:46:50 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-6ce9a2c2-4d74-4b6e-9917-2b842a168724 tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 15:46:50 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-6ce9a2c2-4d74-4b6e-9917-2b842a168724 tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 15:46:50 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-6ce9a2c2-4d74-4b6e-9917-2b842a168724 tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 15:46:50 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-6ce9a2c2-4d74-4b6e-9917-2b842a168724 tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:705191a8-a203-4bbf-93d3-2a4e75a359b9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 15:46:50 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-6ce9a2c2-4d74-4b6e-9917-2b842a168724 tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:705191a8-a203-4bbf-93d3-2a4e75a359b9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 15:46:50 user nova-compute[75176]: INFO os_brick.initiator.connectors.iscsi [None req-6ce9a2c2-4d74-4b6e-9917-2b842a168724 tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 15:46:50 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:705191a8-a203-4bbf-93d3-2a4e75a359b9 -p 172.16.0.220:3260 {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:46:50 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:46:50 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:705191a8-a203-4bbf-93d3-2a4e75a359b9 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:46:50 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[6733e2f9-10b9-4c91-9c77-91fa132a7da5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:46:50 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ce9a2c2-4d74-4b6e-9917-2b842a168724 tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 15:46:50 user nova-compute[75176]:  {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:46:50 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:705191a8-a203-4bbf-93d3-2a4e75a359b9 -p 172.16.0.220:3260 --interface default --op new {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:46:50 user nova-compute[75176]: DEBUG nova.compute.manager [None req-9e9a051d-a4e8-42d4-a4bb-85eb0bf08135 tempest-TestVolumeSwap-440541491 tempest-TestVolumeSwap-440541491-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e7728674-3e10-438c-8fa0-9fc73367663f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OlvPosBa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '6b3646e6-512e-4cd6-b3c1-89438c19c408', 'attached_at': '', 'detached_at': '', 'volume_id': 'e7728674-3e10-438c-8fa0-9fc73367663f', 'serial'} {{(pid=75176) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 28 15:46:50 user nova-compute[75176]: DEBUG nova.compute.manager [None req-9e9a051d-a4e8-42d4-a4bb-85eb0bf08135 tempest-TestVolumeSwap-440541491 tempest-TestVolumeSwap-440541491-project-admin] [instance: 6b3646e6-512e-4cd6-b3c1-89438c19c408] swap_volume: removing Cinder connection for volume 070272de-513d-48de-975c-17e6ce9e5007 {{(pid=75176) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 28 15:46:50 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:705191a8-a203-4bbf-93d3-2a4e75a359b9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:46:50 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[20c39a30-8fbf-4f37-a2db-c1280f6be8f8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:705191a8-a203-4bbf-93d3-2a4e75a359b9] added\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:46:50 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ce9a2c2-4d74-4b6e-9917-2b842a168724 tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:705191a8-a203-4bbf-93d3-2a4e75a359b9] added
Nov 28 15:46:50 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:46:50 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:705191a8-a203-4bbf-93d3-2a4e75a359b9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:46:50 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:705191a8-a203-4bbf-93d3-2a4e75a359b9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:46:50 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e1ca0b1-8d0f-44c8-886c-76f5c8cc2466]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:46:50 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ce9a2c2-4d74-4b6e-9917-2b842a168724 tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:46:50 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:705191a8-a203-4bbf-93d3-2a4e75a359b9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:46:50 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:705191a8-a203-4bbf-93d3-2a4e75a359b9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:46:50 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d3ddbac-e342-4eb7-a9f0-d9cf90b105fd]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:46:50 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ce9a2c2-4d74-4b6e-9917-2b842a168724 tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:46:50 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:705191a8-a203-4bbf-93d3-2a4e75a359b9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KwdWHJLy {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:46:50 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:705191a8-a203-4bbf-93d3-2a4e75a359b9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KwdWHJLy" returned: 0 in 0.022s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:46:50 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[f70013f4-dd04-412a-a9f4-4561f8c50394]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:46:50 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ce9a2c2-4d74-4b6e-9917-2b842a168724 tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KwdWHJLy'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:46:50 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:705191a8-a203-4bbf-93d3-2a4e75a359b9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:46:50 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:705191a8-a203-4bbf-93d3-2a4e75a359b9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:46:50 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[fac4c744-c7de-43f8-af54-03cee1ddd806]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:46:51 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ce9a2c2-4d74-4b6e-9917-2b842a168724 tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:46:51 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:46:51 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:46:51 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c176688-a13a-4013-b8ee-46835caa578c]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1f5de5d-be7a-443a-9831-791c8667c09b (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69f59c18-c5e6-4afe-a74b-afe6d64d4e49 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7728674-3e10-438c-8fa0-9fc73367663f (non-flash)\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:46:51 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ce9a2c2-4d74-4b6e-9917-2b842a168724 tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1f5de5d-be7a-443a-9831-791c8667c09b (non-flash)
Nov 28 15:46:51 user nova-compute[75176]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24 (non-flash)
Nov 28 15:46:51 user nova-compute[75176]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d (non-flash)
Nov 28 15:46:51 user nova-compute[75176]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69f59c18-c5e6-4afe-a74b-afe6d64d4e49 (non-flash)
Nov 28 15:46:51 user nova-compute[75176]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7728674-3e10-438c-8fa0-9fc73367663f (non-flash)
Nov 28 15:46:51 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:46:51 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ce9a2c2-4d74-4b6e-9917-2b842a168724 tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1f5de5d-be7a-443a-9831-791c8667c09b (non-flash)
Nov 28 15:46:51 user nova-compute[75176]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24 (non-flash)
Nov 28 15:46:51 user nova-compute[75176]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d (non-flash)
Nov 28 15:46:51 user nova-compute[75176]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69f59c18-c5e6-4afe-a74b-afe6d64d4e49 (non-flash)
Nov 28 15:46:51 user nova-compute[75176]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7728674-3e10-438c-8fa0-9fc73367663f (non-flash)
Nov 28 15:46:51 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 15:46:51 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:705191a8-a203-4bbf-93d3-2a4e75a359b9 -p 172.16.0.220:3260 --login {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:46:51 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:705191a8-a203-4bbf-93d3-2a4e75a359b9 -p 172.16.0.220:3260 --login" returned: 0 in 0.089s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:46:51 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[7006994d-6704-4981-8170-d73e3de6653f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:705191a8-a203-4bbf-93d3-2a4e75a359b9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:705191a8-a203-4bbf-93d3-2a4e75a359b9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:46:51 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ce9a2c2-4d74-4b6e-9917-2b842a168724 tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:705191a8-a203-4bbf-93d3-2a4e75a359b9, portal: 172.16.0.220,3260]
Nov 28 15:46:51 user nova-compute[75176]: Login to [iface: default, target: iqn.2010-10.org.openstack:705191a8-a203-4bbf-93d3-2a4e75a359b9, portal: 172.16.0.220,3260] successful.
Nov 28 15:46:51 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:46:51 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:705191a8-a203-4bbf-93d3-2a4e75a359b9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:46:51 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:705191a8-a203-4bbf-93d3-2a4e75a359b9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:46:51 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[4af17f94-867d-440e-8455-ea8dbce40f29]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:46:51 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ce9a2c2-4d74-4b6e-9917-2b842a168724 tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:46:51 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:46:51 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:46:51 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[a41ebe0d-4c14-4620-a841-d10f7df9aa0b]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1f5de5d-be7a-443a-9831-791c8667c09b (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69f59c18-c5e6-4afe-a74b-afe6d64d4e49 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7728674-3e10-438c-8fa0-9fc73367663f (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:705191a8-a203-4bbf-93d3-2a4e75a359b9 (non-flash)\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:46:51 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ce9a2c2-4d74-4b6e-9917-2b842a168724 tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1f5de5d-be7a-443a-9831-791c8667c09b (non-flash)
Nov 28 15:46:51 user nova-compute[75176]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24 (non-flash)
Nov 28 15:46:51 user nova-compute[75176]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d (non-flash)
Nov 28 15:46:51 user nova-compute[75176]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69f59c18-c5e6-4afe-a74b-afe6d64d4e49 (non-flash)
Nov 28 15:46:51 user nova-compute[75176]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7728674-3e10-438c-8fa0-9fc73367663f (non-flash)
Nov 28 15:46:51 user nova-compute[75176]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:705191a8-a203-4bbf-93d3-2a4e75a359b9 (non-flash)
Nov 28 15:46:51 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:46:51 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ce9a2c2-4d74-4b6e-9917-2b842a168724 tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1f5de5d-be7a-443a-9831-791c8667c09b (non-flash)
Nov 28 15:46:51 user nova-compute[75176]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24 (non-flash)
Nov 28 15:46:51 user nova-compute[75176]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d (non-flash)
Nov 28 15:46:51 user nova-compute[75176]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69f59c18-c5e6-4afe-a74b-afe6d64d4e49 (non-flash)
Nov 28 15:46:51 user nova-compute[75176]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7728674-3e10-438c-8fa0-9fc73367663f (non-flash)
Nov 28 15:46:51 user nova-compute[75176]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:705191a8-a203-4bbf-93d3-2a4e75a359b9 (non-flash)
Nov 28 15:46:51 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 15:46:51 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-6ce9a2c2-4d74-4b6e-9917-2b842a168724 tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:705191a8-a203-4bbf-93d3-2a4e75a359b9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.343s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 15:46:51 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ce9a2c2-4d74-4b6e-9917-2b842a168724 tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Connected to 172.16.0.220:3260 {{(pid=75176) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 15:46:51 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-6ce9a2c2-4d74-4b6e-9917-2b842a168724 tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] HCTL ('34', '-', '-', 0) found on session 29 with lun 0 {{(pid=75176) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 15:46:51 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-6ce9a2c2-4d74-4b6e-9917-2b842a168724 tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75176) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 15:46:51 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:46:51 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:46:51 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[2561e16b-c2fa-452c-966d-d81271246924]: (4, ('- - 0', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:46:51 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-6ce9a2c2-4d74-4b6e-9917-2b842a168724 tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Searching for a device in session 29 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75176) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 15:46:51 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ce9a2c2-4d74-4b6e-9917-2b842a168724 tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:705191a8-a203-4bbf-93d3-2a4e75a359b9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KwdWHJLy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75176) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 15:46:51 user nova-compute[75176]: DEBUG nova.compute.manager [None req-9e9a051d-a4e8-42d4-a4bb-85eb0bf08135 tempest-TestVolumeSwap-440541491 tempest-TestVolumeSwap-440541491-project-admin] [instance: 6b3646e6-512e-4cd6-b3c1-89438c19c408] swap_volume: Updating volume 070272de-513d-48de-975c-17e6ce9e5007 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:e7728674-3e10-438c-8fa0-9fc73367663f", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "OlvPosBa", "auth_password": "hsH6pMkmEGfdS4", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdb", "volume_id": "e7728674-3e10-438c-8fa0-9fc73367663f"}, "status": "reserved", "instance": "6b3646e6-512e-4cd6-b3c1-89438c19c408", "attached_at": "", "detached_at": "", "volume_id": "e7728674-3e10-438c-8fa0-9fc73367663f", "serial": "e7728674-3e10-438c-8fa0-9fc73367663f"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'e7728674-3e10-438c-8fa0-9fc73367663f', 'no_device': None, 'attachment_id': '16a69424-4a7c-4591-9f60-f4edd97224a0'} {{(pid=75176) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 28 15:46:51 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-9e9a051d-a4e8-42d4-a4bb-85eb0bf08135 tempest-TestVolumeSwap-440541491 tempest-TestVolumeSwap-440541491-project-admin] Lock "6b3646e6-512e-4cd6-b3c1-89438c19c408" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 15.122s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:46:52 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-b7fb4dec-a0d8-4f46-b47d-f64e1ccae0d5 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] Acquiring lock "6b3646e6-512e-4cd6-b3c1-89438c19c408" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:46:52 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-b7fb4dec-a0d8-4f46-b47d-f64e1ccae0d5 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] Lock "6b3646e6-512e-4cd6-b3c1-89438c19c408" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:46:52 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-6ce9a2c2-4d74-4b6e-9917-2b842a168724 tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.382s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 15:46:52 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ce9a2c2-4d74-4b6e-9917-2b842a168724 tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] <== connect_volume: return (1384ms) {'type': 'block', 'scsi_wwn': '23835656362366233', 'path': '/dev/sdc'} {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 15:46:52 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6ce9a2c2-4d74-4b6e-9917-2b842a168724 tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] [instance: 7b4c281e-5b8d-43b1-8914-572e1341c0a7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23835656362366233', 'path': '/dev/sdc'} {{(pid=75176) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 15:46:52 user nova-compute[75176]: INFO nova.compute.manager [None req-b7fb4dec-a0d8-4f46-b47d-f64e1ccae0d5 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] [instance: 6b3646e6-512e-4cd6-b3c1-89438c19c408] Detaching volume e7728674-3e10-438c-8fa0-9fc73367663f
Nov 28 15:46:52 user nova-compute[75176]: DEBUG nova.objects.instance [None req-6ce9a2c2-4d74-4b6e-9917-2b842a168724 tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Lazy-loading 'flavor' on Instance uuid 7b4c281e-5b8d-43b1-8914-572e1341c0a7 {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:46:52 user nova-compute[75176]: DEBUG nova.virt.libvirt.guest [None req-6ce9a2c2-4d74-4b6e-9917-2b842a168724 tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 15:46:52 user nova-compute[75176]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 15:46:52 user nova-compute[75176]:   <source dev="/dev/sdc"/>
Nov 28 15:46:52 user nova-compute[75176]:   <target dev="vdb" bus="virtio"/>
Nov 28 15:46:52 user nova-compute[75176]:   <serial>705191a8-a203-4bbf-93d3-2a4e75a359b9</serial>
Nov 28 15:46:52 user nova-compute[75176]: </disk>
Nov 28 15:46:52 user nova-compute[75176]:  {{(pid=75176) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 15:46:52 user nova-compute[75176]: INFO nova.virt.block_device [None req-b7fb4dec-a0d8-4f46-b47d-f64e1ccae0d5 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] [instance: 6b3646e6-512e-4cd6-b3c1-89438c19c408] Attempting to driver detach volume e7728674-3e10-438c-8fa0-9fc73367663f from mountpoint /dev/vdb
Nov 28 15:46:52 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-b7fb4dec-a0d8-4f46-b47d-f64e1ccae0d5 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] Attempting to detach device vdb from instance 6b3646e6-512e-4cd6-b3c1-89438c19c408 from the persistent domain config. {{(pid=75176) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 15:46:52 user nova-compute[75176]: DEBUG nova.virt.libvirt.guest [None req-b7fb4dec-a0d8-4f46-b47d-f64e1ccae0d5 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 15:46:52 user nova-compute[75176]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 15:46:52 user nova-compute[75176]:   <source dev="/dev/sdb"/>
Nov 28 15:46:52 user nova-compute[75176]:   <target dev="vdb" bus="virtio"/>
Nov 28 15:46:52 user nova-compute[75176]:   <serial>e7728674-3e10-438c-8fa0-9fc73367663f</serial>
Nov 28 15:46:52 user nova-compute[75176]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 15:46:52 user nova-compute[75176]: </disk>
Nov 28 15:46:52 user nova-compute[75176]:  {{(pid=75176) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 15:46:52 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-b7fb4dec-a0d8-4f46-b47d-f64e1ccae0d5 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] Successfully detached device vdb from instance 6b3646e6-512e-4cd6-b3c1-89438c19c408 from the persistent domain config.
Nov 28 15:46:52 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-b7fb4dec-a0d8-4f46-b47d-f64e1ccae0d5 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6b3646e6-512e-4cd6-b3c1-89438c19c408 from the live domain config. {{(pid=75176) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 15:46:52 user nova-compute[75176]: DEBUG nova.virt.libvirt.guest [None req-b7fb4dec-a0d8-4f46-b47d-f64e1ccae0d5 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 15:46:52 user nova-compute[75176]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 15:46:52 user nova-compute[75176]:   <source dev="/dev/sdb"/>
Nov 28 15:46:52 user nova-compute[75176]:   <target dev="vdb" bus="virtio"/>
Nov 28 15:46:52 user nova-compute[75176]:   <serial>e7728674-3e10-438c-8fa0-9fc73367663f</serial>
Nov 28 15:46:52 user nova-compute[75176]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 15:46:52 user nova-compute[75176]: </disk>
Nov 28 15:46:52 user nova-compute[75176]:  {{(pid=75176) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 15:46:52 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:46:52 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-6ce9a2c2-4d74-4b6e-9917-2b842a168724 tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] No BDM found with device name vda, not building metadata. {{(pid=75176) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 15:46:52 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-6ce9a2c2-4d74-4b6e-9917-2b842a168724 tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75176) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 15:46:52 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-6ce9a2c2-4d74-4b6e-9917-2b842a168724 tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] No VIF found with MAC fa:16:3e:07:68:e7, not building metadata {{(pid=75176) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 15:46:52 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-b7fb4dec-a0d8-4f46-b47d-f64e1ccae0d5 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6b3646e6-512e-4cd6-b3c1-89438c19c408 {{(pid=75176) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 15:46:52 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-6ce9a2c2-4d74-4b6e-9917-2b842a168724 tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Lock "7b4c281e-5b8d-43b1-8914-572e1341c0a7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.375s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:46:53 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:46:53 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:46:53 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:46:53 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:46:54 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:46:54 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:46:54 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:46:54 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:46:54 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:46:54 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:46:54 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Auditing locally available compute resources for user (node: user) {{(pid=75176) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 15:46:54 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e8507b7-fccf-4196-b589-bf2b74f165ec/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:46:55 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e8507b7-fccf-4196-b589-bf2b74f165ec/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:46:55 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e8507b7-fccf-4196-b589-bf2b74f165ec/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:46:55 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e8507b7-fccf-4196-b589-bf2b74f165ec/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:46:55 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e8a6e1b-4f71-494a-8f44-f9643c658021/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:46:55 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e8a6e1b-4f71-494a-8f44-f9643c658021/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:46:55 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e8a6e1b-4f71-494a-8f44-f9643c658021/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:46:55 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e8a6e1b-4f71-494a-8f44-f9643c658021/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:46:55 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e02d1e69-5e74-43c3-8546-6044d31145f2/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:46:55 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e02d1e69-5e74-43c3-8546-6044d31145f2/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:46:55 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e02d1e69-5e74-43c3-8546-6044d31145f2/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:46:56 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e02d1e69-5e74-43c3-8546-6044d31145f2/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:46:56 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75176) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 15:46:56 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e465c9f-e8ab-4a28-bf74-2936a272a0e2/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:46:56 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e465c9f-e8ab-4a28-bf74-2936a272a0e2/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:46:56 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e465c9f-e8ab-4a28-bf74-2936a272a0e2/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:46:56 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e465c9f-e8ab-4a28-bf74-2936a272a0e2/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:46:56 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b3646e6-512e-4cd6-b3c1-89438c19c408/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:46:56 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b3646e6-512e-4cd6-b3c1-89438c19c408/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:46:56 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b3646e6-512e-4cd6-b3c1-89438c19c408/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:46:56 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b3646e6-512e-4cd6-b3c1-89438c19c408/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:46:56 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=75176) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 15:46:56 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa223c49-d254-4727-8a01-873026847b37/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:46:57 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa223c49-d254-4727-8a01-873026847b37/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:46:57 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa223c49-d254-4727-8a01-873026847b37/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:46:57 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa223c49-d254-4727-8a01-873026847b37/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:46:57 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75176) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 15:46:57 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcccc277-0049-41c5-9d8c-7db1d86e1fca/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:46:57 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcccc277-0049-41c5-9d8c-7db1d86e1fca/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:46:57 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcccc277-0049-41c5-9d8c-7db1d86e1fca/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:46:57 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcccc277-0049-41c5-9d8c-7db1d86e1fca/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:46:57 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/402e779e-f507-49f1-a0d8-31ab0d23fbcd/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:46:57 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:46:58 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/402e779e-f507-49f1-a0d8-31ab0d23fbcd/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:46:58 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/402e779e-f507-49f1-a0d8-31ab0d23fbcd/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:46:58 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/402e779e-f507-49f1-a0d8-31ab0d23fbcd/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:46:58 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75176) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 15:46:58 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b4c281e-5b8d-43b1-8914-572e1341c0a7/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:46:58 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b4c281e-5b8d-43b1-8914-572e1341c0a7/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:46:58 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b4c281e-5b8d-43b1-8914-572e1341c0a7/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:46:58 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b4c281e-5b8d-43b1-8914-572e1341c0a7/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:46:58 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75176) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 15:46:59 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:46:59 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 15:46:59 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 15:46:59 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Hypervisor/Node resource view: name=user free_ram=7142MB free_disk=25.305885314941406GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75176) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 15:46:59 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:46:59 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:46:59 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance 2e8507b7-fccf-4196-b589-bf2b74f165ec actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:46:59 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance 402e779e-f507-49f1-a0d8-31ab0d23fbcd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:46:59 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance e02d1e69-5e74-43c3-8546-6044d31145f2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:46:59 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance aa223c49-d254-4727-8a01-873026847b37 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:46:59 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance 6b3646e6-512e-4cd6-b3c1-89438c19c408 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:46:59 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance 1e8a6e1b-4f71-494a-8f44-f9643c658021 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:46:59 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance 7b4c281e-5b8d-43b1-8914-572e1341c0a7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:46:59 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance 87037584-a853-4693-bb23-598772ec83c5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:46:59 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance bcccc277-0049-41c5-9d8c-7db1d86e1fca actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:46:59 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance 0e465c9f-e8ab-4a28-bf74-2936a272a0e2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:46:59 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75176) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 15:46:59 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75176) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 15:46:59 user nova-compute[75176]: DEBUG nova.compute.provider_tree [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Inventory has not changed in ProviderTree for provider: b37848d8-f401-4155-a029-b0ffa09ff85b {{(pid=75176) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 15:46:59 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Inventory has not changed for provider b37848d8-f401-4155-a029-b0ffa09ff85b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75176) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 15:46:59 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Compute_service record updated for user:user {{(pid=75176) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 15:46:59 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.575s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:47:00 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:47:00 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:47:00 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:47:00 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Starting heal instance info cache {{(pid=75176) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 15:47:00 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquiring lock "refresh_cache-aa223c49-d254-4727-8a01-873026847b37" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:47:00 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquired lock "refresh_cache-aa223c49-d254-4727-8a01-873026847b37" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:47:00 user nova-compute[75176]: DEBUG nova.network.neutron [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] [instance: aa223c49-d254-4727-8a01-873026847b37] Forcefully refreshing network info cache for instance {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 15:47:01 user nova-compute[75176]: DEBUG nova.network.neutron [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] [instance: aa223c49-d254-4727-8a01-873026847b37] Updating instance_info_cache with network_info: [{"id": "6514aeb6-8ea4-4a27-a54b-32f650c87957", "address": "fa:16:3e:ea:a6:1b", "network": {"id": "51708ad4-dae1-47fc-bd26-aca8c478ca04", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-279988751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c2fe6bf5e4f4bb3b5d50901bfac0b38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6514aeb6-8e", "ovs_interfaceid": "6514aeb6-8ea4-4a27-a54b-32f650c87957", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:47:01 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Releasing lock "refresh_cache-aa223c49-d254-4727-8a01-873026847b37" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:47:01 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] [instance: aa223c49-d254-4727-8a01-873026847b37] Updated the network info_cache for instance {{(pid=75176) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 15:47:01 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:47:01 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75176) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 15:47:03 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-79334e08-7b7d-43d8-9653-183f95bc064e tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] Acquiring lock "8fe64eb8-b4e3-4037-80b1-0c151370d5a8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:47:03 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-79334e08-7b7d-43d8-9653-183f95bc064e tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] Lock "8fe64eb8-b4e3-4037-80b1-0c151370d5a8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:47:03 user nova-compute[75176]: DEBUG nova.compute.manager [None req-79334e08-7b7d-43d8-9653-183f95bc064e tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] [instance: 8fe64eb8-b4e3-4037-80b1-0c151370d5a8] Starting instance... {{(pid=75176) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 15:47:03 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-79334e08-7b7d-43d8-9653-183f95bc064e tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:47:03 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-79334e08-7b7d-43d8-9653-183f95bc064e tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:47:03 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-79334e08-7b7d-43d8-9653-183f95bc064e tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75176) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 15:47:03 user nova-compute[75176]: INFO nova.compute.claims [None req-79334e08-7b7d-43d8-9653-183f95bc064e tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] [instance: 8fe64eb8-b4e3-4037-80b1-0c151370d5a8] Claim successful on node user
Nov 28 15:47:03 user nova-compute[75176]: DEBUG nova.compute.provider_tree [None req-79334e08-7b7d-43d8-9653-183f95bc064e tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] Inventory has not changed in ProviderTree for provider: b37848d8-f401-4155-a029-b0ffa09ff85b {{(pid=75176) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 15:47:03 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-79334e08-7b7d-43d8-9653-183f95bc064e tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] Inventory has not changed for provider b37848d8-f401-4155-a029-b0ffa09ff85b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75176) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 15:47:03 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-79334e08-7b7d-43d8-9653-183f95bc064e tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.448s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:47:03 user nova-compute[75176]: DEBUG nova.compute.manager [None req-79334e08-7b7d-43d8-9653-183f95bc064e tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] [instance: 8fe64eb8-b4e3-4037-80b1-0c151370d5a8] Start building networks asynchronously for instance. {{(pid=75176) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 15:47:03 user nova-compute[75176]: DEBUG nova.compute.manager [None req-79334e08-7b7d-43d8-9653-183f95bc064e tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] [instance: 8fe64eb8-b4e3-4037-80b1-0c151370d5a8] Allocating IP information in the background. {{(pid=75176) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 15:47:03 user nova-compute[75176]: DEBUG nova.network.neutron [None req-79334e08-7b7d-43d8-9653-183f95bc064e tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] [instance: 8fe64eb8-b4e3-4037-80b1-0c151370d5a8] allocate_for_instance() {{(pid=75176) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 15:47:03 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-79334e08-7b7d-43d8-9653-183f95bc064e tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] [instance: 8fe64eb8-b4e3-4037-80b1-0c151370d5a8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 15:47:03 user nova-compute[75176]: DEBUG nova.compute.manager [None req-79334e08-7b7d-43d8-9653-183f95bc064e tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] [instance: 8fe64eb8-b4e3-4037-80b1-0c151370d5a8] Start building block device mappings for instance. {{(pid=75176) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 15:47:03 user nova-compute[75176]: DEBUG nova.policy [None req-79334e08-7b7d-43d8-9653-183f95bc064e tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'dc50b1a21d114a2081d2913f402974d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37788d8e0384afcb348f009062c3b12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75176) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 15:47:03 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:47:03 user nova-compute[75176]: DEBUG nova.compute.manager [None req-79334e08-7b7d-43d8-9653-183f95bc064e tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] [instance: 8fe64eb8-b4e3-4037-80b1-0c151370d5a8] Start spawning the instance on the hypervisor. {{(pid=75176) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 15:47:03 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-79334e08-7b7d-43d8-9653-183f95bc064e tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] [instance: 8fe64eb8-b4e3-4037-80b1-0c151370d5a8] Creating instance directory {{(pid=75176) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 15:47:03 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-79334e08-7b7d-43d8-9653-183f95bc064e tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] [instance: 8fe64eb8-b4e3-4037-80b1-0c151370d5a8] Creating image(s)
Nov 28 15:47:03 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-79334e08-7b7d-43d8-9653-183f95bc064e tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] Acquiring lock "/opt/stack/data/nova/instances/8fe64eb8-b4e3-4037-80b1-0c151370d5a8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:47:03 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-79334e08-7b7d-43d8-9653-183f95bc064e tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] Lock "/opt/stack/data/nova/instances/8fe64eb8-b4e3-4037-80b1-0c151370d5a8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:47:03 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-79334e08-7b7d-43d8-9653-183f95bc064e tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] Lock "/opt/stack/data/nova/instances/8fe64eb8-b4e3-4037-80b1-0c151370d5a8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:47:03 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-79334e08-7b7d-43d8-9653-183f95bc064e tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:47:04 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:47:04 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-79334e08-7b7d-43d8-9653-183f95bc064e tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json" returned: 0 in 0.204s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:47:04 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-79334e08-7b7d-43d8-9653-183f95bc064e tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] Acquiring lock "5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:47:04 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-79334e08-7b7d-43d8-9653-183f95bc064e tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] Lock "5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:47:04 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-79334e08-7b7d-43d8-9653-183f95bc064e tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:47:04 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-79334e08-7b7d-43d8-9653-183f95bc064e tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json" returned: 0 in 0.262s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:47:04 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-79334e08-7b7d-43d8-9653-183f95bc064e tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2,backing_fmt=raw /opt/stack/data/nova/instances/8fe64eb8-b4e3-4037-80b1-0c151370d5a8/disk 1073741824 {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:47:04 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-79334e08-7b7d-43d8-9653-183f95bc064e tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2,backing_fmt=raw /opt/stack/data/nova/instances/8fe64eb8-b4e3-4037-80b1-0c151370d5a8/disk 1073741824" returned: 0 in 0.057s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:47:04 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-79334e08-7b7d-43d8-9653-183f95bc064e tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] Lock "5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.327s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:47:04 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-79334e08-7b7d-43d8-9653-183f95bc064e tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:47:04 user nova-compute[75176]: DEBUG nova.network.neutron [None req-79334e08-7b7d-43d8-9653-183f95bc064e tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] [instance: 8fe64eb8-b4e3-4037-80b1-0c151370d5a8] Successfully created port: 9b3e8a32-f295-4443-b831-b334e3e819ed {{(pid=75176) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 15:47:04 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-79334e08-7b7d-43d8-9653-183f95bc064e tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json" returned: 0 in 0.213s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:47:04 user nova-compute[75176]: DEBUG nova.virt.disk.api [None req-79334e08-7b7d-43d8-9653-183f95bc064e tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8fe64eb8-b4e3-4037-80b1-0c151370d5a8/disk. size=1073741824 {{(pid=75176) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 15:47:04 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-79334e08-7b7d-43d8-9653-183f95bc064e tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fe64eb8-b4e3-4037-80b1-0c151370d5a8/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:47:04 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-79334e08-7b7d-43d8-9653-183f95bc064e tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fe64eb8-b4e3-4037-80b1-0c151370d5a8/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:47:04 user nova-compute[75176]: DEBUG nova.virt.disk.api [None req-79334e08-7b7d-43d8-9653-183f95bc064e tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] Cannot resize image /opt/stack/data/nova/instances/8fe64eb8-b4e3-4037-80b1-0c151370d5a8/disk to a smaller size. {{(pid=75176) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 15:47:04 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-79334e08-7b7d-43d8-9653-183f95bc064e tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] [instance: 8fe64eb8-b4e3-4037-80b1-0c151370d5a8] Created local disks {{(pid=75176) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 15:47:04 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-79334e08-7b7d-43d8-9653-183f95bc064e tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] [instance: 8fe64eb8-b4e3-4037-80b1-0c151370d5a8] Ensure instance console log exists: /opt/stack/data/nova/instances/8fe64eb8-b4e3-4037-80b1-0c151370d5a8/console.log {{(pid=75176) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 15:47:04 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-79334e08-7b7d-43d8-9653-183f95bc064e tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:47:04 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-79334e08-7b7d-43d8-9653-183f95bc064e tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:47:04 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-79334e08-7b7d-43d8-9653-183f95bc064e tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:47:05 user nova-compute[75176]: DEBUG nova.network.neutron [None req-79334e08-7b7d-43d8-9653-183f95bc064e tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] [instance: 8fe64eb8-b4e3-4037-80b1-0c151370d5a8] Successfully updated port: 9b3e8a32-f295-4443-b831-b334e3e819ed {{(pid=75176) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 15:47:05 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-79334e08-7b7d-43d8-9653-183f95bc064e tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] Acquiring lock "refresh_cache-8fe64eb8-b4e3-4037-80b1-0c151370d5a8" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:47:05 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-79334e08-7b7d-43d8-9653-183f95bc064e tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] Acquired lock "refresh_cache-8fe64eb8-b4e3-4037-80b1-0c151370d5a8" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:47:05 user nova-compute[75176]: DEBUG nova.network.neutron [None req-79334e08-7b7d-43d8-9653-183f95bc064e tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] [instance: 8fe64eb8-b4e3-4037-80b1-0c151370d5a8] Building network info cache for instance {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 15:47:05 user nova-compute[75176]: DEBUG nova.compute.manager [req-676305be-2270-40b4-9d2e-b07d4a15fdb1 req-01cef315-ab4a-4329-b041-9f308da0c3ef service nova] [instance: 8fe64eb8-b4e3-4037-80b1-0c151370d5a8] Received event network-changed-9b3e8a32-f295-4443-b831-b334e3e819ed {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:47:05 user nova-compute[75176]: DEBUG nova.compute.manager [req-676305be-2270-40b4-9d2e-b07d4a15fdb1 req-01cef315-ab4a-4329-b041-9f308da0c3ef service nova] [instance: 8fe64eb8-b4e3-4037-80b1-0c151370d5a8] Refreshing instance network info cache due to event network-changed-9b3e8a32-f295-4443-b831-b334e3e819ed. {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 15:47:05 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-676305be-2270-40b4-9d2e-b07d4a15fdb1 req-01cef315-ab4a-4329-b041-9f308da0c3ef service nova] Acquiring lock "refresh_cache-8fe64eb8-b4e3-4037-80b1-0c151370d5a8" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:47:05 user nova-compute[75176]: DEBUG nova.network.neutron [None req-79334e08-7b7d-43d8-9653-183f95bc064e tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] [instance: 8fe64eb8-b4e3-4037-80b1-0c151370d5a8] Instance cache missing network info. {{(pid=75176) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 15:47:05 user nova-compute[75176]: DEBUG nova.network.neutron [None req-79334e08-7b7d-43d8-9653-183f95bc064e tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] [instance: 8fe64eb8-b4e3-4037-80b1-0c151370d5a8] Updating instance_info_cache with network_info: [{"id": "9b3e8a32-f295-4443-b831-b334e3e819ed", "address": "fa:16:3e:00:fc:1e", "network": {"id": "a5685858-c130-4f66-8600-023367af9ea5", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-316757927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d37788d8e0384afcb348f009062c3b12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b3e8a32-f2", "ovs_interfaceid": "9b3e8a32-f295-4443-b831-b334e3e819ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:47:05 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-79334e08-7b7d-43d8-9653-183f95bc064e tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] Releasing lock "refresh_cache-8fe64eb8-b4e3-4037-80b1-0c151370d5a8" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:47:05 user nova-compute[75176]: DEBUG nova.compute.manager [None req-79334e08-7b7d-43d8-9653-183f95bc064e tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] [instance: 8fe64eb8-b4e3-4037-80b1-0c151370d5a8] Instance network_info: |[{"id": "9b3e8a32-f295-4443-b831-b334e3e819ed", "address": "fa:16:3e:00:fc:1e", "network": {"id": "a5685858-c130-4f66-8600-023367af9ea5", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-316757927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d37788d8e0384afcb348f009062c3b12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b3e8a32-f2", "ovs_interfaceid": "9b3e8a32-f295-4443-b831-b334e3e819ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75176) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 15:47:05 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-676305be-2270-40b4-9d2e-b07d4a15fdb1 req-01cef315-ab4a-4329-b041-9f308da0c3ef service nova] Acquired lock "refresh_cache-8fe64eb8-b4e3-4037-80b1-0c151370d5a8" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:47:05 user nova-compute[75176]: DEBUG nova.network.neutron [req-676305be-2270-40b4-9d2e-b07d4a15fdb1 req-01cef315-ab4a-4329-b041-9f308da0c3ef service nova] [instance: 8fe64eb8-b4e3-4037-80b1-0c151370d5a8] Refreshing network info cache for port 9b3e8a32-f295-4443-b831-b334e3e819ed {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 15:47:05 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-79334e08-7b7d-43d8-9653-183f95bc064e tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] [instance: 8fe64eb8-b4e3-4037-80b1-0c151370d5a8] Start _get_guest_xml network_info=[{"id": "9b3e8a32-f295-4443-b831-b334e3e819ed", "address": "fa:16:3e:00:fc:1e", "network": {"id": "a5685858-c130-4f66-8600-023367af9ea5", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-316757927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d37788d8e0384afcb348f009062c3b12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b3e8a32-f2", "ovs_interfaceid": "9b3e8a32-f295-4443-b831-b334e3e819ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T15:35:12Z,direct_url=<?>,disk_format='qcow2',id=1f41819e-c93f-4dc7-b253-37a27bbbbc74,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1b91c5d0672c4224a48df2e1f92688e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T15:35:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'size': 0, 'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'image_id': '1f41819e-c93f-4dc7-b253-37a27bbbbc74'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75176) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 15:47:05 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-79334e08-7b7d-43d8-9653-183f95bc064e tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 15:47:05 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-79334e08-7b7d-43d8-9653-183f95bc064e tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 15:47:05 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-79334e08-7b7d-43d8-9653-183f95bc064e tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75176) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 15:47:05 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-79334e08-7b7d-43d8-9653-183f95bc064e tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] CPU controller missing on host. {{(pid=75176) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 15:47:05 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-79334e08-7b7d-43d8-9653-183f95bc064e tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75176) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 15:47:05 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-79334e08-7b7d-43d8-9653-183f95bc064e tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] CPU controller found on host. {{(pid=75176) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 15:47:05 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-79334e08-7b7d-43d8-9653-183f95bc064e tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75176) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 15:47:05 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-79334e08-7b7d-43d8-9653-183f95bc064e tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T15:35:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T15:35:12Z,direct_url=<?>,disk_format='qcow2',id=1f41819e-c93f-4dc7-b253-37a27bbbbc74,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1b91c5d0672c4224a48df2e1f92688e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T15:35:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 15:47:05 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-79334e08-7b7d-43d8-9653-183f95bc064e tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] Flavor limits 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 15:47:05 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-79334e08-7b7d-43d8-9653-183f95bc064e tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] Image limits 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 15:47:05 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-79334e08-7b7d-43d8-9653-183f95bc064e tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] Flavor pref 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 15:47:05 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-79334e08-7b7d-43d8-9653-183f95bc064e tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] Image pref 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 15:47:05 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-79334e08-7b7d-43d8-9653-183f95bc064e tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 15:47:05 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-79334e08-7b7d-43d8-9653-183f95bc064e tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 15:47:05 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-79334e08-7b7d-43d8-9653-183f95bc064e tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75176) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 15:47:05 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-79334e08-7b7d-43d8-9653-183f95bc064e tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] Got 1 possible topologies {{(pid=75176) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 15:47:05 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-79334e08-7b7d-43d8-9653-183f95bc064e tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 15:47:05 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-79334e08-7b7d-43d8-9653-183f95bc064e tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 15:47:05 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-79334e08-7b7d-43d8-9653-183f95bc064e tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T15:47:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1310921736',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1310921736',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1310921',id=24,image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDV+U70K85QMYI1OGc7tIe4DMCc/JKasNThTbB8PZF5eBwHKeHqIVo22CkrnpPWSJD9kTgpEZU8/hMTrHotZ2qx+cdOGHicBEZMYZdQuVXfvOGj+P/0sxYvomrPYRGGFsg==',key_name='tempest-keypair-134007714',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d37788d8e0384afcb348f009062c3b12',ramdisk_id='',reservation_id='r-9p0kesdr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1242768290',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T15:47:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dc50b1a21d114a2081d2913f402974d1',uuid=8fe64eb8-b4e3-4037-80b1-0c151370d5a8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9b3e8a32-f295-4443-b831-b334e3e819ed", "address": "fa:16:3e:00:fc:1e", "network": {"id": "a5685858-c130-4f66-8600-023367af9ea5", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-316757927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d37788d8e0384afcb348f009062c3b12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b3e8a32-f2", "ovs_interfaceid": "9b3e8a32-f295-4443-b831-b334e3e819ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75176) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 15:47:05 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-79334e08-7b7d-43d8-9653-183f95bc064e tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] Converting VIF {"id": "9b3e8a32-f295-4443-b831-b334e3e819ed", "address": "fa:16:3e:00:fc:1e", "network": {"id": "a5685858-c130-4f66-8600-023367af9ea5", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-316757927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d37788d8e0384afcb348f009062c3b12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b3e8a32-f2", "ovs_interfaceid": "9b3e8a32-f295-4443-b831-b334e3e819ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:47:05 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-79334e08-7b7d-43d8-9653-183f95bc064e tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:fc:1e,bridge_name='br-int',has_traffic_filtering=True,id=9b3e8a32-f295-4443-b831-b334e3e819ed,network=Network(a5685858-c130-4f66-8600-023367af9ea5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b3e8a32-f2') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:47:05 user nova-compute[75176]: DEBUG nova.objects.instance [None req-79334e08-7b7d-43d8-9653-183f95bc064e tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] Lazy-loading 'pci_devices' on Instance uuid 8fe64eb8-b4e3-4037-80b1-0c151370d5a8 {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:47:05 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-79334e08-7b7d-43d8-9653-183f95bc064e tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] [instance: 8fe64eb8-b4e3-4037-80b1-0c151370d5a8] End _get_guest_xml xml=<domain type="kvm">
Nov 28 15:47:05 user nova-compute[75176]:   <uuid>8fe64eb8-b4e3-4037-80b1-0c151370d5a8</uuid>
Nov 28 15:47:05 user nova-compute[75176]:   <name>instance-00000018</name>
Nov 28 15:47:05 user nova-compute[75176]:   <memory>524288</memory>
Nov 28 15:47:05 user nova-compute[75176]:   <vcpu>1</vcpu>
Nov 28 15:47:05 user nova-compute[75176]:   <metadata>
Nov 28 15:47:05 user nova-compute[75176]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 15:47:05 user nova-compute[75176]:       <nova:package version="0.0.0"/>
Nov 28 15:47:05 user nova-compute[75176]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-1310921736</nova:name>
Nov 28 15:47:05 user nova-compute[75176]:       <nova:creationTime>2023-11-28 15:47:05</nova:creationTime>
Nov 28 15:47:05 user nova-compute[75176]:       <nova:flavor name="m1.tiny">
Nov 28 15:47:05 user nova-compute[75176]:         <nova:memory>512</nova:memory>
Nov 28 15:47:05 user nova-compute[75176]:         <nova:disk>1</nova:disk>
Nov 28 15:47:05 user nova-compute[75176]:         <nova:swap>0</nova:swap>
Nov 28 15:47:05 user nova-compute[75176]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 15:47:05 user nova-compute[75176]:         <nova:vcpus>1</nova:vcpus>
Nov 28 15:47:05 user nova-compute[75176]:       </nova:flavor>
Nov 28 15:47:05 user nova-compute[75176]:       <nova:owner>
Nov 28 15:47:05 user nova-compute[75176]:         <nova:user uuid="dc50b1a21d114a2081d2913f402974d1">tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member</nova:user>
Nov 28 15:47:05 user nova-compute[75176]:         <nova:project uuid="d37788d8e0384afcb348f009062c3b12">tempest-TestServerVolumeAttachScenarioOldVersion-1242768290</nova:project>
Nov 28 15:47:05 user nova-compute[75176]:       </nova:owner>
Nov 28 15:47:05 user nova-compute[75176]:       <nova:root type="image" uuid="1f41819e-c93f-4dc7-b253-37a27bbbbc74"/>
Nov 28 15:47:05 user nova-compute[75176]:       <nova:ports>
Nov 28 15:47:05 user nova-compute[75176]:         <nova:port uuid="9b3e8a32-f295-4443-b831-b334e3e819ed">
Nov 28 15:47:05 user nova-compute[75176]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 28 15:47:05 user nova-compute[75176]:         </nova:port>
Nov 28 15:47:05 user nova-compute[75176]:       </nova:ports>
Nov 28 15:47:05 user nova-compute[75176]:     </nova:instance>
Nov 28 15:47:05 user nova-compute[75176]:   </metadata>
Nov 28 15:47:05 user nova-compute[75176]:   <sysinfo type="smbios">
Nov 28 15:47:05 user nova-compute[75176]:     <system>
Nov 28 15:47:05 user nova-compute[75176]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 15:47:05 user nova-compute[75176]:       <entry name="product">OpenStack Nova</entry>
Nov 28 15:47:05 user nova-compute[75176]:       <entry name="version">0.0.0</entry>
Nov 28 15:47:05 user nova-compute[75176]:       <entry name="serial">8fe64eb8-b4e3-4037-80b1-0c151370d5a8</entry>
Nov 28 15:47:05 user nova-compute[75176]:       <entry name="uuid">8fe64eb8-b4e3-4037-80b1-0c151370d5a8</entry>
Nov 28 15:47:05 user nova-compute[75176]:       <entry name="family">Virtual Machine</entry>
Nov 28 15:47:05 user nova-compute[75176]:     </system>
Nov 28 15:47:05 user nova-compute[75176]:   </sysinfo>
Nov 28 15:47:05 user nova-compute[75176]:   <os>
Nov 28 15:47:05 user nova-compute[75176]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 15:47:05 user nova-compute[75176]:     <boot dev="hd"/>
Nov 28 15:47:05 user nova-compute[75176]:     <smbios mode="sysinfo"/>
Nov 28 15:47:05 user nova-compute[75176]:   </os>
Nov 28 15:47:05 user nova-compute[75176]:   <features>
Nov 28 15:47:05 user nova-compute[75176]:     <acpi/>
Nov 28 15:47:05 user nova-compute[75176]:     <apic/>
Nov 28 15:47:05 user nova-compute[75176]:     <vmcoreinfo/>
Nov 28 15:47:05 user nova-compute[75176]:   </features>
Nov 28 15:47:05 user nova-compute[75176]:   <clock offset="utc">
Nov 28 15:47:05 user nova-compute[75176]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 15:47:05 user nova-compute[75176]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 15:47:05 user nova-compute[75176]:     <timer name="hpet" present="no"/>
Nov 28 15:47:05 user nova-compute[75176]:   </clock>
Nov 28 15:47:05 user nova-compute[75176]:   <cpu mode="custom" match="exact">
Nov 28 15:47:05 user nova-compute[75176]:     <model>Nehalem</model>
Nov 28 15:47:05 user nova-compute[75176]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 15:47:05 user nova-compute[75176]:   </cpu>
Nov 28 15:47:05 user nova-compute[75176]:   <devices>
Nov 28 15:47:05 user nova-compute[75176]:     <disk type="file" device="disk">
Nov 28 15:47:05 user nova-compute[75176]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 15:47:05 user nova-compute[75176]:       <source file="/opt/stack/data/nova/instances/8fe64eb8-b4e3-4037-80b1-0c151370d5a8/disk"/>
Nov 28 15:47:05 user nova-compute[75176]:       <target dev="vda" bus="virtio"/>
Nov 28 15:47:05 user nova-compute[75176]:     </disk>
Nov 28 15:47:05 user nova-compute[75176]:     <interface type="ethernet">
Nov 28 15:47:05 user nova-compute[75176]:       <mac address="fa:16:3e:00:fc:1e"/>
Nov 28 15:47:05 user nova-compute[75176]:       <model type="virtio"/>
Nov 28 15:47:05 user nova-compute[75176]:       <mtu size="1442"/>
Nov 28 15:47:05 user nova-compute[75176]:       <target dev="tap9b3e8a32-f2"/>
Nov 28 15:47:05 user nova-compute[75176]:     </interface>
Nov 28 15:47:05 user nova-compute[75176]:     <serial type="pty">
Nov 28 15:47:05 user nova-compute[75176]:       <log file="/opt/stack/data/nova/instances/8fe64eb8-b4e3-4037-80b1-0c151370d5a8/console.log" append="off"/>
Nov 28 15:47:05 user nova-compute[75176]:     </serial>
Nov 28 15:47:05 user nova-compute[75176]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 15:47:05 user nova-compute[75176]:     <video>
Nov 28 15:47:05 user nova-compute[75176]:       <model type="virtio"/>
Nov 28 15:47:05 user nova-compute[75176]:     </video>
Nov 28 15:47:05 user nova-compute[75176]:     <rng model="virtio">
Nov 28 15:47:05 user nova-compute[75176]:       <backend model="random">/dev/urandom</backend>
Nov 28 15:47:05 user nova-compute[75176]:     </rng>
Nov 28 15:47:05 user nova-compute[75176]:     <controller type="usb" index="0" model="none"/>
Nov 28 15:47:05 user nova-compute[75176]:     <memballoon model="virtio">
Nov 28 15:47:05 user nova-compute[75176]:       <stats period="10"/>
Nov 28 15:47:05 user nova-compute[75176]:     </memballoon>
Nov 28 15:47:05 user nova-compute[75176]:   </devices>
Nov 28 15:47:05 user nova-compute[75176]: </domain>
Nov 28 15:47:05 user nova-compute[75176]:  {{(pid=75176) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 15:47:05 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-79334e08-7b7d-43d8-9653-183f95bc064e tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T15:47:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1310921736',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1310921736',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1310921',id=24,image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDV+U70K85QMYI1OGc7tIe4DMCc/JKasNThTbB8PZF5eBwHKeHqIVo22CkrnpPWSJD9kTgpEZU8/hMTrHotZ2qx+cdOGHicBEZMYZdQuVXfvOGj+P/0sxYvomrPYRGGFsg==',key_name='tempest-keypair-134007714',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d37788d8e0384afcb348f009062c3b12',ramdisk_id='',reservation_id='r-9p0kesdr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1242768290',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T15:47:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dc50b1a21d114a2081d2913f402974d1',uuid=8fe64eb8-b4e3-4037-80b1-0c151370d5a8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9b3e8a32-f295-4443-b831-b334e3e819ed", "address": "fa:16:3e:00:fc:1e", "network": {"id": "a5685858-c130-4f66-8600-023367af9ea5", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-316757927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d37788d8e0384afcb348f009062c3b12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b3e8a32-f2", "ovs_interfaceid": "9b3e8a32-f295-4443-b831-b334e3e819ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 15:47:05 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-79334e08-7b7d-43d8-9653-183f95bc064e tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] Converting VIF {"id": "9b3e8a32-f295-4443-b831-b334e3e819ed", "address": "fa:16:3e:00:fc:1e", "network": {"id": "a5685858-c130-4f66-8600-023367af9ea5", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-316757927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d37788d8e0384afcb348f009062c3b12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b3e8a32-f2", "ovs_interfaceid": "9b3e8a32-f295-4443-b831-b334e3e819ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:47:05 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-79334e08-7b7d-43d8-9653-183f95bc064e tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:fc:1e,bridge_name='br-int',has_traffic_filtering=True,id=9b3e8a32-f295-4443-b831-b334e3e819ed,network=Network(a5685858-c130-4f66-8600-023367af9ea5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b3e8a32-f2') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:47:05 user nova-compute[75176]: DEBUG os_vif [None req-79334e08-7b7d-43d8-9653-183f95bc064e tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:fc:1e,bridge_name='br-int',has_traffic_filtering=True,id=9b3e8a32-f295-4443-b831-b334e3e819ed,network=Network(a5685858-c130-4f66-8600-023367af9ea5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b3e8a32-f2') {{(pid=75176) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 15:47:05 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:47:05 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:47:05 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 15:47:05 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:47:05 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '28ab8fa0-32cf-5571-bc65-ea478b0359d6', '_type': 'linux-noop'}}, row=False) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:47:05 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:47:05 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:47:05 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:47:05 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9b3e8a32-f2, may_exist=True, interface_attrs={}) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:47:05 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9b3e8a32-f2, col_values=(('qos', UUID('5e39b6bc-64dd-47fa-8bce-643d0ace8fc7')),), if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:47:05 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9b3e8a32-f2, col_values=(('external_ids', {'iface-id': '9b3e8a32-f295-4443-b831-b334e3e819ed', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:00:fc:1e', 'vm-uuid': '8fe64eb8-b4e3-4037-80b1-0c151370d5a8'}),), if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:47:05 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:47:05 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:47:05 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:47:05 user nova-compute[75176]: INFO os_vif [None req-79334e08-7b7d-43d8-9653-183f95bc064e tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:fc:1e,bridge_name='br-int',has_traffic_filtering=True,id=9b3e8a32-f295-4443-b831-b334e3e819ed,network=Network(a5685858-c130-4f66-8600-023367af9ea5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b3e8a32-f2')
Nov 28 15:47:05 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-79334e08-7b7d-43d8-9653-183f95bc064e tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] No BDM found with device name vda, not building metadata. {{(pid=75176) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 15:47:05 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-79334e08-7b7d-43d8-9653-183f95bc064e tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] No VIF found with MAC fa:16:3e:00:fc:1e, not building metadata {{(pid=75176) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 15:47:06 user nova-compute[75176]: DEBUG nova.network.neutron [req-676305be-2270-40b4-9d2e-b07d4a15fdb1 req-01cef315-ab4a-4329-b041-9f308da0c3ef service nova] [instance: 8fe64eb8-b4e3-4037-80b1-0c151370d5a8] Updated VIF entry in instance network info cache for port 9b3e8a32-f295-4443-b831-b334e3e819ed. {{(pid=75176) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 15:47:06 user nova-compute[75176]: DEBUG nova.network.neutron [req-676305be-2270-40b4-9d2e-b07d4a15fdb1 req-01cef315-ab4a-4329-b041-9f308da0c3ef service nova] [instance: 8fe64eb8-b4e3-4037-80b1-0c151370d5a8] Updating instance_info_cache with network_info: [{"id": "9b3e8a32-f295-4443-b831-b334e3e819ed", "address": "fa:16:3e:00:fc:1e", "network": {"id": "a5685858-c130-4f66-8600-023367af9ea5", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-316757927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d37788d8e0384afcb348f009062c3b12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b3e8a32-f2", "ovs_interfaceid": "9b3e8a32-f295-4443-b831-b334e3e819ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:47:06 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-676305be-2270-40b4-9d2e-b07d4a15fdb1 req-01cef315-ab4a-4329-b041-9f308da0c3ef service nova] Releasing lock "refresh_cache-8fe64eb8-b4e3-4037-80b1-0c151370d5a8" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:47:06 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:47:07 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-694b3795-8d5f-4342-83e2-5fa795260088 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Acquiring lock "402e779e-f507-49f1-a0d8-31ab0d23fbcd" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:47:07 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-694b3795-8d5f-4342-83e2-5fa795260088 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Lock "402e779e-f507-49f1-a0d8-31ab0d23fbcd" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:47:07 user nova-compute[75176]: INFO nova.compute.manager [None req-694b3795-8d5f-4342-83e2-5fa795260088 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] [instance: 402e779e-f507-49f1-a0d8-31ab0d23fbcd] Detaching volume a1f5de5d-be7a-443a-9831-791c8667c09b
Nov 28 15:47:07 user nova-compute[75176]: INFO nova.virt.block_device [None req-694b3795-8d5f-4342-83e2-5fa795260088 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] [instance: 402e779e-f507-49f1-a0d8-31ab0d23fbcd] Attempting to driver detach volume a1f5de5d-be7a-443a-9831-791c8667c09b from mountpoint /dev/vdb
Nov 28 15:47:07 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-694b3795-8d5f-4342-83e2-5fa795260088 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Attempting to detach device vdb from instance 402e779e-f507-49f1-a0d8-31ab0d23fbcd from the persistent domain config. {{(pid=75176) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 15:47:07 user nova-compute[75176]: DEBUG nova.virt.libvirt.guest [None req-694b3795-8d5f-4342-83e2-5fa795260088 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 15:47:07 user nova-compute[75176]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 15:47:07 user nova-compute[75176]:   <source dev="/dev/sdd"/>
Nov 28 15:47:07 user nova-compute[75176]:   <target dev="vdb" bus="virtio"/>
Nov 28 15:47:07 user nova-compute[75176]:   <serial>a1f5de5d-be7a-443a-9831-791c8667c09b</serial>
Nov 28 15:47:07 user nova-compute[75176]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 15:47:07 user nova-compute[75176]: </disk>
Nov 28 15:47:07 user nova-compute[75176]:  {{(pid=75176) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 15:47:07 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:47:07 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-694b3795-8d5f-4342-83e2-5fa795260088 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Successfully detached device vdb from instance 402e779e-f507-49f1-a0d8-31ab0d23fbcd from the persistent domain config.
Nov 28 15:47:07 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-694b3795-8d5f-4342-83e2-5fa795260088 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 402e779e-f507-49f1-a0d8-31ab0d23fbcd from the live domain config. {{(pid=75176) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 15:47:07 user nova-compute[75176]: DEBUG nova.virt.libvirt.guest [None req-694b3795-8d5f-4342-83e2-5fa795260088 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 15:47:07 user nova-compute[75176]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 15:47:07 user nova-compute[75176]:   <source dev="/dev/sdd"/>
Nov 28 15:47:07 user nova-compute[75176]:   <target dev="vdb" bus="virtio"/>
Nov 28 15:47:07 user nova-compute[75176]:   <serial>a1f5de5d-be7a-443a-9831-791c8667c09b</serial>
Nov 28 15:47:07 user nova-compute[75176]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 15:47:07 user nova-compute[75176]: </disk>
Nov 28 15:47:07 user nova-compute[75176]:  {{(pid=75176) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 15:47:07 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:47:07 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:47:07 user nova-compute[75176]: DEBUG nova.compute.manager [req-d49cb960-6cc7-448a-a5dd-bf5934a11ef5 req-898f561f-7938-4238-b55e-2e22f21ef9c2 service nova] [instance: 8fe64eb8-b4e3-4037-80b1-0c151370d5a8] Received event network-vif-plugged-9b3e8a32-f295-4443-b831-b334e3e819ed {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:47:07 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-d49cb960-6cc7-448a-a5dd-bf5934a11ef5 req-898f561f-7938-4238-b55e-2e22f21ef9c2 service nova] Acquiring lock "8fe64eb8-b4e3-4037-80b1-0c151370d5a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:47:07 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-d49cb960-6cc7-448a-a5dd-bf5934a11ef5 req-898f561f-7938-4238-b55e-2e22f21ef9c2 service nova] Lock "8fe64eb8-b4e3-4037-80b1-0c151370d5a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:47:07 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-d49cb960-6cc7-448a-a5dd-bf5934a11ef5 req-898f561f-7938-4238-b55e-2e22f21ef9c2 service nova] Lock "8fe64eb8-b4e3-4037-80b1-0c151370d5a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:47:07 user nova-compute[75176]: DEBUG nova.compute.manager [req-d49cb960-6cc7-448a-a5dd-bf5934a11ef5 req-898f561f-7938-4238-b55e-2e22f21ef9c2 service nova] [instance: 8fe64eb8-b4e3-4037-80b1-0c151370d5a8] No waiting events found dispatching network-vif-plugged-9b3e8a32-f295-4443-b831-b334e3e819ed {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:47:07 user nova-compute[75176]: WARNING nova.compute.manager [req-d49cb960-6cc7-448a-a5dd-bf5934a11ef5 req-898f561f-7938-4238-b55e-2e22f21ef9c2 service nova] [instance: 8fe64eb8-b4e3-4037-80b1-0c151370d5a8] Received unexpected event network-vif-plugged-9b3e8a32-f295-4443-b831-b334e3e819ed for instance with vm_state building and task_state spawning.
Nov 28 15:47:07 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-694b3795-8d5f-4342-83e2-5fa795260088 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 402e779e-f507-49f1-a0d8-31ab0d23fbcd {{(pid=75176) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 15:47:07 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:47:07 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:47:07 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:47:08 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:47:09 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-4a60bf0b-79bc-49e7-ba55-746409dfe35d tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Acquiring lock "87037584-a853-4693-bb23-598772ec83c5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:47:09 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-4a60bf0b-79bc-49e7-ba55-746409dfe35d tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Lock "87037584-a853-4693-bb23-598772ec83c5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:47:09 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-4a60bf0b-79bc-49e7-ba55-746409dfe35d tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Acquiring lock "87037584-a853-4693-bb23-598772ec83c5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:47:09 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-4a60bf0b-79bc-49e7-ba55-746409dfe35d tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Lock "87037584-a853-4693-bb23-598772ec83c5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:47:09 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-4a60bf0b-79bc-49e7-ba55-746409dfe35d tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Lock "87037584-a853-4693-bb23-598772ec83c5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:47:09 user nova-compute[75176]: INFO nova.compute.manager [None req-4a60bf0b-79bc-49e7-ba55-746409dfe35d tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: 87037584-a853-4693-bb23-598772ec83c5] Terminating instance
Nov 28 15:47:09 user nova-compute[75176]: DEBUG nova.compute.manager [None req-4a60bf0b-79bc-49e7-ba55-746409dfe35d tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: 87037584-a853-4693-bb23-598772ec83c5] Start destroying the instance on the hypervisor. {{(pid=75176) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 15:47:09 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:47:09 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:47:09 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:47:09 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:47:09 user nova-compute[75176]: DEBUG nova.compute.manager [req-e3359bb4-2312-45c6-8882-a4802a7d8d7c req-56c95ae5-0010-4a3f-857d-5a14b84f63bf service nova] [instance: 8fe64eb8-b4e3-4037-80b1-0c151370d5a8] Received event network-vif-plugged-9b3e8a32-f295-4443-b831-b334e3e819ed {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:47:09 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-e3359bb4-2312-45c6-8882-a4802a7d8d7c req-56c95ae5-0010-4a3f-857d-5a14b84f63bf service nova] Acquiring lock "8fe64eb8-b4e3-4037-80b1-0c151370d5a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:47:09 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-e3359bb4-2312-45c6-8882-a4802a7d8d7c req-56c95ae5-0010-4a3f-857d-5a14b84f63bf service nova] Lock "8fe64eb8-b4e3-4037-80b1-0c151370d5a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:47:09 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-e3359bb4-2312-45c6-8882-a4802a7d8d7c req-56c95ae5-0010-4a3f-857d-5a14b84f63bf service nova] Lock "8fe64eb8-b4e3-4037-80b1-0c151370d5a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:47:09 user nova-compute[75176]: DEBUG nova.compute.manager [req-e3359bb4-2312-45c6-8882-a4802a7d8d7c req-56c95ae5-0010-4a3f-857d-5a14b84f63bf service nova] [instance: 8fe64eb8-b4e3-4037-80b1-0c151370d5a8] No waiting events found dispatching network-vif-plugged-9b3e8a32-f295-4443-b831-b334e3e819ed {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:47:09 user nova-compute[75176]: WARNING nova.compute.manager [req-e3359bb4-2312-45c6-8882-a4802a7d8d7c req-56c95ae5-0010-4a3f-857d-5a14b84f63bf service nova] [instance: 8fe64eb8-b4e3-4037-80b1-0c151370d5a8] Received unexpected event network-vif-plugged-9b3e8a32-f295-4443-b831-b334e3e819ed for instance with vm_state building and task_state spawning.
Nov 28 15:47:09 user nova-compute[75176]: DEBUG nova.compute.manager [req-16152790-da32-419e-acf6-82d05eb70730 req-70e442aa-c0a6-476b-a05d-6cbfc09d95e9 service nova] [instance: 87037584-a853-4693-bb23-598772ec83c5] Received event network-vif-unplugged-472865a9-bbc1-4a5c-9907-a1163abb4f8a {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:47:09 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-16152790-da32-419e-acf6-82d05eb70730 req-70e442aa-c0a6-476b-a05d-6cbfc09d95e9 service nova] Acquiring lock "87037584-a853-4693-bb23-598772ec83c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:47:09 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-16152790-da32-419e-acf6-82d05eb70730 req-70e442aa-c0a6-476b-a05d-6cbfc09d95e9 service nova] Lock "87037584-a853-4693-bb23-598772ec83c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:47:09 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-16152790-da32-419e-acf6-82d05eb70730 req-70e442aa-c0a6-476b-a05d-6cbfc09d95e9 service nova] Lock "87037584-a853-4693-bb23-598772ec83c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:47:09 user nova-compute[75176]: DEBUG nova.compute.manager [req-16152790-da32-419e-acf6-82d05eb70730 req-70e442aa-c0a6-476b-a05d-6cbfc09d95e9 service nova] [instance: 87037584-a853-4693-bb23-598772ec83c5] No waiting events found dispatching network-vif-unplugged-472865a9-bbc1-4a5c-9907-a1163abb4f8a {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:47:09 user nova-compute[75176]: DEBUG nova.compute.manager [req-16152790-da32-419e-acf6-82d05eb70730 req-70e442aa-c0a6-476b-a05d-6cbfc09d95e9 service nova] [instance: 87037584-a853-4693-bb23-598772ec83c5] Received event network-vif-unplugged-472865a9-bbc1-4a5c-9907-a1163abb4f8a for instance with task_state deleting. {{(pid=75176) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 15:47:09 user nova-compute[75176]: DEBUG nova.compute.manager [None req-79334e08-7b7d-43d8-9653-183f95bc064e tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] [instance: 8fe64eb8-b4e3-4037-80b1-0c151370d5a8] Instance event wait completed in 0 seconds for  {{(pid=75176) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 15:47:09 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-79334e08-7b7d-43d8-9653-183f95bc064e tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] [instance: 8fe64eb8-b4e3-4037-80b1-0c151370d5a8] Guest created on hypervisor {{(pid=75176) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 15:47:09 user nova-compute[75176]: INFO nova.virt.libvirt.driver [-] [instance: 8fe64eb8-b4e3-4037-80b1-0c151370d5a8] Instance spawned successfully.
Nov 28 15:47:09 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-79334e08-7b7d-43d8-9653-183f95bc064e tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] [instance: 8fe64eb8-b4e3-4037-80b1-0c151370d5a8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 15:47:09 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-79334e08-7b7d-43d8-9653-183f95bc064e tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] [instance: 8fe64eb8-b4e3-4037-80b1-0c151370d5a8] Found default for hw_cdrom_bus of ide {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:47:09 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-79334e08-7b7d-43d8-9653-183f95bc064e tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] [instance: 8fe64eb8-b4e3-4037-80b1-0c151370d5a8] Found default for hw_disk_bus of virtio {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:47:09 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-79334e08-7b7d-43d8-9653-183f95bc064e tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] [instance: 8fe64eb8-b4e3-4037-80b1-0c151370d5a8] Found default for hw_input_bus of None {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:47:09 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-79334e08-7b7d-43d8-9653-183f95bc064e tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] [instance: 8fe64eb8-b4e3-4037-80b1-0c151370d5a8] Found default for hw_pointer_model of None {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:47:09 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-79334e08-7b7d-43d8-9653-183f95bc064e tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] [instance: 8fe64eb8-b4e3-4037-80b1-0c151370d5a8] Found default for hw_video_model of virtio {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:47:09 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-79334e08-7b7d-43d8-9653-183f95bc064e tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] [instance: 8fe64eb8-b4e3-4037-80b1-0c151370d5a8] Found default for hw_vif_model of virtio {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:47:09 user nova-compute[75176]: INFO nova.compute.manager [None req-79334e08-7b7d-43d8-9653-183f95bc064e tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] [instance: 8fe64eb8-b4e3-4037-80b1-0c151370d5a8] Took 5.91 seconds to spawn the instance on the hypervisor.
Nov 28 15:47:09 user nova-compute[75176]: DEBUG nova.compute.manager [None req-79334e08-7b7d-43d8-9653-183f95bc064e tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] [instance: 8fe64eb8-b4e3-4037-80b1-0c151370d5a8] Checking state {{(pid=75176) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 15:47:09 user nova-compute[75176]: INFO nova.compute.manager [None req-79334e08-7b7d-43d8-9653-183f95bc064e tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] [instance: 8fe64eb8-b4e3-4037-80b1-0c151370d5a8] Took 6.85 seconds to build instance.
Nov 28 15:47:09 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-79334e08-7b7d-43d8-9653-183f95bc064e tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] Lock "8fe64eb8-b4e3-4037-80b1-0c151370d5a8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.967s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:47:10 user nova-compute[75176]: INFO nova.virt.libvirt.driver [-] [instance: 87037584-a853-4693-bb23-598772ec83c5] Instance destroyed successfully.
Nov 28 15:47:10 user nova-compute[75176]: DEBUG nova.objects.instance [None req-4a60bf0b-79bc-49e7-ba55-746409dfe35d tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Lazy-loading 'resources' on Instance uuid 87037584-a853-4693-bb23-598772ec83c5 {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:47:10 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-4a60bf0b-79bc-49e7-ba55-746409dfe35d tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T15:45:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-788398439',display_name='tempest-TestVolumeBootPattern-server-788398439',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-788398439',id=21,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-28T15:45:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='07c7783cc16049208421204910982c79',ramdisk_id='',reservation_id='r-kw5xlibd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1695196118',owner_user_name='tempest-TestVolumeBootPattern-1695196118-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T15:45:40Z,user_data=None,user_id='081bf84d24194b81be4e0a6638db9b66',uuid=87037584-a853-4693-bb23-598772ec83c5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "472865a9-bbc1-4a5c-9907-a1163abb4f8a", "address": "fa:16:3e:13:7e:bd", "network": {"id": "5ec264ad-3459-468c-bdbf-c6a4ef016951", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1574289626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07c7783cc16049208421204910982c79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap472865a9-bb", "ovs_interfaceid": "472865a9-bbc1-4a5c-9907-a1163abb4f8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 15:47:10 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-4a60bf0b-79bc-49e7-ba55-746409dfe35d tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Converting VIF {"id": "472865a9-bbc1-4a5c-9907-a1163abb4f8a", "address": "fa:16:3e:13:7e:bd", "network": {"id": "5ec264ad-3459-468c-bdbf-c6a4ef016951", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1574289626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07c7783cc16049208421204910982c79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap472865a9-bb", "ovs_interfaceid": "472865a9-bbc1-4a5c-9907-a1163abb4f8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:47:10 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-4a60bf0b-79bc-49e7-ba55-746409dfe35d tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:7e:bd,bridge_name='br-int',has_traffic_filtering=True,id=472865a9-bbc1-4a5c-9907-a1163abb4f8a,network=Network(5ec264ad-3459-468c-bdbf-c6a4ef016951),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap472865a9-bb') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:47:10 user nova-compute[75176]: DEBUG os_vif [None req-4a60bf0b-79bc-49e7-ba55-746409dfe35d tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:7e:bd,bridge_name='br-int',has_traffic_filtering=True,id=472865a9-bbc1-4a5c-9907-a1163abb4f8a,network=Network(5ec264ad-3459-468c-bdbf-c6a4ef016951),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap472865a9-bb') {{(pid=75176) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 15:47:10 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:47:10 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap472865a9-bb, bridge=br-int, if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:47:10 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:47:10 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:47:10 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:47:10 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bc175098-8104-4ff2-a548-92bd43b0ebfe) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:47:10 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:47:10 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:47:10 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:47:10 user nova-compute[75176]: INFO os_vif [None req-4a60bf0b-79bc-49e7-ba55-746409dfe35d tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:7e:bd,bridge_name='br-int',has_traffic_filtering=True,id=472865a9-bbc1-4a5c-9907-a1163abb4f8a,network=Network(5ec264ad-3459-468c-bdbf-c6a4ef016951),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap472865a9-bb')
Nov 28 15:47:10 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4a60bf0b-79bc-49e7-ba55-746409dfe35d tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: 87037584-a853-4693-bb23-598772ec83c5] calling os-brick to detach iSCSI Volume {{(pid=75176) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 15:47:10 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a60bf0b-79bc-49e7-ba55-746409dfe35d tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c1b8a00>, {'target_iqn': 'iqn.2010-10.org.openstack:69f59c18-c5e6-4afe-a74b-afe6d64d4e49', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pQUyFIPa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 15:47:10 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-4a60bf0b-79bc-49e7-ba55-746409dfe35d tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 15:47:10 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-4a60bf0b-79bc-49e7-ba55-746409dfe35d tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 15:47:10 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-4a60bf0b-79bc-49e7-ba55-746409dfe35d tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 15:47:10 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:47:10 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:47:10 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[26c4dc49-b3ca-4d65-b898-fa0ca5b4c785]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a1f5de5d-be7a-443a-9831-791c8667c09b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:69f59c18-c5e6-4afe-a74b-afe6d64d4e49\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:705191a8-a203-4bbf-93d3-2a4e75a359b9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e7728674-3e10-438c-8fa0-9fc73367663f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:47:10 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a60bf0b-79bc-49e7-ba55-746409dfe35d tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 15:47:10 user nova-compute[75176]: No targets found.
Nov 28 15:47:10 user nova-compute[75176]: iSNS:
Nov 28 15:47:10 user nova-compute[75176]: No targets found.
Nov 28 15:47:10 user nova-compute[75176]: STATIC:
Nov 28 15:47:10 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:a1f5de5d-be7a-443a-9831-791c8667c09b
Nov 28 15:47:10 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:47:10 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:47:10 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d
Nov 28 15:47:10 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:47:10 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:47:10 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:69f59c18-c5e6-4afe-a74b-afe6d64d4e49
Nov 28 15:47:10 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:47:10 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:47:10 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24
Nov 28 15:47:10 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:47:10 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:47:10 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:705191a8-a203-4bbf-93d3-2a4e75a359b9
Nov 28 15:47:10 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:47:10 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:47:10 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:e7728674-3e10-438c-8fa0-9fc73367663f
Nov 28 15:47:10 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:47:10 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:47:10 user nova-compute[75176]: FIRMWARE:
Nov 28 15:47:10 user nova-compute[75176]: No targets found.
Nov 28 15:47:10 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:47:10 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a60bf0b-79bc-49e7-ba55-746409dfe35d tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 15:47:10 user nova-compute[75176]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 15:47:10 user nova-compute[75176]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75176) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 15:47:10 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a60bf0b-79bc-49e7-ba55-746409dfe35d tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:69f59c18-c5e6-4afe-a74b-afe6d64d4e49', 0)] {{(pid=75176) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 15:47:10 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:47:10 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:47:10 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[940c0aae-ad10-423e-80e0-e37d09199a41]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:69f59c18-c5e6-4afe-a74b-afe6d64d4e49\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:705191a8-a203-4bbf-93d3-2a4e75a359b9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a1f5de5d-be7a-443a-9831-791c8667c09b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e7728674-3e10-438c-8fa0-9fc73367663f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:47:10 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:47:10 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:47:10 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c01a859-01f8-44d3-9102-85c1b7b41ad5]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1f5de5d-be7a-443a-9831-791c8667c09b (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69f59c18-c5e6-4afe-a74b-afe6d64d4e49 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7728674-3e10-438c-8fa0-9fc73367663f (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:705191a8-a203-4bbf-93d3-2a4e75a359b9 (non-flash)\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:47:10 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a60bf0b-79bc-49e7-ba55-746409dfe35d tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1f5de5d-be7a-443a-9831-791c8667c09b (non-flash)
Nov 28 15:47:10 user nova-compute[75176]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24 (non-flash)
Nov 28 15:47:10 user nova-compute[75176]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d (non-flash)
Nov 28 15:47:10 user nova-compute[75176]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69f59c18-c5e6-4afe-a74b-afe6d64d4e49 (non-flash)
Nov 28 15:47:10 user nova-compute[75176]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7728674-3e10-438c-8fa0-9fc73367663f (non-flash)
Nov 28 15:47:10 user nova-compute[75176]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:705191a8-a203-4bbf-93d3-2a4e75a359b9 (non-flash)
Nov 28 15:47:10 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:47:10 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a60bf0b-79bc-49e7-ba55-746409dfe35d tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1f5de5d-be7a-443a-9831-791c8667c09b (non-flash)
Nov 28 15:47:10 user nova-compute[75176]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24 (non-flash)
Nov 28 15:47:10 user nova-compute[75176]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d (non-flash)
Nov 28 15:47:10 user nova-compute[75176]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69f59c18-c5e6-4afe-a74b-afe6d64d4e49 (non-flash)
Nov 28 15:47:10 user nova-compute[75176]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7728674-3e10-438c-8fa0-9fc73367663f (non-flash)
Nov 28 15:47:10 user nova-compute[75176]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:705191a8-a203-4bbf-93d3-2a4e75a359b9 (non-flash)
Nov 28 15:47:10 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 15:47:10 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a60bf0b-79bc-49e7-ba55-746409dfe35d tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4644361e10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:69f59c18-c5e6-4afe-a74b-afe6d64d4e49'): ({'sdg'}, set())}) {{(pid=75176) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 15:47:10 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-4a60bf0b-79bc-49e7-ba55-746409dfe35d tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Removing single pathed devices sdg {{(pid=75176) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 15:47:10 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:47:10 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:47:10 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c9d1088-5de5-4255-8f3f-4bc45d627577]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:47:10 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:47:10 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.019s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:47:10 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbfeb57a-4b29-44c2-aae7-ea858e98263f]: (4, ('ok\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:47:10 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-4a60bf0b-79bc-49e7-ba55-746409dfe35d tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Flushing IO for device /dev/sdg {{(pid=75176) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 15:47:10 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:47:10 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.013s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:47:10 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[e53ef22f-4743-43cd-9890-fe2d1f8df44a]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:47:10 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-4a60bf0b-79bc-49e7-ba55-746409dfe35d tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75176) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 15:47:10 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:47:10 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:47:10 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.058s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:47:10 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[e84e1ba8-75e6-447f-979d-40a6530fb9c6]: (4, ('1', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:47:10 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-4a60bf0b-79bc-49e7-ba55-746409dfe35d tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75176) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 15:47:10 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-4a60bf0b-79bc-49e7-ba55-746409dfe35d tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] SCSI volumes sdg have been removed. {{(pid=75176) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 15:47:10 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a60bf0b-79bc-49e7-ba55-746409dfe35d tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:69f59c18-c5e6-4afe-a74b-afe6d64d4e49')] {{(pid=75176) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 15:47:10 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69f59c18-c5e6-4afe-a74b-afe6d64d4e49 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:47:10 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69f59c18-c5e6-4afe-a74b-afe6d64d4e49 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:47:10 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[83c26ff6-207c-48e5-9f10-55726a5d36d7]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:47:10 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a60bf0b-79bc-49e7-ba55-746409dfe35d tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:47:10 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69f59c18-c5e6-4afe-a74b-afe6d64d4e49 -p 172.16.0.220:3260 --logout {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:47:10 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69f59c18-c5e6-4afe-a74b-afe6d64d4e49 -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:47:10 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cf54c11-02ae-48a6-8c95-253b8c00b9f6]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:69f59c18-c5e6-4afe-a74b-afe6d64d4e49, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:69f59c18-c5e6-4afe-a74b-afe6d64d4e49, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:47:10 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a60bf0b-79bc-49e7-ba55-746409dfe35d tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:69f59c18-c5e6-4afe-a74b-afe6d64d4e49, portal: 172.16.0.220,3260]
Nov 28 15:47:10 user nova-compute[75176]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:69f59c18-c5e6-4afe-a74b-afe6d64d4e49, portal: 172.16.0.220,3260] successful.
Nov 28 15:47:10 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:47:10 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69f59c18-c5e6-4afe-a74b-afe6d64d4e49 -p 172.16.0.220:3260 --op delete {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:47:10 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69f59c18-c5e6-4afe-a74b-afe6d64d4e49 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:47:10 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[66c25b63-1c31-44a2-9da0-cb348be564e3]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:47:10 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a60bf0b-79bc-49e7-ba55-746409dfe35d tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:47:10 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-4a60bf0b-79bc-49e7-ba55-746409dfe35d tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.378s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 15:47:10 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a60bf0b-79bc-49e7-ba55-746409dfe35d tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] <== disconnect_volume: return (380ms) None {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 15:47:10 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4a60bf0b-79bc-49e7-ba55-746409dfe35d tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: 87037584-a853-4693-bb23-598772ec83c5] Disconnected iSCSI Volume {{(pid=75176) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 15:47:10 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-4a60bf0b-79bc-49e7-ba55-746409dfe35d tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: 87037584-a853-4693-bb23-598772ec83c5] Deleting instance files /opt/stack/data/nova/instances/87037584-a853-4693-bb23-598772ec83c5_del
Nov 28 15:47:10 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-4a60bf0b-79bc-49e7-ba55-746409dfe35d tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: 87037584-a853-4693-bb23-598772ec83c5] Deletion of /opt/stack/data/nova/instances/87037584-a853-4693-bb23-598772ec83c5_del complete
Nov 28 15:47:10 user nova-compute[75176]: INFO nova.compute.manager [None req-4a60bf0b-79bc-49e7-ba55-746409dfe35d tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: 87037584-a853-4693-bb23-598772ec83c5] Took 1.32 seconds to destroy the instance on the hypervisor.
Nov 28 15:47:10 user nova-compute[75176]: DEBUG oslo.service.loopingcall [None req-4a60bf0b-79bc-49e7-ba55-746409dfe35d tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75176) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 15:47:10 user nova-compute[75176]: DEBUG nova.compute.manager [-] [instance: 87037584-a853-4693-bb23-598772ec83c5] Deallocating network for instance {{(pid=75176) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 15:47:10 user nova-compute[75176]: DEBUG nova.network.neutron [-] [instance: 87037584-a853-4693-bb23-598772ec83c5] deallocate_for_instance() {{(pid=75176) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 15:47:11 user nova-compute[75176]: DEBUG nova.network.neutron [-] [instance: 87037584-a853-4693-bb23-598772ec83c5] Updating instance_info_cache with network_info: [] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:47:11 user nova-compute[75176]: INFO nova.compute.manager [-] [instance: 87037584-a853-4693-bb23-598772ec83c5] Took 0.55 seconds to deallocate network for instance.
Nov 28 15:47:11 user nova-compute[75176]: DEBUG nova.compute.manager [req-4097c6a2-a870-44a2-af63-9ec705a114f6 req-df376232-5e2d-478b-9f42-1bf957d8bbef service nova] [instance: 87037584-a853-4693-bb23-598772ec83c5] Received event network-vif-deleted-472865a9-bbc1-4a5c-9907-a1163abb4f8a {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:47:11 user nova-compute[75176]: DEBUG nova.compute.manager [req-6b4ff7ab-56c1-4119-a25f-9ee81f3e10c2 req-275e3c5e-029b-49f3-9cc9-3a475161f8fc service nova] [instance: 87037584-a853-4693-bb23-598772ec83c5] Received event network-vif-plugged-472865a9-bbc1-4a5c-9907-a1163abb4f8a {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:47:11 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-6b4ff7ab-56c1-4119-a25f-9ee81f3e10c2 req-275e3c5e-029b-49f3-9cc9-3a475161f8fc service nova] Acquiring lock "87037584-a853-4693-bb23-598772ec83c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:47:11 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-6b4ff7ab-56c1-4119-a25f-9ee81f3e10c2 req-275e3c5e-029b-49f3-9cc9-3a475161f8fc service nova] Lock "87037584-a853-4693-bb23-598772ec83c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:47:11 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-6b4ff7ab-56c1-4119-a25f-9ee81f3e10c2 req-275e3c5e-029b-49f3-9cc9-3a475161f8fc service nova] Lock "87037584-a853-4693-bb23-598772ec83c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:47:11 user nova-compute[75176]: DEBUG nova.compute.manager [req-6b4ff7ab-56c1-4119-a25f-9ee81f3e10c2 req-275e3c5e-029b-49f3-9cc9-3a475161f8fc service nova] [instance: 87037584-a853-4693-bb23-598772ec83c5] No waiting events found dispatching network-vif-plugged-472865a9-bbc1-4a5c-9907-a1163abb4f8a {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:47:11 user nova-compute[75176]: WARNING nova.compute.manager [req-6b4ff7ab-56c1-4119-a25f-9ee81f3e10c2 req-275e3c5e-029b-49f3-9cc9-3a475161f8fc service nova] [instance: 87037584-a853-4693-bb23-598772ec83c5] Received unexpected event network-vif-plugged-472865a9-bbc1-4a5c-9907-a1163abb4f8a for instance with vm_state active and task_state deleting.
Nov 28 15:47:11 user nova-compute[75176]: INFO nova.compute.manager [None req-4a60bf0b-79bc-49e7-ba55-746409dfe35d tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: 87037584-a853-4693-bb23-598772ec83c5] Took 0.83 seconds to detach 1 volumes for instance.
Nov 28 15:47:11 user nova-compute[75176]: DEBUG nova.compute.manager [None req-4a60bf0b-79bc-49e7-ba55-746409dfe35d tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: 87037584-a853-4693-bb23-598772ec83c5] Deleting volume: 69f59c18-c5e6-4afe-a74b-afe6d64d4e49 {{(pid=75176) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 28 15:47:12 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-4a60bf0b-79bc-49e7-ba55-746409dfe35d tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:47:12 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-4a60bf0b-79bc-49e7-ba55-746409dfe35d tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:47:12 user nova-compute[75176]: DEBUG nova.compute.provider_tree [None req-4a60bf0b-79bc-49e7-ba55-746409dfe35d tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Inventory has not changed in ProviderTree for provider: b37848d8-f401-4155-a029-b0ffa09ff85b {{(pid=75176) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 15:47:12 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-4a60bf0b-79bc-49e7-ba55-746409dfe35d tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Inventory has not changed for provider b37848d8-f401-4155-a029-b0ffa09ff85b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75176) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 15:47:12 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-4a60bf0b-79bc-49e7-ba55-746409dfe35d tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.450s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:47:12 user nova-compute[75176]: INFO nova.scheduler.client.report [None req-4a60bf0b-79bc-49e7-ba55-746409dfe35d tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Deleted allocations for instance 87037584-a853-4693-bb23-598772ec83c5
Nov 28 15:47:12 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-4a60bf0b-79bc-49e7-ba55-746409dfe35d tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Lock "87037584-a853-4693-bb23-598772ec83c5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.483s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:47:12 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-b7fb4dec-a0d8-4f46-b47d-f64e1ccae0d5 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 6b3646e6-512e-4cd6-b3c1-89438c19c408 is timed out.
Nov 28 15:47:12 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-b7fb4dec-a0d8-4f46-b47d-f64e1ccae0d5 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] Successfully detached device vdb from instance 6b3646e6-512e-4cd6-b3c1-89438c19c408 from the live domain config.
Nov 28 15:47:12 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b7fb4dec-a0d8-4f46-b47d-f64e1ccae0d5 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] [instance: 6b3646e6-512e-4cd6-b3c1-89438c19c408] calling os-brick to detach iSCSI Volume {{(pid=75176) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 15:47:12 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7fb4dec-a0d8-4f46-b47d-f64e1ccae0d5 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c1b8a00>, {'target_iqn': 'iqn.2010-10.org.openstack:e7728674-3e10-438c-8fa0-9fc73367663f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OlvPosBa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'volume_id': 'e7728674-3e10-438c-8fa0-9fc73367663f'}, None), 'kwargs': False}}" {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 15:47:12 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-b7fb4dec-a0d8-4f46-b47d-f64e1ccae0d5 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 15:47:12 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-b7fb4dec-a0d8-4f46-b47d-f64e1ccae0d5 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 15:47:12 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-b7fb4dec-a0d8-4f46-b47d-f64e1ccae0d5 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.004s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 15:47:12 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:47:12 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:47:13 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[d110884c-76b6-413e-a63b-0fc122d97597]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a1f5de5d-be7a-443a-9831-791c8667c09b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:705191a8-a203-4bbf-93d3-2a4e75a359b9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e7728674-3e10-438c-8fa0-9fc73367663f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:47:13 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7fb4dec-a0d8-4f46-b47d-f64e1ccae0d5 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 15:47:13 user nova-compute[75176]: No targets found.
Nov 28 15:47:13 user nova-compute[75176]: iSNS:
Nov 28 15:47:13 user nova-compute[75176]: No targets found.
Nov 28 15:47:13 user nova-compute[75176]: STATIC:
Nov 28 15:47:13 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:a1f5de5d-be7a-443a-9831-791c8667c09b
Nov 28 15:47:13 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:47:13 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:47:13 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d
Nov 28 15:47:13 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:47:13 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:47:13 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24
Nov 28 15:47:13 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:47:13 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:47:13 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:705191a8-a203-4bbf-93d3-2a4e75a359b9
Nov 28 15:47:13 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:47:13 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:47:13 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:e7728674-3e10-438c-8fa0-9fc73367663f
Nov 28 15:47:13 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:47:13 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:47:13 user nova-compute[75176]: FIRMWARE:
Nov 28 15:47:13 user nova-compute[75176]: No targets found.
Nov 28 15:47:13 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:47:13 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7fb4dec-a0d8-4f46-b47d-f64e1ccae0d5 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 15:47:13 user nova-compute[75176]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 15:47:13 user nova-compute[75176]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75176) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 15:47:13 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7fb4dec-a0d8-4f46-b47d-f64e1ccae0d5 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e7728674-3e10-438c-8fa0-9fc73367663f', 0)] {{(pid=75176) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 15:47:13 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:47:13 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:47:13 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[11f85f13-50b1-4494-8acc-5618e7ffe44d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:705191a8-a203-4bbf-93d3-2a4e75a359b9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a1f5de5d-be7a-443a-9831-791c8667c09b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e7728674-3e10-438c-8fa0-9fc73367663f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:47:13 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:47:13 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:47:13 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[6852186b-05f5-49df-8443-8f547bde4557]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1f5de5d-be7a-443a-9831-791c8667c09b (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7728674-3e10-438c-8fa0-9fc73367663f (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:705191a8-a203-4bbf-93d3-2a4e75a359b9 (non-flash)\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:47:13 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7fb4dec-a0d8-4f46-b47d-f64e1ccae0d5 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1f5de5d-be7a-443a-9831-791c8667c09b (non-flash)
Nov 28 15:47:13 user nova-compute[75176]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24 (non-flash)
Nov 28 15:47:13 user nova-compute[75176]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d (non-flash)
Nov 28 15:47:13 user nova-compute[75176]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7728674-3e10-438c-8fa0-9fc73367663f (non-flash)
Nov 28 15:47:13 user nova-compute[75176]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:705191a8-a203-4bbf-93d3-2a4e75a359b9 (non-flash)
Nov 28 15:47:13 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:47:13 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7fb4dec-a0d8-4f46-b47d-f64e1ccae0d5 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1f5de5d-be7a-443a-9831-791c8667c09b (non-flash)
Nov 28 15:47:13 user nova-compute[75176]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24 (non-flash)
Nov 28 15:47:13 user nova-compute[75176]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d (non-flash)
Nov 28 15:47:13 user nova-compute[75176]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7728674-3e10-438c-8fa0-9fc73367663f (non-flash)
Nov 28 15:47:13 user nova-compute[75176]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:705191a8-a203-4bbf-93d3-2a4e75a359b9 (non-flash)
Nov 28 15:47:13 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 15:47:13 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7fb4dec-a0d8-4f46-b47d-f64e1ccae0d5 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f462c55d000>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e7728674-3e10-438c-8fa0-9fc73367663f'): ({'sdb'}, set())}) {{(pid=75176) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 15:47:13 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-b7fb4dec-a0d8-4f46-b47d-f64e1ccae0d5 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] Removing single pathed devices sdb {{(pid=75176) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 15:47:13 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:47:13 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:47:13 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec678206-d060-4323-b2fc-0171b61741c0]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:47:13 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:47:13 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.025s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:47:13 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[2747a8d1-f07d-429a-9e7a-3b4786389402]: (4, ('ok\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:47:13 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-b7fb4dec-a0d8-4f46-b47d-f64e1ccae0d5 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] Flushing IO for device /dev/sdb {{(pid=75176) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 15:47:13 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:47:13 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.077s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:47:13 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a88c1a4-cfcb-43bd-b24d-91a3b5cb09ce]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:47:13 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-b7fb4dec-a0d8-4f46-b47d-f64e1ccae0d5 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75176) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 15:47:13 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:47:13 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.055s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:47:13 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1ba1663-b256-487a-8024-506eaff67955]: (4, ('1', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:47:13 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-b7fb4dec-a0d8-4f46-b47d-f64e1ccae0d5 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75176) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 15:47:13 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-b7fb4dec-a0d8-4f46-b47d-f64e1ccae0d5 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] SCSI volumes sdb have been removed. {{(pid=75176) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 15:47:13 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7fb4dec-a0d8-4f46-b47d-f64e1ccae0d5 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e7728674-3e10-438c-8fa0-9fc73367663f')] {{(pid=75176) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 15:47:13 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7728674-3e10-438c-8fa0-9fc73367663f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:47:13 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7728674-3e10-438c-8fa0-9fc73367663f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:47:13 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4a43865-0bfb-45f6-b64d-51950d5c9115]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:47:13 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7fb4dec-a0d8-4f46-b47d-f64e1ccae0d5 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:47:13 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7728674-3e10-438c-8fa0-9fc73367663f -p 172.16.0.220:3260 --logout {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:47:13 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7728674-3e10-438c-8fa0-9fc73367663f -p 172.16.0.220:3260 --logout" returned: 0 in 0.094s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:47:13 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[47c397dc-57ee-4c7e-ab83-6337d28be87b]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:e7728674-3e10-438c-8fa0-9fc73367663f, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:e7728674-3e10-438c-8fa0-9fc73367663f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:47:13 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7fb4dec-a0d8-4f46-b47d-f64e1ccae0d5 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:e7728674-3e10-438c-8fa0-9fc73367663f, portal: 172.16.0.220,3260]
Nov 28 15:47:13 user nova-compute[75176]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:e7728674-3e10-438c-8fa0-9fc73367663f, portal: 172.16.0.220,3260] successful.
Nov 28 15:47:13 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:47:13 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7728674-3e10-438c-8fa0-9fc73367663f -p 172.16.0.220:3260 --op delete {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:47:13 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7728674-3e10-438c-8fa0-9fc73367663f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:47:13 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e9a46f1-8d78-4100-8883-4acfab2ef16a]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:47:13 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7fb4dec-a0d8-4f46-b47d-f64e1ccae0d5 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:47:13 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-b7fb4dec-a0d8-4f46-b47d-f64e1ccae0d5 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.463s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 15:47:13 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7fb4dec-a0d8-4f46-b47d-f64e1ccae0d5 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] <== disconnect_volume: return (467ms) None {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 15:47:13 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b7fb4dec-a0d8-4f46-b47d-f64e1ccae0d5 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] [instance: 6b3646e6-512e-4cd6-b3c1-89438c19c408] Disconnected iSCSI Volume {{(pid=75176) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 15:47:13 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:47:14 user nova-compute[75176]: DEBUG nova.objects.instance [None req-b7fb4dec-a0d8-4f46-b47d-f64e1ccae0d5 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] Lazy-loading 'flavor' on Instance uuid 6b3646e6-512e-4cd6-b3c1-89438c19c408 {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:47:14 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-b7fb4dec-a0d8-4f46-b47d-f64e1ccae0d5 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] Lock "6b3646e6-512e-4cd6-b3c1-89438c19c408" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.220s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:47:15 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:47:15 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-bb6a2c80-e3e4-4b9c-b027-8ce9af8b5b1e tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Acquiring lock "7b4c281e-5b8d-43b1-8914-572e1341c0a7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:47:15 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-bb6a2c80-e3e4-4b9c-b027-8ce9af8b5b1e tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Lock "7b4c281e-5b8d-43b1-8914-572e1341c0a7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:47:15 user nova-compute[75176]: INFO nova.compute.manager [None req-bb6a2c80-e3e4-4b9c-b027-8ce9af8b5b1e tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] [instance: 7b4c281e-5b8d-43b1-8914-572e1341c0a7] Detaching volume 705191a8-a203-4bbf-93d3-2a4e75a359b9
Nov 28 15:47:15 user nova-compute[75176]: INFO nova.virt.block_device [None req-bb6a2c80-e3e4-4b9c-b027-8ce9af8b5b1e tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] [instance: 7b4c281e-5b8d-43b1-8914-572e1341c0a7] Attempting to driver detach volume 705191a8-a203-4bbf-93d3-2a4e75a359b9 from mountpoint /dev/vdb
Nov 28 15:47:15 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-c49c85d0-a6ba-422a-9c08-b6031579ddc8 tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Acquiring lock "7b4c281e-5b8d-43b1-8914-572e1341c0a7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:47:15 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-bb6a2c80-e3e4-4b9c-b027-8ce9af8b5b1e tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Attempting to detach device vdb from instance 7b4c281e-5b8d-43b1-8914-572e1341c0a7 from the persistent domain config. {{(pid=75176) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 15:47:15 user nova-compute[75176]: DEBUG nova.virt.libvirt.guest [None req-bb6a2c80-e3e4-4b9c-b027-8ce9af8b5b1e tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 15:47:15 user nova-compute[75176]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 15:47:15 user nova-compute[75176]:   <source dev="/dev/sdc"/>
Nov 28 15:47:15 user nova-compute[75176]:   <target dev="vdb" bus="virtio"/>
Nov 28 15:47:15 user nova-compute[75176]:   <serial>705191a8-a203-4bbf-93d3-2a4e75a359b9</serial>
Nov 28 15:47:15 user nova-compute[75176]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 15:47:15 user nova-compute[75176]: </disk>
Nov 28 15:47:15 user nova-compute[75176]:  {{(pid=75176) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 15:47:15 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-bb6a2c80-e3e4-4b9c-b027-8ce9af8b5b1e tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Successfully detached device vdb from instance 7b4c281e-5b8d-43b1-8914-572e1341c0a7 from the persistent domain config.
Nov 28 15:47:15 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-bb6a2c80-e3e4-4b9c-b027-8ce9af8b5b1e tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7b4c281e-5b8d-43b1-8914-572e1341c0a7 from the live domain config. {{(pid=75176) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 15:47:15 user nova-compute[75176]: DEBUG nova.virt.libvirt.guest [None req-bb6a2c80-e3e4-4b9c-b027-8ce9af8b5b1e tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 15:47:15 user nova-compute[75176]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 15:47:15 user nova-compute[75176]:   <source dev="/dev/sdc"/>
Nov 28 15:47:15 user nova-compute[75176]:   <target dev="vdb" bus="virtio"/>
Nov 28 15:47:15 user nova-compute[75176]:   <serial>705191a8-a203-4bbf-93d3-2a4e75a359b9</serial>
Nov 28 15:47:15 user nova-compute[75176]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 15:47:15 user nova-compute[75176]: </disk>
Nov 28 15:47:15 user nova-compute[75176]:  {{(pid=75176) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 15:47:16 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-bb6a2c80-e3e4-4b9c-b027-8ce9af8b5b1e tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7b4c281e-5b8d-43b1-8914-572e1341c0a7 {{(pid=75176) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 15:47:20 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:47:20 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:47:20 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75176) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 15:47:20 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75176) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 15:47:20 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75176) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 15:47:20 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:47:22 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-59bdccf0-8ceb-44cc-bdf3-1adc79d68a1c tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Acquiring lock "a6ebcc53-802a-4515-ba41-3e8e1129235f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:47:22 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-59bdccf0-8ceb-44cc-bdf3-1adc79d68a1c tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Lock "a6ebcc53-802a-4515-ba41-3e8e1129235f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:47:22 user nova-compute[75176]: DEBUG nova.compute.manager [None req-59bdccf0-8ceb-44cc-bdf3-1adc79d68a1c tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] [instance: a6ebcc53-802a-4515-ba41-3e8e1129235f] Starting instance... {{(pid=75176) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 15:47:22 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-59bdccf0-8ceb-44cc-bdf3-1adc79d68a1c tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:47:22 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-59bdccf0-8ceb-44cc-bdf3-1adc79d68a1c tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:47:22 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-59bdccf0-8ceb-44cc-bdf3-1adc79d68a1c tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75176) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 15:47:22 user nova-compute[75176]: INFO nova.compute.claims [None req-59bdccf0-8ceb-44cc-bdf3-1adc79d68a1c tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] [instance: a6ebcc53-802a-4515-ba41-3e8e1129235f] Claim successful on node user
Nov 28 15:47:23 user nova-compute[75176]: DEBUG nova.compute.provider_tree [None req-59bdccf0-8ceb-44cc-bdf3-1adc79d68a1c tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Inventory has not changed in ProviderTree for provider: b37848d8-f401-4155-a029-b0ffa09ff85b {{(pid=75176) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 15:47:23 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-59bdccf0-8ceb-44cc-bdf3-1adc79d68a1c tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Inventory has not changed for provider b37848d8-f401-4155-a029-b0ffa09ff85b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75176) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 15:47:23 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-59bdccf0-8ceb-44cc-bdf3-1adc79d68a1c tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.541s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:47:23 user nova-compute[75176]: DEBUG nova.compute.manager [None req-59bdccf0-8ceb-44cc-bdf3-1adc79d68a1c tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] [instance: a6ebcc53-802a-4515-ba41-3e8e1129235f] Start building networks asynchronously for instance. {{(pid=75176) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 15:47:23 user nova-compute[75176]: DEBUG nova.compute.manager [None req-59bdccf0-8ceb-44cc-bdf3-1adc79d68a1c tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] [instance: a6ebcc53-802a-4515-ba41-3e8e1129235f] Allocating IP information in the background. {{(pid=75176) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 15:47:23 user nova-compute[75176]: DEBUG nova.network.neutron [None req-59bdccf0-8ceb-44cc-bdf3-1adc79d68a1c tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] [instance: a6ebcc53-802a-4515-ba41-3e8e1129235f] allocate_for_instance() {{(pid=75176) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 15:47:23 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-59bdccf0-8ceb-44cc-bdf3-1adc79d68a1c tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] [instance: a6ebcc53-802a-4515-ba41-3e8e1129235f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 15:47:23 user nova-compute[75176]: DEBUG nova.compute.manager [None req-59bdccf0-8ceb-44cc-bdf3-1adc79d68a1c tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] [instance: a6ebcc53-802a-4515-ba41-3e8e1129235f] Start building block device mappings for instance. {{(pid=75176) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 15:47:23 user nova-compute[75176]: DEBUG nova.policy [None req-59bdccf0-8ceb-44cc-bdf3-1adc79d68a1c tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '54766bbdce4346c0bd508451478b50aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1dfeef484e4627a0061d9d36fd2b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75176) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 15:47:23 user nova-compute[75176]: DEBUG nova.compute.manager [None req-59bdccf0-8ceb-44cc-bdf3-1adc79d68a1c tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] [instance: a6ebcc53-802a-4515-ba41-3e8e1129235f] Start spawning the instance on the hypervisor. {{(pid=75176) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 15:47:23 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-59bdccf0-8ceb-44cc-bdf3-1adc79d68a1c tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] [instance: a6ebcc53-802a-4515-ba41-3e8e1129235f] Creating instance directory {{(pid=75176) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 15:47:23 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-59bdccf0-8ceb-44cc-bdf3-1adc79d68a1c tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] [instance: a6ebcc53-802a-4515-ba41-3e8e1129235f] Creating image(s)
Nov 28 15:47:23 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-59bdccf0-8ceb-44cc-bdf3-1adc79d68a1c tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Acquiring lock "/opt/stack/data/nova/instances/a6ebcc53-802a-4515-ba41-3e8e1129235f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:47:23 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-59bdccf0-8ceb-44cc-bdf3-1adc79d68a1c tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Lock "/opt/stack/data/nova/instances/a6ebcc53-802a-4515-ba41-3e8e1129235f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:47:23 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-59bdccf0-8ceb-44cc-bdf3-1adc79d68a1c tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Lock "/opt/stack/data/nova/instances/a6ebcc53-802a-4515-ba41-3e8e1129235f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:47:23 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-59bdccf0-8ceb-44cc-bdf3-1adc79d68a1c tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Acquiring lock "85a57ebfd6e0ad1c146d6c71208dc0756fe3c6ca" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:47:23 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-59bdccf0-8ceb-44cc-bdf3-1adc79d68a1c tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Lock "85a57ebfd6e0ad1c146d6c71208dc0756fe3c6ca" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:47:24 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-59bdccf0-8ceb-44cc-bdf3-1adc79d68a1c tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/85a57ebfd6e0ad1c146d6c71208dc0756fe3c6ca.part --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:47:24 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:47:24 user nova-compute[75176]: DEBUG nova.network.neutron [None req-59bdccf0-8ceb-44cc-bdf3-1adc79d68a1c tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] [instance: a6ebcc53-802a-4515-ba41-3e8e1129235f] Successfully created port: 1beb8fcc-a604-4b25-8e50-63325edade24 {{(pid=75176) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 15:47:24 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-59bdccf0-8ceb-44cc-bdf3-1adc79d68a1c tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/85a57ebfd6e0ad1c146d6c71208dc0756fe3c6ca.part --force-share --output=json" returned: 0 in 0.239s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:47:24 user nova-compute[75176]: DEBUG nova.virt.images [None req-59bdccf0-8ceb-44cc-bdf3-1adc79d68a1c tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] 717fdded-f041-4509-a46a-c43a9760030f was qcow2, converting to raw {{(pid=75176) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 28 15:47:24 user nova-compute[75176]: DEBUG nova.privsep.utils [None req-59bdccf0-8ceb-44cc-bdf3-1adc79d68a1c tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75176) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 28 15:47:24 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-59bdccf0-8ceb-44cc-bdf3-1adc79d68a1c tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/85a57ebfd6e0ad1c146d6c71208dc0756fe3c6ca.part /opt/stack/data/nova/instances/_base/85a57ebfd6e0ad1c146d6c71208dc0756fe3c6ca.converted {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:47:24 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-59bdccf0-8ceb-44cc-bdf3-1adc79d68a1c tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/85a57ebfd6e0ad1c146d6c71208dc0756fe3c6ca.part /opt/stack/data/nova/instances/_base/85a57ebfd6e0ad1c146d6c71208dc0756fe3c6ca.converted" returned: 0 in 0.327s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:47:24 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-59bdccf0-8ceb-44cc-bdf3-1adc79d68a1c tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/85a57ebfd6e0ad1c146d6c71208dc0756fe3c6ca.converted --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:47:25 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-59bdccf0-8ceb-44cc-bdf3-1adc79d68a1c tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/85a57ebfd6e0ad1c146d6c71208dc0756fe3c6ca.converted --force-share --output=json" returned: 0 in 0.196s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:47:25 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-59bdccf0-8ceb-44cc-bdf3-1adc79d68a1c tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Lock "85a57ebfd6e0ad1c146d6c71208dc0756fe3c6ca" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.660s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:47:25 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-59bdccf0-8ceb-44cc-bdf3-1adc79d68a1c tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/85a57ebfd6e0ad1c146d6c71208dc0756fe3c6ca --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:47:25 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:47:25 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-59bdccf0-8ceb-44cc-bdf3-1adc79d68a1c tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/85a57ebfd6e0ad1c146d6c71208dc0756fe3c6ca --force-share --output=json" returned: 0 in 0.194s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:47:25 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-59bdccf0-8ceb-44cc-bdf3-1adc79d68a1c tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Acquiring lock "85a57ebfd6e0ad1c146d6c71208dc0756fe3c6ca" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:47:25 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-59bdccf0-8ceb-44cc-bdf3-1adc79d68a1c tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Lock "85a57ebfd6e0ad1c146d6c71208dc0756fe3c6ca" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:47:25 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-59bdccf0-8ceb-44cc-bdf3-1adc79d68a1c tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/85a57ebfd6e0ad1c146d6c71208dc0756fe3c6ca --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:47:25 user nova-compute[75176]: DEBUG nova.network.neutron [None req-59bdccf0-8ceb-44cc-bdf3-1adc79d68a1c tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] [instance: a6ebcc53-802a-4515-ba41-3e8e1129235f] Successfully updated port: 1beb8fcc-a604-4b25-8e50-63325edade24 {{(pid=75176) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 15:47:25 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-59bdccf0-8ceb-44cc-bdf3-1adc79d68a1c tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Acquiring lock "refresh_cache-a6ebcc53-802a-4515-ba41-3e8e1129235f" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:47:25 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-59bdccf0-8ceb-44cc-bdf3-1adc79d68a1c tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Acquired lock "refresh_cache-a6ebcc53-802a-4515-ba41-3e8e1129235f" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:47:25 user nova-compute[75176]: DEBUG nova.network.neutron [None req-59bdccf0-8ceb-44cc-bdf3-1adc79d68a1c tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] [instance: a6ebcc53-802a-4515-ba41-3e8e1129235f] Building network info cache for instance {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 15:47:25 user nova-compute[75176]: DEBUG nova.compute.manager [req-f4199d70-9383-4f1d-aea2-c59ded5bec77 req-48447e62-02ee-4187-aa82-421ecde14c17 service nova] [instance: a6ebcc53-802a-4515-ba41-3e8e1129235f] Received event network-changed-1beb8fcc-a604-4b25-8e50-63325edade24 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:47:25 user nova-compute[75176]: DEBUG nova.compute.manager [req-f4199d70-9383-4f1d-aea2-c59ded5bec77 req-48447e62-02ee-4187-aa82-421ecde14c17 service nova] [instance: a6ebcc53-802a-4515-ba41-3e8e1129235f] Refreshing instance network info cache due to event network-changed-1beb8fcc-a604-4b25-8e50-63325edade24. {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 15:47:25 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-f4199d70-9383-4f1d-aea2-c59ded5bec77 req-48447e62-02ee-4187-aa82-421ecde14c17 service nova] Acquiring lock "refresh_cache-a6ebcc53-802a-4515-ba41-3e8e1129235f" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:47:25 user nova-compute[75176]: DEBUG nova.network.neutron [None req-59bdccf0-8ceb-44cc-bdf3-1adc79d68a1c tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] [instance: a6ebcc53-802a-4515-ba41-3e8e1129235f] Instance cache missing network info. {{(pid=75176) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 15:47:25 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-59bdccf0-8ceb-44cc-bdf3-1adc79d68a1c tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/85a57ebfd6e0ad1c146d6c71208dc0756fe3c6ca --force-share --output=json" returned: 0 in 0.190s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:47:25 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-59bdccf0-8ceb-44cc-bdf3-1adc79d68a1c tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/85a57ebfd6e0ad1c146d6c71208dc0756fe3c6ca,backing_fmt=raw /opt/stack/data/nova/instances/a6ebcc53-802a-4515-ba41-3e8e1129235f/disk 1073741824 {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:47:25 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-59bdccf0-8ceb-44cc-bdf3-1adc79d68a1c tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/85a57ebfd6e0ad1c146d6c71208dc0756fe3c6ca,backing_fmt=raw /opt/stack/data/nova/instances/a6ebcc53-802a-4515-ba41-3e8e1129235f/disk 1073741824" returned: 0 in 0.057s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:47:25 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-59bdccf0-8ceb-44cc-bdf3-1adc79d68a1c tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Lock "85a57ebfd6e0ad1c146d6c71208dc0756fe3c6ca" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.251s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:47:25 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-59bdccf0-8ceb-44cc-bdf3-1adc79d68a1c tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/85a57ebfd6e0ad1c146d6c71208dc0756fe3c6ca --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:47:25 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-59bdccf0-8ceb-44cc-bdf3-1adc79d68a1c tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/85a57ebfd6e0ad1c146d6c71208dc0756fe3c6ca --force-share --output=json" returned: 0 in 0.183s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:47:25 user nova-compute[75176]: DEBUG nova.virt.disk.api [None req-59bdccf0-8ceb-44cc-bdf3-1adc79d68a1c tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a6ebcc53-802a-4515-ba41-3e8e1129235f/disk. size=1073741824 {{(pid=75176) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 15:47:25 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-59bdccf0-8ceb-44cc-bdf3-1adc79d68a1c tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6ebcc53-802a-4515-ba41-3e8e1129235f/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:47:25 user nova-compute[75176]: DEBUG nova.network.neutron [None req-59bdccf0-8ceb-44cc-bdf3-1adc79d68a1c tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] [instance: a6ebcc53-802a-4515-ba41-3e8e1129235f] Updating instance_info_cache with network_info: [{"id": "1beb8fcc-a604-4b25-8e50-63325edade24", "address": "fa:16:3e:84:1e:fa", "network": {"id": "b06b85af-96d9-41cb-9ad2-7fc0523761e7", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-850315220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc1dfeef484e4627a0061d9d36fd2b40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1beb8fcc-a6", "ovs_interfaceid": "1beb8fcc-a604-4b25-8e50-63325edade24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:47:25 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-59bdccf0-8ceb-44cc-bdf3-1adc79d68a1c tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Releasing lock "refresh_cache-a6ebcc53-802a-4515-ba41-3e8e1129235f" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:47:25 user nova-compute[75176]: DEBUG nova.compute.manager [None req-59bdccf0-8ceb-44cc-bdf3-1adc79d68a1c tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] [instance: a6ebcc53-802a-4515-ba41-3e8e1129235f] Instance network_info: |[{"id": "1beb8fcc-a604-4b25-8e50-63325edade24", "address": "fa:16:3e:84:1e:fa", "network": {"id": "b06b85af-96d9-41cb-9ad2-7fc0523761e7", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-850315220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc1dfeef484e4627a0061d9d36fd2b40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1beb8fcc-a6", "ovs_interfaceid": "1beb8fcc-a604-4b25-8e50-63325edade24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75176) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 15:47:25 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-f4199d70-9383-4f1d-aea2-c59ded5bec77 req-48447e62-02ee-4187-aa82-421ecde14c17 service nova] Acquired lock "refresh_cache-a6ebcc53-802a-4515-ba41-3e8e1129235f" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:47:25 user nova-compute[75176]: DEBUG nova.network.neutron [req-f4199d70-9383-4f1d-aea2-c59ded5bec77 req-48447e62-02ee-4187-aa82-421ecde14c17 service nova] [instance: a6ebcc53-802a-4515-ba41-3e8e1129235f] Refreshing network info cache for port 1beb8fcc-a604-4b25-8e50-63325edade24 {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 15:47:25 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-59bdccf0-8ceb-44cc-bdf3-1adc79d68a1c tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6ebcc53-802a-4515-ba41-3e8e1129235f/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:47:25 user nova-compute[75176]: DEBUG nova.virt.disk.api [None req-59bdccf0-8ceb-44cc-bdf3-1adc79d68a1c tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Cannot resize image /opt/stack/data/nova/instances/a6ebcc53-802a-4515-ba41-3e8e1129235f/disk to a smaller size. {{(pid=75176) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 15:47:25 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-59bdccf0-8ceb-44cc-bdf3-1adc79d68a1c tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] [instance: a6ebcc53-802a-4515-ba41-3e8e1129235f] Created local disks {{(pid=75176) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 15:47:25 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-59bdccf0-8ceb-44cc-bdf3-1adc79d68a1c tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] [instance: a6ebcc53-802a-4515-ba41-3e8e1129235f] Ensure instance console log exists: /opt/stack/data/nova/instances/a6ebcc53-802a-4515-ba41-3e8e1129235f/console.log {{(pid=75176) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 15:47:25 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-59bdccf0-8ceb-44cc-bdf3-1adc79d68a1c tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:47:25 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-59bdccf0-8ceb-44cc-bdf3-1adc79d68a1c tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:47:25 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-59bdccf0-8ceb-44cc-bdf3-1adc79d68a1c tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:47:25 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-59bdccf0-8ceb-44cc-bdf3-1adc79d68a1c tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] [instance: a6ebcc53-802a-4515-ba41-3e8e1129235f] Start _get_guest_xml network_info=[{"id": "1beb8fcc-a604-4b25-8e50-63325edade24", "address": "fa:16:3e:84:1e:fa", "network": {"id": "b06b85af-96d9-41cb-9ad2-7fc0523761e7", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-850315220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc1dfeef484e4627a0061d9d36fd2b40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1beb8fcc-a6", "ovs_interfaceid": "1beb8fcc-a604-4b25-8e50-63325edade24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T15:47:20Z,direct_url=<?>,disk_format='qcow2',id=717fdded-f041-4509-a46a-c43a9760030f,min_disk=0,min_ram=0,name='tempest-scenario-img--594469334',owner='bc1dfeef484e4627a0061d9d36fd2b40',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T15:47:21Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'size': 0, 'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'image_id': '717fdded-f041-4509-a46a-c43a9760030f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75176) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 15:47:25 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-59bdccf0-8ceb-44cc-bdf3-1adc79d68a1c tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 15:47:25 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-59bdccf0-8ceb-44cc-bdf3-1adc79d68a1c tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 15:47:25 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-59bdccf0-8ceb-44cc-bdf3-1adc79d68a1c tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75176) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 15:47:25 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-59bdccf0-8ceb-44cc-bdf3-1adc79d68a1c tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] CPU controller missing on host. {{(pid=75176) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 15:47:25 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-59bdccf0-8ceb-44cc-bdf3-1adc79d68a1c tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75176) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 15:47:25 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-59bdccf0-8ceb-44cc-bdf3-1adc79d68a1c tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] CPU controller found on host. {{(pid=75176) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 15:47:25 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-59bdccf0-8ceb-44cc-bdf3-1adc79d68a1c tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75176) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 15:47:25 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-59bdccf0-8ceb-44cc-bdf3-1adc79d68a1c tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T15:35:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T15:47:20Z,direct_url=<?>,disk_format='qcow2',id=717fdded-f041-4509-a46a-c43a9760030f,min_disk=0,min_ram=0,name='tempest-scenario-img--594469334',owner='bc1dfeef484e4627a0061d9d36fd2b40',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T15:47:21Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 15:47:25 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-59bdccf0-8ceb-44cc-bdf3-1adc79d68a1c tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Flavor limits 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 15:47:25 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-59bdccf0-8ceb-44cc-bdf3-1adc79d68a1c tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Image limits 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 15:47:25 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-59bdccf0-8ceb-44cc-bdf3-1adc79d68a1c tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Flavor pref 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 15:47:25 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-59bdccf0-8ceb-44cc-bdf3-1adc79d68a1c tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Image pref 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 15:47:25 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-59bdccf0-8ceb-44cc-bdf3-1adc79d68a1c tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 15:47:25 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-59bdccf0-8ceb-44cc-bdf3-1adc79d68a1c tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 15:47:25 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-59bdccf0-8ceb-44cc-bdf3-1adc79d68a1c tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75176) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 15:47:25 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-59bdccf0-8ceb-44cc-bdf3-1adc79d68a1c tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Got 1 possible topologies {{(pid=75176) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 15:47:25 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-59bdccf0-8ceb-44cc-bdf3-1adc79d68a1c tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 15:47:25 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-59bdccf0-8ceb-44cc-bdf3-1adc79d68a1c tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 15:47:25 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-59bdccf0-8ceb-44cc-bdf3-1adc79d68a1c tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T15:47:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1971119919',display_name='tempest-TestMinimumBasicScenario-server-1971119919',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1971119919',id=25,image_ref='717fdded-f041-4509-a46a-c43a9760030f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPrHG5XKFRVI9bg17IWBz1s26wkAwdLQFgPmyk02mA0wQ4ISd3UFPcE0mNMthjYTq+NqvG2FgGKdnAgmzT19pfZn0CA/D+CpmY17NezaGKpfIuqLp9UpWLE39cYMVn+Vdw==',key_name='tempest-TestMinimumBasicScenario-118055100',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bc1dfeef484e4627a0061d9d36fd2b40',ramdisk_id='',reservation_id='r-sepa4lyv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='717fdded-f041-4509-a46a-c43a9760030f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-438096803',owner_user_name='tempest-TestMinimumBasicScenario-438096803-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T15:47:23Z,user_data=None,user_id='54766bbdce4346c0bd508451478b50aa',uuid=a6ebcc53-802a-4515-ba41-3e8e1129235f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1beb8fcc-a604-4b25-8e50-63325edade24", "address": "fa:16:3e:84:1e:fa", "network": {"id": "b06b85af-96d9-41cb-9ad2-7fc0523761e7", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-850315220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc1dfeef484e4627a0061d9d36fd2b40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1beb8fcc-a6", "ovs_interfaceid": "1beb8fcc-a604-4b25-8e50-63325edade24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75176) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 15:47:25 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-59bdccf0-8ceb-44cc-bdf3-1adc79d68a1c tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Converting VIF {"id": "1beb8fcc-a604-4b25-8e50-63325edade24", "address": "fa:16:3e:84:1e:fa", "network": {"id": "b06b85af-96d9-41cb-9ad2-7fc0523761e7", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-850315220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc1dfeef484e4627a0061d9d36fd2b40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1beb8fcc-a6", "ovs_interfaceid": "1beb8fcc-a604-4b25-8e50-63325edade24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:47:25 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-59bdccf0-8ceb-44cc-bdf3-1adc79d68a1c tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:1e:fa,bridge_name='br-int',has_traffic_filtering=True,id=1beb8fcc-a604-4b25-8e50-63325edade24,network=Network(b06b85af-96d9-41cb-9ad2-7fc0523761e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1beb8fcc-a6') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:47:25 user nova-compute[75176]: DEBUG nova.objects.instance [None req-59bdccf0-8ceb-44cc-bdf3-1adc79d68a1c tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Lazy-loading 'pci_devices' on Instance uuid a6ebcc53-802a-4515-ba41-3e8e1129235f {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:47:25 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-59bdccf0-8ceb-44cc-bdf3-1adc79d68a1c tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] [instance: a6ebcc53-802a-4515-ba41-3e8e1129235f] End _get_guest_xml xml=<domain type="kvm">
Nov 28 15:47:25 user nova-compute[75176]:   <uuid>a6ebcc53-802a-4515-ba41-3e8e1129235f</uuid>
Nov 28 15:47:25 user nova-compute[75176]:   <name>instance-00000019</name>
Nov 28 15:47:25 user nova-compute[75176]:   <memory>524288</memory>
Nov 28 15:47:25 user nova-compute[75176]:   <vcpu>1</vcpu>
Nov 28 15:47:25 user nova-compute[75176]:   <metadata>
Nov 28 15:47:25 user nova-compute[75176]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 15:47:25 user nova-compute[75176]:       <nova:package version="0.0.0"/>
Nov 28 15:47:25 user nova-compute[75176]:       <nova:name>tempest-TestMinimumBasicScenario-server-1971119919</nova:name>
Nov 28 15:47:25 user nova-compute[75176]:       <nova:creationTime>2023-11-28 15:47:25</nova:creationTime>
Nov 28 15:47:25 user nova-compute[75176]:       <nova:flavor name="m1.tiny">
Nov 28 15:47:25 user nova-compute[75176]:         <nova:memory>512</nova:memory>
Nov 28 15:47:25 user nova-compute[75176]:         <nova:disk>1</nova:disk>
Nov 28 15:47:25 user nova-compute[75176]:         <nova:swap>0</nova:swap>
Nov 28 15:47:25 user nova-compute[75176]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 15:47:25 user nova-compute[75176]:         <nova:vcpus>1</nova:vcpus>
Nov 28 15:47:25 user nova-compute[75176]:       </nova:flavor>
Nov 28 15:47:25 user nova-compute[75176]:       <nova:owner>
Nov 28 15:47:25 user nova-compute[75176]:         <nova:user uuid="54766bbdce4346c0bd508451478b50aa">tempest-TestMinimumBasicScenario-438096803-project-member</nova:user>
Nov 28 15:47:25 user nova-compute[75176]:         <nova:project uuid="bc1dfeef484e4627a0061d9d36fd2b40">tempest-TestMinimumBasicScenario-438096803</nova:project>
Nov 28 15:47:25 user nova-compute[75176]:       </nova:owner>
Nov 28 15:47:25 user nova-compute[75176]:       <nova:root type="image" uuid="717fdded-f041-4509-a46a-c43a9760030f"/>
Nov 28 15:47:25 user nova-compute[75176]:       <nova:ports>
Nov 28 15:47:25 user nova-compute[75176]:         <nova:port uuid="1beb8fcc-a604-4b25-8e50-63325edade24">
Nov 28 15:47:25 user nova-compute[75176]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 28 15:47:25 user nova-compute[75176]:         </nova:port>
Nov 28 15:47:25 user nova-compute[75176]:       </nova:ports>
Nov 28 15:47:25 user nova-compute[75176]:     </nova:instance>
Nov 28 15:47:25 user nova-compute[75176]:   </metadata>
Nov 28 15:47:25 user nova-compute[75176]:   <sysinfo type="smbios">
Nov 28 15:47:25 user nova-compute[75176]:     <system>
Nov 28 15:47:25 user nova-compute[75176]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 15:47:25 user nova-compute[75176]:       <entry name="product">OpenStack Nova</entry>
Nov 28 15:47:25 user nova-compute[75176]:       <entry name="version">0.0.0</entry>
Nov 28 15:47:25 user nova-compute[75176]:       <entry name="serial">a6ebcc53-802a-4515-ba41-3e8e1129235f</entry>
Nov 28 15:47:25 user nova-compute[75176]:       <entry name="uuid">a6ebcc53-802a-4515-ba41-3e8e1129235f</entry>
Nov 28 15:47:25 user nova-compute[75176]:       <entry name="family">Virtual Machine</entry>
Nov 28 15:47:25 user nova-compute[75176]:     </system>
Nov 28 15:47:25 user nova-compute[75176]:   </sysinfo>
Nov 28 15:47:25 user nova-compute[75176]:   <os>
Nov 28 15:47:25 user nova-compute[75176]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 15:47:25 user nova-compute[75176]:     <boot dev="hd"/>
Nov 28 15:47:25 user nova-compute[75176]:     <smbios mode="sysinfo"/>
Nov 28 15:47:25 user nova-compute[75176]:   </os>
Nov 28 15:47:25 user nova-compute[75176]:   <features>
Nov 28 15:47:25 user nova-compute[75176]:     <acpi/>
Nov 28 15:47:25 user nova-compute[75176]:     <apic/>
Nov 28 15:47:25 user nova-compute[75176]:     <vmcoreinfo/>
Nov 28 15:47:25 user nova-compute[75176]:   </features>
Nov 28 15:47:25 user nova-compute[75176]:   <clock offset="utc">
Nov 28 15:47:25 user nova-compute[75176]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 15:47:25 user nova-compute[75176]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 15:47:25 user nova-compute[75176]:     <timer name="hpet" present="no"/>
Nov 28 15:47:25 user nova-compute[75176]:   </clock>
Nov 28 15:47:25 user nova-compute[75176]:   <cpu mode="custom" match="exact">
Nov 28 15:47:25 user nova-compute[75176]:     <model>Nehalem</model>
Nov 28 15:47:25 user nova-compute[75176]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 15:47:25 user nova-compute[75176]:   </cpu>
Nov 28 15:47:25 user nova-compute[75176]:   <devices>
Nov 28 15:47:25 user nova-compute[75176]:     <disk type="file" device="disk">
Nov 28 15:47:25 user nova-compute[75176]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 15:47:25 user nova-compute[75176]:       <source file="/opt/stack/data/nova/instances/a6ebcc53-802a-4515-ba41-3e8e1129235f/disk"/>
Nov 28 15:47:25 user nova-compute[75176]:       <target dev="vda" bus="virtio"/>
Nov 28 15:47:25 user nova-compute[75176]:     </disk>
Nov 28 15:47:25 user nova-compute[75176]:     <interface type="ethernet">
Nov 28 15:47:25 user nova-compute[75176]:       <mac address="fa:16:3e:84:1e:fa"/>
Nov 28 15:47:25 user nova-compute[75176]:       <model type="virtio"/>
Nov 28 15:47:25 user nova-compute[75176]:       <mtu size="1442"/>
Nov 28 15:47:25 user nova-compute[75176]:       <target dev="tap1beb8fcc-a6"/>
Nov 28 15:47:25 user nova-compute[75176]:     </interface>
Nov 28 15:47:25 user nova-compute[75176]:     <serial type="pty">
Nov 28 15:47:25 user nova-compute[75176]:       <log file="/opt/stack/data/nova/instances/a6ebcc53-802a-4515-ba41-3e8e1129235f/console.log" append="off"/>
Nov 28 15:47:25 user nova-compute[75176]:     </serial>
Nov 28 15:47:25 user nova-compute[75176]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 15:47:25 user nova-compute[75176]:     <video>
Nov 28 15:47:25 user nova-compute[75176]:       <model type="virtio"/>
Nov 28 15:47:25 user nova-compute[75176]:     </video>
Nov 28 15:47:25 user nova-compute[75176]:     <rng model="virtio">
Nov 28 15:47:25 user nova-compute[75176]:       <backend model="random">/dev/urandom</backend>
Nov 28 15:47:25 user nova-compute[75176]:     </rng>
Nov 28 15:47:25 user nova-compute[75176]:     <controller type="usb" index="0" model="none"/>
Nov 28 15:47:25 user nova-compute[75176]:     <memballoon model="virtio">
Nov 28 15:47:25 user nova-compute[75176]:       <stats period="10"/>
Nov 28 15:47:25 user nova-compute[75176]:     </memballoon>
Nov 28 15:47:25 user nova-compute[75176]:   </devices>
Nov 28 15:47:25 user nova-compute[75176]: </domain>
Nov 28 15:47:25 user nova-compute[75176]:  {{(pid=75176) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 15:47:26 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-59bdccf0-8ceb-44cc-bdf3-1adc79d68a1c tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T15:47:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1971119919',display_name='tempest-TestMinimumBasicScenario-server-1971119919',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1971119919',id=25,image_ref='717fdded-f041-4509-a46a-c43a9760030f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPrHG5XKFRVI9bg17IWBz1s26wkAwdLQFgPmyk02mA0wQ4ISd3UFPcE0mNMthjYTq+NqvG2FgGKdnAgmzT19pfZn0CA/D+CpmY17NezaGKpfIuqLp9UpWLE39cYMVn+Vdw==',key_name='tempest-TestMinimumBasicScenario-118055100',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bc1dfeef484e4627a0061d9d36fd2b40',ramdisk_id='',reservation_id='r-sepa4lyv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='717fdded-f041-4509-a46a-c43a9760030f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-438096803',owner_user_name='tempest-TestMinimumBasicScenario-438096803-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T15:47:23Z,user_data=None,user_id='54766bbdce4346c0bd508451478b50aa',uuid=a6ebcc53-802a-4515-ba41-3e8e1129235f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1beb8fcc-a604-4b25-8e50-63325edade24", "address": "fa:16:3e:84:1e:fa", "network": {"id": "b06b85af-96d9-41cb-9ad2-7fc0523761e7", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-850315220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc1dfeef484e4627a0061d9d36fd2b40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1beb8fcc-a6", "ovs_interfaceid": "1beb8fcc-a604-4b25-8e50-63325edade24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 15:47:26 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-59bdccf0-8ceb-44cc-bdf3-1adc79d68a1c tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Converting VIF {"id": "1beb8fcc-a604-4b25-8e50-63325edade24", "address": "fa:16:3e:84:1e:fa", "network": {"id": "b06b85af-96d9-41cb-9ad2-7fc0523761e7", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-850315220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc1dfeef484e4627a0061d9d36fd2b40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1beb8fcc-a6", "ovs_interfaceid": "1beb8fcc-a604-4b25-8e50-63325edade24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:47:26 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-59bdccf0-8ceb-44cc-bdf3-1adc79d68a1c tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:1e:fa,bridge_name='br-int',has_traffic_filtering=True,id=1beb8fcc-a604-4b25-8e50-63325edade24,network=Network(b06b85af-96d9-41cb-9ad2-7fc0523761e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1beb8fcc-a6') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:47:26 user nova-compute[75176]: DEBUG os_vif [None req-59bdccf0-8ceb-44cc-bdf3-1adc79d68a1c tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:1e:fa,bridge_name='br-int',has_traffic_filtering=True,id=1beb8fcc-a604-4b25-8e50-63325edade24,network=Network(b06b85af-96d9-41cb-9ad2-7fc0523761e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1beb8fcc-a6') {{(pid=75176) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 15:47:26 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:47:26 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:47:26 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 15:47:26 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:47:26 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5b373917-4065-5a0a-945c-909ad56712f9', '_type': 'linux-noop'}}, row=False) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:47:26 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:47:26 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:47:26 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:47:26 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1beb8fcc-a6, may_exist=True, interface_attrs={}) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:47:26 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1beb8fcc-a6, col_values=(('qos', UUID('972e4d69-4a8d-461f-ba27-0546d8b3bf2f')),), if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:47:26 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1beb8fcc-a6, col_values=(('external_ids', {'iface-id': '1beb8fcc-a604-4b25-8e50-63325edade24', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:84:1e:fa', 'vm-uuid': 'a6ebcc53-802a-4515-ba41-3e8e1129235f'}),), if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:47:26 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:47:26 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:47:26 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:47:26 user nova-compute[75176]: INFO os_vif [None req-59bdccf0-8ceb-44cc-bdf3-1adc79d68a1c tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:1e:fa,bridge_name='br-int',has_traffic_filtering=True,id=1beb8fcc-a604-4b25-8e50-63325edade24,network=Network(b06b85af-96d9-41cb-9ad2-7fc0523761e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1beb8fcc-a6')
Nov 28 15:47:26 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-59bdccf0-8ceb-44cc-bdf3-1adc79d68a1c tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] No BDM found with device name vda, not building metadata. {{(pid=75176) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 15:47:26 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-59bdccf0-8ceb-44cc-bdf3-1adc79d68a1c tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] No VIF found with MAC fa:16:3e:84:1e:fa, not building metadata {{(pid=75176) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 15:47:26 user nova-compute[75176]: DEBUG nova.network.neutron [req-f4199d70-9383-4f1d-aea2-c59ded5bec77 req-48447e62-02ee-4187-aa82-421ecde14c17 service nova] [instance: a6ebcc53-802a-4515-ba41-3e8e1129235f] Updated VIF entry in instance network info cache for port 1beb8fcc-a604-4b25-8e50-63325edade24. {{(pid=75176) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 15:47:26 user nova-compute[75176]: DEBUG nova.network.neutron [req-f4199d70-9383-4f1d-aea2-c59ded5bec77 req-48447e62-02ee-4187-aa82-421ecde14c17 service nova] [instance: a6ebcc53-802a-4515-ba41-3e8e1129235f] Updating instance_info_cache with network_info: [{"id": "1beb8fcc-a604-4b25-8e50-63325edade24", "address": "fa:16:3e:84:1e:fa", "network": {"id": "b06b85af-96d9-41cb-9ad2-7fc0523761e7", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-850315220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc1dfeef484e4627a0061d9d36fd2b40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1beb8fcc-a6", "ovs_interfaceid": "1beb8fcc-a604-4b25-8e50-63325edade24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:47:26 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-f4199d70-9383-4f1d-aea2-c59ded5bec77 req-48447e62-02ee-4187-aa82-421ecde14c17 service nova] Releasing lock "refresh_cache-a6ebcc53-802a-4515-ba41-3e8e1129235f" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:47:27 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:47:27 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:47:27 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:47:27 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:47:27 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:47:27 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-694b3795-8d5f-4342-83e2-5fa795260088 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 402e779e-f507-49f1-a0d8-31ab0d23fbcd is timed out.
Nov 28 15:47:27 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-694b3795-8d5f-4342-83e2-5fa795260088 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Successfully detached device vdb from instance 402e779e-f507-49f1-a0d8-31ab0d23fbcd from the live domain config.
Nov 28 15:47:27 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-694b3795-8d5f-4342-83e2-5fa795260088 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] [instance: 402e779e-f507-49f1-a0d8-31ab0d23fbcd] calling os-brick to detach iSCSI Volume {{(pid=75176) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 15:47:27 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-694b3795-8d5f-4342-83e2-5fa795260088 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c1b8a00>, {'target_iqn': 'iqn.2010-10.org.openstack:a1f5de5d-be7a-443a-9831-791c8667c09b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GBiQZrUT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 15:47:27 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-694b3795-8d5f-4342-83e2-5fa795260088 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 15:47:27 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-694b3795-8d5f-4342-83e2-5fa795260088 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 15:47:27 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-694b3795-8d5f-4342-83e2-5fa795260088 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 15:47:27 user nova-compute[75176]: DEBUG nova.compute.manager [req-15dc0e68-6074-4347-90c5-061eed325aed req-2ba57efe-2f6a-49ae-bef2-331dcc4bbdaa service nova] [instance: a6ebcc53-802a-4515-ba41-3e8e1129235f] Received event network-vif-plugged-1beb8fcc-a604-4b25-8e50-63325edade24 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:47:27 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-15dc0e68-6074-4347-90c5-061eed325aed req-2ba57efe-2f6a-49ae-bef2-331dcc4bbdaa service nova] Acquiring lock "a6ebcc53-802a-4515-ba41-3e8e1129235f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:47:27 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-15dc0e68-6074-4347-90c5-061eed325aed req-2ba57efe-2f6a-49ae-bef2-331dcc4bbdaa service nova] Lock "a6ebcc53-802a-4515-ba41-3e8e1129235f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:47:27 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-15dc0e68-6074-4347-90c5-061eed325aed req-2ba57efe-2f6a-49ae-bef2-331dcc4bbdaa service nova] Lock "a6ebcc53-802a-4515-ba41-3e8e1129235f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:47:27 user nova-compute[75176]: DEBUG nova.compute.manager [req-15dc0e68-6074-4347-90c5-061eed325aed req-2ba57efe-2f6a-49ae-bef2-331dcc4bbdaa service nova] [instance: a6ebcc53-802a-4515-ba41-3e8e1129235f] No waiting events found dispatching network-vif-plugged-1beb8fcc-a604-4b25-8e50-63325edade24 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:47:27 user nova-compute[75176]: WARNING nova.compute.manager [req-15dc0e68-6074-4347-90c5-061eed325aed req-2ba57efe-2f6a-49ae-bef2-331dcc4bbdaa service nova] [instance: a6ebcc53-802a-4515-ba41-3e8e1129235f] Received unexpected event network-vif-plugged-1beb8fcc-a604-4b25-8e50-63325edade24 for instance with vm_state building and task_state spawning.
Nov 28 15:47:27 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:47:27 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:47:27 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[240083a0-5609-4e71-b3a8-507c4eedd7ec]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a1f5de5d-be7a-443a-9831-791c8667c09b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:705191a8-a203-4bbf-93d3-2a4e75a359b9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:47:27 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-694b3795-8d5f-4342-83e2-5fa795260088 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 15:47:27 user nova-compute[75176]: No targets found.
Nov 28 15:47:27 user nova-compute[75176]: iSNS:
Nov 28 15:47:27 user nova-compute[75176]: No targets found.
Nov 28 15:47:27 user nova-compute[75176]: STATIC:
Nov 28 15:47:27 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:a1f5de5d-be7a-443a-9831-791c8667c09b
Nov 28 15:47:27 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:47:27 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:47:27 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d
Nov 28 15:47:27 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:47:27 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:47:27 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24
Nov 28 15:47:27 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:47:27 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:47:27 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:705191a8-a203-4bbf-93d3-2a4e75a359b9
Nov 28 15:47:27 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:47:27 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:47:27 user nova-compute[75176]: FIRMWARE:
Nov 28 15:47:27 user nova-compute[75176]: No targets found.
Nov 28 15:47:27 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:47:27 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-694b3795-8d5f-4342-83e2-5fa795260088 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 15:47:27 user nova-compute[75176]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 15:47:27 user nova-compute[75176]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75176) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 15:47:27 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-694b3795-8d5f-4342-83e2-5fa795260088 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a1f5de5d-be7a-443a-9831-791c8667c09b', 0)] {{(pid=75176) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 15:47:27 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:47:27 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:47:27 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[296cdfaf-b128-450d-8f31-69a599b820df]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:705191a8-a203-4bbf-93d3-2a4e75a359b9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a1f5de5d-be7a-443a-9831-791c8667c09b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:47:27 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:47:27 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:47:27 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[12aa5aa4-788f-46bd-95d3-8a9f43ccdc6b]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1f5de5d-be7a-443a-9831-791c8667c09b (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:705191a8-a203-4bbf-93d3-2a4e75a359b9 (non-flash)\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:47:27 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-694b3795-8d5f-4342-83e2-5fa795260088 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1f5de5d-be7a-443a-9831-791c8667c09b (non-flash)
Nov 28 15:47:27 user nova-compute[75176]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24 (non-flash)
Nov 28 15:47:27 user nova-compute[75176]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d (non-flash)
Nov 28 15:47:27 user nova-compute[75176]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:705191a8-a203-4bbf-93d3-2a4e75a359b9 (non-flash)
Nov 28 15:47:27 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:47:27 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-694b3795-8d5f-4342-83e2-5fa795260088 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1f5de5d-be7a-443a-9831-791c8667c09b (non-flash)
Nov 28 15:47:27 user nova-compute[75176]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24 (non-flash)
Nov 28 15:47:27 user nova-compute[75176]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d (non-flash)
Nov 28 15:47:27 user nova-compute[75176]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:705191a8-a203-4bbf-93d3-2a4e75a359b9 (non-flash)
Nov 28 15:47:27 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 15:47:27 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-694b3795-8d5f-4342-83e2-5fa795260088 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f464c1ff1c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a1f5de5d-be7a-443a-9831-791c8667c09b'): ({'sdd'}, set())}) {{(pid=75176) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 15:47:27 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-694b3795-8d5f-4342-83e2-5fa795260088 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Removing single pathed devices sdd {{(pid=75176) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 15:47:27 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:47:27 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:47:27 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[0826b9cb-91e8-4360-aee6-e9384bcdf131]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:47:27 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:47:28 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.025s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:47:28 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[bee39a93-f99a-4084-9e8c-0eb1fdecfe93]: (4, ('ok\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:47:28 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-694b3795-8d5f-4342-83e2-5fa795260088 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Flushing IO for device /dev/sdd {{(pid=75176) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 15:47:28 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:47:28 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.017s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:47:28 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[283e06b8-9b3a-4aca-9346-8727918287e6]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:47:28 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-694b3795-8d5f-4342-83e2-5fa795260088 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75176) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 15:47:28 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:47:28 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.057s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:47:28 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9e151f2-50d3-48af-b424-81d9a2810ba8]: (4, ('1', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:47:28 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-694b3795-8d5f-4342-83e2-5fa795260088 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75176) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 15:47:28 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-694b3795-8d5f-4342-83e2-5fa795260088 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] SCSI volumes sdd have been removed. {{(pid=75176) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 15:47:28 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-694b3795-8d5f-4342-83e2-5fa795260088 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a1f5de5d-be7a-443a-9831-791c8667c09b')] {{(pid=75176) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 15:47:28 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1f5de5d-be7a-443a-9831-791c8667c09b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:47:28 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1f5de5d-be7a-443a-9831-791c8667c09b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:47:28 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[36d67f07-dab4-47e5-9f41-26495ced739e]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:47:28 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-694b3795-8d5f-4342-83e2-5fa795260088 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:47:28 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1f5de5d-be7a-443a-9831-791c8667c09b -p 172.16.0.220:3260 --logout {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:47:28 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:47:28 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:47:28 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:47:28 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:47:28 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1f5de5d-be7a-443a-9831-791c8667c09b -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:47:28 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[83752183-ce67-458a-b916-76954668d44f]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:a1f5de5d-be7a-443a-9831-791c8667c09b, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:a1f5de5d-be7a-443a-9831-791c8667c09b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:47:28 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-694b3795-8d5f-4342-83e2-5fa795260088 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:a1f5de5d-be7a-443a-9831-791c8667c09b, portal: 172.16.0.220,3260]
Nov 28 15:47:28 user nova-compute[75176]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:a1f5de5d-be7a-443a-9831-791c8667c09b, portal: 172.16.0.220,3260] successful.
Nov 28 15:47:28 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:47:28 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1f5de5d-be7a-443a-9831-791c8667c09b -p 172.16.0.220:3260 --op delete {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:47:28 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1f5de5d-be7a-443a-9831-791c8667c09b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:47:28 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[d901e2d2-6fc3-4d8f-9ce5-da08802ab7df]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:47:28 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-694b3795-8d5f-4342-83e2-5fa795260088 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:47:28 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-694b3795-8d5f-4342-83e2-5fa795260088 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.356s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 15:47:28 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-694b3795-8d5f-4342-83e2-5fa795260088 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] <== disconnect_volume: return (357ms) None {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 15:47:28 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-694b3795-8d5f-4342-83e2-5fa795260088 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] [instance: 402e779e-f507-49f1-a0d8-31ab0d23fbcd] Disconnected iSCSI Volume {{(pid=75176) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 15:47:28 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:47:29 user nova-compute[75176]: DEBUG nova.objects.instance [None req-694b3795-8d5f-4342-83e2-5fa795260088 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Lazy-loading 'flavor' on Instance uuid 402e779e-f507-49f1-a0d8-31ab0d23fbcd {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:47:29 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-694b3795-8d5f-4342-83e2-5fa795260088 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Lock "402e779e-f507-49f1-a0d8-31ab0d23fbcd" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.215s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:47:29 user nova-compute[75176]: DEBUG nova.compute.manager [None req-59bdccf0-8ceb-44cc-bdf3-1adc79d68a1c tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] [instance: a6ebcc53-802a-4515-ba41-3e8e1129235f] Instance event wait completed in 0 seconds for  {{(pid=75176) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 15:47:29 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-59bdccf0-8ceb-44cc-bdf3-1adc79d68a1c tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] [instance: a6ebcc53-802a-4515-ba41-3e8e1129235f] Guest created on hypervisor {{(pid=75176) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 15:47:29 user nova-compute[75176]: INFO nova.virt.libvirt.driver [-] [instance: a6ebcc53-802a-4515-ba41-3e8e1129235f] Instance spawned successfully.
Nov 28 15:47:29 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-59bdccf0-8ceb-44cc-bdf3-1adc79d68a1c tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] [instance: a6ebcc53-802a-4515-ba41-3e8e1129235f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 15:47:29 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-59bdccf0-8ceb-44cc-bdf3-1adc79d68a1c tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] [instance: a6ebcc53-802a-4515-ba41-3e8e1129235f] Found default for hw_cdrom_bus of ide {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:47:29 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-59bdccf0-8ceb-44cc-bdf3-1adc79d68a1c tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] [instance: a6ebcc53-802a-4515-ba41-3e8e1129235f] Found default for hw_disk_bus of virtio {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:47:29 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-59bdccf0-8ceb-44cc-bdf3-1adc79d68a1c tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] [instance: a6ebcc53-802a-4515-ba41-3e8e1129235f] Found default for hw_input_bus of None {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:47:29 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-59bdccf0-8ceb-44cc-bdf3-1adc79d68a1c tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] [instance: a6ebcc53-802a-4515-ba41-3e8e1129235f] Found default for hw_pointer_model of None {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:47:29 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-59bdccf0-8ceb-44cc-bdf3-1adc79d68a1c tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] [instance: a6ebcc53-802a-4515-ba41-3e8e1129235f] Found default for hw_video_model of virtio {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:47:29 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-59bdccf0-8ceb-44cc-bdf3-1adc79d68a1c tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] [instance: a6ebcc53-802a-4515-ba41-3e8e1129235f] Found default for hw_vif_model of virtio {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:47:29 user nova-compute[75176]: DEBUG nova.compute.manager [req-d78bca60-65c8-4315-9d43-24937b1cd5c4 req-44a765d5-e517-4f44-8fb3-e8a820b6de5b service nova] [instance: a6ebcc53-802a-4515-ba41-3e8e1129235f] Received event network-vif-plugged-1beb8fcc-a604-4b25-8e50-63325edade24 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:47:29 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-d78bca60-65c8-4315-9d43-24937b1cd5c4 req-44a765d5-e517-4f44-8fb3-e8a820b6de5b service nova] Acquiring lock "a6ebcc53-802a-4515-ba41-3e8e1129235f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:47:29 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-d78bca60-65c8-4315-9d43-24937b1cd5c4 req-44a765d5-e517-4f44-8fb3-e8a820b6de5b service nova] Lock "a6ebcc53-802a-4515-ba41-3e8e1129235f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:47:29 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-d78bca60-65c8-4315-9d43-24937b1cd5c4 req-44a765d5-e517-4f44-8fb3-e8a820b6de5b service nova] Lock "a6ebcc53-802a-4515-ba41-3e8e1129235f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:47:29 user nova-compute[75176]: DEBUG nova.compute.manager [req-d78bca60-65c8-4315-9d43-24937b1cd5c4 req-44a765d5-e517-4f44-8fb3-e8a820b6de5b service nova] [instance: a6ebcc53-802a-4515-ba41-3e8e1129235f] No waiting events found dispatching network-vif-plugged-1beb8fcc-a604-4b25-8e50-63325edade24 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:47:29 user nova-compute[75176]: WARNING nova.compute.manager [req-d78bca60-65c8-4315-9d43-24937b1cd5c4 req-44a765d5-e517-4f44-8fb3-e8a820b6de5b service nova] [instance: a6ebcc53-802a-4515-ba41-3e8e1129235f] Received unexpected event network-vif-plugged-1beb8fcc-a604-4b25-8e50-63325edade24 for instance with vm_state building and task_state spawning.
Nov 28 15:47:29 user nova-compute[75176]: INFO nova.compute.manager [None req-59bdccf0-8ceb-44cc-bdf3-1adc79d68a1c tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] [instance: a6ebcc53-802a-4515-ba41-3e8e1129235f] Took 6.56 seconds to spawn the instance on the hypervisor.
Nov 28 15:47:29 user nova-compute[75176]: DEBUG nova.compute.manager [None req-59bdccf0-8ceb-44cc-bdf3-1adc79d68a1c tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] [instance: a6ebcc53-802a-4515-ba41-3e8e1129235f] Checking state {{(pid=75176) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 15:47:30 user nova-compute[75176]: INFO nova.compute.manager [None req-59bdccf0-8ceb-44cc-bdf3-1adc79d68a1c tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] [instance: a6ebcc53-802a-4515-ba41-3e8e1129235f] Took 7.43 seconds to build instance.
Nov 28 15:47:30 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-59bdccf0-8ceb-44cc-bdf3-1adc79d68a1c tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Lock "a6ebcc53-802a-4515-ba41-3e8e1129235f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.570s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:47:31 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:47:31 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:47:33 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:47:36 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:47:36 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-bb6a2c80-e3e4-4b9c-b027-8ce9af8b5b1e tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 7b4c281e-5b8d-43b1-8914-572e1341c0a7 is timed out.
Nov 28 15:47:36 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-bb6a2c80-e3e4-4b9c-b027-8ce9af8b5b1e tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Successfully detached device vdb from instance 7b4c281e-5b8d-43b1-8914-572e1341c0a7 from the live domain config.
Nov 28 15:47:36 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb6a2c80-e3e4-4b9c-b027-8ce9af8b5b1e tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] [instance: 7b4c281e-5b8d-43b1-8914-572e1341c0a7] calling os-brick to detach iSCSI Volume {{(pid=75176) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 15:47:36 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb6a2c80-e3e4-4b9c-b027-8ce9af8b5b1e tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c1b8a00>, {'target_iqn': 'iqn.2010-10.org.openstack:705191a8-a203-4bbf-93d3-2a4e75a359b9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KwdWHJLy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 15:47:36 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-bb6a2c80-e3e4-4b9c-b027-8ce9af8b5b1e tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 15:47:36 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-bb6a2c80-e3e4-4b9c-b027-8ce9af8b5b1e tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 15:47:36 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-bb6a2c80-e3e4-4b9c-b027-8ce9af8b5b1e tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 15:47:36 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:47:36 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:47:36 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d045c53-d01b-46cc-8ed0-265e9f68471f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:705191a8-a203-4bbf-93d3-2a4e75a359b9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:47:36 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb6a2c80-e3e4-4b9c-b027-8ce9af8b5b1e tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 15:47:36 user nova-compute[75176]: No targets found.
Nov 28 15:47:36 user nova-compute[75176]: iSNS:
Nov 28 15:47:36 user nova-compute[75176]: No targets found.
Nov 28 15:47:36 user nova-compute[75176]: STATIC:
Nov 28 15:47:36 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d
Nov 28 15:47:36 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:47:36 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:47:36 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24
Nov 28 15:47:36 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:47:36 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:47:36 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:705191a8-a203-4bbf-93d3-2a4e75a359b9
Nov 28 15:47:36 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:47:36 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:47:36 user nova-compute[75176]: FIRMWARE:
Nov 28 15:47:36 user nova-compute[75176]: No targets found.
Nov 28 15:47:36 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:47:36 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb6a2c80-e3e4-4b9c-b027-8ce9af8b5b1e tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 15:47:36 user nova-compute[75176]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 15:47:36 user nova-compute[75176]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75176) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 15:47:36 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb6a2c80-e3e4-4b9c-b027-8ce9af8b5b1e tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:705191a8-a203-4bbf-93d3-2a4e75a359b9', 0)] {{(pid=75176) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 15:47:36 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:47:36 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:47:36 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[23287d1d-6ce2-4e15-a5c1-dacbaa476104]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:705191a8-a203-4bbf-93d3-2a4e75a359b9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:47:36 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:47:36 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:47:36 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[e349ff89-2669-4ad0-8957-ac02585aa7ff]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:705191a8-a203-4bbf-93d3-2a4e75a359b9 (non-flash)\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:47:36 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb6a2c80-e3e4-4b9c-b027-8ce9af8b5b1e tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24 (non-flash)
Nov 28 15:47:36 user nova-compute[75176]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d (non-flash)
Nov 28 15:47:36 user nova-compute[75176]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:705191a8-a203-4bbf-93d3-2a4e75a359b9 (non-flash)
Nov 28 15:47:36 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:47:36 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb6a2c80-e3e4-4b9c-b027-8ce9af8b5b1e tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24 (non-flash)
Nov 28 15:47:36 user nova-compute[75176]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d (non-flash)
Nov 28 15:47:36 user nova-compute[75176]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:705191a8-a203-4bbf-93d3-2a4e75a359b9 (non-flash)
Nov 28 15:47:36 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 15:47:36 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb6a2c80-e3e4-4b9c-b027-8ce9af8b5b1e tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4644363910>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:705191a8-a203-4bbf-93d3-2a4e75a359b9'): ({'sdc'}, set())}) {{(pid=75176) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 15:47:36 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-bb6a2c80-e3e4-4b9c-b027-8ce9af8b5b1e tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Removing single pathed devices sdc {{(pid=75176) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 15:47:36 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:47:36 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.068s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:47:36 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[521b1651-31f6-478f-8f9e-404bb112e584]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:47:36 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:47:36 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.025s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:47:36 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef2f6b6c-6165-4433-971d-d23b3a405177]: (4, ('ok\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:47:36 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-bb6a2c80-e3e4-4b9c-b027-8ce9af8b5b1e tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Flushing IO for device /dev/sdc {{(pid=75176) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 15:47:36 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:47:36 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:47:36 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a8339a0-73ba-45b6-ad3c-d77e1432cf68]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:47:36 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-bb6a2c80-e3e4-4b9c-b027-8ce9af8b5b1e tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75176) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 15:47:36 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:47:36 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.043s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:47:36 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[eec53c26-d4d7-44da-a3e4-d6fca16cafaf]: (4, ('1', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:47:36 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-bb6a2c80-e3e4-4b9c-b027-8ce9af8b5b1e tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75176) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 15:47:36 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-bb6a2c80-e3e4-4b9c-b027-8ce9af8b5b1e tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] SCSI volumes sdc have been removed. {{(pid=75176) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 15:47:36 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb6a2c80-e3e4-4b9c-b027-8ce9af8b5b1e tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:705191a8-a203-4bbf-93d3-2a4e75a359b9')] {{(pid=75176) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 15:47:36 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:705191a8-a203-4bbf-93d3-2a4e75a359b9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:47:36 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:705191a8-a203-4bbf-93d3-2a4e75a359b9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:47:36 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[97903b2f-6b61-4059-b6ca-3ed94413b05c]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:47:36 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb6a2c80-e3e4-4b9c-b027-8ce9af8b5b1e tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:47:36 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:705191a8-a203-4bbf-93d3-2a4e75a359b9 -p 172.16.0.220:3260 --logout {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:47:36 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:705191a8-a203-4bbf-93d3-2a4e75a359b9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:47:36 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa2c5faa-4906-44dc-886f-6767ba3524e6]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:705191a8-a203-4bbf-93d3-2a4e75a359b9, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:705191a8-a203-4bbf-93d3-2a4e75a359b9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:47:36 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb6a2c80-e3e4-4b9c-b027-8ce9af8b5b1e tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:705191a8-a203-4bbf-93d3-2a4e75a359b9, portal: 172.16.0.220,3260]
Nov 28 15:47:36 user nova-compute[75176]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:705191a8-a203-4bbf-93d3-2a4e75a359b9, portal: 172.16.0.220,3260] successful.
Nov 28 15:47:36 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:47:36 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:705191a8-a203-4bbf-93d3-2a4e75a359b9 -p 172.16.0.220:3260 --op delete {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:47:36 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:705191a8-a203-4bbf-93d3-2a4e75a359b9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:47:36 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[8adf8112-45c0-4305-a43c-b804efe87503]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:47:36 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb6a2c80-e3e4-4b9c-b027-8ce9af8b5b1e tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:47:36 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-bb6a2c80-e3e4-4b9c-b027-8ce9af8b5b1e tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.440s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 15:47:36 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb6a2c80-e3e4-4b9c-b027-8ce9af8b5b1e tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] <== disconnect_volume: return (442ms) None {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 15:47:36 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb6a2c80-e3e4-4b9c-b027-8ce9af8b5b1e tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] [instance: 7b4c281e-5b8d-43b1-8914-572e1341c0a7] Disconnected iSCSI Volume {{(pid=75176) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 15:47:37 user nova-compute[75176]: DEBUG nova.objects.instance [None req-bb6a2c80-e3e4-4b9c-b027-8ce9af8b5b1e tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Lazy-loading 'flavor' on Instance uuid 7b4c281e-5b8d-43b1-8914-572e1341c0a7 {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:47:37 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-bb6a2c80-e3e4-4b9c-b027-8ce9af8b5b1e tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Lock "7b4c281e-5b8d-43b1-8914-572e1341c0a7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.969s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:47:37 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-c49c85d0-a6ba-422a-9c08-b6031579ddc8 tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Lock "7b4c281e-5b8d-43b1-8914-572e1341c0a7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.773s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:47:37 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-c49c85d0-a6ba-422a-9c08-b6031579ddc8 tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Acquiring lock "7b4c281e-5b8d-43b1-8914-572e1341c0a7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:47:37 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-c49c85d0-a6ba-422a-9c08-b6031579ddc8 tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Lock "7b4c281e-5b8d-43b1-8914-572e1341c0a7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:47:37 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-c49c85d0-a6ba-422a-9c08-b6031579ddc8 tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Lock "7b4c281e-5b8d-43b1-8914-572e1341c0a7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:47:37 user nova-compute[75176]: INFO nova.compute.manager [None req-c49c85d0-a6ba-422a-9c08-b6031579ddc8 tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] [instance: 7b4c281e-5b8d-43b1-8914-572e1341c0a7] Terminating instance
Nov 28 15:47:37 user nova-compute[75176]: DEBUG nova.compute.manager [None req-c49c85d0-a6ba-422a-9c08-b6031579ddc8 tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] [instance: 7b4c281e-5b8d-43b1-8914-572e1341c0a7] Start destroying the instance on the hypervisor. {{(pid=75176) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 15:47:37 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:47:37 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:47:37 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:47:37 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:47:37 user nova-compute[75176]: DEBUG nova.compute.manager [req-6f451f55-ece2-4ca0-a28a-a3752d93a5f8 req-4b498a52-b2f9-45e0-bd3d-0e6fbbc2fe57 service nova] [instance: 7b4c281e-5b8d-43b1-8914-572e1341c0a7] Received event network-vif-unplugged-cfbc5129-eb64-42bb-bec3-cd56a2ec733c {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:47:37 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-6f451f55-ece2-4ca0-a28a-a3752d93a5f8 req-4b498a52-b2f9-45e0-bd3d-0e6fbbc2fe57 service nova] Acquiring lock "7b4c281e-5b8d-43b1-8914-572e1341c0a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:47:37 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-6f451f55-ece2-4ca0-a28a-a3752d93a5f8 req-4b498a52-b2f9-45e0-bd3d-0e6fbbc2fe57 service nova] Lock "7b4c281e-5b8d-43b1-8914-572e1341c0a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:47:37 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-6f451f55-ece2-4ca0-a28a-a3752d93a5f8 req-4b498a52-b2f9-45e0-bd3d-0e6fbbc2fe57 service nova] Lock "7b4c281e-5b8d-43b1-8914-572e1341c0a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:47:37 user nova-compute[75176]: DEBUG nova.compute.manager [req-6f451f55-ece2-4ca0-a28a-a3752d93a5f8 req-4b498a52-b2f9-45e0-bd3d-0e6fbbc2fe57 service nova] [instance: 7b4c281e-5b8d-43b1-8914-572e1341c0a7] No waiting events found dispatching network-vif-unplugged-cfbc5129-eb64-42bb-bec3-cd56a2ec733c {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:47:37 user nova-compute[75176]: DEBUG nova.compute.manager [req-6f451f55-ece2-4ca0-a28a-a3752d93a5f8 req-4b498a52-b2f9-45e0-bd3d-0e6fbbc2fe57 service nova] [instance: 7b4c281e-5b8d-43b1-8914-572e1341c0a7] Received event network-vif-unplugged-cfbc5129-eb64-42bb-bec3-cd56a2ec733c for instance with task_state deleting. {{(pid=75176) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 15:47:38 user nova-compute[75176]: INFO nova.virt.libvirt.driver [-] [instance: 7b4c281e-5b8d-43b1-8914-572e1341c0a7] Instance destroyed successfully.
Nov 28 15:47:38 user nova-compute[75176]: DEBUG nova.objects.instance [None req-c49c85d0-a6ba-422a-9c08-b6031579ddc8 tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Lazy-loading 'resources' on Instance uuid 7b4c281e-5b8d-43b1-8914-572e1341c0a7 {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:47:38 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-c49c85d0-a6ba-422a-9c08-b6031579ddc8 tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T15:44:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-119652217',display_name='tempest-VolumesSnapshotTestJSON-instance-119652217',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-119652217',id=20,image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIX98hMVZy4VbyZtEbNYxY5GDZTytWVzAkwts44r99B8WhDU8T4DSEtoo4wnYPgRCrr1ry6NjRSu3tBFP9rpvjFXWaCyWrLMKGh5YZtz9BnbG83OWHcKYL6NLwjmY/UUeg==',key_name='tempest-keypair-63260765',keypairs=<?>,launch_index=0,launched_at=2023-11-28T15:44:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3669019a110245d19a8ac85b5b20d2bd',ramdisk_id='',reservation_id='r-mcmae38u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-2135242619',owner_user_name='tempest-VolumesSnapshotTestJSON-2135242619-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T15:44:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d8d2394765354c83942d4eafbb437794',uuid=7b4c281e-5b8d-43b1-8914-572e1341c0a7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cfbc5129-eb64-42bb-bec3-cd56a2ec733c", "address": "fa:16:3e:07:68:e7", "network": {"id": "0478f649-0c69-414b-84c3-3ef4604d6062", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-695624980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3669019a110245d19a8ac85b5b20d2bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfbc5129-eb", "ovs_interfaceid": "cfbc5129-eb64-42bb-bec3-cd56a2ec733c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 15:47:38 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-c49c85d0-a6ba-422a-9c08-b6031579ddc8 tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Converting VIF {"id": "cfbc5129-eb64-42bb-bec3-cd56a2ec733c", "address": "fa:16:3e:07:68:e7", "network": {"id": "0478f649-0c69-414b-84c3-3ef4604d6062", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-695624980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3669019a110245d19a8ac85b5b20d2bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfbc5129-eb", "ovs_interfaceid": "cfbc5129-eb64-42bb-bec3-cd56a2ec733c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:47:38 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-c49c85d0-a6ba-422a-9c08-b6031579ddc8 tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:07:68:e7,bridge_name='br-int',has_traffic_filtering=True,id=cfbc5129-eb64-42bb-bec3-cd56a2ec733c,network=Network(0478f649-0c69-414b-84c3-3ef4604d6062),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfbc5129-eb') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:47:38 user nova-compute[75176]: DEBUG os_vif [None req-c49c85d0-a6ba-422a-9c08-b6031579ddc8 tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:07:68:e7,bridge_name='br-int',has_traffic_filtering=True,id=cfbc5129-eb64-42bb-bec3-cd56a2ec733c,network=Network(0478f649-0c69-414b-84c3-3ef4604d6062),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfbc5129-eb') {{(pid=75176) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 15:47:38 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:47:38 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcfbc5129-eb, bridge=br-int, if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:47:38 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:47:38 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:47:38 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:47:38 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=21016b7b-6fd6-4810-b71b-21e8f15406c9) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:47:38 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:47:38 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:47:38 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:47:38 user nova-compute[75176]: INFO os_vif [None req-c49c85d0-a6ba-422a-9c08-b6031579ddc8 tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:07:68:e7,bridge_name='br-int',has_traffic_filtering=True,id=cfbc5129-eb64-42bb-bec3-cd56a2ec733c,network=Network(0478f649-0c69-414b-84c3-3ef4604d6062),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfbc5129-eb')
Nov 28 15:47:38 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c49c85d0-a6ba-422a-9c08-b6031579ddc8 tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] [instance: 7b4c281e-5b8d-43b1-8914-572e1341c0a7] calling os-brick to detach iSCSI Volume {{(pid=75176) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 15:47:38 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-c49c85d0-a6ba-422a-9c08-b6031579ddc8 tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c1b8a00>, {'target_iqn': 'iqn.2010-10.org.openstack:705191a8-a203-4bbf-93d3-2a4e75a359b9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KwdWHJLy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 15:47:38 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-c49c85d0-a6ba-422a-9c08-b6031579ddc8 tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 15:47:38 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-c49c85d0-a6ba-422a-9c08-b6031579ddc8 tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 15:47:38 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-c49c85d0-a6ba-422a-9c08-b6031579ddc8 tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 15:47:38 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:47:38 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:47:38 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e8d3eb4-a6a0-446f-b201-7b0f69a5573d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:47:38 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-c49c85d0-a6ba-422a-9c08-b6031579ddc8 tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 15:47:38 user nova-compute[75176]: No targets found.
Nov 28 15:47:38 user nova-compute[75176]: iSNS:
Nov 28 15:47:38 user nova-compute[75176]: No targets found.
Nov 28 15:47:38 user nova-compute[75176]: STATIC:
Nov 28 15:47:38 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d
Nov 28 15:47:38 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:47:38 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:47:38 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24
Nov 28 15:47:38 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:47:38 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:47:38 user nova-compute[75176]: FIRMWARE:
Nov 28 15:47:38 user nova-compute[75176]: No targets found.
Nov 28 15:47:38 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:47:38 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-c49c85d0-a6ba-422a-9c08-b6031579ddc8 tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 15:47:38 user nova-compute[75176]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 15:47:38 user nova-compute[75176]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75176) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 15:47:38 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-c49c85d0-a6ba-422a-9c08-b6031579ddc8 tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:705191a8-a203-4bbf-93d3-2a4e75a359b9', 0)] {{(pid=75176) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 15:47:38 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:47:38 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:47:38 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2895a23-5662-4312-9849-5a0bb43c98d9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:47:38 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:47:38 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:47:38 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ae485f0-73e9-413e-a510-5b1039095f35]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d (non-flash)\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:47:38 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-c49c85d0-a6ba-422a-9c08-b6031579ddc8 tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24 (non-flash)
Nov 28 15:47:38 user nova-compute[75176]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d (non-flash)
Nov 28 15:47:38 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:47:38 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-c49c85d0-a6ba-422a-9c08-b6031579ddc8 tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24 (non-flash)
Nov 28 15:47:38 user nova-compute[75176]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d (non-flash)
Nov 28 15:47:38 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 15:47:38 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-c49c85d0-a6ba-422a-9c08-b6031579ddc8 tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f462c68bac0>, {}) {{(pid=75176) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 15:47:38 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-c49c85d0-a6ba-422a-9c08-b6031579ddc8 tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Disconnecting from: [] {{(pid=75176) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 15:47:38 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-c49c85d0-a6ba-422a-9c08-b6031579ddc8 tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.073s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 15:47:38 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-c49c85d0-a6ba-422a-9c08-b6031579ddc8 tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] <== disconnect_volume: return (74ms) None {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 15:47:38 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c49c85d0-a6ba-422a-9c08-b6031579ddc8 tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] [instance: 7b4c281e-5b8d-43b1-8914-572e1341c0a7] Disconnected iSCSI Volume {{(pid=75176) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 15:47:38 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-c49c85d0-a6ba-422a-9c08-b6031579ddc8 tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] [instance: 7b4c281e-5b8d-43b1-8914-572e1341c0a7] Deleting instance files /opt/stack/data/nova/instances/7b4c281e-5b8d-43b1-8914-572e1341c0a7_del
Nov 28 15:47:38 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-c49c85d0-a6ba-422a-9c08-b6031579ddc8 tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] [instance: 7b4c281e-5b8d-43b1-8914-572e1341c0a7] Deletion of /opt/stack/data/nova/instances/7b4c281e-5b8d-43b1-8914-572e1341c0a7_del complete
Nov 28 15:47:38 user nova-compute[75176]: INFO nova.compute.manager [None req-c49c85d0-a6ba-422a-9c08-b6031579ddc8 tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] [instance: 7b4c281e-5b8d-43b1-8914-572e1341c0a7] Took 1.00 seconds to destroy the instance on the hypervisor.
Nov 28 15:47:38 user nova-compute[75176]: DEBUG oslo.service.loopingcall [None req-c49c85d0-a6ba-422a-9c08-b6031579ddc8 tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75176) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 15:47:38 user nova-compute[75176]: DEBUG nova.compute.manager [-] [instance: 7b4c281e-5b8d-43b1-8914-572e1341c0a7] Deallocating network for instance {{(pid=75176) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 15:47:38 user nova-compute[75176]: DEBUG nova.network.neutron [-] [instance: 7b4c281e-5b8d-43b1-8914-572e1341c0a7] deallocate_for_instance() {{(pid=75176) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 15:47:38 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:47:39 user nova-compute[75176]: DEBUG nova.network.neutron [-] [instance: 7b4c281e-5b8d-43b1-8914-572e1341c0a7] Updating instance_info_cache with network_info: [] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:47:39 user nova-compute[75176]: INFO nova.compute.manager [-] [instance: 7b4c281e-5b8d-43b1-8914-572e1341c0a7] Took 0.82 seconds to deallocate network for instance.
Nov 28 15:47:39 user nova-compute[75176]: WARNING nova.volume.cinder [None req-c49c85d0-a6ba-422a-9c08-b6031579ddc8 tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Attachment 9cf1f202-a38a-40d6-903d-6d874052a017 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 9cf1f202-a38a-40d6-903d-6d874052a017. (HTTP 404) (Request-ID: req-2435f173-59a9-401e-bafb-90583947a7e8)
Nov 28 15:47:39 user nova-compute[75176]: INFO nova.compute.manager [None req-c49c85d0-a6ba-422a-9c08-b6031579ddc8 tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] [instance: 7b4c281e-5b8d-43b1-8914-572e1341c0a7] Took 0.03 seconds to detach 1 volumes for instance.
Nov 28 15:47:39 user nova-compute[75176]: DEBUG nova.compute.manager [req-1af92896-700b-4098-ac12-98edef428b56 req-42b64d11-5ec0-42a5-899a-9ea1a2358fc4 service nova] [instance: 7b4c281e-5b8d-43b1-8914-572e1341c0a7] Received event network-vif-deleted-cfbc5129-eb64-42bb-bec3-cd56a2ec733c {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:47:39 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-c49c85d0-a6ba-422a-9c08-b6031579ddc8 tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:47:39 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-c49c85d0-a6ba-422a-9c08-b6031579ddc8 tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:47:39 user nova-compute[75176]: DEBUG nova.compute.provider_tree [None req-c49c85d0-a6ba-422a-9c08-b6031579ddc8 tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Inventory has not changed in ProviderTree for provider: b37848d8-f401-4155-a029-b0ffa09ff85b {{(pid=75176) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 15:47:39 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-c49c85d0-a6ba-422a-9c08-b6031579ddc8 tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Inventory has not changed for provider b37848d8-f401-4155-a029-b0ffa09ff85b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75176) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 15:47:39 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-c49c85d0-a6ba-422a-9c08-b6031579ddc8 tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.409s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:47:39 user nova-compute[75176]: DEBUG nova.compute.manager [req-9db04b80-dc34-4001-a515-40d1c6ea7e99 req-ee579994-9778-492c-aee2-ef1a1bccbac8 service nova] [instance: 7b4c281e-5b8d-43b1-8914-572e1341c0a7] Received event network-vif-plugged-cfbc5129-eb64-42bb-bec3-cd56a2ec733c {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:47:39 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-9db04b80-dc34-4001-a515-40d1c6ea7e99 req-ee579994-9778-492c-aee2-ef1a1bccbac8 service nova] Acquiring lock "7b4c281e-5b8d-43b1-8914-572e1341c0a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:47:39 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-9db04b80-dc34-4001-a515-40d1c6ea7e99 req-ee579994-9778-492c-aee2-ef1a1bccbac8 service nova] Lock "7b4c281e-5b8d-43b1-8914-572e1341c0a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:47:39 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-9db04b80-dc34-4001-a515-40d1c6ea7e99 req-ee579994-9778-492c-aee2-ef1a1bccbac8 service nova] Lock "7b4c281e-5b8d-43b1-8914-572e1341c0a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:47:39 user nova-compute[75176]: DEBUG nova.compute.manager [req-9db04b80-dc34-4001-a515-40d1c6ea7e99 req-ee579994-9778-492c-aee2-ef1a1bccbac8 service nova] [instance: 7b4c281e-5b8d-43b1-8914-572e1341c0a7] No waiting events found dispatching network-vif-plugged-cfbc5129-eb64-42bb-bec3-cd56a2ec733c {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:47:39 user nova-compute[75176]: WARNING nova.compute.manager [req-9db04b80-dc34-4001-a515-40d1c6ea7e99 req-ee579994-9778-492c-aee2-ef1a1bccbac8 service nova] [instance: 7b4c281e-5b8d-43b1-8914-572e1341c0a7] Received unexpected event network-vif-plugged-cfbc5129-eb64-42bb-bec3-cd56a2ec733c for instance with vm_state deleted and task_state None.
Nov 28 15:47:39 user nova-compute[75176]: INFO nova.scheduler.client.report [None req-c49c85d0-a6ba-422a-9c08-b6031579ddc8 tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Deleted allocations for instance 7b4c281e-5b8d-43b1-8914-572e1341c0a7
Nov 28 15:47:39 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-c49c85d0-a6ba-422a-9c08-b6031579ddc8 tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Lock "7b4c281e-5b8d-43b1-8914-572e1341c0a7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.562s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:47:41 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:47:42 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-98690172-7988-4504-83be-053e48f04c58 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] Acquiring lock "6b3646e6-512e-4cd6-b3c1-89438c19c408" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:47:42 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-98690172-7988-4504-83be-053e48f04c58 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] Lock "6b3646e6-512e-4cd6-b3c1-89438c19c408" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:47:42 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-98690172-7988-4504-83be-053e48f04c58 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] Acquiring lock "6b3646e6-512e-4cd6-b3c1-89438c19c408-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:47:42 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-98690172-7988-4504-83be-053e48f04c58 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] Lock "6b3646e6-512e-4cd6-b3c1-89438c19c408-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:47:42 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-98690172-7988-4504-83be-053e48f04c58 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] Lock "6b3646e6-512e-4cd6-b3c1-89438c19c408-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:47:42 user nova-compute[75176]: INFO nova.compute.manager [None req-98690172-7988-4504-83be-053e48f04c58 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] [instance: 6b3646e6-512e-4cd6-b3c1-89438c19c408] Terminating instance
Nov 28 15:47:42 user nova-compute[75176]: DEBUG nova.compute.manager [None req-98690172-7988-4504-83be-053e48f04c58 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] [instance: 6b3646e6-512e-4cd6-b3c1-89438c19c408] Start destroying the instance on the hypervisor. {{(pid=75176) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 15:47:42 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:47:42 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:47:42 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:47:42 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:47:43 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:47:43 user nova-compute[75176]: INFO nova.virt.libvirt.driver [-] [instance: 6b3646e6-512e-4cd6-b3c1-89438c19c408] Instance destroyed successfully.
Nov 28 15:47:43 user nova-compute[75176]: DEBUG nova.objects.instance [None req-98690172-7988-4504-83be-053e48f04c58 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] Lazy-loading 'resources' on Instance uuid 6b3646e6-512e-4cd6-b3c1-89438c19c408 {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:47:43 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-98690172-7988-4504-83be-053e48f04c58 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T15:44:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-235438377',display_name='tempest-TestVolumeSwap-server-235438377',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-235438377',id=17,image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCEyJwysEBmzzRqrkvN3FKEcGpwd2ScC2KHWvj0QVsDhczFGBxwnOmUEkqlApiI7qJA2dW6Tg2BRrvRY0JE92XifTxXISgYzRogkfF1oOwDbxLUo24NIkmszfWAI8+cW0g==',key_name='tempest-keypair-738518461',keypairs=<?>,launch_index=0,launched_at=2023-11-28T15:44:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='39f22e22fdcb403d82a186a635d6b44a',ramdisk_id='',reservation_id='r-a91e9r6e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-1198917749',owner_user_name='tempest-TestVolumeSwap-1198917749-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T15:44:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='28d7f43fc5d74a188de770183e44834e',uuid=6b3646e6-512e-4cd6-b3c1-89438c19c408,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "76888781-ca16-4c3d-99b3-37a902459609", "address": "fa:16:3e:42:3e:fc", "network": {"id": "a275bae2-c1ee-445a-adc0-411f99e837e7", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1828472132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39f22e22fdcb403d82a186a635d6b44a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76888781-ca", "ovs_interfaceid": "76888781-ca16-4c3d-99b3-37a902459609", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 15:47:43 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-98690172-7988-4504-83be-053e48f04c58 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] Converting VIF {"id": "76888781-ca16-4c3d-99b3-37a902459609", "address": "fa:16:3e:42:3e:fc", "network": {"id": "a275bae2-c1ee-445a-adc0-411f99e837e7", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1828472132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39f22e22fdcb403d82a186a635d6b44a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76888781-ca", "ovs_interfaceid": "76888781-ca16-4c3d-99b3-37a902459609", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:47:43 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-98690172-7988-4504-83be-053e48f04c58 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:42:3e:fc,bridge_name='br-int',has_traffic_filtering=True,id=76888781-ca16-4c3d-99b3-37a902459609,network=Network(a275bae2-c1ee-445a-adc0-411f99e837e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76888781-ca') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:47:43 user nova-compute[75176]: DEBUG os_vif [None req-98690172-7988-4504-83be-053e48f04c58 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:42:3e:fc,bridge_name='br-int',has_traffic_filtering=True,id=76888781-ca16-4c3d-99b3-37a902459609,network=Network(a275bae2-c1ee-445a-adc0-411f99e837e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76888781-ca') {{(pid=75176) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 15:47:43 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:47:43 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap76888781-ca, bridge=br-int, if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:47:43 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:47:43 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:47:43 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:47:43 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8c906adc-78e4-4a86-ba2f-05ba1619db34) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:47:43 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:47:43 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:47:43 user nova-compute[75176]: INFO os_vif [None req-98690172-7988-4504-83be-053e48f04c58 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:42:3e:fc,bridge_name='br-int',has_traffic_filtering=True,id=76888781-ca16-4c3d-99b3-37a902459609,network=Network(a275bae2-c1ee-445a-adc0-411f99e837e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76888781-ca')
Nov 28 15:47:43 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-98690172-7988-4504-83be-053e48f04c58 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] [instance: 6b3646e6-512e-4cd6-b3c1-89438c19c408] Deleting instance files /opt/stack/data/nova/instances/6b3646e6-512e-4cd6-b3c1-89438c19c408_del
Nov 28 15:47:43 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-98690172-7988-4504-83be-053e48f04c58 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] [instance: 6b3646e6-512e-4cd6-b3c1-89438c19c408] Deletion of /opt/stack/data/nova/instances/6b3646e6-512e-4cd6-b3c1-89438c19c408_del complete
Nov 28 15:47:43 user nova-compute[75176]: INFO nova.compute.manager [None req-98690172-7988-4504-83be-053e48f04c58 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] [instance: 6b3646e6-512e-4cd6-b3c1-89438c19c408] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 28 15:47:43 user nova-compute[75176]: DEBUG oslo.service.loopingcall [None req-98690172-7988-4504-83be-053e48f04c58 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75176) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 15:47:43 user nova-compute[75176]: DEBUG nova.compute.manager [-] [instance: 6b3646e6-512e-4cd6-b3c1-89438c19c408] Deallocating network for instance {{(pid=75176) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 15:47:43 user nova-compute[75176]: DEBUG nova.network.neutron [-] [instance: 6b3646e6-512e-4cd6-b3c1-89438c19c408] deallocate_for_instance() {{(pid=75176) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 15:47:43 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:47:43 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:47:44 user nova-compute[75176]: DEBUG nova.compute.manager [req-1bbdaae9-5c3b-41e3-bfea-201fb6265999 req-76836288-2766-44f3-b178-b0bb682acfcb service nova] [instance: 6b3646e6-512e-4cd6-b3c1-89438c19c408] Received event network-vif-unplugged-76888781-ca16-4c3d-99b3-37a902459609 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:47:44 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-1bbdaae9-5c3b-41e3-bfea-201fb6265999 req-76836288-2766-44f3-b178-b0bb682acfcb service nova] Acquiring lock "6b3646e6-512e-4cd6-b3c1-89438c19c408-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:47:44 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-1bbdaae9-5c3b-41e3-bfea-201fb6265999 req-76836288-2766-44f3-b178-b0bb682acfcb service nova] Lock "6b3646e6-512e-4cd6-b3c1-89438c19c408-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:47:44 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-1bbdaae9-5c3b-41e3-bfea-201fb6265999 req-76836288-2766-44f3-b178-b0bb682acfcb service nova] Lock "6b3646e6-512e-4cd6-b3c1-89438c19c408-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:47:44 user nova-compute[75176]: DEBUG nova.compute.manager [req-1bbdaae9-5c3b-41e3-bfea-201fb6265999 req-76836288-2766-44f3-b178-b0bb682acfcb service nova] [instance: 6b3646e6-512e-4cd6-b3c1-89438c19c408] No waiting events found dispatching network-vif-unplugged-76888781-ca16-4c3d-99b3-37a902459609 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:47:44 user nova-compute[75176]: DEBUG nova.compute.manager [req-1bbdaae9-5c3b-41e3-bfea-201fb6265999 req-76836288-2766-44f3-b178-b0bb682acfcb service nova] [instance: 6b3646e6-512e-4cd6-b3c1-89438c19c408] Received event network-vif-unplugged-76888781-ca16-4c3d-99b3-37a902459609 for instance with task_state deleting. {{(pid=75176) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 15:47:44 user nova-compute[75176]: DEBUG nova.network.neutron [-] [instance: 6b3646e6-512e-4cd6-b3c1-89438c19c408] Updating instance_info_cache with network_info: [] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:47:44 user nova-compute[75176]: INFO nova.compute.manager [-] [instance: 6b3646e6-512e-4cd6-b3c1-89438c19c408] Took 0.92 seconds to deallocate network for instance.
Nov 28 15:47:44 user nova-compute[75176]: DEBUG nova.compute.manager [req-167ffe42-0465-4e97-881a-6fdd4d705482 req-71ffe3c3-8c96-4525-97dc-b5a791e98346 service nova] [instance: 6b3646e6-512e-4cd6-b3c1-89438c19c408] Received event network-vif-deleted-76888781-ca16-4c3d-99b3-37a902459609 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:47:44 user nova-compute[75176]: INFO nova.compute.manager [req-167ffe42-0465-4e97-881a-6fdd4d705482 req-71ffe3c3-8c96-4525-97dc-b5a791e98346 service nova] [instance: 6b3646e6-512e-4cd6-b3c1-89438c19c408] Neutron deleted interface 76888781-ca16-4c3d-99b3-37a902459609; detaching it from the instance and deleting it from the info cache
Nov 28 15:47:44 user nova-compute[75176]: DEBUG nova.network.neutron [req-167ffe42-0465-4e97-881a-6fdd4d705482 req-71ffe3c3-8c96-4525-97dc-b5a791e98346 service nova] [instance: 6b3646e6-512e-4cd6-b3c1-89438c19c408] Updating instance_info_cache with network_info: [] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:47:44 user nova-compute[75176]: DEBUG nova.compute.manager [req-167ffe42-0465-4e97-881a-6fdd4d705482 req-71ffe3c3-8c96-4525-97dc-b5a791e98346 service nova] [instance: 6b3646e6-512e-4cd6-b3c1-89438c19c408] Detach interface failed, port_id=76888781-ca16-4c3d-99b3-37a902459609, reason: Instance 6b3646e6-512e-4cd6-b3c1-89438c19c408 could not be found. {{(pid=75176) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 28 15:47:44 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-98690172-7988-4504-83be-053e48f04c58 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:47:44 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-98690172-7988-4504-83be-053e48f04c58 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:47:44 user nova-compute[75176]: DEBUG nova.compute.provider_tree [None req-98690172-7988-4504-83be-053e48f04c58 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] Inventory has not changed in ProviderTree for provider: b37848d8-f401-4155-a029-b0ffa09ff85b {{(pid=75176) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 15:47:44 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-98690172-7988-4504-83be-053e48f04c58 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] Inventory has not changed for provider b37848d8-f401-4155-a029-b0ffa09ff85b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75176) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 15:47:44 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-98690172-7988-4504-83be-053e48f04c58 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.336s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:47:44 user nova-compute[75176]: INFO nova.scheduler.client.report [None req-98690172-7988-4504-83be-053e48f04c58 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] Deleted allocations for instance 6b3646e6-512e-4cd6-b3c1-89438c19c408
Nov 28 15:47:44 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-98690172-7988-4504-83be-053e48f04c58 tempest-TestVolumeSwap-1198917749 tempest-TestVolumeSwap-1198917749-project-member] Lock "6b3646e6-512e-4cd6-b3c1-89438c19c408" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.354s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:47:45 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-46d4ebf8-121b-4c3a-bd76-a6a43b8c8d5f tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Acquiring lock "aa223c49-d254-4727-8a01-873026847b37" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:47:45 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-46d4ebf8-121b-4c3a-bd76-a6a43b8c8d5f tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Lock "aa223c49-d254-4727-8a01-873026847b37" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:47:45 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-46d4ebf8-121b-4c3a-bd76-a6a43b8c8d5f tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Acquiring lock "aa223c49-d254-4727-8a01-873026847b37-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:47:45 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-46d4ebf8-121b-4c3a-bd76-a6a43b8c8d5f tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Lock "aa223c49-d254-4727-8a01-873026847b37-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:47:45 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-46d4ebf8-121b-4c3a-bd76-a6a43b8c8d5f tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Lock "aa223c49-d254-4727-8a01-873026847b37-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:47:45 user nova-compute[75176]: INFO nova.compute.manager [None req-46d4ebf8-121b-4c3a-bd76-a6a43b8c8d5f tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] [instance: aa223c49-d254-4727-8a01-873026847b37] Terminating instance
Nov 28 15:47:45 user nova-compute[75176]: DEBUG nova.compute.manager [None req-46d4ebf8-121b-4c3a-bd76-a6a43b8c8d5f tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] [instance: aa223c49-d254-4727-8a01-873026847b37] Start destroying the instance on the hypervisor. {{(pid=75176) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 15:47:46 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:47:46 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:47:46 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:47:46 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:47:46 user nova-compute[75176]: DEBUG nova.compute.manager [req-5cc8a4c2-8d79-49cd-bcd1-ac6fbfe5bfda req-35ea4d89-e9a6-4c54-8c67-e4ed22ecf7df service nova] [instance: 6b3646e6-512e-4cd6-b3c1-89438c19c408] Received event network-vif-plugged-76888781-ca16-4c3d-99b3-37a902459609 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:47:46 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-5cc8a4c2-8d79-49cd-bcd1-ac6fbfe5bfda req-35ea4d89-e9a6-4c54-8c67-e4ed22ecf7df service nova] Acquiring lock "6b3646e6-512e-4cd6-b3c1-89438c19c408-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:47:46 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-5cc8a4c2-8d79-49cd-bcd1-ac6fbfe5bfda req-35ea4d89-e9a6-4c54-8c67-e4ed22ecf7df service nova] Lock "6b3646e6-512e-4cd6-b3c1-89438c19c408-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:47:46 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-5cc8a4c2-8d79-49cd-bcd1-ac6fbfe5bfda req-35ea4d89-e9a6-4c54-8c67-e4ed22ecf7df service nova] Lock "6b3646e6-512e-4cd6-b3c1-89438c19c408-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:47:46 user nova-compute[75176]: DEBUG nova.compute.manager [req-5cc8a4c2-8d79-49cd-bcd1-ac6fbfe5bfda req-35ea4d89-e9a6-4c54-8c67-e4ed22ecf7df service nova] [instance: 6b3646e6-512e-4cd6-b3c1-89438c19c408] No waiting events found dispatching network-vif-plugged-76888781-ca16-4c3d-99b3-37a902459609 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:47:46 user nova-compute[75176]: WARNING nova.compute.manager [req-5cc8a4c2-8d79-49cd-bcd1-ac6fbfe5bfda req-35ea4d89-e9a6-4c54-8c67-e4ed22ecf7df service nova] [instance: 6b3646e6-512e-4cd6-b3c1-89438c19c408] Received unexpected event network-vif-plugged-76888781-ca16-4c3d-99b3-37a902459609 for instance with vm_state deleted and task_state None.
Nov 28 15:47:46 user nova-compute[75176]: DEBUG nova.compute.manager [req-5b284291-f5b9-4588-a0db-06c43336019e req-40c8994b-5a45-4752-86f2-f2157a718c39 service nova] [instance: aa223c49-d254-4727-8a01-873026847b37] Received event network-vif-unplugged-6514aeb6-8ea4-4a27-a54b-32f650c87957 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:47:46 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-5b284291-f5b9-4588-a0db-06c43336019e req-40c8994b-5a45-4752-86f2-f2157a718c39 service nova] Acquiring lock "aa223c49-d254-4727-8a01-873026847b37-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:47:46 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-5b284291-f5b9-4588-a0db-06c43336019e req-40c8994b-5a45-4752-86f2-f2157a718c39 service nova] Lock "aa223c49-d254-4727-8a01-873026847b37-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:47:46 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-5b284291-f5b9-4588-a0db-06c43336019e req-40c8994b-5a45-4752-86f2-f2157a718c39 service nova] Lock "aa223c49-d254-4727-8a01-873026847b37-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:47:46 user nova-compute[75176]: DEBUG nova.compute.manager [req-5b284291-f5b9-4588-a0db-06c43336019e req-40c8994b-5a45-4752-86f2-f2157a718c39 service nova] [instance: aa223c49-d254-4727-8a01-873026847b37] No waiting events found dispatching network-vif-unplugged-6514aeb6-8ea4-4a27-a54b-32f650c87957 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:47:46 user nova-compute[75176]: DEBUG nova.compute.manager [req-5b284291-f5b9-4588-a0db-06c43336019e req-40c8994b-5a45-4752-86f2-f2157a718c39 service nova] [instance: aa223c49-d254-4727-8a01-873026847b37] Received event network-vif-unplugged-6514aeb6-8ea4-4a27-a54b-32f650c87957 for instance with task_state deleting. {{(pid=75176) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 15:47:46 user nova-compute[75176]: INFO nova.virt.libvirt.driver [-] [instance: aa223c49-d254-4727-8a01-873026847b37] Instance destroyed successfully.
Nov 28 15:47:46 user nova-compute[75176]: DEBUG nova.objects.instance [None req-46d4ebf8-121b-4c3a-bd76-a6a43b8c8d5f tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Lazy-loading 'resources' on Instance uuid aa223c49-d254-4727-8a01-873026847b37 {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:47:46 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-46d4ebf8-121b-4c3a-bd76-a6a43b8c8d5f tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T15:39:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-595327070',display_name='tempest-ServerActionsTestOtherB-server-595327070',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-595327070',id=3,image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG46aaldZ31/SMomPHuTDQH3UTedHGSV4iG8fWtpOqqr4Cywzy71R0Ov1C6XRnOo4sYKyOfCcRfklnh+MSVYzyKoTfjcvtFT0nSQtOBIOaQ8vVTuyCcNwyJ0nmpmqFlJng==',key_name='tempest-keypair-1738862822',keypairs=<?>,launch_index=0,launched_at=2023-11-28T15:45:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4c2fe6bf5e4f4bb3b5d50901bfac0b38',ramdisk_id='',reservation_id='r-k1by7x80',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-935995346',owner_user_name='tempest-ServerActionsTestOtherB-935995346-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T15:45:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='16ea4be4bcb34749b2f444c4694543b1',uuid=aa223c49-d254-4727-8a01-873026847b37,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6514aeb6-8ea4-4a27-a54b-32f650c87957", "address": "fa:16:3e:ea:a6:1b", "network": {"id": "51708ad4-dae1-47fc-bd26-aca8c478ca04", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-279988751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c2fe6bf5e4f4bb3b5d50901bfac0b38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6514aeb6-8e", "ovs_interfaceid": "6514aeb6-8ea4-4a27-a54b-32f650c87957", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 15:47:46 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-46d4ebf8-121b-4c3a-bd76-a6a43b8c8d5f tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Converting VIF {"id": "6514aeb6-8ea4-4a27-a54b-32f650c87957", "address": "fa:16:3e:ea:a6:1b", "network": {"id": "51708ad4-dae1-47fc-bd26-aca8c478ca04", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-279988751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c2fe6bf5e4f4bb3b5d50901bfac0b38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6514aeb6-8e", "ovs_interfaceid": "6514aeb6-8ea4-4a27-a54b-32f650c87957", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:47:46 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-46d4ebf8-121b-4c3a-bd76-a6a43b8c8d5f tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ea:a6:1b,bridge_name='br-int',has_traffic_filtering=True,id=6514aeb6-8ea4-4a27-a54b-32f650c87957,network=Network(51708ad4-dae1-47fc-bd26-aca8c478ca04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6514aeb6-8e') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:47:46 user nova-compute[75176]: DEBUG os_vif [None req-46d4ebf8-121b-4c3a-bd76-a6a43b8c8d5f tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ea:a6:1b,bridge_name='br-int',has_traffic_filtering=True,id=6514aeb6-8ea4-4a27-a54b-32f650c87957,network=Network(51708ad4-dae1-47fc-bd26-aca8c478ca04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6514aeb6-8e') {{(pid=75176) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 15:47:46 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:47:46 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6514aeb6-8e, bridge=br-int, if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:47:46 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:47:46 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:47:46 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:47:46 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=980b0bd5-1abf-4445-900a-eb54186686de) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:47:46 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:47:46 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:47:46 user nova-compute[75176]: INFO os_vif [None req-46d4ebf8-121b-4c3a-bd76-a6a43b8c8d5f tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ea:a6:1b,bridge_name='br-int',has_traffic_filtering=True,id=6514aeb6-8ea4-4a27-a54b-32f650c87957,network=Network(51708ad4-dae1-47fc-bd26-aca8c478ca04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6514aeb6-8e')
Nov 28 15:47:46 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-46d4ebf8-121b-4c3a-bd76-a6a43b8c8d5f tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] [instance: aa223c49-d254-4727-8a01-873026847b37] calling os-brick to detach iSCSI Volume {{(pid=75176) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 15:47:46 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-46d4ebf8-121b-4c3a-bd76-a6a43b8c8d5f tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c1b8a00>, {'target_iqn': 'iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AVKGrjOB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 15:47:46 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-46d4ebf8-121b-4c3a-bd76-a6a43b8c8d5f tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 15:47:46 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-46d4ebf8-121b-4c3a-bd76-a6a43b8c8d5f tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 15:47:46 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-46d4ebf8-121b-4c3a-bd76-a6a43b8c8d5f tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 15:47:46 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:47:46 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:47:46 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0edf3d8-80f4-46ba-a704-8c4f0d4311a5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:47:46 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-46d4ebf8-121b-4c3a-bd76-a6a43b8c8d5f tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 15:47:46 user nova-compute[75176]: No targets found.
Nov 28 15:47:46 user nova-compute[75176]: iSNS:
Nov 28 15:47:46 user nova-compute[75176]: No targets found.
Nov 28 15:47:46 user nova-compute[75176]: STATIC:
Nov 28 15:47:46 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d
Nov 28 15:47:46 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:47:46 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:47:46 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24
Nov 28 15:47:46 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:47:46 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:47:46 user nova-compute[75176]: FIRMWARE:
Nov 28 15:47:46 user nova-compute[75176]: No targets found.
Nov 28 15:47:46 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:47:46 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-46d4ebf8-121b-4c3a-bd76-a6a43b8c8d5f tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 15:47:46 user nova-compute[75176]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 15:47:46 user nova-compute[75176]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75176) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 15:47:46 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-46d4ebf8-121b-4c3a-bd76-a6a43b8c8d5f tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d', 0)] {{(pid=75176) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 15:47:46 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:47:46 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:47:46 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[f683f414-0e04-4280-bcff-4017db3d59bb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:47:46 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:47:46 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:47:46 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[853a962a-f799-4650-995a-8496f6a52769]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d (non-flash)\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:47:46 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-46d4ebf8-121b-4c3a-bd76-a6a43b8c8d5f tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24 (non-flash)
Nov 28 15:47:46 user nova-compute[75176]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d (non-flash)
Nov 28 15:47:46 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:47:46 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-46d4ebf8-121b-4c3a-bd76-a6a43b8c8d5f tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24 (non-flash)
Nov 28 15:47:46 user nova-compute[75176]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d (non-flash)
Nov 28 15:47:46 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 15:47:46 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-46d4ebf8-121b-4c3a-bd76-a6a43b8c8d5f tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f462c6f1090>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d'): ({'sdf'}, set())}) {{(pid=75176) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 15:47:46 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-46d4ebf8-121b-4c3a-bd76-a6a43b8c8d5f tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Removing single pathed devices sdf {{(pid=75176) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 15:47:46 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:47:46 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:47:46 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[877aff67-0e11-4f4b-87aa-8a5a02f3e5a8]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:47:46 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:47:46 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:47:46 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7721ff4-bbe0-49ee-b1d4-5a82a6f1870c]: (4, ('ok\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:47:46 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-46d4ebf8-121b-4c3a-bd76-a6a43b8c8d5f tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Flushing IO for device /dev/sdf {{(pid=75176) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 15:47:46 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:47:46 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.012s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:47:46 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[421ae50f-f480-4382-b5a3-71202e592596]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:47:46 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-46d4ebf8-121b-4c3a-bd76-a6a43b8c8d5f tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75176) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 15:47:46 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:47:46 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.041s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:47:46 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e528326-1a7e-41bc-82b8-4834aedd19c6]: (4, ('1', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:47:46 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-46d4ebf8-121b-4c3a-bd76-a6a43b8c8d5f tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75176) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 15:47:46 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-46d4ebf8-121b-4c3a-bd76-a6a43b8c8d5f tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] SCSI volumes sdf have been removed. {{(pid=75176) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 15:47:46 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-46d4ebf8-121b-4c3a-bd76-a6a43b8c8d5f tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d')] {{(pid=75176) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 15:47:46 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:47:46 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:47:46 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[50f5a18c-be7a-4fa5-b03c-44853268f811]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:47:47 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-46d4ebf8-121b-4c3a-bd76-a6a43b8c8d5f tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:47:47 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d -p 172.16.0.220:3260 --logout {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:47:47 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:47:47 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b832814-36ed-4b8c-bda4-ba9d4b38ae31]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:47:47 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-46d4ebf8-121b-4c3a-bd76-a6a43b8c8d5f tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d, portal: 172.16.0.220,3260]
Nov 28 15:47:47 user nova-compute[75176]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d, portal: 172.16.0.220,3260] successful.
Nov 28 15:47:47 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:47:47 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d -p 172.16.0.220:3260 --op delete {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:47:47 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f61f7c78-66f5-45c5-85ac-2b97ed31a24d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:47:47 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[7af41d57-5b14-495f-b739-0431172922d1]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:47:47 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-46d4ebf8-121b-4c3a-bd76-a6a43b8c8d5f tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:47:47 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-46d4ebf8-121b-4c3a-bd76-a6a43b8c8d5f tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.293s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 15:47:47 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-46d4ebf8-121b-4c3a-bd76-a6a43b8c8d5f tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] <== disconnect_volume: return (293ms) None {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 15:47:47 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-46d4ebf8-121b-4c3a-bd76-a6a43b8c8d5f tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] [instance: aa223c49-d254-4727-8a01-873026847b37] Disconnected iSCSI Volume {{(pid=75176) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 15:47:47 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-46d4ebf8-121b-4c3a-bd76-a6a43b8c8d5f tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] [instance: aa223c49-d254-4727-8a01-873026847b37] Deleting instance files /opt/stack/data/nova/instances/aa223c49-d254-4727-8a01-873026847b37_del
Nov 28 15:47:47 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-46d4ebf8-121b-4c3a-bd76-a6a43b8c8d5f tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] [instance: aa223c49-d254-4727-8a01-873026847b37] Deletion of /opt/stack/data/nova/instances/aa223c49-d254-4727-8a01-873026847b37_del complete
Nov 28 15:47:47 user nova-compute[75176]: INFO nova.compute.manager [None req-46d4ebf8-121b-4c3a-bd76-a6a43b8c8d5f tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] [instance: aa223c49-d254-4727-8a01-873026847b37] Took 1.19 seconds to destroy the instance on the hypervisor.
Nov 28 15:47:47 user nova-compute[75176]: DEBUG oslo.service.loopingcall [None req-46d4ebf8-121b-4c3a-bd76-a6a43b8c8d5f tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75176) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 15:47:47 user nova-compute[75176]: DEBUG nova.compute.manager [-] [instance: aa223c49-d254-4727-8a01-873026847b37] Deallocating network for instance {{(pid=75176) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 15:47:47 user nova-compute[75176]: DEBUG nova.network.neutron [-] [instance: aa223c49-d254-4727-8a01-873026847b37] deallocate_for_instance() {{(pid=75176) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 15:47:47 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:47:47 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:47:48 user nova-compute[75176]: DEBUG nova.network.neutron [-] [instance: aa223c49-d254-4727-8a01-873026847b37] Updating instance_info_cache with network_info: [] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:47:48 user nova-compute[75176]: INFO nova.compute.manager [-] [instance: aa223c49-d254-4727-8a01-873026847b37] Took 0.91 seconds to deallocate network for instance.
Nov 28 15:47:48 user nova-compute[75176]: DEBUG nova.compute.manager [req-bc7926d3-cd91-455d-b681-9770eafac7de req-3993178a-0e01-404f-aa74-ca8253b17c97 service nova] [instance: aa223c49-d254-4727-8a01-873026847b37] Received event network-vif-deleted-6514aeb6-8ea4-4a27-a54b-32f650c87957 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:47:48 user nova-compute[75176]: DEBUG nova.compute.manager [req-71af7651-a194-4592-a749-ca9758acf644 req-4d8aa22f-d042-4337-8c53-80006b1f2c03 service nova] [instance: aa223c49-d254-4727-8a01-873026847b37] Received event network-vif-plugged-6514aeb6-8ea4-4a27-a54b-32f650c87957 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:47:48 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-71af7651-a194-4592-a749-ca9758acf644 req-4d8aa22f-d042-4337-8c53-80006b1f2c03 service nova] Acquiring lock "aa223c49-d254-4727-8a01-873026847b37-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:47:48 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-71af7651-a194-4592-a749-ca9758acf644 req-4d8aa22f-d042-4337-8c53-80006b1f2c03 service nova] Lock "aa223c49-d254-4727-8a01-873026847b37-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:47:48 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-71af7651-a194-4592-a749-ca9758acf644 req-4d8aa22f-d042-4337-8c53-80006b1f2c03 service nova] Lock "aa223c49-d254-4727-8a01-873026847b37-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:47:48 user nova-compute[75176]: DEBUG nova.compute.manager [req-71af7651-a194-4592-a749-ca9758acf644 req-4d8aa22f-d042-4337-8c53-80006b1f2c03 service nova] [instance: aa223c49-d254-4727-8a01-873026847b37] No waiting events found dispatching network-vif-plugged-6514aeb6-8ea4-4a27-a54b-32f650c87957 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:47:48 user nova-compute[75176]: WARNING nova.compute.manager [req-71af7651-a194-4592-a749-ca9758acf644 req-4d8aa22f-d042-4337-8c53-80006b1f2c03 service nova] [instance: aa223c49-d254-4727-8a01-873026847b37] Received unexpected event network-vif-plugged-6514aeb6-8ea4-4a27-a54b-32f650c87957 for instance with vm_state active and task_state deleting.
Nov 28 15:47:48 user nova-compute[75176]: INFO nova.compute.manager [None req-46d4ebf8-121b-4c3a-bd76-a6a43b8c8d5f tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] [instance: aa223c49-d254-4727-8a01-873026847b37] Took 0.83 seconds to detach 1 volumes for instance.
Nov 28 15:47:48 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-46d4ebf8-121b-4c3a-bd76-a6a43b8c8d5f tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:47:48 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-46d4ebf8-121b-4c3a-bd76-a6a43b8c8d5f tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:47:48 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:47:49 user nova-compute[75176]: DEBUG nova.compute.provider_tree [None req-46d4ebf8-121b-4c3a-bd76-a6a43b8c8d5f tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Inventory has not changed in ProviderTree for provider: b37848d8-f401-4155-a029-b0ffa09ff85b {{(pid=75176) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 15:47:49 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-46d4ebf8-121b-4c3a-bd76-a6a43b8c8d5f tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Inventory has not changed for provider b37848d8-f401-4155-a029-b0ffa09ff85b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75176) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 15:47:49 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-46d4ebf8-121b-4c3a-bd76-a6a43b8c8d5f tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.315s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:47:49 user nova-compute[75176]: INFO nova.scheduler.client.report [None req-46d4ebf8-121b-4c3a-bd76-a6a43b8c8d5f tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Deleted allocations for instance aa223c49-d254-4727-8a01-873026847b37
Nov 28 15:47:49 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-46d4ebf8-121b-4c3a-bd76-a6a43b8c8d5f tempest-ServerActionsTestOtherB-935995346 tempest-ServerActionsTestOtherB-935995346-project-member] Lock "aa223c49-d254-4727-8a01-873026847b37" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.436s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:47:49 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:47:49 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-caa6b324-00c6-4f08-9524-c18712376588 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Acquiring lock "e02d1e69-5e74-43c3-8546-6044d31145f2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:47:49 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-caa6b324-00c6-4f08-9524-c18712376588 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Lock "e02d1e69-5e74-43c3-8546-6044d31145f2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:47:49 user nova-compute[75176]: INFO nova.compute.manager [None req-caa6b324-00c6-4f08-9524-c18712376588 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] [instance: e02d1e69-5e74-43c3-8546-6044d31145f2] Detaching volume b424d718-a756-4599-a969-530c2d3c3c24
Nov 28 15:47:49 user nova-compute[75176]: INFO nova.virt.block_device [None req-caa6b324-00c6-4f08-9524-c18712376588 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] [instance: e02d1e69-5e74-43c3-8546-6044d31145f2] Attempting to driver detach volume b424d718-a756-4599-a969-530c2d3c3c24 from mountpoint /dev/vdb
Nov 28 15:47:49 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-caa6b324-00c6-4f08-9524-c18712376588 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Attempting to detach device vdb from instance e02d1e69-5e74-43c3-8546-6044d31145f2 from the persistent domain config. {{(pid=75176) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 15:47:49 user nova-compute[75176]: DEBUG nova.virt.libvirt.guest [None req-caa6b324-00c6-4f08-9524-c18712376588 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 15:47:49 user nova-compute[75176]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 15:47:49 user nova-compute[75176]:   <source dev="/dev/sde"/>
Nov 28 15:47:49 user nova-compute[75176]:   <target dev="vdb" bus="virtio"/>
Nov 28 15:47:49 user nova-compute[75176]:   <serial>b424d718-a756-4599-a969-530c2d3c3c24</serial>
Nov 28 15:47:49 user nova-compute[75176]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 28 15:47:49 user nova-compute[75176]: </disk>
Nov 28 15:47:49 user nova-compute[75176]:  {{(pid=75176) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 15:47:49 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-caa6b324-00c6-4f08-9524-c18712376588 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Successfully detached device vdb from instance e02d1e69-5e74-43c3-8546-6044d31145f2 from the persistent domain config.
Nov 28 15:47:49 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-caa6b324-00c6-4f08-9524-c18712376588 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e02d1e69-5e74-43c3-8546-6044d31145f2 from the live domain config. {{(pid=75176) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 15:47:49 user nova-compute[75176]: DEBUG nova.virt.libvirt.guest [None req-caa6b324-00c6-4f08-9524-c18712376588 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 15:47:49 user nova-compute[75176]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 15:47:49 user nova-compute[75176]:   <source dev="/dev/sde"/>
Nov 28 15:47:49 user nova-compute[75176]:   <target dev="vdb" bus="virtio"/>
Nov 28 15:47:49 user nova-compute[75176]:   <serial>b424d718-a756-4599-a969-530c2d3c3c24</serial>
Nov 28 15:47:49 user nova-compute[75176]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 28 15:47:49 user nova-compute[75176]: </disk>
Nov 28 15:47:49 user nova-compute[75176]:  {{(pid=75176) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 15:47:50 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-caa6b324-00c6-4f08-9524-c18712376588 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e02d1e69-5e74-43c3-8546-6044d31145f2 {{(pid=75176) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 15:47:51 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:47:51 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:47:52 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:47:53 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-8f2553f8-c392-42bb-8766-4f9152dfdb40 tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] Acquiring lock "bcccc277-0049-41c5-9d8c-7db1d86e1fca" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:47:53 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-8f2553f8-c392-42bb-8766-4f9152dfdb40 tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] Lock "bcccc277-0049-41c5-9d8c-7db1d86e1fca" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:47:53 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-8f2553f8-c392-42bb-8766-4f9152dfdb40 tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] Acquiring lock "bcccc277-0049-41c5-9d8c-7db1d86e1fca-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:47:53 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-8f2553f8-c392-42bb-8766-4f9152dfdb40 tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] Lock "bcccc277-0049-41c5-9d8c-7db1d86e1fca-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:47:53 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-8f2553f8-c392-42bb-8766-4f9152dfdb40 tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] Lock "bcccc277-0049-41c5-9d8c-7db1d86e1fca-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:47:53 user nova-compute[75176]: INFO nova.compute.manager [None req-8f2553f8-c392-42bb-8766-4f9152dfdb40 tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] [instance: bcccc277-0049-41c5-9d8c-7db1d86e1fca] Terminating instance
Nov 28 15:47:53 user nova-compute[75176]: DEBUG nova.compute.manager [None req-8f2553f8-c392-42bb-8766-4f9152dfdb40 tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] [instance: bcccc277-0049-41c5-9d8c-7db1d86e1fca] Start destroying the instance on the hypervisor. {{(pid=75176) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 15:47:53 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:47:53 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:47:53 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:47:53 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:47:53 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:47:54 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:47:54 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:47:54 user nova-compute[75176]: INFO nova.virt.libvirt.driver [-] [instance: bcccc277-0049-41c5-9d8c-7db1d86e1fca] Instance destroyed successfully.
Nov 28 15:47:54 user nova-compute[75176]: DEBUG nova.objects.instance [None req-8f2553f8-c392-42bb-8766-4f9152dfdb40 tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] Lazy-loading 'resources' on Instance uuid bcccc277-0049-41c5-9d8c-7db1d86e1fca {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:47:54 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-8f2553f8-c392-42bb-8766-4f9152dfdb40 tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T15:46:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-57835384',display_name='tempest-ServersNegativeTestJSON-server-57835384',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-57835384',id=22,image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-28T15:46:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='13ce3926a76541f7a32ada5070b10be1',ramdisk_id='',reservation_id='r-1blfv0rc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-417711709',owner_user_name='tempest-ServersNegativeTestJSON-417711709-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T15:46:10Z,user_data=None,user_id='8fdbce92609048169853a846340eb9fe',uuid=bcccc277-0049-41c5-9d8c-7db1d86e1fca,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5b8fbb7b-8b59-4923-ae3e-b7567ad90d30", "address": "fa:16:3e:e8:d8:8e", "network": {"id": "51143aa0-7498-4dfc-8425-9046ee5aa4fc", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-351796020-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13ce3926a76541f7a32ada5070b10be1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b8fbb7b-8b", "ovs_interfaceid": "5b8fbb7b-8b59-4923-ae3e-b7567ad90d30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 15:47:54 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-8f2553f8-c392-42bb-8766-4f9152dfdb40 tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] Converting VIF {"id": "5b8fbb7b-8b59-4923-ae3e-b7567ad90d30", "address": "fa:16:3e:e8:d8:8e", "network": {"id": "51143aa0-7498-4dfc-8425-9046ee5aa4fc", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-351796020-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13ce3926a76541f7a32ada5070b10be1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b8fbb7b-8b", "ovs_interfaceid": "5b8fbb7b-8b59-4923-ae3e-b7567ad90d30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:47:54 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-8f2553f8-c392-42bb-8766-4f9152dfdb40 tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:d8:8e,bridge_name='br-int',has_traffic_filtering=True,id=5b8fbb7b-8b59-4923-ae3e-b7567ad90d30,network=Network(51143aa0-7498-4dfc-8425-9046ee5aa4fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b8fbb7b-8b') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:47:54 user nova-compute[75176]: DEBUG os_vif [None req-8f2553f8-c392-42bb-8766-4f9152dfdb40 tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:d8:8e,bridge_name='br-int',has_traffic_filtering=True,id=5b8fbb7b-8b59-4923-ae3e-b7567ad90d30,network=Network(51143aa0-7498-4dfc-8425-9046ee5aa4fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b8fbb7b-8b') {{(pid=75176) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 15:47:54 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:47:54 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5b8fbb7b-8b, bridge=br-int, if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:47:54 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:47:54 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:47:54 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:47:54 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2da36aa5-5e91-4c3d-b47a-6cf74621e9fc) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:47:54 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:47:54 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:47:54 user nova-compute[75176]: INFO os_vif [None req-8f2553f8-c392-42bb-8766-4f9152dfdb40 tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:d8:8e,bridge_name='br-int',has_traffic_filtering=True,id=5b8fbb7b-8b59-4923-ae3e-b7567ad90d30,network=Network(51143aa0-7498-4dfc-8425-9046ee5aa4fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b8fbb7b-8b')
Nov 28 15:47:54 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-8f2553f8-c392-42bb-8766-4f9152dfdb40 tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] [instance: bcccc277-0049-41c5-9d8c-7db1d86e1fca] Deleting instance files /opt/stack/data/nova/instances/bcccc277-0049-41c5-9d8c-7db1d86e1fca_del
Nov 28 15:47:54 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-8f2553f8-c392-42bb-8766-4f9152dfdb40 tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] [instance: bcccc277-0049-41c5-9d8c-7db1d86e1fca] Deletion of /opt/stack/data/nova/instances/bcccc277-0049-41c5-9d8c-7db1d86e1fca_del complete
Nov 28 15:47:54 user nova-compute[75176]: INFO nova.compute.manager [None req-8f2553f8-c392-42bb-8766-4f9152dfdb40 tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] [instance: bcccc277-0049-41c5-9d8c-7db1d86e1fca] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 28 15:47:54 user nova-compute[75176]: DEBUG oslo.service.loopingcall [None req-8f2553f8-c392-42bb-8766-4f9152dfdb40 tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75176) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 15:47:54 user nova-compute[75176]: DEBUG nova.compute.manager [-] [instance: bcccc277-0049-41c5-9d8c-7db1d86e1fca] Deallocating network for instance {{(pid=75176) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 15:47:54 user nova-compute[75176]: DEBUG nova.network.neutron [-] [instance: bcccc277-0049-41c5-9d8c-7db1d86e1fca] deallocate_for_instance() {{(pid=75176) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 15:47:54 user nova-compute[75176]: DEBUG nova.compute.manager [req-e5e43bd7-1629-4ab9-9c07-98e542a9b349 req-98677b4a-c47a-41ef-946c-84cdb1f61a1b service nova] [instance: bcccc277-0049-41c5-9d8c-7db1d86e1fca] Received event network-vif-unplugged-5b8fbb7b-8b59-4923-ae3e-b7567ad90d30 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:47:54 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-e5e43bd7-1629-4ab9-9c07-98e542a9b349 req-98677b4a-c47a-41ef-946c-84cdb1f61a1b service nova] Acquiring lock "bcccc277-0049-41c5-9d8c-7db1d86e1fca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:47:54 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-e5e43bd7-1629-4ab9-9c07-98e542a9b349 req-98677b4a-c47a-41ef-946c-84cdb1f61a1b service nova] Lock "bcccc277-0049-41c5-9d8c-7db1d86e1fca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:47:54 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-e5e43bd7-1629-4ab9-9c07-98e542a9b349 req-98677b4a-c47a-41ef-946c-84cdb1f61a1b service nova] Lock "bcccc277-0049-41c5-9d8c-7db1d86e1fca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:47:54 user nova-compute[75176]: DEBUG nova.compute.manager [req-e5e43bd7-1629-4ab9-9c07-98e542a9b349 req-98677b4a-c47a-41ef-946c-84cdb1f61a1b service nova] [instance: bcccc277-0049-41c5-9d8c-7db1d86e1fca] No waiting events found dispatching network-vif-unplugged-5b8fbb7b-8b59-4923-ae3e-b7567ad90d30 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:47:54 user nova-compute[75176]: DEBUG nova.compute.manager [req-e5e43bd7-1629-4ab9-9c07-98e542a9b349 req-98677b4a-c47a-41ef-946c-84cdb1f61a1b service nova] [instance: bcccc277-0049-41c5-9d8c-7db1d86e1fca] Received event network-vif-unplugged-5b8fbb7b-8b59-4923-ae3e-b7567ad90d30 for instance with task_state deleting. {{(pid=75176) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 15:47:54 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:47:54 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:47:54 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:47:54 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:47:54 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:47:54 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:47:54 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Auditing locally available compute resources for user (node: user) {{(pid=75176) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 15:47:54 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6ebcc53-802a-4515-ba41-3e8e1129235f/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:47:54 user nova-compute[75176]: DEBUG nova.network.neutron [-] [instance: bcccc277-0049-41c5-9d8c-7db1d86e1fca] Updating instance_info_cache with network_info: [] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:47:55 user nova-compute[75176]: DEBUG nova.compute.manager [req-9a530339-43a1-4241-8f0d-19444c4f1d26 req-33c488ed-9f9f-4fc9-8842-1417a30cb526 service nova] [instance: bcccc277-0049-41c5-9d8c-7db1d86e1fca] Received event network-vif-deleted-5b8fbb7b-8b59-4923-ae3e-b7567ad90d30 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:47:55 user nova-compute[75176]: INFO nova.compute.manager [req-9a530339-43a1-4241-8f0d-19444c4f1d26 req-33c488ed-9f9f-4fc9-8842-1417a30cb526 service nova] [instance: bcccc277-0049-41c5-9d8c-7db1d86e1fca] Neutron deleted interface 5b8fbb7b-8b59-4923-ae3e-b7567ad90d30; detaching it from the instance and deleting it from the info cache
Nov 28 15:47:55 user nova-compute[75176]: DEBUG nova.network.neutron [req-9a530339-43a1-4241-8f0d-19444c4f1d26 req-33c488ed-9f9f-4fc9-8842-1417a30cb526 service nova] [instance: bcccc277-0049-41c5-9d8c-7db1d86e1fca] Updating instance_info_cache with network_info: [] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:47:55 user nova-compute[75176]: INFO nova.compute.manager [-] [instance: bcccc277-0049-41c5-9d8c-7db1d86e1fca] Took 0.49 seconds to deallocate network for instance.
Nov 28 15:47:55 user nova-compute[75176]: DEBUG nova.compute.manager [req-9a530339-43a1-4241-8f0d-19444c4f1d26 req-33c488ed-9f9f-4fc9-8842-1417a30cb526 service nova] [instance: bcccc277-0049-41c5-9d8c-7db1d86e1fca] Detach interface failed, port_id=5b8fbb7b-8b59-4923-ae3e-b7567ad90d30, reason: Instance bcccc277-0049-41c5-9d8c-7db1d86e1fca could not be found. {{(pid=75176) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 28 15:47:55 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6ebcc53-802a-4515-ba41-3e8e1129235f/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:47:55 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6ebcc53-802a-4515-ba41-3e8e1129235f/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:47:55 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-8f2553f8-c392-42bb-8766-4f9152dfdb40 tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:47:55 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-8f2553f8-c392-42bb-8766-4f9152dfdb40 tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:47:55 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6ebcc53-802a-4515-ba41-3e8e1129235f/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:47:55 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e8507b7-fccf-4196-b589-bf2b74f165ec/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:47:55 user nova-compute[75176]: DEBUG nova.compute.provider_tree [None req-8f2553f8-c392-42bb-8766-4f9152dfdb40 tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] Inventory has not changed in ProviderTree for provider: b37848d8-f401-4155-a029-b0ffa09ff85b {{(pid=75176) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 15:47:55 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-8f2553f8-c392-42bb-8766-4f9152dfdb40 tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] Inventory has not changed for provider b37848d8-f401-4155-a029-b0ffa09ff85b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75176) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 15:47:55 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e8507b7-fccf-4196-b589-bf2b74f165ec/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:47:55 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e8507b7-fccf-4196-b589-bf2b74f165ec/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:47:55 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-8f2553f8-c392-42bb-8766-4f9152dfdb40 tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.398s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:47:55 user nova-compute[75176]: INFO nova.scheduler.client.report [None req-8f2553f8-c392-42bb-8766-4f9152dfdb40 tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] Deleted allocations for instance bcccc277-0049-41c5-9d8c-7db1d86e1fca
Nov 28 15:47:55 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-8f2553f8-c392-42bb-8766-4f9152dfdb40 tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] Lock "bcccc277-0049-41c5-9d8c-7db1d86e1fca" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.993s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:47:55 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e8507b7-fccf-4196-b589-bf2b74f165ec/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:47:55 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e8a6e1b-4f71-494a-8f44-f9643c658021/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:47:55 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e8a6e1b-4f71-494a-8f44-f9643c658021/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:47:55 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e8a6e1b-4f71-494a-8f44-f9643c658021/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:47:56 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e8a6e1b-4f71-494a-8f44-f9643c658021/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:47:56 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e02d1e69-5e74-43c3-8546-6044d31145f2/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:47:56 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e02d1e69-5e74-43c3-8546-6044d31145f2/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:47:56 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e02d1e69-5e74-43c3-8546-6044d31145f2/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:47:56 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e02d1e69-5e74-43c3-8546-6044d31145f2/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:47:56 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e465c9f-e8ab-4a28-bf74-2936a272a0e2/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:47:56 user nova-compute[75176]: DEBUG nova.compute.manager [req-8ac52185-fa0c-4be4-9d1f-e4c3532f790f req-038c84fe-1769-4d26-923b-8fe2aa8f5edc service nova] [instance: bcccc277-0049-41c5-9d8c-7db1d86e1fca] Received event network-vif-plugged-5b8fbb7b-8b59-4923-ae3e-b7567ad90d30 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:47:56 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-8ac52185-fa0c-4be4-9d1f-e4c3532f790f req-038c84fe-1769-4d26-923b-8fe2aa8f5edc service nova] Acquiring lock "bcccc277-0049-41c5-9d8c-7db1d86e1fca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:47:56 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-8ac52185-fa0c-4be4-9d1f-e4c3532f790f req-038c84fe-1769-4d26-923b-8fe2aa8f5edc service nova] Lock "bcccc277-0049-41c5-9d8c-7db1d86e1fca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:47:56 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-8ac52185-fa0c-4be4-9d1f-e4c3532f790f req-038c84fe-1769-4d26-923b-8fe2aa8f5edc service nova] Lock "bcccc277-0049-41c5-9d8c-7db1d86e1fca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:47:56 user nova-compute[75176]: DEBUG nova.compute.manager [req-8ac52185-fa0c-4be4-9d1f-e4c3532f790f req-038c84fe-1769-4d26-923b-8fe2aa8f5edc service nova] [instance: bcccc277-0049-41c5-9d8c-7db1d86e1fca] No waiting events found dispatching network-vif-plugged-5b8fbb7b-8b59-4923-ae3e-b7567ad90d30 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:47:56 user nova-compute[75176]: WARNING nova.compute.manager [req-8ac52185-fa0c-4be4-9d1f-e4c3532f790f req-038c84fe-1769-4d26-923b-8fe2aa8f5edc service nova] [instance: bcccc277-0049-41c5-9d8c-7db1d86e1fca] Received unexpected event network-vif-plugged-5b8fbb7b-8b59-4923-ae3e-b7567ad90d30 for instance with vm_state deleted and task_state None.
Nov 28 15:47:56 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e465c9f-e8ab-4a28-bf74-2936a272a0e2/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:47:56 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e465c9f-e8ab-4a28-bf74-2936a272a0e2/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:47:56 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e465c9f-e8ab-4a28-bf74-2936a272a0e2/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:47:56 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fe64eb8-b4e3-4037-80b1-0c151370d5a8/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:47:57 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fe64eb8-b4e3-4037-80b1-0c151370d5a8/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:47:57 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fe64eb8-b4e3-4037-80b1-0c151370d5a8/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:47:57 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fe64eb8-b4e3-4037-80b1-0c151370d5a8/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:47:57 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/402e779e-f507-49f1-a0d8-31ab0d23fbcd/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:47:57 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-288d90be-5d87-49f4-8c48-ea16cfedaefd tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Acquiring lock "402e779e-f507-49f1-a0d8-31ab0d23fbcd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:47:57 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-288d90be-5d87-49f4-8c48-ea16cfedaefd tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Lock "402e779e-f507-49f1-a0d8-31ab0d23fbcd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:47:57 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-288d90be-5d87-49f4-8c48-ea16cfedaefd tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Acquiring lock "402e779e-f507-49f1-a0d8-31ab0d23fbcd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:47:57 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-288d90be-5d87-49f4-8c48-ea16cfedaefd tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Lock "402e779e-f507-49f1-a0d8-31ab0d23fbcd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:47:57 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-288d90be-5d87-49f4-8c48-ea16cfedaefd tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Lock "402e779e-f507-49f1-a0d8-31ab0d23fbcd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:47:57 user nova-compute[75176]: INFO nova.compute.manager [None req-288d90be-5d87-49f4-8c48-ea16cfedaefd tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] [instance: 402e779e-f507-49f1-a0d8-31ab0d23fbcd] Terminating instance
Nov 28 15:47:57 user nova-compute[75176]: DEBUG nova.compute.manager [None req-288d90be-5d87-49f4-8c48-ea16cfedaefd tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] [instance: 402e779e-f507-49f1-a0d8-31ab0d23fbcd] Start destroying the instance on the hypervisor. {{(pid=75176) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 15:47:57 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/402e779e-f507-49f1-a0d8-31ab0d23fbcd/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:47:57 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/402e779e-f507-49f1-a0d8-31ab0d23fbcd/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:47:57 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:47:57 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:47:57 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:47:57 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:47:57 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/402e779e-f507-49f1-a0d8-31ab0d23fbcd/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:47:58 user nova-compute[75176]: DEBUG nova.compute.manager [req-76b77829-99ff-4e26-b3e7-a9c9994b8a4e req-a9832851-fe83-4379-ab2a-e83ca663ddae service nova] [instance: 402e779e-f507-49f1-a0d8-31ab0d23fbcd] Received event network-vif-unplugged-2de2e1eb-51fe-4259-bb8a-20c50e87b4ce {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:47:58 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-76b77829-99ff-4e26-b3e7-a9c9994b8a4e req-a9832851-fe83-4379-ab2a-e83ca663ddae service nova] Acquiring lock "402e779e-f507-49f1-a0d8-31ab0d23fbcd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:47:58 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-76b77829-99ff-4e26-b3e7-a9c9994b8a4e req-a9832851-fe83-4379-ab2a-e83ca663ddae service nova] Lock "402e779e-f507-49f1-a0d8-31ab0d23fbcd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:47:58 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-76b77829-99ff-4e26-b3e7-a9c9994b8a4e req-a9832851-fe83-4379-ab2a-e83ca663ddae service nova] Lock "402e779e-f507-49f1-a0d8-31ab0d23fbcd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:47:58 user nova-compute[75176]: DEBUG nova.compute.manager [req-76b77829-99ff-4e26-b3e7-a9c9994b8a4e req-a9832851-fe83-4379-ab2a-e83ca663ddae service nova] [instance: 402e779e-f507-49f1-a0d8-31ab0d23fbcd] No waiting events found dispatching network-vif-unplugged-2de2e1eb-51fe-4259-bb8a-20c50e87b4ce {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:47:58 user nova-compute[75176]: DEBUG nova.compute.manager [req-76b77829-99ff-4e26-b3e7-a9c9994b8a4e req-a9832851-fe83-4379-ab2a-e83ca663ddae service nova] [instance: 402e779e-f507-49f1-a0d8-31ab0d23fbcd] Received event network-vif-unplugged-2de2e1eb-51fe-4259-bb8a-20c50e87b4ce for instance with task_state deleting. {{(pid=75176) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 15:47:58 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-6c8fc1fa-bf3f-4541-b1bb-11089717578a tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] Acquiring lock "ca1558cf-b235-4a20-8d12-45f1ca16fe41" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:47:58 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-6c8fc1fa-bf3f-4541-b1bb-11089717578a tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] Lock "ca1558cf-b235-4a20-8d12-45f1ca16fe41" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:47:58 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 15:47:58 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 15:47:58 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Hypervisor/Node resource view: name=user free_ram=7715MB free_disk=25.316898345947266GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75176) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 15:47:58 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:47:58 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:47:58 user nova-compute[75176]: DEBUG nova.compute.manager [None req-6c8fc1fa-bf3f-4541-b1bb-11089717578a tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] [instance: ca1558cf-b235-4a20-8d12-45f1ca16fe41] Starting instance... {{(pid=75176) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 15:47:58 user nova-compute[75176]: INFO nova.virt.libvirt.driver [-] [instance: 402e779e-f507-49f1-a0d8-31ab0d23fbcd] Instance destroyed successfully.
Nov 28 15:47:58 user nova-compute[75176]: DEBUG nova.objects.instance [None req-288d90be-5d87-49f4-8c48-ea16cfedaefd tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Lazy-loading 'resources' on Instance uuid 402e779e-f507-49f1-a0d8-31ab0d23fbcd {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:47:58 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-288d90be-5d87-49f4-8c48-ea16cfedaefd tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T15:42:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1989419547',display_name='tempest-AttachVolumeNegativeTest-server-1989419547',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1989419547',id=13,image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDFFWjldyHtbmkwknmcPcPg3lFhol4yQjd0aGcLhl8u/bcASG+kJTHf5jG/jfYqtoq04tUjwJE1sE6H7GDR3xBjF+nxszd0qVv51R7jnyv4CEJMXYm+f8JML2UmVvpu+mA==',key_name='tempest-keypair-1933077131',keypairs=<?>,launch_index=0,launched_at=2023-11-28T15:42:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a194f81f7e104be7940d1d05f71bbad9',ramdisk_id='',reservation_id='r-0k0fuqwb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1403590572',owner_user_name='tempest-AttachVolumeNegativeTest-1403590572-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T15:42:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f9a745552d974e05a9e0befc68eb7f6e',uuid=402e779e-f507-49f1-a0d8-31ab0d23fbcd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2de2e1eb-51fe-4259-bb8a-20c50e87b4ce", "address": "fa:16:3e:c4:29:df", "network": {"id": "7ab60343-57be-427d-9037-6ecf0eaf5de0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1508138843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a194f81f7e104be7940d1d05f71bbad9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2de2e1eb-51", "ovs_interfaceid": "2de2e1eb-51fe-4259-bb8a-20c50e87b4ce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 15:47:58 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-288d90be-5d87-49f4-8c48-ea16cfedaefd tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Converting VIF {"id": "2de2e1eb-51fe-4259-bb8a-20c50e87b4ce", "address": "fa:16:3e:c4:29:df", "network": {"id": "7ab60343-57be-427d-9037-6ecf0eaf5de0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1508138843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a194f81f7e104be7940d1d05f71bbad9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2de2e1eb-51", "ovs_interfaceid": "2de2e1eb-51fe-4259-bb8a-20c50e87b4ce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:47:58 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-288d90be-5d87-49f4-8c48-ea16cfedaefd tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c4:29:df,bridge_name='br-int',has_traffic_filtering=True,id=2de2e1eb-51fe-4259-bb8a-20c50e87b4ce,network=Network(7ab60343-57be-427d-9037-6ecf0eaf5de0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2de2e1eb-51') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:47:58 user nova-compute[75176]: DEBUG os_vif [None req-288d90be-5d87-49f4-8c48-ea16cfedaefd tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c4:29:df,bridge_name='br-int',has_traffic_filtering=True,id=2de2e1eb-51fe-4259-bb8a-20c50e87b4ce,network=Network(7ab60343-57be-427d-9037-6ecf0eaf5de0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2de2e1eb-51') {{(pid=75176) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 15:47:58 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:47:58 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2de2e1eb-51, bridge=br-int, if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:47:58 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:47:58 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:47:58 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:47:58 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f4d25aa5-6132-45ee-bda9-748e2a83de3a) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:47:58 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:47:58 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:47:58 user nova-compute[75176]: INFO os_vif [None req-288d90be-5d87-49f4-8c48-ea16cfedaefd tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c4:29:df,bridge_name='br-int',has_traffic_filtering=True,id=2de2e1eb-51fe-4259-bb8a-20c50e87b4ce,network=Network(7ab60343-57be-427d-9037-6ecf0eaf5de0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2de2e1eb-51')
Nov 28 15:47:58 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-288d90be-5d87-49f4-8c48-ea16cfedaefd tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] [instance: 402e779e-f507-49f1-a0d8-31ab0d23fbcd] Deleting instance files /opt/stack/data/nova/instances/402e779e-f507-49f1-a0d8-31ab0d23fbcd_del
Nov 28 15:47:58 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-288d90be-5d87-49f4-8c48-ea16cfedaefd tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] [instance: 402e779e-f507-49f1-a0d8-31ab0d23fbcd] Deletion of /opt/stack/data/nova/instances/402e779e-f507-49f1-a0d8-31ab0d23fbcd_del complete
Nov 28 15:47:58 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-6c8fc1fa-bf3f-4541-b1bb-11089717578a tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:47:58 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance 2e8507b7-fccf-4196-b589-bf2b74f165ec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:47:58 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance 402e779e-f507-49f1-a0d8-31ab0d23fbcd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:47:58 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance e02d1e69-5e74-43c3-8546-6044d31145f2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:47:58 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance 1e8a6e1b-4f71-494a-8f44-f9643c658021 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:47:58 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance 0e465c9f-e8ab-4a28-bf74-2936a272a0e2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:47:58 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance 8fe64eb8-b4e3-4037-80b1-0c151370d5a8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:47:58 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance a6ebcc53-802a-4515-ba41-3e8e1129235f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:47:58 user nova-compute[75176]: INFO nova.compute.manager [None req-288d90be-5d87-49f4-8c48-ea16cfedaefd tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] [instance: 402e779e-f507-49f1-a0d8-31ab0d23fbcd] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 28 15:47:58 user nova-compute[75176]: DEBUG oslo.service.loopingcall [None req-288d90be-5d87-49f4-8c48-ea16cfedaefd tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75176) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 15:47:58 user nova-compute[75176]: DEBUG nova.compute.manager [-] [instance: 402e779e-f507-49f1-a0d8-31ab0d23fbcd] Deallocating network for instance {{(pid=75176) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 15:47:58 user nova-compute[75176]: DEBUG nova.network.neutron [-] [instance: 402e779e-f507-49f1-a0d8-31ab0d23fbcd] deallocate_for_instance() {{(pid=75176) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 15:47:58 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance ca1558cf-b235-4a20-8d12-45f1ca16fe41 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 28 15:47:58 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75176) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 15:47:58 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75176) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 15:47:58 user nova-compute[75176]: DEBUG nova.compute.provider_tree [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Inventory has not changed in ProviderTree for provider: b37848d8-f401-4155-a029-b0ffa09ff85b {{(pid=75176) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 15:47:58 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Inventory has not changed for provider b37848d8-f401-4155-a029-b0ffa09ff85b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75176) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 15:47:58 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Compute_service record updated for user:user {{(pid=75176) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 15:47:58 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.439s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:47:58 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-6c8fc1fa-bf3f-4541-b1bb-11089717578a tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.338s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:47:58 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-6c8fc1fa-bf3f-4541-b1bb-11089717578a tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75176) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 15:47:58 user nova-compute[75176]: INFO nova.compute.claims [None req-6c8fc1fa-bf3f-4541-b1bb-11089717578a tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] [instance: ca1558cf-b235-4a20-8d12-45f1ca16fe41] Claim successful on node user
Nov 28 15:47:58 user nova-compute[75176]: DEBUG nova.compute.provider_tree [None req-6c8fc1fa-bf3f-4541-b1bb-11089717578a tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] Inventory has not changed in ProviderTree for provider: b37848d8-f401-4155-a029-b0ffa09ff85b {{(pid=75176) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 15:47:58 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-6c8fc1fa-bf3f-4541-b1bb-11089717578a tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] Inventory has not changed for provider b37848d8-f401-4155-a029-b0ffa09ff85b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75176) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 15:47:58 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:47:59 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-6c8fc1fa-bf3f-4541-b1bb-11089717578a tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.404s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:47:59 user nova-compute[75176]: DEBUG nova.compute.manager [None req-6c8fc1fa-bf3f-4541-b1bb-11089717578a tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] [instance: ca1558cf-b235-4a20-8d12-45f1ca16fe41] Start building networks asynchronously for instance. {{(pid=75176) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 15:47:59 user nova-compute[75176]: DEBUG nova.network.neutron [-] [instance: 402e779e-f507-49f1-a0d8-31ab0d23fbcd] Updating instance_info_cache with network_info: [] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:47:59 user nova-compute[75176]: INFO nova.compute.manager [-] [instance: 402e779e-f507-49f1-a0d8-31ab0d23fbcd] Took 0.77 seconds to deallocate network for instance.
Nov 28 15:47:59 user nova-compute[75176]: DEBUG nova.compute.manager [None req-6c8fc1fa-bf3f-4541-b1bb-11089717578a tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] [instance: ca1558cf-b235-4a20-8d12-45f1ca16fe41] Allocating IP information in the background. {{(pid=75176) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 15:47:59 user nova-compute[75176]: DEBUG nova.network.neutron [None req-6c8fc1fa-bf3f-4541-b1bb-11089717578a tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] [instance: ca1558cf-b235-4a20-8d12-45f1ca16fe41] allocate_for_instance() {{(pid=75176) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 15:47:59 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-6c8fc1fa-bf3f-4541-b1bb-11089717578a tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] [instance: ca1558cf-b235-4a20-8d12-45f1ca16fe41] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 15:47:59 user nova-compute[75176]: DEBUG nova.compute.manager [None req-6c8fc1fa-bf3f-4541-b1bb-11089717578a tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] [instance: ca1558cf-b235-4a20-8d12-45f1ca16fe41] Start building block device mappings for instance. {{(pid=75176) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 15:47:59 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-288d90be-5d87-49f4-8c48-ea16cfedaefd tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:47:59 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-288d90be-5d87-49f4-8c48-ea16cfedaefd tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:47:59 user nova-compute[75176]: DEBUG nova.policy [None req-6c8fc1fa-bf3f-4541-b1bb-11089717578a tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4753cf25a4c14e8aacd55309ff7e988d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8b3f118afd469f9c82ec2574586aaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75176) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 15:47:59 user nova-compute[75176]: INFO nova.virt.block_device [None req-6c8fc1fa-bf3f-4541-b1bb-11089717578a tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] [instance: ca1558cf-b235-4a20-8d12-45f1ca16fe41] Booting with volume 22933c6e-3d8f-44f5-bc41-dee97c587055 at /dev/vda
Nov 28 15:47:59 user nova-compute[75176]: DEBUG os_brick.utils [None req-6c8fc1fa-bf3f-4541-b1bb-11089717578a tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 15:47:59 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:47:59 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:47:59 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[fba1baa0-c0bd-49bd-9ff2-bd41a6bff054]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:edc924a949b2\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:47:59 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:47:59 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:47:59 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[9533e177-2131-4cbc-8180-71816ad81242]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:47:59 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:47:59 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:47:59 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[f104f4f1-9b39-4e06-b7a3-a27a702ef594]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:47:59 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bc7eb65-7e81-44ad-9b2d-0be6fd42a47c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:47:59 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-6c8fc1fa-bf3f-4541-b1bb-11089717578a tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] Running cmd (subprocess): nvme version {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:47:59 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-6c8fc1fa-bf3f-4541-b1bb-11089717578a tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] 'nvme version' failed. Not Retrying. {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 15:47:59 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6c8fc1fa-bf3f-4541-b1bb-11089717578a tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] nvme not present on system {{(pid=75176) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 15:47:59 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:47:59 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 15:47:59 user nova-compute[75176]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 15:47:59 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[48dedbad-52f6-4446-9376-700b51c9f228]: (4, '') {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:47:59 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.lightos [None req-6c8fc1fa-bf3f-4541-b1bb-11089717578a tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75176) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 15:47:59 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.lightos [None req-6c8fc1fa-bf3f-4541-b1bb-11089717578a tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75176) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 15:47:59 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.lightos [None req-6c8fc1fa-bf3f-4541-b1bb-11089717578a tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] LIGHTOS: no hostnqn found. {{(pid=75176) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 15:47:59 user nova-compute[75176]: DEBUG os_brick.utils [None req-6c8fc1fa-bf3f-4541-b1bb-11089717578a tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:edc924a949b2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 15:47:59 user nova-compute[75176]: DEBUG nova.virt.block_device [None req-6c8fc1fa-bf3f-4541-b1bb-11089717578a tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] [instance: ca1558cf-b235-4a20-8d12-45f1ca16fe41] Updating existing volume attachment record: f3267f47-896f-494e-b8bb-955cd00be463 {{(pid=75176) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 15:47:59 user nova-compute[75176]: DEBUG nova.compute.provider_tree [None req-288d90be-5d87-49f4-8c48-ea16cfedaefd tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Inventory has not changed in ProviderTree for provider: b37848d8-f401-4155-a029-b0ffa09ff85b {{(pid=75176) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 15:47:59 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-288d90be-5d87-49f4-8c48-ea16cfedaefd tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Inventory has not changed for provider b37848d8-f401-4155-a029-b0ffa09ff85b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75176) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 15:47:59 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-288d90be-5d87-49f4-8c48-ea16cfedaefd tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.359s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:47:59 user nova-compute[75176]: INFO nova.scheduler.client.report [None req-288d90be-5d87-49f4-8c48-ea16cfedaefd tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Deleted allocations for instance 402e779e-f507-49f1-a0d8-31ab0d23fbcd
Nov 28 15:47:59 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-288d90be-5d87-49f4-8c48-ea16cfedaefd tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Lock "402e779e-f507-49f1-a0d8-31ab0d23fbcd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.240s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:47:59 user nova-compute[75176]: DEBUG nova.compute.manager [req-123039d9-ff37-4ecc-96d2-20e1b85a1458 req-59496c1d-9ed2-4f70-bc6a-de7d554a4bbc service nova] [instance: 402e779e-f507-49f1-a0d8-31ab0d23fbcd] Received event network-vif-plugged-2de2e1eb-51fe-4259-bb8a-20c50e87b4ce {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:47:59 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-123039d9-ff37-4ecc-96d2-20e1b85a1458 req-59496c1d-9ed2-4f70-bc6a-de7d554a4bbc service nova] Acquiring lock "402e779e-f507-49f1-a0d8-31ab0d23fbcd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:47:59 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-123039d9-ff37-4ecc-96d2-20e1b85a1458 req-59496c1d-9ed2-4f70-bc6a-de7d554a4bbc service nova] Lock "402e779e-f507-49f1-a0d8-31ab0d23fbcd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:47:59 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-123039d9-ff37-4ecc-96d2-20e1b85a1458 req-59496c1d-9ed2-4f70-bc6a-de7d554a4bbc service nova] Lock "402e779e-f507-49f1-a0d8-31ab0d23fbcd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:47:59 user nova-compute[75176]: DEBUG nova.compute.manager [req-123039d9-ff37-4ecc-96d2-20e1b85a1458 req-59496c1d-9ed2-4f70-bc6a-de7d554a4bbc service nova] [instance: 402e779e-f507-49f1-a0d8-31ab0d23fbcd] No waiting events found dispatching network-vif-plugged-2de2e1eb-51fe-4259-bb8a-20c50e87b4ce {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:47:59 user nova-compute[75176]: WARNING nova.compute.manager [req-123039d9-ff37-4ecc-96d2-20e1b85a1458 req-59496c1d-9ed2-4f70-bc6a-de7d554a4bbc service nova] [instance: 402e779e-f507-49f1-a0d8-31ab0d23fbcd] Received unexpected event network-vif-plugged-2de2e1eb-51fe-4259-bb8a-20c50e87b4ce for instance with vm_state deleted and task_state None.
Nov 28 15:47:59 user nova-compute[75176]: DEBUG nova.compute.manager [req-123039d9-ff37-4ecc-96d2-20e1b85a1458 req-59496c1d-9ed2-4f70-bc6a-de7d554a4bbc service nova] [instance: 402e779e-f507-49f1-a0d8-31ab0d23fbcd] Received event network-vif-deleted-2de2e1eb-51fe-4259-bb8a-20c50e87b4ce {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:48:00 user nova-compute[75176]: DEBUG nova.network.neutron [None req-6c8fc1fa-bf3f-4541-b1bb-11089717578a tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] [instance: ca1558cf-b235-4a20-8d12-45f1ca16fe41] Successfully created port: 2791b548-7207-402c-9f65-c078be714ef5 {{(pid=75176) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 15:48:00 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:48:00 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Starting heal instance info cache {{(pid=75176) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 15:48:00 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquiring lock "refresh_cache-2e8507b7-fccf-4196-b589-bf2b74f165ec" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:48:00 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquired lock "refresh_cache-2e8507b7-fccf-4196-b589-bf2b74f165ec" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:48:00 user nova-compute[75176]: DEBUG nova.network.neutron [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] [instance: 2e8507b7-fccf-4196-b589-bf2b74f165ec] Forcefully refreshing network info cache for instance {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 15:48:00 user nova-compute[75176]: DEBUG nova.network.neutron [None req-6c8fc1fa-bf3f-4541-b1bb-11089717578a tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] [instance: ca1558cf-b235-4a20-8d12-45f1ca16fe41] Successfully updated port: 2791b548-7207-402c-9f65-c078be714ef5 {{(pid=75176) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 15:48:00 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-6c8fc1fa-bf3f-4541-b1bb-11089717578a tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] Acquiring lock "refresh_cache-ca1558cf-b235-4a20-8d12-45f1ca16fe41" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:48:00 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-6c8fc1fa-bf3f-4541-b1bb-11089717578a tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] Acquired lock "refresh_cache-ca1558cf-b235-4a20-8d12-45f1ca16fe41" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:48:00 user nova-compute[75176]: DEBUG nova.network.neutron [None req-6c8fc1fa-bf3f-4541-b1bb-11089717578a tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] [instance: ca1558cf-b235-4a20-8d12-45f1ca16fe41] Building network info cache for instance {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 15:48:00 user nova-compute[75176]: DEBUG nova.network.neutron [None req-6c8fc1fa-bf3f-4541-b1bb-11089717578a tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] [instance: ca1558cf-b235-4a20-8d12-45f1ca16fe41] Instance cache missing network info. {{(pid=75176) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 15:48:01 user nova-compute[75176]: DEBUG nova.network.neutron [None req-6c8fc1fa-bf3f-4541-b1bb-11089717578a tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] [instance: ca1558cf-b235-4a20-8d12-45f1ca16fe41] Updating instance_info_cache with network_info: [{"id": "2791b548-7207-402c-9f65-c078be714ef5", "address": "fa:16:3e:08:ec:9f", "network": {"id": "1f00fd98-3cd0-4c8c-912a-bc29124e1940", "bridge": "br-int", "label": "tempest-TestShelveInstance-1334429215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a8b3f118afd469f9c82ec2574586aaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2791b548-72", "ovs_interfaceid": "2791b548-7207-402c-9f65-c078be714ef5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:48:01 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-6c8fc1fa-bf3f-4541-b1bb-11089717578a tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] Releasing lock "refresh_cache-ca1558cf-b235-4a20-8d12-45f1ca16fe41" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:48:01 user nova-compute[75176]: DEBUG nova.compute.manager [None req-6c8fc1fa-bf3f-4541-b1bb-11089717578a tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] [instance: ca1558cf-b235-4a20-8d12-45f1ca16fe41] Instance network_info: |[{"id": "2791b548-7207-402c-9f65-c078be714ef5", "address": "fa:16:3e:08:ec:9f", "network": {"id": "1f00fd98-3cd0-4c8c-912a-bc29124e1940", "bridge": "br-int", "label": "tempest-TestShelveInstance-1334429215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a8b3f118afd469f9c82ec2574586aaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2791b548-72", "ovs_interfaceid": "2791b548-7207-402c-9f65-c078be714ef5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75176) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 15:48:01 user nova-compute[75176]: DEBUG nova.network.neutron [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] [instance: 2e8507b7-fccf-4196-b589-bf2b74f165ec] Updating instance_info_cache with network_info: [{"id": "3dc67fc3-7fcf-4655-8dbd-22febf2be39e", "address": "fa:16:3e:04:68:53", "network": {"id": "8b63f2d3-0683-4832-abc5-e4c796cf12ab", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-877608435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3704b38a2bd44cb78c28d3f6d86d9e60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dc67fc3-7f", "ovs_interfaceid": "3dc67fc3-7fcf-4655-8dbd-22febf2be39e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:48:01 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Releasing lock "refresh_cache-2e8507b7-fccf-4196-b589-bf2b74f165ec" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:48:01 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] [instance: 2e8507b7-fccf-4196-b589-bf2b74f165ec] Updated the network info_cache for instance {{(pid=75176) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 15:48:01 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:48:01 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75176) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 15:48:01 user nova-compute[75176]: DEBUG nova.compute.manager [req-c36c80d2-6cd0-4d90-a5a4-e57afcc5951b req-9e109d98-5ab3-4637-acc7-8901d4c4f570 service nova] [instance: ca1558cf-b235-4a20-8d12-45f1ca16fe41] Received event network-changed-2791b548-7207-402c-9f65-c078be714ef5 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:48:01 user nova-compute[75176]: DEBUG nova.compute.manager [req-c36c80d2-6cd0-4d90-a5a4-e57afcc5951b req-9e109d98-5ab3-4637-acc7-8901d4c4f570 service nova] [instance: ca1558cf-b235-4a20-8d12-45f1ca16fe41] Refreshing instance network info cache due to event network-changed-2791b548-7207-402c-9f65-c078be714ef5. {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 15:48:01 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-c36c80d2-6cd0-4d90-a5a4-e57afcc5951b req-9e109d98-5ab3-4637-acc7-8901d4c4f570 service nova] Acquiring lock "refresh_cache-ca1558cf-b235-4a20-8d12-45f1ca16fe41" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:48:01 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-c36c80d2-6cd0-4d90-a5a4-e57afcc5951b req-9e109d98-5ab3-4637-acc7-8901d4c4f570 service nova] Acquired lock "refresh_cache-ca1558cf-b235-4a20-8d12-45f1ca16fe41" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:48:01 user nova-compute[75176]: DEBUG nova.network.neutron [req-c36c80d2-6cd0-4d90-a5a4-e57afcc5951b req-9e109d98-5ab3-4637-acc7-8901d4c4f570 service nova] [instance: ca1558cf-b235-4a20-8d12-45f1ca16fe41] Refreshing network info cache for port 2791b548-7207-402c-9f65-c078be714ef5 {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 15:48:02 user nova-compute[75176]: DEBUG nova.network.neutron [req-c36c80d2-6cd0-4d90-a5a4-e57afcc5951b req-9e109d98-5ab3-4637-acc7-8901d4c4f570 service nova] [instance: ca1558cf-b235-4a20-8d12-45f1ca16fe41] Updated VIF entry in instance network info cache for port 2791b548-7207-402c-9f65-c078be714ef5. {{(pid=75176) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 15:48:02 user nova-compute[75176]: DEBUG nova.network.neutron [req-c36c80d2-6cd0-4d90-a5a4-e57afcc5951b req-9e109d98-5ab3-4637-acc7-8901d4c4f570 service nova] [instance: ca1558cf-b235-4a20-8d12-45f1ca16fe41] Updating instance_info_cache with network_info: [{"id": "2791b548-7207-402c-9f65-c078be714ef5", "address": "fa:16:3e:08:ec:9f", "network": {"id": "1f00fd98-3cd0-4c8c-912a-bc29124e1940", "bridge": "br-int", "label": "tempest-TestShelveInstance-1334429215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a8b3f118afd469f9c82ec2574586aaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2791b548-72", "ovs_interfaceid": "2791b548-7207-402c-9f65-c078be714ef5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:48:02 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-c36c80d2-6cd0-4d90-a5a4-e57afcc5951b req-9e109d98-5ab3-4637-acc7-8901d4c4f570 service nova] Releasing lock "refresh_cache-ca1558cf-b235-4a20-8d12-45f1ca16fe41" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:48:03 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:48:03 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:48:06 user nova-compute[75176]: DEBUG nova.compute.manager [None req-6c8fc1fa-bf3f-4541-b1bb-11089717578a tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] [instance: ca1558cf-b235-4a20-8d12-45f1ca16fe41] Start spawning the instance on the hypervisor. {{(pid=75176) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 15:48:06 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-6c8fc1fa-bf3f-4541-b1bb-11089717578a tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] [instance: ca1558cf-b235-4a20-8d12-45f1ca16fe41] Creating instance directory {{(pid=75176) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 15:48:06 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-6c8fc1fa-bf3f-4541-b1bb-11089717578a tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] [instance: ca1558cf-b235-4a20-8d12-45f1ca16fe41] Creating image(s)
Nov 28 15:48:06 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-6c8fc1fa-bf3f-4541-b1bb-11089717578a tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] [instance: ca1558cf-b235-4a20-8d12-45f1ca16fe41] Did not create local disks {{(pid=75176) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 28 15:48:06 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-6c8fc1fa-bf3f-4541-b1bb-11089717578a tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] [instance: ca1558cf-b235-4a20-8d12-45f1ca16fe41] Ensure instance console log exists: /opt/stack/data/nova/instances/ca1558cf-b235-4a20-8d12-45f1ca16fe41/console.log {{(pid=75176) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 15:48:06 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-6c8fc1fa-bf3f-4541-b1bb-11089717578a tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:48:06 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-6c8fc1fa-bf3f-4541-b1bb-11089717578a tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:48:06 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-6c8fc1fa-bf3f-4541-b1bb-11089717578a tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:48:06 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-6c8fc1fa-bf3f-4541-b1bb-11089717578a tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] [instance: ca1558cf-b235-4a20-8d12-45f1ca16fe41] Start _get_guest_xml network_info=[{"id": "2791b548-7207-402c-9f65-c078be714ef5", "address": "fa:16:3e:08:ec:9f", "network": {"id": "1f00fd98-3cd0-4c8c-912a-bc29124e1940", "bridge": "br-int", "label": "tempest-TestShelveInstance-1334429215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a8b3f118afd469f9c82ec2574586aaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2791b548-72", "ovs_interfaceid": "2791b548-7207-402c-9f65-c078be714ef5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:22933c6e-3d8f-44f5-bc41-dee97c587055', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ujGDYdRg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ca1558cf-b235-4a20-8d12-45f1ca16fe41', 'attached_at': '', 'detached_at': '', 'volume_id': '22933c6e-3d8f-44f5-bc41-dee97c587055', 'serial': '22933c6e-3d8f-44f5-bc41-dee97c587055'}, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'delete_on_termination': True, 'mount_device': '/dev/vda', 'attachment_id': 'f3267f47-896f-494e-b8bb-955cd00be463', 'volume_type': None} {{(pid=75176) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 15:48:06 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-6c8fc1fa-bf3f-4541-b1bb-11089717578a tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 15:48:06 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-6c8fc1fa-bf3f-4541-b1bb-11089717578a tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 15:48:06 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-6c8fc1fa-bf3f-4541-b1bb-11089717578a tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75176) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 15:48:06 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-6c8fc1fa-bf3f-4541-b1bb-11089717578a tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] CPU controller missing on host. {{(pid=75176) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 15:48:06 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-6c8fc1fa-bf3f-4541-b1bb-11089717578a tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75176) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 15:48:06 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-6c8fc1fa-bf3f-4541-b1bb-11089717578a tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] CPU controller found on host. {{(pid=75176) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 15:48:06 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-6c8fc1fa-bf3f-4541-b1bb-11089717578a tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75176) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 15:48:06 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-6c8fc1fa-bf3f-4541-b1bb-11089717578a tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T15:35:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 15:48:06 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-6c8fc1fa-bf3f-4541-b1bb-11089717578a tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] Flavor limits 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 15:48:06 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-6c8fc1fa-bf3f-4541-b1bb-11089717578a tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] Image limits 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 15:48:06 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-6c8fc1fa-bf3f-4541-b1bb-11089717578a tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] Flavor pref 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 15:48:06 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-6c8fc1fa-bf3f-4541-b1bb-11089717578a tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] Image pref 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 15:48:06 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-6c8fc1fa-bf3f-4541-b1bb-11089717578a tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 15:48:06 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-6c8fc1fa-bf3f-4541-b1bb-11089717578a tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 15:48:06 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-6c8fc1fa-bf3f-4541-b1bb-11089717578a tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75176) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 15:48:06 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-6c8fc1fa-bf3f-4541-b1bb-11089717578a tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] Got 1 possible topologies {{(pid=75176) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 15:48:06 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-6c8fc1fa-bf3f-4541-b1bb-11089717578a tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 15:48:06 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-6c8fc1fa-bf3f-4541-b1bb-11089717578a tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 15:48:06 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6c8fc1fa-bf3f-4541-b1bb-11089717578a tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] [instance: ca1558cf-b235-4a20-8d12-45f1ca16fe41] Calling os-brick to attach iSCSI Volume {{(pid=75176) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 15:48:06 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c8fc1fa-bf3f-4541-b1bb-11089717578a tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c1b8a00>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:22933c6e-3d8f-44f5-bc41-dee97c587055', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ujGDYdRg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 15:48:06 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-6c8fc1fa-bf3f-4541-b1bb-11089717578a tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 15:48:06 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-6c8fc1fa-bf3f-4541-b1bb-11089717578a tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 15:48:06 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-6c8fc1fa-bf3f-4541-b1bb-11089717578a tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 15:48:06 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-6c8fc1fa-bf3f-4541-b1bb-11089717578a tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 15:48:06 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-6c8fc1fa-bf3f-4541-b1bb-11089717578a tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:22933c6e-3d8f-44f5-bc41-dee97c587055" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 15:48:06 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-6c8fc1fa-bf3f-4541-b1bb-11089717578a tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:22933c6e-3d8f-44f5-bc41-dee97c587055" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 15:48:06 user nova-compute[75176]: INFO os_brick.initiator.connectors.iscsi [None req-6c8fc1fa-bf3f-4541-b1bb-11089717578a tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 15:48:06 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22933c6e-3d8f-44f5-bc41-dee97c587055 -p 172.16.0.220:3260 {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:48:06 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22933c6e-3d8f-44f5-bc41-dee97c587055 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:48:06 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[c723523b-b8a0-4240-997e-ea80de049f1f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:48:06 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c8fc1fa-bf3f-4541-b1bb-11089717578a tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 15:48:06 user nova-compute[75176]:  {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:48:06 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22933c6e-3d8f-44f5-bc41-dee97c587055 -p 172.16.0.220:3260 --interface default --op new {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:48:06 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22933c6e-3d8f-44f5-bc41-dee97c587055 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:48:06 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[21ae509f-c509-46d0-800f-80400cc85a28]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:22933c6e-3d8f-44f5-bc41-dee97c587055] added\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:48:06 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c8fc1fa-bf3f-4541-b1bb-11089717578a tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:22933c6e-3d8f-44f5-bc41-dee97c587055] added
Nov 28 15:48:06 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:48:06 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22933c6e-3d8f-44f5-bc41-dee97c587055 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:48:06 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22933c6e-3d8f-44f5-bc41-dee97c587055 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:48:06 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[069a8739-055b-4ab3-b7cb-7ffec18e6436]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:48:06 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c8fc1fa-bf3f-4541-b1bb-11089717578a tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:48:06 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22933c6e-3d8f-44f5-bc41-dee97c587055 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:48:06 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22933c6e-3d8f-44f5-bc41-dee97c587055 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:48:06 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba035750-8d79-45f7-9ec8-40a70dd34fa4]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:48:06 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c8fc1fa-bf3f-4541-b1bb-11089717578a tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:48:06 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22933c6e-3d8f-44f5-bc41-dee97c587055 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ujGDYdRg {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:48:06 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22933c6e-3d8f-44f5-bc41-dee97c587055 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ujGDYdRg" returned: 0 in 0.018s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:48:06 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[6203b23c-964d-4fa0-bea6-46bc5ba2c885]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:48:06 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c8fc1fa-bf3f-4541-b1bb-11089717578a tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ujGDYdRg'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:48:06 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22933c6e-3d8f-44f5-bc41-dee97c587055 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:48:06 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22933c6e-3d8f-44f5-bc41-dee97c587055 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:48:06 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[d71beec0-8e46-4b48-93dc-6ed227edc65b]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:48:06 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c8fc1fa-bf3f-4541-b1bb-11089717578a tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:48:06 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:48:06 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:48:06 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[72f4180c-056a-4aee-8b0f-c2e605d0acb9]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24 (non-flash)\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:48:06 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c8fc1fa-bf3f-4541-b1bb-11089717578a tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24 (non-flash)
Nov 28 15:48:06 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:48:06 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c8fc1fa-bf3f-4541-b1bb-11089717578a tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24 (non-flash)
Nov 28 15:48:06 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 15:48:06 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22933c6e-3d8f-44f5-bc41-dee97c587055 -p 172.16.0.220:3260 --login {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:48:06 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:48:06 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22933c6e-3d8f-44f5-bc41-dee97c587055 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:48:06 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[69af3cbf-b256-4f8b-a7a2-9364b5b259f3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:22933c6e-3d8f-44f5-bc41-dee97c587055, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:22933c6e-3d8f-44f5-bc41-dee97c587055, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:48:06 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c8fc1fa-bf3f-4541-b1bb-11089717578a tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:22933c6e-3d8f-44f5-bc41-dee97c587055, portal: 172.16.0.220,3260]
Nov 28 15:48:06 user nova-compute[75176]: Login to [iface: default, target: iqn.2010-10.org.openstack:22933c6e-3d8f-44f5-bc41-dee97c587055, portal: 172.16.0.220,3260] successful.
Nov 28 15:48:06 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:48:06 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22933c6e-3d8f-44f5-bc41-dee97c587055 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:48:06 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22933c6e-3d8f-44f5-bc41-dee97c587055 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:48:06 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ff68dbc-9eb2-459a-b542-5052d726137e]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:48:06 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c8fc1fa-bf3f-4541-b1bb-11089717578a tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:48:06 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:48:06 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:48:06 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[be4a27e2-664a-40fc-b5c1-278e10995f75]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22933c6e-3d8f-44f5-bc41-dee97c587055 (non-flash)\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:48:06 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c8fc1fa-bf3f-4541-b1bb-11089717578a tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24 (non-flash)
Nov 28 15:48:06 user nova-compute[75176]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22933c6e-3d8f-44f5-bc41-dee97c587055 (non-flash)
Nov 28 15:48:06 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:48:06 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c8fc1fa-bf3f-4541-b1bb-11089717578a tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24 (non-flash)
Nov 28 15:48:06 user nova-compute[75176]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22933c6e-3d8f-44f5-bc41-dee97c587055 (non-flash)
Nov 28 15:48:06 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 15:48:06 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-6c8fc1fa-bf3f-4541-b1bb-11089717578a tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:22933c6e-3d8f-44f5-bc41-dee97c587055" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.282s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 15:48:06 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c8fc1fa-bf3f-4541-b1bb-11089717578a tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] Connected to 172.16.0.220:3260 {{(pid=75176) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 15:48:06 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-6c8fc1fa-bf3f-4541-b1bb-11089717578a tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] HCTL ('33', '-', '-', 0) found on session 30 with lun 0 {{(pid=75176) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 15:48:06 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-6c8fc1fa-bf3f-4541-b1bb-11089717578a tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75176) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 15:48:06 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:48:06 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.025s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:48:06 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f0b6ef7-0d38-493e-9c01-2407486be8b0]: (4, ('- - 0', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:48:06 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-6c8fc1fa-bf3f-4541-b1bb-11089717578a tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] Searching for a device in session 30 and hctl ['33', '*', '*', 0] yield: None {{(pid=75176) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 15:48:07 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-6c8fc1fa-bf3f-4541-b1bb-11089717578a tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] Searching for a device in session 30 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75176) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 15:48:07 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c8fc1fa-bf3f-4541-b1bb-11089717578a tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:22933c6e-3d8f-44f5-bc41-dee97c587055', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ujGDYdRg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75176) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 15:48:07 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-6c8fc1fa-bf3f-4541-b1bb-11089717578a tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.322s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 15:48:07 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c8fc1fa-bf3f-4541-b1bb-11089717578a tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] <== connect_volume: return (1323ms) {'type': 'block', 'scsi_wwn': '23366336565616637', 'path': '/dev/sdb'} {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 15:48:07 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6c8fc1fa-bf3f-4541-b1bb-11089717578a tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] [instance: ca1558cf-b235-4a20-8d12-45f1ca16fe41] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23366336565616637', 'path': '/dev/sdb'} {{(pid=75176) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 15:48:07 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-6c8fc1fa-bf3f-4541-b1bb-11089717578a tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T15:47:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1092777141',display_name='tempest-TestShelveInstance-server-1092777141',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1092777141',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPlWOjLW2NpfEDLiMEuh38MSf6V/+wJUiKnArs/gZG1j8jp3V+GFd/BW0+XH7hYqoFiR47yFKC6ZOU1dYUI6qcGVEhOBdCmxl100xpeAUerFPsLxDciq8AgBllG8Awa1CQ==',key_name='tempest-TestShelveInstance-2062365153',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7a8b3f118afd469f9c82ec2574586aaf',ramdisk_id='',reservation_id='r-0ue1lblf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-801353787',owner_user_name='tempest-TestShelveInstance-801353787-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T15:47:59Z,user_data=None,user_id='4753cf25a4c14e8aacd55309ff7e988d',uuid=ca1558cf-b235-4a20-8d12-45f1ca16fe41,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2791b548-7207-402c-9f65-c078be714ef5", "address": "fa:16:3e:08:ec:9f", "network": {"id": "1f00fd98-3cd0-4c8c-912a-bc29124e1940", "bridge": "br-int", "label": "tempest-TestShelveInstance-1334429215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a8b3f118afd469f9c82ec2574586aaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2791b548-72", "ovs_interfaceid": "2791b548-7207-402c-9f65-c078be714ef5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75176) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 15:48:07 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-6c8fc1fa-bf3f-4541-b1bb-11089717578a tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] Converting VIF {"id": "2791b548-7207-402c-9f65-c078be714ef5", "address": "fa:16:3e:08:ec:9f", "network": {"id": "1f00fd98-3cd0-4c8c-912a-bc29124e1940", "bridge": "br-int", "label": "tempest-TestShelveInstance-1334429215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a8b3f118afd469f9c82ec2574586aaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2791b548-72", "ovs_interfaceid": "2791b548-7207-402c-9f65-c078be714ef5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:48:07 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-6c8fc1fa-bf3f-4541-b1bb-11089717578a tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:ec:9f,bridge_name='br-int',has_traffic_filtering=True,id=2791b548-7207-402c-9f65-c078be714ef5,network=Network(1f00fd98-3cd0-4c8c-912a-bc29124e1940),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2791b548-72') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:48:07 user nova-compute[75176]: DEBUG nova.objects.instance [None req-6c8fc1fa-bf3f-4541-b1bb-11089717578a tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] Lazy-loading 'pci_devices' on Instance uuid ca1558cf-b235-4a20-8d12-45f1ca16fe41 {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:48:07 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-6c8fc1fa-bf3f-4541-b1bb-11089717578a tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] [instance: ca1558cf-b235-4a20-8d12-45f1ca16fe41] End _get_guest_xml xml=<domain type="kvm">
Nov 28 15:48:07 user nova-compute[75176]:   <uuid>ca1558cf-b235-4a20-8d12-45f1ca16fe41</uuid>
Nov 28 15:48:07 user nova-compute[75176]:   <name>instance-0000001a</name>
Nov 28 15:48:07 user nova-compute[75176]:   <memory>524288</memory>
Nov 28 15:48:07 user nova-compute[75176]:   <vcpu>1</vcpu>
Nov 28 15:48:07 user nova-compute[75176]:   <metadata>
Nov 28 15:48:07 user nova-compute[75176]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 15:48:07 user nova-compute[75176]:       <nova:package version="0.0.0"/>
Nov 28 15:48:07 user nova-compute[75176]:       <nova:name>tempest-TestShelveInstance-server-1092777141</nova:name>
Nov 28 15:48:07 user nova-compute[75176]:       <nova:creationTime>2023-11-28 15:48:06</nova:creationTime>
Nov 28 15:48:07 user nova-compute[75176]:       <nova:flavor name="m1.tiny">
Nov 28 15:48:07 user nova-compute[75176]:         <nova:memory>512</nova:memory>
Nov 28 15:48:07 user nova-compute[75176]:         <nova:disk>1</nova:disk>
Nov 28 15:48:07 user nova-compute[75176]:         <nova:swap>0</nova:swap>
Nov 28 15:48:07 user nova-compute[75176]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 15:48:07 user nova-compute[75176]:         <nova:vcpus>1</nova:vcpus>
Nov 28 15:48:07 user nova-compute[75176]:       </nova:flavor>
Nov 28 15:48:07 user nova-compute[75176]:       <nova:owner>
Nov 28 15:48:07 user nova-compute[75176]:         <nova:user uuid="4753cf25a4c14e8aacd55309ff7e988d">tempest-TestShelveInstance-801353787-project-member</nova:user>
Nov 28 15:48:07 user nova-compute[75176]:         <nova:project uuid="7a8b3f118afd469f9c82ec2574586aaf">tempest-TestShelveInstance-801353787</nova:project>
Nov 28 15:48:07 user nova-compute[75176]:       </nova:owner>
Nov 28 15:48:07 user nova-compute[75176]:       <nova:ports>
Nov 28 15:48:07 user nova-compute[75176]:         <nova:port uuid="2791b548-7207-402c-9f65-c078be714ef5">
Nov 28 15:48:07 user nova-compute[75176]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 28 15:48:07 user nova-compute[75176]:         </nova:port>
Nov 28 15:48:07 user nova-compute[75176]:       </nova:ports>
Nov 28 15:48:07 user nova-compute[75176]:     </nova:instance>
Nov 28 15:48:07 user nova-compute[75176]:   </metadata>
Nov 28 15:48:07 user nova-compute[75176]:   <sysinfo type="smbios">
Nov 28 15:48:07 user nova-compute[75176]:     <system>
Nov 28 15:48:07 user nova-compute[75176]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 15:48:07 user nova-compute[75176]:       <entry name="product">OpenStack Nova</entry>
Nov 28 15:48:07 user nova-compute[75176]:       <entry name="version">0.0.0</entry>
Nov 28 15:48:07 user nova-compute[75176]:       <entry name="serial">ca1558cf-b235-4a20-8d12-45f1ca16fe41</entry>
Nov 28 15:48:07 user nova-compute[75176]:       <entry name="uuid">ca1558cf-b235-4a20-8d12-45f1ca16fe41</entry>
Nov 28 15:48:07 user nova-compute[75176]:       <entry name="family">Virtual Machine</entry>
Nov 28 15:48:07 user nova-compute[75176]:     </system>
Nov 28 15:48:07 user nova-compute[75176]:   </sysinfo>
Nov 28 15:48:07 user nova-compute[75176]:   <os>
Nov 28 15:48:07 user nova-compute[75176]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 15:48:07 user nova-compute[75176]:     <boot dev="hd"/>
Nov 28 15:48:07 user nova-compute[75176]:     <smbios mode="sysinfo"/>
Nov 28 15:48:07 user nova-compute[75176]:   </os>
Nov 28 15:48:07 user nova-compute[75176]:   <features>
Nov 28 15:48:07 user nova-compute[75176]:     <acpi/>
Nov 28 15:48:07 user nova-compute[75176]:     <apic/>
Nov 28 15:48:07 user nova-compute[75176]:     <vmcoreinfo/>
Nov 28 15:48:07 user nova-compute[75176]:   </features>
Nov 28 15:48:07 user nova-compute[75176]:   <clock offset="utc">
Nov 28 15:48:07 user nova-compute[75176]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 15:48:07 user nova-compute[75176]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 15:48:07 user nova-compute[75176]:     <timer name="hpet" present="no"/>
Nov 28 15:48:07 user nova-compute[75176]:   </clock>
Nov 28 15:48:07 user nova-compute[75176]:   <cpu mode="custom" match="exact">
Nov 28 15:48:07 user nova-compute[75176]:     <model>Nehalem</model>
Nov 28 15:48:07 user nova-compute[75176]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 15:48:07 user nova-compute[75176]:   </cpu>
Nov 28 15:48:07 user nova-compute[75176]:   <devices>
Nov 28 15:48:07 user nova-compute[75176]:     <disk type="block" device="disk">
Nov 28 15:48:07 user nova-compute[75176]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 15:48:07 user nova-compute[75176]:       <source dev="/dev/sdb"/>
Nov 28 15:48:07 user nova-compute[75176]:       <target dev="vda" bus="virtio"/>
Nov 28 15:48:07 user nova-compute[75176]:       <serial>22933c6e-3d8f-44f5-bc41-dee97c587055</serial>
Nov 28 15:48:07 user nova-compute[75176]:     </disk>
Nov 28 15:48:07 user nova-compute[75176]:     <interface type="ethernet">
Nov 28 15:48:07 user nova-compute[75176]:       <mac address="fa:16:3e:08:ec:9f"/>
Nov 28 15:48:07 user nova-compute[75176]:       <model type="virtio"/>
Nov 28 15:48:07 user nova-compute[75176]:       <mtu size="1442"/>
Nov 28 15:48:07 user nova-compute[75176]:       <target dev="tap2791b548-72"/>
Nov 28 15:48:07 user nova-compute[75176]:     </interface>
Nov 28 15:48:07 user nova-compute[75176]:     <serial type="pty">
Nov 28 15:48:07 user nova-compute[75176]:       <log file="/opt/stack/data/nova/instances/ca1558cf-b235-4a20-8d12-45f1ca16fe41/console.log" append="off"/>
Nov 28 15:48:07 user nova-compute[75176]:     </serial>
Nov 28 15:48:07 user nova-compute[75176]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 15:48:07 user nova-compute[75176]:     <video>
Nov 28 15:48:07 user nova-compute[75176]:       <model type="virtio"/>
Nov 28 15:48:07 user nova-compute[75176]:     </video>
Nov 28 15:48:07 user nova-compute[75176]:     <rng model="virtio">
Nov 28 15:48:07 user nova-compute[75176]:       <backend model="random">/dev/urandom</backend>
Nov 28 15:48:07 user nova-compute[75176]:     </rng>
Nov 28 15:48:07 user nova-compute[75176]:     <controller type="usb" index="0" model="none"/>
Nov 28 15:48:07 user nova-compute[75176]:     <memballoon model="virtio">
Nov 28 15:48:07 user nova-compute[75176]:       <stats period="10"/>
Nov 28 15:48:07 user nova-compute[75176]:     </memballoon>
Nov 28 15:48:07 user nova-compute[75176]:   </devices>
Nov 28 15:48:07 user nova-compute[75176]: </domain>
Nov 28 15:48:07 user nova-compute[75176]:  {{(pid=75176) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 15:48:07 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-6c8fc1fa-bf3f-4541-b1bb-11089717578a tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T15:47:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1092777141',display_name='tempest-TestShelveInstance-server-1092777141',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1092777141',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPlWOjLW2NpfEDLiMEuh38MSf6V/+wJUiKnArs/gZG1j8jp3V+GFd/BW0+XH7hYqoFiR47yFKC6ZOU1dYUI6qcGVEhOBdCmxl100xpeAUerFPsLxDciq8AgBllG8Awa1CQ==',key_name='tempest-TestShelveInstance-2062365153',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7a8b3f118afd469f9c82ec2574586aaf',ramdisk_id='',reservation_id='r-0ue1lblf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-801353787',owner_user_name='tempest-TestShelveInstance-801353787-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T15:47:59Z,user_data=None,user_id='4753cf25a4c14e8aacd55309ff7e988d',uuid=ca1558cf-b235-4a20-8d12-45f1ca16fe41,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2791b548-7207-402c-9f65-c078be714ef5", "address": "fa:16:3e:08:ec:9f", "network": {"id": "1f00fd98-3cd0-4c8c-912a-bc29124e1940", "bridge": "br-int", "label": "tempest-TestShelveInstance-1334429215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a8b3f118afd469f9c82ec2574586aaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2791b548-72", "ovs_interfaceid": "2791b548-7207-402c-9f65-c078be714ef5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 15:48:07 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-6c8fc1fa-bf3f-4541-b1bb-11089717578a tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] Converting VIF {"id": "2791b548-7207-402c-9f65-c078be714ef5", "address": "fa:16:3e:08:ec:9f", "network": {"id": "1f00fd98-3cd0-4c8c-912a-bc29124e1940", "bridge": "br-int", "label": "tempest-TestShelveInstance-1334429215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a8b3f118afd469f9c82ec2574586aaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2791b548-72", "ovs_interfaceid": "2791b548-7207-402c-9f65-c078be714ef5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:48:07 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-6c8fc1fa-bf3f-4541-b1bb-11089717578a tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:ec:9f,bridge_name='br-int',has_traffic_filtering=True,id=2791b548-7207-402c-9f65-c078be714ef5,network=Network(1f00fd98-3cd0-4c8c-912a-bc29124e1940),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2791b548-72') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:48:07 user nova-compute[75176]: DEBUG os_vif [None req-6c8fc1fa-bf3f-4541-b1bb-11089717578a tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:ec:9f,bridge_name='br-int',has_traffic_filtering=True,id=2791b548-7207-402c-9f65-c078be714ef5,network=Network(1f00fd98-3cd0-4c8c-912a-bc29124e1940),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2791b548-72') {{(pid=75176) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 15:48:07 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:48:07 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:48:07 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 15:48:07 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:48:07 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6845c186-3373-5c94-93fd-d4b7aef5e53e', '_type': 'linux-noop'}}, row=False) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:48:07 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:48:07 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:48:07 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:48:07 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2791b548-72, may_exist=True, interface_attrs={}) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:48:07 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2791b548-72, col_values=(('qos', UUID('b3e2b417-fdd0-445b-8522-9b458b0a2e0c')),), if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:48:07 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2791b548-72, col_values=(('external_ids', {'iface-id': '2791b548-7207-402c-9f65-c078be714ef5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:08:ec:9f', 'vm-uuid': 'ca1558cf-b235-4a20-8d12-45f1ca16fe41'}),), if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:48:07 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:48:07 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:48:07 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:48:07 user nova-compute[75176]: INFO os_vif [None req-6c8fc1fa-bf3f-4541-b1bb-11089717578a tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:ec:9f,bridge_name='br-int',has_traffic_filtering=True,id=2791b548-7207-402c-9f65-c078be714ef5,network=Network(1f00fd98-3cd0-4c8c-912a-bc29124e1940),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2791b548-72')
Nov 28 15:48:07 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-6c8fc1fa-bf3f-4541-b1bb-11089717578a tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] No BDM found with device name vda, not building metadata. {{(pid=75176) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 15:48:07 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-6c8fc1fa-bf3f-4541-b1bb-11089717578a tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] No VIF found with MAC fa:16:3e:08:ec:9f, not building metadata {{(pid=75176) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 15:48:09 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:48:09 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:48:09 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:48:09 user nova-compute[75176]: DEBUG nova.compute.manager [req-f8c349e0-dd45-4924-aed2-32ca756aaa80 req-da737b52-396a-4ad7-bd6e-0f8c44fb2f5d service nova] [instance: ca1558cf-b235-4a20-8d12-45f1ca16fe41] Received event network-vif-plugged-2791b548-7207-402c-9f65-c078be714ef5 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:48:09 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-f8c349e0-dd45-4924-aed2-32ca756aaa80 req-da737b52-396a-4ad7-bd6e-0f8c44fb2f5d service nova] Acquiring lock "ca1558cf-b235-4a20-8d12-45f1ca16fe41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:48:09 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-f8c349e0-dd45-4924-aed2-32ca756aaa80 req-da737b52-396a-4ad7-bd6e-0f8c44fb2f5d service nova] Lock "ca1558cf-b235-4a20-8d12-45f1ca16fe41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:48:09 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-f8c349e0-dd45-4924-aed2-32ca756aaa80 req-da737b52-396a-4ad7-bd6e-0f8c44fb2f5d service nova] Lock "ca1558cf-b235-4a20-8d12-45f1ca16fe41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:48:09 user nova-compute[75176]: DEBUG nova.compute.manager [req-f8c349e0-dd45-4924-aed2-32ca756aaa80 req-da737b52-396a-4ad7-bd6e-0f8c44fb2f5d service nova] [instance: ca1558cf-b235-4a20-8d12-45f1ca16fe41] No waiting events found dispatching network-vif-plugged-2791b548-7207-402c-9f65-c078be714ef5 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:48:09 user nova-compute[75176]: WARNING nova.compute.manager [req-f8c349e0-dd45-4924-aed2-32ca756aaa80 req-da737b52-396a-4ad7-bd6e-0f8c44fb2f5d service nova] [instance: ca1558cf-b235-4a20-8d12-45f1ca16fe41] Received unexpected event network-vif-plugged-2791b548-7207-402c-9f65-c078be714ef5 for instance with vm_state building and task_state spawning.
Nov 28 15:48:09 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:48:09 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:48:09 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:48:09 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:48:10 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-caa6b324-00c6-4f08-9524-c18712376588 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance e02d1e69-5e74-43c3-8546-6044d31145f2 is timed out.
Nov 28 15:48:10 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-caa6b324-00c6-4f08-9524-c18712376588 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Successfully detached device vdb from instance e02d1e69-5e74-43c3-8546-6044d31145f2 from the live domain config.
Nov 28 15:48:10 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-caa6b324-00c6-4f08-9524-c18712376588 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] [instance: e02d1e69-5e74-43c3-8546-6044d31145f2] calling os-brick to detach iSCSI Volume {{(pid=75176) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 15:48:10 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-caa6b324-00c6-4f08-9524-c18712376588 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c1b8a00>, {'target_iqn': 'iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'grxAmRcs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 15:48:10 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-caa6b324-00c6-4f08-9524-c18712376588 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 15:48:10 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-caa6b324-00c6-4f08-9524-c18712376588 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 15:48:10 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-caa6b324-00c6-4f08-9524-c18712376588 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 15:48:10 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:48:10 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:48:10 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[1101623c-d739-4b3e-b0af-440d1368680d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:22933c6e-3d8f-44f5-bc41-dee97c587055\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:48:10 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-caa6b324-00c6-4f08-9524-c18712376588 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 15:48:10 user nova-compute[75176]: No targets found.
Nov 28 15:48:10 user nova-compute[75176]: iSNS:
Nov 28 15:48:10 user nova-compute[75176]: No targets found.
Nov 28 15:48:10 user nova-compute[75176]: STATIC:
Nov 28 15:48:10 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24
Nov 28 15:48:10 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:48:10 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:48:10 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:22933c6e-3d8f-44f5-bc41-dee97c587055
Nov 28 15:48:10 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:48:10 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:48:10 user nova-compute[75176]: FIRMWARE:
Nov 28 15:48:10 user nova-compute[75176]: No targets found.
Nov 28 15:48:10 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:48:10 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-caa6b324-00c6-4f08-9524-c18712376588 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 15:48:10 user nova-compute[75176]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 15:48:10 user nova-compute[75176]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75176) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 15:48:10 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-caa6b324-00c6-4f08-9524-c18712376588 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24', 0)] {{(pid=75176) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 15:48:10 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:48:10 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:48:10 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bde2cef-a32b-4331-83f2-890751b9e88c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:22933c6e-3d8f-44f5-bc41-dee97c587055\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:48:10 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:48:10 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:48:10 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[f02090ee-7e9e-4dca-92cd-8d48e1792775]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22933c6e-3d8f-44f5-bc41-dee97c587055 (non-flash)\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:48:10 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-caa6b324-00c6-4f08-9524-c18712376588 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24 (non-flash)
Nov 28 15:48:10 user nova-compute[75176]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22933c6e-3d8f-44f5-bc41-dee97c587055 (non-flash)
Nov 28 15:48:10 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:48:10 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-caa6b324-00c6-4f08-9524-c18712376588 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24 (non-flash)
Nov 28 15:48:10 user nova-compute[75176]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22933c6e-3d8f-44f5-bc41-dee97c587055 (non-flash)
Nov 28 15:48:10 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 15:48:10 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-caa6b324-00c6-4f08-9524-c18712376588 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f462c55c430>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24'): ({'sde'}, set())}) {{(pid=75176) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 15:48:10 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-caa6b324-00c6-4f08-9524-c18712376588 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Removing single pathed devices sde {{(pid=75176) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 15:48:10 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:48:10 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:48:10 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[c407363c-5042-47b7-8439-9bf6b97a727d]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:48:10 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:48:10 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:48:10 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[b916a196-b3d9-47f4-b142-76744f66f386]: (4, ('ok\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:48:10 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-caa6b324-00c6-4f08-9524-c18712376588 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Flushing IO for device /dev/sde {{(pid=75176) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 15:48:10 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:48:10 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:48:10 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdef047a-910f-4607-9772-77d0ff95b598]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:48:10 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-caa6b324-00c6-4f08-9524-c18712376588 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75176) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 15:48:10 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:48:10 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.053s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:48:10 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccb23f5c-96a4-4751-a4be-9d51112e836d]: (4, ('1', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:48:10 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-caa6b324-00c6-4f08-9524-c18712376588 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75176) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 15:48:10 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-caa6b324-00c6-4f08-9524-c18712376588 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] SCSI volumes sde have been removed. {{(pid=75176) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 15:48:10 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-caa6b324-00c6-4f08-9524-c18712376588 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24')] {{(pid=75176) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 15:48:10 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:48:10 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:48:10 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[56d940b9-bbe2-454c-b20a-41b7db326ac4]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:48:10 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-caa6b324-00c6-4f08-9524-c18712376588 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:48:10 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24 -p 172.16.0.220:3260 --logout {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:48:10 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:48:10 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[560c058f-9a04-4876-8e3b-a9ea65d06382]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:48:10 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-caa6b324-00c6-4f08-9524-c18712376588 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24, portal: 172.16.0.220,3260]
Nov 28 15:48:10 user nova-compute[75176]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24, portal: 172.16.0.220,3260] successful.
Nov 28 15:48:10 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:48:10 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24 -p 172.16.0.220:3260 --op delete {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:48:10 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b424d718-a756-4599-a969-530c2d3c3c24 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:48:10 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7e8da88-a1be-46e8-8bd9-4a526e969f6d]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:48:10 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-caa6b324-00c6-4f08-9524-c18712376588 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:48:10 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-caa6b324-00c6-4f08-9524-c18712376588 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.325s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 15:48:10 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-caa6b324-00c6-4f08-9524-c18712376588 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] <== disconnect_volume: return (326ms) None {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 15:48:10 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-caa6b324-00c6-4f08-9524-c18712376588 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] [instance: e02d1e69-5e74-43c3-8546-6044d31145f2] Disconnected iSCSI Volume {{(pid=75176) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 15:48:11 user nova-compute[75176]: DEBUG nova.compute.manager [None req-6c8fc1fa-bf3f-4541-b1bb-11089717578a tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] [instance: ca1558cf-b235-4a20-8d12-45f1ca16fe41] Instance event wait completed in 0 seconds for  {{(pid=75176) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 15:48:11 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-6c8fc1fa-bf3f-4541-b1bb-11089717578a tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] [instance: ca1558cf-b235-4a20-8d12-45f1ca16fe41] Guest created on hypervisor {{(pid=75176) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 15:48:11 user nova-compute[75176]: INFO nova.virt.libvirt.driver [-] [instance: ca1558cf-b235-4a20-8d12-45f1ca16fe41] Instance spawned successfully.
Nov 28 15:48:11 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-6c8fc1fa-bf3f-4541-b1bb-11089717578a tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] [instance: ca1558cf-b235-4a20-8d12-45f1ca16fe41] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 15:48:11 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-6c8fc1fa-bf3f-4541-b1bb-11089717578a tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] [instance: ca1558cf-b235-4a20-8d12-45f1ca16fe41] Found default for hw_cdrom_bus of ide {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:48:11 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-6c8fc1fa-bf3f-4541-b1bb-11089717578a tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] [instance: ca1558cf-b235-4a20-8d12-45f1ca16fe41] Found default for hw_disk_bus of virtio {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:48:11 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-6c8fc1fa-bf3f-4541-b1bb-11089717578a tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] [instance: ca1558cf-b235-4a20-8d12-45f1ca16fe41] Found default for hw_input_bus of None {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:48:11 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-6c8fc1fa-bf3f-4541-b1bb-11089717578a tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] [instance: ca1558cf-b235-4a20-8d12-45f1ca16fe41] Found default for hw_pointer_model of None {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:48:11 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-6c8fc1fa-bf3f-4541-b1bb-11089717578a tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] [instance: ca1558cf-b235-4a20-8d12-45f1ca16fe41] Found default for hw_video_model of virtio {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:48:11 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-6c8fc1fa-bf3f-4541-b1bb-11089717578a tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] [instance: ca1558cf-b235-4a20-8d12-45f1ca16fe41] Found default for hw_vif_model of virtio {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:48:11 user nova-compute[75176]: DEBUG nova.compute.manager [req-6f4f9c84-6a8b-43f0-ba3e-094547abf859 req-b0377c43-5f3d-4ea8-9b61-72b15bac1b39 service nova] [instance: ca1558cf-b235-4a20-8d12-45f1ca16fe41] Received event network-vif-plugged-2791b548-7207-402c-9f65-c078be714ef5 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:48:11 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-6f4f9c84-6a8b-43f0-ba3e-094547abf859 req-b0377c43-5f3d-4ea8-9b61-72b15bac1b39 service nova] Acquiring lock "ca1558cf-b235-4a20-8d12-45f1ca16fe41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:48:11 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-6f4f9c84-6a8b-43f0-ba3e-094547abf859 req-b0377c43-5f3d-4ea8-9b61-72b15bac1b39 service nova] Lock "ca1558cf-b235-4a20-8d12-45f1ca16fe41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:48:11 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-6f4f9c84-6a8b-43f0-ba3e-094547abf859 req-b0377c43-5f3d-4ea8-9b61-72b15bac1b39 service nova] Lock "ca1558cf-b235-4a20-8d12-45f1ca16fe41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:48:11 user nova-compute[75176]: DEBUG nova.compute.manager [req-6f4f9c84-6a8b-43f0-ba3e-094547abf859 req-b0377c43-5f3d-4ea8-9b61-72b15bac1b39 service nova] [instance: ca1558cf-b235-4a20-8d12-45f1ca16fe41] No waiting events found dispatching network-vif-plugged-2791b548-7207-402c-9f65-c078be714ef5 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:48:11 user nova-compute[75176]: WARNING nova.compute.manager [req-6f4f9c84-6a8b-43f0-ba3e-094547abf859 req-b0377c43-5f3d-4ea8-9b61-72b15bac1b39 service nova] [instance: ca1558cf-b235-4a20-8d12-45f1ca16fe41] Received unexpected event network-vif-plugged-2791b548-7207-402c-9f65-c078be714ef5 for instance with vm_state building and task_state spawning.
Nov 28 15:48:11 user nova-compute[75176]: INFO nova.compute.manager [None req-6c8fc1fa-bf3f-4541-b1bb-11089717578a tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] [instance: ca1558cf-b235-4a20-8d12-45f1ca16fe41] Took 5.04 seconds to spawn the instance on the hypervisor.
Nov 28 15:48:11 user nova-compute[75176]: DEBUG nova.compute.manager [None req-6c8fc1fa-bf3f-4541-b1bb-11089717578a tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] [instance: ca1558cf-b235-4a20-8d12-45f1ca16fe41] Checking state {{(pid=75176) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 15:48:11 user nova-compute[75176]: DEBUG nova.objects.instance [None req-caa6b324-00c6-4f08-9524-c18712376588 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Lazy-loading 'flavor' on Instance uuid e02d1e69-5e74-43c3-8546-6044d31145f2 {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:48:11 user nova-compute[75176]: INFO nova.compute.manager [None req-6c8fc1fa-bf3f-4541-b1bb-11089717578a tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] [instance: ca1558cf-b235-4a20-8d12-45f1ca16fe41] Took 13.34 seconds to build instance.
Nov 28 15:48:11 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-6c8fc1fa-bf3f-4541-b1bb-11089717578a tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] Lock "ca1558cf-b235-4a20-8d12-45f1ca16fe41" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.451s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:48:11 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-caa6b324-00c6-4f08-9524-c18712376588 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Lock "e02d1e69-5e74-43c3-8546-6044d31145f2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.786s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:48:12 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:48:13 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-4f979ef0-f481-4a35-ba16-8c9546dc8634 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Acquiring lock "42579ef7-54dc-4165-a144-61e80fdd5626" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:48:13 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-4f979ef0-f481-4a35-ba16-8c9546dc8634 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Lock "42579ef7-54dc-4165-a144-61e80fdd5626" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:48:13 user nova-compute[75176]: DEBUG nova.compute.manager [None req-4f979ef0-f481-4a35-ba16-8c9546dc8634 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: 42579ef7-54dc-4165-a144-61e80fdd5626] Starting instance... {{(pid=75176) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 15:48:13 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:48:14 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-4f979ef0-f481-4a35-ba16-8c9546dc8634 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:48:14 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-4f979ef0-f481-4a35-ba16-8c9546dc8634 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:48:14 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-4f979ef0-f481-4a35-ba16-8c9546dc8634 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75176) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 15:48:14 user nova-compute[75176]: INFO nova.compute.claims [None req-4f979ef0-f481-4a35-ba16-8c9546dc8634 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: 42579ef7-54dc-4165-a144-61e80fdd5626] Claim successful on node user
Nov 28 15:48:14 user nova-compute[75176]: DEBUG nova.compute.provider_tree [None req-4f979ef0-f481-4a35-ba16-8c9546dc8634 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Inventory has not changed in ProviderTree for provider: b37848d8-f401-4155-a029-b0ffa09ff85b {{(pid=75176) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 15:48:14 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-4f979ef0-f481-4a35-ba16-8c9546dc8634 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Inventory has not changed for provider b37848d8-f401-4155-a029-b0ffa09ff85b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75176) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 15:48:14 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-4f979ef0-f481-4a35-ba16-8c9546dc8634 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.366s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:48:14 user nova-compute[75176]: DEBUG nova.compute.manager [None req-4f979ef0-f481-4a35-ba16-8c9546dc8634 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: 42579ef7-54dc-4165-a144-61e80fdd5626] Start building networks asynchronously for instance. {{(pid=75176) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 15:48:14 user nova-compute[75176]: DEBUG nova.compute.manager [None req-4f979ef0-f481-4a35-ba16-8c9546dc8634 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: 42579ef7-54dc-4165-a144-61e80fdd5626] Allocating IP information in the background. {{(pid=75176) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 15:48:14 user nova-compute[75176]: DEBUG nova.network.neutron [None req-4f979ef0-f481-4a35-ba16-8c9546dc8634 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: 42579ef7-54dc-4165-a144-61e80fdd5626] allocate_for_instance() {{(pid=75176) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 15:48:14 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-4f979ef0-f481-4a35-ba16-8c9546dc8634 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: 42579ef7-54dc-4165-a144-61e80fdd5626] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 15:48:14 user nova-compute[75176]: DEBUG nova.compute.manager [None req-4f979ef0-f481-4a35-ba16-8c9546dc8634 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: 42579ef7-54dc-4165-a144-61e80fdd5626] Start building block device mappings for instance. {{(pid=75176) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 15:48:14 user nova-compute[75176]: INFO nova.virt.block_device [None req-4f979ef0-f481-4a35-ba16-8c9546dc8634 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: 42579ef7-54dc-4165-a144-61e80fdd5626] Booting with volume 8452525c-6845-4edb-bf69-1e2ffe0ef2eb at /dev/vda
Nov 28 15:48:14 user nova-compute[75176]: DEBUG nova.policy [None req-4f979ef0-f481-4a35-ba16-8c9546dc8634 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '081bf84d24194b81be4e0a6638db9b66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c7783cc16049208421204910982c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75176) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 15:48:14 user nova-compute[75176]: DEBUG os_brick.utils [None req-4f979ef0-f481-4a35-ba16-8c9546dc8634 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 15:48:14 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:48:14 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:48:14 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f60c0d8-675d-450f-8fd0-14eb8fd43827]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:edc924a949b2\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:48:14 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:48:14 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:48:14 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c2f28a9-3ed3-4590-a279-4875e61a9684]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:48:14 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:48:14 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:48:14 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9a26b77-1af6-49d3-8ca8-97b423c0cf30]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:48:14 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[691a0520-c1b0-4212-858c-574a7734e986]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:48:14 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-4f979ef0-f481-4a35-ba16-8c9546dc8634 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Running cmd (subprocess): nvme version {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:48:14 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-4f979ef0-f481-4a35-ba16-8c9546dc8634 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] 'nvme version' failed. Not Retrying. {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 15:48:14 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4f979ef0-f481-4a35-ba16-8c9546dc8634 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] nvme not present on system {{(pid=75176) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 15:48:14 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:48:14 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 15:48:14 user nova-compute[75176]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 15:48:14 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[219233f5-aa88-462e-ac32-d303f0c94c6e]: (4, '') {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:48:14 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.lightos [None req-4f979ef0-f481-4a35-ba16-8c9546dc8634 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75176) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 15:48:14 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.lightos [None req-4f979ef0-f481-4a35-ba16-8c9546dc8634 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75176) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 15:48:14 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.lightos [None req-4f979ef0-f481-4a35-ba16-8c9546dc8634 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] LIGHTOS: no hostnqn found. {{(pid=75176) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 15:48:14 user nova-compute[75176]: DEBUG os_brick.utils [None req-4f979ef0-f481-4a35-ba16-8c9546dc8634 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:edc924a949b2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 15:48:14 user nova-compute[75176]: DEBUG nova.virt.block_device [None req-4f979ef0-f481-4a35-ba16-8c9546dc8634 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: 42579ef7-54dc-4165-a144-61e80fdd5626] Updating existing volume attachment record: 81757ee6-718d-4094-b113-989446133759 {{(pid=75176) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 15:48:16 user nova-compute[75176]: DEBUG nova.compute.manager [req-6f39f079-9d56-4b9e-b6ed-6ccfb2918855 req-faaa0067-8563-4842-88e4-52683326cc73 service nova] [instance: 0e465c9f-e8ab-4a28-bf74-2936a272a0e2] Received event network-changed-86effed2-558e-4427-82be-761ca28e6d8c {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:48:16 user nova-compute[75176]: DEBUG nova.compute.manager [req-6f39f079-9d56-4b9e-b6ed-6ccfb2918855 req-faaa0067-8563-4842-88e4-52683326cc73 service nova] [instance: 0e465c9f-e8ab-4a28-bf74-2936a272a0e2] Refreshing instance network info cache due to event network-changed-86effed2-558e-4427-82be-761ca28e6d8c. {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 15:48:16 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-6f39f079-9d56-4b9e-b6ed-6ccfb2918855 req-faaa0067-8563-4842-88e4-52683326cc73 service nova] Acquiring lock "refresh_cache-0e465c9f-e8ab-4a28-bf74-2936a272a0e2" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:48:16 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-6f39f079-9d56-4b9e-b6ed-6ccfb2918855 req-faaa0067-8563-4842-88e4-52683326cc73 service nova] Acquired lock "refresh_cache-0e465c9f-e8ab-4a28-bf74-2936a272a0e2" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:48:16 user nova-compute[75176]: DEBUG nova.network.neutron [req-6f39f079-9d56-4b9e-b6ed-6ccfb2918855 req-faaa0067-8563-4842-88e4-52683326cc73 service nova] [instance: 0e465c9f-e8ab-4a28-bf74-2936a272a0e2] Refreshing network info cache for port 86effed2-558e-4427-82be-761ca28e6d8c {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 15:48:16 user nova-compute[75176]: DEBUG nova.network.neutron [None req-4f979ef0-f481-4a35-ba16-8c9546dc8634 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: 42579ef7-54dc-4165-a144-61e80fdd5626] Successfully created port: c60779ce-eea1-4d7d-9195-4c1c4921a5fb {{(pid=75176) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 15:48:16 user nova-compute[75176]: DEBUG nova.network.neutron [req-6f39f079-9d56-4b9e-b6ed-6ccfb2918855 req-faaa0067-8563-4842-88e4-52683326cc73 service nova] [instance: 0e465c9f-e8ab-4a28-bf74-2936a272a0e2] Updated VIF entry in instance network info cache for port 86effed2-558e-4427-82be-761ca28e6d8c. {{(pid=75176) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 15:48:16 user nova-compute[75176]: DEBUG nova.network.neutron [req-6f39f079-9d56-4b9e-b6ed-6ccfb2918855 req-faaa0067-8563-4842-88e4-52683326cc73 service nova] [instance: 0e465c9f-e8ab-4a28-bf74-2936a272a0e2] Updating instance_info_cache with network_info: [{"id": "86effed2-558e-4427-82be-761ca28e6d8c", "address": "fa:16:3e:95:66:57", "network": {"id": "5d0ae041-a67d-4a54-bd53-104c4f44209d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-938551772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "169fdaea89d4431aa6adacdbb76f3546", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86effed2-55", "ovs_interfaceid": "86effed2-558e-4427-82be-761ca28e6d8c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:48:16 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-6f39f079-9d56-4b9e-b6ed-6ccfb2918855 req-faaa0067-8563-4842-88e4-52683326cc73 service nova] Releasing lock "refresh_cache-0e465c9f-e8ab-4a28-bf74-2936a272a0e2" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:48:17 user nova-compute[75176]: DEBUG nova.network.neutron [None req-4f979ef0-f481-4a35-ba16-8c9546dc8634 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: 42579ef7-54dc-4165-a144-61e80fdd5626] Successfully updated port: c60779ce-eea1-4d7d-9195-4c1c4921a5fb {{(pid=75176) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 15:48:17 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-4f979ef0-f481-4a35-ba16-8c9546dc8634 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Acquiring lock "refresh_cache-42579ef7-54dc-4165-a144-61e80fdd5626" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:48:17 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-4f979ef0-f481-4a35-ba16-8c9546dc8634 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Acquired lock "refresh_cache-42579ef7-54dc-4165-a144-61e80fdd5626" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:48:17 user nova-compute[75176]: DEBUG nova.network.neutron [None req-4f979ef0-f481-4a35-ba16-8c9546dc8634 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: 42579ef7-54dc-4165-a144-61e80fdd5626] Building network info cache for instance {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 15:48:17 user nova-compute[75176]: DEBUG nova.network.neutron [None req-4f979ef0-f481-4a35-ba16-8c9546dc8634 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: 42579ef7-54dc-4165-a144-61e80fdd5626] Instance cache missing network info. {{(pid=75176) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 15:48:17 user nova-compute[75176]: DEBUG nova.network.neutron [None req-4f979ef0-f481-4a35-ba16-8c9546dc8634 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: 42579ef7-54dc-4165-a144-61e80fdd5626] Updating instance_info_cache with network_info: [{"id": "c60779ce-eea1-4d7d-9195-4c1c4921a5fb", "address": "fa:16:3e:ba:f7:78", "network": {"id": "5ec264ad-3459-468c-bdbf-c6a4ef016951", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1574289626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07c7783cc16049208421204910982c79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc60779ce-ee", "ovs_interfaceid": "c60779ce-eea1-4d7d-9195-4c1c4921a5fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:48:17 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-4f979ef0-f481-4a35-ba16-8c9546dc8634 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Releasing lock "refresh_cache-42579ef7-54dc-4165-a144-61e80fdd5626" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:48:17 user nova-compute[75176]: DEBUG nova.compute.manager [None req-4f979ef0-f481-4a35-ba16-8c9546dc8634 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: 42579ef7-54dc-4165-a144-61e80fdd5626] Instance network_info: |[{"id": "c60779ce-eea1-4d7d-9195-4c1c4921a5fb", "address": "fa:16:3e:ba:f7:78", "network": {"id": "5ec264ad-3459-468c-bdbf-c6a4ef016951", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1574289626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07c7783cc16049208421204910982c79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc60779ce-ee", "ovs_interfaceid": "c60779ce-eea1-4d7d-9195-4c1c4921a5fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75176) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 15:48:17 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:48:18 user nova-compute[75176]: DEBUG nova.compute.manager [req-f7f184b8-cf5d-4bee-9bd3-c40759b2a701 req-5c952968-7e3b-497c-a075-69588898f192 service nova] [instance: 42579ef7-54dc-4165-a144-61e80fdd5626] Received event network-changed-c60779ce-eea1-4d7d-9195-4c1c4921a5fb {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:48:18 user nova-compute[75176]: DEBUG nova.compute.manager [req-f7f184b8-cf5d-4bee-9bd3-c40759b2a701 req-5c952968-7e3b-497c-a075-69588898f192 service nova] [instance: 42579ef7-54dc-4165-a144-61e80fdd5626] Refreshing instance network info cache due to event network-changed-c60779ce-eea1-4d7d-9195-4c1c4921a5fb. {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 15:48:18 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-f7f184b8-cf5d-4bee-9bd3-c40759b2a701 req-5c952968-7e3b-497c-a075-69588898f192 service nova] Acquiring lock "refresh_cache-42579ef7-54dc-4165-a144-61e80fdd5626" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:48:18 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-f7f184b8-cf5d-4bee-9bd3-c40759b2a701 req-5c952968-7e3b-497c-a075-69588898f192 service nova] Acquired lock "refresh_cache-42579ef7-54dc-4165-a144-61e80fdd5626" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:48:18 user nova-compute[75176]: DEBUG nova.network.neutron [req-f7f184b8-cf5d-4bee-9bd3-c40759b2a701 req-5c952968-7e3b-497c-a075-69588898f192 service nova] [instance: 42579ef7-54dc-4165-a144-61e80fdd5626] Refreshing network info cache for port c60779ce-eea1-4d7d-9195-4c1c4921a5fb {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 15:48:18 user nova-compute[75176]: DEBUG nova.network.neutron [req-f7f184b8-cf5d-4bee-9bd3-c40759b2a701 req-5c952968-7e3b-497c-a075-69588898f192 service nova] [instance: 42579ef7-54dc-4165-a144-61e80fdd5626] Updated VIF entry in instance network info cache for port c60779ce-eea1-4d7d-9195-4c1c4921a5fb. {{(pid=75176) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 15:48:18 user nova-compute[75176]: DEBUG nova.network.neutron [req-f7f184b8-cf5d-4bee-9bd3-c40759b2a701 req-5c952968-7e3b-497c-a075-69588898f192 service nova] [instance: 42579ef7-54dc-4165-a144-61e80fdd5626] Updating instance_info_cache with network_info: [{"id": "c60779ce-eea1-4d7d-9195-4c1c4921a5fb", "address": "fa:16:3e:ba:f7:78", "network": {"id": "5ec264ad-3459-468c-bdbf-c6a4ef016951", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1574289626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07c7783cc16049208421204910982c79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc60779ce-ee", "ovs_interfaceid": "c60779ce-eea1-4d7d-9195-4c1c4921a5fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:48:18 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-f7f184b8-cf5d-4bee-9bd3-c40759b2a701 req-5c952968-7e3b-497c-a075-69588898f192 service nova] Releasing lock "refresh_cache-42579ef7-54dc-4165-a144-61e80fdd5626" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:48:19 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:48:20 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-878047f9-9474-4811-87cd-eb6d0e4fa463 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Acquiring lock "0e465c9f-e8ab-4a28-bf74-2936a272a0e2" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:48:20 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-878047f9-9474-4811-87cd-eb6d0e4fa463 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Lock "0e465c9f-e8ab-4a28-bf74-2936a272a0e2" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:48:20 user nova-compute[75176]: INFO nova.compute.manager [None req-878047f9-9474-4811-87cd-eb6d0e4fa463 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] [instance: 0e465c9f-e8ab-4a28-bf74-2936a272a0e2] Shelving
Nov 28 15:48:20 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:48:20 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:48:20 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:48:20 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:48:20 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:48:20 user nova-compute[75176]: DEBUG nova.compute.manager [req-ba047224-5100-4548-a072-8c34bb2a7833 req-4d75bf2b-041a-4bb7-bb5f-544869e46777 service nova] [instance: 0e465c9f-e8ab-4a28-bf74-2936a272a0e2] Received event network-vif-unplugged-86effed2-558e-4427-82be-761ca28e6d8c {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:48:20 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-ba047224-5100-4548-a072-8c34bb2a7833 req-4d75bf2b-041a-4bb7-bb5f-544869e46777 service nova] Acquiring lock "0e465c9f-e8ab-4a28-bf74-2936a272a0e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:48:20 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-ba047224-5100-4548-a072-8c34bb2a7833 req-4d75bf2b-041a-4bb7-bb5f-544869e46777 service nova] Lock "0e465c9f-e8ab-4a28-bf74-2936a272a0e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:48:20 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-ba047224-5100-4548-a072-8c34bb2a7833 req-4d75bf2b-041a-4bb7-bb5f-544869e46777 service nova] Lock "0e465c9f-e8ab-4a28-bf74-2936a272a0e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:48:20 user nova-compute[75176]: DEBUG nova.compute.manager [req-ba047224-5100-4548-a072-8c34bb2a7833 req-4d75bf2b-041a-4bb7-bb5f-544869e46777 service nova] [instance: 0e465c9f-e8ab-4a28-bf74-2936a272a0e2] No waiting events found dispatching network-vif-unplugged-86effed2-558e-4427-82be-761ca28e6d8c {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:48:20 user nova-compute[75176]: WARNING nova.compute.manager [req-ba047224-5100-4548-a072-8c34bb2a7833 req-4d75bf2b-041a-4bb7-bb5f-544869e46777 service nova] [instance: 0e465c9f-e8ab-4a28-bf74-2936a272a0e2] Received unexpected event network-vif-unplugged-86effed2-558e-4427-82be-761ca28e6d8c for instance with vm_state active and task_state shelving.
Nov 28 15:48:20 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:48:20 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:48:20 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:48:20 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:48:20 user nova-compute[75176]: INFO nova.virt.libvirt.driver [-] [instance: 0e465c9f-e8ab-4a28-bf74-2936a272a0e2] Instance destroyed successfully.
Nov 28 15:48:21 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:48:21 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-878047f9-9474-4811-87cd-eb6d0e4fa463 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] [instance: 0e465c9f-e8ab-4a28-bf74-2936a272a0e2] Beginning cold snapshot process
Nov 28 15:48:21 user nova-compute[75176]: DEBUG nova.privsep.utils [None req-878047f9-9474-4811-87cd-eb6d0e4fa463 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75176) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 28 15:48:21 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-878047f9-9474-4811-87cd-eb6d0e4fa463 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/0e465c9f-e8ab-4a28-bf74-2936a272a0e2/disk /opt/stack/data/nova/instances/snapshots/tmpe9ksu368/a879655328744af79f7156971816fea3 {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:48:22 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-878047f9-9474-4811-87cd-eb6d0e4fa463 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/0e465c9f-e8ab-4a28-bf74-2936a272a0e2/disk /opt/stack/data/nova/instances/snapshots/tmpe9ksu368/a879655328744af79f7156971816fea3" returned: 0 in 1.045s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:48:22 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-878047f9-9474-4811-87cd-eb6d0e4fa463 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] [instance: 0e465c9f-e8ab-4a28-bf74-2936a272a0e2] Snapshot extracted, beginning image upload
Nov 28 15:48:22 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:48:22 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:48:22 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:48:22 user nova-compute[75176]: DEBUG nova.compute.manager [None req-4f979ef0-f481-4a35-ba16-8c9546dc8634 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: 42579ef7-54dc-4165-a144-61e80fdd5626] Start spawning the instance on the hypervisor. {{(pid=75176) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 15:48:22 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-4f979ef0-f481-4a35-ba16-8c9546dc8634 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: 42579ef7-54dc-4165-a144-61e80fdd5626] Creating instance directory {{(pid=75176) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 15:48:22 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-4f979ef0-f481-4a35-ba16-8c9546dc8634 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: 42579ef7-54dc-4165-a144-61e80fdd5626] Creating image(s)
Nov 28 15:48:22 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-4f979ef0-f481-4a35-ba16-8c9546dc8634 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: 42579ef7-54dc-4165-a144-61e80fdd5626] Did not create local disks {{(pid=75176) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 28 15:48:22 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-4f979ef0-f481-4a35-ba16-8c9546dc8634 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: 42579ef7-54dc-4165-a144-61e80fdd5626] Ensure instance console log exists: /opt/stack/data/nova/instances/42579ef7-54dc-4165-a144-61e80fdd5626/console.log {{(pid=75176) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 15:48:22 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-4f979ef0-f481-4a35-ba16-8c9546dc8634 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:48:22 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-4f979ef0-f481-4a35-ba16-8c9546dc8634 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:48:22 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-4f979ef0-f481-4a35-ba16-8c9546dc8634 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:48:22 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-4f979ef0-f481-4a35-ba16-8c9546dc8634 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: 42579ef7-54dc-4165-a144-61e80fdd5626] Start _get_guest_xml network_info=[{"id": "c60779ce-eea1-4d7d-9195-4c1c4921a5fb", "address": "fa:16:3e:ba:f7:78", "network": {"id": "5ec264ad-3459-468c-bdbf-c6a4ef016951", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1574289626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07c7783cc16049208421204910982c79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc60779ce-ee", "ovs_interfaceid": "c60779ce-eea1-4d7d-9195-4c1c4921a5fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8452525c-6845-4edb-bf69-1e2ffe0ef2eb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OyWVuqAt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '42579ef7-54dc-4165-a144-61e80fdd5626', 'attached_at': '', 'detached_at': '', 'volume_id': '8452525c-6845-4edb-bf69-1e2ffe0ef2eb', 'serial': '8452525c-6845-4edb-bf69-1e2ffe0ef2eb'}, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'delete_on_termination': True, 'mount_device': '/dev/vda', 'attachment_id': '81757ee6-718d-4094-b113-989446133759', 'volume_type': None} {{(pid=75176) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 15:48:22 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-4f979ef0-f481-4a35-ba16-8c9546dc8634 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 15:48:22 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-4f979ef0-f481-4a35-ba16-8c9546dc8634 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 15:48:22 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-4f979ef0-f481-4a35-ba16-8c9546dc8634 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75176) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 15:48:22 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-4f979ef0-f481-4a35-ba16-8c9546dc8634 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] CPU controller missing on host. {{(pid=75176) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 15:48:22 user nova-compute[75176]: DEBUG nova.compute.manager [req-bee71a79-008b-4881-a564-e2e0ad3b0c3f req-1965cba0-32e6-46ac-9493-73cbbcf34440 service nova] [instance: 0e465c9f-e8ab-4a28-bf74-2936a272a0e2] Received event network-vif-plugged-86effed2-558e-4427-82be-761ca28e6d8c {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:48:22 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-bee71a79-008b-4881-a564-e2e0ad3b0c3f req-1965cba0-32e6-46ac-9493-73cbbcf34440 service nova] Acquiring lock "0e465c9f-e8ab-4a28-bf74-2936a272a0e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:48:22 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-bee71a79-008b-4881-a564-e2e0ad3b0c3f req-1965cba0-32e6-46ac-9493-73cbbcf34440 service nova] Lock "0e465c9f-e8ab-4a28-bf74-2936a272a0e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:48:22 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-bee71a79-008b-4881-a564-e2e0ad3b0c3f req-1965cba0-32e6-46ac-9493-73cbbcf34440 service nova] Lock "0e465c9f-e8ab-4a28-bf74-2936a272a0e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:48:22 user nova-compute[75176]: DEBUG nova.compute.manager [req-bee71a79-008b-4881-a564-e2e0ad3b0c3f req-1965cba0-32e6-46ac-9493-73cbbcf34440 service nova] [instance: 0e465c9f-e8ab-4a28-bf74-2936a272a0e2] No waiting events found dispatching network-vif-plugged-86effed2-558e-4427-82be-761ca28e6d8c {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:48:22 user nova-compute[75176]: WARNING nova.compute.manager [req-bee71a79-008b-4881-a564-e2e0ad3b0c3f req-1965cba0-32e6-46ac-9493-73cbbcf34440 service nova] [instance: 0e465c9f-e8ab-4a28-bf74-2936a272a0e2] Received unexpected event network-vif-plugged-86effed2-558e-4427-82be-761ca28e6d8c for instance with vm_state active and task_state shelving_image_uploading.
Nov 28 15:48:22 user nova-compute[75176]: DEBUG nova.compute.manager [req-bee71a79-008b-4881-a564-e2e0ad3b0c3f req-1965cba0-32e6-46ac-9493-73cbbcf34440 service nova] [instance: 0e465c9f-e8ab-4a28-bf74-2936a272a0e2] Received event network-vif-plugged-86effed2-558e-4427-82be-761ca28e6d8c {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:48:22 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-bee71a79-008b-4881-a564-e2e0ad3b0c3f req-1965cba0-32e6-46ac-9493-73cbbcf34440 service nova] Acquiring lock "0e465c9f-e8ab-4a28-bf74-2936a272a0e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:48:22 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-bee71a79-008b-4881-a564-e2e0ad3b0c3f req-1965cba0-32e6-46ac-9493-73cbbcf34440 service nova] Lock "0e465c9f-e8ab-4a28-bf74-2936a272a0e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:48:22 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-bee71a79-008b-4881-a564-e2e0ad3b0c3f req-1965cba0-32e6-46ac-9493-73cbbcf34440 service nova] Lock "0e465c9f-e8ab-4a28-bf74-2936a272a0e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:48:22 user nova-compute[75176]: DEBUG nova.compute.manager [req-bee71a79-008b-4881-a564-e2e0ad3b0c3f req-1965cba0-32e6-46ac-9493-73cbbcf34440 service nova] [instance: 0e465c9f-e8ab-4a28-bf74-2936a272a0e2] No waiting events found dispatching network-vif-plugged-86effed2-558e-4427-82be-761ca28e6d8c {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:48:22 user nova-compute[75176]: WARNING nova.compute.manager [req-bee71a79-008b-4881-a564-e2e0ad3b0c3f req-1965cba0-32e6-46ac-9493-73cbbcf34440 service nova] [instance: 0e465c9f-e8ab-4a28-bf74-2936a272a0e2] Received unexpected event network-vif-plugged-86effed2-558e-4427-82be-761ca28e6d8c for instance with vm_state active and task_state shelving_image_uploading.
Nov 28 15:48:22 user nova-compute[75176]: DEBUG nova.compute.manager [req-bee71a79-008b-4881-a564-e2e0ad3b0c3f req-1965cba0-32e6-46ac-9493-73cbbcf34440 service nova] [instance: 0e465c9f-e8ab-4a28-bf74-2936a272a0e2] Received event network-vif-plugged-86effed2-558e-4427-82be-761ca28e6d8c {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:48:22 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-bee71a79-008b-4881-a564-e2e0ad3b0c3f req-1965cba0-32e6-46ac-9493-73cbbcf34440 service nova] Acquiring lock "0e465c9f-e8ab-4a28-bf74-2936a272a0e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:48:22 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-bee71a79-008b-4881-a564-e2e0ad3b0c3f req-1965cba0-32e6-46ac-9493-73cbbcf34440 service nova] Lock "0e465c9f-e8ab-4a28-bf74-2936a272a0e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:48:22 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-bee71a79-008b-4881-a564-e2e0ad3b0c3f req-1965cba0-32e6-46ac-9493-73cbbcf34440 service nova] Lock "0e465c9f-e8ab-4a28-bf74-2936a272a0e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:48:22 user nova-compute[75176]: DEBUG nova.compute.manager [req-bee71a79-008b-4881-a564-e2e0ad3b0c3f req-1965cba0-32e6-46ac-9493-73cbbcf34440 service nova] [instance: 0e465c9f-e8ab-4a28-bf74-2936a272a0e2] No waiting events found dispatching network-vif-plugged-86effed2-558e-4427-82be-761ca28e6d8c {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:48:22 user nova-compute[75176]: WARNING nova.compute.manager [req-bee71a79-008b-4881-a564-e2e0ad3b0c3f req-1965cba0-32e6-46ac-9493-73cbbcf34440 service nova] [instance: 0e465c9f-e8ab-4a28-bf74-2936a272a0e2] Received unexpected event network-vif-plugged-86effed2-558e-4427-82be-761ca28e6d8c for instance with vm_state active and task_state shelving_image_uploading.
Nov 28 15:48:22 user nova-compute[75176]: DEBUG nova.compute.manager [req-bee71a79-008b-4881-a564-e2e0ad3b0c3f req-1965cba0-32e6-46ac-9493-73cbbcf34440 service nova] [instance: 0e465c9f-e8ab-4a28-bf74-2936a272a0e2] Received event network-vif-unplugged-86effed2-558e-4427-82be-761ca28e6d8c {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:48:22 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-bee71a79-008b-4881-a564-e2e0ad3b0c3f req-1965cba0-32e6-46ac-9493-73cbbcf34440 service nova] Acquiring lock "0e465c9f-e8ab-4a28-bf74-2936a272a0e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:48:22 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-bee71a79-008b-4881-a564-e2e0ad3b0c3f req-1965cba0-32e6-46ac-9493-73cbbcf34440 service nova] Lock "0e465c9f-e8ab-4a28-bf74-2936a272a0e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:48:22 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-bee71a79-008b-4881-a564-e2e0ad3b0c3f req-1965cba0-32e6-46ac-9493-73cbbcf34440 service nova] Lock "0e465c9f-e8ab-4a28-bf74-2936a272a0e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:48:22 user nova-compute[75176]: DEBUG nova.compute.manager [req-bee71a79-008b-4881-a564-e2e0ad3b0c3f req-1965cba0-32e6-46ac-9493-73cbbcf34440 service nova] [instance: 0e465c9f-e8ab-4a28-bf74-2936a272a0e2] No waiting events found dispatching network-vif-unplugged-86effed2-558e-4427-82be-761ca28e6d8c {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:48:22 user nova-compute[75176]: WARNING nova.compute.manager [req-bee71a79-008b-4881-a564-e2e0ad3b0c3f req-1965cba0-32e6-46ac-9493-73cbbcf34440 service nova] [instance: 0e465c9f-e8ab-4a28-bf74-2936a272a0e2] Received unexpected event network-vif-unplugged-86effed2-558e-4427-82be-761ca28e6d8c for instance with vm_state active and task_state shelving_image_uploading.
Nov 28 15:48:22 user nova-compute[75176]: DEBUG nova.compute.manager [req-bee71a79-008b-4881-a564-e2e0ad3b0c3f req-1965cba0-32e6-46ac-9493-73cbbcf34440 service nova] [instance: 0e465c9f-e8ab-4a28-bf74-2936a272a0e2] Received event network-vif-plugged-86effed2-558e-4427-82be-761ca28e6d8c {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:48:22 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-bee71a79-008b-4881-a564-e2e0ad3b0c3f req-1965cba0-32e6-46ac-9493-73cbbcf34440 service nova] Acquiring lock "0e465c9f-e8ab-4a28-bf74-2936a272a0e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:48:22 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-bee71a79-008b-4881-a564-e2e0ad3b0c3f req-1965cba0-32e6-46ac-9493-73cbbcf34440 service nova] Lock "0e465c9f-e8ab-4a28-bf74-2936a272a0e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:48:22 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-bee71a79-008b-4881-a564-e2e0ad3b0c3f req-1965cba0-32e6-46ac-9493-73cbbcf34440 service nova] Lock "0e465c9f-e8ab-4a28-bf74-2936a272a0e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:48:22 user nova-compute[75176]: DEBUG nova.compute.manager [req-bee71a79-008b-4881-a564-e2e0ad3b0c3f req-1965cba0-32e6-46ac-9493-73cbbcf34440 service nova] [instance: 0e465c9f-e8ab-4a28-bf74-2936a272a0e2] No waiting events found dispatching network-vif-plugged-86effed2-558e-4427-82be-761ca28e6d8c {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:48:22 user nova-compute[75176]: WARNING nova.compute.manager [req-bee71a79-008b-4881-a564-e2e0ad3b0c3f req-1965cba0-32e6-46ac-9493-73cbbcf34440 service nova] [instance: 0e465c9f-e8ab-4a28-bf74-2936a272a0e2] Received unexpected event network-vif-plugged-86effed2-558e-4427-82be-761ca28e6d8c for instance with vm_state active and task_state shelving_image_uploading.
Nov 28 15:48:22 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:48:22 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-4f979ef0-f481-4a35-ba16-8c9546dc8634 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75176) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 15:48:22 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-4f979ef0-f481-4a35-ba16-8c9546dc8634 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] CPU controller found on host. {{(pid=75176) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 15:48:22 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-4f979ef0-f481-4a35-ba16-8c9546dc8634 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75176) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 15:48:22 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-4f979ef0-f481-4a35-ba16-8c9546dc8634 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T15:35:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 15:48:22 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-4f979ef0-f481-4a35-ba16-8c9546dc8634 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Flavor limits 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 15:48:22 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-4f979ef0-f481-4a35-ba16-8c9546dc8634 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Image limits 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 15:48:22 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-4f979ef0-f481-4a35-ba16-8c9546dc8634 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Flavor pref 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 15:48:22 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-4f979ef0-f481-4a35-ba16-8c9546dc8634 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Image pref 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 15:48:22 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-4f979ef0-f481-4a35-ba16-8c9546dc8634 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 15:48:22 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-4f979ef0-f481-4a35-ba16-8c9546dc8634 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 15:48:22 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-4f979ef0-f481-4a35-ba16-8c9546dc8634 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75176) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 15:48:22 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-4f979ef0-f481-4a35-ba16-8c9546dc8634 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Got 1 possible topologies {{(pid=75176) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 15:48:22 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-4f979ef0-f481-4a35-ba16-8c9546dc8634 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 15:48:22 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-4f979ef0-f481-4a35-ba16-8c9546dc8634 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 15:48:22 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4f979ef0-f481-4a35-ba16-8c9546dc8634 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: 42579ef7-54dc-4165-a144-61e80fdd5626] Calling os-brick to attach iSCSI Volume {{(pid=75176) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 15:48:22 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f979ef0-f481-4a35-ba16-8c9546dc8634 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c1b8a00>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8452525c-6845-4edb-bf69-1e2ffe0ef2eb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OyWVuqAt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 15:48:22 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-4f979ef0-f481-4a35-ba16-8c9546dc8634 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 15:48:22 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-4f979ef0-f481-4a35-ba16-8c9546dc8634 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 15:48:22 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-4f979ef0-f481-4a35-ba16-8c9546dc8634 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 15:48:22 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-4f979ef0-f481-4a35-ba16-8c9546dc8634 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 15:48:22 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-4f979ef0-f481-4a35-ba16-8c9546dc8634 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8452525c-6845-4edb-bf69-1e2ffe0ef2eb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 15:48:22 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-4f979ef0-f481-4a35-ba16-8c9546dc8634 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8452525c-6845-4edb-bf69-1e2ffe0ef2eb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 15:48:22 user nova-compute[75176]: INFO os_brick.initiator.connectors.iscsi [None req-4f979ef0-f481-4a35-ba16-8c9546dc8634 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 15:48:22 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:48:22 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8452525c-6845-4edb-bf69-1e2ffe0ef2eb -p 172.16.0.220:3260 {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:48:22 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8452525c-6845-4edb-bf69-1e2ffe0ef2eb -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:48:22 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[39585089-ca49-495b-a401-5ad4b81515dc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:48:22 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f979ef0-f481-4a35-ba16-8c9546dc8634 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 15:48:22 user nova-compute[75176]:  {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:48:22 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8452525c-6845-4edb-bf69-1e2ffe0ef2eb -p 172.16.0.220:3260 --interface default --op new {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:48:22 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8452525c-6845-4edb-bf69-1e2ffe0ef2eb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:48:22 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[99123f44-00ab-4c00-8ec9-0ebb429bc011]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8452525c-6845-4edb-bf69-1e2ffe0ef2eb] added\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:48:22 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f979ef0-f481-4a35-ba16-8c9546dc8634 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8452525c-6845-4edb-bf69-1e2ffe0ef2eb] added
Nov 28 15:48:22 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:48:22 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8452525c-6845-4edb-bf69-1e2ffe0ef2eb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:48:22 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8452525c-6845-4edb-bf69-1e2ffe0ef2eb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:48:22 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[738876f7-b2b3-415e-880c-3449dc9d8bb3]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:48:22 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f979ef0-f481-4a35-ba16-8c9546dc8634 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:48:22 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8452525c-6845-4edb-bf69-1e2ffe0ef2eb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:48:22 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8452525c-6845-4edb-bf69-1e2ffe0ef2eb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:48:22 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[a15e8aec-575d-4348-afc7-c580487de3a1]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:48:22 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f979ef0-f481-4a35-ba16-8c9546dc8634 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:48:22 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8452525c-6845-4edb-bf69-1e2ffe0ef2eb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OyWVuqAt {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:48:22 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8452525c-6845-4edb-bf69-1e2ffe0ef2eb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OyWVuqAt" returned: 0 in 0.021s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:48:22 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3b1faf1-358b-4bb1-aa74-e75bfc1c09ad]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:48:22 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f979ef0-f481-4a35-ba16-8c9546dc8634 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OyWVuqAt'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:48:22 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8452525c-6845-4edb-bf69-1e2ffe0ef2eb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:48:22 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8452525c-6845-4edb-bf69-1e2ffe0ef2eb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:48:22 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[80d31b21-e70e-42dc-ab1a-807d0261b4d0]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:48:22 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f979ef0-f481-4a35-ba16-8c9546dc8634 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:48:22 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:48:22 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:48:22 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[c812c0d7-d7de-46a0-b3cb-b31b65af67f7]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22933c6e-3d8f-44f5-bc41-dee97c587055 (non-flash)\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:48:22 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f979ef0-f481-4a35-ba16-8c9546dc8634 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22933c6e-3d8f-44f5-bc41-dee97c587055 (non-flash)
Nov 28 15:48:22 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:48:22 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f979ef0-f481-4a35-ba16-8c9546dc8634 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22933c6e-3d8f-44f5-bc41-dee97c587055 (non-flash)
Nov 28 15:48:22 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 15:48:22 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8452525c-6845-4edb-bf69-1e2ffe0ef2eb -p 172.16.0.220:3260 --login {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:48:22 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8452525c-6845-4edb-bf69-1e2ffe0ef2eb -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:48:22 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[7508d903-68f8-4814-b65f-a2bfb30f5a96]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8452525c-6845-4edb-bf69-1e2ffe0ef2eb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8452525c-6845-4edb-bf69-1e2ffe0ef2eb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:48:22 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f979ef0-f481-4a35-ba16-8c9546dc8634 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8452525c-6845-4edb-bf69-1e2ffe0ef2eb, portal: 172.16.0.220,3260]
Nov 28 15:48:22 user nova-compute[75176]: Login to [iface: default, target: iqn.2010-10.org.openstack:8452525c-6845-4edb-bf69-1e2ffe0ef2eb, portal: 172.16.0.220,3260] successful.
Nov 28 15:48:22 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:48:22 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8452525c-6845-4edb-bf69-1e2ffe0ef2eb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:48:22 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8452525c-6845-4edb-bf69-1e2ffe0ef2eb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.042s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:48:22 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd2bcf05-02eb-4c3b-a2b9-bba1960e7f3a]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:48:22 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f979ef0-f481-4a35-ba16-8c9546dc8634 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:48:22 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:48:22 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:48:22 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[15579483-c113-4bdd-9e21-32612dbab7c9]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22933c6e-3d8f-44f5-bc41-dee97c587055 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8452525c-6845-4edb-bf69-1e2ffe0ef2eb (non-flash)\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:48:22 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f979ef0-f481-4a35-ba16-8c9546dc8634 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22933c6e-3d8f-44f5-bc41-dee97c587055 (non-flash)
Nov 28 15:48:22 user nova-compute[75176]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8452525c-6845-4edb-bf69-1e2ffe0ef2eb (non-flash)
Nov 28 15:48:22 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:48:22 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f979ef0-f481-4a35-ba16-8c9546dc8634 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22933c6e-3d8f-44f5-bc41-dee97c587055 (non-flash)
Nov 28 15:48:22 user nova-compute[75176]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8452525c-6845-4edb-bf69-1e2ffe0ef2eb (non-flash)
Nov 28 15:48:22 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 15:48:22 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-4f979ef0-f481-4a35-ba16-8c9546dc8634 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8452525c-6845-4edb-bf69-1e2ffe0ef2eb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.340s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 15:48:22 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f979ef0-f481-4a35-ba16-8c9546dc8634 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Connected to 172.16.0.220:3260 {{(pid=75176) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 15:48:22 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-4f979ef0-f481-4a35-ba16-8c9546dc8634 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] HCTL ('34', '-', '-', 0) found on session 31 with lun 0 {{(pid=75176) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 15:48:22 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-4f979ef0-f481-4a35-ba16-8c9546dc8634 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75176) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 15:48:22 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:48:22 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:48:22 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.025s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:48:22 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[65c3ae87-7a1f-4b99-839f-a5171f19625b]: (4, ('- - 0', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:48:22 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-4f979ef0-f481-4a35-ba16-8c9546dc8634 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Searching for a device in session 31 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75176) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 15:48:22 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f979ef0-f481-4a35-ba16-8c9546dc8634 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:8452525c-6845-4edb-bf69-1e2ffe0ef2eb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OyWVuqAt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75176) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 15:48:23 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d37bd68-994c-4f04-9625-9b4ca2a3633c tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Acquiring lock "6d061df5-8dbc-4fc1-9935-d46efc934b58" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:48:23 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d37bd68-994c-4f04-9625-9b4ca2a3633c tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Lock "6d061df5-8dbc-4fc1-9935-d46efc934b58" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:48:23 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d37bd68-994c-4f04-9625-9b4ca2a3633c tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] [instance: 6d061df5-8dbc-4fc1-9935-d46efc934b58] Starting instance... {{(pid=75176) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 15:48:23 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d37bd68-994c-4f04-9625-9b4ca2a3633c tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:48:23 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d37bd68-994c-4f04-9625-9b4ca2a3633c tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:48:23 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-7d37bd68-994c-4f04-9625-9b4ca2a3633c tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75176) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 15:48:23 user nova-compute[75176]: INFO nova.compute.claims [None req-7d37bd68-994c-4f04-9625-9b4ca2a3633c tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] [instance: 6d061df5-8dbc-4fc1-9935-d46efc934b58] Claim successful on node user
Nov 28 15:48:23 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-4f979ef0-f481-4a35-ba16-8c9546dc8634 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.379s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 15:48:23 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f979ef0-f481-4a35-ba16-8c9546dc8634 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] <== connect_volume: return (1381ms) {'type': 'block', 'scsi_wwn': '26235333039376333', 'path': '/dev/sdc'} {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 15:48:23 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4f979ef0-f481-4a35-ba16-8c9546dc8634 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: 42579ef7-54dc-4165-a144-61e80fdd5626] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26235333039376333', 'path': '/dev/sdc'} {{(pid=75176) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 15:48:23 user nova-compute[75176]: DEBUG nova.compute.provider_tree [None req-7d37bd68-994c-4f04-9625-9b4ca2a3633c tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Inventory has not changed in ProviderTree for provider: b37848d8-f401-4155-a029-b0ffa09ff85b {{(pid=75176) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 15:48:23 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-7d37bd68-994c-4f04-9625-9b4ca2a3633c tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Inventory has not changed for provider b37848d8-f401-4155-a029-b0ffa09ff85b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75176) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 15:48:23 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-4f979ef0-f481-4a35-ba16-8c9546dc8634 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T15:48:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1575944035',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1575944035',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1575944035',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCbenEEWjXrLPvri/j1bdPyiyqrJRmRMAdi7hUTEC0T2nCGTikp77R+EDjNHnXzYPrHqzBqe6Ldu/dqSmsIZWIpiqT5NtZgFvXAji1sOrvffB/TZAa2hdFESwhP/dCBRNA==',key_name='tempest-keypair-456872669',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='07c7783cc16049208421204910982c79',ramdisk_id='',reservation_id='r-3qrjmp63',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1695196118',owner_user_name='tempest-TestVolumeBootPattern-1695196118-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T15:48:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='081bf84d24194b81be4e0a6638db9b66',uuid=42579ef7-54dc-4165-a144-61e80fdd5626,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c60779ce-eea1-4d7d-9195-4c1c4921a5fb", "address": "fa:16:3e:ba:f7:78", "network": {"id": "5ec264ad-3459-468c-bdbf-c6a4ef016951", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1574289626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07c7783cc16049208421204910982c79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc60779ce-ee", "ovs_interfaceid": "c60779ce-eea1-4d7d-9195-4c1c4921a5fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75176) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 15:48:23 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-4f979ef0-f481-4a35-ba16-8c9546dc8634 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Converting VIF {"id": "c60779ce-eea1-4d7d-9195-4c1c4921a5fb", "address": "fa:16:3e:ba:f7:78", "network": {"id": "5ec264ad-3459-468c-bdbf-c6a4ef016951", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1574289626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07c7783cc16049208421204910982c79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc60779ce-ee", "ovs_interfaceid": "c60779ce-eea1-4d7d-9195-4c1c4921a5fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:48:23 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-4f979ef0-f481-4a35-ba16-8c9546dc8634 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:f7:78,bridge_name='br-int',has_traffic_filtering=True,id=c60779ce-eea1-4d7d-9195-4c1c4921a5fb,network=Network(5ec264ad-3459-468c-bdbf-c6a4ef016951),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc60779ce-ee') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:48:23 user nova-compute[75176]: DEBUG nova.objects.instance [None req-4f979ef0-f481-4a35-ba16-8c9546dc8634 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Lazy-loading 'pci_devices' on Instance uuid 42579ef7-54dc-4165-a144-61e80fdd5626 {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:48:23 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-4f979ef0-f481-4a35-ba16-8c9546dc8634 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: 42579ef7-54dc-4165-a144-61e80fdd5626] End _get_guest_xml xml=<domain type="kvm">
Nov 28 15:48:23 user nova-compute[75176]:   <uuid>42579ef7-54dc-4165-a144-61e80fdd5626</uuid>
Nov 28 15:48:23 user nova-compute[75176]:   <name>instance-0000001b</name>
Nov 28 15:48:23 user nova-compute[75176]:   <memory>524288</memory>
Nov 28 15:48:23 user nova-compute[75176]:   <vcpu>1</vcpu>
Nov 28 15:48:23 user nova-compute[75176]:   <metadata>
Nov 28 15:48:23 user nova-compute[75176]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 15:48:23 user nova-compute[75176]:       <nova:package version="0.0.0"/>
Nov 28 15:48:23 user nova-compute[75176]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-1575944035</nova:name>
Nov 28 15:48:23 user nova-compute[75176]:       <nova:creationTime>2023-11-28 15:48:22</nova:creationTime>
Nov 28 15:48:23 user nova-compute[75176]:       <nova:flavor name="m1.tiny">
Nov 28 15:48:23 user nova-compute[75176]:         <nova:memory>512</nova:memory>
Nov 28 15:48:23 user nova-compute[75176]:         <nova:disk>1</nova:disk>
Nov 28 15:48:23 user nova-compute[75176]:         <nova:swap>0</nova:swap>
Nov 28 15:48:23 user nova-compute[75176]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 15:48:23 user nova-compute[75176]:         <nova:vcpus>1</nova:vcpus>
Nov 28 15:48:23 user nova-compute[75176]:       </nova:flavor>
Nov 28 15:48:23 user nova-compute[75176]:       <nova:owner>
Nov 28 15:48:23 user nova-compute[75176]:         <nova:user uuid="081bf84d24194b81be4e0a6638db9b66">tempest-TestVolumeBootPattern-1695196118-project-member</nova:user>
Nov 28 15:48:23 user nova-compute[75176]:         <nova:project uuid="07c7783cc16049208421204910982c79">tempest-TestVolumeBootPattern-1695196118</nova:project>
Nov 28 15:48:23 user nova-compute[75176]:       </nova:owner>
Nov 28 15:48:23 user nova-compute[75176]:       <nova:ports>
Nov 28 15:48:23 user nova-compute[75176]:         <nova:port uuid="c60779ce-eea1-4d7d-9195-4c1c4921a5fb">
Nov 28 15:48:23 user nova-compute[75176]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 28 15:48:23 user nova-compute[75176]:         </nova:port>
Nov 28 15:48:23 user nova-compute[75176]:       </nova:ports>
Nov 28 15:48:23 user nova-compute[75176]:     </nova:instance>
Nov 28 15:48:23 user nova-compute[75176]:   </metadata>
Nov 28 15:48:23 user nova-compute[75176]:   <sysinfo type="smbios">
Nov 28 15:48:23 user nova-compute[75176]:     <system>
Nov 28 15:48:23 user nova-compute[75176]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 15:48:23 user nova-compute[75176]:       <entry name="product">OpenStack Nova</entry>
Nov 28 15:48:23 user nova-compute[75176]:       <entry name="version">0.0.0</entry>
Nov 28 15:48:23 user nova-compute[75176]:       <entry name="serial">42579ef7-54dc-4165-a144-61e80fdd5626</entry>
Nov 28 15:48:23 user nova-compute[75176]:       <entry name="uuid">42579ef7-54dc-4165-a144-61e80fdd5626</entry>
Nov 28 15:48:23 user nova-compute[75176]:       <entry name="family">Virtual Machine</entry>
Nov 28 15:48:23 user nova-compute[75176]:     </system>
Nov 28 15:48:23 user nova-compute[75176]:   </sysinfo>
Nov 28 15:48:23 user nova-compute[75176]:   <os>
Nov 28 15:48:23 user nova-compute[75176]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 15:48:23 user nova-compute[75176]:     <boot dev="hd"/>
Nov 28 15:48:23 user nova-compute[75176]:     <smbios mode="sysinfo"/>
Nov 28 15:48:23 user nova-compute[75176]:   </os>
Nov 28 15:48:23 user nova-compute[75176]:   <features>
Nov 28 15:48:23 user nova-compute[75176]:     <acpi/>
Nov 28 15:48:23 user nova-compute[75176]:     <apic/>
Nov 28 15:48:23 user nova-compute[75176]:     <vmcoreinfo/>
Nov 28 15:48:23 user nova-compute[75176]:   </features>
Nov 28 15:48:23 user nova-compute[75176]:   <clock offset="utc">
Nov 28 15:48:23 user nova-compute[75176]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 15:48:23 user nova-compute[75176]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 15:48:23 user nova-compute[75176]:     <timer name="hpet" present="no"/>
Nov 28 15:48:23 user nova-compute[75176]:   </clock>
Nov 28 15:48:23 user nova-compute[75176]:   <cpu mode="custom" match="exact">
Nov 28 15:48:23 user nova-compute[75176]:     <model>Nehalem</model>
Nov 28 15:48:23 user nova-compute[75176]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 15:48:23 user nova-compute[75176]:   </cpu>
Nov 28 15:48:23 user nova-compute[75176]:   <devices>
Nov 28 15:48:23 user nova-compute[75176]:     <disk type="block" device="disk">
Nov 28 15:48:23 user nova-compute[75176]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 15:48:23 user nova-compute[75176]:       <source dev="/dev/sdc"/>
Nov 28 15:48:23 user nova-compute[75176]:       <target dev="vda" bus="virtio"/>
Nov 28 15:48:23 user nova-compute[75176]:       <serial>8452525c-6845-4edb-bf69-1e2ffe0ef2eb</serial>
Nov 28 15:48:23 user nova-compute[75176]:     </disk>
Nov 28 15:48:23 user nova-compute[75176]:     <interface type="ethernet">
Nov 28 15:48:23 user nova-compute[75176]:       <mac address="fa:16:3e:ba:f7:78"/>
Nov 28 15:48:23 user nova-compute[75176]:       <model type="virtio"/>
Nov 28 15:48:23 user nova-compute[75176]:       <mtu size="1442"/>
Nov 28 15:48:23 user nova-compute[75176]:       <target dev="tapc60779ce-ee"/>
Nov 28 15:48:23 user nova-compute[75176]:     </interface>
Nov 28 15:48:23 user nova-compute[75176]:     <serial type="pty">
Nov 28 15:48:23 user nova-compute[75176]:       <log file="/opt/stack/data/nova/instances/42579ef7-54dc-4165-a144-61e80fdd5626/console.log" append="off"/>
Nov 28 15:48:23 user nova-compute[75176]:     </serial>
Nov 28 15:48:23 user nova-compute[75176]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 15:48:23 user nova-compute[75176]:     <video>
Nov 28 15:48:23 user nova-compute[75176]:       <model type="virtio"/>
Nov 28 15:48:23 user nova-compute[75176]:     </video>
Nov 28 15:48:23 user nova-compute[75176]:     <rng model="virtio">
Nov 28 15:48:23 user nova-compute[75176]:       <backend model="random">/dev/urandom</backend>
Nov 28 15:48:23 user nova-compute[75176]:     </rng>
Nov 28 15:48:23 user nova-compute[75176]:     <controller type="usb" index="0" model="none"/>
Nov 28 15:48:23 user nova-compute[75176]:     <memballoon model="virtio">
Nov 28 15:48:23 user nova-compute[75176]:       <stats period="10"/>
Nov 28 15:48:23 user nova-compute[75176]:     </memballoon>
Nov 28 15:48:23 user nova-compute[75176]:   </devices>
Nov 28 15:48:23 user nova-compute[75176]: </domain>
Nov 28 15:48:23 user nova-compute[75176]:  {{(pid=75176) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 15:48:23 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-4f979ef0-f481-4a35-ba16-8c9546dc8634 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T15:48:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1575944035',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1575944035',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1575944035',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCbenEEWjXrLPvri/j1bdPyiyqrJRmRMAdi7hUTEC0T2nCGTikp77R+EDjNHnXzYPrHqzBqe6Ldu/dqSmsIZWIpiqT5NtZgFvXAji1sOrvffB/TZAa2hdFESwhP/dCBRNA==',key_name='tempest-keypair-456872669',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='07c7783cc16049208421204910982c79',ramdisk_id='',reservation_id='r-3qrjmp63',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1695196118',owner_user_name='tempest-TestVolumeBootPattern-1695196118-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T15:48:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='081bf84d24194b81be4e0a6638db9b66',uuid=42579ef7-54dc-4165-a144-61e80fdd5626,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c60779ce-eea1-4d7d-9195-4c1c4921a5fb", "address": "fa:16:3e:ba:f7:78", "network": {"id": "5ec264ad-3459-468c-bdbf-c6a4ef016951", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1574289626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07c7783cc16049208421204910982c79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc60779ce-ee", "ovs_interfaceid": "c60779ce-eea1-4d7d-9195-4c1c4921a5fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 15:48:23 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-4f979ef0-f481-4a35-ba16-8c9546dc8634 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Converting VIF {"id": "c60779ce-eea1-4d7d-9195-4c1c4921a5fb", "address": "fa:16:3e:ba:f7:78", "network": {"id": "5ec264ad-3459-468c-bdbf-c6a4ef016951", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1574289626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07c7783cc16049208421204910982c79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc60779ce-ee", "ovs_interfaceid": "c60779ce-eea1-4d7d-9195-4c1c4921a5fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:48:23 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-4f979ef0-f481-4a35-ba16-8c9546dc8634 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:f7:78,bridge_name='br-int',has_traffic_filtering=True,id=c60779ce-eea1-4d7d-9195-4c1c4921a5fb,network=Network(5ec264ad-3459-468c-bdbf-c6a4ef016951),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc60779ce-ee') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:48:23 user nova-compute[75176]: DEBUG os_vif [None req-4f979ef0-f481-4a35-ba16-8c9546dc8634 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:f7:78,bridge_name='br-int',has_traffic_filtering=True,id=c60779ce-eea1-4d7d-9195-4c1c4921a5fb,network=Network(5ec264ad-3459-468c-bdbf-c6a4ef016951),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc60779ce-ee') {{(pid=75176) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 15:48:23 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:48:23 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:48:23 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 15:48:23 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d37bd68-994c-4f04-9625-9b4ca2a3633c tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.455s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:48:23 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d37bd68-994c-4f04-9625-9b4ca2a3633c tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] [instance: 6d061df5-8dbc-4fc1-9935-d46efc934b58] Start building networks asynchronously for instance. {{(pid=75176) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 15:48:24 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:48:24 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ae0e6172-d6e3-5f46-91bd-abd5fb05ea83', '_type': 'linux-noop'}}, row=False) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:48:24 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:48:24 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:48:24 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:48:24 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:48:24 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc60779ce-ee, may_exist=True, interface_attrs={}) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:48:24 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc60779ce-ee, col_values=(('qos', UUID('bd58e6bb-c6e2-4478-bfd3-325c9c2bd533')),), if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:48:24 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc60779ce-ee, col_values=(('external_ids', {'iface-id': 'c60779ce-eea1-4d7d-9195-4c1c4921a5fb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ba:f7:78', 'vm-uuid': '42579ef7-54dc-4165-a144-61e80fdd5626'}),), if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:48:24 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:48:24 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:48:24 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:48:24 user nova-compute[75176]: INFO os_vif [None req-4f979ef0-f481-4a35-ba16-8c9546dc8634 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:f7:78,bridge_name='br-int',has_traffic_filtering=True,id=c60779ce-eea1-4d7d-9195-4c1c4921a5fb,network=Network(5ec264ad-3459-468c-bdbf-c6a4ef016951),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc60779ce-ee')
Nov 28 15:48:24 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d37bd68-994c-4f04-9625-9b4ca2a3633c tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] [instance: 6d061df5-8dbc-4fc1-9935-d46efc934b58] Allocating IP information in the background. {{(pid=75176) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 15:48:24 user nova-compute[75176]: DEBUG nova.network.neutron [None req-7d37bd68-994c-4f04-9625-9b4ca2a3633c tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] [instance: 6d061df5-8dbc-4fc1-9935-d46efc934b58] allocate_for_instance() {{(pid=75176) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 15:48:24 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-7d37bd68-994c-4f04-9625-9b4ca2a3633c tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] [instance: 6d061df5-8dbc-4fc1-9935-d46efc934b58] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 15:48:24 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-4f979ef0-f481-4a35-ba16-8c9546dc8634 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] No BDM found with device name vda, not building metadata. {{(pid=75176) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 15:48:24 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-4f979ef0-f481-4a35-ba16-8c9546dc8634 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] No VIF found with MAC fa:16:3e:ba:f7:78, not building metadata {{(pid=75176) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 15:48:24 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d37bd68-994c-4f04-9625-9b4ca2a3633c tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] [instance: 6d061df5-8dbc-4fc1-9935-d46efc934b58] Start building block device mappings for instance. {{(pid=75176) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 15:48:24 user nova-compute[75176]: DEBUG nova.policy [None req-7d37bd68-994c-4f04-9625-9b4ca2a3633c tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd8d2394765354c83942d4eafbb437794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3669019a110245d19a8ac85b5b20d2bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75176) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 15:48:24 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d37bd68-994c-4f04-9625-9b4ca2a3633c tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] [instance: 6d061df5-8dbc-4fc1-9935-d46efc934b58] Start spawning the instance on the hypervisor. {{(pid=75176) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 15:48:24 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-7d37bd68-994c-4f04-9625-9b4ca2a3633c tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] [instance: 6d061df5-8dbc-4fc1-9935-d46efc934b58] Creating instance directory {{(pid=75176) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 15:48:24 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-7d37bd68-994c-4f04-9625-9b4ca2a3633c tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] [instance: 6d061df5-8dbc-4fc1-9935-d46efc934b58] Creating image(s)
Nov 28 15:48:24 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d37bd68-994c-4f04-9625-9b4ca2a3633c tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Acquiring lock "/opt/stack/data/nova/instances/6d061df5-8dbc-4fc1-9935-d46efc934b58/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:48:24 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d37bd68-994c-4f04-9625-9b4ca2a3633c tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Lock "/opt/stack/data/nova/instances/6d061df5-8dbc-4fc1-9935-d46efc934b58/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:48:24 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d37bd68-994c-4f04-9625-9b4ca2a3633c tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Lock "/opt/stack/data/nova/instances/6d061df5-8dbc-4fc1-9935-d46efc934b58/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:48:24 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d37bd68-994c-4f04-9625-9b4ca2a3633c tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:48:24 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d37bd68-994c-4f04-9625-9b4ca2a3633c tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json" returned: 0 in 0.215s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:48:24 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d37bd68-994c-4f04-9625-9b4ca2a3633c tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Acquiring lock "5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:48:24 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d37bd68-994c-4f04-9625-9b4ca2a3633c tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Lock "5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:48:24 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d37bd68-994c-4f04-9625-9b4ca2a3633c tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:48:24 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d37bd68-994c-4f04-9625-9b4ca2a3633c tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json" returned: 0 in 0.218s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:48:24 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d37bd68-994c-4f04-9625-9b4ca2a3633c tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2,backing_fmt=raw /opt/stack/data/nova/instances/6d061df5-8dbc-4fc1-9935-d46efc934b58/disk 1073741824 {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:48:24 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d37bd68-994c-4f04-9625-9b4ca2a3633c tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2,backing_fmt=raw /opt/stack/data/nova/instances/6d061df5-8dbc-4fc1-9935-d46efc934b58/disk 1073741824" returned: 0 in 0.056s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:48:24 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d37bd68-994c-4f04-9625-9b4ca2a3633c tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Lock "5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.281s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:48:24 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d37bd68-994c-4f04-9625-9b4ca2a3633c tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:48:24 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d37bd68-994c-4f04-9625-9b4ca2a3633c tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json" returned: 0 in 0.176s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:48:24 user nova-compute[75176]: DEBUG nova.virt.disk.api [None req-7d37bd68-994c-4f04-9625-9b4ca2a3633c tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6d061df5-8dbc-4fc1-9935-d46efc934b58/disk. size=1073741824 {{(pid=75176) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 15:48:24 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d37bd68-994c-4f04-9625-9b4ca2a3633c tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d061df5-8dbc-4fc1-9935-d46efc934b58/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:48:25 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-878047f9-9474-4811-87cd-eb6d0e4fa463 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] [instance: 0e465c9f-e8ab-4a28-bf74-2936a272a0e2] Snapshot image upload complete
Nov 28 15:48:25 user nova-compute[75176]: DEBUG nova.compute.manager [None req-878047f9-9474-4811-87cd-eb6d0e4fa463 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] [instance: 0e465c9f-e8ab-4a28-bf74-2936a272a0e2] Checking state {{(pid=75176) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 15:48:25 user nova-compute[75176]: DEBUG nova.network.neutron [None req-7d37bd68-994c-4f04-9625-9b4ca2a3633c tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] [instance: 6d061df5-8dbc-4fc1-9935-d46efc934b58] Successfully created port: 6912fd20-0a10-42ab-935d-148644fca89b {{(pid=75176) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 15:48:25 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d37bd68-994c-4f04-9625-9b4ca2a3633c tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d061df5-8dbc-4fc1-9935-d46efc934b58/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:48:25 user nova-compute[75176]: DEBUG nova.virt.disk.api [None req-7d37bd68-994c-4f04-9625-9b4ca2a3633c tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Cannot resize image /opt/stack/data/nova/instances/6d061df5-8dbc-4fc1-9935-d46efc934b58/disk to a smaller size. {{(pid=75176) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 15:48:25 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-7d37bd68-994c-4f04-9625-9b4ca2a3633c tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] [instance: 6d061df5-8dbc-4fc1-9935-d46efc934b58] Created local disks {{(pid=75176) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 15:48:25 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-7d37bd68-994c-4f04-9625-9b4ca2a3633c tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] [instance: 6d061df5-8dbc-4fc1-9935-d46efc934b58] Ensure instance console log exists: /opt/stack/data/nova/instances/6d061df5-8dbc-4fc1-9935-d46efc934b58/console.log {{(pid=75176) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 15:48:25 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d37bd68-994c-4f04-9625-9b4ca2a3633c tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:48:25 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d37bd68-994c-4f04-9625-9b4ca2a3633c tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:48:25 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d37bd68-994c-4f04-9625-9b4ca2a3633c tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:48:25 user nova-compute[75176]: INFO nova.compute.manager [None req-878047f9-9474-4811-87cd-eb6d0e4fa463 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] [instance: 0e465c9f-e8ab-4a28-bf74-2936a272a0e2] Shelve offloading
Nov 28 15:48:25 user nova-compute[75176]: INFO nova.virt.libvirt.driver [-] [instance: 0e465c9f-e8ab-4a28-bf74-2936a272a0e2] Instance destroyed successfully.
Nov 28 15:48:25 user nova-compute[75176]: DEBUG nova.compute.manager [None req-878047f9-9474-4811-87cd-eb6d0e4fa463 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] [instance: 0e465c9f-e8ab-4a28-bf74-2936a272a0e2] Checking state {{(pid=75176) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 15:48:25 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-878047f9-9474-4811-87cd-eb6d0e4fa463 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Acquiring lock "refresh_cache-0e465c9f-e8ab-4a28-bf74-2936a272a0e2" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:48:25 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-878047f9-9474-4811-87cd-eb6d0e4fa463 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Acquired lock "refresh_cache-0e465c9f-e8ab-4a28-bf74-2936a272a0e2" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:48:25 user nova-compute[75176]: DEBUG nova.network.neutron [None req-878047f9-9474-4811-87cd-eb6d0e4fa463 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] [instance: 0e465c9f-e8ab-4a28-bf74-2936a272a0e2] Building network info cache for instance {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 15:48:25 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:48:25 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:48:25 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:48:25 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:48:25 user nova-compute[75176]: DEBUG nova.compute.manager [req-bf7ad7ab-c6ed-482a-988e-c7441dbfeb04 req-904d5bb9-6e48-40a9-9d31-d8374d4a950d service nova] [instance: 42579ef7-54dc-4165-a144-61e80fdd5626] Received event network-vif-plugged-c60779ce-eea1-4d7d-9195-4c1c4921a5fb {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:48:25 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-bf7ad7ab-c6ed-482a-988e-c7441dbfeb04 req-904d5bb9-6e48-40a9-9d31-d8374d4a950d service nova] Acquiring lock "42579ef7-54dc-4165-a144-61e80fdd5626-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:48:25 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-bf7ad7ab-c6ed-482a-988e-c7441dbfeb04 req-904d5bb9-6e48-40a9-9d31-d8374d4a950d service nova] Lock "42579ef7-54dc-4165-a144-61e80fdd5626-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:48:25 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-bf7ad7ab-c6ed-482a-988e-c7441dbfeb04 req-904d5bb9-6e48-40a9-9d31-d8374d4a950d service nova] Lock "42579ef7-54dc-4165-a144-61e80fdd5626-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:48:25 user nova-compute[75176]: DEBUG nova.compute.manager [req-bf7ad7ab-c6ed-482a-988e-c7441dbfeb04 req-904d5bb9-6e48-40a9-9d31-d8374d4a950d service nova] [instance: 42579ef7-54dc-4165-a144-61e80fdd5626] No waiting events found dispatching network-vif-plugged-c60779ce-eea1-4d7d-9195-4c1c4921a5fb {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:48:25 user nova-compute[75176]: WARNING nova.compute.manager [req-bf7ad7ab-c6ed-482a-988e-c7441dbfeb04 req-904d5bb9-6e48-40a9-9d31-d8374d4a950d service nova] [instance: 42579ef7-54dc-4165-a144-61e80fdd5626] Received unexpected event network-vif-plugged-c60779ce-eea1-4d7d-9195-4c1c4921a5fb for instance with vm_state building and task_state spawning.
Nov 28 15:48:25 user nova-compute[75176]: DEBUG nova.network.neutron [None req-7d37bd68-994c-4f04-9625-9b4ca2a3633c tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] [instance: 6d061df5-8dbc-4fc1-9935-d46efc934b58] Successfully updated port: 6912fd20-0a10-42ab-935d-148644fca89b {{(pid=75176) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 15:48:25 user nova-compute[75176]: DEBUG nova.network.neutron [None req-878047f9-9474-4811-87cd-eb6d0e4fa463 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] [instance: 0e465c9f-e8ab-4a28-bf74-2936a272a0e2] Updating instance_info_cache with network_info: [{"id": "86effed2-558e-4427-82be-761ca28e6d8c", "address": "fa:16:3e:95:66:57", "network": {"id": "5d0ae041-a67d-4a54-bd53-104c4f44209d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-938551772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "169fdaea89d4431aa6adacdbb76f3546", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86effed2-55", "ovs_interfaceid": "86effed2-558e-4427-82be-761ca28e6d8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:48:25 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d37bd68-994c-4f04-9625-9b4ca2a3633c tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Acquiring lock "refresh_cache-6d061df5-8dbc-4fc1-9935-d46efc934b58" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:48:25 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d37bd68-994c-4f04-9625-9b4ca2a3633c tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Acquired lock "refresh_cache-6d061df5-8dbc-4fc1-9935-d46efc934b58" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:48:25 user nova-compute[75176]: DEBUG nova.network.neutron [None req-7d37bd68-994c-4f04-9625-9b4ca2a3633c tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] [instance: 6d061df5-8dbc-4fc1-9935-d46efc934b58] Building network info cache for instance {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 15:48:25 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-878047f9-9474-4811-87cd-eb6d0e4fa463 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Releasing lock "refresh_cache-0e465c9f-e8ab-4a28-bf74-2936a272a0e2" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:48:25 user nova-compute[75176]: DEBUG nova.compute.manager [req-beef6607-95b6-4bc9-8d4d-53d705ff5095 req-0948781f-f02e-4289-b33f-60de311dd0e1 service nova] [instance: 6d061df5-8dbc-4fc1-9935-d46efc934b58] Received event network-changed-6912fd20-0a10-42ab-935d-148644fca89b {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:48:25 user nova-compute[75176]: DEBUG nova.compute.manager [req-beef6607-95b6-4bc9-8d4d-53d705ff5095 req-0948781f-f02e-4289-b33f-60de311dd0e1 service nova] [instance: 6d061df5-8dbc-4fc1-9935-d46efc934b58] Refreshing instance network info cache due to event network-changed-6912fd20-0a10-42ab-935d-148644fca89b. {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 15:48:25 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-beef6607-95b6-4bc9-8d4d-53d705ff5095 req-0948781f-f02e-4289-b33f-60de311dd0e1 service nova] Acquiring lock "refresh_cache-6d061df5-8dbc-4fc1-9935-d46efc934b58" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:48:25 user nova-compute[75176]: DEBUG nova.network.neutron [None req-7d37bd68-994c-4f04-9625-9b4ca2a3633c tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] [instance: 6d061df5-8dbc-4fc1-9935-d46efc934b58] Instance cache missing network info. {{(pid=75176) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 15:48:26 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:48:26 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:48:26 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:48:26 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:48:26 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:48:26 user nova-compute[75176]: DEBUG nova.network.neutron [None req-7d37bd68-994c-4f04-9625-9b4ca2a3633c tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] [instance: 6d061df5-8dbc-4fc1-9935-d46efc934b58] Updating instance_info_cache with network_info: [{"id": "6912fd20-0a10-42ab-935d-148644fca89b", "address": "fa:16:3e:31:cd:96", "network": {"id": "0478f649-0c69-414b-84c3-3ef4604d6062", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-695624980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3669019a110245d19a8ac85b5b20d2bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6912fd20-0a", "ovs_interfaceid": "6912fd20-0a10-42ab-935d-148644fca89b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:48:26 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d37bd68-994c-4f04-9625-9b4ca2a3633c tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Releasing lock "refresh_cache-6d061df5-8dbc-4fc1-9935-d46efc934b58" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:48:26 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d37bd68-994c-4f04-9625-9b4ca2a3633c tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] [instance: 6d061df5-8dbc-4fc1-9935-d46efc934b58] Instance network_info: |[{"id": "6912fd20-0a10-42ab-935d-148644fca89b", "address": "fa:16:3e:31:cd:96", "network": {"id": "0478f649-0c69-414b-84c3-3ef4604d6062", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-695624980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3669019a110245d19a8ac85b5b20d2bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6912fd20-0a", "ovs_interfaceid": "6912fd20-0a10-42ab-935d-148644fca89b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75176) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 15:48:26 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-beef6607-95b6-4bc9-8d4d-53d705ff5095 req-0948781f-f02e-4289-b33f-60de311dd0e1 service nova] Acquired lock "refresh_cache-6d061df5-8dbc-4fc1-9935-d46efc934b58" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:48:26 user nova-compute[75176]: DEBUG nova.network.neutron [req-beef6607-95b6-4bc9-8d4d-53d705ff5095 req-0948781f-f02e-4289-b33f-60de311dd0e1 service nova] [instance: 6d061df5-8dbc-4fc1-9935-d46efc934b58] Refreshing network info cache for port 6912fd20-0a10-42ab-935d-148644fca89b {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 15:48:26 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-7d37bd68-994c-4f04-9625-9b4ca2a3633c tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] [instance: 6d061df5-8dbc-4fc1-9935-d46efc934b58] Start _get_guest_xml network_info=[{"id": "6912fd20-0a10-42ab-935d-148644fca89b", "address": "fa:16:3e:31:cd:96", "network": {"id": "0478f649-0c69-414b-84c3-3ef4604d6062", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-695624980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3669019a110245d19a8ac85b5b20d2bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6912fd20-0a", "ovs_interfaceid": "6912fd20-0a10-42ab-935d-148644fca89b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T15:35:12Z,direct_url=<?>,disk_format='qcow2',id=1f41819e-c93f-4dc7-b253-37a27bbbbc74,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1b91c5d0672c4224a48df2e1f92688e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T15:35:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'size': 0, 'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'image_id': '1f41819e-c93f-4dc7-b253-37a27bbbbc74'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75176) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 15:48:26 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-7d37bd68-994c-4f04-9625-9b4ca2a3633c tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 15:48:26 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-7d37bd68-994c-4f04-9625-9b4ca2a3633c tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 15:48:26 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-7d37bd68-994c-4f04-9625-9b4ca2a3633c tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75176) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 15:48:26 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-7d37bd68-994c-4f04-9625-9b4ca2a3633c tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] CPU controller missing on host. {{(pid=75176) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 15:48:26 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-7d37bd68-994c-4f04-9625-9b4ca2a3633c tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75176) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 15:48:26 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-7d37bd68-994c-4f04-9625-9b4ca2a3633c tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] CPU controller found on host. {{(pid=75176) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 15:48:26 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-7d37bd68-994c-4f04-9625-9b4ca2a3633c tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75176) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 15:48:26 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-7d37bd68-994c-4f04-9625-9b4ca2a3633c tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T15:35:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T15:35:12Z,direct_url=<?>,disk_format='qcow2',id=1f41819e-c93f-4dc7-b253-37a27bbbbc74,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1b91c5d0672c4224a48df2e1f92688e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T15:35:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 15:48:26 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-7d37bd68-994c-4f04-9625-9b4ca2a3633c tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Flavor limits 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 15:48:26 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-7d37bd68-994c-4f04-9625-9b4ca2a3633c tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Image limits 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 15:48:26 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-7d37bd68-994c-4f04-9625-9b4ca2a3633c tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Flavor pref 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 15:48:26 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-7d37bd68-994c-4f04-9625-9b4ca2a3633c tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Image pref 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 15:48:26 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-7d37bd68-994c-4f04-9625-9b4ca2a3633c tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 15:48:26 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-7d37bd68-994c-4f04-9625-9b4ca2a3633c tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 15:48:26 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-7d37bd68-994c-4f04-9625-9b4ca2a3633c tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75176) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 15:48:26 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-7d37bd68-994c-4f04-9625-9b4ca2a3633c tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Got 1 possible topologies {{(pid=75176) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 15:48:26 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-7d37bd68-994c-4f04-9625-9b4ca2a3633c tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 15:48:26 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-7d37bd68-994c-4f04-9625-9b4ca2a3633c tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 15:48:26 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-7d37bd68-994c-4f04-9625-9b4ca2a3633c tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T15:48:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1273199637',display_name='tempest-VolumesSnapshotTestJSON-instance-1273199637',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1273199637',id=28,image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLWtNGYkqWiD928l3ftSnYSOANR278BSmNrLe+mPNcMBy2+95Ap31KqVLPeL83gUlz+8R5SfiaSPtCa2BU3WpGMIb1OcUc3iLCPkP1Jkh7IbaNU+XV7puCVu7g88Usb6NA==',key_name='tempest-keypair-1769904179',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3669019a110245d19a8ac85b5b20d2bd',ramdisk_id='',reservation_id='r-nrfg00sn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-2135242619',owner_user_name='tempest-VolumesSnapshotTestJSON-2135242619-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T15:48:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d8d2394765354c83942d4eafbb437794',uuid=6d061df5-8dbc-4fc1-9935-d46efc934b58,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6912fd20-0a10-42ab-935d-148644fca89b", "address": "fa:16:3e:31:cd:96", "network": {"id": "0478f649-0c69-414b-84c3-3ef4604d6062", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-695624980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3669019a110245d19a8ac85b5b20d2bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6912fd20-0a", "ovs_interfaceid": "6912fd20-0a10-42ab-935d-148644fca89b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75176) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 15:48:26 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-7d37bd68-994c-4f04-9625-9b4ca2a3633c tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Converting VIF {"id": "6912fd20-0a10-42ab-935d-148644fca89b", "address": "fa:16:3e:31:cd:96", "network": {"id": "0478f649-0c69-414b-84c3-3ef4604d6062", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-695624980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3669019a110245d19a8ac85b5b20d2bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6912fd20-0a", "ovs_interfaceid": "6912fd20-0a10-42ab-935d-148644fca89b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:48:26 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-7d37bd68-994c-4f04-9625-9b4ca2a3633c tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:31:cd:96,bridge_name='br-int',has_traffic_filtering=True,id=6912fd20-0a10-42ab-935d-148644fca89b,network=Network(0478f649-0c69-414b-84c3-3ef4604d6062),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6912fd20-0a') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:48:26 user nova-compute[75176]: DEBUG nova.objects.instance [None req-7d37bd68-994c-4f04-9625-9b4ca2a3633c tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Lazy-loading 'pci_devices' on Instance uuid 6d061df5-8dbc-4fc1-9935-d46efc934b58 {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:48:26 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-7d37bd68-994c-4f04-9625-9b4ca2a3633c tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] [instance: 6d061df5-8dbc-4fc1-9935-d46efc934b58] End _get_guest_xml xml=<domain type="kvm">
Nov 28 15:48:26 user nova-compute[75176]:   <uuid>6d061df5-8dbc-4fc1-9935-d46efc934b58</uuid>
Nov 28 15:48:26 user nova-compute[75176]:   <name>instance-0000001c</name>
Nov 28 15:48:26 user nova-compute[75176]:   <memory>524288</memory>
Nov 28 15:48:26 user nova-compute[75176]:   <vcpu>1</vcpu>
Nov 28 15:48:26 user nova-compute[75176]:   <metadata>
Nov 28 15:48:26 user nova-compute[75176]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 15:48:26 user nova-compute[75176]:       <nova:package version="0.0.0"/>
Nov 28 15:48:26 user nova-compute[75176]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1273199637</nova:name>
Nov 28 15:48:26 user nova-compute[75176]:       <nova:creationTime>2023-11-28 15:48:26</nova:creationTime>
Nov 28 15:48:26 user nova-compute[75176]:       <nova:flavor name="m1.tiny">
Nov 28 15:48:26 user nova-compute[75176]:         <nova:memory>512</nova:memory>
Nov 28 15:48:26 user nova-compute[75176]:         <nova:disk>1</nova:disk>
Nov 28 15:48:26 user nova-compute[75176]:         <nova:swap>0</nova:swap>
Nov 28 15:48:26 user nova-compute[75176]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 15:48:26 user nova-compute[75176]:         <nova:vcpus>1</nova:vcpus>
Nov 28 15:48:26 user nova-compute[75176]:       </nova:flavor>
Nov 28 15:48:26 user nova-compute[75176]:       <nova:owner>
Nov 28 15:48:26 user nova-compute[75176]:         <nova:user uuid="d8d2394765354c83942d4eafbb437794">tempest-VolumesSnapshotTestJSON-2135242619-project-member</nova:user>
Nov 28 15:48:26 user nova-compute[75176]:         <nova:project uuid="3669019a110245d19a8ac85b5b20d2bd">tempest-VolumesSnapshotTestJSON-2135242619</nova:project>
Nov 28 15:48:26 user nova-compute[75176]:       </nova:owner>
Nov 28 15:48:26 user nova-compute[75176]:       <nova:root type="image" uuid="1f41819e-c93f-4dc7-b253-37a27bbbbc74"/>
Nov 28 15:48:26 user nova-compute[75176]:       <nova:ports>
Nov 28 15:48:26 user nova-compute[75176]:         <nova:port uuid="6912fd20-0a10-42ab-935d-148644fca89b">
Nov 28 15:48:26 user nova-compute[75176]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 28 15:48:26 user nova-compute[75176]:         </nova:port>
Nov 28 15:48:26 user nova-compute[75176]:       </nova:ports>
Nov 28 15:48:26 user nova-compute[75176]:     </nova:instance>
Nov 28 15:48:26 user nova-compute[75176]:   </metadata>
Nov 28 15:48:26 user nova-compute[75176]:   <sysinfo type="smbios">
Nov 28 15:48:26 user nova-compute[75176]:     <system>
Nov 28 15:48:26 user nova-compute[75176]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 15:48:26 user nova-compute[75176]:       <entry name="product">OpenStack Nova</entry>
Nov 28 15:48:26 user nova-compute[75176]:       <entry name="version">0.0.0</entry>
Nov 28 15:48:26 user nova-compute[75176]:       <entry name="serial">6d061df5-8dbc-4fc1-9935-d46efc934b58</entry>
Nov 28 15:48:26 user nova-compute[75176]:       <entry name="uuid">6d061df5-8dbc-4fc1-9935-d46efc934b58</entry>
Nov 28 15:48:26 user nova-compute[75176]:       <entry name="family">Virtual Machine</entry>
Nov 28 15:48:26 user nova-compute[75176]:     </system>
Nov 28 15:48:26 user nova-compute[75176]:   </sysinfo>
Nov 28 15:48:26 user nova-compute[75176]:   <os>
Nov 28 15:48:26 user nova-compute[75176]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 15:48:26 user nova-compute[75176]:     <boot dev="hd"/>
Nov 28 15:48:26 user nova-compute[75176]:     <smbios mode="sysinfo"/>
Nov 28 15:48:26 user nova-compute[75176]:   </os>
Nov 28 15:48:26 user nova-compute[75176]:   <features>
Nov 28 15:48:26 user nova-compute[75176]:     <acpi/>
Nov 28 15:48:26 user nova-compute[75176]:     <apic/>
Nov 28 15:48:26 user nova-compute[75176]:     <vmcoreinfo/>
Nov 28 15:48:26 user nova-compute[75176]:   </features>
Nov 28 15:48:26 user nova-compute[75176]:   <clock offset="utc">
Nov 28 15:48:26 user nova-compute[75176]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 15:48:26 user nova-compute[75176]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 15:48:26 user nova-compute[75176]:     <timer name="hpet" present="no"/>
Nov 28 15:48:26 user nova-compute[75176]:   </clock>
Nov 28 15:48:26 user nova-compute[75176]:   <cpu mode="custom" match="exact">
Nov 28 15:48:26 user nova-compute[75176]:     <model>Nehalem</model>
Nov 28 15:48:26 user nova-compute[75176]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 15:48:26 user nova-compute[75176]:   </cpu>
Nov 28 15:48:26 user nova-compute[75176]:   <devices>
Nov 28 15:48:26 user nova-compute[75176]:     <disk type="file" device="disk">
Nov 28 15:48:26 user nova-compute[75176]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 15:48:26 user nova-compute[75176]:       <source file="/opt/stack/data/nova/instances/6d061df5-8dbc-4fc1-9935-d46efc934b58/disk"/>
Nov 28 15:48:26 user nova-compute[75176]:       <target dev="vda" bus="virtio"/>
Nov 28 15:48:26 user nova-compute[75176]:     </disk>
Nov 28 15:48:26 user nova-compute[75176]:     <interface type="ethernet">
Nov 28 15:48:26 user nova-compute[75176]:       <mac address="fa:16:3e:31:cd:96"/>
Nov 28 15:48:26 user nova-compute[75176]:       <model type="virtio"/>
Nov 28 15:48:26 user nova-compute[75176]:       <mtu size="1442"/>
Nov 28 15:48:26 user nova-compute[75176]:       <target dev="tap6912fd20-0a"/>
Nov 28 15:48:26 user nova-compute[75176]:     </interface>
Nov 28 15:48:26 user nova-compute[75176]:     <serial type="pty">
Nov 28 15:48:26 user nova-compute[75176]:       <log file="/opt/stack/data/nova/instances/6d061df5-8dbc-4fc1-9935-d46efc934b58/console.log" append="off"/>
Nov 28 15:48:26 user nova-compute[75176]:     </serial>
Nov 28 15:48:26 user nova-compute[75176]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 15:48:26 user nova-compute[75176]:     <video>
Nov 28 15:48:26 user nova-compute[75176]:       <model type="virtio"/>
Nov 28 15:48:26 user nova-compute[75176]:     </video>
Nov 28 15:48:26 user nova-compute[75176]:     <rng model="virtio">
Nov 28 15:48:26 user nova-compute[75176]:       <backend model="random">/dev/urandom</backend>
Nov 28 15:48:26 user nova-compute[75176]:     </rng>
Nov 28 15:48:26 user nova-compute[75176]:     <controller type="usb" index="0" model="none"/>
Nov 28 15:48:26 user nova-compute[75176]:     <memballoon model="virtio">
Nov 28 15:48:26 user nova-compute[75176]:       <stats period="10"/>
Nov 28 15:48:26 user nova-compute[75176]:     </memballoon>
Nov 28 15:48:26 user nova-compute[75176]:   </devices>
Nov 28 15:48:26 user nova-compute[75176]: </domain>
Nov 28 15:48:26 user nova-compute[75176]:  {{(pid=75176) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 15:48:26 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-7d37bd68-994c-4f04-9625-9b4ca2a3633c tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T15:48:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1273199637',display_name='tempest-VolumesSnapshotTestJSON-instance-1273199637',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1273199637',id=28,image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLWtNGYkqWiD928l3ftSnYSOANR278BSmNrLe+mPNcMBy2+95Ap31KqVLPeL83gUlz+8R5SfiaSPtCa2BU3WpGMIb1OcUc3iLCPkP1Jkh7IbaNU+XV7puCVu7g88Usb6NA==',key_name='tempest-keypair-1769904179',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3669019a110245d19a8ac85b5b20d2bd',ramdisk_id='',reservation_id='r-nrfg00sn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-2135242619',owner_user_name='tempest-VolumesSnapshotTestJSON-2135242619-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T15:48:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d8d2394765354c83942d4eafbb437794',uuid=6d061df5-8dbc-4fc1-9935-d46efc934b58,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6912fd20-0a10-42ab-935d-148644fca89b", "address": "fa:16:3e:31:cd:96", "network": {"id": "0478f649-0c69-414b-84c3-3ef4604d6062", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-695624980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3669019a110245d19a8ac85b5b20d2bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6912fd20-0a", "ovs_interfaceid": "6912fd20-0a10-42ab-935d-148644fca89b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 15:48:26 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-7d37bd68-994c-4f04-9625-9b4ca2a3633c tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Converting VIF {"id": "6912fd20-0a10-42ab-935d-148644fca89b", "address": "fa:16:3e:31:cd:96", "network": {"id": "0478f649-0c69-414b-84c3-3ef4604d6062", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-695624980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3669019a110245d19a8ac85b5b20d2bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6912fd20-0a", "ovs_interfaceid": "6912fd20-0a10-42ab-935d-148644fca89b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:48:26 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-7d37bd68-994c-4f04-9625-9b4ca2a3633c tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:31:cd:96,bridge_name='br-int',has_traffic_filtering=True,id=6912fd20-0a10-42ab-935d-148644fca89b,network=Network(0478f649-0c69-414b-84c3-3ef4604d6062),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6912fd20-0a') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:48:26 user nova-compute[75176]: DEBUG os_vif [None req-7d37bd68-994c-4f04-9625-9b4ca2a3633c tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:31:cd:96,bridge_name='br-int',has_traffic_filtering=True,id=6912fd20-0a10-42ab-935d-148644fca89b,network=Network(0478f649-0c69-414b-84c3-3ef4604d6062),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6912fd20-0a') {{(pid=75176) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 15:48:26 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:48:26 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:48:26 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 15:48:26 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:48:26 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '766c1d82-b7fb-5218-b727-5f6c6f9be73b', '_type': 'linux-noop'}}, row=False) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:48:26 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:48:26 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:48:26 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:48:26 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:48:26 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6912fd20-0a, may_exist=True, interface_attrs={}) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:48:26 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6912fd20-0a, col_values=(('qos', UUID('1c2b23b8-209f-4ac1-9cc7-cfbf0ffe725c')),), if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:48:26 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6912fd20-0a, col_values=(('external_ids', {'iface-id': '6912fd20-0a10-42ab-935d-148644fca89b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:31:cd:96', 'vm-uuid': '6d061df5-8dbc-4fc1-9935-d46efc934b58'}),), if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:48:26 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:48:26 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:48:26 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:48:26 user nova-compute[75176]: INFO os_vif [None req-7d37bd68-994c-4f04-9625-9b4ca2a3633c tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:31:cd:96,bridge_name='br-int',has_traffic_filtering=True,id=6912fd20-0a10-42ab-935d-148644fca89b,network=Network(0478f649-0c69-414b-84c3-3ef4604d6062),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6912fd20-0a')
Nov 28 15:48:26 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-7d37bd68-994c-4f04-9625-9b4ca2a3633c tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] No BDM found with device name vda, not building metadata. {{(pid=75176) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 15:48:26 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-7d37bd68-994c-4f04-9625-9b4ca2a3633c tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] No VIF found with MAC fa:16:3e:31:cd:96, not building metadata {{(pid=75176) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 15:48:26 user nova-compute[75176]: INFO nova.virt.libvirt.driver [-] [instance: 0e465c9f-e8ab-4a28-bf74-2936a272a0e2] Instance destroyed successfully.
Nov 28 15:48:26 user nova-compute[75176]: DEBUG nova.objects.instance [None req-878047f9-9474-4811-87cd-eb6d0e4fa463 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Lazy-loading 'resources' on Instance uuid 0e465c9f-e8ab-4a28-bf74-2936a272a0e2 {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:48:26 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-878047f9-9474-4811-87cd-eb6d0e4fa463 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T15:46:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-447740496',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-447740496',id=23,image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF/pYrzcTrtQ3nwooZBOWnAPi4M5mz16IJrnTqwXqwCVaE4JIJYdwHlVPfsp02/e05TmymOA0Zx46jNuNLVfWRTBx9AVrbXibAt/hO6ZnAPzuudKre3uKffG2AkKZrLXTw==',key_name='tempest-keypair-1203625989',keypairs=<?>,launch_index=0,launched_at=2023-11-28T15:46:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='169fdaea89d4431aa6adacdbb76f3546',ramdisk_id='',reservation_id='r-avjj7pv9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1264107218',owner_user_name='tempest-AttachVolumeShelveTestJSON-1264107218-project-member',shelved_at='2023-11-28T15:48:25.137372',shelved_host='user',shelved_image_id='835977a9-d2bb-48e3-aede-ee974513e28e'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T15:48:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3146d6b1e7324ebaa62ade09f1d1c68f',uuid=0e465c9f-e8ab-4a28-bf74-2936a272a0e2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "86effed2-558e-4427-82be-761ca28e6d8c", "address": "fa:16:3e:95:66:57", "network": {"id": "5d0ae041-a67d-4a54-bd53-104c4f44209d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-938551772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "169fdaea89d4431aa6adacdbb76f3546", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86effed2-55", "ovs_interfaceid": "86effed2-558e-4427-82be-761ca28e6d8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 15:48:26 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-878047f9-9474-4811-87cd-eb6d0e4fa463 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Converting VIF {"id": "86effed2-558e-4427-82be-761ca28e6d8c", "address": "fa:16:3e:95:66:57", "network": {"id": "5d0ae041-a67d-4a54-bd53-104c4f44209d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-938551772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "169fdaea89d4431aa6adacdbb76f3546", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86effed2-55", "ovs_interfaceid": "86effed2-558e-4427-82be-761ca28e6d8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:48:26 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-878047f9-9474-4811-87cd-eb6d0e4fa463 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:66:57,bridge_name='br-int',has_traffic_filtering=True,id=86effed2-558e-4427-82be-761ca28e6d8c,network=Network(5d0ae041-a67d-4a54-bd53-104c4f44209d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86effed2-55') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:48:26 user nova-compute[75176]: DEBUG os_vif [None req-878047f9-9474-4811-87cd-eb6d0e4fa463 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:66:57,bridge_name='br-int',has_traffic_filtering=True,id=86effed2-558e-4427-82be-761ca28e6d8c,network=Network(5d0ae041-a67d-4a54-bd53-104c4f44209d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86effed2-55') {{(pid=75176) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 15:48:26 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:48:26 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap86effed2-55, bridge=br-int, if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:48:26 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:48:26 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:48:26 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:48:26 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:48:26 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=268d4ec1-5250-4277-b0f9-6a7cc6dbc0a3) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:48:26 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:48:26 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:48:26 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:48:26 user nova-compute[75176]: INFO os_vif [None req-878047f9-9474-4811-87cd-eb6d0e4fa463 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:66:57,bridge_name='br-int',has_traffic_filtering=True,id=86effed2-558e-4427-82be-761ca28e6d8c,network=Network(5d0ae041-a67d-4a54-bd53-104c4f44209d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86effed2-55')
Nov 28 15:48:26 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-878047f9-9474-4811-87cd-eb6d0e4fa463 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] [instance: 0e465c9f-e8ab-4a28-bf74-2936a272a0e2] Deleting instance files /opt/stack/data/nova/instances/0e465c9f-e8ab-4a28-bf74-2936a272a0e2_del
Nov 28 15:48:26 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-878047f9-9474-4811-87cd-eb6d0e4fa463 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] [instance: 0e465c9f-e8ab-4a28-bf74-2936a272a0e2] Deletion of /opt/stack/data/nova/instances/0e465c9f-e8ab-4a28-bf74-2936a272a0e2_del complete
Nov 28 15:48:26 user nova-compute[75176]: DEBUG nova.network.neutron [req-beef6607-95b6-4bc9-8d4d-53d705ff5095 req-0948781f-f02e-4289-b33f-60de311dd0e1 service nova] [instance: 6d061df5-8dbc-4fc1-9935-d46efc934b58] Updated VIF entry in instance network info cache for port 6912fd20-0a10-42ab-935d-148644fca89b. {{(pid=75176) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 15:48:26 user nova-compute[75176]: DEBUG nova.network.neutron [req-beef6607-95b6-4bc9-8d4d-53d705ff5095 req-0948781f-f02e-4289-b33f-60de311dd0e1 service nova] [instance: 6d061df5-8dbc-4fc1-9935-d46efc934b58] Updating instance_info_cache with network_info: [{"id": "6912fd20-0a10-42ab-935d-148644fca89b", "address": "fa:16:3e:31:cd:96", "network": {"id": "0478f649-0c69-414b-84c3-3ef4604d6062", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-695624980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3669019a110245d19a8ac85b5b20d2bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6912fd20-0a", "ovs_interfaceid": "6912fd20-0a10-42ab-935d-148644fca89b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:48:26 user nova-compute[75176]: INFO nova.scheduler.client.report [None req-878047f9-9474-4811-87cd-eb6d0e4fa463 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Deleted allocations for instance 0e465c9f-e8ab-4a28-bf74-2936a272a0e2
Nov 28 15:48:26 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-beef6607-95b6-4bc9-8d4d-53d705ff5095 req-0948781f-f02e-4289-b33f-60de311dd0e1 service nova] Releasing lock "refresh_cache-6d061df5-8dbc-4fc1-9935-d46efc934b58" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:48:26 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-878047f9-9474-4811-87cd-eb6d0e4fa463 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:48:26 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-878047f9-9474-4811-87cd-eb6d0e4fa463 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:48:26 user nova-compute[75176]: DEBUG nova.objects.instance [None req-878047f9-9474-4811-87cd-eb6d0e4fa463 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Lazy-loading 'numa_topology' on Instance uuid 0e465c9f-e8ab-4a28-bf74-2936a272a0e2 {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:48:26 user nova-compute[75176]: DEBUG nova.objects.base [None req-878047f9-9474-4811-87cd-eb6d0e4fa463 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Object Instance<0e465c9f-e8ab-4a28-bf74-2936a272a0e2> lazy-loaded attributes: resources,numa_topology {{(pid=75176) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 15:48:27 user nova-compute[75176]: DEBUG nova.compute.provider_tree [None req-878047f9-9474-4811-87cd-eb6d0e4fa463 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Inventory has not changed in ProviderTree for provider: b37848d8-f401-4155-a029-b0ffa09ff85b {{(pid=75176) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 15:48:27 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-878047f9-9474-4811-87cd-eb6d0e4fa463 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Inventory has not changed for provider b37848d8-f401-4155-a029-b0ffa09ff85b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75176) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 15:48:27 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-878047f9-9474-4811-87cd-eb6d0e4fa463 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.546s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:48:27 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-878047f9-9474-4811-87cd-eb6d0e4fa463 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Lock "0e465c9f-e8ab-4a28-bf74-2936a272a0e2" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 7.333s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:48:27 user nova-compute[75176]: DEBUG nova.compute.manager [None req-4f979ef0-f481-4a35-ba16-8c9546dc8634 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: 42579ef7-54dc-4165-a144-61e80fdd5626] Instance event wait completed in 0 seconds for  {{(pid=75176) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 15:48:27 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-4f979ef0-f481-4a35-ba16-8c9546dc8634 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: 42579ef7-54dc-4165-a144-61e80fdd5626] Guest created on hypervisor {{(pid=75176) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 15:48:27 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:48:27 user nova-compute[75176]: INFO nova.virt.libvirt.driver [-] [instance: 42579ef7-54dc-4165-a144-61e80fdd5626] Instance spawned successfully.
Nov 28 15:48:27 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-4f979ef0-f481-4a35-ba16-8c9546dc8634 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: 42579ef7-54dc-4165-a144-61e80fdd5626] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 15:48:27 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:48:27 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:48:27 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-4f979ef0-f481-4a35-ba16-8c9546dc8634 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: 42579ef7-54dc-4165-a144-61e80fdd5626] Found default for hw_cdrom_bus of ide {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:48:27 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-4f979ef0-f481-4a35-ba16-8c9546dc8634 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: 42579ef7-54dc-4165-a144-61e80fdd5626] Found default for hw_disk_bus of virtio {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:48:27 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-4f979ef0-f481-4a35-ba16-8c9546dc8634 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: 42579ef7-54dc-4165-a144-61e80fdd5626] Found default for hw_input_bus of None {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:48:27 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-4f979ef0-f481-4a35-ba16-8c9546dc8634 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: 42579ef7-54dc-4165-a144-61e80fdd5626] Found default for hw_pointer_model of None {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:48:27 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-4f979ef0-f481-4a35-ba16-8c9546dc8634 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: 42579ef7-54dc-4165-a144-61e80fdd5626] Found default for hw_video_model of virtio {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:48:27 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-4f979ef0-f481-4a35-ba16-8c9546dc8634 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: 42579ef7-54dc-4165-a144-61e80fdd5626] Found default for hw_vif_model of virtio {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:48:27 user nova-compute[75176]: DEBUG nova.compute.manager [req-f1d15a00-aa16-4d6f-8dc4-78ff5d8ec1b6 req-bbe40f3a-7fcd-4712-bbb0-f30bad391ea9 service nova] [instance: 42579ef7-54dc-4165-a144-61e80fdd5626] Received event network-vif-plugged-c60779ce-eea1-4d7d-9195-4c1c4921a5fb {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:48:27 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-f1d15a00-aa16-4d6f-8dc4-78ff5d8ec1b6 req-bbe40f3a-7fcd-4712-bbb0-f30bad391ea9 service nova] Acquiring lock "42579ef7-54dc-4165-a144-61e80fdd5626-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:48:27 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-f1d15a00-aa16-4d6f-8dc4-78ff5d8ec1b6 req-bbe40f3a-7fcd-4712-bbb0-f30bad391ea9 service nova] Lock "42579ef7-54dc-4165-a144-61e80fdd5626-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:48:27 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-f1d15a00-aa16-4d6f-8dc4-78ff5d8ec1b6 req-bbe40f3a-7fcd-4712-bbb0-f30bad391ea9 service nova] Lock "42579ef7-54dc-4165-a144-61e80fdd5626-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:48:27 user nova-compute[75176]: DEBUG nova.compute.manager [req-f1d15a00-aa16-4d6f-8dc4-78ff5d8ec1b6 req-bbe40f3a-7fcd-4712-bbb0-f30bad391ea9 service nova] [instance: 42579ef7-54dc-4165-a144-61e80fdd5626] No waiting events found dispatching network-vif-plugged-c60779ce-eea1-4d7d-9195-4c1c4921a5fb {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:48:27 user nova-compute[75176]: WARNING nova.compute.manager [req-f1d15a00-aa16-4d6f-8dc4-78ff5d8ec1b6 req-bbe40f3a-7fcd-4712-bbb0-f30bad391ea9 service nova] [instance: 42579ef7-54dc-4165-a144-61e80fdd5626] Received unexpected event network-vif-plugged-c60779ce-eea1-4d7d-9195-4c1c4921a5fb for instance with vm_state building and task_state spawning.
Nov 28 15:48:28 user nova-compute[75176]: INFO nova.compute.manager [None req-4f979ef0-f481-4a35-ba16-8c9546dc8634 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: 42579ef7-54dc-4165-a144-61e80fdd5626] Took 5.63 seconds to spawn the instance on the hypervisor.
Nov 28 15:48:28 user nova-compute[75176]: DEBUG nova.compute.manager [None req-4f979ef0-f481-4a35-ba16-8c9546dc8634 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: 42579ef7-54dc-4165-a144-61e80fdd5626] Checking state {{(pid=75176) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 15:48:28 user nova-compute[75176]: INFO nova.compute.manager [None req-4f979ef0-f481-4a35-ba16-8c9546dc8634 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: 42579ef7-54dc-4165-a144-61e80fdd5626] Took 14.17 seconds to build instance.
Nov 28 15:48:28 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-4f979ef0-f481-4a35-ba16-8c9546dc8634 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Lock "42579ef7-54dc-4165-a144-61e80fdd5626" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.277s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:48:28 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:48:28 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:48:28 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:48:28 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:48:29 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:48:30 user nova-compute[75176]: DEBUG nova.compute.manager [req-1d248cf1-b296-4511-a96d-d3f9b2a529ef req-75395bb1-e9d4-426a-be31-2c9cf9509dcb service nova] [instance: 6d061df5-8dbc-4fc1-9935-d46efc934b58] Received event network-vif-plugged-6912fd20-0a10-42ab-935d-148644fca89b {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:48:30 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-1d248cf1-b296-4511-a96d-d3f9b2a529ef req-75395bb1-e9d4-426a-be31-2c9cf9509dcb service nova] Acquiring lock "6d061df5-8dbc-4fc1-9935-d46efc934b58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:48:30 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-1d248cf1-b296-4511-a96d-d3f9b2a529ef req-75395bb1-e9d4-426a-be31-2c9cf9509dcb service nova] Lock "6d061df5-8dbc-4fc1-9935-d46efc934b58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:48:30 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-1d248cf1-b296-4511-a96d-d3f9b2a529ef req-75395bb1-e9d4-426a-be31-2c9cf9509dcb service nova] Lock "6d061df5-8dbc-4fc1-9935-d46efc934b58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:48:30 user nova-compute[75176]: DEBUG nova.compute.manager [req-1d248cf1-b296-4511-a96d-d3f9b2a529ef req-75395bb1-e9d4-426a-be31-2c9cf9509dcb service nova] [instance: 6d061df5-8dbc-4fc1-9935-d46efc934b58] No waiting events found dispatching network-vif-plugged-6912fd20-0a10-42ab-935d-148644fca89b {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:48:30 user nova-compute[75176]: WARNING nova.compute.manager [req-1d248cf1-b296-4511-a96d-d3f9b2a529ef req-75395bb1-e9d4-426a-be31-2c9cf9509dcb service nova] [instance: 6d061df5-8dbc-4fc1-9935-d46efc934b58] Received unexpected event network-vif-plugged-6912fd20-0a10-42ab-935d-148644fca89b for instance with vm_state building and task_state spawning.
Nov 28 15:48:30 user nova-compute[75176]: DEBUG nova.compute.manager [req-1d248cf1-b296-4511-a96d-d3f9b2a529ef req-75395bb1-e9d4-426a-be31-2c9cf9509dcb service nova] [instance: 6d061df5-8dbc-4fc1-9935-d46efc934b58] Received event network-vif-plugged-6912fd20-0a10-42ab-935d-148644fca89b {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:48:30 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-1d248cf1-b296-4511-a96d-d3f9b2a529ef req-75395bb1-e9d4-426a-be31-2c9cf9509dcb service nova] Acquiring lock "6d061df5-8dbc-4fc1-9935-d46efc934b58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:48:30 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-1d248cf1-b296-4511-a96d-d3f9b2a529ef req-75395bb1-e9d4-426a-be31-2c9cf9509dcb service nova] Lock "6d061df5-8dbc-4fc1-9935-d46efc934b58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:48:30 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-1d248cf1-b296-4511-a96d-d3f9b2a529ef req-75395bb1-e9d4-426a-be31-2c9cf9509dcb service nova] Lock "6d061df5-8dbc-4fc1-9935-d46efc934b58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:48:30 user nova-compute[75176]: DEBUG nova.compute.manager [req-1d248cf1-b296-4511-a96d-d3f9b2a529ef req-75395bb1-e9d4-426a-be31-2c9cf9509dcb service nova] [instance: 6d061df5-8dbc-4fc1-9935-d46efc934b58] No waiting events found dispatching network-vif-plugged-6912fd20-0a10-42ab-935d-148644fca89b {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:48:30 user nova-compute[75176]: WARNING nova.compute.manager [req-1d248cf1-b296-4511-a96d-d3f9b2a529ef req-75395bb1-e9d4-426a-be31-2c9cf9509dcb service nova] [instance: 6d061df5-8dbc-4fc1-9935-d46efc934b58] Received unexpected event network-vif-plugged-6912fd20-0a10-42ab-935d-148644fca89b for instance with vm_state building and task_state spawning.
Nov 28 15:48:30 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d37bd68-994c-4f04-9625-9b4ca2a3633c tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] [instance: 6d061df5-8dbc-4fc1-9935-d46efc934b58] Instance event wait completed in 0 seconds for  {{(pid=75176) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 15:48:30 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-7d37bd68-994c-4f04-9625-9b4ca2a3633c tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] [instance: 6d061df5-8dbc-4fc1-9935-d46efc934b58] Guest created on hypervisor {{(pid=75176) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 15:48:30 user nova-compute[75176]: INFO nova.virt.libvirt.driver [-] [instance: 6d061df5-8dbc-4fc1-9935-d46efc934b58] Instance spawned successfully.
Nov 28 15:48:30 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-7d37bd68-994c-4f04-9625-9b4ca2a3633c tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] [instance: 6d061df5-8dbc-4fc1-9935-d46efc934b58] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 15:48:30 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-7d37bd68-994c-4f04-9625-9b4ca2a3633c tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] [instance: 6d061df5-8dbc-4fc1-9935-d46efc934b58] Found default for hw_cdrom_bus of ide {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:48:30 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-7d37bd68-994c-4f04-9625-9b4ca2a3633c tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] [instance: 6d061df5-8dbc-4fc1-9935-d46efc934b58] Found default for hw_disk_bus of virtio {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:48:30 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-7d37bd68-994c-4f04-9625-9b4ca2a3633c tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] [instance: 6d061df5-8dbc-4fc1-9935-d46efc934b58] Found default for hw_input_bus of None {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:48:30 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-7d37bd68-994c-4f04-9625-9b4ca2a3633c tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] [instance: 6d061df5-8dbc-4fc1-9935-d46efc934b58] Found default for hw_pointer_model of None {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:48:30 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-7d37bd68-994c-4f04-9625-9b4ca2a3633c tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] [instance: 6d061df5-8dbc-4fc1-9935-d46efc934b58] Found default for hw_video_model of virtio {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:48:30 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-7d37bd68-994c-4f04-9625-9b4ca2a3633c tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] [instance: 6d061df5-8dbc-4fc1-9935-d46efc934b58] Found default for hw_vif_model of virtio {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:48:30 user nova-compute[75176]: INFO nova.compute.manager [None req-7d37bd68-994c-4f04-9625-9b4ca2a3633c tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] [instance: 6d061df5-8dbc-4fc1-9935-d46efc934b58] Took 6.15 seconds to spawn the instance on the hypervisor.
Nov 28 15:48:30 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d37bd68-994c-4f04-9625-9b4ca2a3633c tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] [instance: 6d061df5-8dbc-4fc1-9935-d46efc934b58] Checking state {{(pid=75176) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 15:48:30 user nova-compute[75176]: INFO nova.compute.manager [None req-7d37bd68-994c-4f04-9625-9b4ca2a3633c tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] [instance: 6d061df5-8dbc-4fc1-9935-d46efc934b58] Took 7.03 seconds to build instance.
Nov 28 15:48:30 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d37bd68-994c-4f04-9625-9b4ca2a3633c tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Lock "6d061df5-8dbc-4fc1-9935-d46efc934b58" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.145s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:48:31 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:48:34 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:48:36 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:48:39 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:48:40 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-ae515dcc-f1cd-43cb-9750-766185b59fc3 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Acquiring lock "e02d1e69-5e74-43c3-8546-6044d31145f2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:48:40 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-ae515dcc-f1cd-43cb-9750-766185b59fc3 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Lock "e02d1e69-5e74-43c3-8546-6044d31145f2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:48:40 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-ae515dcc-f1cd-43cb-9750-766185b59fc3 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Acquiring lock "e02d1e69-5e74-43c3-8546-6044d31145f2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:48:40 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-ae515dcc-f1cd-43cb-9750-766185b59fc3 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Lock "e02d1e69-5e74-43c3-8546-6044d31145f2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:48:40 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-ae515dcc-f1cd-43cb-9750-766185b59fc3 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Lock "e02d1e69-5e74-43c3-8546-6044d31145f2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:48:40 user nova-compute[75176]: INFO nova.compute.manager [None req-ae515dcc-f1cd-43cb-9750-766185b59fc3 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] [instance: e02d1e69-5e74-43c3-8546-6044d31145f2] Terminating instance
Nov 28 15:48:40 user nova-compute[75176]: DEBUG nova.compute.manager [None req-ae515dcc-f1cd-43cb-9750-766185b59fc3 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] [instance: e02d1e69-5e74-43c3-8546-6044d31145f2] Start destroying the instance on the hypervisor. {{(pid=75176) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 15:48:40 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:48:40 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:48:40 user nova-compute[75176]: DEBUG nova.compute.manager [req-00f8cf2b-b86c-49d2-8ead-681996024276 req-57ba720a-0e5c-4828-a370-9dbdcb278420 service nova] [instance: e02d1e69-5e74-43c3-8546-6044d31145f2] Received event network-vif-unplugged-9a63b660-0280-42b9-868c-dbf0c26ee995 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:48:40 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-00f8cf2b-b86c-49d2-8ead-681996024276 req-57ba720a-0e5c-4828-a370-9dbdcb278420 service nova] Acquiring lock "e02d1e69-5e74-43c3-8546-6044d31145f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:48:40 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-00f8cf2b-b86c-49d2-8ead-681996024276 req-57ba720a-0e5c-4828-a370-9dbdcb278420 service nova] Lock "e02d1e69-5e74-43c3-8546-6044d31145f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:48:40 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-00f8cf2b-b86c-49d2-8ead-681996024276 req-57ba720a-0e5c-4828-a370-9dbdcb278420 service nova] Lock "e02d1e69-5e74-43c3-8546-6044d31145f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:48:40 user nova-compute[75176]: DEBUG nova.compute.manager [req-00f8cf2b-b86c-49d2-8ead-681996024276 req-57ba720a-0e5c-4828-a370-9dbdcb278420 service nova] [instance: e02d1e69-5e74-43c3-8546-6044d31145f2] No waiting events found dispatching network-vif-unplugged-9a63b660-0280-42b9-868c-dbf0c26ee995 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:48:40 user nova-compute[75176]: DEBUG nova.compute.manager [req-00f8cf2b-b86c-49d2-8ead-681996024276 req-57ba720a-0e5c-4828-a370-9dbdcb278420 service nova] [instance: e02d1e69-5e74-43c3-8546-6044d31145f2] Received event network-vif-unplugged-9a63b660-0280-42b9-868c-dbf0c26ee995 for instance with task_state deleting. {{(pid=75176) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 15:48:40 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:48:40 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:48:41 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:48:41 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:48:41 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:48:41 user nova-compute[75176]: INFO nova.virt.libvirt.driver [-] [instance: e02d1e69-5e74-43c3-8546-6044d31145f2] Instance destroyed successfully.
Nov 28 15:48:41 user nova-compute[75176]: DEBUG nova.objects.instance [None req-ae515dcc-f1cd-43cb-9750-766185b59fc3 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Lazy-loading 'resources' on Instance uuid e02d1e69-5e74-43c3-8546-6044d31145f2 {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:48:41 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-ae515dcc-f1cd-43cb-9750-766185b59fc3 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-28T15:42:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-675567476',display_name='tempest-ServerActionsTestOtherA-server-1020561533',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-675567476',id=15,image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGHQgrfEWt8pIfRnhBJ24kFyu29uELDK7Re5fQAvns3FKElXmrGxqyeLKhrovaGXrIG8CV9ozkAnryzObqKasCPi8GMPgqqgdQkjAV0c1Qea28G7qtna2/64n19K46tX/A==',key_name='tempest-keypair-1504939882',keypairs=<?>,launch_index=0,launched_at=2023-11-28T15:45:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3704b38a2bd44cb78c28d3f6d86d9e60',ramdisk_id='',reservation_id='r-2pd1l9gx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-680502445',owner_user_name='tempest-ServerActionsTestOtherA-680502445-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T15:45:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d028b79a105b485dbb0178c9da162640',uuid=e02d1e69-5e74-43c3-8546-6044d31145f2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9a63b660-0280-42b9-868c-dbf0c26ee995", "address": "fa:16:3e:ed:a5:68", "network": {"id": "8b63f2d3-0683-4832-abc5-e4c796cf12ab", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-877608435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3704b38a2bd44cb78c28d3f6d86d9e60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a63b660-02", "ovs_interfaceid": "9a63b660-0280-42b9-868c-dbf0c26ee995", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 15:48:41 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-ae515dcc-f1cd-43cb-9750-766185b59fc3 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Converting VIF {"id": "9a63b660-0280-42b9-868c-dbf0c26ee995", "address": "fa:16:3e:ed:a5:68", "network": {"id": "8b63f2d3-0683-4832-abc5-e4c796cf12ab", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-877608435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3704b38a2bd44cb78c28d3f6d86d9e60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a63b660-02", "ovs_interfaceid": "9a63b660-0280-42b9-868c-dbf0c26ee995", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:48:41 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-ae515dcc-f1cd-43cb-9750-766185b59fc3 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ed:a5:68,bridge_name='br-int',has_traffic_filtering=True,id=9a63b660-0280-42b9-868c-dbf0c26ee995,network=Network(8b63f2d3-0683-4832-abc5-e4c796cf12ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a63b660-02') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:48:41 user nova-compute[75176]: DEBUG os_vif [None req-ae515dcc-f1cd-43cb-9750-766185b59fc3 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ed:a5:68,bridge_name='br-int',has_traffic_filtering=True,id=9a63b660-0280-42b9-868c-dbf0c26ee995,network=Network(8b63f2d3-0683-4832-abc5-e4c796cf12ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a63b660-02') {{(pid=75176) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 15:48:41 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:48:41 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9a63b660-02, bridge=br-int, if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:48:41 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:48:41 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:48:41 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:48:41 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0c2e2d58-3b64-4f9b-88bb-50ded33eff41) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:48:41 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:48:41 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:48:41 user nova-compute[75176]: INFO os_vif [None req-ae515dcc-f1cd-43cb-9750-766185b59fc3 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ed:a5:68,bridge_name='br-int',has_traffic_filtering=True,id=9a63b660-0280-42b9-868c-dbf0c26ee995,network=Network(8b63f2d3-0683-4832-abc5-e4c796cf12ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a63b660-02')
Nov 28 15:48:41 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-ae515dcc-f1cd-43cb-9750-766185b59fc3 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] [instance: e02d1e69-5e74-43c3-8546-6044d31145f2] Deleting instance files /opt/stack/data/nova/instances/e02d1e69-5e74-43c3-8546-6044d31145f2_del
Nov 28 15:48:41 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-ae515dcc-f1cd-43cb-9750-766185b59fc3 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] [instance: e02d1e69-5e74-43c3-8546-6044d31145f2] Deletion of /opt/stack/data/nova/instances/e02d1e69-5e74-43c3-8546-6044d31145f2_del complete
Nov 28 15:48:41 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:48:41 user nova-compute[75176]: INFO nova.compute.manager [None req-ae515dcc-f1cd-43cb-9750-766185b59fc3 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] [instance: e02d1e69-5e74-43c3-8546-6044d31145f2] Took 0.92 seconds to destroy the instance on the hypervisor.
Nov 28 15:48:41 user nova-compute[75176]: DEBUG oslo.service.loopingcall [None req-ae515dcc-f1cd-43cb-9750-766185b59fc3 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75176) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 15:48:41 user nova-compute[75176]: DEBUG nova.compute.manager [-] [instance: e02d1e69-5e74-43c3-8546-6044d31145f2] Deallocating network for instance {{(pid=75176) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 15:48:41 user nova-compute[75176]: DEBUG nova.network.neutron [-] [instance: e02d1e69-5e74-43c3-8546-6044d31145f2] deallocate_for_instance() {{(pid=75176) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 15:48:41 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:48:41 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:48:41 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:48:42 user nova-compute[75176]: DEBUG nova.network.neutron [-] [instance: e02d1e69-5e74-43c3-8546-6044d31145f2] Updating instance_info_cache with network_info: [] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:48:42 user nova-compute[75176]: INFO nova.compute.manager [-] [instance: e02d1e69-5e74-43c3-8546-6044d31145f2] Took 1.30 seconds to deallocate network for instance.
Nov 28 15:48:42 user nova-compute[75176]: DEBUG nova.compute.manager [req-27a9d8fb-8698-4db8-8a48-1d99c89ecaf9 req-ebd4404e-6e89-4f19-9451-6a5dccf85aa5 service nova] [instance: e02d1e69-5e74-43c3-8546-6044d31145f2] Received event network-vif-deleted-9a63b660-0280-42b9-868c-dbf0c26ee995 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:48:42 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-ae515dcc-f1cd-43cb-9750-766185b59fc3 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:48:42 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-ae515dcc-f1cd-43cb-9750-766185b59fc3 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:48:42 user nova-compute[75176]: DEBUG nova.compute.manager [req-aab229bd-c3e2-48b4-bbca-528858f779f9 req-17c14277-6825-426d-ba6b-34913154bf36 service nova] [instance: e02d1e69-5e74-43c3-8546-6044d31145f2] Received event network-vif-plugged-9a63b660-0280-42b9-868c-dbf0c26ee995 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:48:42 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-aab229bd-c3e2-48b4-bbca-528858f779f9 req-17c14277-6825-426d-ba6b-34913154bf36 service nova] Acquiring lock "e02d1e69-5e74-43c3-8546-6044d31145f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:48:42 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-aab229bd-c3e2-48b4-bbca-528858f779f9 req-17c14277-6825-426d-ba6b-34913154bf36 service nova] Lock "e02d1e69-5e74-43c3-8546-6044d31145f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:48:42 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-aab229bd-c3e2-48b4-bbca-528858f779f9 req-17c14277-6825-426d-ba6b-34913154bf36 service nova] Lock "e02d1e69-5e74-43c3-8546-6044d31145f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:48:42 user nova-compute[75176]: DEBUG nova.compute.manager [req-aab229bd-c3e2-48b4-bbca-528858f779f9 req-17c14277-6825-426d-ba6b-34913154bf36 service nova] [instance: e02d1e69-5e74-43c3-8546-6044d31145f2] No waiting events found dispatching network-vif-plugged-9a63b660-0280-42b9-868c-dbf0c26ee995 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:48:42 user nova-compute[75176]: WARNING nova.compute.manager [req-aab229bd-c3e2-48b4-bbca-528858f779f9 req-17c14277-6825-426d-ba6b-34913154bf36 service nova] [instance: e02d1e69-5e74-43c3-8546-6044d31145f2] Received unexpected event network-vif-plugged-9a63b660-0280-42b9-868c-dbf0c26ee995 for instance with vm_state deleted and task_state None.
Nov 28 15:48:42 user nova-compute[75176]: DEBUG nova.compute.manager [req-aab229bd-c3e2-48b4-bbca-528858f779f9 req-17c14277-6825-426d-ba6b-34913154bf36 service nova] [instance: e02d1e69-5e74-43c3-8546-6044d31145f2] Received event network-vif-plugged-9a63b660-0280-42b9-868c-dbf0c26ee995 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:48:42 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-aab229bd-c3e2-48b4-bbca-528858f779f9 req-17c14277-6825-426d-ba6b-34913154bf36 service nova] Acquiring lock "e02d1e69-5e74-43c3-8546-6044d31145f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:48:42 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-aab229bd-c3e2-48b4-bbca-528858f779f9 req-17c14277-6825-426d-ba6b-34913154bf36 service nova] Lock "e02d1e69-5e74-43c3-8546-6044d31145f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:48:42 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-aab229bd-c3e2-48b4-bbca-528858f779f9 req-17c14277-6825-426d-ba6b-34913154bf36 service nova] Lock "e02d1e69-5e74-43c3-8546-6044d31145f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:48:42 user nova-compute[75176]: DEBUG nova.compute.manager [req-aab229bd-c3e2-48b4-bbca-528858f779f9 req-17c14277-6825-426d-ba6b-34913154bf36 service nova] [instance: e02d1e69-5e74-43c3-8546-6044d31145f2] No waiting events found dispatching network-vif-plugged-9a63b660-0280-42b9-868c-dbf0c26ee995 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:48:42 user nova-compute[75176]: WARNING nova.compute.manager [req-aab229bd-c3e2-48b4-bbca-528858f779f9 req-17c14277-6825-426d-ba6b-34913154bf36 service nova] [instance: e02d1e69-5e74-43c3-8546-6044d31145f2] Received unexpected event network-vif-plugged-9a63b660-0280-42b9-868c-dbf0c26ee995 for instance with vm_state deleted and task_state None.
Nov 28 15:48:42 user nova-compute[75176]: DEBUG nova.compute.manager [req-aab229bd-c3e2-48b4-bbca-528858f779f9 req-17c14277-6825-426d-ba6b-34913154bf36 service nova] [instance: e02d1e69-5e74-43c3-8546-6044d31145f2] Received event network-vif-plugged-9a63b660-0280-42b9-868c-dbf0c26ee995 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:48:42 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-aab229bd-c3e2-48b4-bbca-528858f779f9 req-17c14277-6825-426d-ba6b-34913154bf36 service nova] Acquiring lock "e02d1e69-5e74-43c3-8546-6044d31145f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:48:42 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-aab229bd-c3e2-48b4-bbca-528858f779f9 req-17c14277-6825-426d-ba6b-34913154bf36 service nova] Lock "e02d1e69-5e74-43c3-8546-6044d31145f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:48:42 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-aab229bd-c3e2-48b4-bbca-528858f779f9 req-17c14277-6825-426d-ba6b-34913154bf36 service nova] Lock "e02d1e69-5e74-43c3-8546-6044d31145f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:48:42 user nova-compute[75176]: DEBUG nova.compute.manager [req-aab229bd-c3e2-48b4-bbca-528858f779f9 req-17c14277-6825-426d-ba6b-34913154bf36 service nova] [instance: e02d1e69-5e74-43c3-8546-6044d31145f2] No waiting events found dispatching network-vif-plugged-9a63b660-0280-42b9-868c-dbf0c26ee995 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:48:42 user nova-compute[75176]: WARNING nova.compute.manager [req-aab229bd-c3e2-48b4-bbca-528858f779f9 req-17c14277-6825-426d-ba6b-34913154bf36 service nova] [instance: e02d1e69-5e74-43c3-8546-6044d31145f2] Received unexpected event network-vif-plugged-9a63b660-0280-42b9-868c-dbf0c26ee995 for instance with vm_state deleted and task_state None.
Nov 28 15:48:42 user nova-compute[75176]: DEBUG nova.compute.manager [req-aab229bd-c3e2-48b4-bbca-528858f779f9 req-17c14277-6825-426d-ba6b-34913154bf36 service nova] [instance: e02d1e69-5e74-43c3-8546-6044d31145f2] Received event network-vif-unplugged-9a63b660-0280-42b9-868c-dbf0c26ee995 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:48:42 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-aab229bd-c3e2-48b4-bbca-528858f779f9 req-17c14277-6825-426d-ba6b-34913154bf36 service nova] Acquiring lock "e02d1e69-5e74-43c3-8546-6044d31145f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:48:42 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-aab229bd-c3e2-48b4-bbca-528858f779f9 req-17c14277-6825-426d-ba6b-34913154bf36 service nova] Lock "e02d1e69-5e74-43c3-8546-6044d31145f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:48:42 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-aab229bd-c3e2-48b4-bbca-528858f779f9 req-17c14277-6825-426d-ba6b-34913154bf36 service nova] Lock "e02d1e69-5e74-43c3-8546-6044d31145f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:48:42 user nova-compute[75176]: DEBUG nova.compute.manager [req-aab229bd-c3e2-48b4-bbca-528858f779f9 req-17c14277-6825-426d-ba6b-34913154bf36 service nova] [instance: e02d1e69-5e74-43c3-8546-6044d31145f2] No waiting events found dispatching network-vif-unplugged-9a63b660-0280-42b9-868c-dbf0c26ee995 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:48:42 user nova-compute[75176]: WARNING nova.compute.manager [req-aab229bd-c3e2-48b4-bbca-528858f779f9 req-17c14277-6825-426d-ba6b-34913154bf36 service nova] [instance: e02d1e69-5e74-43c3-8546-6044d31145f2] Received unexpected event network-vif-unplugged-9a63b660-0280-42b9-868c-dbf0c26ee995 for instance with vm_state deleted and task_state None.
Nov 28 15:48:42 user nova-compute[75176]: DEBUG nova.compute.manager [req-aab229bd-c3e2-48b4-bbca-528858f779f9 req-17c14277-6825-426d-ba6b-34913154bf36 service nova] [instance: e02d1e69-5e74-43c3-8546-6044d31145f2] Received event network-vif-plugged-9a63b660-0280-42b9-868c-dbf0c26ee995 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:48:42 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-aab229bd-c3e2-48b4-bbca-528858f779f9 req-17c14277-6825-426d-ba6b-34913154bf36 service nova] Acquiring lock "e02d1e69-5e74-43c3-8546-6044d31145f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:48:42 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-aab229bd-c3e2-48b4-bbca-528858f779f9 req-17c14277-6825-426d-ba6b-34913154bf36 service nova] Lock "e02d1e69-5e74-43c3-8546-6044d31145f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:48:42 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-aab229bd-c3e2-48b4-bbca-528858f779f9 req-17c14277-6825-426d-ba6b-34913154bf36 service nova] Lock "e02d1e69-5e74-43c3-8546-6044d31145f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:48:42 user nova-compute[75176]: DEBUG nova.compute.manager [req-aab229bd-c3e2-48b4-bbca-528858f779f9 req-17c14277-6825-426d-ba6b-34913154bf36 service nova] [instance: e02d1e69-5e74-43c3-8546-6044d31145f2] No waiting events found dispatching network-vif-plugged-9a63b660-0280-42b9-868c-dbf0c26ee995 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:48:42 user nova-compute[75176]: WARNING nova.compute.manager [req-aab229bd-c3e2-48b4-bbca-528858f779f9 req-17c14277-6825-426d-ba6b-34913154bf36 service nova] [instance: e02d1e69-5e74-43c3-8546-6044d31145f2] Received unexpected event network-vif-plugged-9a63b660-0280-42b9-868c-dbf0c26ee995 for instance with vm_state deleted and task_state None.
Nov 28 15:48:42 user nova-compute[75176]: DEBUG nova.compute.provider_tree [None req-ae515dcc-f1cd-43cb-9750-766185b59fc3 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Inventory has not changed in ProviderTree for provider: b37848d8-f401-4155-a029-b0ffa09ff85b {{(pid=75176) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 15:48:42 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-ae515dcc-f1cd-43cb-9750-766185b59fc3 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Inventory has not changed for provider b37848d8-f401-4155-a029-b0ffa09ff85b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75176) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 15:48:42 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-ae515dcc-f1cd-43cb-9750-766185b59fc3 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.340s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:48:42 user nova-compute[75176]: INFO nova.scheduler.client.report [None req-ae515dcc-f1cd-43cb-9750-766185b59fc3 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Deleted allocations for instance e02d1e69-5e74-43c3-8546-6044d31145f2
Nov 28 15:48:43 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-ae515dcc-f1cd-43cb-9750-766185b59fc3 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Lock "e02d1e69-5e74-43c3-8546-6044d31145f2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.767s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:48:44 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:48:45 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:48:46 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:48:46 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:48:48 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:48:48 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:48:49 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:48:51 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:48:51 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-37481a34-5998-4c13-8082-6269fbfec6e8 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Acquiring lock "cbefda8d-d285-404b-9817-49deada49d0b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:48:51 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-37481a34-5998-4c13-8082-6269fbfec6e8 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Lock "cbefda8d-d285-404b-9817-49deada49d0b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:48:51 user nova-compute[75176]: DEBUG nova.compute.manager [None req-37481a34-5998-4c13-8082-6269fbfec6e8 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] [instance: cbefda8d-d285-404b-9817-49deada49d0b] Starting instance... {{(pid=75176) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 15:48:51 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-37481a34-5998-4c13-8082-6269fbfec6e8 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:48:51 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-37481a34-5998-4c13-8082-6269fbfec6e8 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:48:51 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-37481a34-5998-4c13-8082-6269fbfec6e8 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75176) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 15:48:51 user nova-compute[75176]: INFO nova.compute.claims [None req-37481a34-5998-4c13-8082-6269fbfec6e8 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] [instance: cbefda8d-d285-404b-9817-49deada49d0b] Claim successful on node user
Nov 28 15:48:51 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:48:51 user nova-compute[75176]: DEBUG nova.compute.provider_tree [None req-37481a34-5998-4c13-8082-6269fbfec6e8 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Inventory has not changed in ProviderTree for provider: b37848d8-f401-4155-a029-b0ffa09ff85b {{(pid=75176) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 15:48:51 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-37481a34-5998-4c13-8082-6269fbfec6e8 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Inventory has not changed for provider b37848d8-f401-4155-a029-b0ffa09ff85b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75176) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 15:48:51 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-37481a34-5998-4c13-8082-6269fbfec6e8 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.373s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:48:51 user nova-compute[75176]: DEBUG nova.compute.manager [None req-37481a34-5998-4c13-8082-6269fbfec6e8 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] [instance: cbefda8d-d285-404b-9817-49deada49d0b] Start building networks asynchronously for instance. {{(pid=75176) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 15:48:51 user nova-compute[75176]: DEBUG nova.compute.manager [None req-37481a34-5998-4c13-8082-6269fbfec6e8 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] [instance: cbefda8d-d285-404b-9817-49deada49d0b] Allocating IP information in the background. {{(pid=75176) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 15:48:51 user nova-compute[75176]: DEBUG nova.network.neutron [None req-37481a34-5998-4c13-8082-6269fbfec6e8 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] [instance: cbefda8d-d285-404b-9817-49deada49d0b] allocate_for_instance() {{(pid=75176) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 15:48:51 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-37481a34-5998-4c13-8082-6269fbfec6e8 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] [instance: cbefda8d-d285-404b-9817-49deada49d0b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 15:48:52 user nova-compute[75176]: DEBUG nova.compute.manager [None req-37481a34-5998-4c13-8082-6269fbfec6e8 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] [instance: cbefda8d-d285-404b-9817-49deada49d0b] Start building block device mappings for instance. {{(pid=75176) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 15:48:52 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:48:52 user nova-compute[75176]: DEBUG nova.policy [None req-37481a34-5998-4c13-8082-6269fbfec6e8 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f9a745552d974e05a9e0befc68eb7f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a194f81f7e104be7940d1d05f71bbad9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75176) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 15:48:52 user nova-compute[75176]: DEBUG nova.compute.manager [None req-37481a34-5998-4c13-8082-6269fbfec6e8 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] [instance: cbefda8d-d285-404b-9817-49deada49d0b] Start spawning the instance on the hypervisor. {{(pid=75176) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 15:48:52 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-37481a34-5998-4c13-8082-6269fbfec6e8 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] [instance: cbefda8d-d285-404b-9817-49deada49d0b] Creating instance directory {{(pid=75176) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 15:48:52 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-37481a34-5998-4c13-8082-6269fbfec6e8 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] [instance: cbefda8d-d285-404b-9817-49deada49d0b] Creating image(s)
Nov 28 15:48:52 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-37481a34-5998-4c13-8082-6269fbfec6e8 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Acquiring lock "/opt/stack/data/nova/instances/cbefda8d-d285-404b-9817-49deada49d0b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:48:52 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-37481a34-5998-4c13-8082-6269fbfec6e8 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Lock "/opt/stack/data/nova/instances/cbefda8d-d285-404b-9817-49deada49d0b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:48:52 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-37481a34-5998-4c13-8082-6269fbfec6e8 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Lock "/opt/stack/data/nova/instances/cbefda8d-d285-404b-9817-49deada49d0b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:48:52 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-37481a34-5998-4c13-8082-6269fbfec6e8 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:48:52 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-37481a34-5998-4c13-8082-6269fbfec6e8 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json" returned: 0 in 0.169s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:48:52 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-37481a34-5998-4c13-8082-6269fbfec6e8 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Acquiring lock "5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:48:52 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-37481a34-5998-4c13-8082-6269fbfec6e8 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Lock "5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:48:52 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-37481a34-5998-4c13-8082-6269fbfec6e8 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:48:52 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-37481a34-5998-4c13-8082-6269fbfec6e8 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json" returned: 0 in 0.177s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:48:52 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-37481a34-5998-4c13-8082-6269fbfec6e8 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2,backing_fmt=raw /opt/stack/data/nova/instances/cbefda8d-d285-404b-9817-49deada49d0b/disk 1073741824 {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:48:52 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-37481a34-5998-4c13-8082-6269fbfec6e8 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2,backing_fmt=raw /opt/stack/data/nova/instances/cbefda8d-d285-404b-9817-49deada49d0b/disk 1073741824" returned: 0 in 0.061s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:48:52 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-37481a34-5998-4c13-8082-6269fbfec6e8 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Lock "5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.247s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:48:52 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-37481a34-5998-4c13-8082-6269fbfec6e8 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:48:52 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:48:52 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-37481a34-5998-4c13-8082-6269fbfec6e8 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json" returned: 0 in 0.172s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:48:52 user nova-compute[75176]: DEBUG nova.virt.disk.api [None req-37481a34-5998-4c13-8082-6269fbfec6e8 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cbefda8d-d285-404b-9817-49deada49d0b/disk. size=1073741824 {{(pid=75176) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 15:48:52 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-37481a34-5998-4c13-8082-6269fbfec6e8 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbefda8d-d285-404b-9817-49deada49d0b/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:48:52 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-37481a34-5998-4c13-8082-6269fbfec6e8 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbefda8d-d285-404b-9817-49deada49d0b/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:48:52 user nova-compute[75176]: DEBUG nova.virt.disk.api [None req-37481a34-5998-4c13-8082-6269fbfec6e8 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Cannot resize image /opt/stack/data/nova/instances/cbefda8d-d285-404b-9817-49deada49d0b/disk to a smaller size. {{(pid=75176) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 15:48:52 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-37481a34-5998-4c13-8082-6269fbfec6e8 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] [instance: cbefda8d-d285-404b-9817-49deada49d0b] Created local disks {{(pid=75176) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 15:48:52 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-37481a34-5998-4c13-8082-6269fbfec6e8 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] [instance: cbefda8d-d285-404b-9817-49deada49d0b] Ensure instance console log exists: /opt/stack/data/nova/instances/cbefda8d-d285-404b-9817-49deada49d0b/console.log {{(pid=75176) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 15:48:52 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-37481a34-5998-4c13-8082-6269fbfec6e8 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:48:52 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-37481a34-5998-4c13-8082-6269fbfec6e8 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:48:52 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-37481a34-5998-4c13-8082-6269fbfec6e8 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:48:53 user nova-compute[75176]: DEBUG nova.network.neutron [None req-37481a34-5998-4c13-8082-6269fbfec6e8 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] [instance: cbefda8d-d285-404b-9817-49deada49d0b] Successfully created port: b402b4bc-60ff-48fa-9fff-f9ec26d82fa0 {{(pid=75176) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 15:48:54 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:48:54 user nova-compute[75176]: DEBUG nova.compute.manager [req-961dd0d7-fca2-4c46-8303-d5cc1208f228 req-83c644e6-f7df-4d13-9bbc-6c687ba440ba service nova] [instance: 8fe64eb8-b4e3-4037-80b1-0c151370d5a8] Received event network-changed-9b3e8a32-f295-4443-b831-b334e3e819ed {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:48:54 user nova-compute[75176]: DEBUG nova.compute.manager [req-961dd0d7-fca2-4c46-8303-d5cc1208f228 req-83c644e6-f7df-4d13-9bbc-6c687ba440ba service nova] [instance: 8fe64eb8-b4e3-4037-80b1-0c151370d5a8] Refreshing instance network info cache due to event network-changed-9b3e8a32-f295-4443-b831-b334e3e819ed. {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 15:48:54 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-961dd0d7-fca2-4c46-8303-d5cc1208f228 req-83c644e6-f7df-4d13-9bbc-6c687ba440ba service nova] Acquiring lock "refresh_cache-8fe64eb8-b4e3-4037-80b1-0c151370d5a8" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:48:54 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-961dd0d7-fca2-4c46-8303-d5cc1208f228 req-83c644e6-f7df-4d13-9bbc-6c687ba440ba service nova] Acquired lock "refresh_cache-8fe64eb8-b4e3-4037-80b1-0c151370d5a8" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:48:54 user nova-compute[75176]: DEBUG nova.network.neutron [req-961dd0d7-fca2-4c46-8303-d5cc1208f228 req-83c644e6-f7df-4d13-9bbc-6c687ba440ba service nova] [instance: 8fe64eb8-b4e3-4037-80b1-0c151370d5a8] Refreshing network info cache for port 9b3e8a32-f295-4443-b831-b334e3e819ed {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 15:48:54 user nova-compute[75176]: DEBUG nova.network.neutron [None req-37481a34-5998-4c13-8082-6269fbfec6e8 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] [instance: cbefda8d-d285-404b-9817-49deada49d0b] Successfully updated port: b402b4bc-60ff-48fa-9fff-f9ec26d82fa0 {{(pid=75176) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 15:48:54 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-37481a34-5998-4c13-8082-6269fbfec6e8 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Acquiring lock "refresh_cache-cbefda8d-d285-404b-9817-49deada49d0b" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:48:54 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-37481a34-5998-4c13-8082-6269fbfec6e8 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Acquired lock "refresh_cache-cbefda8d-d285-404b-9817-49deada49d0b" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:48:54 user nova-compute[75176]: DEBUG nova.network.neutron [None req-37481a34-5998-4c13-8082-6269fbfec6e8 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] [instance: cbefda8d-d285-404b-9817-49deada49d0b] Building network info cache for instance {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 15:48:54 user nova-compute[75176]: DEBUG nova.compute.manager [req-163afc62-41c7-4424-bd3f-59ff81a3151b req-03880c4b-8a91-4cbe-b3ea-e51636921772 service nova] [instance: cbefda8d-d285-404b-9817-49deada49d0b] Received event network-changed-b402b4bc-60ff-48fa-9fff-f9ec26d82fa0 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:48:54 user nova-compute[75176]: DEBUG nova.compute.manager [req-163afc62-41c7-4424-bd3f-59ff81a3151b req-03880c4b-8a91-4cbe-b3ea-e51636921772 service nova] [instance: cbefda8d-d285-404b-9817-49deada49d0b] Refreshing instance network info cache due to event network-changed-b402b4bc-60ff-48fa-9fff-f9ec26d82fa0. {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 15:48:54 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-163afc62-41c7-4424-bd3f-59ff81a3151b req-03880c4b-8a91-4cbe-b3ea-e51636921772 service nova] Acquiring lock "refresh_cache-cbefda8d-d285-404b-9817-49deada49d0b" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:48:54 user nova-compute[75176]: DEBUG nova.network.neutron [None req-37481a34-5998-4c13-8082-6269fbfec6e8 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] [instance: cbefda8d-d285-404b-9817-49deada49d0b] Instance cache missing network info. {{(pid=75176) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 15:48:54 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:48:55 user nova-compute[75176]: DEBUG nova.network.neutron [None req-37481a34-5998-4c13-8082-6269fbfec6e8 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] [instance: cbefda8d-d285-404b-9817-49deada49d0b] Updating instance_info_cache with network_info: [{"id": "b402b4bc-60ff-48fa-9fff-f9ec26d82fa0", "address": "fa:16:3e:b8:33:b8", "network": {"id": "7ab60343-57be-427d-9037-6ecf0eaf5de0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1508138843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a194f81f7e104be7940d1d05f71bbad9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb402b4bc-60", "ovs_interfaceid": "b402b4bc-60ff-48fa-9fff-f9ec26d82fa0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:48:55 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-37481a34-5998-4c13-8082-6269fbfec6e8 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Releasing lock "refresh_cache-cbefda8d-d285-404b-9817-49deada49d0b" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:48:55 user nova-compute[75176]: DEBUG nova.compute.manager [None req-37481a34-5998-4c13-8082-6269fbfec6e8 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] [instance: cbefda8d-d285-404b-9817-49deada49d0b] Instance network_info: |[{"id": "b402b4bc-60ff-48fa-9fff-f9ec26d82fa0", "address": "fa:16:3e:b8:33:b8", "network": {"id": "7ab60343-57be-427d-9037-6ecf0eaf5de0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1508138843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a194f81f7e104be7940d1d05f71bbad9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb402b4bc-60", "ovs_interfaceid": "b402b4bc-60ff-48fa-9fff-f9ec26d82fa0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75176) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 15:48:55 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-163afc62-41c7-4424-bd3f-59ff81a3151b req-03880c4b-8a91-4cbe-b3ea-e51636921772 service nova] Acquired lock "refresh_cache-cbefda8d-d285-404b-9817-49deada49d0b" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:48:55 user nova-compute[75176]: DEBUG nova.network.neutron [req-163afc62-41c7-4424-bd3f-59ff81a3151b req-03880c4b-8a91-4cbe-b3ea-e51636921772 service nova] [instance: cbefda8d-d285-404b-9817-49deada49d0b] Refreshing network info cache for port b402b4bc-60ff-48fa-9fff-f9ec26d82fa0 {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 15:48:55 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-37481a34-5998-4c13-8082-6269fbfec6e8 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] [instance: cbefda8d-d285-404b-9817-49deada49d0b] Start _get_guest_xml network_info=[{"id": "b402b4bc-60ff-48fa-9fff-f9ec26d82fa0", "address": "fa:16:3e:b8:33:b8", "network": {"id": "7ab60343-57be-427d-9037-6ecf0eaf5de0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1508138843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a194f81f7e104be7940d1d05f71bbad9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb402b4bc-60", "ovs_interfaceid": "b402b4bc-60ff-48fa-9fff-f9ec26d82fa0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T15:35:12Z,direct_url=<?>,disk_format='qcow2',id=1f41819e-c93f-4dc7-b253-37a27bbbbc74,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1b91c5d0672c4224a48df2e1f92688e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T15:35:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'size': 0, 'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'image_id': '1f41819e-c93f-4dc7-b253-37a27bbbbc74'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75176) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 15:48:55 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-37481a34-5998-4c13-8082-6269fbfec6e8 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 15:48:55 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-37481a34-5998-4c13-8082-6269fbfec6e8 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 15:48:55 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-37481a34-5998-4c13-8082-6269fbfec6e8 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75176) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 15:48:55 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-37481a34-5998-4c13-8082-6269fbfec6e8 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] CPU controller missing on host. {{(pid=75176) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 15:48:55 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-37481a34-5998-4c13-8082-6269fbfec6e8 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75176) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 15:48:55 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-37481a34-5998-4c13-8082-6269fbfec6e8 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] CPU controller found on host. {{(pid=75176) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 15:48:55 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-37481a34-5998-4c13-8082-6269fbfec6e8 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75176) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 15:48:55 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-37481a34-5998-4c13-8082-6269fbfec6e8 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T15:35:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T15:35:12Z,direct_url=<?>,disk_format='qcow2',id=1f41819e-c93f-4dc7-b253-37a27bbbbc74,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1b91c5d0672c4224a48df2e1f92688e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T15:35:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 15:48:55 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-37481a34-5998-4c13-8082-6269fbfec6e8 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Flavor limits 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 15:48:55 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-37481a34-5998-4c13-8082-6269fbfec6e8 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Image limits 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 15:48:55 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-37481a34-5998-4c13-8082-6269fbfec6e8 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Flavor pref 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 15:48:55 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-37481a34-5998-4c13-8082-6269fbfec6e8 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Image pref 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 15:48:55 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-37481a34-5998-4c13-8082-6269fbfec6e8 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 15:48:55 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-37481a34-5998-4c13-8082-6269fbfec6e8 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 15:48:55 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-37481a34-5998-4c13-8082-6269fbfec6e8 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75176) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 15:48:55 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-37481a34-5998-4c13-8082-6269fbfec6e8 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Got 1 possible topologies {{(pid=75176) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 15:48:55 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-37481a34-5998-4c13-8082-6269fbfec6e8 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 15:48:55 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-37481a34-5998-4c13-8082-6269fbfec6e8 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 15:48:55 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-37481a34-5998-4c13-8082-6269fbfec6e8 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T15:48:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-457527942',display_name='tempest-AttachVolumeNegativeTest-server-457527942',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-457527942',id=29,image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM1xb1w6vkpWoAyAdn1haqlReexF6NyUKIxeUkA+iAyXdDoS8pSd0LDNx6z1XpYl+y9RfN/9vW8FFzLTu1EmkfynQSX+ueIX7y+hYerPPhHmZDwfjuXiZHVuYWw/l9lptQ==',key_name='tempest-keypair-1426689179',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a194f81f7e104be7940d1d05f71bbad9',ramdisk_id='',reservation_id='r-lj7bv023',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1403590572',owner_user_name='tempest-AttachVolumeNegativeTest-1403590572-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T15:48:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f9a745552d974e05a9e0befc68eb7f6e',uuid=cbefda8d-d285-404b-9817-49deada49d0b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b402b4bc-60ff-48fa-9fff-f9ec26d82fa0", "address": "fa:16:3e:b8:33:b8", "network": {"id": "7ab60343-57be-427d-9037-6ecf0eaf5de0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1508138843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a194f81f7e104be7940d1d05f71bbad9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb402b4bc-60", "ovs_interfaceid": "b402b4bc-60ff-48fa-9fff-f9ec26d82fa0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75176) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 15:48:55 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-37481a34-5998-4c13-8082-6269fbfec6e8 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Converting VIF {"id": "b402b4bc-60ff-48fa-9fff-f9ec26d82fa0", "address": "fa:16:3e:b8:33:b8", "network": {"id": "7ab60343-57be-427d-9037-6ecf0eaf5de0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1508138843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a194f81f7e104be7940d1d05f71bbad9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb402b4bc-60", "ovs_interfaceid": "b402b4bc-60ff-48fa-9fff-f9ec26d82fa0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:48:55 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-37481a34-5998-4c13-8082-6269fbfec6e8 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:33:b8,bridge_name='br-int',has_traffic_filtering=True,id=b402b4bc-60ff-48fa-9fff-f9ec26d82fa0,network=Network(7ab60343-57be-427d-9037-6ecf0eaf5de0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb402b4bc-60') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:48:55 user nova-compute[75176]: DEBUG nova.objects.instance [None req-37481a34-5998-4c13-8082-6269fbfec6e8 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Lazy-loading 'pci_devices' on Instance uuid cbefda8d-d285-404b-9817-49deada49d0b {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:48:55 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-37481a34-5998-4c13-8082-6269fbfec6e8 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] [instance: cbefda8d-d285-404b-9817-49deada49d0b] End _get_guest_xml xml=<domain type="kvm">
Nov 28 15:48:55 user nova-compute[75176]:   <uuid>cbefda8d-d285-404b-9817-49deada49d0b</uuid>
Nov 28 15:48:55 user nova-compute[75176]:   <name>instance-0000001d</name>
Nov 28 15:48:55 user nova-compute[75176]:   <memory>524288</memory>
Nov 28 15:48:55 user nova-compute[75176]:   <vcpu>1</vcpu>
Nov 28 15:48:55 user nova-compute[75176]:   <metadata>
Nov 28 15:48:55 user nova-compute[75176]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 15:48:55 user nova-compute[75176]:       <nova:package version="0.0.0"/>
Nov 28 15:48:55 user nova-compute[75176]:       <nova:name>tempest-AttachVolumeNegativeTest-server-457527942</nova:name>
Nov 28 15:48:55 user nova-compute[75176]:       <nova:creationTime>2023-11-28 15:48:55</nova:creationTime>
Nov 28 15:48:55 user nova-compute[75176]:       <nova:flavor name="m1.tiny">
Nov 28 15:48:55 user nova-compute[75176]:         <nova:memory>512</nova:memory>
Nov 28 15:48:55 user nova-compute[75176]:         <nova:disk>1</nova:disk>
Nov 28 15:48:55 user nova-compute[75176]:         <nova:swap>0</nova:swap>
Nov 28 15:48:55 user nova-compute[75176]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 15:48:55 user nova-compute[75176]:         <nova:vcpus>1</nova:vcpus>
Nov 28 15:48:55 user nova-compute[75176]:       </nova:flavor>
Nov 28 15:48:55 user nova-compute[75176]:       <nova:owner>
Nov 28 15:48:55 user nova-compute[75176]:         <nova:user uuid="f9a745552d974e05a9e0befc68eb7f6e">tempest-AttachVolumeNegativeTest-1403590572-project-member</nova:user>
Nov 28 15:48:55 user nova-compute[75176]:         <nova:project uuid="a194f81f7e104be7940d1d05f71bbad9">tempest-AttachVolumeNegativeTest-1403590572</nova:project>
Nov 28 15:48:55 user nova-compute[75176]:       </nova:owner>
Nov 28 15:48:55 user nova-compute[75176]:       <nova:root type="image" uuid="1f41819e-c93f-4dc7-b253-37a27bbbbc74"/>
Nov 28 15:48:55 user nova-compute[75176]:       <nova:ports>
Nov 28 15:48:55 user nova-compute[75176]:         <nova:port uuid="b402b4bc-60ff-48fa-9fff-f9ec26d82fa0">
Nov 28 15:48:55 user nova-compute[75176]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 28 15:48:55 user nova-compute[75176]:         </nova:port>
Nov 28 15:48:55 user nova-compute[75176]:       </nova:ports>
Nov 28 15:48:55 user nova-compute[75176]:     </nova:instance>
Nov 28 15:48:55 user nova-compute[75176]:   </metadata>
Nov 28 15:48:55 user nova-compute[75176]:   <sysinfo type="smbios">
Nov 28 15:48:55 user nova-compute[75176]:     <system>
Nov 28 15:48:55 user nova-compute[75176]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 15:48:55 user nova-compute[75176]:       <entry name="product">OpenStack Nova</entry>
Nov 28 15:48:55 user nova-compute[75176]:       <entry name="version">0.0.0</entry>
Nov 28 15:48:55 user nova-compute[75176]:       <entry name="serial">cbefda8d-d285-404b-9817-49deada49d0b</entry>
Nov 28 15:48:55 user nova-compute[75176]:       <entry name="uuid">cbefda8d-d285-404b-9817-49deada49d0b</entry>
Nov 28 15:48:55 user nova-compute[75176]:       <entry name="family">Virtual Machine</entry>
Nov 28 15:48:55 user nova-compute[75176]:     </system>
Nov 28 15:48:55 user nova-compute[75176]:   </sysinfo>
Nov 28 15:48:55 user nova-compute[75176]:   <os>
Nov 28 15:48:55 user nova-compute[75176]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 15:48:55 user nova-compute[75176]:     <boot dev="hd"/>
Nov 28 15:48:55 user nova-compute[75176]:     <smbios mode="sysinfo"/>
Nov 28 15:48:55 user nova-compute[75176]:   </os>
Nov 28 15:48:55 user nova-compute[75176]:   <features>
Nov 28 15:48:55 user nova-compute[75176]:     <acpi/>
Nov 28 15:48:55 user nova-compute[75176]:     <apic/>
Nov 28 15:48:55 user nova-compute[75176]:     <vmcoreinfo/>
Nov 28 15:48:55 user nova-compute[75176]:   </features>
Nov 28 15:48:55 user nova-compute[75176]:   <clock offset="utc">
Nov 28 15:48:55 user nova-compute[75176]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 15:48:55 user nova-compute[75176]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 15:48:55 user nova-compute[75176]:     <timer name="hpet" present="no"/>
Nov 28 15:48:55 user nova-compute[75176]:   </clock>
Nov 28 15:48:55 user nova-compute[75176]:   <cpu mode="custom" match="exact">
Nov 28 15:48:55 user nova-compute[75176]:     <model>Nehalem</model>
Nov 28 15:48:55 user nova-compute[75176]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 15:48:55 user nova-compute[75176]:   </cpu>
Nov 28 15:48:55 user nova-compute[75176]:   <devices>
Nov 28 15:48:55 user nova-compute[75176]:     <disk type="file" device="disk">
Nov 28 15:48:55 user nova-compute[75176]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 15:48:55 user nova-compute[75176]:       <source file="/opt/stack/data/nova/instances/cbefda8d-d285-404b-9817-49deada49d0b/disk"/>
Nov 28 15:48:55 user nova-compute[75176]:       <target dev="vda" bus="virtio"/>
Nov 28 15:48:55 user nova-compute[75176]:     </disk>
Nov 28 15:48:55 user nova-compute[75176]:     <interface type="ethernet">
Nov 28 15:48:55 user nova-compute[75176]:       <mac address="fa:16:3e:b8:33:b8"/>
Nov 28 15:48:55 user nova-compute[75176]:       <model type="virtio"/>
Nov 28 15:48:55 user nova-compute[75176]:       <mtu size="1442"/>
Nov 28 15:48:55 user nova-compute[75176]:       <target dev="tapb402b4bc-60"/>
Nov 28 15:48:55 user nova-compute[75176]:     </interface>
Nov 28 15:48:55 user nova-compute[75176]:     <serial type="pty">
Nov 28 15:48:55 user nova-compute[75176]:       <log file="/opt/stack/data/nova/instances/cbefda8d-d285-404b-9817-49deada49d0b/console.log" append="off"/>
Nov 28 15:48:55 user nova-compute[75176]:     </serial>
Nov 28 15:48:55 user nova-compute[75176]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 15:48:55 user nova-compute[75176]:     <video>
Nov 28 15:48:55 user nova-compute[75176]:       <model type="virtio"/>
Nov 28 15:48:55 user nova-compute[75176]:     </video>
Nov 28 15:48:55 user nova-compute[75176]:     <rng model="virtio">
Nov 28 15:48:55 user nova-compute[75176]:       <backend model="random">/dev/urandom</backend>
Nov 28 15:48:55 user nova-compute[75176]:     </rng>
Nov 28 15:48:55 user nova-compute[75176]:     <controller type="usb" index="0" model="none"/>
Nov 28 15:48:55 user nova-compute[75176]:     <memballoon model="virtio">
Nov 28 15:48:55 user nova-compute[75176]:       <stats period="10"/>
Nov 28 15:48:55 user nova-compute[75176]:     </memballoon>
Nov 28 15:48:55 user nova-compute[75176]:   </devices>
Nov 28 15:48:55 user nova-compute[75176]: </domain>
Nov 28 15:48:55 user nova-compute[75176]:  {{(pid=75176) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 15:48:55 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-37481a34-5998-4c13-8082-6269fbfec6e8 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T15:48:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-457527942',display_name='tempest-AttachVolumeNegativeTest-server-457527942',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-457527942',id=29,image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM1xb1w6vkpWoAyAdn1haqlReexF6NyUKIxeUkA+iAyXdDoS8pSd0LDNx6z1XpYl+y9RfN/9vW8FFzLTu1EmkfynQSX+ueIX7y+hYerPPhHmZDwfjuXiZHVuYWw/l9lptQ==',key_name='tempest-keypair-1426689179',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a194f81f7e104be7940d1d05f71bbad9',ramdisk_id='',reservation_id='r-lj7bv023',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1403590572',owner_user_name='tempest-AttachVolumeNegativeTest-1403590572-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T15:48:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f9a745552d974e05a9e0befc68eb7f6e',uuid=cbefda8d-d285-404b-9817-49deada49d0b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b402b4bc-60ff-48fa-9fff-f9ec26d82fa0", "address": "fa:16:3e:b8:33:b8", "network": {"id": "7ab60343-57be-427d-9037-6ecf0eaf5de0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1508138843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a194f81f7e104be7940d1d05f71bbad9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb402b4bc-60", "ovs_interfaceid": "b402b4bc-60ff-48fa-9fff-f9ec26d82fa0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 15:48:55 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-37481a34-5998-4c13-8082-6269fbfec6e8 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Converting VIF {"id": "b402b4bc-60ff-48fa-9fff-f9ec26d82fa0", "address": "fa:16:3e:b8:33:b8", "network": {"id": "7ab60343-57be-427d-9037-6ecf0eaf5de0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1508138843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a194f81f7e104be7940d1d05f71bbad9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb402b4bc-60", "ovs_interfaceid": "b402b4bc-60ff-48fa-9fff-f9ec26d82fa0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:48:55 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-37481a34-5998-4c13-8082-6269fbfec6e8 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:33:b8,bridge_name='br-int',has_traffic_filtering=True,id=b402b4bc-60ff-48fa-9fff-f9ec26d82fa0,network=Network(7ab60343-57be-427d-9037-6ecf0eaf5de0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb402b4bc-60') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:48:55 user nova-compute[75176]: DEBUG os_vif [None req-37481a34-5998-4c13-8082-6269fbfec6e8 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:33:b8,bridge_name='br-int',has_traffic_filtering=True,id=b402b4bc-60ff-48fa-9fff-f9ec26d82fa0,network=Network(7ab60343-57be-427d-9037-6ecf0eaf5de0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb402b4bc-60') {{(pid=75176) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 15:48:55 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:48:55 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:48:55 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 15:48:55 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:48:55 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0a879372-ad7c-5498-a36c-8234b0c698a7', '_type': 'linux-noop'}}, row=False) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:48:55 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:48:55 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:48:55 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:48:55 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb402b4bc-60, may_exist=True, interface_attrs={}) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:48:55 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb402b4bc-60, col_values=(('qos', UUID('414ffea0-f067-49ae-b412-f95b0e69577c')),), if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:48:55 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb402b4bc-60, col_values=(('external_ids', {'iface-id': 'b402b4bc-60ff-48fa-9fff-f9ec26d82fa0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b8:33:b8', 'vm-uuid': 'cbefda8d-d285-404b-9817-49deada49d0b'}),), if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:48:55 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:48:55 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:48:55 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:48:55 user nova-compute[75176]: INFO os_vif [None req-37481a34-5998-4c13-8082-6269fbfec6e8 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:33:b8,bridge_name='br-int',has_traffic_filtering=True,id=b402b4bc-60ff-48fa-9fff-f9ec26d82fa0,network=Network(7ab60343-57be-427d-9037-6ecf0eaf5de0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb402b4bc-60')
Nov 28 15:48:55 user nova-compute[75176]: DEBUG nova.network.neutron [req-961dd0d7-fca2-4c46-8303-d5cc1208f228 req-83c644e6-f7df-4d13-9bbc-6c687ba440ba service nova] [instance: 8fe64eb8-b4e3-4037-80b1-0c151370d5a8] Updated VIF entry in instance network info cache for port 9b3e8a32-f295-4443-b831-b334e3e819ed. {{(pid=75176) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 15:48:55 user nova-compute[75176]: DEBUG nova.network.neutron [req-961dd0d7-fca2-4c46-8303-d5cc1208f228 req-83c644e6-f7df-4d13-9bbc-6c687ba440ba service nova] [instance: 8fe64eb8-b4e3-4037-80b1-0c151370d5a8] Updating instance_info_cache with network_info: [{"id": "9b3e8a32-f295-4443-b831-b334e3e819ed", "address": "fa:16:3e:00:fc:1e", "network": {"id": "a5685858-c130-4f66-8600-023367af9ea5", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-316757927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d37788d8e0384afcb348f009062c3b12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b3e8a32-f2", "ovs_interfaceid": "9b3e8a32-f295-4443-b831-b334e3e819ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:48:55 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-961dd0d7-fca2-4c46-8303-d5cc1208f228 req-83c644e6-f7df-4d13-9bbc-6c687ba440ba service nova] Releasing lock "refresh_cache-8fe64eb8-b4e3-4037-80b1-0c151370d5a8" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:48:55 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-37481a34-5998-4c13-8082-6269fbfec6e8 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] No BDM found with device name vda, not building metadata. {{(pid=75176) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 15:48:55 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-37481a34-5998-4c13-8082-6269fbfec6e8 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] No VIF found with MAC fa:16:3e:b8:33:b8, not building metadata {{(pid=75176) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 15:48:55 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:48:55 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:48:55 user nova-compute[75176]: DEBUG nova.network.neutron [req-163afc62-41c7-4424-bd3f-59ff81a3151b req-03880c4b-8a91-4cbe-b3ea-e51636921772 service nova] [instance: cbefda8d-d285-404b-9817-49deada49d0b] Updated VIF entry in instance network info cache for port b402b4bc-60ff-48fa-9fff-f9ec26d82fa0. {{(pid=75176) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 15:48:55 user nova-compute[75176]: DEBUG nova.network.neutron [req-163afc62-41c7-4424-bd3f-59ff81a3151b req-03880c4b-8a91-4cbe-b3ea-e51636921772 service nova] [instance: cbefda8d-d285-404b-9817-49deada49d0b] Updating instance_info_cache with network_info: [{"id": "b402b4bc-60ff-48fa-9fff-f9ec26d82fa0", "address": "fa:16:3e:b8:33:b8", "network": {"id": "7ab60343-57be-427d-9037-6ecf0eaf5de0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1508138843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a194f81f7e104be7940d1d05f71bbad9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb402b4bc-60", "ovs_interfaceid": "b402b4bc-60ff-48fa-9fff-f9ec26d82fa0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:48:55 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-163afc62-41c7-4424-bd3f-59ff81a3151b req-03880c4b-8a91-4cbe-b3ea-e51636921772 service nova] Releasing lock "refresh_cache-cbefda8d-d285-404b-9817-49deada49d0b" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:48:56 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:48:56 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:48:56 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:48:56 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75176) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 15:48:56 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:48:56 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:48:56 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:48:56 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:48:56 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:48:56 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Auditing locally available compute resources for user (node: user) {{(pid=75176) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 15:48:56 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:48:56 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:48:57 user nova-compute[75176]: DEBUG nova.compute.manager [req-87b8f27d-c026-4dd3-9e53-4499790535dd req-107c3f0a-6097-44eb-8710-4e50c97dc1c0 service nova] [instance: cbefda8d-d285-404b-9817-49deada49d0b] Received event network-vif-plugged-b402b4bc-60ff-48fa-9fff-f9ec26d82fa0 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:48:57 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-87b8f27d-c026-4dd3-9e53-4499790535dd req-107c3f0a-6097-44eb-8710-4e50c97dc1c0 service nova] Acquiring lock "cbefda8d-d285-404b-9817-49deada49d0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:48:57 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-87b8f27d-c026-4dd3-9e53-4499790535dd req-107c3f0a-6097-44eb-8710-4e50c97dc1c0 service nova] Lock "cbefda8d-d285-404b-9817-49deada49d0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:48:57 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-87b8f27d-c026-4dd3-9e53-4499790535dd req-107c3f0a-6097-44eb-8710-4e50c97dc1c0 service nova] Lock "cbefda8d-d285-404b-9817-49deada49d0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:48:57 user nova-compute[75176]: DEBUG nova.compute.manager [req-87b8f27d-c026-4dd3-9e53-4499790535dd req-107c3f0a-6097-44eb-8710-4e50c97dc1c0 service nova] [instance: cbefda8d-d285-404b-9817-49deada49d0b] No waiting events found dispatching network-vif-plugged-b402b4bc-60ff-48fa-9fff-f9ec26d82fa0 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:48:57 user nova-compute[75176]: WARNING nova.compute.manager [req-87b8f27d-c026-4dd3-9e53-4499790535dd req-107c3f0a-6097-44eb-8710-4e50c97dc1c0 service nova] [instance: cbefda8d-d285-404b-9817-49deada49d0b] Received unexpected event network-vif-plugged-b402b4bc-60ff-48fa-9fff-f9ec26d82fa0 for instance with vm_state building and task_state spawning.
Nov 28 15:48:57 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-694c954f-f1df-4cb5-bed0-424d27ccf0b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Acquiring lock "f66ead7d-98f4-4822-9dce-f2ea0206a58d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:48:57 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-694c954f-f1df-4cb5-bed0-424d27ccf0b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Lock "f66ead7d-98f4-4822-9dce-f2ea0206a58d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:48:57 user nova-compute[75176]: DEBUG nova.compute.manager [None req-694c954f-f1df-4cb5-bed0-424d27ccf0b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: f66ead7d-98f4-4822-9dce-f2ea0206a58d] Starting instance... {{(pid=75176) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 15:48:57 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-694c954f-f1df-4cb5-bed0-424d27ccf0b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:48:57 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-694c954f-f1df-4cb5-bed0-424d27ccf0b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:48:57 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-694c954f-f1df-4cb5-bed0-424d27ccf0b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75176) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 15:48:57 user nova-compute[75176]: INFO nova.compute.claims [None req-694c954f-f1df-4cb5-bed0-424d27ccf0b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: f66ead7d-98f4-4822-9dce-f2ea0206a58d] Claim successful on node user
Nov 28 15:48:57 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6ebcc53-802a-4515-ba41-3e8e1129235f/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:48:57 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:48:57 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:48:57 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:48:57 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-e7aec8e0-365d-4726-aa5c-ac4daf2ba718 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] Acquiring lock "8fe64eb8-b4e3-4037-80b1-0c151370d5a8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:48:57 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-e7aec8e0-365d-4726-aa5c-ac4daf2ba718 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] Lock "8fe64eb8-b4e3-4037-80b1-0c151370d5a8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:48:57 user nova-compute[75176]: DEBUG nova.objects.instance [None req-e7aec8e0-365d-4726-aa5c-ac4daf2ba718 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] Lazy-loading 'flavor' on Instance uuid 8fe64eb8-b4e3-4037-80b1-0c151370d5a8 {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:48:57 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6ebcc53-802a-4515-ba41-3e8e1129235f/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:48:57 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6ebcc53-802a-4515-ba41-3e8e1129235f/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:48:57 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-e7aec8e0-365d-4726-aa5c-ac4daf2ba718 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] Lock "8fe64eb8-b4e3-4037-80b1-0c151370d5a8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.121s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:48:57 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6ebcc53-802a-4515-ba41-3e8e1129235f/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:48:57 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e8507b7-fccf-4196-b589-bf2b74f165ec/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:48:57 user nova-compute[75176]: DEBUG nova.compute.provider_tree [None req-694c954f-f1df-4cb5-bed0-424d27ccf0b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Inventory has not changed in ProviderTree for provider: b37848d8-f401-4155-a029-b0ffa09ff85b {{(pid=75176) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 15:48:57 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-e7aec8e0-365d-4726-aa5c-ac4daf2ba718 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] Acquiring lock "8fe64eb8-b4e3-4037-80b1-0c151370d5a8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:48:57 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-e7aec8e0-365d-4726-aa5c-ac4daf2ba718 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] Lock "8fe64eb8-b4e3-4037-80b1-0c151370d5a8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.003s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:48:57 user nova-compute[75176]: INFO nova.compute.manager [None req-e7aec8e0-365d-4726-aa5c-ac4daf2ba718 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] [instance: 8fe64eb8-b4e3-4037-80b1-0c151370d5a8] Attaching volume 393b4cdf-14ce-4fce-ad98-c04e7f5b7296 to /dev/vdb
Nov 28 15:48:57 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-694c954f-f1df-4cb5-bed0-424d27ccf0b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Inventory has not changed for provider b37848d8-f401-4155-a029-b0ffa09ff85b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75176) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 15:48:58 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-694c954f-f1df-4cb5-bed0-424d27ccf0b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.722s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:48:58 user nova-compute[75176]: DEBUG nova.compute.manager [None req-694c954f-f1df-4cb5-bed0-424d27ccf0b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: f66ead7d-98f4-4822-9dce-f2ea0206a58d] Start building networks asynchronously for instance. {{(pid=75176) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 15:48:58 user nova-compute[75176]: DEBUG os_brick.utils [None req-e7aec8e0-365d-4726-aa5c-ac4daf2ba718 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 15:48:58 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:48:58 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e8507b7-fccf-4196-b589-bf2b74f165ec/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:48:58 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e8507b7-fccf-4196-b589-bf2b74f165ec/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:48:58 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:48:58 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[68669e8b-5dde-4cfa-baed-12d967b8499d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:edc924a949b2\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:48:58 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:48:58 user nova-compute[75176]: DEBUG nova.compute.manager [None req-694c954f-f1df-4cb5-bed0-424d27ccf0b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: f66ead7d-98f4-4822-9dce-f2ea0206a58d] Allocating IP information in the background. {{(pid=75176) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 15:48:58 user nova-compute[75176]: DEBUG nova.network.neutron [None req-694c954f-f1df-4cb5-bed0-424d27ccf0b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: f66ead7d-98f4-4822-9dce-f2ea0206a58d] allocate_for_instance() {{(pid=75176) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 15:48:58 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:48:58 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e56850c-4fd0-4b1f-b480-8ccd029cd73e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:48:58 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:48:58 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-694c954f-f1df-4cb5-bed0-424d27ccf0b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: f66ead7d-98f4-4822-9dce-f2ea0206a58d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 15:48:58 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:48:58 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ba30b52-7ba9-4baa-b39a-aa7affaa4ebb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:48:58 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cf5e034-e9fc-4496-af97-a3e952d78c27]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:48:58 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-e7aec8e0-365d-4726-aa5c-ac4daf2ba718 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] Running cmd (subprocess): nvme version {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:48:58 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-e7aec8e0-365d-4726-aa5c-ac4daf2ba718 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] 'nvme version' failed. Not Retrying. {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 15:48:58 user nova-compute[75176]: DEBUG nova.compute.manager [None req-694c954f-f1df-4cb5-bed0-424d27ccf0b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: f66ead7d-98f4-4822-9dce-f2ea0206a58d] Start building block device mappings for instance. {{(pid=75176) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 15:48:58 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e7aec8e0-365d-4726-aa5c-ac4daf2ba718 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] nvme not present on system {{(pid=75176) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 15:48:58 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:48:58 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 15:48:58 user nova-compute[75176]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 15:48:58 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[68ec4c8b-a864-40dc-a912-f6b26a44ff73]: (4, '') {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:48:58 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.lightos [None req-e7aec8e0-365d-4726-aa5c-ac4daf2ba718 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75176) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 15:48:58 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.lightos [None req-e7aec8e0-365d-4726-aa5c-ac4daf2ba718 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75176) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 15:48:58 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.lightos [None req-e7aec8e0-365d-4726-aa5c-ac4daf2ba718 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] LIGHTOS: no hostnqn found. {{(pid=75176) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 15:48:58 user nova-compute[75176]: DEBUG os_brick.utils [None req-e7aec8e0-365d-4726-aa5c-ac4daf2ba718 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] <== get_connector_properties: return (189ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:edc924a949b2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 15:48:58 user nova-compute[75176]: DEBUG nova.virt.block_device [None req-e7aec8e0-365d-4726-aa5c-ac4daf2ba718 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] [instance: 8fe64eb8-b4e3-4037-80b1-0c151370d5a8] Updating existing volume attachment record: e0f766ae-6d54-4909-8ea7-f54f57f35fbb {{(pid=75176) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 15:48:58 user nova-compute[75176]: DEBUG nova.policy [None req-694c954f-f1df-4cb5-bed0-424d27ccf0b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f24cedac95a44bb5a9ee54cc4713945c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf05c8836b8a40de8e64c2d046ed71ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75176) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 15:48:58 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e8507b7-fccf-4196-b589-bf2b74f165ec/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:48:58 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e8a6e1b-4f71-494a-8f44-f9643c658021/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:48:58 user nova-compute[75176]: DEBUG nova.compute.manager [None req-694c954f-f1df-4cb5-bed0-424d27ccf0b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: f66ead7d-98f4-4822-9dce-f2ea0206a58d] Start spawning the instance on the hypervisor. {{(pid=75176) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 15:48:58 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-694c954f-f1df-4cb5-bed0-424d27ccf0b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: f66ead7d-98f4-4822-9dce-f2ea0206a58d] Creating instance directory {{(pid=75176) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 15:48:58 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-694c954f-f1df-4cb5-bed0-424d27ccf0b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: f66ead7d-98f4-4822-9dce-f2ea0206a58d] Creating image(s)
Nov 28 15:48:58 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-694c954f-f1df-4cb5-bed0-424d27ccf0b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Acquiring lock "/opt/stack/data/nova/instances/f66ead7d-98f4-4822-9dce-f2ea0206a58d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:48:58 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-694c954f-f1df-4cb5-bed0-424d27ccf0b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Lock "/opt/stack/data/nova/instances/f66ead7d-98f4-4822-9dce-f2ea0206a58d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:48:58 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-694c954f-f1df-4cb5-bed0-424d27ccf0b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Lock "/opt/stack/data/nova/instances/f66ead7d-98f4-4822-9dce-f2ea0206a58d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:48:58 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-694c954f-f1df-4cb5-bed0-424d27ccf0b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:48:58 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e8a6e1b-4f71-494a-8f44-f9643c658021/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:48:58 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e8a6e1b-4f71-494a-8f44-f9643c658021/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:48:58 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-694c954f-f1df-4cb5-bed0-424d27ccf0b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json" returned: 0 in 0.179s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:48:58 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-694c954f-f1df-4cb5-bed0-424d27ccf0b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Acquiring lock "5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:48:58 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-694c954f-f1df-4cb5-bed0-424d27ccf0b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Lock "5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:48:58 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-694c954f-f1df-4cb5-bed0-424d27ccf0b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:48:58 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e8a6e1b-4f71-494a-8f44-f9643c658021/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:48:58 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbefda8d-d285-404b-9817-49deada49d0b/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:48:58 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-694c954f-f1df-4cb5-bed0-424d27ccf0b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json" returned: 0 in 0.184s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:48:58 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-694c954f-f1df-4cb5-bed0-424d27ccf0b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2,backing_fmt=raw /opt/stack/data/nova/instances/f66ead7d-98f4-4822-9dce-f2ea0206a58d/disk 1073741824 {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:48:58 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-694c954f-f1df-4cb5-bed0-424d27ccf0b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2,backing_fmt=raw /opt/stack/data/nova/instances/f66ead7d-98f4-4822-9dce-f2ea0206a58d/disk 1073741824" returned: 0 in 0.069s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:48:58 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-694c954f-f1df-4cb5-bed0-424d27ccf0b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Lock "5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.266s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:48:58 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-694c954f-f1df-4cb5-bed0-424d27ccf0b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:48:58 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbefda8d-d285-404b-9817-49deada49d0b/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:48:58 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbefda8d-d285-404b-9817-49deada49d0b/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:48:58 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:48:59 user nova-compute[75176]: DEBUG nova.compute.manager [None req-37481a34-5998-4c13-8082-6269fbfec6e8 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] [instance: cbefda8d-d285-404b-9817-49deada49d0b] Instance event wait completed in 0 seconds for  {{(pid=75176) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 15:48:59 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-37481a34-5998-4c13-8082-6269fbfec6e8 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] [instance: cbefda8d-d285-404b-9817-49deada49d0b] Guest created on hypervisor {{(pid=75176) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 15:48:59 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-694c954f-f1df-4cb5-bed0-424d27ccf0b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json" returned: 0 in 0.197s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:48:59 user nova-compute[75176]: INFO nova.virt.libvirt.driver [-] [instance: cbefda8d-d285-404b-9817-49deada49d0b] Instance spawned successfully.
Nov 28 15:48:59 user nova-compute[75176]: DEBUG nova.virt.disk.api [None req-694c954f-f1df-4cb5-bed0-424d27ccf0b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f66ead7d-98f4-4822-9dce-f2ea0206a58d/disk. size=1073741824 {{(pid=75176) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 15:48:59 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-694c954f-f1df-4cb5-bed0-424d27ccf0b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66ead7d-98f4-4822-9dce-f2ea0206a58d/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:48:59 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:48:59 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-37481a34-5998-4c13-8082-6269fbfec6e8 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] [instance: cbefda8d-d285-404b-9817-49deada49d0b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 15:48:59 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbefda8d-d285-404b-9817-49deada49d0b/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:48:59 user nova-compute[75176]: DEBUG nova.compute.manager [req-547e02c1-42df-4b51-8559-aae07b7ff63b req-4b77c997-193c-4fe6-ad3b-f363b7788289 service nova] [instance: cbefda8d-d285-404b-9817-49deada49d0b] Received event network-vif-plugged-b402b4bc-60ff-48fa-9fff-f9ec26d82fa0 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:48:59 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-547e02c1-42df-4b51-8559-aae07b7ff63b req-4b77c997-193c-4fe6-ad3b-f363b7788289 service nova] Acquiring lock "cbefda8d-d285-404b-9817-49deada49d0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:48:59 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-547e02c1-42df-4b51-8559-aae07b7ff63b req-4b77c997-193c-4fe6-ad3b-f363b7788289 service nova] Lock "cbefda8d-d285-404b-9817-49deada49d0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:48:59 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-547e02c1-42df-4b51-8559-aae07b7ff63b req-4b77c997-193c-4fe6-ad3b-f363b7788289 service nova] Lock "cbefda8d-d285-404b-9817-49deada49d0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:48:59 user nova-compute[75176]: DEBUG nova.compute.manager [req-547e02c1-42df-4b51-8559-aae07b7ff63b req-4b77c997-193c-4fe6-ad3b-f363b7788289 service nova] [instance: cbefda8d-d285-404b-9817-49deada49d0b] No waiting events found dispatching network-vif-plugged-b402b4bc-60ff-48fa-9fff-f9ec26d82fa0 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:48:59 user nova-compute[75176]: WARNING nova.compute.manager [req-547e02c1-42df-4b51-8559-aae07b7ff63b req-4b77c997-193c-4fe6-ad3b-f363b7788289 service nova] [instance: cbefda8d-d285-404b-9817-49deada49d0b] Received unexpected event network-vif-plugged-b402b4bc-60ff-48fa-9fff-f9ec26d82fa0 for instance with vm_state building and task_state spawning.
Nov 28 15:48:59 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-37481a34-5998-4c13-8082-6269fbfec6e8 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] [instance: cbefda8d-d285-404b-9817-49deada49d0b] Found default for hw_cdrom_bus of ide {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:48:59 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-37481a34-5998-4c13-8082-6269fbfec6e8 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] [instance: cbefda8d-d285-404b-9817-49deada49d0b] Found default for hw_disk_bus of virtio {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:48:59 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-37481a34-5998-4c13-8082-6269fbfec6e8 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] [instance: cbefda8d-d285-404b-9817-49deada49d0b] Found default for hw_input_bus of None {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:48:59 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-37481a34-5998-4c13-8082-6269fbfec6e8 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] [instance: cbefda8d-d285-404b-9817-49deada49d0b] Found default for hw_pointer_model of None {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:48:59 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-37481a34-5998-4c13-8082-6269fbfec6e8 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] [instance: cbefda8d-d285-404b-9817-49deada49d0b] Found default for hw_video_model of virtio {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:48:59 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-37481a34-5998-4c13-8082-6269fbfec6e8 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] [instance: cbefda8d-d285-404b-9817-49deada49d0b] Found default for hw_vif_model of virtio {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:48:59 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75176) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 15:48:59 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75176) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 15:48:59 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fe64eb8-b4e3-4037-80b1-0c151370d5a8/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:48:59 user nova-compute[75176]: DEBUG nova.network.neutron [None req-694c954f-f1df-4cb5-bed0-424d27ccf0b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: f66ead7d-98f4-4822-9dce-f2ea0206a58d] Successfully created port: 30bb2de8-1609-4cd8-8bb1-e32f2c4bfa81 {{(pid=75176) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 15:48:59 user nova-compute[75176]: INFO nova.compute.manager [None req-37481a34-5998-4c13-8082-6269fbfec6e8 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] [instance: cbefda8d-d285-404b-9817-49deada49d0b] Took 7.13 seconds to spawn the instance on the hypervisor.
Nov 28 15:48:59 user nova-compute[75176]: DEBUG nova.compute.manager [None req-37481a34-5998-4c13-8082-6269fbfec6e8 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] [instance: cbefda8d-d285-404b-9817-49deada49d0b] Checking state {{(pid=75176) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 15:48:59 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-694c954f-f1df-4cb5-bed0-424d27ccf0b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66ead7d-98f4-4822-9dce-f2ea0206a58d/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:48:59 user nova-compute[75176]: DEBUG nova.virt.disk.api [None req-694c954f-f1df-4cb5-bed0-424d27ccf0b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Cannot resize image /opt/stack/data/nova/instances/f66ead7d-98f4-4822-9dce-f2ea0206a58d/disk to a smaller size. {{(pid=75176) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 15:48:59 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-694c954f-f1df-4cb5-bed0-424d27ccf0b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: f66ead7d-98f4-4822-9dce-f2ea0206a58d] Created local disks {{(pid=75176) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 15:48:59 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-694c954f-f1df-4cb5-bed0-424d27ccf0b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: f66ead7d-98f4-4822-9dce-f2ea0206a58d] Ensure instance console log exists: /opt/stack/data/nova/instances/f66ead7d-98f4-4822-9dce-f2ea0206a58d/console.log {{(pid=75176) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 15:48:59 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-694c954f-f1df-4cb5-bed0-424d27ccf0b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:48:59 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-694c954f-f1df-4cb5-bed0-424d27ccf0b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:48:59 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-694c954f-f1df-4cb5-bed0-424d27ccf0b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:48:59 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fe64eb8-b4e3-4037-80b1-0c151370d5a8/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:48:59 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fe64eb8-b4e3-4037-80b1-0c151370d5a8/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:48:59 user nova-compute[75176]: INFO nova.compute.manager [None req-37481a34-5998-4c13-8082-6269fbfec6e8 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] [instance: cbefda8d-d285-404b-9817-49deada49d0b] Took 7.91 seconds to build instance.
Nov 28 15:48:59 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fe64eb8-b4e3-4037-80b1-0c151370d5a8/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:48:59 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d061df5-8dbc-4fc1-9935-d46efc934b58/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:48:59 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-37481a34-5998-4c13-8082-6269fbfec6e8 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Lock "cbefda8d-d285-404b-9817-49deada49d0b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.298s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:48:59 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d061df5-8dbc-4fc1-9935-d46efc934b58/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:48:59 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d061df5-8dbc-4fc1-9935-d46efc934b58/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:48:59 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d061df5-8dbc-4fc1-9935-d46efc934b58/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:49:00 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:49:00 user nova-compute[75176]: DEBUG nova.network.neutron [None req-694c954f-f1df-4cb5-bed0-424d27ccf0b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: f66ead7d-98f4-4822-9dce-f2ea0206a58d] Successfully updated port: 30bb2de8-1609-4cd8-8bb1-e32f2c4bfa81 {{(pid=75176) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 15:49:00 user nova-compute[75176]: DEBUG nova.compute.manager [req-28ce96ff-8191-4d27-b3ad-758074472122 req-0a959712-b9c3-4494-99aa-c4a169efdf93 service nova] [instance: f66ead7d-98f4-4822-9dce-f2ea0206a58d] Received event network-changed-30bb2de8-1609-4cd8-8bb1-e32f2c4bfa81 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:49:00 user nova-compute[75176]: DEBUG nova.compute.manager [req-28ce96ff-8191-4d27-b3ad-758074472122 req-0a959712-b9c3-4494-99aa-c4a169efdf93 service nova] [instance: f66ead7d-98f4-4822-9dce-f2ea0206a58d] Refreshing instance network info cache due to event network-changed-30bb2de8-1609-4cd8-8bb1-e32f2c4bfa81. {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 15:49:00 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-28ce96ff-8191-4d27-b3ad-758074472122 req-0a959712-b9c3-4494-99aa-c4a169efdf93 service nova] Acquiring lock "refresh_cache-f66ead7d-98f4-4822-9dce-f2ea0206a58d" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:49:00 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-28ce96ff-8191-4d27-b3ad-758074472122 req-0a959712-b9c3-4494-99aa-c4a169efdf93 service nova] Acquired lock "refresh_cache-f66ead7d-98f4-4822-9dce-f2ea0206a58d" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:49:00 user nova-compute[75176]: DEBUG nova.network.neutron [req-28ce96ff-8191-4d27-b3ad-758074472122 req-0a959712-b9c3-4494-99aa-c4a169efdf93 service nova] [instance: f66ead7d-98f4-4822-9dce-f2ea0206a58d] Refreshing network info cache for port 30bb2de8-1609-4cd8-8bb1-e32f2c4bfa81 {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 15:49:00 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-694c954f-f1df-4cb5-bed0-424d27ccf0b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Acquiring lock "refresh_cache-f66ead7d-98f4-4822-9dce-f2ea0206a58d" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:49:00 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 15:49:00 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 15:49:00 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Hypervisor/Node resource view: name=user free_ram=7556MB free_disk=25.307628631591797GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75176) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 15:49:00 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:49:00 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:49:00 user nova-compute[75176]: DEBUG nova.network.neutron [req-28ce96ff-8191-4d27-b3ad-758074472122 req-0a959712-b9c3-4494-99aa-c4a169efdf93 service nova] [instance: f66ead7d-98f4-4822-9dce-f2ea0206a58d] Instance cache missing network info. {{(pid=75176) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 15:49:00 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance 2e8507b7-fccf-4196-b589-bf2b74f165ec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:49:00 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance 1e8a6e1b-4f71-494a-8f44-f9643c658021 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:49:00 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance 8fe64eb8-b4e3-4037-80b1-0c151370d5a8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:49:00 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance a6ebcc53-802a-4515-ba41-3e8e1129235f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:49:00 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance ca1558cf-b235-4a20-8d12-45f1ca16fe41 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:49:00 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance 42579ef7-54dc-4165-a144-61e80fdd5626 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:49:00 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance 6d061df5-8dbc-4fc1-9935-d46efc934b58 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:49:00 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance cbefda8d-d285-404b-9817-49deada49d0b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:49:00 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance f66ead7d-98f4-4822-9dce-f2ea0206a58d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:49:00 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-64c58229-d3e7-48d7-8fb7-4df822ce3ccc tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Acquiring lock "55febf04-14ea-4903-8692-c7cc6115de75" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:49:00 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-64c58229-d3e7-48d7-8fb7-4df822ce3ccc tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Lock "55febf04-14ea-4903-8692-c7cc6115de75" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:49:00 user nova-compute[75176]: DEBUG nova.compute.manager [None req-64c58229-d3e7-48d7-8fb7-4df822ce3ccc tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] [instance: 55febf04-14ea-4903-8692-c7cc6115de75] Starting instance... {{(pid=75176) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 15:49:00 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance 55febf04-14ea-4903-8692-c7cc6115de75 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 28 15:49:00 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75176) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 15:49:00 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75176) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 15:49:00 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-64c58229-d3e7-48d7-8fb7-4df822ce3ccc tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:49:00 user nova-compute[75176]: DEBUG nova.network.neutron [req-28ce96ff-8191-4d27-b3ad-758074472122 req-0a959712-b9c3-4494-99aa-c4a169efdf93 service nova] [instance: f66ead7d-98f4-4822-9dce-f2ea0206a58d] Updating instance_info_cache with network_info: [] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:49:01 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-28ce96ff-8191-4d27-b3ad-758074472122 req-0a959712-b9c3-4494-99aa-c4a169efdf93 service nova] Releasing lock "refresh_cache-f66ead7d-98f4-4822-9dce-f2ea0206a58d" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:49:01 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-694c954f-f1df-4cb5-bed0-424d27ccf0b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Acquired lock "refresh_cache-f66ead7d-98f4-4822-9dce-f2ea0206a58d" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:49:01 user nova-compute[75176]: DEBUG nova.network.neutron [None req-694c954f-f1df-4cb5-bed0-424d27ccf0b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: f66ead7d-98f4-4822-9dce-f2ea0206a58d] Building network info cache for instance {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 15:49:01 user nova-compute[75176]: DEBUG nova.network.neutron [None req-694c954f-f1df-4cb5-bed0-424d27ccf0b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: f66ead7d-98f4-4822-9dce-f2ea0206a58d] Instance cache missing network info. {{(pid=75176) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 15:49:01 user nova-compute[75176]: DEBUG nova.compute.provider_tree [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Inventory has not changed in ProviderTree for provider: b37848d8-f401-4155-a029-b0ffa09ff85b {{(pid=75176) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 15:49:01 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Inventory has not changed for provider b37848d8-f401-4155-a029-b0ffa09ff85b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75176) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 15:49:01 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Compute_service record updated for user:user {{(pid=75176) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 15:49:01 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.667s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:49:01 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-64c58229-d3e7-48d7-8fb7-4df822ce3ccc tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.301s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:49:01 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-64c58229-d3e7-48d7-8fb7-4df822ce3ccc tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75176) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 15:49:01 user nova-compute[75176]: INFO nova.compute.claims [None req-64c58229-d3e7-48d7-8fb7-4df822ce3ccc tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] [instance: 55febf04-14ea-4903-8692-c7cc6115de75] Claim successful on node user
Nov 28 15:49:01 user nova-compute[75176]: DEBUG nova.network.neutron [None req-694c954f-f1df-4cb5-bed0-424d27ccf0b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: f66ead7d-98f4-4822-9dce-f2ea0206a58d] Updating instance_info_cache with network_info: [{"id": "30bb2de8-1609-4cd8-8bb1-e32f2c4bfa81", "address": "fa:16:3e:22:f2:8e", "network": {"id": "998766cd-2e8e-4e39-add9-286086640993", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-989265510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf05c8836b8a40de8e64c2d046ed71ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30bb2de8-16", "ovs_interfaceid": "30bb2de8-1609-4cd8-8bb1-e32f2c4bfa81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:49:01 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-694c954f-f1df-4cb5-bed0-424d27ccf0b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Releasing lock "refresh_cache-f66ead7d-98f4-4822-9dce-f2ea0206a58d" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:49:01 user nova-compute[75176]: DEBUG nova.compute.manager [None req-694c954f-f1df-4cb5-bed0-424d27ccf0b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: f66ead7d-98f4-4822-9dce-f2ea0206a58d] Instance network_info: |[{"id": "30bb2de8-1609-4cd8-8bb1-e32f2c4bfa81", "address": "fa:16:3e:22:f2:8e", "network": {"id": "998766cd-2e8e-4e39-add9-286086640993", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-989265510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf05c8836b8a40de8e64c2d046ed71ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30bb2de8-16", "ovs_interfaceid": "30bb2de8-1609-4cd8-8bb1-e32f2c4bfa81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75176) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 15:49:01 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-694c954f-f1df-4cb5-bed0-424d27ccf0b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: f66ead7d-98f4-4822-9dce-f2ea0206a58d] Start _get_guest_xml network_info=[{"id": "30bb2de8-1609-4cd8-8bb1-e32f2c4bfa81", "address": "fa:16:3e:22:f2:8e", "network": {"id": "998766cd-2e8e-4e39-add9-286086640993", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-989265510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf05c8836b8a40de8e64c2d046ed71ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30bb2de8-16", "ovs_interfaceid": "30bb2de8-1609-4cd8-8bb1-e32f2c4bfa81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T15:35:12Z,direct_url=<?>,disk_format='qcow2',id=1f41819e-c93f-4dc7-b253-37a27bbbbc74,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1b91c5d0672c4224a48df2e1f92688e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T15:35:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'size': 0, 'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'image_id': '1f41819e-c93f-4dc7-b253-37a27bbbbc74'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75176) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 15:49:01 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-694c954f-f1df-4cb5-bed0-424d27ccf0b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 15:49:01 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-694c954f-f1df-4cb5-bed0-424d27ccf0b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 15:49:01 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-694c954f-f1df-4cb5-bed0-424d27ccf0b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75176) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 15:49:01 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-694c954f-f1df-4cb5-bed0-424d27ccf0b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] CPU controller missing on host. {{(pid=75176) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 15:49:01 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-694c954f-f1df-4cb5-bed0-424d27ccf0b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75176) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 15:49:01 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-694c954f-f1df-4cb5-bed0-424d27ccf0b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] CPU controller found on host. {{(pid=75176) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 15:49:01 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-694c954f-f1df-4cb5-bed0-424d27ccf0b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75176) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 15:49:01 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-694c954f-f1df-4cb5-bed0-424d27ccf0b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T15:35:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T15:35:12Z,direct_url=<?>,disk_format='qcow2',id=1f41819e-c93f-4dc7-b253-37a27bbbbc74,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1b91c5d0672c4224a48df2e1f92688e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T15:35:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 15:49:01 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-694c954f-f1df-4cb5-bed0-424d27ccf0b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Flavor limits 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 15:49:01 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-694c954f-f1df-4cb5-bed0-424d27ccf0b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Image limits 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 15:49:01 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-694c954f-f1df-4cb5-bed0-424d27ccf0b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Flavor pref 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 15:49:01 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-694c954f-f1df-4cb5-bed0-424d27ccf0b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Image pref 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 15:49:01 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-694c954f-f1df-4cb5-bed0-424d27ccf0b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 15:49:01 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-694c954f-f1df-4cb5-bed0-424d27ccf0b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 15:49:01 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-694c954f-f1df-4cb5-bed0-424d27ccf0b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75176) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 15:49:01 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-694c954f-f1df-4cb5-bed0-424d27ccf0b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Got 1 possible topologies {{(pid=75176) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 15:49:01 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-694c954f-f1df-4cb5-bed0-424d27ccf0b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 15:49:01 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-694c954f-f1df-4cb5-bed0-424d27ccf0b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 15:49:01 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-694c954f-f1df-4cb5-bed0-424d27ccf0b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T15:48:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1211401386',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1211401386',id=30,image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bf05c8836b8a40de8e64c2d046ed71ff',ramdisk_id='',reservation_id='r-t3h4fnpo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1648409789',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T15:48:58Z,user_data=None,user_id='f24cedac95a44bb5a9ee54cc4713945c',uuid=f66ead7d-98f4-4822-9dce-f2ea0206a58d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "30bb2de8-1609-4cd8-8bb1-e32f2c4bfa81", "address": "fa:16:3e:22:f2:8e", "network": {"id": "998766cd-2e8e-4e39-add9-286086640993", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-989265510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf05c8836b8a40de8e64c2d046ed71ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30bb2de8-16", "ovs_interfaceid": "30bb2de8-1609-4cd8-8bb1-e32f2c4bfa81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75176) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 15:49:01 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-694c954f-f1df-4cb5-bed0-424d27ccf0b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Converting VIF {"id": "30bb2de8-1609-4cd8-8bb1-e32f2c4bfa81", "address": "fa:16:3e:22:f2:8e", "network": {"id": "998766cd-2e8e-4e39-add9-286086640993", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-989265510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf05c8836b8a40de8e64c2d046ed71ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30bb2de8-16", "ovs_interfaceid": "30bb2de8-1609-4cd8-8bb1-e32f2c4bfa81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:49:01 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-694c954f-f1df-4cb5-bed0-424d27ccf0b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:f2:8e,bridge_name='br-int',has_traffic_filtering=True,id=30bb2de8-1609-4cd8-8bb1-e32f2c4bfa81,network=Network(998766cd-2e8e-4e39-add9-286086640993),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30bb2de8-16') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:49:01 user nova-compute[75176]: DEBUG nova.objects.instance [None req-694c954f-f1df-4cb5-bed0-424d27ccf0b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Lazy-loading 'pci_devices' on Instance uuid f66ead7d-98f4-4822-9dce-f2ea0206a58d {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:49:01 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-694c954f-f1df-4cb5-bed0-424d27ccf0b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: f66ead7d-98f4-4822-9dce-f2ea0206a58d] End _get_guest_xml xml=<domain type="kvm">
Nov 28 15:49:01 user nova-compute[75176]:   <uuid>f66ead7d-98f4-4822-9dce-f2ea0206a58d</uuid>
Nov 28 15:49:01 user nova-compute[75176]:   <name>instance-0000001e</name>
Nov 28 15:49:01 user nova-compute[75176]:   <memory>524288</memory>
Nov 28 15:49:01 user nova-compute[75176]:   <vcpu>1</vcpu>
Nov 28 15:49:01 user nova-compute[75176]:   <metadata>
Nov 28 15:49:01 user nova-compute[75176]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 15:49:01 user nova-compute[75176]:       <nova:package version="0.0.0"/>
Nov 28 15:49:01 user nova-compute[75176]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1211401386</nova:name>
Nov 28 15:49:01 user nova-compute[75176]:       <nova:creationTime>2023-11-28 15:49:01</nova:creationTime>
Nov 28 15:49:01 user nova-compute[75176]:       <nova:flavor name="m1.tiny">
Nov 28 15:49:01 user nova-compute[75176]:         <nova:memory>512</nova:memory>
Nov 28 15:49:01 user nova-compute[75176]:         <nova:disk>1</nova:disk>
Nov 28 15:49:01 user nova-compute[75176]:         <nova:swap>0</nova:swap>
Nov 28 15:49:01 user nova-compute[75176]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 15:49:01 user nova-compute[75176]:         <nova:vcpus>1</nova:vcpus>
Nov 28 15:49:01 user nova-compute[75176]:       </nova:flavor>
Nov 28 15:49:01 user nova-compute[75176]:       <nova:owner>
Nov 28 15:49:01 user nova-compute[75176]:         <nova:user uuid="f24cedac95a44bb5a9ee54cc4713945c">tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member</nova:user>
Nov 28 15:49:01 user nova-compute[75176]:         <nova:project uuid="bf05c8836b8a40de8e64c2d046ed71ff">tempest-ServerBootFromVolumeStableRescueTest-1648409789</nova:project>
Nov 28 15:49:01 user nova-compute[75176]:       </nova:owner>
Nov 28 15:49:01 user nova-compute[75176]:       <nova:root type="image" uuid="1f41819e-c93f-4dc7-b253-37a27bbbbc74"/>
Nov 28 15:49:01 user nova-compute[75176]:       <nova:ports>
Nov 28 15:49:01 user nova-compute[75176]:         <nova:port uuid="30bb2de8-1609-4cd8-8bb1-e32f2c4bfa81">
Nov 28 15:49:01 user nova-compute[75176]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 28 15:49:01 user nova-compute[75176]:         </nova:port>
Nov 28 15:49:01 user nova-compute[75176]:       </nova:ports>
Nov 28 15:49:01 user nova-compute[75176]:     </nova:instance>
Nov 28 15:49:01 user nova-compute[75176]:   </metadata>
Nov 28 15:49:01 user nova-compute[75176]:   <sysinfo type="smbios">
Nov 28 15:49:01 user nova-compute[75176]:     <system>
Nov 28 15:49:01 user nova-compute[75176]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 15:49:01 user nova-compute[75176]:       <entry name="product">OpenStack Nova</entry>
Nov 28 15:49:01 user nova-compute[75176]:       <entry name="version">0.0.0</entry>
Nov 28 15:49:01 user nova-compute[75176]:       <entry name="serial">f66ead7d-98f4-4822-9dce-f2ea0206a58d</entry>
Nov 28 15:49:01 user nova-compute[75176]:       <entry name="uuid">f66ead7d-98f4-4822-9dce-f2ea0206a58d</entry>
Nov 28 15:49:01 user nova-compute[75176]:       <entry name="family">Virtual Machine</entry>
Nov 28 15:49:01 user nova-compute[75176]:     </system>
Nov 28 15:49:01 user nova-compute[75176]:   </sysinfo>
Nov 28 15:49:01 user nova-compute[75176]:   <os>
Nov 28 15:49:01 user nova-compute[75176]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 15:49:01 user nova-compute[75176]:     <boot dev="hd"/>
Nov 28 15:49:01 user nova-compute[75176]:     <smbios mode="sysinfo"/>
Nov 28 15:49:01 user nova-compute[75176]:   </os>
Nov 28 15:49:01 user nova-compute[75176]:   <features>
Nov 28 15:49:01 user nova-compute[75176]:     <acpi/>
Nov 28 15:49:01 user nova-compute[75176]:     <apic/>
Nov 28 15:49:01 user nova-compute[75176]:     <vmcoreinfo/>
Nov 28 15:49:01 user nova-compute[75176]:   </features>
Nov 28 15:49:01 user nova-compute[75176]:   <clock offset="utc">
Nov 28 15:49:01 user nova-compute[75176]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 15:49:01 user nova-compute[75176]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 15:49:01 user nova-compute[75176]:     <timer name="hpet" present="no"/>
Nov 28 15:49:01 user nova-compute[75176]:   </clock>
Nov 28 15:49:01 user nova-compute[75176]:   <cpu mode="custom" match="exact">
Nov 28 15:49:01 user nova-compute[75176]:     <model>Nehalem</model>
Nov 28 15:49:01 user nova-compute[75176]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 15:49:01 user nova-compute[75176]:   </cpu>
Nov 28 15:49:01 user nova-compute[75176]:   <devices>
Nov 28 15:49:01 user nova-compute[75176]:     <disk type="file" device="disk">
Nov 28 15:49:01 user nova-compute[75176]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 15:49:01 user nova-compute[75176]:       <source file="/opt/stack/data/nova/instances/f66ead7d-98f4-4822-9dce-f2ea0206a58d/disk"/>
Nov 28 15:49:01 user nova-compute[75176]:       <target dev="vda" bus="virtio"/>
Nov 28 15:49:01 user nova-compute[75176]:     </disk>
Nov 28 15:49:01 user nova-compute[75176]:     <interface type="ethernet">
Nov 28 15:49:01 user nova-compute[75176]:       <mac address="fa:16:3e:22:f2:8e"/>
Nov 28 15:49:01 user nova-compute[75176]:       <model type="virtio"/>
Nov 28 15:49:01 user nova-compute[75176]:       <mtu size="1442"/>
Nov 28 15:49:01 user nova-compute[75176]:       <target dev="tap30bb2de8-16"/>
Nov 28 15:49:01 user nova-compute[75176]:     </interface>
Nov 28 15:49:01 user nova-compute[75176]:     <serial type="pty">
Nov 28 15:49:01 user nova-compute[75176]:       <log file="/opt/stack/data/nova/instances/f66ead7d-98f4-4822-9dce-f2ea0206a58d/console.log" append="off"/>
Nov 28 15:49:01 user nova-compute[75176]:     </serial>
Nov 28 15:49:01 user nova-compute[75176]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 15:49:01 user nova-compute[75176]:     <video>
Nov 28 15:49:01 user nova-compute[75176]:       <model type="virtio"/>
Nov 28 15:49:01 user nova-compute[75176]:     </video>
Nov 28 15:49:01 user nova-compute[75176]:     <rng model="virtio">
Nov 28 15:49:01 user nova-compute[75176]:       <backend model="random">/dev/urandom</backend>
Nov 28 15:49:01 user nova-compute[75176]:     </rng>
Nov 28 15:49:01 user nova-compute[75176]:     <controller type="usb" index="0" model="none"/>
Nov 28 15:49:01 user nova-compute[75176]:     <memballoon model="virtio">
Nov 28 15:49:01 user nova-compute[75176]:       <stats period="10"/>
Nov 28 15:49:01 user nova-compute[75176]:     </memballoon>
Nov 28 15:49:01 user nova-compute[75176]:   </devices>
Nov 28 15:49:01 user nova-compute[75176]: </domain>
Nov 28 15:49:01 user nova-compute[75176]:  {{(pid=75176) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 15:49:01 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-694c954f-f1df-4cb5-bed0-424d27ccf0b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T15:48:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1211401386',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1211401386',id=30,image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bf05c8836b8a40de8e64c2d046ed71ff',ramdisk_id='',reservation_id='r-t3h4fnpo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1648409789',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T15:48:58Z,user_data=None,user_id='f24cedac95a44bb5a9ee54cc4713945c',uuid=f66ead7d-98f4-4822-9dce-f2ea0206a58d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "30bb2de8-1609-4cd8-8bb1-e32f2c4bfa81", "address": "fa:16:3e:22:f2:8e", "network": {"id": "998766cd-2e8e-4e39-add9-286086640993", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-989265510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf05c8836b8a40de8e64c2d046ed71ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30bb2de8-16", "ovs_interfaceid": "30bb2de8-1609-4cd8-8bb1-e32f2c4bfa81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 15:49:01 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-694c954f-f1df-4cb5-bed0-424d27ccf0b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Converting VIF {"id": "30bb2de8-1609-4cd8-8bb1-e32f2c4bfa81", "address": "fa:16:3e:22:f2:8e", "network": {"id": "998766cd-2e8e-4e39-add9-286086640993", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-989265510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf05c8836b8a40de8e64c2d046ed71ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30bb2de8-16", "ovs_interfaceid": "30bb2de8-1609-4cd8-8bb1-e32f2c4bfa81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:49:01 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-694c954f-f1df-4cb5-bed0-424d27ccf0b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:f2:8e,bridge_name='br-int',has_traffic_filtering=True,id=30bb2de8-1609-4cd8-8bb1-e32f2c4bfa81,network=Network(998766cd-2e8e-4e39-add9-286086640993),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30bb2de8-16') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:49:01 user nova-compute[75176]: DEBUG os_vif [None req-694c954f-f1df-4cb5-bed0-424d27ccf0b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:f2:8e,bridge_name='br-int',has_traffic_filtering=True,id=30bb2de8-1609-4cd8-8bb1-e32f2c4bfa81,network=Network(998766cd-2e8e-4e39-add9-286086640993),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30bb2de8-16') {{(pid=75176) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 15:49:01 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:49:01 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:49:01 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 15:49:01 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:49:01 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8d7899ab-7027-5ffe-8b50-4776f77f152a', '_type': 'linux-noop'}}, row=False) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:49:01 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:49:01 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:49:01 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:49:01 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap30bb2de8-16, may_exist=True, interface_attrs={}) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:49:01 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap30bb2de8-16, col_values=(('qos', UUID('0775a78d-7e38-4bab-aa40-1922a87fc58b')),), if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:49:01 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap30bb2de8-16, col_values=(('external_ids', {'iface-id': '30bb2de8-1609-4cd8-8bb1-e32f2c4bfa81', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:22:f2:8e', 'vm-uuid': 'f66ead7d-98f4-4822-9dce-f2ea0206a58d'}),), if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:49:01 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:49:01 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:49:01 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:49:01 user nova-compute[75176]: INFO os_vif [None req-694c954f-f1df-4cb5-bed0-424d27ccf0b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:f2:8e,bridge_name='br-int',has_traffic_filtering=True,id=30bb2de8-1609-4cd8-8bb1-e32f2c4bfa81,network=Network(998766cd-2e8e-4e39-add9-286086640993),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30bb2de8-16')
Nov 28 15:49:01 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-694c954f-f1df-4cb5-bed0-424d27ccf0b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] No BDM found with device name vda, not building metadata. {{(pid=75176) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 15:49:01 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-694c954f-f1df-4cb5-bed0-424d27ccf0b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] No VIF found with MAC fa:16:3e:22:f2:8e, not building metadata {{(pid=75176) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 15:49:01 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-a7e4b7c1-c986-420d-985c-b839a84aa042 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Acquiring lock "8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:49:01 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-a7e4b7c1-c986-420d-985c-b839a84aa042 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Lock "8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:49:01 user nova-compute[75176]: DEBUG nova.compute.manager [None req-a7e4b7c1-c986-420d-985c-b839a84aa042 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] [instance: 8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7] Starting instance... {{(pid=75176) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 15:49:01 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-a7e4b7c1-c986-420d-985c-b839a84aa042 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:49:01 user nova-compute[75176]: DEBUG nova.compute.provider_tree [None req-64c58229-d3e7-48d7-8fb7-4df822ce3ccc tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Inventory has not changed in ProviderTree for provider: b37848d8-f401-4155-a029-b0ffa09ff85b {{(pid=75176) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 15:49:01 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-64c58229-d3e7-48d7-8fb7-4df822ce3ccc tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Inventory has not changed for provider b37848d8-f401-4155-a029-b0ffa09ff85b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75176) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 15:49:01 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-64c58229-d3e7-48d7-8fb7-4df822ce3ccc tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.528s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:49:01 user nova-compute[75176]: DEBUG nova.compute.manager [None req-64c58229-d3e7-48d7-8fb7-4df822ce3ccc tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] [instance: 55febf04-14ea-4903-8692-c7cc6115de75] Start building networks asynchronously for instance. {{(pid=75176) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 15:49:01 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-a7e4b7c1-c986-420d-985c-b839a84aa042 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.118s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:49:01 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-a7e4b7c1-c986-420d-985c-b839a84aa042 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75176) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 15:49:01 user nova-compute[75176]: INFO nova.compute.claims [None req-a7e4b7c1-c986-420d-985c-b839a84aa042 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] [instance: 8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7] Claim successful on node user
Nov 28 15:49:01 user nova-compute[75176]: DEBUG nova.compute.manager [None req-64c58229-d3e7-48d7-8fb7-4df822ce3ccc tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] [instance: 55febf04-14ea-4903-8692-c7cc6115de75] Allocating IP information in the background. {{(pid=75176) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 15:49:01 user nova-compute[75176]: DEBUG nova.network.neutron [None req-64c58229-d3e7-48d7-8fb7-4df822ce3ccc tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] [instance: 55febf04-14ea-4903-8692-c7cc6115de75] allocate_for_instance() {{(pid=75176) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 15:49:01 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-64c58229-d3e7-48d7-8fb7-4df822ce3ccc tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] [instance: 55febf04-14ea-4903-8692-c7cc6115de75] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 15:49:01 user nova-compute[75176]: DEBUG nova.compute.manager [None req-64c58229-d3e7-48d7-8fb7-4df822ce3ccc tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] [instance: 55febf04-14ea-4903-8692-c7cc6115de75] Start building block device mappings for instance. {{(pid=75176) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 15:49:01 user nova-compute[75176]: DEBUG nova.policy [None req-64c58229-d3e7-48d7-8fb7-4df822ce3ccc tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b7bd0e1b307f4d339ca2e540e063f028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2856ce0a2545cda0b796eb0be10a40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75176) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 15:49:02 user nova-compute[75176]: DEBUG nova.compute.manager [None req-64c58229-d3e7-48d7-8fb7-4df822ce3ccc tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] [instance: 55febf04-14ea-4903-8692-c7cc6115de75] Start spawning the instance on the hypervisor. {{(pid=75176) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 15:49:02 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-64c58229-d3e7-48d7-8fb7-4df822ce3ccc tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] [instance: 55febf04-14ea-4903-8692-c7cc6115de75] Creating instance directory {{(pid=75176) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 15:49:02 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-64c58229-d3e7-48d7-8fb7-4df822ce3ccc tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] [instance: 55febf04-14ea-4903-8692-c7cc6115de75] Creating image(s)
Nov 28 15:49:02 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-64c58229-d3e7-48d7-8fb7-4df822ce3ccc tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Acquiring lock "/opt/stack/data/nova/instances/55febf04-14ea-4903-8692-c7cc6115de75/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:49:02 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-64c58229-d3e7-48d7-8fb7-4df822ce3ccc tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Lock "/opt/stack/data/nova/instances/55febf04-14ea-4903-8692-c7cc6115de75/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:49:02 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-64c58229-d3e7-48d7-8fb7-4df822ce3ccc tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Lock "/opt/stack/data/nova/instances/55febf04-14ea-4903-8692-c7cc6115de75/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:49:02 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-64c58229-d3e7-48d7-8fb7-4df822ce3ccc tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:49:02 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-64c58229-d3e7-48d7-8fb7-4df822ce3ccc tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json" returned: 0 in 0.201s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:49:02 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-64c58229-d3e7-48d7-8fb7-4df822ce3ccc tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Acquiring lock "5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:49:02 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-64c58229-d3e7-48d7-8fb7-4df822ce3ccc tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Lock "5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:49:02 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-64c58229-d3e7-48d7-8fb7-4df822ce3ccc tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:49:02 user nova-compute[75176]: DEBUG nova.compute.provider_tree [None req-a7e4b7c1-c986-420d-985c-b839a84aa042 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Inventory has not changed in ProviderTree for provider: b37848d8-f401-4155-a029-b0ffa09ff85b {{(pid=75176) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 15:49:02 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-a7e4b7c1-c986-420d-985c-b839a84aa042 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Inventory has not changed for provider b37848d8-f401-4155-a029-b0ffa09ff85b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75176) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 15:49:02 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-a7e4b7c1-c986-420d-985c-b839a84aa042 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.588s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:49:02 user nova-compute[75176]: DEBUG nova.compute.manager [None req-a7e4b7c1-c986-420d-985c-b839a84aa042 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] [instance: 8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7] Start building networks asynchronously for instance. {{(pid=75176) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 15:49:02 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-64c58229-d3e7-48d7-8fb7-4df822ce3ccc tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json" returned: 0 in 0.206s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:49:02 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-64c58229-d3e7-48d7-8fb7-4df822ce3ccc tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2,backing_fmt=raw /opt/stack/data/nova/instances/55febf04-14ea-4903-8692-c7cc6115de75/disk 1073741824 {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:49:02 user nova-compute[75176]: DEBUG nova.compute.manager [None req-a7e4b7c1-c986-420d-985c-b839a84aa042 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] [instance: 8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7] Allocating IP information in the background. {{(pid=75176) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 15:49:02 user nova-compute[75176]: DEBUG nova.network.neutron [None req-a7e4b7c1-c986-420d-985c-b839a84aa042 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] [instance: 8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7] allocate_for_instance() {{(pid=75176) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 15:49:02 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-a7e4b7c1-c986-420d-985c-b839a84aa042 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] [instance: 8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 15:49:02 user nova-compute[75176]: DEBUG nova.network.neutron [None req-64c58229-d3e7-48d7-8fb7-4df822ce3ccc tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] [instance: 55febf04-14ea-4903-8692-c7cc6115de75] Successfully created port: e287ec1a-3726-4719-94b2-79764f7abd31 {{(pid=75176) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 15:49:02 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-64c58229-d3e7-48d7-8fb7-4df822ce3ccc tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2,backing_fmt=raw /opt/stack/data/nova/instances/55febf04-14ea-4903-8692-c7cc6115de75/disk 1073741824" returned: 0 in 0.066s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:49:02 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-64c58229-d3e7-48d7-8fb7-4df822ce3ccc tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Lock "5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.286s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:49:02 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-64c58229-d3e7-48d7-8fb7-4df822ce3ccc tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:49:02 user nova-compute[75176]: DEBUG nova.compute.manager [None req-a7e4b7c1-c986-420d-985c-b839a84aa042 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] [instance: 8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7] Start building block device mappings for instance. {{(pid=75176) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 15:49:02 user nova-compute[75176]: DEBUG nova.policy [None req-a7e4b7c1-c986-420d-985c-b839a84aa042 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b7bd0e1b307f4d339ca2e540e063f028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2856ce0a2545cda0b796eb0be10a40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75176) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 15:49:02 user nova-compute[75176]: DEBUG nova.compute.manager [None req-a7e4b7c1-c986-420d-985c-b839a84aa042 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] [instance: 8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7] Start spawning the instance on the hypervisor. {{(pid=75176) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 15:49:02 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-a7e4b7c1-c986-420d-985c-b839a84aa042 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] [instance: 8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7] Creating instance directory {{(pid=75176) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 15:49:02 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-a7e4b7c1-c986-420d-985c-b839a84aa042 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] [instance: 8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7] Creating image(s)
Nov 28 15:49:02 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-a7e4b7c1-c986-420d-985c-b839a84aa042 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Acquiring lock "/opt/stack/data/nova/instances/8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:49:02 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-a7e4b7c1-c986-420d-985c-b839a84aa042 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Lock "/opt/stack/data/nova/instances/8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:49:02 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-a7e4b7c1-c986-420d-985c-b839a84aa042 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Lock "/opt/stack/data/nova/instances/8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:49:02 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-a7e4b7c1-c986-420d-985c-b839a84aa042 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:49:02 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-64c58229-d3e7-48d7-8fb7-4df822ce3ccc tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json" returned: 0 in 0.237s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:49:02 user nova-compute[75176]: DEBUG nova.virt.disk.api [None req-64c58229-d3e7-48d7-8fb7-4df822ce3ccc tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Checking if we can resize image /opt/stack/data/nova/instances/55febf04-14ea-4903-8692-c7cc6115de75/disk. size=1073741824 {{(pid=75176) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 15:49:02 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-64c58229-d3e7-48d7-8fb7-4df822ce3ccc tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55febf04-14ea-4903-8692-c7cc6115de75/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:49:02 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:49:02 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:49:02 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:49:02 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-a7e4b7c1-c986-420d-985c-b839a84aa042 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json" returned: 0 in 0.199s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:49:02 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-a7e4b7c1-c986-420d-985c-b839a84aa042 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Acquiring lock "5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:49:02 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-a7e4b7c1-c986-420d-985c-b839a84aa042 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Lock "5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.004s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:49:02 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-a7e4b7c1-c986-420d-985c-b839a84aa042 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:49:02 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:49:03 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-64c58229-d3e7-48d7-8fb7-4df822ce3ccc tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55febf04-14ea-4903-8692-c7cc6115de75/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:49:03 user nova-compute[75176]: DEBUG nova.virt.disk.api [None req-64c58229-d3e7-48d7-8fb7-4df822ce3ccc tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Cannot resize image /opt/stack/data/nova/instances/55febf04-14ea-4903-8692-c7cc6115de75/disk to a smaller size. {{(pid=75176) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 15:49:03 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-64c58229-d3e7-48d7-8fb7-4df822ce3ccc tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] [instance: 55febf04-14ea-4903-8692-c7cc6115de75] Created local disks {{(pid=75176) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 15:49:03 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-64c58229-d3e7-48d7-8fb7-4df822ce3ccc tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] [instance: 55febf04-14ea-4903-8692-c7cc6115de75] Ensure instance console log exists: /opt/stack/data/nova/instances/55febf04-14ea-4903-8692-c7cc6115de75/console.log {{(pid=75176) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 15:49:03 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-64c58229-d3e7-48d7-8fb7-4df822ce3ccc tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:49:03 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-64c58229-d3e7-48d7-8fb7-4df822ce3ccc tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:49:03 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-64c58229-d3e7-48d7-8fb7-4df822ce3ccc tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:49:03 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-a7e4b7c1-c986-420d-985c-b839a84aa042 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json" returned: 0 in 0.280s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:49:03 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-a7e4b7c1-c986-420d-985c-b839a84aa042 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2,backing_fmt=raw /opt/stack/data/nova/instances/8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7/disk 1073741824 {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:49:03 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:49:03 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:49:03 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Starting heal instance info cache {{(pid=75176) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 15:49:03 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-a7e4b7c1-c986-420d-985c-b839a84aa042 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2,backing_fmt=raw /opt/stack/data/nova/instances/8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7/disk 1073741824" returned: 0 in 0.062s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:49:03 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-a7e4b7c1-c986-420d-985c-b839a84aa042 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Lock "5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.346s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:49:03 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-a7e4b7c1-c986-420d-985c-b839a84aa042 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:49:03 user nova-compute[75176]: DEBUG nova.compute.manager [req-4946d183-94d3-4dfd-8c85-c353db392bea req-dfd0176e-e85e-4431-97ee-a2c0e4bb2c19 service nova] [instance: f66ead7d-98f4-4822-9dce-f2ea0206a58d] Received event network-vif-plugged-30bb2de8-1609-4cd8-8bb1-e32f2c4bfa81 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:49:03 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-4946d183-94d3-4dfd-8c85-c353db392bea req-dfd0176e-e85e-4431-97ee-a2c0e4bb2c19 service nova] Acquiring lock "f66ead7d-98f4-4822-9dce-f2ea0206a58d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:49:03 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-4946d183-94d3-4dfd-8c85-c353db392bea req-dfd0176e-e85e-4431-97ee-a2c0e4bb2c19 service nova] Lock "f66ead7d-98f4-4822-9dce-f2ea0206a58d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:49:03 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-4946d183-94d3-4dfd-8c85-c353db392bea req-dfd0176e-e85e-4431-97ee-a2c0e4bb2c19 service nova] Lock "f66ead7d-98f4-4822-9dce-f2ea0206a58d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:49:03 user nova-compute[75176]: DEBUG nova.compute.manager [req-4946d183-94d3-4dfd-8c85-c353db392bea req-dfd0176e-e85e-4431-97ee-a2c0e4bb2c19 service nova] [instance: f66ead7d-98f4-4822-9dce-f2ea0206a58d] No waiting events found dispatching network-vif-plugged-30bb2de8-1609-4cd8-8bb1-e32f2c4bfa81 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:49:03 user nova-compute[75176]: WARNING nova.compute.manager [req-4946d183-94d3-4dfd-8c85-c353db392bea req-dfd0176e-e85e-4431-97ee-a2c0e4bb2c19 service nova] [instance: f66ead7d-98f4-4822-9dce-f2ea0206a58d] Received unexpected event network-vif-plugged-30bb2de8-1609-4cd8-8bb1-e32f2c4bfa81 for instance with vm_state building and task_state spawning.
Nov 28 15:49:03 user nova-compute[75176]: DEBUG nova.network.neutron [None req-a7e4b7c1-c986-420d-985c-b839a84aa042 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] [instance: 8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7] Successfully created port: dcbed8eb-5414-44c1-a7d9-2358d4549f99 {{(pid=75176) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 15:49:03 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquiring lock "refresh_cache-1e8a6e1b-4f71-494a-8f44-f9643c658021" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:49:03 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquired lock "refresh_cache-1e8a6e1b-4f71-494a-8f44-f9643c658021" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:49:03 user nova-compute[75176]: DEBUG nova.network.neutron [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] [instance: 1e8a6e1b-4f71-494a-8f44-f9643c658021] Forcefully refreshing network info cache for instance {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 15:49:03 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-a7e4b7c1-c986-420d-985c-b839a84aa042 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json" returned: 0 in 0.281s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:49:03 user nova-compute[75176]: DEBUG nova.virt.disk.api [None req-a7e4b7c1-c986-420d-985c-b839a84aa042 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7/disk. size=1073741824 {{(pid=75176) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 15:49:03 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-a7e4b7c1-c986-420d-985c-b839a84aa042 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:49:03 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:49:03 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:49:03 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:49:03 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-a7e4b7c1-c986-420d-985c-b839a84aa042 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:49:03 user nova-compute[75176]: DEBUG nova.virt.disk.api [None req-a7e4b7c1-c986-420d-985c-b839a84aa042 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Cannot resize image /opt/stack/data/nova/instances/8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7/disk to a smaller size. {{(pid=75176) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 15:49:03 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-a7e4b7c1-c986-420d-985c-b839a84aa042 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] [instance: 8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7] Created local disks {{(pid=75176) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 15:49:03 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-a7e4b7c1-c986-420d-985c-b839a84aa042 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] [instance: 8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7] Ensure instance console log exists: /opt/stack/data/nova/instances/8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7/console.log {{(pid=75176) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 15:49:03 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-a7e4b7c1-c986-420d-985c-b839a84aa042 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:49:03 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-a7e4b7c1-c986-420d-985c-b839a84aa042 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:49:03 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-a7e4b7c1-c986-420d-985c-b839a84aa042 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:49:03 user nova-compute[75176]: DEBUG nova.network.neutron [None req-64c58229-d3e7-48d7-8fb7-4df822ce3ccc tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] [instance: 55febf04-14ea-4903-8692-c7cc6115de75] Successfully updated port: e287ec1a-3726-4719-94b2-79764f7abd31 {{(pid=75176) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 15:49:03 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-64c58229-d3e7-48d7-8fb7-4df822ce3ccc tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Acquiring lock "refresh_cache-55febf04-14ea-4903-8692-c7cc6115de75" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:49:03 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-64c58229-d3e7-48d7-8fb7-4df822ce3ccc tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Acquired lock "refresh_cache-55febf04-14ea-4903-8692-c7cc6115de75" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:49:03 user nova-compute[75176]: DEBUG nova.network.neutron [None req-64c58229-d3e7-48d7-8fb7-4df822ce3ccc tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] [instance: 55febf04-14ea-4903-8692-c7cc6115de75] Building network info cache for instance {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 15:49:04 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:49:04 user nova-compute[75176]: DEBUG nova.network.neutron [None req-64c58229-d3e7-48d7-8fb7-4df822ce3ccc tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] [instance: 55febf04-14ea-4903-8692-c7cc6115de75] Instance cache missing network info. {{(pid=75176) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 15:49:04 user nova-compute[75176]: DEBUG nova.network.neutron [None req-a7e4b7c1-c986-420d-985c-b839a84aa042 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] [instance: 8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7] Successfully updated port: dcbed8eb-5414-44c1-a7d9-2358d4549f99 {{(pid=75176) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 15:49:04 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-a7e4b7c1-c986-420d-985c-b839a84aa042 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Acquiring lock "refresh_cache-8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:49:04 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-a7e4b7c1-c986-420d-985c-b839a84aa042 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Acquired lock "refresh_cache-8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:49:04 user nova-compute[75176]: DEBUG nova.network.neutron [None req-a7e4b7c1-c986-420d-985c-b839a84aa042 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] [instance: 8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7] Building network info cache for instance {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 15:49:04 user nova-compute[75176]: DEBUG nova.compute.manager [req-3eda8c4c-a82a-4ad1-9763-c964993cea25 req-80d0de9c-8119-49b9-9046-7a6060cc7e32 service nova] [instance: 8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7] Received event network-changed-dcbed8eb-5414-44c1-a7d9-2358d4549f99 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:49:04 user nova-compute[75176]: DEBUG nova.compute.manager [req-3eda8c4c-a82a-4ad1-9763-c964993cea25 req-80d0de9c-8119-49b9-9046-7a6060cc7e32 service nova] [instance: 8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7] Refreshing instance network info cache due to event network-changed-dcbed8eb-5414-44c1-a7d9-2358d4549f99. {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 15:49:04 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-3eda8c4c-a82a-4ad1-9763-c964993cea25 req-80d0de9c-8119-49b9-9046-7a6060cc7e32 service nova] Acquiring lock "refresh_cache-8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:49:04 user nova-compute[75176]: DEBUG nova.network.neutron [None req-a7e4b7c1-c986-420d-985c-b839a84aa042 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] [instance: 8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7] Instance cache missing network info. {{(pid=75176) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 15:49:04 user nova-compute[75176]: DEBUG nova.network.neutron [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] [instance: 1e8a6e1b-4f71-494a-8f44-f9643c658021] Updating instance_info_cache with network_info: [{"id": "34bebf25-27db-4839-9184-30d78a0ee582", "address": "fa:16:3e:90:a9:7c", "network": {"id": "51143aa0-7498-4dfc-8425-9046ee5aa4fc", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-351796020-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13ce3926a76541f7a32ada5070b10be1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34bebf25-27", "ovs_interfaceid": "34bebf25-27db-4839-9184-30d78a0ee582", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:49:04 user nova-compute[75176]: DEBUG nova.network.neutron [None req-64c58229-d3e7-48d7-8fb7-4df822ce3ccc tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] [instance: 55febf04-14ea-4903-8692-c7cc6115de75] Updating instance_info_cache with network_info: [{"id": "e287ec1a-3726-4719-94b2-79764f7abd31", "address": "fa:16:3e:0c:d1:2f", "network": {"id": "d47c1797-a66f-4f2d-b83e-903b5bd3251c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1416388789-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd2856ce0a2545cda0b796eb0be10a40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape287ec1a-37", "ovs_interfaceid": "e287ec1a-3726-4719-94b2-79764f7abd31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:49:04 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Releasing lock "refresh_cache-1e8a6e1b-4f71-494a-8f44-f9643c658021" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:49:04 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] [instance: 1e8a6e1b-4f71-494a-8f44-f9643c658021] Updated the network info_cache for instance {{(pid=75176) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 15:49:04 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-64c58229-d3e7-48d7-8fb7-4df822ce3ccc tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Releasing lock "refresh_cache-55febf04-14ea-4903-8692-c7cc6115de75" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:49:04 user nova-compute[75176]: DEBUG nova.compute.manager [None req-64c58229-d3e7-48d7-8fb7-4df822ce3ccc tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] [instance: 55febf04-14ea-4903-8692-c7cc6115de75] Instance network_info: |[{"id": "e287ec1a-3726-4719-94b2-79764f7abd31", "address": "fa:16:3e:0c:d1:2f", "network": {"id": "d47c1797-a66f-4f2d-b83e-903b5bd3251c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1416388789-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd2856ce0a2545cda0b796eb0be10a40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape287ec1a-37", "ovs_interfaceid": "e287ec1a-3726-4719-94b2-79764f7abd31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75176) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 15:49:04 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-64c58229-d3e7-48d7-8fb7-4df822ce3ccc tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] [instance: 55febf04-14ea-4903-8692-c7cc6115de75] Start _get_guest_xml network_info=[{"id": "e287ec1a-3726-4719-94b2-79764f7abd31", "address": "fa:16:3e:0c:d1:2f", "network": {"id": "d47c1797-a66f-4f2d-b83e-903b5bd3251c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1416388789-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd2856ce0a2545cda0b796eb0be10a40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape287ec1a-37", "ovs_interfaceid": "e287ec1a-3726-4719-94b2-79764f7abd31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T15:35:12Z,direct_url=<?>,disk_format='qcow2',id=1f41819e-c93f-4dc7-b253-37a27bbbbc74,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1b91c5d0672c4224a48df2e1f92688e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T15:35:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'size': 0, 'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'image_id': '1f41819e-c93f-4dc7-b253-37a27bbbbc74'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75176) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 15:49:04 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-64c58229-d3e7-48d7-8fb7-4df822ce3ccc tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 15:49:04 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-64c58229-d3e7-48d7-8fb7-4df822ce3ccc tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 15:49:04 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-64c58229-d3e7-48d7-8fb7-4df822ce3ccc tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75176) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 15:49:04 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-64c58229-d3e7-48d7-8fb7-4df822ce3ccc tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] CPU controller missing on host. {{(pid=75176) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 15:49:04 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-64c58229-d3e7-48d7-8fb7-4df822ce3ccc tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75176) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 15:49:04 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-64c58229-d3e7-48d7-8fb7-4df822ce3ccc tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] CPU controller found on host. {{(pid=75176) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 15:49:04 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-64c58229-d3e7-48d7-8fb7-4df822ce3ccc tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75176) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 15:49:04 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-64c58229-d3e7-48d7-8fb7-4df822ce3ccc tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T15:35:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T15:35:12Z,direct_url=<?>,disk_format='qcow2',id=1f41819e-c93f-4dc7-b253-37a27bbbbc74,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1b91c5d0672c4224a48df2e1f92688e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T15:35:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 15:49:04 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-64c58229-d3e7-48d7-8fb7-4df822ce3ccc tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Flavor limits 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 15:49:04 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-64c58229-d3e7-48d7-8fb7-4df822ce3ccc tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Image limits 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 15:49:04 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-64c58229-d3e7-48d7-8fb7-4df822ce3ccc tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Flavor pref 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 15:49:04 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-64c58229-d3e7-48d7-8fb7-4df822ce3ccc tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Image pref 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 15:49:04 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-64c58229-d3e7-48d7-8fb7-4df822ce3ccc tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 15:49:04 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-64c58229-d3e7-48d7-8fb7-4df822ce3ccc tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 15:49:04 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-64c58229-d3e7-48d7-8fb7-4df822ce3ccc tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75176) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 15:49:04 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-64c58229-d3e7-48d7-8fb7-4df822ce3ccc tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Got 1 possible topologies {{(pid=75176) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 15:49:04 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-64c58229-d3e7-48d7-8fb7-4df822ce3ccc tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 15:49:04 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-64c58229-d3e7-48d7-8fb7-4df822ce3ccc tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 15:49:04 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-64c58229-d3e7-48d7-8fb7-4df822ce3ccc tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T15:48:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1621955693',display_name='tempest-ServerRescueNegativeTestJSON-server-1621955693',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1621955693',id=31,image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fd2856ce0a2545cda0b796eb0be10a40',ramdisk_id='',reservation_id='r-r0jnkzy2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1263291627',owner_user_name='tempest-ServerRescueNegativeTestJSON-1263291627-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T15:49:02Z,user_data=None,user_id='b7bd0e1b307f4d339ca2e540e063f028',uuid=55febf04-14ea-4903-8692-c7cc6115de75,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e287ec1a-3726-4719-94b2-79764f7abd31", "address": "fa:16:3e:0c:d1:2f", "network": {"id": "d47c1797-a66f-4f2d-b83e-903b5bd3251c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1416388789-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd2856ce0a2545cda0b796eb0be10a40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape287ec1a-37", "ovs_interfaceid": "e287ec1a-3726-4719-94b2-79764f7abd31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75176) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 15:49:04 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-64c58229-d3e7-48d7-8fb7-4df822ce3ccc tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Converting VIF {"id": "e287ec1a-3726-4719-94b2-79764f7abd31", "address": "fa:16:3e:0c:d1:2f", "network": {"id": "d47c1797-a66f-4f2d-b83e-903b5bd3251c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1416388789-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd2856ce0a2545cda0b796eb0be10a40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape287ec1a-37", "ovs_interfaceid": "e287ec1a-3726-4719-94b2-79764f7abd31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:49:04 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-64c58229-d3e7-48d7-8fb7-4df822ce3ccc tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:d1:2f,bridge_name='br-int',has_traffic_filtering=True,id=e287ec1a-3726-4719-94b2-79764f7abd31,network=Network(d47c1797-a66f-4f2d-b83e-903b5bd3251c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape287ec1a-37') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:49:04 user nova-compute[75176]: DEBUG nova.objects.instance [None req-64c58229-d3e7-48d7-8fb7-4df822ce3ccc tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Lazy-loading 'pci_devices' on Instance uuid 55febf04-14ea-4903-8692-c7cc6115de75 {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:49:04 user nova-compute[75176]: DEBUG nova.network.neutron [None req-a7e4b7c1-c986-420d-985c-b839a84aa042 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] [instance: 8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7] Updating instance_info_cache with network_info: [{"id": "dcbed8eb-5414-44c1-a7d9-2358d4549f99", "address": "fa:16:3e:fd:e1:90", "network": {"id": "d47c1797-a66f-4f2d-b83e-903b5bd3251c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1416388789-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd2856ce0a2545cda0b796eb0be10a40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcbed8eb-54", "ovs_interfaceid": "dcbed8eb-5414-44c1-a7d9-2358d4549f99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:49:04 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-64c58229-d3e7-48d7-8fb7-4df822ce3ccc tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] [instance: 55febf04-14ea-4903-8692-c7cc6115de75] End _get_guest_xml xml=<domain type="kvm">
Nov 28 15:49:04 user nova-compute[75176]:   <uuid>55febf04-14ea-4903-8692-c7cc6115de75</uuid>
Nov 28 15:49:04 user nova-compute[75176]:   <name>instance-0000001f</name>
Nov 28 15:49:04 user nova-compute[75176]:   <memory>524288</memory>
Nov 28 15:49:04 user nova-compute[75176]:   <vcpu>1</vcpu>
Nov 28 15:49:04 user nova-compute[75176]:   <metadata>
Nov 28 15:49:04 user nova-compute[75176]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 15:49:04 user nova-compute[75176]:       <nova:package version="0.0.0"/>
Nov 28 15:49:04 user nova-compute[75176]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1621955693</nova:name>
Nov 28 15:49:04 user nova-compute[75176]:       <nova:creationTime>2023-11-28 15:49:04</nova:creationTime>
Nov 28 15:49:04 user nova-compute[75176]:       <nova:flavor name="m1.tiny">
Nov 28 15:49:04 user nova-compute[75176]:         <nova:memory>512</nova:memory>
Nov 28 15:49:04 user nova-compute[75176]:         <nova:disk>1</nova:disk>
Nov 28 15:49:04 user nova-compute[75176]:         <nova:swap>0</nova:swap>
Nov 28 15:49:04 user nova-compute[75176]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 15:49:04 user nova-compute[75176]:         <nova:vcpus>1</nova:vcpus>
Nov 28 15:49:04 user nova-compute[75176]:       </nova:flavor>
Nov 28 15:49:04 user nova-compute[75176]:       <nova:owner>
Nov 28 15:49:04 user nova-compute[75176]:         <nova:user uuid="b7bd0e1b307f4d339ca2e540e063f028">tempest-ServerRescueNegativeTestJSON-1263291627-project-member</nova:user>
Nov 28 15:49:04 user nova-compute[75176]:         <nova:project uuid="fd2856ce0a2545cda0b796eb0be10a40">tempest-ServerRescueNegativeTestJSON-1263291627</nova:project>
Nov 28 15:49:04 user nova-compute[75176]:       </nova:owner>
Nov 28 15:49:04 user nova-compute[75176]:       <nova:root type="image" uuid="1f41819e-c93f-4dc7-b253-37a27bbbbc74"/>
Nov 28 15:49:04 user nova-compute[75176]:       <nova:ports>
Nov 28 15:49:04 user nova-compute[75176]:         <nova:port uuid="e287ec1a-3726-4719-94b2-79764f7abd31">
Nov 28 15:49:04 user nova-compute[75176]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 28 15:49:04 user nova-compute[75176]:         </nova:port>
Nov 28 15:49:04 user nova-compute[75176]:       </nova:ports>
Nov 28 15:49:04 user nova-compute[75176]:     </nova:instance>
Nov 28 15:49:04 user nova-compute[75176]:   </metadata>
Nov 28 15:49:04 user nova-compute[75176]:   <sysinfo type="smbios">
Nov 28 15:49:04 user nova-compute[75176]:     <system>
Nov 28 15:49:04 user nova-compute[75176]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 15:49:04 user nova-compute[75176]:       <entry name="product">OpenStack Nova</entry>
Nov 28 15:49:04 user nova-compute[75176]:       <entry name="version">0.0.0</entry>
Nov 28 15:49:04 user nova-compute[75176]:       <entry name="serial">55febf04-14ea-4903-8692-c7cc6115de75</entry>
Nov 28 15:49:04 user nova-compute[75176]:       <entry name="uuid">55febf04-14ea-4903-8692-c7cc6115de75</entry>
Nov 28 15:49:04 user nova-compute[75176]:       <entry name="family">Virtual Machine</entry>
Nov 28 15:49:04 user nova-compute[75176]:     </system>
Nov 28 15:49:04 user nova-compute[75176]:   </sysinfo>
Nov 28 15:49:04 user nova-compute[75176]:   <os>
Nov 28 15:49:04 user nova-compute[75176]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 15:49:04 user nova-compute[75176]:     <boot dev="hd"/>
Nov 28 15:49:04 user nova-compute[75176]:     <smbios mode="sysinfo"/>
Nov 28 15:49:04 user nova-compute[75176]:   </os>
Nov 28 15:49:04 user nova-compute[75176]:   <features>
Nov 28 15:49:04 user nova-compute[75176]:     <acpi/>
Nov 28 15:49:04 user nova-compute[75176]:     <apic/>
Nov 28 15:49:04 user nova-compute[75176]:     <vmcoreinfo/>
Nov 28 15:49:04 user nova-compute[75176]:   </features>
Nov 28 15:49:04 user nova-compute[75176]:   <clock offset="utc">
Nov 28 15:49:04 user nova-compute[75176]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 15:49:04 user nova-compute[75176]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 15:49:04 user nova-compute[75176]:     <timer name="hpet" present="no"/>
Nov 28 15:49:04 user nova-compute[75176]:   </clock>
Nov 28 15:49:04 user nova-compute[75176]:   <cpu mode="custom" match="exact">
Nov 28 15:49:04 user nova-compute[75176]:     <model>Nehalem</model>
Nov 28 15:49:04 user nova-compute[75176]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 15:49:04 user nova-compute[75176]:   </cpu>
Nov 28 15:49:04 user nova-compute[75176]:   <devices>
Nov 28 15:49:04 user nova-compute[75176]:     <disk type="file" device="disk">
Nov 28 15:49:04 user nova-compute[75176]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 15:49:04 user nova-compute[75176]:       <source file="/opt/stack/data/nova/instances/55febf04-14ea-4903-8692-c7cc6115de75/disk"/>
Nov 28 15:49:04 user nova-compute[75176]:       <target dev="vda" bus="virtio"/>
Nov 28 15:49:04 user nova-compute[75176]:     </disk>
Nov 28 15:49:04 user nova-compute[75176]:     <interface type="ethernet">
Nov 28 15:49:04 user nova-compute[75176]:       <mac address="fa:16:3e:0c:d1:2f"/>
Nov 28 15:49:04 user nova-compute[75176]:       <model type="virtio"/>
Nov 28 15:49:04 user nova-compute[75176]:       <mtu size="1442"/>
Nov 28 15:49:04 user nova-compute[75176]:       <target dev="tape287ec1a-37"/>
Nov 28 15:49:04 user nova-compute[75176]:     </interface>
Nov 28 15:49:04 user nova-compute[75176]:     <serial type="pty">
Nov 28 15:49:04 user nova-compute[75176]:       <log file="/opt/stack/data/nova/instances/55febf04-14ea-4903-8692-c7cc6115de75/console.log" append="off"/>
Nov 28 15:49:04 user nova-compute[75176]:     </serial>
Nov 28 15:49:04 user nova-compute[75176]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 15:49:04 user nova-compute[75176]:     <video>
Nov 28 15:49:04 user nova-compute[75176]:       <model type="virtio"/>
Nov 28 15:49:04 user nova-compute[75176]:     </video>
Nov 28 15:49:04 user nova-compute[75176]:     <rng model="virtio">
Nov 28 15:49:04 user nova-compute[75176]:       <backend model="random">/dev/urandom</backend>
Nov 28 15:49:04 user nova-compute[75176]:     </rng>
Nov 28 15:49:04 user nova-compute[75176]:     <controller type="usb" index="0" model="none"/>
Nov 28 15:49:04 user nova-compute[75176]:     <memballoon model="virtio">
Nov 28 15:49:04 user nova-compute[75176]:       <stats period="10"/>
Nov 28 15:49:04 user nova-compute[75176]:     </memballoon>
Nov 28 15:49:04 user nova-compute[75176]:   </devices>
Nov 28 15:49:04 user nova-compute[75176]: </domain>
Nov 28 15:49:04 user nova-compute[75176]:  {{(pid=75176) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 15:49:04 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-64c58229-d3e7-48d7-8fb7-4df822ce3ccc tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T15:48:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1621955693',display_name='tempest-ServerRescueNegativeTestJSON-server-1621955693',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1621955693',id=31,image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fd2856ce0a2545cda0b796eb0be10a40',ramdisk_id='',reservation_id='r-r0jnkzy2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1263291627',owner_user_name='tempest-ServerRescueNegativeTestJSON-1263291627-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T15:49:02Z,user_data=None,user_id='b7bd0e1b307f4d339ca2e540e063f028',uuid=55febf04-14ea-4903-8692-c7cc6115de75,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e287ec1a-3726-4719-94b2-79764f7abd31", "address": "fa:16:3e:0c:d1:2f", "network": {"id": "d47c1797-a66f-4f2d-b83e-903b5bd3251c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1416388789-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd2856ce0a2545cda0b796eb0be10a40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape287ec1a-37", "ovs_interfaceid": "e287ec1a-3726-4719-94b2-79764f7abd31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 15:49:04 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-64c58229-d3e7-48d7-8fb7-4df822ce3ccc tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Converting VIF {"id": "e287ec1a-3726-4719-94b2-79764f7abd31", "address": "fa:16:3e:0c:d1:2f", "network": {"id": "d47c1797-a66f-4f2d-b83e-903b5bd3251c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1416388789-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd2856ce0a2545cda0b796eb0be10a40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape287ec1a-37", "ovs_interfaceid": "e287ec1a-3726-4719-94b2-79764f7abd31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:49:04 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-64c58229-d3e7-48d7-8fb7-4df822ce3ccc tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:d1:2f,bridge_name='br-int',has_traffic_filtering=True,id=e287ec1a-3726-4719-94b2-79764f7abd31,network=Network(d47c1797-a66f-4f2d-b83e-903b5bd3251c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape287ec1a-37') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:49:04 user nova-compute[75176]: DEBUG os_vif [None req-64c58229-d3e7-48d7-8fb7-4df822ce3ccc tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:d1:2f,bridge_name='br-int',has_traffic_filtering=True,id=e287ec1a-3726-4719-94b2-79764f7abd31,network=Network(d47c1797-a66f-4f2d-b83e-903b5bd3251c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape287ec1a-37') {{(pid=75176) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 15:49:04 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:49:04 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:49:04 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 15:49:04 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-a7e4b7c1-c986-420d-985c-b839a84aa042 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Releasing lock "refresh_cache-8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:49:04 user nova-compute[75176]: DEBUG nova.compute.manager [None req-a7e4b7c1-c986-420d-985c-b839a84aa042 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] [instance: 8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7] Instance network_info: |[{"id": "dcbed8eb-5414-44c1-a7d9-2358d4549f99", "address": "fa:16:3e:fd:e1:90", "network": {"id": "d47c1797-a66f-4f2d-b83e-903b5bd3251c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1416388789-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd2856ce0a2545cda0b796eb0be10a40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcbed8eb-54", "ovs_interfaceid": "dcbed8eb-5414-44c1-a7d9-2358d4549f99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75176) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 15:49:04 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:49:04 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0f30382a-0c16-5c88-a07b-94d4dbee9057', '_type': 'linux-noop'}}, row=False) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:49:04 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-3eda8c4c-a82a-4ad1-9763-c964993cea25 req-80d0de9c-8119-49b9-9046-7a6060cc7e32 service nova] Acquired lock "refresh_cache-8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:49:04 user nova-compute[75176]: DEBUG nova.network.neutron [req-3eda8c4c-a82a-4ad1-9763-c964993cea25 req-80d0de9c-8119-49b9-9046-7a6060cc7e32 service nova] [instance: 8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7] Refreshing network info cache for port dcbed8eb-5414-44c1-a7d9-2358d4549f99 {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 15:49:04 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-a7e4b7c1-c986-420d-985c-b839a84aa042 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] [instance: 8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7] Start _get_guest_xml network_info=[{"id": "dcbed8eb-5414-44c1-a7d9-2358d4549f99", "address": "fa:16:3e:fd:e1:90", "network": {"id": "d47c1797-a66f-4f2d-b83e-903b5bd3251c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1416388789-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd2856ce0a2545cda0b796eb0be10a40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcbed8eb-54", "ovs_interfaceid": "dcbed8eb-5414-44c1-a7d9-2358d4549f99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T15:35:12Z,direct_url=<?>,disk_format='qcow2',id=1f41819e-c93f-4dc7-b253-37a27bbbbc74,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1b91c5d0672c4224a48df2e1f92688e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T15:35:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'size': 0, 'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'image_id': '1f41819e-c93f-4dc7-b253-37a27bbbbc74'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75176) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 15:49:04 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:49:04 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:49:04 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:49:04 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape287ec1a-37, may_exist=True, interface_attrs={}) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:49:04 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape287ec1a-37, col_values=(('qos', UUID('12501ec4-3479-42b4-abfb-faf7bb6257ce')),), if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:49:04 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape287ec1a-37, col_values=(('external_ids', {'iface-id': 'e287ec1a-3726-4719-94b2-79764f7abd31', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0c:d1:2f', 'vm-uuid': '55febf04-14ea-4903-8692-c7cc6115de75'}),), if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:49:04 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:49:04 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:49:04 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:49:04 user nova-compute[75176]: INFO os_vif [None req-64c58229-d3e7-48d7-8fb7-4df822ce3ccc tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:d1:2f,bridge_name='br-int',has_traffic_filtering=True,id=e287ec1a-3726-4719-94b2-79764f7abd31,network=Network(d47c1797-a66f-4f2d-b83e-903b5bd3251c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape287ec1a-37')
Nov 28 15:49:04 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-a7e4b7c1-c986-420d-985c-b839a84aa042 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 15:49:04 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-a7e4b7c1-c986-420d-985c-b839a84aa042 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 15:49:04 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-a7e4b7c1-c986-420d-985c-b839a84aa042 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75176) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 15:49:04 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-a7e4b7c1-c986-420d-985c-b839a84aa042 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] CPU controller missing on host. {{(pid=75176) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 15:49:04 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-a7e4b7c1-c986-420d-985c-b839a84aa042 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75176) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 15:49:04 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-a7e4b7c1-c986-420d-985c-b839a84aa042 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] CPU controller found on host. {{(pid=75176) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 15:49:04 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-a7e4b7c1-c986-420d-985c-b839a84aa042 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75176) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 15:49:04 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-a7e4b7c1-c986-420d-985c-b839a84aa042 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T15:35:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T15:35:12Z,direct_url=<?>,disk_format='qcow2',id=1f41819e-c93f-4dc7-b253-37a27bbbbc74,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1b91c5d0672c4224a48df2e1f92688e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T15:35:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 15:49:04 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-a7e4b7c1-c986-420d-985c-b839a84aa042 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Flavor limits 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 15:49:04 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-a7e4b7c1-c986-420d-985c-b839a84aa042 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Image limits 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 15:49:04 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-a7e4b7c1-c986-420d-985c-b839a84aa042 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Flavor pref 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 15:49:04 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-a7e4b7c1-c986-420d-985c-b839a84aa042 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Image pref 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 15:49:04 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-a7e4b7c1-c986-420d-985c-b839a84aa042 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 15:49:04 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-a7e4b7c1-c986-420d-985c-b839a84aa042 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 15:49:04 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-a7e4b7c1-c986-420d-985c-b839a84aa042 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75176) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 15:49:04 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-a7e4b7c1-c986-420d-985c-b839a84aa042 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Got 1 possible topologies {{(pid=75176) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 15:49:04 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-a7e4b7c1-c986-420d-985c-b839a84aa042 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 15:49:04 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-a7e4b7c1-c986-420d-985c-b839a84aa042 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 15:49:04 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-a7e4b7c1-c986-420d-985c-b839a84aa042 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T15:49:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-912460137',display_name='tempest-ServerRescueNegativeTestJSON-server-912460137',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-912460137',id=32,image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fd2856ce0a2545cda0b796eb0be10a40',ramdisk_id='',reservation_id='r-buh2xw1r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1263291627',owner_user_name='tempest-ServerRescueNegativeTestJSON-1263291627-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T15:49:03Z,user_data=None,user_id='b7bd0e1b307f4d339ca2e540e063f028',uuid=8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dcbed8eb-5414-44c1-a7d9-2358d4549f99", "address": "fa:16:3e:fd:e1:90", "network": {"id": "d47c1797-a66f-4f2d-b83e-903b5bd3251c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1416388789-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd2856ce0a2545cda0b796eb0be10a40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcbed8eb-54", "ovs_interfaceid": "dcbed8eb-5414-44c1-a7d9-2358d4549f99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75176) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 15:49:04 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-a7e4b7c1-c986-420d-985c-b839a84aa042 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Converting VIF {"id": "dcbed8eb-5414-44c1-a7d9-2358d4549f99", "address": "fa:16:3e:fd:e1:90", "network": {"id": "d47c1797-a66f-4f2d-b83e-903b5bd3251c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1416388789-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd2856ce0a2545cda0b796eb0be10a40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcbed8eb-54", "ovs_interfaceid": "dcbed8eb-5414-44c1-a7d9-2358d4549f99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:49:04 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-a7e4b7c1-c986-420d-985c-b839a84aa042 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:e1:90,bridge_name='br-int',has_traffic_filtering=True,id=dcbed8eb-5414-44c1-a7d9-2358d4549f99,network=Network(d47c1797-a66f-4f2d-b83e-903b5bd3251c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdcbed8eb-54') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:49:04 user nova-compute[75176]: DEBUG nova.objects.instance [None req-a7e4b7c1-c986-420d-985c-b839a84aa042 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Lazy-loading 'pci_devices' on Instance uuid 8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7 {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:49:04 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-a7e4b7c1-c986-420d-985c-b839a84aa042 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] [instance: 8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7] End _get_guest_xml xml=<domain type="kvm">
Nov 28 15:49:04 user nova-compute[75176]:   <uuid>8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7</uuid>
Nov 28 15:49:04 user nova-compute[75176]:   <name>instance-00000020</name>
Nov 28 15:49:04 user nova-compute[75176]:   <memory>524288</memory>
Nov 28 15:49:04 user nova-compute[75176]:   <vcpu>1</vcpu>
Nov 28 15:49:04 user nova-compute[75176]:   <metadata>
Nov 28 15:49:04 user nova-compute[75176]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 15:49:04 user nova-compute[75176]:       <nova:package version="0.0.0"/>
Nov 28 15:49:04 user nova-compute[75176]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-912460137</nova:name>
Nov 28 15:49:04 user nova-compute[75176]:       <nova:creationTime>2023-11-28 15:49:04</nova:creationTime>
Nov 28 15:49:04 user nova-compute[75176]:       <nova:flavor name="m1.tiny">
Nov 28 15:49:04 user nova-compute[75176]:         <nova:memory>512</nova:memory>
Nov 28 15:49:04 user nova-compute[75176]:         <nova:disk>1</nova:disk>
Nov 28 15:49:04 user nova-compute[75176]:         <nova:swap>0</nova:swap>
Nov 28 15:49:04 user nova-compute[75176]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 15:49:04 user nova-compute[75176]:         <nova:vcpus>1</nova:vcpus>
Nov 28 15:49:04 user nova-compute[75176]:       </nova:flavor>
Nov 28 15:49:04 user nova-compute[75176]:       <nova:owner>
Nov 28 15:49:04 user nova-compute[75176]:         <nova:user uuid="b7bd0e1b307f4d339ca2e540e063f028">tempest-ServerRescueNegativeTestJSON-1263291627-project-member</nova:user>
Nov 28 15:49:04 user nova-compute[75176]:         <nova:project uuid="fd2856ce0a2545cda0b796eb0be10a40">tempest-ServerRescueNegativeTestJSON-1263291627</nova:project>
Nov 28 15:49:04 user nova-compute[75176]:       </nova:owner>
Nov 28 15:49:04 user nova-compute[75176]:       <nova:root type="image" uuid="1f41819e-c93f-4dc7-b253-37a27bbbbc74"/>
Nov 28 15:49:04 user nova-compute[75176]:       <nova:ports>
Nov 28 15:49:04 user nova-compute[75176]:         <nova:port uuid="dcbed8eb-5414-44c1-a7d9-2358d4549f99">
Nov 28 15:49:04 user nova-compute[75176]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 28 15:49:04 user nova-compute[75176]:         </nova:port>
Nov 28 15:49:04 user nova-compute[75176]:       </nova:ports>
Nov 28 15:49:04 user nova-compute[75176]:     </nova:instance>
Nov 28 15:49:04 user nova-compute[75176]:   </metadata>
Nov 28 15:49:04 user nova-compute[75176]:   <sysinfo type="smbios">
Nov 28 15:49:04 user nova-compute[75176]:     <system>
Nov 28 15:49:04 user nova-compute[75176]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 15:49:04 user nova-compute[75176]:       <entry name="product">OpenStack Nova</entry>
Nov 28 15:49:04 user nova-compute[75176]:       <entry name="version">0.0.0</entry>
Nov 28 15:49:04 user nova-compute[75176]:       <entry name="serial">8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7</entry>
Nov 28 15:49:04 user nova-compute[75176]:       <entry name="uuid">8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7</entry>
Nov 28 15:49:04 user nova-compute[75176]:       <entry name="family">Virtual Machine</entry>
Nov 28 15:49:04 user nova-compute[75176]:     </system>
Nov 28 15:49:04 user nova-compute[75176]:   </sysinfo>
Nov 28 15:49:04 user nova-compute[75176]:   <os>
Nov 28 15:49:04 user nova-compute[75176]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 15:49:04 user nova-compute[75176]:     <boot dev="hd"/>
Nov 28 15:49:04 user nova-compute[75176]:     <smbios mode="sysinfo"/>
Nov 28 15:49:04 user nova-compute[75176]:   </os>
Nov 28 15:49:04 user nova-compute[75176]:   <features>
Nov 28 15:49:04 user nova-compute[75176]:     <acpi/>
Nov 28 15:49:04 user nova-compute[75176]:     <apic/>
Nov 28 15:49:04 user nova-compute[75176]:     <vmcoreinfo/>
Nov 28 15:49:04 user nova-compute[75176]:   </features>
Nov 28 15:49:04 user nova-compute[75176]:   <clock offset="utc">
Nov 28 15:49:04 user nova-compute[75176]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 15:49:04 user nova-compute[75176]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 15:49:04 user nova-compute[75176]:     <timer name="hpet" present="no"/>
Nov 28 15:49:04 user nova-compute[75176]:   </clock>
Nov 28 15:49:04 user nova-compute[75176]:   <cpu mode="custom" match="exact">
Nov 28 15:49:04 user nova-compute[75176]:     <model>Nehalem</model>
Nov 28 15:49:04 user nova-compute[75176]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 15:49:04 user nova-compute[75176]:   </cpu>
Nov 28 15:49:04 user nova-compute[75176]:   <devices>
Nov 28 15:49:04 user nova-compute[75176]:     <disk type="file" device="disk">
Nov 28 15:49:04 user nova-compute[75176]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 15:49:04 user nova-compute[75176]:       <source file="/opt/stack/data/nova/instances/8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7/disk"/>
Nov 28 15:49:04 user nova-compute[75176]:       <target dev="vda" bus="virtio"/>
Nov 28 15:49:04 user nova-compute[75176]:     </disk>
Nov 28 15:49:04 user nova-compute[75176]:     <interface type="ethernet">
Nov 28 15:49:04 user nova-compute[75176]:       <mac address="fa:16:3e:fd:e1:90"/>
Nov 28 15:49:04 user nova-compute[75176]:       <model type="virtio"/>
Nov 28 15:49:04 user nova-compute[75176]:       <mtu size="1442"/>
Nov 28 15:49:04 user nova-compute[75176]:       <target dev="tapdcbed8eb-54"/>
Nov 28 15:49:04 user nova-compute[75176]:     </interface>
Nov 28 15:49:04 user nova-compute[75176]:     <serial type="pty">
Nov 28 15:49:04 user nova-compute[75176]:       <log file="/opt/stack/data/nova/instances/8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7/console.log" append="off"/>
Nov 28 15:49:04 user nova-compute[75176]:     </serial>
Nov 28 15:49:04 user nova-compute[75176]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 15:49:04 user nova-compute[75176]:     <video>
Nov 28 15:49:04 user nova-compute[75176]:       <model type="virtio"/>
Nov 28 15:49:04 user nova-compute[75176]:     </video>
Nov 28 15:49:04 user nova-compute[75176]:     <rng model="virtio">
Nov 28 15:49:04 user nova-compute[75176]:       <backend model="random">/dev/urandom</backend>
Nov 28 15:49:04 user nova-compute[75176]:     </rng>
Nov 28 15:49:04 user nova-compute[75176]:     <controller type="usb" index="0" model="none"/>
Nov 28 15:49:04 user nova-compute[75176]:     <memballoon model="virtio">
Nov 28 15:49:04 user nova-compute[75176]:       <stats period="10"/>
Nov 28 15:49:04 user nova-compute[75176]:     </memballoon>
Nov 28 15:49:04 user nova-compute[75176]:   </devices>
Nov 28 15:49:04 user nova-compute[75176]: </domain>
Nov 28 15:49:04 user nova-compute[75176]:  {{(pid=75176) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 15:49:04 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-a7e4b7c1-c986-420d-985c-b839a84aa042 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T15:49:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-912460137',display_name='tempest-ServerRescueNegativeTestJSON-server-912460137',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-912460137',id=32,image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fd2856ce0a2545cda0b796eb0be10a40',ramdisk_id='',reservation_id='r-buh2xw1r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1263291627',owner_user_name='tempest-ServerRescueNegativeTestJSON-1263291627-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T15:49:03Z,user_data=None,user_id='b7bd0e1b307f4d339ca2e540e063f028',uuid=8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dcbed8eb-5414-44c1-a7d9-2358d4549f99", "address": "fa:16:3e:fd:e1:90", "network": {"id": "d47c1797-a66f-4f2d-b83e-903b5bd3251c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1416388789-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd2856ce0a2545cda0b796eb0be10a40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcbed8eb-54", "ovs_interfaceid": "dcbed8eb-5414-44c1-a7d9-2358d4549f99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 15:49:04 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-a7e4b7c1-c986-420d-985c-b839a84aa042 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Converting VIF {"id": "dcbed8eb-5414-44c1-a7d9-2358d4549f99", "address": "fa:16:3e:fd:e1:90", "network": {"id": "d47c1797-a66f-4f2d-b83e-903b5bd3251c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1416388789-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd2856ce0a2545cda0b796eb0be10a40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcbed8eb-54", "ovs_interfaceid": "dcbed8eb-5414-44c1-a7d9-2358d4549f99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:49:04 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-a7e4b7c1-c986-420d-985c-b839a84aa042 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:e1:90,bridge_name='br-int',has_traffic_filtering=True,id=dcbed8eb-5414-44c1-a7d9-2358d4549f99,network=Network(d47c1797-a66f-4f2d-b83e-903b5bd3251c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdcbed8eb-54') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:49:04 user nova-compute[75176]: DEBUG os_vif [None req-a7e4b7c1-c986-420d-985c-b839a84aa042 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:e1:90,bridge_name='br-int',has_traffic_filtering=True,id=dcbed8eb-5414-44c1-a7d9-2358d4549f99,network=Network(d47c1797-a66f-4f2d-b83e-903b5bd3251c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdcbed8eb-54') {{(pid=75176) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 15:49:04 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:49:04 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:49:04 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 15:49:04 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:49:04 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ffc20035-eb79-5a0a-96b4-2f7a54cf6df8', '_type': 'linux-noop'}}, row=False) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:49:04 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:49:04 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:49:04 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:49:04 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-64c58229-d3e7-48d7-8fb7-4df822ce3ccc tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] No BDM found with device name vda, not building metadata. {{(pid=75176) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 15:49:04 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-64c58229-d3e7-48d7-8fb7-4df822ce3ccc tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] No VIF found with MAC fa:16:3e:0c:d1:2f, not building metadata {{(pid=75176) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 15:49:04 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:49:04 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdcbed8eb-54, may_exist=True, interface_attrs={}) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:49:04 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdcbed8eb-54, col_values=(('qos', UUID('c97dfaa1-4175-472b-b204-6cef4163125e')),), if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:49:04 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdcbed8eb-54, col_values=(('external_ids', {'iface-id': 'dcbed8eb-5414-44c1-a7d9-2358d4549f99', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fd:e1:90', 'vm-uuid': '8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7'}),), if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:49:04 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:49:04 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:49:04 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:49:04 user nova-compute[75176]: INFO os_vif [None req-a7e4b7c1-c986-420d-985c-b839a84aa042 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:e1:90,bridge_name='br-int',has_traffic_filtering=True,id=dcbed8eb-5414-44c1-a7d9-2358d4549f99,network=Network(d47c1797-a66f-4f2d-b83e-903b5bd3251c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdcbed8eb-54')
Nov 28 15:49:04 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-a7e4b7c1-c986-420d-985c-b839a84aa042 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] No BDM found with device name vda, not building metadata. {{(pid=75176) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 15:49:04 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-a7e4b7c1-c986-420d-985c-b839a84aa042 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] No VIF found with MAC fa:16:3e:fd:e1:90, not building metadata {{(pid=75176) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 15:49:05 user nova-compute[75176]: DEBUG nova.network.neutron [req-3eda8c4c-a82a-4ad1-9763-c964993cea25 req-80d0de9c-8119-49b9-9046-7a6060cc7e32 service nova] [instance: 8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7] Updated VIF entry in instance network info cache for port dcbed8eb-5414-44c1-a7d9-2358d4549f99. {{(pid=75176) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 15:49:05 user nova-compute[75176]: DEBUG nova.network.neutron [req-3eda8c4c-a82a-4ad1-9763-c964993cea25 req-80d0de9c-8119-49b9-9046-7a6060cc7e32 service nova] [instance: 8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7] Updating instance_info_cache with network_info: [{"id": "dcbed8eb-5414-44c1-a7d9-2358d4549f99", "address": "fa:16:3e:fd:e1:90", "network": {"id": "d47c1797-a66f-4f2d-b83e-903b5bd3251c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1416388789-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd2856ce0a2545cda0b796eb0be10a40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcbed8eb-54", "ovs_interfaceid": "dcbed8eb-5414-44c1-a7d9-2358d4549f99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:49:05 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-3eda8c4c-a82a-4ad1-9763-c964993cea25 req-80d0de9c-8119-49b9-9046-7a6060cc7e32 service nova] Releasing lock "refresh_cache-8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:49:05 user nova-compute[75176]: DEBUG nova.compute.manager [None req-694c954f-f1df-4cb5-bed0-424d27ccf0b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: f66ead7d-98f4-4822-9dce-f2ea0206a58d] Instance event wait completed in 0 seconds for  {{(pid=75176) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 15:49:05 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-694c954f-f1df-4cb5-bed0-424d27ccf0b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: f66ead7d-98f4-4822-9dce-f2ea0206a58d] Guest created on hypervisor {{(pid=75176) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 15:49:05 user nova-compute[75176]: INFO nova.virt.libvirt.driver [-] [instance: f66ead7d-98f4-4822-9dce-f2ea0206a58d] Instance spawned successfully.
Nov 28 15:49:05 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-694c954f-f1df-4cb5-bed0-424d27ccf0b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: f66ead7d-98f4-4822-9dce-f2ea0206a58d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 15:49:05 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-694c954f-f1df-4cb5-bed0-424d27ccf0b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: f66ead7d-98f4-4822-9dce-f2ea0206a58d] Found default for hw_cdrom_bus of ide {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:49:05 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-694c954f-f1df-4cb5-bed0-424d27ccf0b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: f66ead7d-98f4-4822-9dce-f2ea0206a58d] Found default for hw_disk_bus of virtio {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:49:05 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-694c954f-f1df-4cb5-bed0-424d27ccf0b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: f66ead7d-98f4-4822-9dce-f2ea0206a58d] Found default for hw_input_bus of None {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:49:05 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-694c954f-f1df-4cb5-bed0-424d27ccf0b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: f66ead7d-98f4-4822-9dce-f2ea0206a58d] Found default for hw_pointer_model of None {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:49:05 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-694c954f-f1df-4cb5-bed0-424d27ccf0b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: f66ead7d-98f4-4822-9dce-f2ea0206a58d] Found default for hw_video_model of virtio {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:49:05 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-694c954f-f1df-4cb5-bed0-424d27ccf0b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: f66ead7d-98f4-4822-9dce-f2ea0206a58d] Found default for hw_vif_model of virtio {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:49:05 user nova-compute[75176]: INFO nova.compute.manager [None req-694c954f-f1df-4cb5-bed0-424d27ccf0b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: f66ead7d-98f4-4822-9dce-f2ea0206a58d] Took 7.01 seconds to spawn the instance on the hypervisor.
Nov 28 15:49:05 user nova-compute[75176]: DEBUG nova.compute.manager [None req-694c954f-f1df-4cb5-bed0-424d27ccf0b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: f66ead7d-98f4-4822-9dce-f2ea0206a58d] Checking state {{(pid=75176) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 15:49:05 user nova-compute[75176]: INFO nova.compute.manager [None req-694c954f-f1df-4cb5-bed0-424d27ccf0b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: f66ead7d-98f4-4822-9dce-f2ea0206a58d] Took 8.19 seconds to build instance.
Nov 28 15:49:05 user nova-compute[75176]: DEBUG nova.compute.manager [req-6ab28ae7-2486-4338-80d1-2e99e004062c req-d4be05f2-2cd0-4a52-a7bf-f2095661f33e service nova] [instance: 55febf04-14ea-4903-8692-c7cc6115de75] Received event network-changed-e287ec1a-3726-4719-94b2-79764f7abd31 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:49:05 user nova-compute[75176]: DEBUG nova.compute.manager [req-6ab28ae7-2486-4338-80d1-2e99e004062c req-d4be05f2-2cd0-4a52-a7bf-f2095661f33e service nova] [instance: 55febf04-14ea-4903-8692-c7cc6115de75] Refreshing instance network info cache due to event network-changed-e287ec1a-3726-4719-94b2-79764f7abd31. {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 15:49:05 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-6ab28ae7-2486-4338-80d1-2e99e004062c req-d4be05f2-2cd0-4a52-a7bf-f2095661f33e service nova] Acquiring lock "refresh_cache-55febf04-14ea-4903-8692-c7cc6115de75" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:49:05 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-6ab28ae7-2486-4338-80d1-2e99e004062c req-d4be05f2-2cd0-4a52-a7bf-f2095661f33e service nova] Acquired lock "refresh_cache-55febf04-14ea-4903-8692-c7cc6115de75" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:49:05 user nova-compute[75176]: DEBUG nova.network.neutron [req-6ab28ae7-2486-4338-80d1-2e99e004062c req-d4be05f2-2cd0-4a52-a7bf-f2095661f33e service nova] [instance: 55febf04-14ea-4903-8692-c7cc6115de75] Refreshing network info cache for port e287ec1a-3726-4719-94b2-79764f7abd31 {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 15:49:05 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-694c954f-f1df-4cb5-bed0-424d27ccf0b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Lock "f66ead7d-98f4-4822-9dce-f2ea0206a58d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.321s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:49:05 user nova-compute[75176]: DEBUG nova.network.neutron [req-6ab28ae7-2486-4338-80d1-2e99e004062c req-d4be05f2-2cd0-4a52-a7bf-f2095661f33e service nova] [instance: 55febf04-14ea-4903-8692-c7cc6115de75] Updated VIF entry in instance network info cache for port e287ec1a-3726-4719-94b2-79764f7abd31. {{(pid=75176) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 15:49:05 user nova-compute[75176]: DEBUG nova.network.neutron [req-6ab28ae7-2486-4338-80d1-2e99e004062c req-d4be05f2-2cd0-4a52-a7bf-f2095661f33e service nova] [instance: 55febf04-14ea-4903-8692-c7cc6115de75] Updating instance_info_cache with network_info: [{"id": "e287ec1a-3726-4719-94b2-79764f7abd31", "address": "fa:16:3e:0c:d1:2f", "network": {"id": "d47c1797-a66f-4f2d-b83e-903b5bd3251c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1416388789-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd2856ce0a2545cda0b796eb0be10a40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape287ec1a-37", "ovs_interfaceid": "e287ec1a-3726-4719-94b2-79764f7abd31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:49:05 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-6ab28ae7-2486-4338-80d1-2e99e004062c req-d4be05f2-2cd0-4a52-a7bf-f2095661f33e service nova] Releasing lock "refresh_cache-55febf04-14ea-4903-8692-c7cc6115de75" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:49:05 user nova-compute[75176]: DEBUG nova.compute.manager [req-6ab28ae7-2486-4338-80d1-2e99e004062c req-d4be05f2-2cd0-4a52-a7bf-f2095661f33e service nova] [instance: f66ead7d-98f4-4822-9dce-f2ea0206a58d] Received event network-vif-plugged-30bb2de8-1609-4cd8-8bb1-e32f2c4bfa81 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:49:05 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-6ab28ae7-2486-4338-80d1-2e99e004062c req-d4be05f2-2cd0-4a52-a7bf-f2095661f33e service nova] Acquiring lock "f66ead7d-98f4-4822-9dce-f2ea0206a58d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:49:05 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-6ab28ae7-2486-4338-80d1-2e99e004062c req-d4be05f2-2cd0-4a52-a7bf-f2095661f33e service nova] Lock "f66ead7d-98f4-4822-9dce-f2ea0206a58d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:49:05 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-6ab28ae7-2486-4338-80d1-2e99e004062c req-d4be05f2-2cd0-4a52-a7bf-f2095661f33e service nova] Lock "f66ead7d-98f4-4822-9dce-f2ea0206a58d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:49:05 user nova-compute[75176]: DEBUG nova.compute.manager [req-6ab28ae7-2486-4338-80d1-2e99e004062c req-d4be05f2-2cd0-4a52-a7bf-f2095661f33e service nova] [instance: f66ead7d-98f4-4822-9dce-f2ea0206a58d] No waiting events found dispatching network-vif-plugged-30bb2de8-1609-4cd8-8bb1-e32f2c4bfa81 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:49:05 user nova-compute[75176]: WARNING nova.compute.manager [req-6ab28ae7-2486-4338-80d1-2e99e004062c req-d4be05f2-2cd0-4a52-a7bf-f2095661f33e service nova] [instance: f66ead7d-98f4-4822-9dce-f2ea0206a58d] Received unexpected event network-vif-plugged-30bb2de8-1609-4cd8-8bb1-e32f2c4bfa81 for instance with vm_state active and task_state None.
Nov 28 15:49:06 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e7aec8e0-365d-4726-aa5c-ac4daf2ba718 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] [instance: 8fe64eb8-b4e3-4037-80b1-0c151370d5a8] Calling os-brick to attach iSCSI Volume {{(pid=75176) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 15:49:06 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7aec8e0-365d-4726-aa5c-ac4daf2ba718 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c1b8a00>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:393b4cdf-14ce-4fce-ad98-c04e7f5b7296', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ipouPXGx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 15:49:06 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-e7aec8e0-365d-4726-aa5c-ac4daf2ba718 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 15:49:06 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-e7aec8e0-365d-4726-aa5c-ac4daf2ba718 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 15:49:06 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-e7aec8e0-365d-4726-aa5c-ac4daf2ba718 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 15:49:06 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-e7aec8e0-365d-4726-aa5c-ac4daf2ba718 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 15:49:06 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-e7aec8e0-365d-4726-aa5c-ac4daf2ba718 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:393b4cdf-14ce-4fce-ad98-c04e7f5b7296" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 15:49:06 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-e7aec8e0-365d-4726-aa5c-ac4daf2ba718 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:393b4cdf-14ce-4fce-ad98-c04e7f5b7296" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 15:49:06 user nova-compute[75176]: INFO os_brick.initiator.connectors.iscsi [None req-e7aec8e0-365d-4726-aa5c-ac4daf2ba718 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 15:49:06 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:393b4cdf-14ce-4fce-ad98-c04e7f5b7296 -p 172.16.0.220:3260 {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:49:06 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:393b4cdf-14ce-4fce-ad98-c04e7f5b7296 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:49:06 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ecab8ad-3647-45ca-ae4d-3b052fe000c5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:49:06 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7aec8e0-365d-4726-aa5c-ac4daf2ba718 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 15:49:06 user nova-compute[75176]:  {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:49:06 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:393b4cdf-14ce-4fce-ad98-c04e7f5b7296 -p 172.16.0.220:3260 --interface default --op new {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:49:06 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:393b4cdf-14ce-4fce-ad98-c04e7f5b7296 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:49:06 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eef86ce-7425-4b2c-8b4d-6661a8a0fa7d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:393b4cdf-14ce-4fce-ad98-c04e7f5b7296] added\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:49:06 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7aec8e0-365d-4726-aa5c-ac4daf2ba718 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:393b4cdf-14ce-4fce-ad98-c04e7f5b7296] added
Nov 28 15:49:06 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:49:06 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:393b4cdf-14ce-4fce-ad98-c04e7f5b7296 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:49:06 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:393b4cdf-14ce-4fce-ad98-c04e7f5b7296 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:49:06 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee273254-ffc1-489e-9a90-ea7ecd9b12eb]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:49:06 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7aec8e0-365d-4726-aa5c-ac4daf2ba718 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:49:06 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:393b4cdf-14ce-4fce-ad98-c04e7f5b7296 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:49:06 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:393b4cdf-14ce-4fce-ad98-c04e7f5b7296 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:49:06 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[2de92a8c-a2b2-47ab-a8a5-754619fe2424]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:49:06 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7aec8e0-365d-4726-aa5c-ac4daf2ba718 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:49:06 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:393b4cdf-14ce-4fce-ad98-c04e7f5b7296 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ipouPXGx {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:49:06 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:393b4cdf-14ce-4fce-ad98-c04e7f5b7296 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ipouPXGx" returned: 0 in 0.016s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:49:06 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbaebbf6-9c7e-463c-bcee-388339ccad13]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:49:06 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7aec8e0-365d-4726-aa5c-ac4daf2ba718 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ipouPXGx'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:49:06 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:393b4cdf-14ce-4fce-ad98-c04e7f5b7296 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:49:06 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:393b4cdf-14ce-4fce-ad98-c04e7f5b7296 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:49:06 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[14df9c01-c31e-4881-a589-e87296e1fd01]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:49:06 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7aec8e0-365d-4726-aa5c-ac4daf2ba718 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:49:06 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:49:06 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:49:06 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[70d85c7a-5ee3-4dbe-b921-528c4cc257f7]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22933c6e-3d8f-44f5-bc41-dee97c587055 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8452525c-6845-4edb-bf69-1e2ffe0ef2eb (non-flash)\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:49:06 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7aec8e0-365d-4726-aa5c-ac4daf2ba718 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22933c6e-3d8f-44f5-bc41-dee97c587055 (non-flash)
Nov 28 15:49:06 user nova-compute[75176]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8452525c-6845-4edb-bf69-1e2ffe0ef2eb (non-flash)
Nov 28 15:49:06 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:49:06 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7aec8e0-365d-4726-aa5c-ac4daf2ba718 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22933c6e-3d8f-44f5-bc41-dee97c587055 (non-flash)
Nov 28 15:49:06 user nova-compute[75176]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8452525c-6845-4edb-bf69-1e2ffe0ef2eb (non-flash)
Nov 28 15:49:06 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 15:49:06 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:393b4cdf-14ce-4fce-ad98-c04e7f5b7296 -p 172.16.0.220:3260 --login {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:49:06 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:393b4cdf-14ce-4fce-ad98-c04e7f5b7296 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:49:06 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc112d80-06d7-4716-adc6-79bd468e85e2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:393b4cdf-14ce-4fce-ad98-c04e7f5b7296, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:393b4cdf-14ce-4fce-ad98-c04e7f5b7296, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:49:06 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7aec8e0-365d-4726-aa5c-ac4daf2ba718 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:393b4cdf-14ce-4fce-ad98-c04e7f5b7296, portal: 172.16.0.220,3260]
Nov 28 15:49:06 user nova-compute[75176]: Login to [iface: default, target: iqn.2010-10.org.openstack:393b4cdf-14ce-4fce-ad98-c04e7f5b7296, portal: 172.16.0.220,3260] successful.
Nov 28 15:49:06 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:49:06 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:393b4cdf-14ce-4fce-ad98-c04e7f5b7296 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:49:06 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:393b4cdf-14ce-4fce-ad98-c04e7f5b7296 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:49:06 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[faf6614a-46a4-4f8c-a758-8bd524eea224]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:49:06 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7aec8e0-365d-4726-aa5c-ac4daf2ba718 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:49:06 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:49:06 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:49:06 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6d146ff-bed0-467d-b1db-6b949b8b748b]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22933c6e-3d8f-44f5-bc41-dee97c587055 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8452525c-6845-4edb-bf69-1e2ffe0ef2eb (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:393b4cdf-14ce-4fce-ad98-c04e7f5b7296 (non-flash)\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:49:06 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7aec8e0-365d-4726-aa5c-ac4daf2ba718 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22933c6e-3d8f-44f5-bc41-dee97c587055 (non-flash)
Nov 28 15:49:06 user nova-compute[75176]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8452525c-6845-4edb-bf69-1e2ffe0ef2eb (non-flash)
Nov 28 15:49:06 user nova-compute[75176]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:393b4cdf-14ce-4fce-ad98-c04e7f5b7296 (non-flash)
Nov 28 15:49:06 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:49:06 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7aec8e0-365d-4726-aa5c-ac4daf2ba718 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22933c6e-3d8f-44f5-bc41-dee97c587055 (non-flash)
Nov 28 15:49:06 user nova-compute[75176]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8452525c-6845-4edb-bf69-1e2ffe0ef2eb (non-flash)
Nov 28 15:49:06 user nova-compute[75176]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:393b4cdf-14ce-4fce-ad98-c04e7f5b7296 (non-flash)
Nov 28 15:49:06 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 15:49:06 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-e7aec8e0-365d-4726-aa5c-ac4daf2ba718 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:393b4cdf-14ce-4fce-ad98-c04e7f5b7296" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.280s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 15:49:06 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7aec8e0-365d-4726-aa5c-ac4daf2ba718 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] Connected to 172.16.0.220:3260 {{(pid=75176) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 15:49:06 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-e7aec8e0-365d-4726-aa5c-ac4daf2ba718 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] HCTL ('35', '-', '-', 0) found on session 32 with lun 0 {{(pid=75176) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 15:49:06 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-e7aec8e0-365d-4726-aa5c-ac4daf2ba718 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75176) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 15:49:06 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:49:06 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.027s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:49:06 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[55b017e3-9566-4c56-ba97-7c3ab5dedd0c]: (4, ('- - 0', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:49:06 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-e7aec8e0-365d-4726-aa5c-ac4daf2ba718 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] Searching for a device in session 32 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75176) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 15:49:06 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7aec8e0-365d-4726-aa5c-ac4daf2ba718 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:393b4cdf-14ce-4fce-ad98-c04e7f5b7296', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ipouPXGx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75176) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 15:49:07 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:49:07 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:49:07 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:49:07 user nova-compute[75176]: DEBUG nova.compute.manager [req-37227735-cbe0-429d-a82a-1992fc091268 req-359f29af-13c2-4d5e-81f9-35ab1a6cd9d5 service nova] [instance: 55febf04-14ea-4903-8692-c7cc6115de75] Received event network-vif-plugged-e287ec1a-3726-4719-94b2-79764f7abd31 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:49:07 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-37227735-cbe0-429d-a82a-1992fc091268 req-359f29af-13c2-4d5e-81f9-35ab1a6cd9d5 service nova] Acquiring lock "55febf04-14ea-4903-8692-c7cc6115de75-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:49:07 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-37227735-cbe0-429d-a82a-1992fc091268 req-359f29af-13c2-4d5e-81f9-35ab1a6cd9d5 service nova] Lock "55febf04-14ea-4903-8692-c7cc6115de75-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:49:07 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-37227735-cbe0-429d-a82a-1992fc091268 req-359f29af-13c2-4d5e-81f9-35ab1a6cd9d5 service nova] Lock "55febf04-14ea-4903-8692-c7cc6115de75-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:49:07 user nova-compute[75176]: DEBUG nova.compute.manager [req-37227735-cbe0-429d-a82a-1992fc091268 req-359f29af-13c2-4d5e-81f9-35ab1a6cd9d5 service nova] [instance: 55febf04-14ea-4903-8692-c7cc6115de75] No waiting events found dispatching network-vif-plugged-e287ec1a-3726-4719-94b2-79764f7abd31 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:49:07 user nova-compute[75176]: WARNING nova.compute.manager [req-37227735-cbe0-429d-a82a-1992fc091268 req-359f29af-13c2-4d5e-81f9-35ab1a6cd9d5 service nova] [instance: 55febf04-14ea-4903-8692-c7cc6115de75] Received unexpected event network-vif-plugged-e287ec1a-3726-4719-94b2-79764f7abd31 for instance with vm_state building and task_state spawning.
Nov 28 15:49:07 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:49:07 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:49:07 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:49:07 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-e7aec8e0-365d-4726-aa5c-ac4daf2ba718 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.347s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 15:49:07 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7aec8e0-365d-4726-aa5c-ac4daf2ba718 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] <== connect_volume: return (1348ms) {'type': 'block', 'scsi_wwn': '23339373236323031', 'path': '/dev/sdd'} {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 15:49:07 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e7aec8e0-365d-4726-aa5c-ac4daf2ba718 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] [instance: 8fe64eb8-b4e3-4037-80b1-0c151370d5a8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23339373236323031', 'path': '/dev/sdd'} {{(pid=75176) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 15:49:07 user nova-compute[75176]: DEBUG nova.objects.instance [None req-e7aec8e0-365d-4726-aa5c-ac4daf2ba718 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] Lazy-loading 'flavor' on Instance uuid 8fe64eb8-b4e3-4037-80b1-0c151370d5a8 {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:49:07 user nova-compute[75176]: DEBUG nova.virt.libvirt.guest [None req-e7aec8e0-365d-4726-aa5c-ac4daf2ba718 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 15:49:07 user nova-compute[75176]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 15:49:07 user nova-compute[75176]:   <source dev="/dev/sdd"/>
Nov 28 15:49:07 user nova-compute[75176]:   <target dev="vdb" bus="virtio"/>
Nov 28 15:49:07 user nova-compute[75176]:   <serial>393b4cdf-14ce-4fce-ad98-c04e7f5b7296</serial>
Nov 28 15:49:07 user nova-compute[75176]: </disk>
Nov 28 15:49:07 user nova-compute[75176]:  {{(pid=75176) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 15:49:07 user nova-compute[75176]: DEBUG nova.compute.manager [req-3cf2bb9a-834c-4f24-8898-f8cb4c84d9bb req-f25d203b-862a-4a2e-8f1f-d89a9a642708 service nova] [instance: 8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7] Received event network-vif-plugged-dcbed8eb-5414-44c1-a7d9-2358d4549f99 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:49:07 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-3cf2bb9a-834c-4f24-8898-f8cb4c84d9bb req-f25d203b-862a-4a2e-8f1f-d89a9a642708 service nova] Acquiring lock "8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:49:07 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-3cf2bb9a-834c-4f24-8898-f8cb4c84d9bb req-f25d203b-862a-4a2e-8f1f-d89a9a642708 service nova] Lock "8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:49:07 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-3cf2bb9a-834c-4f24-8898-f8cb4c84d9bb req-f25d203b-862a-4a2e-8f1f-d89a9a642708 service nova] Lock "8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:49:07 user nova-compute[75176]: DEBUG nova.compute.manager [req-3cf2bb9a-834c-4f24-8898-f8cb4c84d9bb req-f25d203b-862a-4a2e-8f1f-d89a9a642708 service nova] [instance: 8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7] No waiting events found dispatching network-vif-plugged-dcbed8eb-5414-44c1-a7d9-2358d4549f99 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:49:07 user nova-compute[75176]: WARNING nova.compute.manager [req-3cf2bb9a-834c-4f24-8898-f8cb4c84d9bb req-f25d203b-862a-4a2e-8f1f-d89a9a642708 service nova] [instance: 8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7] Received unexpected event network-vif-plugged-dcbed8eb-5414-44c1-a7d9-2358d4549f99 for instance with vm_state building and task_state spawning.
Nov 28 15:49:07 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:49:07 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:49:07 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:49:08 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:49:08 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:49:08 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-e7aec8e0-365d-4726-aa5c-ac4daf2ba718 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] No BDM found with device name vda, not building metadata. {{(pid=75176) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 15:49:08 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-e7aec8e0-365d-4726-aa5c-ac4daf2ba718 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75176) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 15:49:08 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-e7aec8e0-365d-4726-aa5c-ac4daf2ba718 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] No VIF found with MAC fa:16:3e:00:fc:1e, not building metadata {{(pid=75176) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 15:49:08 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-e7aec8e0-365d-4726-aa5c-ac4daf2ba718 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] Lock "8fe64eb8-b4e3-4037-80b1-0c151370d5a8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.753s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:49:09 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:49:09 user nova-compute[75176]: DEBUG nova.compute.manager [req-5308562d-7fe1-469b-b91d-50c6c0dcfbf6 req-8cd4dd97-7153-413e-81dc-632acf49b5fc service nova] [instance: 55febf04-14ea-4903-8692-c7cc6115de75] Received event network-vif-plugged-e287ec1a-3726-4719-94b2-79764f7abd31 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:49:09 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-5308562d-7fe1-469b-b91d-50c6c0dcfbf6 req-8cd4dd97-7153-413e-81dc-632acf49b5fc service nova] Acquiring lock "55febf04-14ea-4903-8692-c7cc6115de75-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:49:09 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-5308562d-7fe1-469b-b91d-50c6c0dcfbf6 req-8cd4dd97-7153-413e-81dc-632acf49b5fc service nova] Lock "55febf04-14ea-4903-8692-c7cc6115de75-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:49:09 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-5308562d-7fe1-469b-b91d-50c6c0dcfbf6 req-8cd4dd97-7153-413e-81dc-632acf49b5fc service nova] Lock "55febf04-14ea-4903-8692-c7cc6115de75-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:49:09 user nova-compute[75176]: DEBUG nova.compute.manager [req-5308562d-7fe1-469b-b91d-50c6c0dcfbf6 req-8cd4dd97-7153-413e-81dc-632acf49b5fc service nova] [instance: 55febf04-14ea-4903-8692-c7cc6115de75] No waiting events found dispatching network-vif-plugged-e287ec1a-3726-4719-94b2-79764f7abd31 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:49:09 user nova-compute[75176]: WARNING nova.compute.manager [req-5308562d-7fe1-469b-b91d-50c6c0dcfbf6 req-8cd4dd97-7153-413e-81dc-632acf49b5fc service nova] [instance: 55febf04-14ea-4903-8692-c7cc6115de75] Received unexpected event network-vif-plugged-e287ec1a-3726-4719-94b2-79764f7abd31 for instance with vm_state building and task_state spawning.
Nov 28 15:49:09 user nova-compute[75176]: DEBUG nova.compute.manager [req-37d071ab-d0a8-41ee-a521-5fad208f6201 req-e309f40d-2735-4969-b751-4604421686c2 service nova] [instance: 8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7] Received event network-vif-plugged-dcbed8eb-5414-44c1-a7d9-2358d4549f99 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:49:09 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-37d071ab-d0a8-41ee-a521-5fad208f6201 req-e309f40d-2735-4969-b751-4604421686c2 service nova] Acquiring lock "8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:49:09 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-37d071ab-d0a8-41ee-a521-5fad208f6201 req-e309f40d-2735-4969-b751-4604421686c2 service nova] Lock "8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:49:09 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-37d071ab-d0a8-41ee-a521-5fad208f6201 req-e309f40d-2735-4969-b751-4604421686c2 service nova] Lock "8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:49:09 user nova-compute[75176]: DEBUG nova.compute.manager [req-37d071ab-d0a8-41ee-a521-5fad208f6201 req-e309f40d-2735-4969-b751-4604421686c2 service nova] [instance: 8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7] No waiting events found dispatching network-vif-plugged-dcbed8eb-5414-44c1-a7d9-2358d4549f99 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:49:09 user nova-compute[75176]: WARNING nova.compute.manager [req-37d071ab-d0a8-41ee-a521-5fad208f6201 req-e309f40d-2735-4969-b751-4604421686c2 service nova] [instance: 8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7] Received unexpected event network-vif-plugged-dcbed8eb-5414-44c1-a7d9-2358d4549f99 for instance with vm_state building and task_state spawning.
Nov 28 15:49:09 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:49:10 user nova-compute[75176]: DEBUG nova.compute.manager [None req-64c58229-d3e7-48d7-8fb7-4df822ce3ccc tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] [instance: 55febf04-14ea-4903-8692-c7cc6115de75] Instance event wait completed in 0 seconds for  {{(pid=75176) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 15:49:10 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-64c58229-d3e7-48d7-8fb7-4df822ce3ccc tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] [instance: 55febf04-14ea-4903-8692-c7cc6115de75] Guest created on hypervisor {{(pid=75176) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 15:49:10 user nova-compute[75176]: INFO nova.virt.libvirt.driver [-] [instance: 55febf04-14ea-4903-8692-c7cc6115de75] Instance spawned successfully.
Nov 28 15:49:10 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-64c58229-d3e7-48d7-8fb7-4df822ce3ccc tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] [instance: 55febf04-14ea-4903-8692-c7cc6115de75] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 15:49:10 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-64c58229-d3e7-48d7-8fb7-4df822ce3ccc tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] [instance: 55febf04-14ea-4903-8692-c7cc6115de75] Found default for hw_cdrom_bus of ide {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:49:10 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-64c58229-d3e7-48d7-8fb7-4df822ce3ccc tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] [instance: 55febf04-14ea-4903-8692-c7cc6115de75] Found default for hw_disk_bus of virtio {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:49:10 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-64c58229-d3e7-48d7-8fb7-4df822ce3ccc tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] [instance: 55febf04-14ea-4903-8692-c7cc6115de75] Found default for hw_input_bus of None {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:49:10 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-64c58229-d3e7-48d7-8fb7-4df822ce3ccc tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] [instance: 55febf04-14ea-4903-8692-c7cc6115de75] Found default for hw_pointer_model of None {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:49:10 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-64c58229-d3e7-48d7-8fb7-4df822ce3ccc tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] [instance: 55febf04-14ea-4903-8692-c7cc6115de75] Found default for hw_video_model of virtio {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:49:10 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-64c58229-d3e7-48d7-8fb7-4df822ce3ccc tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] [instance: 55febf04-14ea-4903-8692-c7cc6115de75] Found default for hw_vif_model of virtio {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:49:10 user nova-compute[75176]: INFO nova.compute.manager [None req-64c58229-d3e7-48d7-8fb7-4df822ce3ccc tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] [instance: 55febf04-14ea-4903-8692-c7cc6115de75] Took 8.43 seconds to spawn the instance on the hypervisor.
Nov 28 15:49:10 user nova-compute[75176]: DEBUG nova.compute.manager [None req-64c58229-d3e7-48d7-8fb7-4df822ce3ccc tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] [instance: 55febf04-14ea-4903-8692-c7cc6115de75] Checking state {{(pid=75176) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 15:49:10 user nova-compute[75176]: DEBUG nova.compute.manager [None req-a7e4b7c1-c986-420d-985c-b839a84aa042 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] [instance: 8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7] Instance event wait completed in 0 seconds for  {{(pid=75176) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 15:49:10 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-a7e4b7c1-c986-420d-985c-b839a84aa042 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] [instance: 8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7] Guest created on hypervisor {{(pid=75176) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 15:49:10 user nova-compute[75176]: INFO nova.virt.libvirt.driver [-] [instance: 8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7] Instance spawned successfully.
Nov 28 15:49:10 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-a7e4b7c1-c986-420d-985c-b839a84aa042 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] [instance: 8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 15:49:10 user nova-compute[75176]: INFO nova.compute.manager [None req-64c58229-d3e7-48d7-8fb7-4df822ce3ccc tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] [instance: 55febf04-14ea-4903-8692-c7cc6115de75] Took 9.66 seconds to build instance.
Nov 28 15:49:10 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-a7e4b7c1-c986-420d-985c-b839a84aa042 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] [instance: 8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7] Found default for hw_cdrom_bus of ide {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:49:10 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-a7e4b7c1-c986-420d-985c-b839a84aa042 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] [instance: 8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7] Found default for hw_disk_bus of virtio {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:49:10 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-a7e4b7c1-c986-420d-985c-b839a84aa042 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] [instance: 8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7] Found default for hw_input_bus of None {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:49:10 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-a7e4b7c1-c986-420d-985c-b839a84aa042 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] [instance: 8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7] Found default for hw_pointer_model of None {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:49:10 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-a7e4b7c1-c986-420d-985c-b839a84aa042 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] [instance: 8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7] Found default for hw_video_model of virtio {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:49:10 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-a7e4b7c1-c986-420d-985c-b839a84aa042 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] [instance: 8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7] Found default for hw_vif_model of virtio {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:49:10 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-64c58229-d3e7-48d7-8fb7-4df822ce3ccc tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Lock "55febf04-14ea-4903-8692-c7cc6115de75" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.844s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:49:10 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-8d1f9e9b-ef15-4b65-847f-4fec08a2ad56 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] Acquiring lock "8fe64eb8-b4e3-4037-80b1-0c151370d5a8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:49:10 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-8d1f9e9b-ef15-4b65-847f-4fec08a2ad56 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] Lock "8fe64eb8-b4e3-4037-80b1-0c151370d5a8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:49:10 user nova-compute[75176]: INFO nova.compute.manager [None req-8d1f9e9b-ef15-4b65-847f-4fec08a2ad56 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] [instance: 8fe64eb8-b4e3-4037-80b1-0c151370d5a8] Detaching volume 393b4cdf-14ce-4fce-ad98-c04e7f5b7296
Nov 28 15:49:10 user nova-compute[75176]: INFO nova.compute.manager [None req-a7e4b7c1-c986-420d-985c-b839a84aa042 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] [instance: 8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7] Took 7.97 seconds to spawn the instance on the hypervisor.
Nov 28 15:49:10 user nova-compute[75176]: DEBUG nova.compute.manager [None req-a7e4b7c1-c986-420d-985c-b839a84aa042 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] [instance: 8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7] Checking state {{(pid=75176) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 15:49:10 user nova-compute[75176]: INFO nova.virt.block_device [None req-8d1f9e9b-ef15-4b65-847f-4fec08a2ad56 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] [instance: 8fe64eb8-b4e3-4037-80b1-0c151370d5a8] Attempting to driver detach volume 393b4cdf-14ce-4fce-ad98-c04e7f5b7296 from mountpoint /dev/vdb
Nov 28 15:49:10 user nova-compute[75176]: INFO nova.compute.manager [None req-a7e4b7c1-c986-420d-985c-b839a84aa042 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] [instance: 8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7] Took 9.15 seconds to build instance.
Nov 28 15:49:10 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-8d1f9e9b-ef15-4b65-847f-4fec08a2ad56 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] Attempting to detach device vdb from instance 8fe64eb8-b4e3-4037-80b1-0c151370d5a8 from the persistent domain config. {{(pid=75176) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 15:49:10 user nova-compute[75176]: DEBUG nova.virt.libvirt.guest [None req-8d1f9e9b-ef15-4b65-847f-4fec08a2ad56 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 15:49:10 user nova-compute[75176]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 15:49:10 user nova-compute[75176]:   <source dev="/dev/sdd"/>
Nov 28 15:49:10 user nova-compute[75176]:   <target dev="vdb" bus="virtio"/>
Nov 28 15:49:10 user nova-compute[75176]:   <serial>393b4cdf-14ce-4fce-ad98-c04e7f5b7296</serial>
Nov 28 15:49:10 user nova-compute[75176]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 15:49:10 user nova-compute[75176]: </disk>
Nov 28 15:49:10 user nova-compute[75176]:  {{(pid=75176) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 15:49:10 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-a7e4b7c1-c986-420d-985c-b839a84aa042 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Lock "8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.273s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:49:10 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-8d1f9e9b-ef15-4b65-847f-4fec08a2ad56 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] Successfully detached device vdb from instance 8fe64eb8-b4e3-4037-80b1-0c151370d5a8 from the persistent domain config.
Nov 28 15:49:10 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-8d1f9e9b-ef15-4b65-847f-4fec08a2ad56 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8fe64eb8-b4e3-4037-80b1-0c151370d5a8 from the live domain config. {{(pid=75176) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 15:49:10 user nova-compute[75176]: DEBUG nova.virt.libvirt.guest [None req-8d1f9e9b-ef15-4b65-847f-4fec08a2ad56 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 15:49:10 user nova-compute[75176]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 15:49:10 user nova-compute[75176]:   <source dev="/dev/sdd"/>
Nov 28 15:49:10 user nova-compute[75176]:   <target dev="vdb" bus="virtio"/>
Nov 28 15:49:10 user nova-compute[75176]:   <serial>393b4cdf-14ce-4fce-ad98-c04e7f5b7296</serial>
Nov 28 15:49:10 user nova-compute[75176]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 15:49:10 user nova-compute[75176]: </disk>
Nov 28 15:49:10 user nova-compute[75176]:  {{(pid=75176) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 15:49:11 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-8d1f9e9b-ef15-4b65-847f-4fec08a2ad56 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8fe64eb8-b4e3-4037-80b1-0c151370d5a8 {{(pid=75176) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 15:49:14 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:49:14 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:49:16 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-82c01541-79e6-4079-ba49-a04ef639b42c tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Acquiring lock "a6ebcc53-802a-4515-ba41-3e8e1129235f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:49:16 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-82c01541-79e6-4079-ba49-a04ef639b42c tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Lock "a6ebcc53-802a-4515-ba41-3e8e1129235f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:49:16 user nova-compute[75176]: DEBUG nova.objects.instance [None req-82c01541-79e6-4079-ba49-a04ef639b42c tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Lazy-loading 'flavor' on Instance uuid a6ebcc53-802a-4515-ba41-3e8e1129235f {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:49:16 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-82c01541-79e6-4079-ba49-a04ef639b42c tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Lock "a6ebcc53-802a-4515-ba41-3e8e1129235f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:49:16 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-82c01541-79e6-4079-ba49-a04ef639b42c tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Acquiring lock "a6ebcc53-802a-4515-ba41-3e8e1129235f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:49:16 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-82c01541-79e6-4079-ba49-a04ef639b42c tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Lock "a6ebcc53-802a-4515-ba41-3e8e1129235f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:49:16 user nova-compute[75176]: INFO nova.compute.manager [None req-82c01541-79e6-4079-ba49-a04ef639b42c tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] [instance: a6ebcc53-802a-4515-ba41-3e8e1129235f] Attaching volume 36b14046-bbe0-45c6-add0-ab16578b41d3 to /dev/vdb
Nov 28 15:49:16 user nova-compute[75176]: DEBUG os_brick.utils [None req-82c01541-79e6-4079-ba49-a04ef639b42c tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 15:49:16 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:49:16 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:49:16 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5f609c9-ca3a-42b1-b8be-d4dbe37672b0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:edc924a949b2\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:49:16 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:49:16 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:49:16 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f090c5f-69cb-4b50-93eb-bfa301f71dec]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:49:16 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:49:16 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:49:16 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[97ee057a-41fd-4199-a5db-f0912e335820]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:49:16 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e4d87fd-a939-4f76-a4c7-60edf2035e5d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:49:16 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-82c01541-79e6-4079-ba49-a04ef639b42c tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Running cmd (subprocess): nvme version {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:49:16 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-82c01541-79e6-4079-ba49-a04ef639b42c tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] 'nvme version' failed. Not Retrying. {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 15:49:16 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.nvmeof [None req-82c01541-79e6-4079-ba49-a04ef639b42c tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] nvme not present on system {{(pid=75176) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 15:49:16 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:49:16 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 15:49:16 user nova-compute[75176]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 15:49:16 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[95e142af-9a9a-4d9c-b66d-f65b8d0b3758]: (4, '') {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:49:16 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.lightos [None req-82c01541-79e6-4079-ba49-a04ef639b42c tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75176) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 15:49:16 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.lightos [None req-82c01541-79e6-4079-ba49-a04ef639b42c tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75176) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 15:49:16 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.lightos [None req-82c01541-79e6-4079-ba49-a04ef639b42c tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] LIGHTOS: no hostnqn found. {{(pid=75176) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 15:49:16 user nova-compute[75176]: DEBUG os_brick.utils [None req-82c01541-79e6-4079-ba49-a04ef639b42c tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:edc924a949b2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 15:49:16 user nova-compute[75176]: DEBUG nova.virt.block_device [None req-82c01541-79e6-4079-ba49-a04ef639b42c tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] [instance: a6ebcc53-802a-4515-ba41-3e8e1129235f] Updating existing volume attachment record: 0769c656-89eb-431a-b803-2f98c4274181 {{(pid=75176) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 15:49:19 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:49:19 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:49:24 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:49:24 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-82c01541-79e6-4079-ba49-a04ef639b42c tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] [instance: a6ebcc53-802a-4515-ba41-3e8e1129235f] Calling os-brick to attach iSCSI Volume {{(pid=75176) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 15:49:24 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-82c01541-79e6-4079-ba49-a04ef639b42c tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c1b8a00>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:36b14046-bbe0-45c6-add0-ab16578b41d3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'coLtfdCj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 15:49:24 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-82c01541-79e6-4079-ba49-a04ef639b42c tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 15:49:24 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-82c01541-79e6-4079-ba49-a04ef639b42c tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 15:49:24 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-82c01541-79e6-4079-ba49-a04ef639b42c tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 15:49:24 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-82c01541-79e6-4079-ba49-a04ef639b42c tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 15:49:24 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-82c01541-79e6-4079-ba49-a04ef639b42c tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:36b14046-bbe0-45c6-add0-ab16578b41d3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 15:49:24 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-82c01541-79e6-4079-ba49-a04ef639b42c tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:36b14046-bbe0-45c6-add0-ab16578b41d3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 15:49:24 user nova-compute[75176]: INFO os_brick.initiator.connectors.iscsi [None req-82c01541-79e6-4079-ba49-a04ef639b42c tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 15:49:24 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36b14046-bbe0-45c6-add0-ab16578b41d3 -p 172.16.0.220:3260 {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:49:24 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36b14046-bbe0-45c6-add0-ab16578b41d3 -p 172.16.0.220:3260" returned: 21 in 0.027s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:49:24 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e4e8a10-b6c5-41d5-b5fe-55af1eca7198]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:49:24 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-82c01541-79e6-4079-ba49-a04ef639b42c tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 15:49:24 user nova-compute[75176]:  {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:49:24 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36b14046-bbe0-45c6-add0-ab16578b41d3 -p 172.16.0.220:3260 --interface default --op new {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:49:24 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36b14046-bbe0-45c6-add0-ab16578b41d3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:49:24 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[9343ac45-bd2f-438d-ad0d-7cd35475b64e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:36b14046-bbe0-45c6-add0-ab16578b41d3] added\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:49:24 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-82c01541-79e6-4079-ba49-a04ef639b42c tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:36b14046-bbe0-45c6-add0-ab16578b41d3] added
Nov 28 15:49:24 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:49:24 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36b14046-bbe0-45c6-add0-ab16578b41d3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:49:24 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36b14046-bbe0-45c6-add0-ab16578b41d3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:49:24 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[331043ab-ef18-40e8-acf7-160697e647ee]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:49:24 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-82c01541-79e6-4079-ba49-a04ef639b42c tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:49:24 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36b14046-bbe0-45c6-add0-ab16578b41d3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:49:24 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36b14046-bbe0-45c6-add0-ab16578b41d3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:49:24 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[b72b0d15-81a2-4954-9b96-bea123b4fd39]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:49:24 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-82c01541-79e6-4079-ba49-a04ef639b42c tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:49:24 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36b14046-bbe0-45c6-add0-ab16578b41d3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v coLtfdCj {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:49:24 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36b14046-bbe0-45c6-add0-ab16578b41d3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v coLtfdCj" returned: 0 in 0.017s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:49:24 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfae8924-2153-4a71-ab53-652e5fd74123]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:49:24 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-82c01541-79e6-4079-ba49-a04ef639b42c tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'coLtfdCj'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:49:24 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36b14046-bbe0-45c6-add0-ab16578b41d3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:49:24 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36b14046-bbe0-45c6-add0-ab16578b41d3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:49:24 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[662dcc07-ff60-43cd-bce5-37ccac0de679]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:49:24 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-82c01541-79e6-4079-ba49-a04ef639b42c tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:49:24 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:49:24 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:49:24 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ad6e275-0c07-41d7-90ee-7a777bfb325d]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22933c6e-3d8f-44f5-bc41-dee97c587055 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8452525c-6845-4edb-bf69-1e2ffe0ef2eb (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:393b4cdf-14ce-4fce-ad98-c04e7f5b7296 (non-flash)\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:49:24 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-82c01541-79e6-4079-ba49-a04ef639b42c tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22933c6e-3d8f-44f5-bc41-dee97c587055 (non-flash)
Nov 28 15:49:24 user nova-compute[75176]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8452525c-6845-4edb-bf69-1e2ffe0ef2eb (non-flash)
Nov 28 15:49:24 user nova-compute[75176]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:393b4cdf-14ce-4fce-ad98-c04e7f5b7296 (non-flash)
Nov 28 15:49:24 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:49:24 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-82c01541-79e6-4079-ba49-a04ef639b42c tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22933c6e-3d8f-44f5-bc41-dee97c587055 (non-flash)
Nov 28 15:49:24 user nova-compute[75176]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8452525c-6845-4edb-bf69-1e2ffe0ef2eb (non-flash)
Nov 28 15:49:24 user nova-compute[75176]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:393b4cdf-14ce-4fce-ad98-c04e7f5b7296 (non-flash)
Nov 28 15:49:24 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 15:49:24 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36b14046-bbe0-45c6-add0-ab16578b41d3 -p 172.16.0.220:3260 --login {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:49:24 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36b14046-bbe0-45c6-add0-ab16578b41d3 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:49:24 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb9df45a-4d7f-42ae-b5b2-45788f80e748]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:36b14046-bbe0-45c6-add0-ab16578b41d3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:36b14046-bbe0-45c6-add0-ab16578b41d3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:49:24 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-82c01541-79e6-4079-ba49-a04ef639b42c tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:36b14046-bbe0-45c6-add0-ab16578b41d3, portal: 172.16.0.220,3260]
Nov 28 15:49:24 user nova-compute[75176]: Login to [iface: default, target: iqn.2010-10.org.openstack:36b14046-bbe0-45c6-add0-ab16578b41d3, portal: 172.16.0.220,3260] successful.
Nov 28 15:49:24 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:49:24 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36b14046-bbe0-45c6-add0-ab16578b41d3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:49:24 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36b14046-bbe0-45c6-add0-ab16578b41d3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.036s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:49:24 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[4818b946-9698-4d31-94a9-4ffd25c97612]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:49:24 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-82c01541-79e6-4079-ba49-a04ef639b42c tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:49:24 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:49:24 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:49:24 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:49:24 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[82dcc7b5-450b-42c6-b4e4-50ccd622da52]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22933c6e-3d8f-44f5-bc41-dee97c587055 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8452525c-6845-4edb-bf69-1e2ffe0ef2eb (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:393b4cdf-14ce-4fce-ad98-c04e7f5b7296 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36b14046-bbe0-45c6-add0-ab16578b41d3 (non-flash)\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:49:24 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-82c01541-79e6-4079-ba49-a04ef639b42c tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22933c6e-3d8f-44f5-bc41-dee97c587055 (non-flash)
Nov 28 15:49:24 user nova-compute[75176]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8452525c-6845-4edb-bf69-1e2ffe0ef2eb (non-flash)
Nov 28 15:49:24 user nova-compute[75176]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:393b4cdf-14ce-4fce-ad98-c04e7f5b7296 (non-flash)
Nov 28 15:49:24 user nova-compute[75176]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36b14046-bbe0-45c6-add0-ab16578b41d3 (non-flash)
Nov 28 15:49:24 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:49:24 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-82c01541-79e6-4079-ba49-a04ef639b42c tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22933c6e-3d8f-44f5-bc41-dee97c587055 (non-flash)
Nov 28 15:49:24 user nova-compute[75176]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8452525c-6845-4edb-bf69-1e2ffe0ef2eb (non-flash)
Nov 28 15:49:24 user nova-compute[75176]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:393b4cdf-14ce-4fce-ad98-c04e7f5b7296 (non-flash)
Nov 28 15:49:24 user nova-compute[75176]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36b14046-bbe0-45c6-add0-ab16578b41d3 (non-flash)
Nov 28 15:49:24 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 15:49:24 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-82c01541-79e6-4079-ba49-a04ef639b42c tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:36b14046-bbe0-45c6-add0-ab16578b41d3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.352s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 15:49:24 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-82c01541-79e6-4079-ba49-a04ef639b42c tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Connected to 172.16.0.220:3260 {{(pid=75176) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 15:49:24 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-82c01541-79e6-4079-ba49-a04ef639b42c tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] HCTL ('36', '-', '-', 0) found on session 33 with lun 0 {{(pid=75176) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 15:49:24 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-82c01541-79e6-4079-ba49-a04ef639b42c tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75176) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 15:49:24 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:49:24 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.108s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:49:24 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[35ef95d2-7f2e-441f-bd79-087671dcbb58]: (4, ('- - 0', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:49:24 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-82c01541-79e6-4079-ba49-a04ef639b42c tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Searching for a device in session 33 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75176) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 15:49:24 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-82c01541-79e6-4079-ba49-a04ef639b42c tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:36b14046-bbe0-45c6-add0-ab16578b41d3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'coLtfdCj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75176) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 15:49:25 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-82c01541-79e6-4079-ba49-a04ef639b42c tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.477s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 15:49:25 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-82c01541-79e6-4079-ba49-a04ef639b42c tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] <== connect_volume: return (1479ms) {'type': 'block', 'scsi_wwn': '23033623936356535', 'path': '/dev/sde'} {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 15:49:25 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-82c01541-79e6-4079-ba49-a04ef639b42c tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] [instance: a6ebcc53-802a-4515-ba41-3e8e1129235f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23033623936356535', 'path': '/dev/sde'} {{(pid=75176) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 15:49:25 user nova-compute[75176]: DEBUG nova.objects.instance [None req-82c01541-79e6-4079-ba49-a04ef639b42c tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Lazy-loading 'flavor' on Instance uuid a6ebcc53-802a-4515-ba41-3e8e1129235f {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:49:26 user nova-compute[75176]: DEBUG nova.virt.libvirt.guest [None req-82c01541-79e6-4079-ba49-a04ef639b42c tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 15:49:26 user nova-compute[75176]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 15:49:26 user nova-compute[75176]:   <source dev="/dev/sde"/>
Nov 28 15:49:26 user nova-compute[75176]:   <target dev="vdb" bus="virtio"/>
Nov 28 15:49:26 user nova-compute[75176]:   <serial>36b14046-bbe0-45c6-add0-ab16578b41d3</serial>
Nov 28 15:49:26 user nova-compute[75176]: </disk>
Nov 28 15:49:26 user nova-compute[75176]:  {{(pid=75176) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 15:49:26 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-82c01541-79e6-4079-ba49-a04ef639b42c tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] No BDM found with device name vda, not building metadata. {{(pid=75176) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 15:49:26 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-82c01541-79e6-4079-ba49-a04ef639b42c tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75176) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 15:49:26 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-82c01541-79e6-4079-ba49-a04ef639b42c tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] No VIF found with MAC fa:16:3e:84:1e:fa, not building metadata {{(pid=75176) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 15:49:26 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-82c01541-79e6-4079-ba49-a04ef639b42c tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Lock "a6ebcc53-802a-4515-ba41-3e8e1129235f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.837s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:49:29 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:49:29 user nova-compute[75176]: DEBUG nova.compute.manager [req-9e872079-dca4-43b3-9855-05fc30dc5821 req-b6a9ee42-3141-420c-91bd-28722af31a4e service nova] [instance: a6ebcc53-802a-4515-ba41-3e8e1129235f] Received event network-changed-1beb8fcc-a604-4b25-8e50-63325edade24 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:49:29 user nova-compute[75176]: DEBUG nova.compute.manager [req-9e872079-dca4-43b3-9855-05fc30dc5821 req-b6a9ee42-3141-420c-91bd-28722af31a4e service nova] [instance: a6ebcc53-802a-4515-ba41-3e8e1129235f] Refreshing instance network info cache due to event network-changed-1beb8fcc-a604-4b25-8e50-63325edade24. {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 15:49:29 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-9e872079-dca4-43b3-9855-05fc30dc5821 req-b6a9ee42-3141-420c-91bd-28722af31a4e service nova] Acquiring lock "refresh_cache-a6ebcc53-802a-4515-ba41-3e8e1129235f" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:49:29 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-9e872079-dca4-43b3-9855-05fc30dc5821 req-b6a9ee42-3141-420c-91bd-28722af31a4e service nova] Acquired lock "refresh_cache-a6ebcc53-802a-4515-ba41-3e8e1129235f" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:49:29 user nova-compute[75176]: DEBUG nova.network.neutron [req-9e872079-dca4-43b3-9855-05fc30dc5821 req-b6a9ee42-3141-420c-91bd-28722af31a4e service nova] [instance: a6ebcc53-802a-4515-ba41-3e8e1129235f] Refreshing network info cache for port 1beb8fcc-a604-4b25-8e50-63325edade24 {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 15:49:29 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:49:30 user nova-compute[75176]: DEBUG nova.network.neutron [req-9e872079-dca4-43b3-9855-05fc30dc5821 req-b6a9ee42-3141-420c-91bd-28722af31a4e service nova] [instance: a6ebcc53-802a-4515-ba41-3e8e1129235f] Updated VIF entry in instance network info cache for port 1beb8fcc-a604-4b25-8e50-63325edade24. {{(pid=75176) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 15:49:30 user nova-compute[75176]: DEBUG nova.network.neutron [req-9e872079-dca4-43b3-9855-05fc30dc5821 req-b6a9ee42-3141-420c-91bd-28722af31a4e service nova] [instance: a6ebcc53-802a-4515-ba41-3e8e1129235f] Updating instance_info_cache with network_info: [{"id": "1beb8fcc-a604-4b25-8e50-63325edade24", "address": "fa:16:3e:84:1e:fa", "network": {"id": "b06b85af-96d9-41cb-9ad2-7fc0523761e7", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-850315220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc1dfeef484e4627a0061d9d36fd2b40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1beb8fcc-a6", "ovs_interfaceid": "1beb8fcc-a604-4b25-8e50-63325edade24", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:49:30 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-9e872079-dca4-43b3-9855-05fc30dc5821 req-b6a9ee42-3141-420c-91bd-28722af31a4e service nova] Releasing lock "refresh_cache-a6ebcc53-802a-4515-ba41-3e8e1129235f" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:49:31 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-8d1f9e9b-ef15-4b65-847f-4fec08a2ad56 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 8fe64eb8-b4e3-4037-80b1-0c151370d5a8 is timed out.
Nov 28 15:49:31 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-8d1f9e9b-ef15-4b65-847f-4fec08a2ad56 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] Successfully detached device vdb from instance 8fe64eb8-b4e3-4037-80b1-0c151370d5a8 from the live domain config.
Nov 28 15:49:31 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8d1f9e9b-ef15-4b65-847f-4fec08a2ad56 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] [instance: 8fe64eb8-b4e3-4037-80b1-0c151370d5a8] calling os-brick to detach iSCSI Volume {{(pid=75176) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 15:49:31 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d1f9e9b-ef15-4b65-847f-4fec08a2ad56 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c1b8a00>, {'target_iqn': 'iqn.2010-10.org.openstack:393b4cdf-14ce-4fce-ad98-c04e7f5b7296', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ipouPXGx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 15:49:31 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-8d1f9e9b-ef15-4b65-847f-4fec08a2ad56 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 15:49:31 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-8d1f9e9b-ef15-4b65-847f-4fec08a2ad56 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 15:49:31 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-8d1f9e9b-ef15-4b65-847f-4fec08a2ad56 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 15:49:31 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:49:31 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:49:31 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[96a7c58f-2653-41c6-b34d-7867d377379e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8452525c-6845-4edb-bf69-1e2ffe0ef2eb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:36b14046-bbe0-45c6-add0-ab16578b41d3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:393b4cdf-14ce-4fce-ad98-c04e7f5b7296\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:22933c6e-3d8f-44f5-bc41-dee97c587055\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:49:31 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d1f9e9b-ef15-4b65-847f-4fec08a2ad56 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 15:49:31 user nova-compute[75176]: No targets found.
Nov 28 15:49:31 user nova-compute[75176]: iSNS:
Nov 28 15:49:31 user nova-compute[75176]: No targets found.
Nov 28 15:49:31 user nova-compute[75176]: STATIC:
Nov 28 15:49:31 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:8452525c-6845-4edb-bf69-1e2ffe0ef2eb
Nov 28 15:49:31 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:49:31 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:49:31 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:36b14046-bbe0-45c6-add0-ab16578b41d3
Nov 28 15:49:31 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:49:31 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:49:31 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:393b4cdf-14ce-4fce-ad98-c04e7f5b7296
Nov 28 15:49:31 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:49:31 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:49:31 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:22933c6e-3d8f-44f5-bc41-dee97c587055
Nov 28 15:49:31 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:49:31 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:49:31 user nova-compute[75176]: FIRMWARE:
Nov 28 15:49:31 user nova-compute[75176]: No targets found.
Nov 28 15:49:31 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:49:31 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d1f9e9b-ef15-4b65-847f-4fec08a2ad56 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 15:49:31 user nova-compute[75176]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 15:49:31 user nova-compute[75176]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75176) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 15:49:31 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d1f9e9b-ef15-4b65-847f-4fec08a2ad56 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:393b4cdf-14ce-4fce-ad98-c04e7f5b7296', 0)] {{(pid=75176) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 15:49:31 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:49:31 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:49:31 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2132f80-2a4f-4317-9aa9-c8f24d49b44c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:22933c6e-3d8f-44f5-bc41-dee97c587055\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:36b14046-bbe0-45c6-add0-ab16578b41d3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:393b4cdf-14ce-4fce-ad98-c04e7f5b7296\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8452525c-6845-4edb-bf69-1e2ffe0ef2eb\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:49:31 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:49:31 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:49:31 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0ce9c06-353d-4ad0-bf7a-4e3c6d5e1a7a]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22933c6e-3d8f-44f5-bc41-dee97c587055 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8452525c-6845-4edb-bf69-1e2ffe0ef2eb (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:393b4cdf-14ce-4fce-ad98-c04e7f5b7296 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36b14046-bbe0-45c6-add0-ab16578b41d3 (non-flash)\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:49:31 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d1f9e9b-ef15-4b65-847f-4fec08a2ad56 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22933c6e-3d8f-44f5-bc41-dee97c587055 (non-flash)
Nov 28 15:49:31 user nova-compute[75176]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8452525c-6845-4edb-bf69-1e2ffe0ef2eb (non-flash)
Nov 28 15:49:31 user nova-compute[75176]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:393b4cdf-14ce-4fce-ad98-c04e7f5b7296 (non-flash)
Nov 28 15:49:31 user nova-compute[75176]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36b14046-bbe0-45c6-add0-ab16578b41d3 (non-flash)
Nov 28 15:49:31 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:49:31 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d1f9e9b-ef15-4b65-847f-4fec08a2ad56 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22933c6e-3d8f-44f5-bc41-dee97c587055 (non-flash)
Nov 28 15:49:31 user nova-compute[75176]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8452525c-6845-4edb-bf69-1e2ffe0ef2eb (non-flash)
Nov 28 15:49:31 user nova-compute[75176]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:393b4cdf-14ce-4fce-ad98-c04e7f5b7296 (non-flash)
Nov 28 15:49:31 user nova-compute[75176]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36b14046-bbe0-45c6-add0-ab16578b41d3 (non-flash)
Nov 28 15:49:31 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 15:49:31 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d1f9e9b-ef15-4b65-847f-4fec08a2ad56 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f464432f9a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:393b4cdf-14ce-4fce-ad98-c04e7f5b7296'): ({'sdd'}, set())}) {{(pid=75176) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 15:49:31 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-8d1f9e9b-ef15-4b65-847f-4fec08a2ad56 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] Removing single pathed devices sdd {{(pid=75176) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 15:49:31 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:49:31 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:49:31 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[30b2583e-fb12-4e34-891f-f745ac585fef]: (4, ('path checker states:\nup                  3\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:49:31 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:49:31 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.024s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:49:31 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0ce4fe5-ebcb-44b8-8eca-966e01c41ab1]: (4, ('ok\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:49:31 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-8d1f9e9b-ef15-4b65-847f-4fec08a2ad56 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] Flushing IO for device /dev/sdd {{(pid=75176) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 15:49:31 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:49:31 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:49:31 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ea88e29-6670-45fa-836a-f0ac573dfffc]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:49:31 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-8d1f9e9b-ef15-4b65-847f-4fec08a2ad56 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75176) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 15:49:31 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:49:31 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.045s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:49:31 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[34e590b1-9512-4cd7-9cf6-9cf800084170]: (4, ('1', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:49:31 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-8d1f9e9b-ef15-4b65-847f-4fec08a2ad56 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75176) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 15:49:31 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-8d1f9e9b-ef15-4b65-847f-4fec08a2ad56 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] SCSI volumes sdd have been removed. {{(pid=75176) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 15:49:31 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d1f9e9b-ef15-4b65-847f-4fec08a2ad56 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:393b4cdf-14ce-4fce-ad98-c04e7f5b7296')] {{(pid=75176) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 15:49:31 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:393b4cdf-14ce-4fce-ad98-c04e7f5b7296 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:49:31 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:393b4cdf-14ce-4fce-ad98-c04e7f5b7296 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:49:31 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[a46c3d05-0aa8-441b-b7d7-8fa03c4a4c2f]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:49:31 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d1f9e9b-ef15-4b65-847f-4fec08a2ad56 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:49:31 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:393b4cdf-14ce-4fce-ad98-c04e7f5b7296 -p 172.16.0.220:3260 --logout {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:49:31 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:393b4cdf-14ce-4fce-ad98-c04e7f5b7296 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:49:31 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[15708a16-fbf3-4f1d-a21c-0c70fcc7ed60]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:393b4cdf-14ce-4fce-ad98-c04e7f5b7296, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:393b4cdf-14ce-4fce-ad98-c04e7f5b7296, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:49:31 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d1f9e9b-ef15-4b65-847f-4fec08a2ad56 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:393b4cdf-14ce-4fce-ad98-c04e7f5b7296, portal: 172.16.0.220,3260]
Nov 28 15:49:31 user nova-compute[75176]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:393b4cdf-14ce-4fce-ad98-c04e7f5b7296, portal: 172.16.0.220,3260] successful.
Nov 28 15:49:31 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:49:31 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:393b4cdf-14ce-4fce-ad98-c04e7f5b7296 -p 172.16.0.220:3260 --op delete {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:49:31 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:393b4cdf-14ce-4fce-ad98-c04e7f5b7296 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:49:31 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[c26e5f7f-76a1-4a02-b1f8-7cc621695205]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:49:31 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d1f9e9b-ef15-4b65-847f-4fec08a2ad56 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:49:31 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-8d1f9e9b-ef15-4b65-847f-4fec08a2ad56 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.352s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 15:49:31 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d1f9e9b-ef15-4b65-847f-4fec08a2ad56 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] <== disconnect_volume: return (353ms) None {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 15:49:31 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8d1f9e9b-ef15-4b65-847f-4fec08a2ad56 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] [instance: 8fe64eb8-b4e3-4037-80b1-0c151370d5a8] Disconnected iSCSI Volume {{(pid=75176) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 15:49:32 user nova-compute[75176]: DEBUG nova.compute.manager [req-bf69aa1e-53a6-4959-af35-de705632941b req-d4a157dc-db65-44e3-9b5c-3799f9ef63e5 service nova] [instance: a6ebcc53-802a-4515-ba41-3e8e1129235f] Received event network-changed-1beb8fcc-a604-4b25-8e50-63325edade24 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:49:32 user nova-compute[75176]: DEBUG nova.compute.manager [req-bf69aa1e-53a6-4959-af35-de705632941b req-d4a157dc-db65-44e3-9b5c-3799f9ef63e5 service nova] [instance: a6ebcc53-802a-4515-ba41-3e8e1129235f] Refreshing instance network info cache due to event network-changed-1beb8fcc-a604-4b25-8e50-63325edade24. {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 15:49:32 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-bf69aa1e-53a6-4959-af35-de705632941b req-d4a157dc-db65-44e3-9b5c-3799f9ef63e5 service nova] Acquiring lock "refresh_cache-a6ebcc53-802a-4515-ba41-3e8e1129235f" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:49:32 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-bf69aa1e-53a6-4959-af35-de705632941b req-d4a157dc-db65-44e3-9b5c-3799f9ef63e5 service nova] Acquired lock "refresh_cache-a6ebcc53-802a-4515-ba41-3e8e1129235f" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:49:32 user nova-compute[75176]: DEBUG nova.network.neutron [req-bf69aa1e-53a6-4959-af35-de705632941b req-d4a157dc-db65-44e3-9b5c-3799f9ef63e5 service nova] [instance: a6ebcc53-802a-4515-ba41-3e8e1129235f] Refreshing network info cache for port 1beb8fcc-a604-4b25-8e50-63325edade24 {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 15:49:32 user nova-compute[75176]: DEBUG nova.objects.instance [None req-8d1f9e9b-ef15-4b65-847f-4fec08a2ad56 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] Lazy-loading 'flavor' on Instance uuid 8fe64eb8-b4e3-4037-80b1-0c151370d5a8 {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:49:32 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-8d1f9e9b-ef15-4b65-847f-4fec08a2ad56 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] Lock "8fe64eb8-b4e3-4037-80b1-0c151370d5a8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.877s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:49:33 user nova-compute[75176]: DEBUG nova.network.neutron [req-bf69aa1e-53a6-4959-af35-de705632941b req-d4a157dc-db65-44e3-9b5c-3799f9ef63e5 service nova] [instance: a6ebcc53-802a-4515-ba41-3e8e1129235f] Updated VIF entry in instance network info cache for port 1beb8fcc-a604-4b25-8e50-63325edade24. {{(pid=75176) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 15:49:33 user nova-compute[75176]: DEBUG nova.network.neutron [req-bf69aa1e-53a6-4959-af35-de705632941b req-d4a157dc-db65-44e3-9b5c-3799f9ef63e5 service nova] [instance: a6ebcc53-802a-4515-ba41-3e8e1129235f] Updating instance_info_cache with network_info: [{"id": "1beb8fcc-a604-4b25-8e50-63325edade24", "address": "fa:16:3e:84:1e:fa", "network": {"id": "b06b85af-96d9-41cb-9ad2-7fc0523761e7", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-850315220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc1dfeef484e4627a0061d9d36fd2b40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1beb8fcc-a6", "ovs_interfaceid": "1beb8fcc-a604-4b25-8e50-63325edade24", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:49:33 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-bf69aa1e-53a6-4959-af35-de705632941b req-d4a157dc-db65-44e3-9b5c-3799f9ef63e5 service nova] Releasing lock "refresh_cache-a6ebcc53-802a-4515-ba41-3e8e1129235f" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:49:33 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-96316a77-0c38-4aa8-b99d-46bdc3410d97 tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Acquiring lock "a6ebcc53-802a-4515-ba41-3e8e1129235f" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:49:33 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-96316a77-0c38-4aa8-b99d-46bdc3410d97 tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Lock "a6ebcc53-802a-4515-ba41-3e8e1129235f" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:49:33 user nova-compute[75176]: INFO nova.compute.manager [None req-96316a77-0c38-4aa8-b99d-46bdc3410d97 tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] [instance: a6ebcc53-802a-4515-ba41-3e8e1129235f] Rebooting instance
Nov 28 15:49:33 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-96316a77-0c38-4aa8-b99d-46bdc3410d97 tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Acquiring lock "refresh_cache-a6ebcc53-802a-4515-ba41-3e8e1129235f" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:49:33 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-96316a77-0c38-4aa8-b99d-46bdc3410d97 tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Acquired lock "refresh_cache-a6ebcc53-802a-4515-ba41-3e8e1129235f" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:49:33 user nova-compute[75176]: DEBUG nova.network.neutron [None req-96316a77-0c38-4aa8-b99d-46bdc3410d97 tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] [instance: a6ebcc53-802a-4515-ba41-3e8e1129235f] Building network info cache for instance {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 15:49:33 user nova-compute[75176]: DEBUG nova.network.neutron [None req-96316a77-0c38-4aa8-b99d-46bdc3410d97 tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] [instance: a6ebcc53-802a-4515-ba41-3e8e1129235f] Updating instance_info_cache with network_info: [{"id": "1beb8fcc-a604-4b25-8e50-63325edade24", "address": "fa:16:3e:84:1e:fa", "network": {"id": "b06b85af-96d9-41cb-9ad2-7fc0523761e7", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-850315220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc1dfeef484e4627a0061d9d36fd2b40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1beb8fcc-a6", "ovs_interfaceid": "1beb8fcc-a604-4b25-8e50-63325edade24", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:49:33 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-96316a77-0c38-4aa8-b99d-46bdc3410d97 tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Releasing lock "refresh_cache-a6ebcc53-802a-4515-ba41-3e8e1129235f" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:49:33 user nova-compute[75176]: DEBUG nova.compute.manager [None req-96316a77-0c38-4aa8-b99d-46bdc3410d97 tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] [instance: a6ebcc53-802a-4515-ba41-3e8e1129235f] Checking state {{(pid=75176) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 15:49:34 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:49:34 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:49:36 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:49:36 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:49:36 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:49:36 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:49:36 user nova-compute[75176]: DEBUG nova.compute.manager [req-fa180b66-2740-4de2-95dd-06a8997dd30b req-86a8ef68-4f3c-49ec-bbb4-5852c314d0e2 service nova] [instance: a6ebcc53-802a-4515-ba41-3e8e1129235f] Received event network-vif-unplugged-1beb8fcc-a604-4b25-8e50-63325edade24 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:49:36 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-fa180b66-2740-4de2-95dd-06a8997dd30b req-86a8ef68-4f3c-49ec-bbb4-5852c314d0e2 service nova] Acquiring lock "a6ebcc53-802a-4515-ba41-3e8e1129235f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:49:36 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-fa180b66-2740-4de2-95dd-06a8997dd30b req-86a8ef68-4f3c-49ec-bbb4-5852c314d0e2 service nova] Lock "a6ebcc53-802a-4515-ba41-3e8e1129235f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:49:36 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-fa180b66-2740-4de2-95dd-06a8997dd30b req-86a8ef68-4f3c-49ec-bbb4-5852c314d0e2 service nova] Lock "a6ebcc53-802a-4515-ba41-3e8e1129235f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:49:36 user nova-compute[75176]: DEBUG nova.compute.manager [req-fa180b66-2740-4de2-95dd-06a8997dd30b req-86a8ef68-4f3c-49ec-bbb4-5852c314d0e2 service nova] [instance: a6ebcc53-802a-4515-ba41-3e8e1129235f] No waiting events found dispatching network-vif-unplugged-1beb8fcc-a604-4b25-8e50-63325edade24 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:49:36 user nova-compute[75176]: WARNING nova.compute.manager [req-fa180b66-2740-4de2-95dd-06a8997dd30b req-86a8ef68-4f3c-49ec-bbb4-5852c314d0e2 service nova] [instance: a6ebcc53-802a-4515-ba41-3e8e1129235f] Received unexpected event network-vif-unplugged-1beb8fcc-a604-4b25-8e50-63325edade24 for instance with vm_state active and task_state reboot_started.
Nov 28 15:49:37 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-96316a77-0c38-4aa8-b99d-46bdc3410d97 tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] [instance: a6ebcc53-802a-4515-ba41-3e8e1129235f] Instance shutdown successfully.
Nov 28 15:49:38 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:49:38 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:49:38 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:49:38 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:49:38 user nova-compute[75176]: DEBUG nova.compute.manager [req-a09cdd40-dc43-4e06-a66b-e3bf5d9679bf req-77ba0900-d698-4a5d-b878-a123a21b3bdf service nova] [instance: a6ebcc53-802a-4515-ba41-3e8e1129235f] Received event network-vif-plugged-1beb8fcc-a604-4b25-8e50-63325edade24 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:49:38 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-a09cdd40-dc43-4e06-a66b-e3bf5d9679bf req-77ba0900-d698-4a5d-b878-a123a21b3bdf service nova] Acquiring lock "a6ebcc53-802a-4515-ba41-3e8e1129235f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:49:38 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-a09cdd40-dc43-4e06-a66b-e3bf5d9679bf req-77ba0900-d698-4a5d-b878-a123a21b3bdf service nova] Lock "a6ebcc53-802a-4515-ba41-3e8e1129235f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:49:38 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-a09cdd40-dc43-4e06-a66b-e3bf5d9679bf req-77ba0900-d698-4a5d-b878-a123a21b3bdf service nova] Lock "a6ebcc53-802a-4515-ba41-3e8e1129235f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:49:38 user nova-compute[75176]: DEBUG nova.compute.manager [req-a09cdd40-dc43-4e06-a66b-e3bf5d9679bf req-77ba0900-d698-4a5d-b878-a123a21b3bdf service nova] [instance: a6ebcc53-802a-4515-ba41-3e8e1129235f] No waiting events found dispatching network-vif-plugged-1beb8fcc-a604-4b25-8e50-63325edade24 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:49:38 user nova-compute[75176]: WARNING nova.compute.manager [req-a09cdd40-dc43-4e06-a66b-e3bf5d9679bf req-77ba0900-d698-4a5d-b878-a123a21b3bdf service nova] [instance: a6ebcc53-802a-4515-ba41-3e8e1129235f] Received unexpected event network-vif-plugged-1beb8fcc-a604-4b25-8e50-63325edade24 for instance with vm_state active and task_state reboot_started.
Nov 28 15:49:38 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:49:39 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:49:39 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:49:40 user nova-compute[75176]: DEBUG nova.compute.manager [req-a2a0ede0-e7a0-4fbb-83aa-f8cb0bd80917 req-7b73ac93-fc8d-47e7-9593-f8719bd033d3 service nova] [instance: a6ebcc53-802a-4515-ba41-3e8e1129235f] Received event network-vif-plugged-1beb8fcc-a604-4b25-8e50-63325edade24 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:49:40 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-a2a0ede0-e7a0-4fbb-83aa-f8cb0bd80917 req-7b73ac93-fc8d-47e7-9593-f8719bd033d3 service nova] Acquiring lock "a6ebcc53-802a-4515-ba41-3e8e1129235f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:49:40 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-a2a0ede0-e7a0-4fbb-83aa-f8cb0bd80917 req-7b73ac93-fc8d-47e7-9593-f8719bd033d3 service nova] Lock "a6ebcc53-802a-4515-ba41-3e8e1129235f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:49:40 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-a2a0ede0-e7a0-4fbb-83aa-f8cb0bd80917 req-7b73ac93-fc8d-47e7-9593-f8719bd033d3 service nova] Lock "a6ebcc53-802a-4515-ba41-3e8e1129235f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:49:40 user nova-compute[75176]: DEBUG nova.compute.manager [req-a2a0ede0-e7a0-4fbb-83aa-f8cb0bd80917 req-7b73ac93-fc8d-47e7-9593-f8719bd033d3 service nova] [instance: a6ebcc53-802a-4515-ba41-3e8e1129235f] No waiting events found dispatching network-vif-plugged-1beb8fcc-a604-4b25-8e50-63325edade24 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:49:40 user nova-compute[75176]: WARNING nova.compute.manager [req-a2a0ede0-e7a0-4fbb-83aa-f8cb0bd80917 req-7b73ac93-fc8d-47e7-9593-f8719bd033d3 service nova] [instance: a6ebcc53-802a-4515-ba41-3e8e1129235f] Received unexpected event network-vif-plugged-1beb8fcc-a604-4b25-8e50-63325edade24 for instance with vm_state active and task_state reboot_started.
Nov 28 15:49:40 user nova-compute[75176]: DEBUG nova.compute.manager [req-a2a0ede0-e7a0-4fbb-83aa-f8cb0bd80917 req-7b73ac93-fc8d-47e7-9593-f8719bd033d3 service nova] [instance: a6ebcc53-802a-4515-ba41-3e8e1129235f] Received event network-vif-plugged-1beb8fcc-a604-4b25-8e50-63325edade24 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:49:40 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-a2a0ede0-e7a0-4fbb-83aa-f8cb0bd80917 req-7b73ac93-fc8d-47e7-9593-f8719bd033d3 service nova] Acquiring lock "a6ebcc53-802a-4515-ba41-3e8e1129235f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:49:40 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-a2a0ede0-e7a0-4fbb-83aa-f8cb0bd80917 req-7b73ac93-fc8d-47e7-9593-f8719bd033d3 service nova] Lock "a6ebcc53-802a-4515-ba41-3e8e1129235f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:49:40 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-a2a0ede0-e7a0-4fbb-83aa-f8cb0bd80917 req-7b73ac93-fc8d-47e7-9593-f8719bd033d3 service nova] Lock "a6ebcc53-802a-4515-ba41-3e8e1129235f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:49:40 user nova-compute[75176]: DEBUG nova.compute.manager [req-a2a0ede0-e7a0-4fbb-83aa-f8cb0bd80917 req-7b73ac93-fc8d-47e7-9593-f8719bd033d3 service nova] [instance: a6ebcc53-802a-4515-ba41-3e8e1129235f] No waiting events found dispatching network-vif-plugged-1beb8fcc-a604-4b25-8e50-63325edade24 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:49:40 user nova-compute[75176]: WARNING nova.compute.manager [req-a2a0ede0-e7a0-4fbb-83aa-f8cb0bd80917 req-7b73ac93-fc8d-47e7-9593-f8719bd033d3 service nova] [instance: a6ebcc53-802a-4515-ba41-3e8e1129235f] Received unexpected event network-vif-plugged-1beb8fcc-a604-4b25-8e50-63325edade24 for instance with vm_state active and task_state reboot_started.
Nov 28 15:49:40 user nova-compute[75176]: INFO nova.virt.libvirt.driver [-] [instance: a6ebcc53-802a-4515-ba41-3e8e1129235f] Instance running successfully.
Nov 28 15:49:40 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-96316a77-0c38-4aa8-b99d-46bdc3410d97 tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] [instance: a6ebcc53-802a-4515-ba41-3e8e1129235f] Instance soft rebooted successfully.
Nov 28 15:49:40 user nova-compute[75176]: DEBUG nova.compute.manager [None req-96316a77-0c38-4aa8-b99d-46bdc3410d97 tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] [instance: a6ebcc53-802a-4515-ba41-3e8e1129235f] Checking state {{(pid=75176) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 15:49:40 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-96316a77-0c38-4aa8-b99d-46bdc3410d97 tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Lock "a6ebcc53-802a-4515-ba41-3e8e1129235f" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.234s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:49:44 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:49:44 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:49:49 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:49:49 user nova-compute[75176]: DEBUG nova.compute.manager [req-ab0517cd-7eb8-44fa-9e84-f0ecaf9304a5 req-1059d60e-7f18-4baa-8020-c7bd21304398 service nova] [instance: ca1558cf-b235-4a20-8d12-45f1ca16fe41] Received event network-changed-2791b548-7207-402c-9f65-c078be714ef5 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:49:49 user nova-compute[75176]: DEBUG nova.compute.manager [req-ab0517cd-7eb8-44fa-9e84-f0ecaf9304a5 req-1059d60e-7f18-4baa-8020-c7bd21304398 service nova] [instance: ca1558cf-b235-4a20-8d12-45f1ca16fe41] Refreshing instance network info cache due to event network-changed-2791b548-7207-402c-9f65-c078be714ef5. {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 15:49:49 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-ab0517cd-7eb8-44fa-9e84-f0ecaf9304a5 req-1059d60e-7f18-4baa-8020-c7bd21304398 service nova] Acquiring lock "refresh_cache-ca1558cf-b235-4a20-8d12-45f1ca16fe41" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:49:49 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-ab0517cd-7eb8-44fa-9e84-f0ecaf9304a5 req-1059d60e-7f18-4baa-8020-c7bd21304398 service nova] Acquired lock "refresh_cache-ca1558cf-b235-4a20-8d12-45f1ca16fe41" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:49:49 user nova-compute[75176]: DEBUG nova.network.neutron [req-ab0517cd-7eb8-44fa-9e84-f0ecaf9304a5 req-1059d60e-7f18-4baa-8020-c7bd21304398 service nova] [instance: ca1558cf-b235-4a20-8d12-45f1ca16fe41] Refreshing network info cache for port 2791b548-7207-402c-9f65-c078be714ef5 {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 15:49:49 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:49:49 user nova-compute[75176]: DEBUG nova.network.neutron [req-ab0517cd-7eb8-44fa-9e84-f0ecaf9304a5 req-1059d60e-7f18-4baa-8020-c7bd21304398 service nova] [instance: ca1558cf-b235-4a20-8d12-45f1ca16fe41] Updated VIF entry in instance network info cache for port 2791b548-7207-402c-9f65-c078be714ef5. {{(pid=75176) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 15:49:49 user nova-compute[75176]: DEBUG nova.network.neutron [req-ab0517cd-7eb8-44fa-9e84-f0ecaf9304a5 req-1059d60e-7f18-4baa-8020-c7bd21304398 service nova] [instance: ca1558cf-b235-4a20-8d12-45f1ca16fe41] Updating instance_info_cache with network_info: [{"id": "2791b548-7207-402c-9f65-c078be714ef5", "address": "fa:16:3e:08:ec:9f", "network": {"id": "1f00fd98-3cd0-4c8c-912a-bc29124e1940", "bridge": "br-int", "label": "tempest-TestShelveInstance-1334429215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a8b3f118afd469f9c82ec2574586aaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2791b548-72", "ovs_interfaceid": "2791b548-7207-402c-9f65-c078be714ef5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:49:49 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-ab0517cd-7eb8-44fa-9e84-f0ecaf9304a5 req-1059d60e-7f18-4baa-8020-c7bd21304398 service nova] Releasing lock "refresh_cache-ca1558cf-b235-4a20-8d12-45f1ca16fe41" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:49:49 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:49:49 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-0df51d5a-c126-4a0f-832b-48d2d240fc1a tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] Acquiring lock "ca1558cf-b235-4a20-8d12-45f1ca16fe41" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:49:49 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-0df51d5a-c126-4a0f-832b-48d2d240fc1a tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] Lock "ca1558cf-b235-4a20-8d12-45f1ca16fe41" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:49:49 user nova-compute[75176]: INFO nova.compute.manager [None req-0df51d5a-c126-4a0f-832b-48d2d240fc1a tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] [instance: ca1558cf-b235-4a20-8d12-45f1ca16fe41] Shelve offloading
Nov 28 15:49:50 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:49:50 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:49:50 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:49:50 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:49:50 user nova-compute[75176]: DEBUG nova.compute.manager [req-fdf5c47a-0017-4a03-be67-5d2b6b04b61e req-68fdef04-ee6c-42d0-9c40-aae240743a59 service nova] [instance: ca1558cf-b235-4a20-8d12-45f1ca16fe41] Received event network-vif-unplugged-2791b548-7207-402c-9f65-c078be714ef5 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:49:50 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-fdf5c47a-0017-4a03-be67-5d2b6b04b61e req-68fdef04-ee6c-42d0-9c40-aae240743a59 service nova] Acquiring lock "ca1558cf-b235-4a20-8d12-45f1ca16fe41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:49:50 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-fdf5c47a-0017-4a03-be67-5d2b6b04b61e req-68fdef04-ee6c-42d0-9c40-aae240743a59 service nova] Lock "ca1558cf-b235-4a20-8d12-45f1ca16fe41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:49:50 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-fdf5c47a-0017-4a03-be67-5d2b6b04b61e req-68fdef04-ee6c-42d0-9c40-aae240743a59 service nova] Lock "ca1558cf-b235-4a20-8d12-45f1ca16fe41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:49:50 user nova-compute[75176]: DEBUG nova.compute.manager [req-fdf5c47a-0017-4a03-be67-5d2b6b04b61e req-68fdef04-ee6c-42d0-9c40-aae240743a59 service nova] [instance: ca1558cf-b235-4a20-8d12-45f1ca16fe41] No waiting events found dispatching network-vif-unplugged-2791b548-7207-402c-9f65-c078be714ef5 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:49:50 user nova-compute[75176]: WARNING nova.compute.manager [req-fdf5c47a-0017-4a03-be67-5d2b6b04b61e req-68fdef04-ee6c-42d0-9c40-aae240743a59 service nova] [instance: ca1558cf-b235-4a20-8d12-45f1ca16fe41] Received unexpected event network-vif-unplugged-2791b548-7207-402c-9f65-c078be714ef5 for instance with vm_state active and task_state shelving.
Nov 28 15:49:50 user nova-compute[75176]: INFO nova.virt.libvirt.driver [-] [instance: ca1558cf-b235-4a20-8d12-45f1ca16fe41] Instance destroyed successfully.
Nov 28 15:49:50 user nova-compute[75176]: DEBUG nova.compute.manager [None req-0df51d5a-c126-4a0f-832b-48d2d240fc1a tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] [instance: ca1558cf-b235-4a20-8d12-45f1ca16fe41] Checking state {{(pid=75176) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 15:49:50 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-0df51d5a-c126-4a0f-832b-48d2d240fc1a tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] Acquiring lock "refresh_cache-ca1558cf-b235-4a20-8d12-45f1ca16fe41" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:49:50 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-0df51d5a-c126-4a0f-832b-48d2d240fc1a tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] Acquired lock "refresh_cache-ca1558cf-b235-4a20-8d12-45f1ca16fe41" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:49:50 user nova-compute[75176]: DEBUG nova.network.neutron [None req-0df51d5a-c126-4a0f-832b-48d2d240fc1a tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] [instance: ca1558cf-b235-4a20-8d12-45f1ca16fe41] Building network info cache for instance {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 15:49:51 user nova-compute[75176]: DEBUG nova.network.neutron [None req-0df51d5a-c126-4a0f-832b-48d2d240fc1a tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] [instance: ca1558cf-b235-4a20-8d12-45f1ca16fe41] Updating instance_info_cache with network_info: [{"id": "2791b548-7207-402c-9f65-c078be714ef5", "address": "fa:16:3e:08:ec:9f", "network": {"id": "1f00fd98-3cd0-4c8c-912a-bc29124e1940", "bridge": "br-int", "label": "tempest-TestShelveInstance-1334429215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a8b3f118afd469f9c82ec2574586aaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2791b548-72", "ovs_interfaceid": "2791b548-7207-402c-9f65-c078be714ef5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:49:51 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-0df51d5a-c126-4a0f-832b-48d2d240fc1a tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] Releasing lock "refresh_cache-ca1558cf-b235-4a20-8d12-45f1ca16fe41" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:49:51 user nova-compute[75176]: INFO nova.virt.libvirt.driver [-] [instance: ca1558cf-b235-4a20-8d12-45f1ca16fe41] Instance destroyed successfully.
Nov 28 15:49:51 user nova-compute[75176]: DEBUG nova.objects.instance [None req-0df51d5a-c126-4a0f-832b-48d2d240fc1a tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] Lazy-loading 'resources' on Instance uuid ca1558cf-b235-4a20-8d12-45f1ca16fe41 {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:49:51 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-0df51d5a-c126-4a0f-832b-48d2d240fc1a tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T15:47:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1092777141',display_name='tempest-TestShelveInstance-server-1092777141',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1092777141',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPlWOjLW2NpfEDLiMEuh38MSf6V/+wJUiKnArs/gZG1j8jp3V+GFd/BW0+XH7hYqoFiR47yFKC6ZOU1dYUI6qcGVEhOBdCmxl100xpeAUerFPsLxDciq8AgBllG8Awa1CQ==',key_name='tempest-TestShelveInstance-2062365153',keypairs=<?>,launch_index=0,launched_at=2023-11-28T15:48:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7a8b3f118afd469f9c82ec2574586aaf',ramdisk_id='',reservation_id='r-0ue1lblf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-801353787',owner_user_name='tempest-TestShelveInstance-801353787-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T15:48:12Z,user_data=None,user_id='4753cf25a4c14e8aacd55309ff7e988d',uuid=ca1558cf-b235-4a20-8d12-45f1ca16fe41,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2791b548-7207-402c-9f65-c078be714ef5", "address": "fa:16:3e:08:ec:9f", "network": {"id": "1f00fd98-3cd0-4c8c-912a-bc29124e1940", "bridge": "br-int", "label": "tempest-TestShelveInstance-1334429215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a8b3f118afd469f9c82ec2574586aaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2791b548-72", "ovs_interfaceid": "2791b548-7207-402c-9f65-c078be714ef5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 15:49:51 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-0df51d5a-c126-4a0f-832b-48d2d240fc1a tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] Converting VIF {"id": "2791b548-7207-402c-9f65-c078be714ef5", "address": "fa:16:3e:08:ec:9f", "network": {"id": "1f00fd98-3cd0-4c8c-912a-bc29124e1940", "bridge": "br-int", "label": "tempest-TestShelveInstance-1334429215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a8b3f118afd469f9c82ec2574586aaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2791b548-72", "ovs_interfaceid": "2791b548-7207-402c-9f65-c078be714ef5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:49:51 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-0df51d5a-c126-4a0f-832b-48d2d240fc1a tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:ec:9f,bridge_name='br-int',has_traffic_filtering=True,id=2791b548-7207-402c-9f65-c078be714ef5,network=Network(1f00fd98-3cd0-4c8c-912a-bc29124e1940),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2791b548-72') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:49:51 user nova-compute[75176]: DEBUG os_vif [None req-0df51d5a-c126-4a0f-832b-48d2d240fc1a tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:ec:9f,bridge_name='br-int',has_traffic_filtering=True,id=2791b548-7207-402c-9f65-c078be714ef5,network=Network(1f00fd98-3cd0-4c8c-912a-bc29124e1940),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2791b548-72') {{(pid=75176) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 15:49:51 user nova-compute[75176]: DEBUG nova.compute.manager [req-995e8339-6de4-4743-83ba-a3c67dca620c req-60008fae-9436-4a14-aa4f-e9fe72a6ac7a service nova] [instance: ca1558cf-b235-4a20-8d12-45f1ca16fe41] Received event network-changed-2791b548-7207-402c-9f65-c078be714ef5 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:49:51 user nova-compute[75176]: DEBUG nova.compute.manager [req-995e8339-6de4-4743-83ba-a3c67dca620c req-60008fae-9436-4a14-aa4f-e9fe72a6ac7a service nova] [instance: ca1558cf-b235-4a20-8d12-45f1ca16fe41] Refreshing instance network info cache due to event network-changed-2791b548-7207-402c-9f65-c078be714ef5. {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 15:49:51 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-995e8339-6de4-4743-83ba-a3c67dca620c req-60008fae-9436-4a14-aa4f-e9fe72a6ac7a service nova] Acquiring lock "refresh_cache-ca1558cf-b235-4a20-8d12-45f1ca16fe41" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:49:51 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-995e8339-6de4-4743-83ba-a3c67dca620c req-60008fae-9436-4a14-aa4f-e9fe72a6ac7a service nova] Acquired lock "refresh_cache-ca1558cf-b235-4a20-8d12-45f1ca16fe41" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:49:51 user nova-compute[75176]: DEBUG nova.network.neutron [req-995e8339-6de4-4743-83ba-a3c67dca620c req-60008fae-9436-4a14-aa4f-e9fe72a6ac7a service nova] [instance: ca1558cf-b235-4a20-8d12-45f1ca16fe41] Refreshing network info cache for port 2791b548-7207-402c-9f65-c078be714ef5 {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 15:49:51 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:49:51 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2791b548-72, bridge=br-int, if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:49:51 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:49:51 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:49:51 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:49:51 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b3e2b417-fdd0-445b-8522-9b458b0a2e0c) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:49:51 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:49:51 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:49:51 user nova-compute[75176]: INFO os_vif [None req-0df51d5a-c126-4a0f-832b-48d2d240fc1a tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:ec:9f,bridge_name='br-int',has_traffic_filtering=True,id=2791b548-7207-402c-9f65-c078be714ef5,network=Network(1f00fd98-3cd0-4c8c-912a-bc29124e1940),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2791b548-72')
Nov 28 15:49:51 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0df51d5a-c126-4a0f-832b-48d2d240fc1a tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] [instance: ca1558cf-b235-4a20-8d12-45f1ca16fe41] calling os-brick to detach iSCSI Volume {{(pid=75176) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 15:49:51 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-0df51d5a-c126-4a0f-832b-48d2d240fc1a tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c1b8a00>, {'target_iqn': 'iqn.2010-10.org.openstack:22933c6e-3d8f-44f5-bc41-dee97c587055', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ujGDYdRg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 15:49:51 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-0df51d5a-c126-4a0f-832b-48d2d240fc1a tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 15:49:51 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-0df51d5a-c126-4a0f-832b-48d2d240fc1a tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 15:49:51 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-0df51d5a-c126-4a0f-832b-48d2d240fc1a tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 15:49:51 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:49:51 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:49:51 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[4675fe1a-dfb9-4d72-b8bf-69e6d05c454b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8452525c-6845-4edb-bf69-1e2ffe0ef2eb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:36b14046-bbe0-45c6-add0-ab16578b41d3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:22933c6e-3d8f-44f5-bc41-dee97c587055\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:49:51 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-0df51d5a-c126-4a0f-832b-48d2d240fc1a tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 15:49:51 user nova-compute[75176]: No targets found.
Nov 28 15:49:51 user nova-compute[75176]: iSNS:
Nov 28 15:49:51 user nova-compute[75176]: No targets found.
Nov 28 15:49:51 user nova-compute[75176]: STATIC:
Nov 28 15:49:51 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:8452525c-6845-4edb-bf69-1e2ffe0ef2eb
Nov 28 15:49:51 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:49:51 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:49:51 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:36b14046-bbe0-45c6-add0-ab16578b41d3
Nov 28 15:49:51 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:49:51 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:49:51 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:22933c6e-3d8f-44f5-bc41-dee97c587055
Nov 28 15:49:51 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:49:51 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:49:51 user nova-compute[75176]: FIRMWARE:
Nov 28 15:49:51 user nova-compute[75176]: No targets found.
Nov 28 15:49:51 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:49:51 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-0df51d5a-c126-4a0f-832b-48d2d240fc1a tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 15:49:51 user nova-compute[75176]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 15:49:51 user nova-compute[75176]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75176) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 15:49:51 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-0df51d5a-c126-4a0f-832b-48d2d240fc1a tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:22933c6e-3d8f-44f5-bc41-dee97c587055', 0)] {{(pid=75176) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 15:49:51 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:49:51 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:49:51 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[a079f99c-fcd3-4bd7-93cc-b92f52cbf4ef]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:22933c6e-3d8f-44f5-bc41-dee97c587055\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:36b14046-bbe0-45c6-add0-ab16578b41d3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8452525c-6845-4edb-bf69-1e2ffe0ef2eb\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:49:51 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:49:51 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:49:51 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[eea91839-0571-464a-876f-6f9f1a594aad]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22933c6e-3d8f-44f5-bc41-dee97c587055 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8452525c-6845-4edb-bf69-1e2ffe0ef2eb (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36b14046-bbe0-45c6-add0-ab16578b41d3 (non-flash)\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:49:51 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-0df51d5a-c126-4a0f-832b-48d2d240fc1a tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22933c6e-3d8f-44f5-bc41-dee97c587055 (non-flash)
Nov 28 15:49:51 user nova-compute[75176]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8452525c-6845-4edb-bf69-1e2ffe0ef2eb (non-flash)
Nov 28 15:49:51 user nova-compute[75176]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36b14046-bbe0-45c6-add0-ab16578b41d3 (non-flash)
Nov 28 15:49:51 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:49:51 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-0df51d5a-c126-4a0f-832b-48d2d240fc1a tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22933c6e-3d8f-44f5-bc41-dee97c587055 (non-flash)
Nov 28 15:49:51 user nova-compute[75176]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8452525c-6845-4edb-bf69-1e2ffe0ef2eb (non-flash)
Nov 28 15:49:51 user nova-compute[75176]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36b14046-bbe0-45c6-add0-ab16578b41d3 (non-flash)
Nov 28 15:49:51 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 15:49:51 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-0df51d5a-c126-4a0f-832b-48d2d240fc1a tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f464432e050>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:22933c6e-3d8f-44f5-bc41-dee97c587055'): ({'sdb'}, set())}) {{(pid=75176) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 15:49:51 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-0df51d5a-c126-4a0f-832b-48d2d240fc1a tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] Removing single pathed devices sdb {{(pid=75176) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 15:49:51 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:49:51 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:49:51 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8b38c6c-229b-4015-a2a3-e9ab8ae14fec]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:49:51 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:49:51 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:49:51 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0961763-1780-4f2b-a306-65ebc6198e88]: (4, ('ok\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:49:51 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-0df51d5a-c126-4a0f-832b-48d2d240fc1a tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] Flushing IO for device /dev/sdb {{(pid=75176) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 15:49:51 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:49:51 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:49:51 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8800c51-be81-4b4b-945a-15f8173dd71b]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:49:51 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-0df51d5a-c126-4a0f-832b-48d2d240fc1a tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75176) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 15:49:51 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:49:51 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:49:51 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[cce36f7e-2674-440d-a7dc-2d05a94a8ad9]: (4, ('1', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:49:51 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-0df51d5a-c126-4a0f-832b-48d2d240fc1a tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75176) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 15:49:51 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-0df51d5a-c126-4a0f-832b-48d2d240fc1a tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] SCSI volumes sdb have been removed. {{(pid=75176) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 15:49:51 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-0df51d5a-c126-4a0f-832b-48d2d240fc1a tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:22933c6e-3d8f-44f5-bc41-dee97c587055')] {{(pid=75176) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 15:49:51 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22933c6e-3d8f-44f5-bc41-dee97c587055 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:49:51 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22933c6e-3d8f-44f5-bc41-dee97c587055 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:49:51 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab92f3bc-f142-4288-beb9-4d812f4e3c30]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:49:51 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-0df51d5a-c126-4a0f-832b-48d2d240fc1a tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:49:51 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22933c6e-3d8f-44f5-bc41-dee97c587055 -p 172.16.0.220:3260 --logout {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:49:52 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22933c6e-3d8f-44f5-bc41-dee97c587055 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:49:52 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ac12062-4e58-406b-86f7-ca75bd05f9f8]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:22933c6e-3d8f-44f5-bc41-dee97c587055, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:22933c6e-3d8f-44f5-bc41-dee97c587055, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:49:52 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-0df51d5a-c126-4a0f-832b-48d2d240fc1a tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:22933c6e-3d8f-44f5-bc41-dee97c587055, portal: 172.16.0.220,3260]
Nov 28 15:49:52 user nova-compute[75176]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:22933c6e-3d8f-44f5-bc41-dee97c587055, portal: 172.16.0.220,3260] successful.
Nov 28 15:49:52 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:49:52 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22933c6e-3d8f-44f5-bc41-dee97c587055 -p 172.16.0.220:3260 --op delete {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:49:52 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22933c6e-3d8f-44f5-bc41-dee97c587055 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:49:52 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[978986f3-7418-4777-bc81-d5c88f304214]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:49:52 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-0df51d5a-c126-4a0f-832b-48d2d240fc1a tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:49:52 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-0df51d5a-c126-4a0f-832b-48d2d240fc1a tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.311s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 15:49:52 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-0df51d5a-c126-4a0f-832b-48d2d240fc1a tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] <== disconnect_volume: return (312ms) None {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 15:49:52 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0df51d5a-c126-4a0f-832b-48d2d240fc1a tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] [instance: ca1558cf-b235-4a20-8d12-45f1ca16fe41] Disconnected iSCSI Volume {{(pid=75176) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 15:49:52 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-0df51d5a-c126-4a0f-832b-48d2d240fc1a tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] [instance: ca1558cf-b235-4a20-8d12-45f1ca16fe41] Deleting instance files /opt/stack/data/nova/instances/ca1558cf-b235-4a20-8d12-45f1ca16fe41_del
Nov 28 15:49:52 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-0df51d5a-c126-4a0f-832b-48d2d240fc1a tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] [instance: ca1558cf-b235-4a20-8d12-45f1ca16fe41] Deletion of /opt/stack/data/nova/instances/ca1558cf-b235-4a20-8d12-45f1ca16fe41_del complete
Nov 28 15:49:52 user nova-compute[75176]: DEBUG nova.network.neutron [req-995e8339-6de4-4743-83ba-a3c67dca620c req-60008fae-9436-4a14-aa4f-e9fe72a6ac7a service nova] [instance: ca1558cf-b235-4a20-8d12-45f1ca16fe41] Updated VIF entry in instance network info cache for port 2791b548-7207-402c-9f65-c078be714ef5. {{(pid=75176) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 15:49:52 user nova-compute[75176]: DEBUG nova.network.neutron [req-995e8339-6de4-4743-83ba-a3c67dca620c req-60008fae-9436-4a14-aa4f-e9fe72a6ac7a service nova] [instance: ca1558cf-b235-4a20-8d12-45f1ca16fe41] Updating instance_info_cache with network_info: [{"id": "2791b548-7207-402c-9f65-c078be714ef5", "address": "fa:16:3e:08:ec:9f", "network": {"id": "1f00fd98-3cd0-4c8c-912a-bc29124e1940", "bridge": null, "label": "tempest-TestShelveInstance-1334429215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a8b3f118afd469f9c82ec2574586aaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap2791b548-72", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:49:52 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-995e8339-6de4-4743-83ba-a3c67dca620c req-60008fae-9436-4a14-aa4f-e9fe72a6ac7a service nova] Releasing lock "refresh_cache-ca1558cf-b235-4a20-8d12-45f1ca16fe41" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:49:52 user nova-compute[75176]: DEBUG nova.compute.manager [req-5d0420c5-795e-4bb0-af09-c99cd65d01ea req-25f3fd3a-24da-4e28-bb2b-259431c9bd57 service nova] [instance: ca1558cf-b235-4a20-8d12-45f1ca16fe41] Received event network-vif-plugged-2791b548-7207-402c-9f65-c078be714ef5 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:49:52 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-5d0420c5-795e-4bb0-af09-c99cd65d01ea req-25f3fd3a-24da-4e28-bb2b-259431c9bd57 service nova] Acquiring lock "ca1558cf-b235-4a20-8d12-45f1ca16fe41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:49:52 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-5d0420c5-795e-4bb0-af09-c99cd65d01ea req-25f3fd3a-24da-4e28-bb2b-259431c9bd57 service nova] Lock "ca1558cf-b235-4a20-8d12-45f1ca16fe41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:49:52 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-5d0420c5-795e-4bb0-af09-c99cd65d01ea req-25f3fd3a-24da-4e28-bb2b-259431c9bd57 service nova] Lock "ca1558cf-b235-4a20-8d12-45f1ca16fe41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:49:52 user nova-compute[75176]: DEBUG nova.compute.manager [req-5d0420c5-795e-4bb0-af09-c99cd65d01ea req-25f3fd3a-24da-4e28-bb2b-259431c9bd57 service nova] [instance: ca1558cf-b235-4a20-8d12-45f1ca16fe41] No waiting events found dispatching network-vif-plugged-2791b548-7207-402c-9f65-c078be714ef5 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:49:52 user nova-compute[75176]: WARNING nova.compute.manager [req-5d0420c5-795e-4bb0-af09-c99cd65d01ea req-25f3fd3a-24da-4e28-bb2b-259431c9bd57 service nova] [instance: ca1558cf-b235-4a20-8d12-45f1ca16fe41] Received unexpected event network-vif-plugged-2791b548-7207-402c-9f65-c078be714ef5 for instance with vm_state active and task_state shelving.
Nov 28 15:49:52 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:49:52 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:49:53 user nova-compute[75176]: INFO nova.scheduler.client.report [None req-0df51d5a-c126-4a0f-832b-48d2d240fc1a tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] Deleted allocations for instance ca1558cf-b235-4a20-8d12-45f1ca16fe41
Nov 28 15:49:53 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-0df51d5a-c126-4a0f-832b-48d2d240fc1a tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:49:53 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-0df51d5a-c126-4a0f-832b-48d2d240fc1a tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:49:53 user nova-compute[75176]: DEBUG nova.objects.instance [None req-0df51d5a-c126-4a0f-832b-48d2d240fc1a tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] Lazy-loading 'numa_topology' on Instance uuid ca1558cf-b235-4a20-8d12-45f1ca16fe41 {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:49:53 user nova-compute[75176]: DEBUG nova.objects.base [None req-0df51d5a-c126-4a0f-832b-48d2d240fc1a tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] Object Instance<ca1558cf-b235-4a20-8d12-45f1ca16fe41> lazy-loaded attributes: resources,numa_topology {{(pid=75176) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 15:49:53 user nova-compute[75176]: DEBUG nova.compute.provider_tree [None req-0df51d5a-c126-4a0f-832b-48d2d240fc1a tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] Inventory has not changed in ProviderTree for provider: b37848d8-f401-4155-a029-b0ffa09ff85b {{(pid=75176) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 15:49:53 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-0df51d5a-c126-4a0f-832b-48d2d240fc1a tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] Inventory has not changed for provider b37848d8-f401-4155-a029-b0ffa09ff85b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75176) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 15:49:53 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-0df51d5a-c126-4a0f-832b-48d2d240fc1a tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.341s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:49:53 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-0df51d5a-c126-4a0f-832b-48d2d240fc1a tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] Lock "ca1558cf-b235-4a20-8d12-45f1ca16fe41" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 3.630s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:49:54 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:49:55 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:49:56 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:49:56 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:49:57 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:49:57 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:49:57 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75176) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 15:49:57 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:49:57 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Cleaning up deleted instances {{(pid=75176) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 28 15:49:57 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] There are 0 instances to clean {{(pid=75176) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 28 15:49:58 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:49:58 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Starting heal instance info cache {{(pid=75176) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 15:49:58 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Didn't find any instances for network info cache update. {{(pid=75176) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 28 15:49:58 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:49:58 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:49:58 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:49:58 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:49:58 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Auditing locally available compute resources for user (node: user) {{(pid=75176) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 15:49:58 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55febf04-14ea-4903-8692-c7cc6115de75/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:49:59 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:49:59 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55febf04-14ea-4903-8692-c7cc6115de75/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:49:59 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55febf04-14ea-4903-8692-c7cc6115de75/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:49:59 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55febf04-14ea-4903-8692-c7cc6115de75/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:49:59 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e8507b7-fccf-4196-b589-bf2b74f165ec/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:49:59 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e8507b7-fccf-4196-b589-bf2b74f165ec/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:49:59 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e8507b7-fccf-4196-b589-bf2b74f165ec/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:49:59 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e8507b7-fccf-4196-b589-bf2b74f165ec/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:49:59 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e8a6e1b-4f71-494a-8f44-f9643c658021/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:49:59 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e8a6e1b-4f71-494a-8f44-f9643c658021/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:49:59 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e8a6e1b-4f71-494a-8f44-f9643c658021/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:50:00 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e8a6e1b-4f71-494a-8f44-f9643c658021/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:50:00 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbefda8d-d285-404b-9817-49deada49d0b/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:50:00 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbefda8d-d285-404b-9817-49deada49d0b/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:50:00 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbefda8d-d285-404b-9817-49deada49d0b/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:50:00 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbefda8d-d285-404b-9817-49deada49d0b/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:50:00 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d061df5-8dbc-4fc1-9935-d46efc934b58/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:50:00 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d061df5-8dbc-4fc1-9935-d46efc934b58/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:50:00 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d061df5-8dbc-4fc1-9935-d46efc934b58/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:50:00 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d061df5-8dbc-4fc1-9935-d46efc934b58/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:50:00 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75176) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 15:50:00 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6ebcc53-802a-4515-ba41-3e8e1129235f/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:50:01 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6ebcc53-802a-4515-ba41-3e8e1129235f/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:50:01 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6ebcc53-802a-4515-ba41-3e8e1129235f/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:50:01 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6ebcc53-802a-4515-ba41-3e8e1129235f/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:50:01 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75176) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 15:50:01 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66ead7d-98f4-4822-9dce-f2ea0206a58d/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:50:01 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66ead7d-98f4-4822-9dce-f2ea0206a58d/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:50:01 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66ead7d-98f4-4822-9dce-f2ea0206a58d/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:50:01 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66ead7d-98f4-4822-9dce-f2ea0206a58d/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:50:01 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fe64eb8-b4e3-4037-80b1-0c151370d5a8/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:50:01 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:50:01 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fe64eb8-b4e3-4037-80b1-0c151370d5a8/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:50:01 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fe64eb8-b4e3-4037-80b1-0c151370d5a8/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:50:01 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fe64eb8-b4e3-4037-80b1-0c151370d5a8/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:50:01 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:50:02 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:50:02 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:50:02 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:50:02 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 15:50:02 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 15:50:02 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Hypervisor/Node resource view: name=user free_ram=7133MB free_disk=25.18932342529297GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75176) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 15:50:02 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:50:02 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:50:03 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance 2e8507b7-fccf-4196-b589-bf2b74f165ec actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:50:03 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance 1e8a6e1b-4f71-494a-8f44-f9643c658021 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:50:03 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance 8fe64eb8-b4e3-4037-80b1-0c151370d5a8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:50:03 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance a6ebcc53-802a-4515-ba41-3e8e1129235f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:50:03 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance 42579ef7-54dc-4165-a144-61e80fdd5626 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:50:03 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance 6d061df5-8dbc-4fc1-9935-d46efc934b58 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:50:03 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance cbefda8d-d285-404b-9817-49deada49d0b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:50:03 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance f66ead7d-98f4-4822-9dce-f2ea0206a58d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:50:03 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance 55febf04-14ea-4903-8692-c7cc6115de75 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:50:03 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance 8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:50:03 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75176) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 15:50:03 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75176) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 15:50:03 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Refreshing inventories for resource provider b37848d8-f401-4155-a029-b0ffa09ff85b {{(pid=75176) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 28 15:50:03 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Updating ProviderTree inventory for provider b37848d8-f401-4155-a029-b0ffa09ff85b from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75176) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 28 15:50:03 user nova-compute[75176]: DEBUG nova.compute.provider_tree [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Updating inventory in ProviderTree for provider b37848d8-f401-4155-a029-b0ffa09ff85b with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75176) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 28 15:50:03 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Refreshing aggregate associations for resource provider b37848d8-f401-4155-a029-b0ffa09ff85b, aggregates: None {{(pid=75176) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 28 15:50:03 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Refreshing trait associations for resource provider b37848d8-f401-4155-a029-b0ffa09ff85b, traits: COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_RESCUE_BFV,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NODE,HW_CPU_X86_SSSE3,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE42,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE2,COMPUTE_ACCELERATORS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VIRTIO {{(pid=75176) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 28 15:50:03 user nova-compute[75176]: DEBUG nova.compute.provider_tree [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Inventory has not changed in ProviderTree for provider: b37848d8-f401-4155-a029-b0ffa09ff85b {{(pid=75176) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 15:50:03 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Inventory has not changed for provider b37848d8-f401-4155-a029-b0ffa09ff85b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75176) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 15:50:03 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Compute_service record updated for user:user {{(pid=75176) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 15:50:03 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.673s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:50:03 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:50:03 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75176) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 28 15:50:04 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:50:04 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-b7293bec-66b5-478e-934a-43c9356085dd tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] Acquiring lock "8fe64eb8-b4e3-4037-80b1-0c151370d5a8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:50:04 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-b7293bec-66b5-478e-934a-43c9356085dd tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] Lock "8fe64eb8-b4e3-4037-80b1-0c151370d5a8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:50:04 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-b7293bec-66b5-478e-934a-43c9356085dd tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] Acquiring lock "8fe64eb8-b4e3-4037-80b1-0c151370d5a8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:50:04 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-b7293bec-66b5-478e-934a-43c9356085dd tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] Lock "8fe64eb8-b4e3-4037-80b1-0c151370d5a8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:50:04 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-b7293bec-66b5-478e-934a-43c9356085dd tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] Lock "8fe64eb8-b4e3-4037-80b1-0c151370d5a8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:50:04 user nova-compute[75176]: INFO nova.compute.manager [None req-b7293bec-66b5-478e-934a-43c9356085dd tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] [instance: 8fe64eb8-b4e3-4037-80b1-0c151370d5a8] Terminating instance
Nov 28 15:50:04 user nova-compute[75176]: DEBUG nova.compute.manager [None req-b7293bec-66b5-478e-934a-43c9356085dd tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] [instance: 8fe64eb8-b4e3-4037-80b1-0c151370d5a8] Start destroying the instance on the hypervisor. {{(pid=75176) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 15:50:04 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:50:04 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:50:04 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:50:04 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:50:04 user nova-compute[75176]: DEBUG nova.compute.manager [req-c81e7252-0c30-4329-b43e-3329873e7be3 req-a05c2cfc-dcc9-40ab-8e37-6c33238a353f service nova] [instance: 8fe64eb8-b4e3-4037-80b1-0c151370d5a8] Received event network-vif-unplugged-9b3e8a32-f295-4443-b831-b334e3e819ed {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:50:04 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-c81e7252-0c30-4329-b43e-3329873e7be3 req-a05c2cfc-dcc9-40ab-8e37-6c33238a353f service nova] Acquiring lock "8fe64eb8-b4e3-4037-80b1-0c151370d5a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:50:04 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-c81e7252-0c30-4329-b43e-3329873e7be3 req-a05c2cfc-dcc9-40ab-8e37-6c33238a353f service nova] Lock "8fe64eb8-b4e3-4037-80b1-0c151370d5a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:50:04 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-c81e7252-0c30-4329-b43e-3329873e7be3 req-a05c2cfc-dcc9-40ab-8e37-6c33238a353f service nova] Lock "8fe64eb8-b4e3-4037-80b1-0c151370d5a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:50:04 user nova-compute[75176]: DEBUG nova.compute.manager [req-c81e7252-0c30-4329-b43e-3329873e7be3 req-a05c2cfc-dcc9-40ab-8e37-6c33238a353f service nova] [instance: 8fe64eb8-b4e3-4037-80b1-0c151370d5a8] No waiting events found dispatching network-vif-unplugged-9b3e8a32-f295-4443-b831-b334e3e819ed {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:50:04 user nova-compute[75176]: DEBUG nova.compute.manager [req-c81e7252-0c30-4329-b43e-3329873e7be3 req-a05c2cfc-dcc9-40ab-8e37-6c33238a353f service nova] [instance: 8fe64eb8-b4e3-4037-80b1-0c151370d5a8] Received event network-vif-unplugged-9b3e8a32-f295-4443-b831-b334e3e819ed for instance with task_state deleting. {{(pid=75176) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 15:50:05 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:50:05 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:50:05 user nova-compute[75176]: INFO nova.virt.libvirt.driver [-] [instance: 8fe64eb8-b4e3-4037-80b1-0c151370d5a8] Instance destroyed successfully.
Nov 28 15:50:05 user nova-compute[75176]: DEBUG nova.objects.instance [None req-b7293bec-66b5-478e-934a-43c9356085dd tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] Lazy-loading 'resources' on Instance uuid 8fe64eb8-b4e3-4037-80b1-0c151370d5a8 {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:50:05 user nova-compute[75176]: DEBUG nova.compute.manager [req-7a9ca8fc-fc5b-458a-acb2-90bde635f66b req-34f7126e-0ece-416f-be62-7e4e40ecffab service nova] [instance: 42579ef7-54dc-4165-a144-61e80fdd5626] Received event network-changed-c60779ce-eea1-4d7d-9195-4c1c4921a5fb {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:50:05 user nova-compute[75176]: DEBUG nova.compute.manager [req-7a9ca8fc-fc5b-458a-acb2-90bde635f66b req-34f7126e-0ece-416f-be62-7e4e40ecffab service nova] [instance: 42579ef7-54dc-4165-a144-61e80fdd5626] Refreshing instance network info cache due to event network-changed-c60779ce-eea1-4d7d-9195-4c1c4921a5fb. {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 15:50:05 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-7a9ca8fc-fc5b-458a-acb2-90bde635f66b req-34f7126e-0ece-416f-be62-7e4e40ecffab service nova] Acquiring lock "refresh_cache-42579ef7-54dc-4165-a144-61e80fdd5626" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:50:05 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-7a9ca8fc-fc5b-458a-acb2-90bde635f66b req-34f7126e-0ece-416f-be62-7e4e40ecffab service nova] Acquired lock "refresh_cache-42579ef7-54dc-4165-a144-61e80fdd5626" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:50:05 user nova-compute[75176]: DEBUG nova.network.neutron [req-7a9ca8fc-fc5b-458a-acb2-90bde635f66b req-34f7126e-0ece-416f-be62-7e4e40ecffab service nova] [instance: 42579ef7-54dc-4165-a144-61e80fdd5626] Refreshing network info cache for port c60779ce-eea1-4d7d-9195-4c1c4921a5fb {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 15:50:05 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-b7293bec-66b5-478e-934a-43c9356085dd tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T15:47:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1310921736',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1310921736',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1310921',id=24,image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDV+U70K85QMYI1OGc7tIe4DMCc/JKasNThTbB8PZF5eBwHKeHqIVo22CkrnpPWSJD9kTgpEZU8/hMTrHotZ2qx+cdOGHicBEZMYZdQuVXfvOGj+P/0sxYvomrPYRGGFsg==',key_name='tempest-keypair-134007714',keypairs=<?>,launch_index=0,launched_at=2023-11-28T15:47:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d37788d8e0384afcb348f009062c3b12',ramdisk_id='',reservation_id='r-9p0kesdr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1242768290',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T15:47:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dc50b1a21d114a2081d2913f402974d1',uuid=8fe64eb8-b4e3-4037-80b1-0c151370d5a8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9b3e8a32-f295-4443-b831-b334e3e819ed", "address": "fa:16:3e:00:fc:1e", "network": {"id": "a5685858-c130-4f66-8600-023367af9ea5", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-316757927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d37788d8e0384afcb348f009062c3b12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b3e8a32-f2", "ovs_interfaceid": "9b3e8a32-f295-4443-b831-b334e3e819ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 15:50:05 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-b7293bec-66b5-478e-934a-43c9356085dd tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] Converting VIF {"id": "9b3e8a32-f295-4443-b831-b334e3e819ed", "address": "fa:16:3e:00:fc:1e", "network": {"id": "a5685858-c130-4f66-8600-023367af9ea5", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-316757927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d37788d8e0384afcb348f009062c3b12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b3e8a32-f2", "ovs_interfaceid": "9b3e8a32-f295-4443-b831-b334e3e819ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:50:05 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-b7293bec-66b5-478e-934a-43c9356085dd tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:00:fc:1e,bridge_name='br-int',has_traffic_filtering=True,id=9b3e8a32-f295-4443-b831-b334e3e819ed,network=Network(a5685858-c130-4f66-8600-023367af9ea5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b3e8a32-f2') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:50:05 user nova-compute[75176]: DEBUG os_vif [None req-b7293bec-66b5-478e-934a-43c9356085dd tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:00:fc:1e,bridge_name='br-int',has_traffic_filtering=True,id=9b3e8a32-f295-4443-b831-b334e3e819ed,network=Network(a5685858-c130-4f66-8600-023367af9ea5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b3e8a32-f2') {{(pid=75176) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 15:50:05 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:50:05 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9b3e8a32-f2, bridge=br-int, if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:50:05 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:50:05 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:50:05 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:50:05 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5e39b6bc-64dd-47fa-8bce-643d0ace8fc7) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:50:05 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:50:05 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:50:05 user nova-compute[75176]: INFO os_vif [None req-b7293bec-66b5-478e-934a-43c9356085dd tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:00:fc:1e,bridge_name='br-int',has_traffic_filtering=True,id=9b3e8a32-f295-4443-b831-b334e3e819ed,network=Network(a5685858-c130-4f66-8600-023367af9ea5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b3e8a32-f2')
Nov 28 15:50:05 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-b7293bec-66b5-478e-934a-43c9356085dd tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] [instance: 8fe64eb8-b4e3-4037-80b1-0c151370d5a8] Deleting instance files /opt/stack/data/nova/instances/8fe64eb8-b4e3-4037-80b1-0c151370d5a8_del
Nov 28 15:50:05 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-b7293bec-66b5-478e-934a-43c9356085dd tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] [instance: 8fe64eb8-b4e3-4037-80b1-0c151370d5a8] Deletion of /opt/stack/data/nova/instances/8fe64eb8-b4e3-4037-80b1-0c151370d5a8_del complete
Nov 28 15:50:05 user nova-compute[75176]: INFO nova.compute.manager [None req-b7293bec-66b5-478e-934a-43c9356085dd tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] [instance: 8fe64eb8-b4e3-4037-80b1-0c151370d5a8] Took 0.91 seconds to destroy the instance on the hypervisor.
Nov 28 15:50:05 user nova-compute[75176]: DEBUG oslo.service.loopingcall [None req-b7293bec-66b5-478e-934a-43c9356085dd tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75176) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 15:50:05 user nova-compute[75176]: DEBUG nova.compute.manager [-] [instance: 8fe64eb8-b4e3-4037-80b1-0c151370d5a8] Deallocating network for instance {{(pid=75176) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 15:50:05 user nova-compute[75176]: DEBUG nova.network.neutron [-] [instance: 8fe64eb8-b4e3-4037-80b1-0c151370d5a8] deallocate_for_instance() {{(pid=75176) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 15:50:05 user nova-compute[75176]: DEBUG nova.network.neutron [req-7a9ca8fc-fc5b-458a-acb2-90bde635f66b req-34f7126e-0ece-416f-be62-7e4e40ecffab service nova] [instance: 42579ef7-54dc-4165-a144-61e80fdd5626] Updated VIF entry in instance network info cache for port c60779ce-eea1-4d7d-9195-4c1c4921a5fb. {{(pid=75176) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 15:50:05 user nova-compute[75176]: DEBUG nova.network.neutron [req-7a9ca8fc-fc5b-458a-acb2-90bde635f66b req-34f7126e-0ece-416f-be62-7e4e40ecffab service nova] [instance: 42579ef7-54dc-4165-a144-61e80fdd5626] Updating instance_info_cache with network_info: [{"id": "c60779ce-eea1-4d7d-9195-4c1c4921a5fb", "address": "fa:16:3e:ba:f7:78", "network": {"id": "5ec264ad-3459-468c-bdbf-c6a4ef016951", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1574289626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07c7783cc16049208421204910982c79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc60779ce-ee", "ovs_interfaceid": "c60779ce-eea1-4d7d-9195-4c1c4921a5fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:50:05 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-7a9ca8fc-fc5b-458a-acb2-90bde635f66b req-34f7126e-0ece-416f-be62-7e4e40ecffab service nova] Releasing lock "refresh_cache-42579ef7-54dc-4165-a144-61e80fdd5626" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:50:06 user nova-compute[75176]: DEBUG nova.network.neutron [-] [instance: 8fe64eb8-b4e3-4037-80b1-0c151370d5a8] Updating instance_info_cache with network_info: [] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:50:06 user nova-compute[75176]: INFO nova.compute.manager [-] [instance: 8fe64eb8-b4e3-4037-80b1-0c151370d5a8] Took 0.87 seconds to deallocate network for instance.
Nov 28 15:50:06 user nova-compute[75176]: DEBUG nova.compute.manager [req-6ebe30a8-a22b-4082-8db1-bb3ca3aea656 req-49afa123-916e-440a-8a9d-94d05a0dbf40 service nova] [instance: 8fe64eb8-b4e3-4037-80b1-0c151370d5a8] Received event network-vif-deleted-9b3e8a32-f295-4443-b831-b334e3e819ed {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:50:06 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-b7293bec-66b5-478e-934a-43c9356085dd tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:50:06 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-b7293bec-66b5-478e-934a-43c9356085dd tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:50:06 user nova-compute[75176]: DEBUG nova.compute.provider_tree [None req-b7293bec-66b5-478e-934a-43c9356085dd tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] Inventory has not changed in ProviderTree for provider: b37848d8-f401-4155-a029-b0ffa09ff85b {{(pid=75176) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 15:50:06 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-b7293bec-66b5-478e-934a-43c9356085dd tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] Inventory has not changed for provider b37848d8-f401-4155-a029-b0ffa09ff85b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75176) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 15:50:06 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-b7293bec-66b5-478e-934a-43c9356085dd tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.339s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:50:06 user nova-compute[75176]: INFO nova.scheduler.client.report [None req-b7293bec-66b5-478e-934a-43c9356085dd tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] Deleted allocations for instance 8fe64eb8-b4e3-4037-80b1-0c151370d5a8
Nov 28 15:50:06 user nova-compute[75176]: DEBUG nova.compute.manager [req-ab5ce158-464d-46f0-88af-3774fdd3118b req-c763204b-75f9-4314-b831-addf6074f469 service nova] [instance: 8fe64eb8-b4e3-4037-80b1-0c151370d5a8] Received event network-vif-plugged-9b3e8a32-f295-4443-b831-b334e3e819ed {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:50:06 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-ab5ce158-464d-46f0-88af-3774fdd3118b req-c763204b-75f9-4314-b831-addf6074f469 service nova] Acquiring lock "8fe64eb8-b4e3-4037-80b1-0c151370d5a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:50:06 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-ab5ce158-464d-46f0-88af-3774fdd3118b req-c763204b-75f9-4314-b831-addf6074f469 service nova] Lock "8fe64eb8-b4e3-4037-80b1-0c151370d5a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:50:06 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-ab5ce158-464d-46f0-88af-3774fdd3118b req-c763204b-75f9-4314-b831-addf6074f469 service nova] Lock "8fe64eb8-b4e3-4037-80b1-0c151370d5a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:50:06 user nova-compute[75176]: DEBUG nova.compute.manager [req-ab5ce158-464d-46f0-88af-3774fdd3118b req-c763204b-75f9-4314-b831-addf6074f469 service nova] [instance: 8fe64eb8-b4e3-4037-80b1-0c151370d5a8] No waiting events found dispatching network-vif-plugged-9b3e8a32-f295-4443-b831-b334e3e819ed {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:50:06 user nova-compute[75176]: WARNING nova.compute.manager [req-ab5ce158-464d-46f0-88af-3774fdd3118b req-c763204b-75f9-4314-b831-addf6074f469 service nova] [instance: 8fe64eb8-b4e3-4037-80b1-0c151370d5a8] Received unexpected event network-vif-plugged-9b3e8a32-f295-4443-b831-b334e3e819ed for instance with vm_state deleted and task_state None.
Nov 28 15:50:06 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-b7293bec-66b5-478e-934a-43c9356085dd tempest-TestServerVolumeAttachScenarioOldVersion-1242768290 tempest-TestServerVolumeAttachScenarioOldVersion-1242768290-project-member] Lock "8fe64eb8-b4e3-4037-80b1-0c151370d5a8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.329s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:50:09 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:50:10 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:50:10 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:50:11 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-51d95862-bb17-4db3-abbe-78d0643cfa59 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Acquiring lock "e8b9c885-42ba-4f74-86b2-d091ebd08ed5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:50:11 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-51d95862-bb17-4db3-abbe-78d0643cfa59 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Lock "e8b9c885-42ba-4f74-86b2-d091ebd08ed5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:50:11 user nova-compute[75176]: DEBUG nova.compute.manager [None req-51d95862-bb17-4db3-abbe-78d0643cfa59 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: e8b9c885-42ba-4f74-86b2-d091ebd08ed5] Starting instance... {{(pid=75176) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 15:50:11 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-51d95862-bb17-4db3-abbe-78d0643cfa59 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:50:11 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-51d95862-bb17-4db3-abbe-78d0643cfa59 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:50:11 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-51d95862-bb17-4db3-abbe-78d0643cfa59 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75176) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 15:50:11 user nova-compute[75176]: INFO nova.compute.claims [None req-51d95862-bb17-4db3-abbe-78d0643cfa59 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: e8b9c885-42ba-4f74-86b2-d091ebd08ed5] Claim successful on node user
Nov 28 15:50:12 user nova-compute[75176]: DEBUG nova.compute.provider_tree [None req-51d95862-bb17-4db3-abbe-78d0643cfa59 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Inventory has not changed in ProviderTree for provider: b37848d8-f401-4155-a029-b0ffa09ff85b {{(pid=75176) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 15:50:12 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-51d95862-bb17-4db3-abbe-78d0643cfa59 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Inventory has not changed for provider b37848d8-f401-4155-a029-b0ffa09ff85b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75176) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 15:50:12 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-51d95862-bb17-4db3-abbe-78d0643cfa59 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.401s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:50:12 user nova-compute[75176]: DEBUG nova.compute.manager [None req-51d95862-bb17-4db3-abbe-78d0643cfa59 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: e8b9c885-42ba-4f74-86b2-d091ebd08ed5] Start building networks asynchronously for instance. {{(pid=75176) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 15:50:12 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-51d95862-bb17-4db3-abbe-78d0643cfa59 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: e8b9c885-42ba-4f74-86b2-d091ebd08ed5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 15:50:12 user nova-compute[75176]: DEBUG nova.compute.manager [None req-51d95862-bb17-4db3-abbe-78d0643cfa59 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: e8b9c885-42ba-4f74-86b2-d091ebd08ed5] Allocating IP information in the background. {{(pid=75176) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 15:50:12 user nova-compute[75176]: DEBUG nova.network.neutron [None req-51d95862-bb17-4db3-abbe-78d0643cfa59 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: e8b9c885-42ba-4f74-86b2-d091ebd08ed5] allocate_for_instance() {{(pid=75176) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 15:50:12 user nova-compute[75176]: DEBUG nova.compute.manager [None req-51d95862-bb17-4db3-abbe-78d0643cfa59 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: e8b9c885-42ba-4f74-86b2-d091ebd08ed5] Start building block device mappings for instance. {{(pid=75176) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 15:50:12 user nova-compute[75176]: INFO nova.virt.block_device [None req-51d95862-bb17-4db3-abbe-78d0643cfa59 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: e8b9c885-42ba-4f74-86b2-d091ebd08ed5] Booting with volume snapshot 94185632-78c0-4dba-a23d-f6bdb2266c31 at /dev/vda
Nov 28 15:50:12 user nova-compute[75176]: DEBUG nova.policy [None req-51d95862-bb17-4db3-abbe-78d0643cfa59 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '081bf84d24194b81be4e0a6638db9b66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c7783cc16049208421204910982c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75176) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 15:50:12 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-4bf3a351-6e94-4e35-b361-bf620fd99ed6 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Acquiring lock "0e465c9f-e8ab-4a28-bf74-2936a272a0e2" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:50:12 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-4bf3a351-6e94-4e35-b361-bf620fd99ed6 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Lock "0e465c9f-e8ab-4a28-bf74-2936a272a0e2" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:50:12 user nova-compute[75176]: INFO nova.compute.manager [None req-4bf3a351-6e94-4e35-b361-bf620fd99ed6 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] [instance: 0e465c9f-e8ab-4a28-bf74-2936a272a0e2] Unshelving
Nov 28 15:50:12 user nova-compute[75176]: INFO nova.virt.block_device [None req-4bf3a351-6e94-4e35-b361-bf620fd99ed6 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] [instance: 0e465c9f-e8ab-4a28-bf74-2936a272a0e2] Booting with volume 07de7953-293c-4762-b695-ed3190c934d5 at /dev/vdc
Nov 28 15:50:12 user nova-compute[75176]: DEBUG os_brick.utils [None req-4bf3a351-6e94-4e35-b361-bf620fd99ed6 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 15:50:12 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:50:12 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:50:12 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[c73dc37d-1657-431b-9455-7037b2360c12]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:edc924a949b2\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:50:12 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:50:12 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:50:12 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[eff7edd5-d540-4058-b884-11f19b9bad73]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:50:12 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:50:12 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:50:12 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f9c0ac2-90c7-4f2c-b77a-0fe6f0d61175]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:50:12 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdccd48f-b76a-40a9-acf0-ff2197923068]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:50:12 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-4bf3a351-6e94-4e35-b361-bf620fd99ed6 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Running cmd (subprocess): nvme version {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:50:12 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-4bf3a351-6e94-4e35-b361-bf620fd99ed6 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] 'nvme version' failed. Not Retrying. {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 15:50:12 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4bf3a351-6e94-4e35-b361-bf620fd99ed6 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] nvme not present on system {{(pid=75176) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 15:50:12 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:50:12 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 15:50:12 user nova-compute[75176]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 15:50:12 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[9450a627-8d05-43dc-aa32-f1efcf2e608e]: (4, '') {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:50:12 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.lightos [None req-4bf3a351-6e94-4e35-b361-bf620fd99ed6 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75176) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 15:50:12 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.lightos [None req-4bf3a351-6e94-4e35-b361-bf620fd99ed6 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75176) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 15:50:12 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.lightos [None req-4bf3a351-6e94-4e35-b361-bf620fd99ed6 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] LIGHTOS: no hostnqn found. {{(pid=75176) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 15:50:12 user nova-compute[75176]: DEBUG os_brick.utils [None req-4bf3a351-6e94-4e35-b361-bf620fd99ed6 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:edc924a949b2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 15:50:12 user nova-compute[75176]: DEBUG nova.virt.block_device [None req-4bf3a351-6e94-4e35-b361-bf620fd99ed6 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] [instance: 0e465c9f-e8ab-4a28-bf74-2936a272a0e2] Updating existing volume attachment record: 193ef665-2555-4bb1-9a79-f77ca2afa6ba {{(pid=75176) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 15:50:12 user nova-compute[75176]: DEBUG nova.network.neutron [None req-51d95862-bb17-4db3-abbe-78d0643cfa59 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: e8b9c885-42ba-4f74-86b2-d091ebd08ed5] Successfully created port: 62fa1256-2b2c-4740-b93c-9e98a0a738f8 {{(pid=75176) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 15:50:13 user nova-compute[75176]: DEBUG nova.network.neutron [None req-51d95862-bb17-4db3-abbe-78d0643cfa59 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: e8b9c885-42ba-4f74-86b2-d091ebd08ed5] Successfully updated port: 62fa1256-2b2c-4740-b93c-9e98a0a738f8 {{(pid=75176) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 15:50:13 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-51d95862-bb17-4db3-abbe-78d0643cfa59 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Acquiring lock "refresh_cache-e8b9c885-42ba-4f74-86b2-d091ebd08ed5" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:50:13 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-51d95862-bb17-4db3-abbe-78d0643cfa59 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Acquired lock "refresh_cache-e8b9c885-42ba-4f74-86b2-d091ebd08ed5" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:50:13 user nova-compute[75176]: DEBUG nova.network.neutron [None req-51d95862-bb17-4db3-abbe-78d0643cfa59 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: e8b9c885-42ba-4f74-86b2-d091ebd08ed5] Building network info cache for instance {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 15:50:13 user nova-compute[75176]: DEBUG nova.compute.manager [req-3b0f4b75-21a6-4908-87f3-1854f51d34c8 req-137c4f65-af59-4977-a8f5-ca901129907e service nova] [instance: e8b9c885-42ba-4f74-86b2-d091ebd08ed5] Received event network-changed-62fa1256-2b2c-4740-b93c-9e98a0a738f8 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:50:13 user nova-compute[75176]: DEBUG nova.compute.manager [req-3b0f4b75-21a6-4908-87f3-1854f51d34c8 req-137c4f65-af59-4977-a8f5-ca901129907e service nova] [instance: e8b9c885-42ba-4f74-86b2-d091ebd08ed5] Refreshing instance network info cache due to event network-changed-62fa1256-2b2c-4740-b93c-9e98a0a738f8. {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 15:50:13 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-3b0f4b75-21a6-4908-87f3-1854f51d34c8 req-137c4f65-af59-4977-a8f5-ca901129907e service nova] Acquiring lock "refresh_cache-e8b9c885-42ba-4f74-86b2-d091ebd08ed5" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:50:13 user nova-compute[75176]: DEBUG nova.network.neutron [None req-51d95862-bb17-4db3-abbe-78d0643cfa59 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: e8b9c885-42ba-4f74-86b2-d091ebd08ed5] Instance cache missing network info. {{(pid=75176) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 15:50:13 user nova-compute[75176]: DEBUG nova.network.neutron [None req-51d95862-bb17-4db3-abbe-78d0643cfa59 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: e8b9c885-42ba-4f74-86b2-d091ebd08ed5] Updating instance_info_cache with network_info: [{"id": "62fa1256-2b2c-4740-b93c-9e98a0a738f8", "address": "fa:16:3e:a4:c5:51", "network": {"id": "5ec264ad-3459-468c-bdbf-c6a4ef016951", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1574289626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07c7783cc16049208421204910982c79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62fa1256-2b", "ovs_interfaceid": "62fa1256-2b2c-4740-b93c-9e98a0a738f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:50:13 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-51d95862-bb17-4db3-abbe-78d0643cfa59 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Releasing lock "refresh_cache-e8b9c885-42ba-4f74-86b2-d091ebd08ed5" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:50:13 user nova-compute[75176]: DEBUG nova.compute.manager [None req-51d95862-bb17-4db3-abbe-78d0643cfa59 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: e8b9c885-42ba-4f74-86b2-d091ebd08ed5] Instance network_info: |[{"id": "62fa1256-2b2c-4740-b93c-9e98a0a738f8", "address": "fa:16:3e:a4:c5:51", "network": {"id": "5ec264ad-3459-468c-bdbf-c6a4ef016951", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1574289626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07c7783cc16049208421204910982c79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62fa1256-2b", "ovs_interfaceid": "62fa1256-2b2c-4740-b93c-9e98a0a738f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75176) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 15:50:13 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-3b0f4b75-21a6-4908-87f3-1854f51d34c8 req-137c4f65-af59-4977-a8f5-ca901129907e service nova] Acquired lock "refresh_cache-e8b9c885-42ba-4f74-86b2-d091ebd08ed5" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:50:13 user nova-compute[75176]: DEBUG nova.network.neutron [req-3b0f4b75-21a6-4908-87f3-1854f51d34c8 req-137c4f65-af59-4977-a8f5-ca901129907e service nova] [instance: e8b9c885-42ba-4f74-86b2-d091ebd08ed5] Refreshing network info cache for port 62fa1256-2b2c-4740-b93c-9e98a0a738f8 {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 15:50:14 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:50:14 user nova-compute[75176]: DEBUG nova.network.neutron [req-3b0f4b75-21a6-4908-87f3-1854f51d34c8 req-137c4f65-af59-4977-a8f5-ca901129907e service nova] [instance: e8b9c885-42ba-4f74-86b2-d091ebd08ed5] Updated VIF entry in instance network info cache for port 62fa1256-2b2c-4740-b93c-9e98a0a738f8. {{(pid=75176) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 15:50:14 user nova-compute[75176]: DEBUG nova.network.neutron [req-3b0f4b75-21a6-4908-87f3-1854f51d34c8 req-137c4f65-af59-4977-a8f5-ca901129907e service nova] [instance: e8b9c885-42ba-4f74-86b2-d091ebd08ed5] Updating instance_info_cache with network_info: [{"id": "62fa1256-2b2c-4740-b93c-9e98a0a738f8", "address": "fa:16:3e:a4:c5:51", "network": {"id": "5ec264ad-3459-468c-bdbf-c6a4ef016951", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1574289626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07c7783cc16049208421204910982c79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62fa1256-2b", "ovs_interfaceid": "62fa1256-2b2c-4740-b93c-9e98a0a738f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:50:14 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-3b0f4b75-21a6-4908-87f3-1854f51d34c8 req-137c4f65-af59-4977-a8f5-ca901129907e service nova] Releasing lock "refresh_cache-e8b9c885-42ba-4f74-86b2-d091ebd08ed5" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:50:15 user nova-compute[75176]: DEBUG nova.compute.manager [req-d3484278-63cb-4a34-b59d-f23cb0ed6a7e req-e260fcb0-f94f-4010-bc16-f1cce595441e service nova] [instance: 6d061df5-8dbc-4fc1-9935-d46efc934b58] Received event network-changed-6912fd20-0a10-42ab-935d-148644fca89b {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:50:15 user nova-compute[75176]: DEBUG nova.compute.manager [req-d3484278-63cb-4a34-b59d-f23cb0ed6a7e req-e260fcb0-f94f-4010-bc16-f1cce595441e service nova] [instance: 6d061df5-8dbc-4fc1-9935-d46efc934b58] Refreshing instance network info cache due to event network-changed-6912fd20-0a10-42ab-935d-148644fca89b. {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 15:50:15 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-d3484278-63cb-4a34-b59d-f23cb0ed6a7e req-e260fcb0-f94f-4010-bc16-f1cce595441e service nova] Acquiring lock "refresh_cache-6d061df5-8dbc-4fc1-9935-d46efc934b58" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:50:15 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-d3484278-63cb-4a34-b59d-f23cb0ed6a7e req-e260fcb0-f94f-4010-bc16-f1cce595441e service nova] Acquired lock "refresh_cache-6d061df5-8dbc-4fc1-9935-d46efc934b58" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:50:15 user nova-compute[75176]: DEBUG nova.network.neutron [req-d3484278-63cb-4a34-b59d-f23cb0ed6a7e req-e260fcb0-f94f-4010-bc16-f1cce595441e service nova] [instance: 6d061df5-8dbc-4fc1-9935-d46efc934b58] Refreshing network info cache for port 6912fd20-0a10-42ab-935d-148644fca89b {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 15:50:15 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:50:15 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7a1611f3-2976-4f80-9f23-67bf14db402e tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Acquiring lock "6d061df5-8dbc-4fc1-9935-d46efc934b58" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:50:15 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7a1611f3-2976-4f80-9f23-67bf14db402e tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Lock "6d061df5-8dbc-4fc1-9935-d46efc934b58" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:50:15 user nova-compute[75176]: DEBUG nova.objects.instance [None req-7a1611f3-2976-4f80-9f23-67bf14db402e tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Lazy-loading 'flavor' on Instance uuid 6d061df5-8dbc-4fc1-9935-d46efc934b58 {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:50:15 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-7a1611f3-2976-4f80-9f23-67bf14db402e tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] [instance: 6d061df5-8dbc-4fc1-9935-d46efc934b58] Ignoring supplied device name: /dev/vdb
Nov 28 15:50:15 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7a1611f3-2976-4f80-9f23-67bf14db402e tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Lock "6d061df5-8dbc-4fc1-9935-d46efc934b58" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:50:15 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7a1611f3-2976-4f80-9f23-67bf14db402e tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Acquiring lock "6d061df5-8dbc-4fc1-9935-d46efc934b58" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:50:15 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7a1611f3-2976-4f80-9f23-67bf14db402e tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Lock "6d061df5-8dbc-4fc1-9935-d46efc934b58" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:50:15 user nova-compute[75176]: INFO nova.compute.manager [None req-7a1611f3-2976-4f80-9f23-67bf14db402e tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] [instance: 6d061df5-8dbc-4fc1-9935-d46efc934b58] Attaching volume 370d91ef-d3c5-4019-b447-3f8134556e11 to /dev/vdb
Nov 28 15:50:15 user nova-compute[75176]: DEBUG nova.network.neutron [req-d3484278-63cb-4a34-b59d-f23cb0ed6a7e req-e260fcb0-f94f-4010-bc16-f1cce595441e service nova] [instance: 6d061df5-8dbc-4fc1-9935-d46efc934b58] Updated VIF entry in instance network info cache for port 6912fd20-0a10-42ab-935d-148644fca89b. {{(pid=75176) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 15:50:15 user nova-compute[75176]: DEBUG nova.network.neutron [req-d3484278-63cb-4a34-b59d-f23cb0ed6a7e req-e260fcb0-f94f-4010-bc16-f1cce595441e service nova] [instance: 6d061df5-8dbc-4fc1-9935-d46efc934b58] Updating instance_info_cache with network_info: [{"id": "6912fd20-0a10-42ab-935d-148644fca89b", "address": "fa:16:3e:31:cd:96", "network": {"id": "0478f649-0c69-414b-84c3-3ef4604d6062", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-695624980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3669019a110245d19a8ac85b5b20d2bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6912fd20-0a", "ovs_interfaceid": "6912fd20-0a10-42ab-935d-148644fca89b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:50:15 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-d3484278-63cb-4a34-b59d-f23cb0ed6a7e req-e260fcb0-f94f-4010-bc16-f1cce595441e service nova] Releasing lock "refresh_cache-6d061df5-8dbc-4fc1-9935-d46efc934b58" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:50:15 user nova-compute[75176]: DEBUG os_brick.utils [None req-7a1611f3-2976-4f80-9f23-67bf14db402e tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 15:50:15 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:50:15 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:50:15 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[e594a73c-36c4-46fd-afd7-64fb3019002c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:edc924a949b2\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:50:15 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:50:15 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:50:15 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[aee94f22-df7b-4d78-b207-6fd1be9a812b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:50:15 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:50:15 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:50:15 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d4582e0-3fa2-4759-9a21-0751c3cb2b39]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:50:15 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1f796e0-9e22-4f71-aa7e-a7a4d7f7db92]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:50:15 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7a1611f3-2976-4f80-9f23-67bf14db402e tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Running cmd (subprocess): nvme version {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:50:15 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7a1611f3-2976-4f80-9f23-67bf14db402e tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] 'nvme version' failed. Not Retrying. {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 15:50:15 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7a1611f3-2976-4f80-9f23-67bf14db402e tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] nvme not present on system {{(pid=75176) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 15:50:15 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:50:15 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 15:50:15 user nova-compute[75176]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 15:50:15 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[b31061b6-57be-42f3-9d4e-fb5e19eaf9d3]: (4, '') {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:50:15 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.lightos [None req-7a1611f3-2976-4f80-9f23-67bf14db402e tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75176) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 15:50:15 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.lightos [None req-7a1611f3-2976-4f80-9f23-67bf14db402e tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75176) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 15:50:15 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.lightos [None req-7a1611f3-2976-4f80-9f23-67bf14db402e tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] LIGHTOS: no hostnqn found. {{(pid=75176) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 15:50:15 user nova-compute[75176]: DEBUG os_brick.utils [None req-7a1611f3-2976-4f80-9f23-67bf14db402e tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:edc924a949b2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 15:50:15 user nova-compute[75176]: DEBUG nova.virt.block_device [None req-7a1611f3-2976-4f80-9f23-67bf14db402e tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] [instance: 6d061df5-8dbc-4fc1-9935-d46efc934b58] Updating existing volume attachment record: 727d33b4-56c5-4dce-959c-ad91e2f01a76 {{(pid=75176) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 15:50:17 user nova-compute[75176]: DEBUG os_brick.utils [None req-51d95862-bb17-4db3-abbe-78d0643cfa59 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 15:50:17 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:50:17 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:50:17 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2468014-1b7d-4e31-9494-69b068266cd0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:edc924a949b2\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:50:17 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:50:17 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:50:17 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[462181b9-c966-4d44-ba57-3e67cb7c1f76]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:50:17 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:50:17 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:50:17 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2638bd5-72c6-4677-b666-ea6a6658c8be]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:50:17 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ede592f-d651-4f13-9876-8de0a355e5c2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:50:17 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-51d95862-bb17-4db3-abbe-78d0643cfa59 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Running cmd (subprocess): nvme version {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:50:18 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-51d95862-bb17-4db3-abbe-78d0643cfa59 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] 'nvme version' failed. Not Retrying. {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 15:50:18 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.nvmeof [None req-51d95862-bb17-4db3-abbe-78d0643cfa59 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] nvme not present on system {{(pid=75176) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 15:50:18 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:50:18 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 15:50:18 user nova-compute[75176]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 15:50:18 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[6122a066-c9e8-4c46-aa08-466951374986]: (4, '') {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:50:18 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.lightos [None req-51d95862-bb17-4db3-abbe-78d0643cfa59 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75176) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 15:50:18 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.lightos [None req-51d95862-bb17-4db3-abbe-78d0643cfa59 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75176) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 15:50:18 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.lightos [None req-51d95862-bb17-4db3-abbe-78d0643cfa59 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] LIGHTOS: no hostnqn found. {{(pid=75176) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 15:50:18 user nova-compute[75176]: DEBUG os_brick.utils [None req-51d95862-bb17-4db3-abbe-78d0643cfa59 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:edc924a949b2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 15:50:18 user nova-compute[75176]: DEBUG nova.virt.block_device [None req-51d95862-bb17-4db3-abbe-78d0643cfa59 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: e8b9c885-42ba-4f74-86b2-d091ebd08ed5] Updating existing volume attachment record: 1bf23b13-fce2-4364-a428-ec96673c4dd7 {{(pid=75176) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 15:50:19 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:50:19 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-4bf3a351-6e94-4e35-b361-bf620fd99ed6 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:50:19 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-4bf3a351-6e94-4e35-b361-bf620fd99ed6 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:50:19 user nova-compute[75176]: DEBUG nova.objects.instance [None req-4bf3a351-6e94-4e35-b361-bf620fd99ed6 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Lazy-loading 'pci_requests' on Instance uuid 0e465c9f-e8ab-4a28-bf74-2936a272a0e2 {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:50:19 user nova-compute[75176]: DEBUG nova.objects.instance [None req-4bf3a351-6e94-4e35-b361-bf620fd99ed6 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Lazy-loading 'numa_topology' on Instance uuid 0e465c9f-e8ab-4a28-bf74-2936a272a0e2 {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:50:19 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-4bf3a351-6e94-4e35-b361-bf620fd99ed6 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75176) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 15:50:19 user nova-compute[75176]: INFO nova.compute.claims [None req-4bf3a351-6e94-4e35-b361-bf620fd99ed6 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] [instance: 0e465c9f-e8ab-4a28-bf74-2936a272a0e2] Claim successful on node user
Nov 28 15:50:20 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:50:20 user nova-compute[75176]: DEBUG nova.compute.provider_tree [None req-4bf3a351-6e94-4e35-b361-bf620fd99ed6 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Inventory has not changed in ProviderTree for provider: b37848d8-f401-4155-a029-b0ffa09ff85b {{(pid=75176) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 15:50:20 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-4bf3a351-6e94-4e35-b361-bf620fd99ed6 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Inventory has not changed for provider b37848d8-f401-4155-a029-b0ffa09ff85b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75176) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 15:50:20 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-4bf3a351-6e94-4e35-b361-bf620fd99ed6 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.479s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:50:20 user nova-compute[75176]: INFO nova.network.neutron [None req-4bf3a351-6e94-4e35-b361-bf620fd99ed6 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] [instance: 0e465c9f-e8ab-4a28-bf74-2936a272a0e2] Updating port 86effed2-558e-4427-82be-761ca28e6d8c with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 28 15:50:21 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-4bf3a351-6e94-4e35-b361-bf620fd99ed6 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Acquiring lock "refresh_cache-0e465c9f-e8ab-4a28-bf74-2936a272a0e2" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:50:21 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-4bf3a351-6e94-4e35-b361-bf620fd99ed6 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Acquired lock "refresh_cache-0e465c9f-e8ab-4a28-bf74-2936a272a0e2" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:50:21 user nova-compute[75176]: DEBUG nova.network.neutron [None req-4bf3a351-6e94-4e35-b361-bf620fd99ed6 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] [instance: 0e465c9f-e8ab-4a28-bf74-2936a272a0e2] Building network info cache for instance {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 15:50:21 user nova-compute[75176]: DEBUG nova.compute.manager [req-d56631cb-73b1-436c-8d43-d1ba9c9f411b req-4e2af9d0-59eb-47c1-971d-d79883e56006 service nova] [instance: 0e465c9f-e8ab-4a28-bf74-2936a272a0e2] Received event network-changed-86effed2-558e-4427-82be-761ca28e6d8c {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:50:21 user nova-compute[75176]: DEBUG nova.compute.manager [req-d56631cb-73b1-436c-8d43-d1ba9c9f411b req-4e2af9d0-59eb-47c1-971d-d79883e56006 service nova] [instance: 0e465c9f-e8ab-4a28-bf74-2936a272a0e2] Refreshing instance network info cache due to event network-changed-86effed2-558e-4427-82be-761ca28e6d8c. {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 15:50:21 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-d56631cb-73b1-436c-8d43-d1ba9c9f411b req-4e2af9d0-59eb-47c1-971d-d79883e56006 service nova] Acquiring lock "refresh_cache-0e465c9f-e8ab-4a28-bf74-2936a272a0e2" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:50:21 user nova-compute[75176]: DEBUG nova.network.neutron [None req-4bf3a351-6e94-4e35-b361-bf620fd99ed6 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] [instance: 0e465c9f-e8ab-4a28-bf74-2936a272a0e2] Updating instance_info_cache with network_info: [{"id": "86effed2-558e-4427-82be-761ca28e6d8c", "address": "fa:16:3e:95:66:57", "network": {"id": "5d0ae041-a67d-4a54-bd53-104c4f44209d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-938551772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "169fdaea89d4431aa6adacdbb76f3546", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86effed2-55", "ovs_interfaceid": "86effed2-558e-4427-82be-761ca28e6d8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:50:21 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-4bf3a351-6e94-4e35-b361-bf620fd99ed6 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Releasing lock "refresh_cache-0e465c9f-e8ab-4a28-bf74-2936a272a0e2" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:50:21 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-4bf3a351-6e94-4e35-b361-bf620fd99ed6 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] [instance: 0e465c9f-e8ab-4a28-bf74-2936a272a0e2] Creating instance directory {{(pid=75176) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 15:50:21 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-4bf3a351-6e94-4e35-b361-bf620fd99ed6 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] [instance: 0e465c9f-e8ab-4a28-bf74-2936a272a0e2] Creating image(s)
Nov 28 15:50:21 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-4bf3a351-6e94-4e35-b361-bf620fd99ed6 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Acquiring lock "/opt/stack/data/nova/instances/0e465c9f-e8ab-4a28-bf74-2936a272a0e2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:50:21 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-4bf3a351-6e94-4e35-b361-bf620fd99ed6 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Lock "/opt/stack/data/nova/instances/0e465c9f-e8ab-4a28-bf74-2936a272a0e2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:50:21 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-4bf3a351-6e94-4e35-b361-bf620fd99ed6 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Lock "/opt/stack/data/nova/instances/0e465c9f-e8ab-4a28-bf74-2936a272a0e2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:50:21 user nova-compute[75176]: DEBUG nova.objects.instance [None req-4bf3a351-6e94-4e35-b361-bf620fd99ed6 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Lazy-loading 'trusted_certs' on Instance uuid 0e465c9f-e8ab-4a28-bf74-2936a272a0e2 {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:50:21 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-d56631cb-73b1-436c-8d43-d1ba9c9f411b req-4e2af9d0-59eb-47c1-971d-d79883e56006 service nova] Acquired lock "refresh_cache-0e465c9f-e8ab-4a28-bf74-2936a272a0e2" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:50:21 user nova-compute[75176]: DEBUG nova.network.neutron [req-d56631cb-73b1-436c-8d43-d1ba9c9f411b req-4e2af9d0-59eb-47c1-971d-d79883e56006 service nova] [instance: 0e465c9f-e8ab-4a28-bf74-2936a272a0e2] Refreshing network info cache for port 86effed2-558e-4427-82be-761ca28e6d8c {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 15:50:21 user nova-compute[75176]: DEBUG nova.objects.base [None req-4bf3a351-6e94-4e35-b361-bf620fd99ed6 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Object Instance<0e465c9f-e8ab-4a28-bf74-2936a272a0e2> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=75176) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 15:50:21 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-4bf3a351-6e94-4e35-b361-bf620fd99ed6 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Acquiring lock "4b0340fffc5d9270b5c1dc2181ab32ed03e4df1f" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:50:21 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-4bf3a351-6e94-4e35-b361-bf620fd99ed6 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Lock "4b0340fffc5d9270b5c1dc2181ab32ed03e4df1f" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:50:22 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-4bf3a351-6e94-4e35-b361-bf620fd99ed6 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4b0340fffc5d9270b5c1dc2181ab32ed03e4df1f.part --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:50:22 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7a1611f3-2976-4f80-9f23-67bf14db402e tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] [instance: 6d061df5-8dbc-4fc1-9935-d46efc934b58] Calling os-brick to attach iSCSI Volume {{(pid=75176) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 15:50:22 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a1611f3-2976-4f80-9f23-67bf14db402e tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c1b8a00>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:370d91ef-d3c5-4019-b447-3f8134556e11', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CrMsKZpx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 15:50:22 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-7a1611f3-2976-4f80-9f23-67bf14db402e tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 15:50:22 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-7a1611f3-2976-4f80-9f23-67bf14db402e tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 15:50:22 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-7a1611f3-2976-4f80-9f23-67bf14db402e tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 15:50:22 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-7a1611f3-2976-4f80-9f23-67bf14db402e tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 15:50:22 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-7a1611f3-2976-4f80-9f23-67bf14db402e tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:370d91ef-d3c5-4019-b447-3f8134556e11" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 15:50:22 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-7a1611f3-2976-4f80-9f23-67bf14db402e tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:370d91ef-d3c5-4019-b447-3f8134556e11" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 15:50:22 user nova-compute[75176]: INFO os_brick.initiator.connectors.iscsi [None req-7a1611f3-2976-4f80-9f23-67bf14db402e tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 15:50:22 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:370d91ef-d3c5-4019-b447-3f8134556e11 -p 172.16.0.220:3260 {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:50:22 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:370d91ef-d3c5-4019-b447-3f8134556e11 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:50:22 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[545af8bc-021e-4612-97e0-88499fab9464]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:50:22 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a1611f3-2976-4f80-9f23-67bf14db402e tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 15:50:22 user nova-compute[75176]:  {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:50:22 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:370d91ef-d3c5-4019-b447-3f8134556e11 -p 172.16.0.220:3260 --interface default --op new {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:50:22 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:370d91ef-d3c5-4019-b447-3f8134556e11 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:50:22 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[511d44c6-77d0-48f0-b0a5-aae78ca0b25c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:370d91ef-d3c5-4019-b447-3f8134556e11] added\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:50:22 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a1611f3-2976-4f80-9f23-67bf14db402e tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:370d91ef-d3c5-4019-b447-3f8134556e11] added
Nov 28 15:50:22 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:50:22 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:370d91ef-d3c5-4019-b447-3f8134556e11 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:50:22 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-4bf3a351-6e94-4e35-b361-bf620fd99ed6 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4b0340fffc5d9270b5c1dc2181ab32ed03e4df1f.part --force-share --output=json" returned: 0 in 0.196s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:50:22 user nova-compute[75176]: DEBUG nova.virt.images [None req-4bf3a351-6e94-4e35-b361-bf620fd99ed6 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] 835977a9-d2bb-48e3-aede-ee974513e28e was qcow2, converting to raw {{(pid=75176) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 28 15:50:22 user nova-compute[75176]: DEBUG nova.privsep.utils [None req-4bf3a351-6e94-4e35-b361-bf620fd99ed6 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75176) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 28 15:50:22 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-4bf3a351-6e94-4e35-b361-bf620fd99ed6 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/4b0340fffc5d9270b5c1dc2181ab32ed03e4df1f.part /opt/stack/data/nova/instances/_base/4b0340fffc5d9270b5c1dc2181ab32ed03e4df1f.converted {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:50:22 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:370d91ef-d3c5-4019-b447-3f8134556e11 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:50:22 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dbe6ce3-a6df-4f47-a43a-3081ff1368be]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:50:22 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a1611f3-2976-4f80-9f23-67bf14db402e tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:50:22 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:370d91ef-d3c5-4019-b447-3f8134556e11 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:50:22 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:370d91ef-d3c5-4019-b447-3f8134556e11 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:50:22 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e27b95f-382f-4a3d-9d1f-81dc0bd9628b]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:50:22 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a1611f3-2976-4f80-9f23-67bf14db402e tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:50:22 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:370d91ef-d3c5-4019-b447-3f8134556e11 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CrMsKZpx {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:50:23 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:370d91ef-d3c5-4019-b447-3f8134556e11 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CrMsKZpx" returned: 0 in 0.052s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:50:23 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ad1bed8-be0f-4417-85e3-c639e3b01604]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:50:23 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a1611f3-2976-4f80-9f23-67bf14db402e tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CrMsKZpx'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:50:23 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:370d91ef-d3c5-4019-b447-3f8134556e11 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:50:23 user nova-compute[75176]: DEBUG nova.network.neutron [req-d56631cb-73b1-436c-8d43-d1ba9c9f411b req-4e2af9d0-59eb-47c1-971d-d79883e56006 service nova] [instance: 0e465c9f-e8ab-4a28-bf74-2936a272a0e2] Updated VIF entry in instance network info cache for port 86effed2-558e-4427-82be-761ca28e6d8c. {{(pid=75176) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 15:50:23 user nova-compute[75176]: DEBUG nova.network.neutron [req-d56631cb-73b1-436c-8d43-d1ba9c9f411b req-4e2af9d0-59eb-47c1-971d-d79883e56006 service nova] [instance: 0e465c9f-e8ab-4a28-bf74-2936a272a0e2] Updating instance_info_cache with network_info: [{"id": "86effed2-558e-4427-82be-761ca28e6d8c", "address": "fa:16:3e:95:66:57", "network": {"id": "5d0ae041-a67d-4a54-bd53-104c4f44209d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-938551772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "169fdaea89d4431aa6adacdbb76f3546", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86effed2-55", "ovs_interfaceid": "86effed2-558e-4427-82be-761ca28e6d8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:50:23 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:370d91ef-d3c5-4019-b447-3f8134556e11 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.053s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:50:23 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[001963f2-3cd8-41d9-8416-8dc1a5b304f6]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:50:23 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a1611f3-2976-4f80-9f23-67bf14db402e tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:50:23 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:50:23 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-d56631cb-73b1-436c-8d43-d1ba9c9f411b req-4e2af9d0-59eb-47c1-971d-d79883e56006 service nova] Releasing lock "refresh_cache-0e465c9f-e8ab-4a28-bf74-2936a272a0e2" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:50:23 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:50:23 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[7071cebb-51d1-492f-8b17-f3c44db0db33]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8452525c-6845-4edb-bf69-1e2ffe0ef2eb (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36b14046-bbe0-45c6-add0-ab16578b41d3 (non-flash)\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:50:23 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a1611f3-2976-4f80-9f23-67bf14db402e tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8452525c-6845-4edb-bf69-1e2ffe0ef2eb (non-flash)
Nov 28 15:50:23 user nova-compute[75176]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36b14046-bbe0-45c6-add0-ab16578b41d3 (non-flash)
Nov 28 15:50:23 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:50:23 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a1611f3-2976-4f80-9f23-67bf14db402e tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8452525c-6845-4edb-bf69-1e2ffe0ef2eb (non-flash)
Nov 28 15:50:23 user nova-compute[75176]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36b14046-bbe0-45c6-add0-ab16578b41d3 (non-flash)
Nov 28 15:50:23 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 15:50:23 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:370d91ef-d3c5-4019-b447-3f8134556e11 -p 172.16.0.220:3260 --login {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:50:23 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:370d91ef-d3c5-4019-b447-3f8134556e11 -p 172.16.0.220:3260 --login" returned: 0 in 0.087s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:50:23 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[3616db8c-69a3-444a-ba14-f2b8175e44e9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:370d91ef-d3c5-4019-b447-3f8134556e11, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:370d91ef-d3c5-4019-b447-3f8134556e11, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:50:23 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a1611f3-2976-4f80-9f23-67bf14db402e tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:370d91ef-d3c5-4019-b447-3f8134556e11, portal: 172.16.0.220,3260]
Nov 28 15:50:23 user nova-compute[75176]: Login to [iface: default, target: iqn.2010-10.org.openstack:370d91ef-d3c5-4019-b447-3f8134556e11, portal: 172.16.0.220,3260] successful.
Nov 28 15:50:23 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:50:23 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:370d91ef-d3c5-4019-b447-3f8134556e11 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:50:23 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:370d91ef-d3c5-4019-b447-3f8134556e11 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.125s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:50:23 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac34e3dd-7ad2-4a3e-a251-2cd20f11c154]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:50:23 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a1611f3-2976-4f80-9f23-67bf14db402e tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:50:23 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:50:23 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:50:23 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca93482d-9a47-478d-8da0-5485daf65a9b]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8452525c-6845-4edb-bf69-1e2ffe0ef2eb (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36b14046-bbe0-45c6-add0-ab16578b41d3 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:370d91ef-d3c5-4019-b447-3f8134556e11 (non-flash)\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:50:23 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a1611f3-2976-4f80-9f23-67bf14db402e tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8452525c-6845-4edb-bf69-1e2ffe0ef2eb (non-flash)
Nov 28 15:50:23 user nova-compute[75176]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36b14046-bbe0-45c6-add0-ab16578b41d3 (non-flash)
Nov 28 15:50:23 user nova-compute[75176]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:370d91ef-d3c5-4019-b447-3f8134556e11 (non-flash)
Nov 28 15:50:23 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:50:23 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a1611f3-2976-4f80-9f23-67bf14db402e tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8452525c-6845-4edb-bf69-1e2ffe0ef2eb (non-flash)
Nov 28 15:50:23 user nova-compute[75176]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36b14046-bbe0-45c6-add0-ab16578b41d3 (non-flash)
Nov 28 15:50:23 user nova-compute[75176]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:370d91ef-d3c5-4019-b447-3f8134556e11 (non-flash)
Nov 28 15:50:23 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 15:50:23 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-7a1611f3-2976-4f80-9f23-67bf14db402e tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:370d91ef-d3c5-4019-b447-3f8134556e11" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.534s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 15:50:23 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a1611f3-2976-4f80-9f23-67bf14db402e tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Connected to 172.16.0.220:3260 {{(pid=75176) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 15:50:23 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-7a1611f3-2976-4f80-9f23-67bf14db402e tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] HCTL ('33', '-', '-', 0) found on session 34 with lun 0 {{(pid=75176) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 15:50:23 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-7a1611f3-2976-4f80-9f23-67bf14db402e tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75176) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 15:50:23 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:50:23 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-4bf3a351-6e94-4e35-b361-bf620fd99ed6 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/4b0340fffc5d9270b5c1dc2181ab32ed03e4df1f.part /opt/stack/data/nova/instances/_base/4b0340fffc5d9270b5c1dc2181ab32ed03e4df1f.converted" returned: 0 in 0.481s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:50:23 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-4bf3a351-6e94-4e35-b361-bf620fd99ed6 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4b0340fffc5d9270b5c1dc2181ab32ed03e4df1f.converted --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:50:23 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.022s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:50:23 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e3e8cae-76e0-4680-930f-e3e04ea7661e]: (4, ('- - 0', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:50:23 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-7a1611f3-2976-4f80-9f23-67bf14db402e tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Searching for a device in session 34 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75176) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 15:50:23 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a1611f3-2976-4f80-9f23-67bf14db402e tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:370d91ef-d3c5-4019-b447-3f8134556e11', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CrMsKZpx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75176) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 15:50:23 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-4bf3a351-6e94-4e35-b361-bf620fd99ed6 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4b0340fffc5d9270b5c1dc2181ab32ed03e4df1f.converted --force-share --output=json" returned: 0 in 0.180s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:50:23 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-4bf3a351-6e94-4e35-b361-bf620fd99ed6 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Lock "4b0340fffc5d9270b5c1dc2181ab32ed03e4df1f" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.900s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:50:23 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-4bf3a351-6e94-4e35-b361-bf620fd99ed6 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4b0340fffc5d9270b5c1dc2181ab32ed03e4df1f --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:50:23 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-4bf3a351-6e94-4e35-b361-bf620fd99ed6 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4b0340fffc5d9270b5c1dc2181ab32ed03e4df1f --force-share --output=json" returned: 0 in 0.186s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:50:23 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-4bf3a351-6e94-4e35-b361-bf620fd99ed6 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Acquiring lock "4b0340fffc5d9270b5c1dc2181ab32ed03e4df1f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:50:23 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-4bf3a351-6e94-4e35-b361-bf620fd99ed6 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Lock "4b0340fffc5d9270b5c1dc2181ab32ed03e4df1f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:50:23 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-4bf3a351-6e94-4e35-b361-bf620fd99ed6 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4b0340fffc5d9270b5c1dc2181ab32ed03e4df1f --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:50:23 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-4bf3a351-6e94-4e35-b361-bf620fd99ed6 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4b0340fffc5d9270b5c1dc2181ab32ed03e4df1f --force-share --output=json" returned: 0 in 0.178s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:50:23 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-4bf3a351-6e94-4e35-b361-bf620fd99ed6 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4b0340fffc5d9270b5c1dc2181ab32ed03e4df1f,backing_fmt=raw /opt/stack/data/nova/instances/0e465c9f-e8ab-4a28-bf74-2936a272a0e2/disk 1073741824 {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:50:24 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:50:24 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-4bf3a351-6e94-4e35-b361-bf620fd99ed6 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4b0340fffc5d9270b5c1dc2181ab32ed03e4df1f,backing_fmt=raw /opt/stack/data/nova/instances/0e465c9f-e8ab-4a28-bf74-2936a272a0e2/disk 1073741824" returned: 0 in 0.145s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:50:24 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-4bf3a351-6e94-4e35-b361-bf620fd99ed6 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Lock "4b0340fffc5d9270b5c1dc2181ab32ed03e4df1f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.329s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:50:24 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-4bf3a351-6e94-4e35-b361-bf620fd99ed6 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4b0340fffc5d9270b5c1dc2181ab32ed03e4df1f --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:50:24 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-4bf3a351-6e94-4e35-b361-bf620fd99ed6 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4b0340fffc5d9270b5c1dc2181ab32ed03e4df1f --force-share --output=json" returned: 0 in 0.174s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:50:24 user nova-compute[75176]: DEBUG nova.objects.instance [None req-4bf3a351-6e94-4e35-b361-bf620fd99ed6 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Lazy-loading 'migration_context' on Instance uuid 0e465c9f-e8ab-4a28-bf74-2936a272a0e2 {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:50:24 user nova-compute[75176]: DEBUG nova.objects.base [None req-4bf3a351-6e94-4e35-b361-bf620fd99ed6 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Object Instance<0e465c9f-e8ab-4a28-bf74-2936a272a0e2> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=75176) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 15:50:24 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-4bf3a351-6e94-4e35-b361-bf620fd99ed6 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] [instance: 0e465c9f-e8ab-4a28-bf74-2936a272a0e2] Rebasing disk image.
Nov 28 15:50:24 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-4bf3a351-6e94-4e35-b361-bf620fd99ed6 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:50:24 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-7a1611f3-2976-4f80-9f23-67bf14db402e tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.627s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 15:50:24 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a1611f3-2976-4f80-9f23-67bf14db402e tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] <== connect_volume: return (1631ms) {'type': 'block', 'scsi_wwn': '26631346634313033', 'path': '/dev/sdb'} {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 15:50:24 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7a1611f3-2976-4f80-9f23-67bf14db402e tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] [instance: 6d061df5-8dbc-4fc1-9935-d46efc934b58] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26631346634313033', 'path': '/dev/sdb'} {{(pid=75176) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 15:50:24 user nova-compute[75176]: DEBUG nova.objects.instance [None req-7a1611f3-2976-4f80-9f23-67bf14db402e tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Lazy-loading 'flavor' on Instance uuid 6d061df5-8dbc-4fc1-9935-d46efc934b58 {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:50:24 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-4bf3a351-6e94-4e35-b361-bf620fd99ed6 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json" returned: 0 in 0.171s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:50:24 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-4bf3a351-6e94-4e35-b361-bf620fd99ed6 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 -F raw /opt/stack/data/nova/instances/0e465c9f-e8ab-4a28-bf74-2936a272a0e2/disk {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:50:24 user nova-compute[75176]: DEBUG nova.virt.libvirt.guest [None req-7a1611f3-2976-4f80-9f23-67bf14db402e tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 15:50:24 user nova-compute[75176]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 15:50:24 user nova-compute[75176]:   <source dev="/dev/sdb"/>
Nov 28 15:50:24 user nova-compute[75176]:   <target dev="vdb" bus="virtio"/>
Nov 28 15:50:24 user nova-compute[75176]:   <serial>370d91ef-d3c5-4019-b447-3f8134556e11</serial>
Nov 28 15:50:24 user nova-compute[75176]: </disk>
Nov 28 15:50:24 user nova-compute[75176]:  {{(pid=75176) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 15:50:24 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-7a1611f3-2976-4f80-9f23-67bf14db402e tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] No BDM found with device name vda, not building metadata. {{(pid=75176) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 15:50:24 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-7a1611f3-2976-4f80-9f23-67bf14db402e tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75176) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 15:50:24 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-7a1611f3-2976-4f80-9f23-67bf14db402e tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] No VIF found with MAC fa:16:3e:31:cd:96, not building metadata {{(pid=75176) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 15:50:25 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7a1611f3-2976-4f80-9f23-67bf14db402e tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Lock "6d061df5-8dbc-4fc1-9935-d46efc934b58" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.686s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:50:25 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:50:25 user nova-compute[75176]: DEBUG nova.compute.manager [None req-51d95862-bb17-4db3-abbe-78d0643cfa59 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: e8b9c885-42ba-4f74-86b2-d091ebd08ed5] Start spawning the instance on the hypervisor. {{(pid=75176) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 15:50:25 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-51d95862-bb17-4db3-abbe-78d0643cfa59 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: e8b9c885-42ba-4f74-86b2-d091ebd08ed5] Creating instance directory {{(pid=75176) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 15:50:25 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-51d95862-bb17-4db3-abbe-78d0643cfa59 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: e8b9c885-42ba-4f74-86b2-d091ebd08ed5] Creating image(s)
Nov 28 15:50:25 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-51d95862-bb17-4db3-abbe-78d0643cfa59 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: e8b9c885-42ba-4f74-86b2-d091ebd08ed5] Did not create local disks {{(pid=75176) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 28 15:50:25 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-51d95862-bb17-4db3-abbe-78d0643cfa59 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: e8b9c885-42ba-4f74-86b2-d091ebd08ed5] Ensure instance console log exists: /opt/stack/data/nova/instances/e8b9c885-42ba-4f74-86b2-d091ebd08ed5/console.log {{(pid=75176) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 15:50:25 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-51d95862-bb17-4db3-abbe-78d0643cfa59 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:50:25 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-51d95862-bb17-4db3-abbe-78d0643cfa59 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:50:25 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-51d95862-bb17-4db3-abbe-78d0643cfa59 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:50:25 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-51d95862-bb17-4db3-abbe-78d0643cfa59 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: e8b9c885-42ba-4f74-86b2-d091ebd08ed5] Start _get_guest_xml network_info=[{"id": "62fa1256-2b2c-4740-b93c-9e98a0a738f8", "address": "fa:16:3e:a4:c5:51", "network": {"id": "5ec264ad-3459-468c-bdbf-c6a4ef016951", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1574289626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07c7783cc16049208421204910982c79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62fa1256-2b", "ovs_interfaceid": "62fa1256-2b2c-4740-b93c-9e98a0a738f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-28T15:50:07Z,direct_url=<?>,disk_format='qcow2',id=eb338f00-fd5b-4aea-be71-a4b5c50587a4,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-684158633',owner='07c7783cc16049208421204910982c79',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-28T15:50:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:21587566-b951-4b3e-8024-b6c2d2da35af', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sApFNrwe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e8b9c885-42ba-4f74-86b2-d091ebd08ed5', 'attached_at': '', 'detached_at': '', 'volume_id': '21587566-b951-4b3e-8024-b6c2d2da35af', 'serial': '21587566-b951-4b3e-8024-b6c2d2da35af'}, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'delete_on_termination': True, 'mount_device': '/dev/vda', 'attachment_id': '1bf23b13-fce2-4364-a428-ec96673c4dd7', 'volume_type': None} {{(pid=75176) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 15:50:25 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-51d95862-bb17-4db3-abbe-78d0643cfa59 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 15:50:25 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-51d95862-bb17-4db3-abbe-78d0643cfa59 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 15:50:25 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-51d95862-bb17-4db3-abbe-78d0643cfa59 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75176) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 15:50:25 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-51d95862-bb17-4db3-abbe-78d0643cfa59 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] CPU controller missing on host. {{(pid=75176) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 15:50:25 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-51d95862-bb17-4db3-abbe-78d0643cfa59 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75176) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 15:50:25 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-51d95862-bb17-4db3-abbe-78d0643cfa59 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] CPU controller found on host. {{(pid=75176) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 15:50:25 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-51d95862-bb17-4db3-abbe-78d0643cfa59 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75176) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 15:50:25 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-51d95862-bb17-4db3-abbe-78d0643cfa59 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T15:35:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-28T15:50:07Z,direct_url=<?>,disk_format='qcow2',id=eb338f00-fd5b-4aea-be71-a4b5c50587a4,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-684158633',owner='07c7783cc16049208421204910982c79',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-28T15:50:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 15:50:25 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-51d95862-bb17-4db3-abbe-78d0643cfa59 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Flavor limits 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 15:50:25 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-51d95862-bb17-4db3-abbe-78d0643cfa59 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Image limits 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 15:50:25 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-51d95862-bb17-4db3-abbe-78d0643cfa59 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Flavor pref 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 15:50:25 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-51d95862-bb17-4db3-abbe-78d0643cfa59 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Image pref 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 15:50:25 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-51d95862-bb17-4db3-abbe-78d0643cfa59 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 15:50:25 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-51d95862-bb17-4db3-abbe-78d0643cfa59 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 15:50:25 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-51d95862-bb17-4db3-abbe-78d0643cfa59 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75176) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 15:50:25 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-51d95862-bb17-4db3-abbe-78d0643cfa59 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Got 1 possible topologies {{(pid=75176) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 15:50:25 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-51d95862-bb17-4db3-abbe-78d0643cfa59 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 15:50:25 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-51d95862-bb17-4db3-abbe-78d0643cfa59 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 15:50:25 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-51d95862-bb17-4db3-abbe-78d0643cfa59 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: e8b9c885-42ba-4f74-86b2-d091ebd08ed5] Calling os-brick to attach iSCSI Volume {{(pid=75176) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 15:50:25 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-51d95862-bb17-4db3-abbe-78d0643cfa59 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c1b8a00>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:21587566-b951-4b3e-8024-b6c2d2da35af', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sApFNrwe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 15:50:25 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-51d95862-bb17-4db3-abbe-78d0643cfa59 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 15:50:25 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-51d95862-bb17-4db3-abbe-78d0643cfa59 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 15:50:25 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-51d95862-bb17-4db3-abbe-78d0643cfa59 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 15:50:25 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-51d95862-bb17-4db3-abbe-78d0643cfa59 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 15:50:25 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-51d95862-bb17-4db3-abbe-78d0643cfa59 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:21587566-b951-4b3e-8024-b6c2d2da35af" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 15:50:25 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-51d95862-bb17-4db3-abbe-78d0643cfa59 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:21587566-b951-4b3e-8024-b6c2d2da35af" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 15:50:25 user nova-compute[75176]: INFO os_brick.initiator.connectors.iscsi [None req-51d95862-bb17-4db3-abbe-78d0643cfa59 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 15:50:25 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21587566-b951-4b3e-8024-b6c2d2da35af -p 172.16.0.220:3260 {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:50:25 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21587566-b951-4b3e-8024-b6c2d2da35af -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:50:25 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5854979-3667-4b09-ad09-ee638230f3bb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:50:25 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-51d95862-bb17-4db3-abbe-78d0643cfa59 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 15:50:25 user nova-compute[75176]:  {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:50:25 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21587566-b951-4b3e-8024-b6c2d2da35af -p 172.16.0.220:3260 --interface default --op new {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:50:25 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21587566-b951-4b3e-8024-b6c2d2da35af -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:50:25 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddf88dee-5acf-4dc2-814e-d1a5709b220a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:21587566-b951-4b3e-8024-b6c2d2da35af] added\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:50:25 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-51d95862-bb17-4db3-abbe-78d0643cfa59 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:21587566-b951-4b3e-8024-b6c2d2da35af] added
Nov 28 15:50:25 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:50:25 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21587566-b951-4b3e-8024-b6c2d2da35af -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:50:25 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21587566-b951-4b3e-8024-b6c2d2da35af -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.038s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:50:25 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[4343129b-6aec-4def-bd81-87f79f92c9f8]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:50:25 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-51d95862-bb17-4db3-abbe-78d0643cfa59 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:50:25 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21587566-b951-4b3e-8024-b6c2d2da35af -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:50:25 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21587566-b951-4b3e-8024-b6c2d2da35af -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:50:25 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfc457bf-ad01-4fc2-a010-3385a74a0998]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:50:25 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-51d95862-bb17-4db3-abbe-78d0643cfa59 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:50:25 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21587566-b951-4b3e-8024-b6c2d2da35af -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sApFNrwe {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:50:25 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21587566-b951-4b3e-8024-b6c2d2da35af -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sApFNrwe" returned: 0 in 0.131s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:50:25 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[e23e1480-b0fd-45e3-bfbd-a0a6ef9f37d7]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:50:25 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-51d95862-bb17-4db3-abbe-78d0643cfa59 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sApFNrwe'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:50:25 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21587566-b951-4b3e-8024-b6c2d2da35af -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:50:25 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21587566-b951-4b3e-8024-b6c2d2da35af -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.084s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:50:25 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[51671604-12eb-4168-a3f4-6aa24042f646]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:50:25 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-51d95862-bb17-4db3-abbe-78d0643cfa59 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:50:25 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:50:26 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:50:26 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[621a69ee-6807-4b41-b318-952d8f6f636e]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8452525c-6845-4edb-bf69-1e2ffe0ef2eb (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36b14046-bbe0-45c6-add0-ab16578b41d3 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:370d91ef-d3c5-4019-b447-3f8134556e11 (non-flash)\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:50:26 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-51d95862-bb17-4db3-abbe-78d0643cfa59 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8452525c-6845-4edb-bf69-1e2ffe0ef2eb (non-flash)
Nov 28 15:50:26 user nova-compute[75176]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36b14046-bbe0-45c6-add0-ab16578b41d3 (non-flash)
Nov 28 15:50:26 user nova-compute[75176]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:370d91ef-d3c5-4019-b447-3f8134556e11 (non-flash)
Nov 28 15:50:26 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:50:26 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-51d95862-bb17-4db3-abbe-78d0643cfa59 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8452525c-6845-4edb-bf69-1e2ffe0ef2eb (non-flash)
Nov 28 15:50:26 user nova-compute[75176]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36b14046-bbe0-45c6-add0-ab16578b41d3 (non-flash)
Nov 28 15:50:26 user nova-compute[75176]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:370d91ef-d3c5-4019-b447-3f8134556e11 (non-flash)
Nov 28 15:50:26 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 15:50:26 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21587566-b951-4b3e-8024-b6c2d2da35af -p 172.16.0.220:3260 --login {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:50:27 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21587566-b951-4b3e-8024-b6c2d2da35af -p 172.16.0.220:3260 --login" returned: 0 in 1.085s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:50:27 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9a8fc66-2d03-461b-8c85-6b9011a87e16]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:21587566-b951-4b3e-8024-b6c2d2da35af, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:21587566-b951-4b3e-8024-b6c2d2da35af, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:50:27 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-51d95862-bb17-4db3-abbe-78d0643cfa59 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:21587566-b951-4b3e-8024-b6c2d2da35af, portal: 172.16.0.220,3260]
Nov 28 15:50:27 user nova-compute[75176]: Login to [iface: default, target: iqn.2010-10.org.openstack:21587566-b951-4b3e-8024-b6c2d2da35af, portal: 172.16.0.220,3260] successful.
Nov 28 15:50:27 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:50:27 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21587566-b951-4b3e-8024-b6c2d2da35af -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:50:27 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21587566-b951-4b3e-8024-b6c2d2da35af -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:50:27 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[419c3eae-200e-4067-8442-170feda77891]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:50:27 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-51d95862-bb17-4db3-abbe-78d0643cfa59 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:50:27 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:50:27 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:50:27 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[432371f2-9d7f-41ce-8bee-b8e8c648b101]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8452525c-6845-4edb-bf69-1e2ffe0ef2eb (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36b14046-bbe0-45c6-add0-ab16578b41d3 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:370d91ef-d3c5-4019-b447-3f8134556e11 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21587566-b951-4b3e-8024-b6c2d2da35af (non-flash)\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:50:27 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-51d95862-bb17-4db3-abbe-78d0643cfa59 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8452525c-6845-4edb-bf69-1e2ffe0ef2eb (non-flash)
Nov 28 15:50:27 user nova-compute[75176]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36b14046-bbe0-45c6-add0-ab16578b41d3 (non-flash)
Nov 28 15:50:27 user nova-compute[75176]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:370d91ef-d3c5-4019-b447-3f8134556e11 (non-flash)
Nov 28 15:50:27 user nova-compute[75176]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21587566-b951-4b3e-8024-b6c2d2da35af (non-flash)
Nov 28 15:50:27 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:50:27 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-51d95862-bb17-4db3-abbe-78d0643cfa59 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8452525c-6845-4edb-bf69-1e2ffe0ef2eb (non-flash)
Nov 28 15:50:27 user nova-compute[75176]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36b14046-bbe0-45c6-add0-ab16578b41d3 (non-flash)
Nov 28 15:50:27 user nova-compute[75176]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:370d91ef-d3c5-4019-b447-3f8134556e11 (non-flash)
Nov 28 15:50:27 user nova-compute[75176]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21587566-b951-4b3e-8024-b6c2d2da35af (non-flash)
Nov 28 15:50:27 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 15:50:27 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-51d95862-bb17-4db3-abbe-78d0643cfa59 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:21587566-b951-4b3e-8024-b6c2d2da35af" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.544s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 15:50:27 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-51d95862-bb17-4db3-abbe-78d0643cfa59 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Connected to 172.16.0.220:3260 {{(pid=75176) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 15:50:27 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-51d95862-bb17-4db3-abbe-78d0643cfa59 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] HCTL ('35', '-', '-', 0) found on session 35 with lun 0 {{(pid=75176) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 15:50:27 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-51d95862-bb17-4db3-abbe-78d0643cfa59 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75176) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 15:50:27 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:50:27 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.032s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:50:27 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dab4bdd-1de5-4230-85a5-6a2951a3f142]: (4, ('- - 0', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:50:27 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-51d95862-bb17-4db3-abbe-78d0643cfa59 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Searching for a device in session 35 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75176) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 15:50:27 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-51d95862-bb17-4db3-abbe-78d0643cfa59 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:21587566-b951-4b3e-8024-b6c2d2da35af', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sApFNrwe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75176) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 15:50:27 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-4bf3a351-6e94-4e35-b361-bf620fd99ed6 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 -F raw /opt/stack/data/nova/instances/0e465c9f-e8ab-4a28-bf74-2936a272a0e2/disk" returned: 0 in 2.745s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:50:27 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-4bf3a351-6e94-4e35-b361-bf620fd99ed6 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] [instance: 0e465c9f-e8ab-4a28-bf74-2936a272a0e2] Created local disks {{(pid=75176) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 15:50:27 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-4bf3a351-6e94-4e35-b361-bf620fd99ed6 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] [instance: 0e465c9f-e8ab-4a28-bf74-2936a272a0e2] Ensure instance console log exists: /opt/stack/data/nova/instances/0e465c9f-e8ab-4a28-bf74-2936a272a0e2/console.log {{(pid=75176) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 15:50:27 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-4bf3a351-6e94-4e35-b361-bf620fd99ed6 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:50:27 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-4bf3a351-6e94-4e35-b361-bf620fd99ed6 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:50:27 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-4bf3a351-6e94-4e35-b361-bf620fd99ed6 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:50:27 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-4bf3a351-6e94-4e35-b361-bf620fd99ed6 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] [instance: 0e465c9f-e8ab-4a28-bf74-2936a272a0e2] Start _get_guest_xml network_info=[{"id": "86effed2-558e-4427-82be-761ca28e6d8c", "address": "fa:16:3e:95:66:57", "network": {"id": "5d0ae041-a67d-4a54-bd53-104c4f44209d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-938551772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "169fdaea89d4431aa6adacdbb76f3546", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86effed2-55", "ovs_interfaceid": "86effed2-558e-4427-82be-761ca28e6d8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='9ccef3929056c59fe2bfe02f30e9fa98',container_format='bare',created_at=2023-11-28T15:48:20Z,direct_url=<?>,disk_format='qcow2',id=835977a9-d2bb-48e3-aede-ee974513e28e,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-447740496-shelved',owner='169fdaea89d4431aa6adacdbb76f3546',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-28T15:48:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'size': 0, 'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'image_id': '1f41819e-c93f-4dc7-b253-37a27bbbbc74'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:07de7953-293c-4762-b695-ed3190c934d5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tdMblYUX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': '0e465c9f-e8ab-4a28-bf74-2936a272a0e2', 'attached_at': '', 'detached_at': '', 'volume_id': '07de7953-293c-4762-b695-ed3190c934d5', 'serial': '07de7953-293c-4762-b695-ed3190c934d5'}, 'guest_format': None, 'device_type': 'disk', 'boot_index': None, 'disk_bus': 'virtio', 'delete_on_termination': False, 'mount_device': '/dev/vdc', 'attachment_id': '193ef665-2555-4bb1-9a79-f77ca2afa6ba', 'volume_type': None} {{(pid=75176) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 15:50:27 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-4bf3a351-6e94-4e35-b361-bf620fd99ed6 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 15:50:27 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-4bf3a351-6e94-4e35-b361-bf620fd99ed6 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 15:50:27 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-4bf3a351-6e94-4e35-b361-bf620fd99ed6 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75176) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 15:50:27 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-4bf3a351-6e94-4e35-b361-bf620fd99ed6 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] CPU controller missing on host. {{(pid=75176) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 15:50:27 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-4bf3a351-6e94-4e35-b361-bf620fd99ed6 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75176) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 15:50:27 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-4bf3a351-6e94-4e35-b361-bf620fd99ed6 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] CPU controller found on host. {{(pid=75176) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 15:50:27 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-4bf3a351-6e94-4e35-b361-bf620fd99ed6 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75176) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 15:50:27 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-4bf3a351-6e94-4e35-b361-bf620fd99ed6 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T15:35:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='9ccef3929056c59fe2bfe02f30e9fa98',container_format='bare',created_at=2023-11-28T15:48:20Z,direct_url=<?>,disk_format='qcow2',id=835977a9-d2bb-48e3-aede-ee974513e28e,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-447740496-shelved',owner='169fdaea89d4431aa6adacdbb76f3546',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-28T15:48:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 15:50:27 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-4bf3a351-6e94-4e35-b361-bf620fd99ed6 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Flavor limits 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 15:50:27 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-4bf3a351-6e94-4e35-b361-bf620fd99ed6 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Image limits 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 15:50:27 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-4bf3a351-6e94-4e35-b361-bf620fd99ed6 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Flavor pref 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 15:50:27 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-4bf3a351-6e94-4e35-b361-bf620fd99ed6 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Image pref 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 15:50:27 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-4bf3a351-6e94-4e35-b361-bf620fd99ed6 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 15:50:27 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-4bf3a351-6e94-4e35-b361-bf620fd99ed6 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 15:50:27 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-4bf3a351-6e94-4e35-b361-bf620fd99ed6 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75176) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 15:50:27 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-4bf3a351-6e94-4e35-b361-bf620fd99ed6 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Got 1 possible topologies {{(pid=75176) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 15:50:27 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-4bf3a351-6e94-4e35-b361-bf620fd99ed6 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 15:50:27 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-4bf3a351-6e94-4e35-b361-bf620fd99ed6 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 15:50:27 user nova-compute[75176]: DEBUG nova.objects.instance [None req-4bf3a351-6e94-4e35-b361-bf620fd99ed6 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Lazy-loading 'vcpu_model' on Instance uuid 0e465c9f-e8ab-4a28-bf74-2936a272a0e2 {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:50:27 user nova-compute[75176]: DEBUG nova.objects.base [None req-4bf3a351-6e94-4e35-b361-bf620fd99ed6 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Object Instance<0e465c9f-e8ab-4a28-bf74-2936a272a0e2> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=75176) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 15:50:27 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4bf3a351-6e94-4e35-b361-bf620fd99ed6 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] [instance: 0e465c9f-e8ab-4a28-bf74-2936a272a0e2] Calling os-brick to attach iSCSI Volume {{(pid=75176) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 15:50:27 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bf3a351-6e94-4e35-b361-bf620fd99ed6 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c1b8a00>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:07de7953-293c-4762-b695-ed3190c934d5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tdMblYUX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 15:50:27 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-4bf3a351-6e94-4e35-b361-bf620fd99ed6 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 15:50:27 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-4bf3a351-6e94-4e35-b361-bf620fd99ed6 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 15:50:28 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-51d95862-bb17-4db3-abbe-78d0643cfa59 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.595s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 15:50:28 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-51d95862-bb17-4db3-abbe-78d0643cfa59 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] <== connect_volume: return (2598ms) {'type': 'block', 'scsi_wwn': '26632366630633139', 'path': '/dev/sdd'} {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 15:50:28 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-51d95862-bb17-4db3-abbe-78d0643cfa59 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: e8b9c885-42ba-4f74-86b2-d091ebd08ed5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26632366630633139', 'path': '/dev/sdd'} {{(pid=75176) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 15:50:28 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-4bf3a351-6e94-4e35-b361-bf620fd99ed6 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.882s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 15:50:28 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-4bf3a351-6e94-4e35-b361-bf620fd99ed6 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 15:50:28 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-4bf3a351-6e94-4e35-b361-bf620fd99ed6 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:07de7953-293c-4762-b695-ed3190c934d5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 15:50:28 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-4bf3a351-6e94-4e35-b361-bf620fd99ed6 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:07de7953-293c-4762-b695-ed3190c934d5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 15:50:28 user nova-compute[75176]: INFO os_brick.initiator.connectors.iscsi [None req-4bf3a351-6e94-4e35-b361-bf620fd99ed6 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 15:50:28 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07de7953-293c-4762-b695-ed3190c934d5 -p 172.16.0.220:3260 {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:50:28 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07de7953-293c-4762-b695-ed3190c934d5 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:50:28 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-51d95862-bb17-4db3-abbe-78d0643cfa59 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T15:50:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-270334912',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-270334912',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-270334912',id=33,image_ref='eb338f00-fd5b-4aea-be71-a4b5c50587a4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC+7of0XZ2pVt3UTAIB2O/FT+MuXYP9jChLC/UhmN4hFIqlf8XSIqfTRCD6jjN2Fp/f0rjgDE8+xXfdaq4hGvkqkZyvOmwWqBAtkdUVie2yexc6iZr/uNEiZVn4SwxQ2CQ==',key_name='tempest-keypair-1562696194',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='07c7783cc16049208421204910982c79',ramdisk_id='',reservation_id='r-hytihj8m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1695196118',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1695196118-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1695196118',owner_user_name='tempest-TestVolumeBootPattern-1695196118-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T15:50:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='081bf84d24194b81be4e0a6638db9b66',uuid=e8b9c885-42ba-4f74-86b2-d091ebd08ed5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "62fa1256-2b2c-4740-b93c-9e98a0a738f8", "address": "fa:16:3e:a4:c5:51", "network": {"id": "5ec264ad-3459-468c-bdbf-c6a4ef016951", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1574289626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07c7783cc16049208421204910982c79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62fa1256-2b", "ovs_interfaceid": "62fa1256-2b2c-4740-b93c-9e98a0a738f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75176) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 15:50:28 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-51d95862-bb17-4db3-abbe-78d0643cfa59 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Converting VIF {"id": "62fa1256-2b2c-4740-b93c-9e98a0a738f8", "address": "fa:16:3e:a4:c5:51", "network": {"id": "5ec264ad-3459-468c-bdbf-c6a4ef016951", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1574289626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07c7783cc16049208421204910982c79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62fa1256-2b", "ovs_interfaceid": "62fa1256-2b2c-4740-b93c-9e98a0a738f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:50:28 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-51d95862-bb17-4db3-abbe-78d0643cfa59 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:c5:51,bridge_name='br-int',has_traffic_filtering=True,id=62fa1256-2b2c-4740-b93c-9e98a0a738f8,network=Network(5ec264ad-3459-468c-bdbf-c6a4ef016951),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62fa1256-2b') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:50:28 user nova-compute[75176]: DEBUG nova.objects.instance [None req-51d95862-bb17-4db3-abbe-78d0643cfa59 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Lazy-loading 'pci_devices' on Instance uuid e8b9c885-42ba-4f74-86b2-d091ebd08ed5 {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:50:28 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b951446-fb1d-4bb8-abe0-fe2f6100de27]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:50:28 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bf3a351-6e94-4e35-b361-bf620fd99ed6 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 15:50:28 user nova-compute[75176]:  {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:50:28 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07de7953-293c-4762-b695-ed3190c934d5 -p 172.16.0.220:3260 --interface default --op new {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:50:28 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-51d95862-bb17-4db3-abbe-78d0643cfa59 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: e8b9c885-42ba-4f74-86b2-d091ebd08ed5] End _get_guest_xml xml=<domain type="kvm">
Nov 28 15:50:28 user nova-compute[75176]:   <uuid>e8b9c885-42ba-4f74-86b2-d091ebd08ed5</uuid>
Nov 28 15:50:28 user nova-compute[75176]:   <name>instance-00000021</name>
Nov 28 15:50:28 user nova-compute[75176]:   <memory>524288</memory>
Nov 28 15:50:28 user nova-compute[75176]:   <vcpu>1</vcpu>
Nov 28 15:50:28 user nova-compute[75176]:   <metadata>
Nov 28 15:50:28 user nova-compute[75176]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 15:50:28 user nova-compute[75176]:       <nova:package version="0.0.0"/>
Nov 28 15:50:28 user nova-compute[75176]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-270334912</nova:name>
Nov 28 15:50:28 user nova-compute[75176]:       <nova:creationTime>2023-11-28 15:50:25</nova:creationTime>
Nov 28 15:50:28 user nova-compute[75176]:       <nova:flavor name="m1.tiny">
Nov 28 15:50:28 user nova-compute[75176]:         <nova:memory>512</nova:memory>
Nov 28 15:50:28 user nova-compute[75176]:         <nova:disk>1</nova:disk>
Nov 28 15:50:28 user nova-compute[75176]:         <nova:swap>0</nova:swap>
Nov 28 15:50:28 user nova-compute[75176]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 15:50:28 user nova-compute[75176]:         <nova:vcpus>1</nova:vcpus>
Nov 28 15:50:28 user nova-compute[75176]:       </nova:flavor>
Nov 28 15:50:28 user nova-compute[75176]:       <nova:owner>
Nov 28 15:50:28 user nova-compute[75176]:         <nova:user uuid="081bf84d24194b81be4e0a6638db9b66">tempest-TestVolumeBootPattern-1695196118-project-member</nova:user>
Nov 28 15:50:28 user nova-compute[75176]:         <nova:project uuid="07c7783cc16049208421204910982c79">tempest-TestVolumeBootPattern-1695196118</nova:project>
Nov 28 15:50:28 user nova-compute[75176]:       </nova:owner>
Nov 28 15:50:28 user nova-compute[75176]:       <nova:root type="image" uuid="eb338f00-fd5b-4aea-be71-a4b5c50587a4"/>
Nov 28 15:50:28 user nova-compute[75176]:       <nova:ports>
Nov 28 15:50:28 user nova-compute[75176]:         <nova:port uuid="62fa1256-2b2c-4740-b93c-9e98a0a738f8">
Nov 28 15:50:28 user nova-compute[75176]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 28 15:50:28 user nova-compute[75176]:         </nova:port>
Nov 28 15:50:28 user nova-compute[75176]:       </nova:ports>
Nov 28 15:50:28 user nova-compute[75176]:     </nova:instance>
Nov 28 15:50:28 user nova-compute[75176]:   </metadata>
Nov 28 15:50:28 user nova-compute[75176]:   <sysinfo type="smbios">
Nov 28 15:50:28 user nova-compute[75176]:     <system>
Nov 28 15:50:28 user nova-compute[75176]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 15:50:28 user nova-compute[75176]:       <entry name="product">OpenStack Nova</entry>
Nov 28 15:50:28 user nova-compute[75176]:       <entry name="version">0.0.0</entry>
Nov 28 15:50:28 user nova-compute[75176]:       <entry name="serial">e8b9c885-42ba-4f74-86b2-d091ebd08ed5</entry>
Nov 28 15:50:28 user nova-compute[75176]:       <entry name="uuid">e8b9c885-42ba-4f74-86b2-d091ebd08ed5</entry>
Nov 28 15:50:28 user nova-compute[75176]:       <entry name="family">Virtual Machine</entry>
Nov 28 15:50:28 user nova-compute[75176]:     </system>
Nov 28 15:50:28 user nova-compute[75176]:   </sysinfo>
Nov 28 15:50:28 user nova-compute[75176]:   <os>
Nov 28 15:50:28 user nova-compute[75176]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 15:50:28 user nova-compute[75176]:     <boot dev="hd"/>
Nov 28 15:50:28 user nova-compute[75176]:     <smbios mode="sysinfo"/>
Nov 28 15:50:28 user nova-compute[75176]:   </os>
Nov 28 15:50:28 user nova-compute[75176]:   <features>
Nov 28 15:50:28 user nova-compute[75176]:     <acpi/>
Nov 28 15:50:28 user nova-compute[75176]:     <apic/>
Nov 28 15:50:28 user nova-compute[75176]:     <vmcoreinfo/>
Nov 28 15:50:28 user nova-compute[75176]:   </features>
Nov 28 15:50:28 user nova-compute[75176]:   <clock offset="utc">
Nov 28 15:50:28 user nova-compute[75176]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 15:50:28 user nova-compute[75176]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 15:50:28 user nova-compute[75176]:     <timer name="hpet" present="no"/>
Nov 28 15:50:28 user nova-compute[75176]:   </clock>
Nov 28 15:50:28 user nova-compute[75176]:   <cpu mode="custom" match="exact">
Nov 28 15:50:28 user nova-compute[75176]:     <model>Nehalem</model>
Nov 28 15:50:28 user nova-compute[75176]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 15:50:28 user nova-compute[75176]:   </cpu>
Nov 28 15:50:28 user nova-compute[75176]:   <devices>
Nov 28 15:50:28 user nova-compute[75176]:     <disk type="block" device="disk">
Nov 28 15:50:28 user nova-compute[75176]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 15:50:28 user nova-compute[75176]:       <source dev="/dev/sdd"/>
Nov 28 15:50:28 user nova-compute[75176]:       <target dev="vda" bus="virtio"/>
Nov 28 15:50:28 user nova-compute[75176]:       <serial>21587566-b951-4b3e-8024-b6c2d2da35af</serial>
Nov 28 15:50:28 user nova-compute[75176]:     </disk>
Nov 28 15:50:28 user nova-compute[75176]:     <interface type="ethernet">
Nov 28 15:50:28 user nova-compute[75176]:       <mac address="fa:16:3e:a4:c5:51"/>
Nov 28 15:50:28 user nova-compute[75176]:       <model type="virtio"/>
Nov 28 15:50:28 user nova-compute[75176]:       <mtu size="1442"/>
Nov 28 15:50:28 user nova-compute[75176]:       <target dev="tap62fa1256-2b"/>
Nov 28 15:50:28 user nova-compute[75176]:     </interface>
Nov 28 15:50:28 user nova-compute[75176]:     <serial type="pty">
Nov 28 15:50:28 user nova-compute[75176]:       <log file="/opt/stack/data/nova/instances/e8b9c885-42ba-4f74-86b2-d091ebd08ed5/console.log" append="off"/>
Nov 28 15:50:28 user nova-compute[75176]:     </serial>
Nov 28 15:50:28 user nova-compute[75176]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 15:50:28 user nova-compute[75176]:     <video>
Nov 28 15:50:28 user nova-compute[75176]:       <model type="virtio"/>
Nov 28 15:50:28 user nova-compute[75176]:     </video>
Nov 28 15:50:28 user nova-compute[75176]:     <rng model="virtio">
Nov 28 15:50:28 user nova-compute[75176]:       <backend model="random">/dev/urandom</backend>
Nov 28 15:50:28 user nova-compute[75176]:     </rng>
Nov 28 15:50:28 user nova-compute[75176]:     <controller type="usb" index="0" model="none"/>
Nov 28 15:50:28 user nova-compute[75176]:     <memballoon model="virtio">
Nov 28 15:50:28 user nova-compute[75176]:       <stats period="10"/>
Nov 28 15:50:28 user nova-compute[75176]:     </memballoon>
Nov 28 15:50:28 user nova-compute[75176]:   </devices>
Nov 28 15:50:28 user nova-compute[75176]: </domain>
Nov 28 15:50:28 user nova-compute[75176]:  {{(pid=75176) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 15:50:28 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-51d95862-bb17-4db3-abbe-78d0643cfa59 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T15:50:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-270334912',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-270334912',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-270334912',id=33,image_ref='eb338f00-fd5b-4aea-be71-a4b5c50587a4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC+7of0XZ2pVt3UTAIB2O/FT+MuXYP9jChLC/UhmN4hFIqlf8XSIqfTRCD6jjN2Fp/f0rjgDE8+xXfdaq4hGvkqkZyvOmwWqBAtkdUVie2yexc6iZr/uNEiZVn4SwxQ2CQ==',key_name='tempest-keypair-1562696194',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='07c7783cc16049208421204910982c79',ramdisk_id='',reservation_id='r-hytihj8m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1695196118',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1695196118-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1695196118',owner_user_name='tempest-TestVolumeBootPattern-1695196118-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T15:50:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='081bf84d24194b81be4e0a6638db9b66',uuid=e8b9c885-42ba-4f74-86b2-d091ebd08ed5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "62fa1256-2b2c-4740-b93c-9e98a0a738f8", "address": "fa:16:3e:a4:c5:51", "network": {"id": "5ec264ad-3459-468c-bdbf-c6a4ef016951", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1574289626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07c7783cc16049208421204910982c79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62fa1256-2b", "ovs_interfaceid": "62fa1256-2b2c-4740-b93c-9e98a0a738f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 15:50:28 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-51d95862-bb17-4db3-abbe-78d0643cfa59 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Converting VIF {"id": "62fa1256-2b2c-4740-b93c-9e98a0a738f8", "address": "fa:16:3e:a4:c5:51", "network": {"id": "5ec264ad-3459-468c-bdbf-c6a4ef016951", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1574289626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07c7783cc16049208421204910982c79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62fa1256-2b", "ovs_interfaceid": "62fa1256-2b2c-4740-b93c-9e98a0a738f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:50:28 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-51d95862-bb17-4db3-abbe-78d0643cfa59 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:c5:51,bridge_name='br-int',has_traffic_filtering=True,id=62fa1256-2b2c-4740-b93c-9e98a0a738f8,network=Network(5ec264ad-3459-468c-bdbf-c6a4ef016951),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62fa1256-2b') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:50:28 user nova-compute[75176]: DEBUG os_vif [None req-51d95862-bb17-4db3-abbe-78d0643cfa59 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:c5:51,bridge_name='br-int',has_traffic_filtering=True,id=62fa1256-2b2c-4740-b93c-9e98a0a738f8,network=Network(5ec264ad-3459-468c-bdbf-c6a4ef016951),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62fa1256-2b') {{(pid=75176) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 15:50:28 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:50:28 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:50:28 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 15:50:28 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:50:28 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '625e730f-9179-5123-8fc5-689e78d49d98', '_type': 'linux-noop'}}, row=False) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:50:28 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:50:28 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07de7953-293c-4762-b695-ed3190c934d5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:50:28 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[d55ae144-9c8c-49e8-aa9a-2dfe70fefae5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:07de7953-293c-4762-b695-ed3190c934d5] added\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:50:28 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bf3a351-6e94-4e35-b361-bf620fd99ed6 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:07de7953-293c-4762-b695-ed3190c934d5] added
Nov 28 15:50:28 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:50:28 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07de7953-293c-4762-b695-ed3190c934d5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:50:28 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:50:28 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap62fa1256-2b, may_exist=True, interface_attrs={}) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:50:28 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap62fa1256-2b, col_values=(('qos', UUID('4d6d6a94-77d7-4df5-8c9d-574889bf74c6')),), if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:50:28 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap62fa1256-2b, col_values=(('external_ids', {'iface-id': '62fa1256-2b2c-4740-b93c-9e98a0a738f8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a4:c5:51', 'vm-uuid': 'e8b9c885-42ba-4f74-86b2-d091ebd08ed5'}),), if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:50:28 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:50:28 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:50:28 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07de7953-293c-4762-b695-ed3190c934d5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:50:28 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[69a6a908-0605-4a42-85f7-aca8c3ddddd7]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:50:28 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bf3a351-6e94-4e35-b361-bf620fd99ed6 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:50:28 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:50:28 user nova-compute[75176]: INFO os_vif [None req-51d95862-bb17-4db3-abbe-78d0643cfa59 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:c5:51,bridge_name='br-int',has_traffic_filtering=True,id=62fa1256-2b2c-4740-b93c-9e98a0a738f8,network=Network(5ec264ad-3459-468c-bdbf-c6a4ef016951),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62fa1256-2b')
Nov 28 15:50:28 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07de7953-293c-4762-b695-ed3190c934d5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:50:28 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07de7953-293c-4762-b695-ed3190c934d5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:50:28 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f52a971-dc7a-4d30-adfb-ae08d8423731]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:50:28 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bf3a351-6e94-4e35-b361-bf620fd99ed6 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:50:28 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07de7953-293c-4762-b695-ed3190c934d5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tdMblYUX {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:50:28 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07de7953-293c-4762-b695-ed3190c934d5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tdMblYUX" returned: 0 in 0.017s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:50:28 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[f32ce5f8-56a8-441f-b3f5-9f4de6792d96]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:50:28 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bf3a351-6e94-4e35-b361-bf620fd99ed6 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tdMblYUX'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:50:28 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07de7953-293c-4762-b695-ed3190c934d5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:50:28 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07de7953-293c-4762-b695-ed3190c934d5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:50:28 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4f93c88-0476-4961-b84f-b5a5d6b1e3e2]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:50:28 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bf3a351-6e94-4e35-b361-bf620fd99ed6 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:50:28 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:50:28 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-51d95862-bb17-4db3-abbe-78d0643cfa59 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] No BDM found with device name vda, not building metadata. {{(pid=75176) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 15:50:28 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-51d95862-bb17-4db3-abbe-78d0643cfa59 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] No VIF found with MAC fa:16:3e:a4:c5:51, not building metadata {{(pid=75176) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 15:50:28 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:50:28 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e9fb31b-68bc-4b2a-97b9-c321026c9572]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8452525c-6845-4edb-bf69-1e2ffe0ef2eb (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36b14046-bbe0-45c6-add0-ab16578b41d3 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:370d91ef-d3c5-4019-b447-3f8134556e11 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21587566-b951-4b3e-8024-b6c2d2da35af (non-flash)\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:50:28 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bf3a351-6e94-4e35-b361-bf620fd99ed6 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8452525c-6845-4edb-bf69-1e2ffe0ef2eb (non-flash)
Nov 28 15:50:28 user nova-compute[75176]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36b14046-bbe0-45c6-add0-ab16578b41d3 (non-flash)
Nov 28 15:50:28 user nova-compute[75176]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:370d91ef-d3c5-4019-b447-3f8134556e11 (non-flash)
Nov 28 15:50:28 user nova-compute[75176]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21587566-b951-4b3e-8024-b6c2d2da35af (non-flash)
Nov 28 15:50:28 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:50:28 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bf3a351-6e94-4e35-b361-bf620fd99ed6 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8452525c-6845-4edb-bf69-1e2ffe0ef2eb (non-flash)
Nov 28 15:50:28 user nova-compute[75176]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36b14046-bbe0-45c6-add0-ab16578b41d3 (non-flash)
Nov 28 15:50:28 user nova-compute[75176]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:370d91ef-d3c5-4019-b447-3f8134556e11 (non-flash)
Nov 28 15:50:28 user nova-compute[75176]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21587566-b951-4b3e-8024-b6c2d2da35af (non-flash)
Nov 28 15:50:28 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 15:50:28 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07de7953-293c-4762-b695-ed3190c934d5 -p 172.16.0.220:3260 --login {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:50:29 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07de7953-293c-4762-b695-ed3190c934d5 -p 172.16.0.220:3260 --login" returned: 0 in 1.073s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:50:29 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[882f48b8-e9a1-402e-8a7f-f38575577c43]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:07de7953-293c-4762-b695-ed3190c934d5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:07de7953-293c-4762-b695-ed3190c934d5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:50:29 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bf3a351-6e94-4e35-b361-bf620fd99ed6 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:07de7953-293c-4762-b695-ed3190c934d5, portal: 172.16.0.220,3260]
Nov 28 15:50:29 user nova-compute[75176]: Login to [iface: default, target: iqn.2010-10.org.openstack:07de7953-293c-4762-b695-ed3190c934d5, portal: 172.16.0.220,3260] successful.
Nov 28 15:50:29 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:50:29 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07de7953-293c-4762-b695-ed3190c934d5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:50:29 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07de7953-293c-4762-b695-ed3190c934d5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:50:29 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[b43b6c93-0d3e-4df0-a77a-e5cedf29a0d8]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:50:29 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bf3a351-6e94-4e35-b361-bf620fd99ed6 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:50:29 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:50:29 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:50:29 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a1f6b18-f387-48ec-a662-10a1b192656b]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8452525c-6845-4edb-bf69-1e2ffe0ef2eb (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36b14046-bbe0-45c6-add0-ab16578b41d3 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:370d91ef-d3c5-4019-b447-3f8134556e11 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21587566-b951-4b3e-8024-b6c2d2da35af (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07de7953-293c-4762-b695-ed3190c934d5 (non-flash)\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:50:29 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bf3a351-6e94-4e35-b361-bf620fd99ed6 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8452525c-6845-4edb-bf69-1e2ffe0ef2eb (non-flash)
Nov 28 15:50:29 user nova-compute[75176]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36b14046-bbe0-45c6-add0-ab16578b41d3 (non-flash)
Nov 28 15:50:29 user nova-compute[75176]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:370d91ef-d3c5-4019-b447-3f8134556e11 (non-flash)
Nov 28 15:50:29 user nova-compute[75176]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21587566-b951-4b3e-8024-b6c2d2da35af (non-flash)
Nov 28 15:50:29 user nova-compute[75176]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07de7953-293c-4762-b695-ed3190c934d5 (non-flash)
Nov 28 15:50:29 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:50:29 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bf3a351-6e94-4e35-b361-bf620fd99ed6 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8452525c-6845-4edb-bf69-1e2ffe0ef2eb (non-flash)
Nov 28 15:50:29 user nova-compute[75176]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36b14046-bbe0-45c6-add0-ab16578b41d3 (non-flash)
Nov 28 15:50:29 user nova-compute[75176]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:370d91ef-d3c5-4019-b447-3f8134556e11 (non-flash)
Nov 28 15:50:29 user nova-compute[75176]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21587566-b951-4b3e-8024-b6c2d2da35af (non-flash)
Nov 28 15:50:29 user nova-compute[75176]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07de7953-293c-4762-b695-ed3190c934d5 (non-flash)
Nov 28 15:50:29 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 15:50:29 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-4bf3a351-6e94-4e35-b361-bf620fd99ed6 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:07de7953-293c-4762-b695-ed3190c934d5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.312s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 15:50:29 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bf3a351-6e94-4e35-b361-bf620fd99ed6 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Connected to 172.16.0.220:3260 {{(pid=75176) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 15:50:29 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-4bf3a351-6e94-4e35-b361-bf620fd99ed6 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] HCTL ('37', '-', '-', 0) found on session 36 with lun 0 {{(pid=75176) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 15:50:29 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-4bf3a351-6e94-4e35-b361-bf620fd99ed6 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75176) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 15:50:29 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:50:29 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.018s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:50:29 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[12f06ea2-fbb5-4396-9998-0bcfade860b9]: (4, ('- - 0', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:50:29 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-4bf3a351-6e94-4e35-b361-bf620fd99ed6 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Searching for a device in session 36 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75176) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 15:50:29 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bf3a351-6e94-4e35-b361-bf620fd99ed6 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:07de7953-293c-4762-b695-ed3190c934d5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tdMblYUX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75176) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 15:50:29 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:50:29 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:50:29 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:50:29 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:50:29 user nova-compute[75176]: DEBUG nova.compute.manager [req-c9bc206c-af0b-480b-90d5-755a3bc12ab4 req-f940c20d-424c-4025-94e1-3b097a3b7f82 service nova] [instance: e8b9c885-42ba-4f74-86b2-d091ebd08ed5] Received event network-vif-plugged-62fa1256-2b2c-4740-b93c-9e98a0a738f8 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:50:29 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-c9bc206c-af0b-480b-90d5-755a3bc12ab4 req-f940c20d-424c-4025-94e1-3b097a3b7f82 service nova] Acquiring lock "e8b9c885-42ba-4f74-86b2-d091ebd08ed5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:50:29 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-c9bc206c-af0b-480b-90d5-755a3bc12ab4 req-f940c20d-424c-4025-94e1-3b097a3b7f82 service nova] Lock "e8b9c885-42ba-4f74-86b2-d091ebd08ed5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:50:29 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-c9bc206c-af0b-480b-90d5-755a3bc12ab4 req-f940c20d-424c-4025-94e1-3b097a3b7f82 service nova] Lock "e8b9c885-42ba-4f74-86b2-d091ebd08ed5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:50:29 user nova-compute[75176]: DEBUG nova.compute.manager [req-c9bc206c-af0b-480b-90d5-755a3bc12ab4 req-f940c20d-424c-4025-94e1-3b097a3b7f82 service nova] [instance: e8b9c885-42ba-4f74-86b2-d091ebd08ed5] No waiting events found dispatching network-vif-plugged-62fa1256-2b2c-4740-b93c-9e98a0a738f8 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:50:29 user nova-compute[75176]: WARNING nova.compute.manager [req-c9bc206c-af0b-480b-90d5-755a3bc12ab4 req-f940c20d-424c-4025-94e1-3b097a3b7f82 service nova] [instance: e8b9c885-42ba-4f74-86b2-d091ebd08ed5] Received unexpected event network-vif-plugged-62fa1256-2b2c-4740-b93c-9e98a0a738f8 for instance with vm_state building and task_state spawning.
Nov 28 15:50:29 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:50:30 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:50:30 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-4bf3a351-6e94-4e35-b361-bf620fd99ed6 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.348s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 15:50:30 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bf3a351-6e94-4e35-b361-bf620fd99ed6 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] <== connect_volume: return (3231ms) {'type': 'block', 'scsi_wwn': '23637326433313039', 'path': '/dev/sdf'} {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 15:50:30 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4bf3a351-6e94-4e35-b361-bf620fd99ed6 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] [instance: 0e465c9f-e8ab-4a28-bf74-2936a272a0e2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23637326433313039', 'path': '/dev/sdf'} {{(pid=75176) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 15:50:30 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-4bf3a351-6e94-4e35-b361-bf620fd99ed6 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-28T15:46:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-447740496',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-447740496',id=23,image_ref='835977a9-d2bb-48e3-aede-ee974513e28e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1203625989',keypairs=<?>,launch_index=0,launched_at=2023-11-28T15:46:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='169fdaea89d4431aa6adacdbb76f3546',ramdisk_id='',reservation_id='r-avjj7pv9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1264107218',owner_user_name='tempest-AttachVolumeShelveTestJSON-1264107218-project-member',shelved_at='2023-11-28T15:48:25.137372',shelved_host='user',shelved_image_id='835977a9-d2bb-48e3-aede-ee974513e28e'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T15:50:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3146d6b1e7324ebaa62ade09f1d1c68f',uuid=0e465c9f-e8ab-4a28-bf74-2936a272a0e2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "86effed2-558e-4427-82be-761ca28e6d8c", "address": "fa:16:3e:95:66:57", "network": {"id": "5d0ae041-a67d-4a54-bd53-104c4f44209d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-938551772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "169fdaea89d4431aa6adacdbb76f3546", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86effed2-55", "ovs_interfaceid": "86effed2-558e-4427-82be-761ca28e6d8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75176) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 15:50:30 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-4bf3a351-6e94-4e35-b361-bf620fd99ed6 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Converting VIF {"id": "86effed2-558e-4427-82be-761ca28e6d8c", "address": "fa:16:3e:95:66:57", "network": {"id": "5d0ae041-a67d-4a54-bd53-104c4f44209d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-938551772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "169fdaea89d4431aa6adacdbb76f3546", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86effed2-55", "ovs_interfaceid": "86effed2-558e-4427-82be-761ca28e6d8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:50:30 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-4bf3a351-6e94-4e35-b361-bf620fd99ed6 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:66:57,bridge_name='br-int',has_traffic_filtering=True,id=86effed2-558e-4427-82be-761ca28e6d8c,network=Network(5d0ae041-a67d-4a54-bd53-104c4f44209d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86effed2-55') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:50:30 user nova-compute[75176]: DEBUG nova.objects.instance [None req-4bf3a351-6e94-4e35-b361-bf620fd99ed6 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Lazy-loading 'pci_devices' on Instance uuid 0e465c9f-e8ab-4a28-bf74-2936a272a0e2 {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:50:30 user nova-compute[75176]: DEBUG nova.objects.base [None req-4bf3a351-6e94-4e35-b361-bf620fd99ed6 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Object Instance<0e465c9f-e8ab-4a28-bf74-2936a272a0e2> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=75176) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 15:50:30 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-4bf3a351-6e94-4e35-b361-bf620fd99ed6 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] [instance: 0e465c9f-e8ab-4a28-bf74-2936a272a0e2] End _get_guest_xml xml=<domain type="kvm">
Nov 28 15:50:30 user nova-compute[75176]:   <uuid>0e465c9f-e8ab-4a28-bf74-2936a272a0e2</uuid>
Nov 28 15:50:30 user nova-compute[75176]:   <name>instance-00000017</name>
Nov 28 15:50:30 user nova-compute[75176]:   <memory>524288</memory>
Nov 28 15:50:30 user nova-compute[75176]:   <vcpu>1</vcpu>
Nov 28 15:50:30 user nova-compute[75176]:   <metadata>
Nov 28 15:50:30 user nova-compute[75176]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 15:50:30 user nova-compute[75176]:       <nova:package version="0.0.0"/>
Nov 28 15:50:30 user nova-compute[75176]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-447740496</nova:name>
Nov 28 15:50:30 user nova-compute[75176]:       <nova:creationTime>2023-11-28 15:50:27</nova:creationTime>
Nov 28 15:50:30 user nova-compute[75176]:       <nova:flavor name="m1.tiny">
Nov 28 15:50:30 user nova-compute[75176]:         <nova:memory>512</nova:memory>
Nov 28 15:50:30 user nova-compute[75176]:         <nova:disk>1</nova:disk>
Nov 28 15:50:30 user nova-compute[75176]:         <nova:swap>0</nova:swap>
Nov 28 15:50:30 user nova-compute[75176]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 15:50:30 user nova-compute[75176]:         <nova:vcpus>1</nova:vcpus>
Nov 28 15:50:30 user nova-compute[75176]:       </nova:flavor>
Nov 28 15:50:30 user nova-compute[75176]:       <nova:owner>
Nov 28 15:50:30 user nova-compute[75176]:         <nova:user uuid="3146d6b1e7324ebaa62ade09f1d1c68f">tempest-AttachVolumeShelveTestJSON-1264107218-project-member</nova:user>
Nov 28 15:50:30 user nova-compute[75176]:         <nova:project uuid="169fdaea89d4431aa6adacdbb76f3546">tempest-AttachVolumeShelveTestJSON-1264107218</nova:project>
Nov 28 15:50:30 user nova-compute[75176]:       </nova:owner>
Nov 28 15:50:30 user nova-compute[75176]:       <nova:root type="image" uuid="835977a9-d2bb-48e3-aede-ee974513e28e"/>
Nov 28 15:50:30 user nova-compute[75176]:       <nova:ports>
Nov 28 15:50:30 user nova-compute[75176]:         <nova:port uuid="86effed2-558e-4427-82be-761ca28e6d8c">
Nov 28 15:50:30 user nova-compute[75176]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 28 15:50:30 user nova-compute[75176]:         </nova:port>
Nov 28 15:50:30 user nova-compute[75176]:       </nova:ports>
Nov 28 15:50:30 user nova-compute[75176]:     </nova:instance>
Nov 28 15:50:30 user nova-compute[75176]:   </metadata>
Nov 28 15:50:30 user nova-compute[75176]:   <sysinfo type="smbios">
Nov 28 15:50:30 user nova-compute[75176]:     <system>
Nov 28 15:50:30 user nova-compute[75176]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 15:50:30 user nova-compute[75176]:       <entry name="product">OpenStack Nova</entry>
Nov 28 15:50:30 user nova-compute[75176]:       <entry name="version">0.0.0</entry>
Nov 28 15:50:30 user nova-compute[75176]:       <entry name="serial">0e465c9f-e8ab-4a28-bf74-2936a272a0e2</entry>
Nov 28 15:50:30 user nova-compute[75176]:       <entry name="uuid">0e465c9f-e8ab-4a28-bf74-2936a272a0e2</entry>
Nov 28 15:50:30 user nova-compute[75176]:       <entry name="family">Virtual Machine</entry>
Nov 28 15:50:30 user nova-compute[75176]:     </system>
Nov 28 15:50:30 user nova-compute[75176]:   </sysinfo>
Nov 28 15:50:30 user nova-compute[75176]:   <os>
Nov 28 15:50:30 user nova-compute[75176]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 15:50:30 user nova-compute[75176]:     <boot dev="hd"/>
Nov 28 15:50:30 user nova-compute[75176]:     <smbios mode="sysinfo"/>
Nov 28 15:50:30 user nova-compute[75176]:   </os>
Nov 28 15:50:30 user nova-compute[75176]:   <features>
Nov 28 15:50:30 user nova-compute[75176]:     <acpi/>
Nov 28 15:50:30 user nova-compute[75176]:     <apic/>
Nov 28 15:50:30 user nova-compute[75176]:     <vmcoreinfo/>
Nov 28 15:50:30 user nova-compute[75176]:   </features>
Nov 28 15:50:30 user nova-compute[75176]:   <clock offset="utc">
Nov 28 15:50:30 user nova-compute[75176]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 15:50:30 user nova-compute[75176]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 15:50:30 user nova-compute[75176]:     <timer name="hpet" present="no"/>
Nov 28 15:50:30 user nova-compute[75176]:   </clock>
Nov 28 15:50:30 user nova-compute[75176]:   <cpu mode="custom" match="exact">
Nov 28 15:50:30 user nova-compute[75176]:     <model>Nehalem</model>
Nov 28 15:50:30 user nova-compute[75176]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 15:50:30 user nova-compute[75176]:   </cpu>
Nov 28 15:50:30 user nova-compute[75176]:   <devices>
Nov 28 15:50:30 user nova-compute[75176]:     <disk type="file" device="disk">
Nov 28 15:50:30 user nova-compute[75176]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 15:50:30 user nova-compute[75176]:       <source file="/opt/stack/data/nova/instances/0e465c9f-e8ab-4a28-bf74-2936a272a0e2/disk"/>
Nov 28 15:50:30 user nova-compute[75176]:       <target dev="vda" bus="virtio"/>
Nov 28 15:50:30 user nova-compute[75176]:     </disk>
Nov 28 15:50:30 user nova-compute[75176]:     <disk type="block" device="disk">
Nov 28 15:50:30 user nova-compute[75176]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 15:50:30 user nova-compute[75176]:       <source dev="/dev/sdf"/>
Nov 28 15:50:30 user nova-compute[75176]:       <target dev="vdc" bus="virtio"/>
Nov 28 15:50:30 user nova-compute[75176]:       <serial>07de7953-293c-4762-b695-ed3190c934d5</serial>
Nov 28 15:50:30 user nova-compute[75176]:     </disk>
Nov 28 15:50:30 user nova-compute[75176]:     <interface type="ethernet">
Nov 28 15:50:30 user nova-compute[75176]:       <mac address="fa:16:3e:95:66:57"/>
Nov 28 15:50:30 user nova-compute[75176]:       <model type="virtio"/>
Nov 28 15:50:30 user nova-compute[75176]:       <mtu size="1442"/>
Nov 28 15:50:30 user nova-compute[75176]:       <target dev="tap86effed2-55"/>
Nov 28 15:50:30 user nova-compute[75176]:     </interface>
Nov 28 15:50:30 user nova-compute[75176]:     <serial type="pty">
Nov 28 15:50:30 user nova-compute[75176]:       <log file="/opt/stack/data/nova/instances/0e465c9f-e8ab-4a28-bf74-2936a272a0e2/console.log" append="off"/>
Nov 28 15:50:30 user nova-compute[75176]:     </serial>
Nov 28 15:50:30 user nova-compute[75176]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 15:50:30 user nova-compute[75176]:     <video>
Nov 28 15:50:30 user nova-compute[75176]:       <model type="virtio"/>
Nov 28 15:50:30 user nova-compute[75176]:     </video>
Nov 28 15:50:30 user nova-compute[75176]:     <rng model="virtio">
Nov 28 15:50:30 user nova-compute[75176]:       <backend model="random">/dev/urandom</backend>
Nov 28 15:50:30 user nova-compute[75176]:     </rng>
Nov 28 15:50:30 user nova-compute[75176]:     <controller type="usb" index="0" model="none"/>
Nov 28 15:50:30 user nova-compute[75176]:     <memballoon model="virtio">
Nov 28 15:50:30 user nova-compute[75176]:       <stats period="10"/>
Nov 28 15:50:30 user nova-compute[75176]:     </memballoon>
Nov 28 15:50:30 user nova-compute[75176]:   </devices>
Nov 28 15:50:30 user nova-compute[75176]: </domain>
Nov 28 15:50:30 user nova-compute[75176]:  {{(pid=75176) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 15:50:30 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-4bf3a351-6e94-4e35-b361-bf620fd99ed6 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-28T15:46:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-447740496',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-447740496',id=23,image_ref='835977a9-d2bb-48e3-aede-ee974513e28e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1203625989',keypairs=<?>,launch_index=0,launched_at=2023-11-28T15:46:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='169fdaea89d4431aa6adacdbb76f3546',ramdisk_id='',reservation_id='r-avjj7pv9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1264107218',owner_user_name='tempest-AttachVolumeShelveTestJSON-1264107218-project-member',shelved_at='2023-11-28T15:48:25.137372',shelved_host='user',shelved_image_id='835977a9-d2bb-48e3-aede-ee974513e28e'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T15:50:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3146d6b1e7324ebaa62ade09f1d1c68f',uuid=0e465c9f-e8ab-4a28-bf74-2936a272a0e2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "86effed2-558e-4427-82be-761ca28e6d8c", "address": "fa:16:3e:95:66:57", "network": {"id": "5d0ae041-a67d-4a54-bd53-104c4f44209d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-938551772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "169fdaea89d4431aa6adacdbb76f3546", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86effed2-55", "ovs_interfaceid": "86effed2-558e-4427-82be-761ca28e6d8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 15:50:30 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-4bf3a351-6e94-4e35-b361-bf620fd99ed6 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Converting VIF {"id": "86effed2-558e-4427-82be-761ca28e6d8c", "address": "fa:16:3e:95:66:57", "network": {"id": "5d0ae041-a67d-4a54-bd53-104c4f44209d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-938551772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "169fdaea89d4431aa6adacdbb76f3546", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86effed2-55", "ovs_interfaceid": "86effed2-558e-4427-82be-761ca28e6d8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:50:30 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-4bf3a351-6e94-4e35-b361-bf620fd99ed6 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:66:57,bridge_name='br-int',has_traffic_filtering=True,id=86effed2-558e-4427-82be-761ca28e6d8c,network=Network(5d0ae041-a67d-4a54-bd53-104c4f44209d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86effed2-55') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:50:30 user nova-compute[75176]: DEBUG os_vif [None req-4bf3a351-6e94-4e35-b361-bf620fd99ed6 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:66:57,bridge_name='br-int',has_traffic_filtering=True,id=86effed2-558e-4427-82be-761ca28e6d8c,network=Network(5d0ae041-a67d-4a54-bd53-104c4f44209d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86effed2-55') {{(pid=75176) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 15:50:30 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:50:30 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:50:30 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 15:50:30 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:50:30 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '830667c9-126c-5bd1-9e2c-dab4fa16e8a5', '_type': 'linux-noop'}}, row=False) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:50:30 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:50:30 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:50:30 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap86effed2-55, may_exist=True, interface_attrs={}) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:50:30 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap86effed2-55, col_values=(('qos', UUID('088dde16-ec7a-4c5f-8fb9-706c0bf0655c')),), if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:50:30 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap86effed2-55, col_values=(('external_ids', {'iface-id': '86effed2-558e-4427-82be-761ca28e6d8c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:95:66:57', 'vm-uuid': '0e465c9f-e8ab-4a28-bf74-2936a272a0e2'}),), if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:50:30 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:50:30 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:50:30 user nova-compute[75176]: INFO os_vif [None req-4bf3a351-6e94-4e35-b361-bf620fd99ed6 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:66:57,bridge_name='br-int',has_traffic_filtering=True,id=86effed2-558e-4427-82be-761ca28e6d8c,network=Network(5d0ae041-a67d-4a54-bd53-104c4f44209d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86effed2-55')
Nov 28 15:50:30 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-4bf3a351-6e94-4e35-b361-bf620fd99ed6 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] No BDM found with device name vda, not building metadata. {{(pid=75176) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 15:50:30 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-4bf3a351-6e94-4e35-b361-bf620fd99ed6 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75176) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 15:50:30 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-4bf3a351-6e94-4e35-b361-bf620fd99ed6 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] No VIF found with MAC fa:16:3e:95:66:57, not building metadata {{(pid=75176) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 15:50:32 user nova-compute[75176]: DEBUG nova.compute.manager [req-9b21e7fd-ef75-4487-bb5f-c38c4a47b8ac req-1f3e0c07-e5ef-4bb4-a5d4-24e552745c90 service nova] [instance: e8b9c885-42ba-4f74-86b2-d091ebd08ed5] Received event network-vif-plugged-62fa1256-2b2c-4740-b93c-9e98a0a738f8 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:50:32 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-9b21e7fd-ef75-4487-bb5f-c38c4a47b8ac req-1f3e0c07-e5ef-4bb4-a5d4-24e552745c90 service nova] Acquiring lock "e8b9c885-42ba-4f74-86b2-d091ebd08ed5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:50:32 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-9b21e7fd-ef75-4487-bb5f-c38c4a47b8ac req-1f3e0c07-e5ef-4bb4-a5d4-24e552745c90 service nova] Lock "e8b9c885-42ba-4f74-86b2-d091ebd08ed5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:50:32 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-9b21e7fd-ef75-4487-bb5f-c38c4a47b8ac req-1f3e0c07-e5ef-4bb4-a5d4-24e552745c90 service nova] Lock "e8b9c885-42ba-4f74-86b2-d091ebd08ed5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:50:32 user nova-compute[75176]: DEBUG nova.compute.manager [req-9b21e7fd-ef75-4487-bb5f-c38c4a47b8ac req-1f3e0c07-e5ef-4bb4-a5d4-24e552745c90 service nova] [instance: e8b9c885-42ba-4f74-86b2-d091ebd08ed5] No waiting events found dispatching network-vif-plugged-62fa1256-2b2c-4740-b93c-9e98a0a738f8 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:50:32 user nova-compute[75176]: WARNING nova.compute.manager [req-9b21e7fd-ef75-4487-bb5f-c38c4a47b8ac req-1f3e0c07-e5ef-4bb4-a5d4-24e552745c90 service nova] [instance: e8b9c885-42ba-4f74-86b2-d091ebd08ed5] Received unexpected event network-vif-plugged-62fa1256-2b2c-4740-b93c-9e98a0a738f8 for instance with vm_state building and task_state spawning.
Nov 28 15:50:32 user nova-compute[75176]: DEBUG nova.compute.manager [None req-51d95862-bb17-4db3-abbe-78d0643cfa59 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: e8b9c885-42ba-4f74-86b2-d091ebd08ed5] Instance event wait completed in 0 seconds for  {{(pid=75176) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 15:50:32 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-51d95862-bb17-4db3-abbe-78d0643cfa59 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: e8b9c885-42ba-4f74-86b2-d091ebd08ed5] Guest created on hypervisor {{(pid=75176) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 15:50:32 user nova-compute[75176]: INFO nova.virt.libvirt.driver [-] [instance: e8b9c885-42ba-4f74-86b2-d091ebd08ed5] Instance spawned successfully.
Nov 28 15:50:32 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-51d95862-bb17-4db3-abbe-78d0643cfa59 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: e8b9c885-42ba-4f74-86b2-d091ebd08ed5] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 15:50:32 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-51d95862-bb17-4db3-abbe-78d0643cfa59 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: e8b9c885-42ba-4f74-86b2-d091ebd08ed5] Found default for hw_input_bus of None {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:50:32 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-51d95862-bb17-4db3-abbe-78d0643cfa59 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: e8b9c885-42ba-4f74-86b2-d091ebd08ed5] Found default for hw_pointer_model of None {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:50:32 user nova-compute[75176]: INFO nova.compute.manager [None req-51d95862-bb17-4db3-abbe-78d0643cfa59 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: e8b9c885-42ba-4f74-86b2-d091ebd08ed5] Took 6.69 seconds to spawn the instance on the hypervisor.
Nov 28 15:50:32 user nova-compute[75176]: DEBUG nova.compute.manager [None req-51d95862-bb17-4db3-abbe-78d0643cfa59 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: e8b9c885-42ba-4f74-86b2-d091ebd08ed5] Checking state {{(pid=75176) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 15:50:32 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:50:32 user nova-compute[75176]: INFO nova.compute.manager [None req-51d95862-bb17-4db3-abbe-78d0643cfa59 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: e8b9c885-42ba-4f74-86b2-d091ebd08ed5] Took 20.71 seconds to build instance.
Nov 28 15:50:32 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:50:32 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:50:32 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-51d95862-bb17-4db3-abbe-78d0643cfa59 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Lock "e8b9c885-42ba-4f74-86b2-d091ebd08ed5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.822s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:50:32 user nova-compute[75176]: DEBUG nova.compute.manager [req-2f10c5e0-2e1a-4099-8431-d928b9ef3e5b req-d720004f-85fa-4f95-b952-ec7a0a9b6250 service nova] [instance: 0e465c9f-e8ab-4a28-bf74-2936a272a0e2] Received event network-vif-plugged-86effed2-558e-4427-82be-761ca28e6d8c {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:50:32 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-2f10c5e0-2e1a-4099-8431-d928b9ef3e5b req-d720004f-85fa-4f95-b952-ec7a0a9b6250 service nova] Acquiring lock "0e465c9f-e8ab-4a28-bf74-2936a272a0e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:50:32 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-2f10c5e0-2e1a-4099-8431-d928b9ef3e5b req-d720004f-85fa-4f95-b952-ec7a0a9b6250 service nova] Lock "0e465c9f-e8ab-4a28-bf74-2936a272a0e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:50:32 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-2f10c5e0-2e1a-4099-8431-d928b9ef3e5b req-d720004f-85fa-4f95-b952-ec7a0a9b6250 service nova] Lock "0e465c9f-e8ab-4a28-bf74-2936a272a0e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:50:32 user nova-compute[75176]: DEBUG nova.compute.manager [req-2f10c5e0-2e1a-4099-8431-d928b9ef3e5b req-d720004f-85fa-4f95-b952-ec7a0a9b6250 service nova] [instance: 0e465c9f-e8ab-4a28-bf74-2936a272a0e2] No waiting events found dispatching network-vif-plugged-86effed2-558e-4427-82be-761ca28e6d8c {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:50:32 user nova-compute[75176]: WARNING nova.compute.manager [req-2f10c5e0-2e1a-4099-8431-d928b9ef3e5b req-d720004f-85fa-4f95-b952-ec7a0a9b6250 service nova] [instance: 0e465c9f-e8ab-4a28-bf74-2936a272a0e2] Received unexpected event network-vif-plugged-86effed2-558e-4427-82be-761ca28e6d8c for instance with vm_state shelved_offloaded and task_state spawning.
Nov 28 15:50:33 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:50:33 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:50:33 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:50:33 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:50:33 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:50:34 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:50:34 user nova-compute[75176]: DEBUG nova.compute.manager [req-3008dd9b-aaa5-40b7-ac5a-cac7b18275a9 req-96a476db-3900-4dc5-9cc6-438b5790d07d service nova] [instance: 0e465c9f-e8ab-4a28-bf74-2936a272a0e2] Received event network-vif-plugged-86effed2-558e-4427-82be-761ca28e6d8c {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:50:34 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-3008dd9b-aaa5-40b7-ac5a-cac7b18275a9 req-96a476db-3900-4dc5-9cc6-438b5790d07d service nova] Acquiring lock "0e465c9f-e8ab-4a28-bf74-2936a272a0e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:50:34 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-3008dd9b-aaa5-40b7-ac5a-cac7b18275a9 req-96a476db-3900-4dc5-9cc6-438b5790d07d service nova] Lock "0e465c9f-e8ab-4a28-bf74-2936a272a0e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:50:34 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-3008dd9b-aaa5-40b7-ac5a-cac7b18275a9 req-96a476db-3900-4dc5-9cc6-438b5790d07d service nova] Lock "0e465c9f-e8ab-4a28-bf74-2936a272a0e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:50:34 user nova-compute[75176]: DEBUG nova.compute.manager [req-3008dd9b-aaa5-40b7-ac5a-cac7b18275a9 req-96a476db-3900-4dc5-9cc6-438b5790d07d service nova] [instance: 0e465c9f-e8ab-4a28-bf74-2936a272a0e2] No waiting events found dispatching network-vif-plugged-86effed2-558e-4427-82be-761ca28e6d8c {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:50:34 user nova-compute[75176]: WARNING nova.compute.manager [req-3008dd9b-aaa5-40b7-ac5a-cac7b18275a9 req-96a476db-3900-4dc5-9cc6-438b5790d07d service nova] [instance: 0e465c9f-e8ab-4a28-bf74-2936a272a0e2] Received unexpected event network-vif-plugged-86effed2-558e-4427-82be-761ca28e6d8c for instance with vm_state shelved_offloaded and task_state spawning.
Nov 28 15:50:34 user nova-compute[75176]: DEBUG nova.compute.manager [None req-4bf3a351-6e94-4e35-b361-bf620fd99ed6 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] [instance: 0e465c9f-e8ab-4a28-bf74-2936a272a0e2] Instance event wait completed in 0 seconds for  {{(pid=75176) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 15:50:34 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-4bf3a351-6e94-4e35-b361-bf620fd99ed6 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] [instance: 0e465c9f-e8ab-4a28-bf74-2936a272a0e2] Guest created on hypervisor {{(pid=75176) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 15:50:34 user nova-compute[75176]: INFO nova.virt.libvirt.driver [-] [instance: 0e465c9f-e8ab-4a28-bf74-2936a272a0e2] Instance spawned successfully.
Nov 28 15:50:35 user nova-compute[75176]: DEBUG nova.compute.manager [None req-4bf3a351-6e94-4e35-b361-bf620fd99ed6 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] [instance: 0e465c9f-e8ab-4a28-bf74-2936a272a0e2] Checking state {{(pid=75176) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 15:50:35 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-4bf3a351-6e94-4e35-b361-bf620fd99ed6 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Lock "0e465c9f-e8ab-4a28-bf74-2936a272a0e2" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 22.494s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:50:35 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:50:39 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:50:40 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7e96ec4c-0c12-40a6-b8e5-b466b4efa195 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Acquiring lock "6161cab2-eb1f-44cb-bbd5-077e6db42f77" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:50:40 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7e96ec4c-0c12-40a6-b8e5-b466b4efa195 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Lock "6161cab2-eb1f-44cb-bbd5-077e6db42f77" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:50:40 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7e96ec4c-0c12-40a6-b8e5-b466b4efa195 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] [instance: 6161cab2-eb1f-44cb-bbd5-077e6db42f77] Starting instance... {{(pid=75176) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 15:50:40 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7e96ec4c-0c12-40a6-b8e5-b466b4efa195 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:50:40 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7e96ec4c-0c12-40a6-b8e5-b466b4efa195 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:50:40 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-7e96ec4c-0c12-40a6-b8e5-b466b4efa195 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75176) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 15:50:40 user nova-compute[75176]: INFO nova.compute.claims [None req-7e96ec4c-0c12-40a6-b8e5-b466b4efa195 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] [instance: 6161cab2-eb1f-44cb-bbd5-077e6db42f77] Claim successful on node user
Nov 28 15:50:40 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:50:40 user nova-compute[75176]: DEBUG nova.compute.provider_tree [None req-7e96ec4c-0c12-40a6-b8e5-b466b4efa195 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Inventory has not changed in ProviderTree for provider: b37848d8-f401-4155-a029-b0ffa09ff85b {{(pid=75176) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 15:50:40 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-7e96ec4c-0c12-40a6-b8e5-b466b4efa195 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Inventory has not changed for provider b37848d8-f401-4155-a029-b0ffa09ff85b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75176) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 15:50:40 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7e96ec4c-0c12-40a6-b8e5-b466b4efa195 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.559s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:50:40 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7e96ec4c-0c12-40a6-b8e5-b466b4efa195 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] [instance: 6161cab2-eb1f-44cb-bbd5-077e6db42f77] Start building networks asynchronously for instance. {{(pid=75176) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 15:50:40 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7e96ec4c-0c12-40a6-b8e5-b466b4efa195 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] [instance: 6161cab2-eb1f-44cb-bbd5-077e6db42f77] Allocating IP information in the background. {{(pid=75176) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 15:50:40 user nova-compute[75176]: DEBUG nova.network.neutron [None req-7e96ec4c-0c12-40a6-b8e5-b466b4efa195 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] [instance: 6161cab2-eb1f-44cb-bbd5-077e6db42f77] allocate_for_instance() {{(pid=75176) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 15:50:40 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-7e96ec4c-0c12-40a6-b8e5-b466b4efa195 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] [instance: 6161cab2-eb1f-44cb-bbd5-077e6db42f77] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 15:50:40 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7e96ec4c-0c12-40a6-b8e5-b466b4efa195 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] [instance: 6161cab2-eb1f-44cb-bbd5-077e6db42f77] Start building block device mappings for instance. {{(pid=75176) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 15:50:41 user nova-compute[75176]: DEBUG nova.policy [None req-7e96ec4c-0c12-40a6-b8e5-b466b4efa195 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd028b79a105b485dbb0178c9da162640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3704b38a2bd44cb78c28d3f6d86d9e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75176) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 15:50:41 user nova-compute[75176]: INFO nova.virt.block_device [None req-7e96ec4c-0c12-40a6-b8e5-b466b4efa195 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] [instance: 6161cab2-eb1f-44cb-bbd5-077e6db42f77] Booting with volume d3e5eacd-1738-4959-be40-6d99da8776fc at /dev/vda
Nov 28 15:50:41 user nova-compute[75176]: DEBUG os_brick.utils [None req-7e96ec4c-0c12-40a6-b8e5-b466b4efa195 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 15:50:41 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:50:41 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:50:41 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1ea08e0-4bf2-4ca6-8ca5-8ad13503dd22]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:edc924a949b2\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:50:41 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:50:41 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:50:41 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae8c341e-92d2-4c92-be9b-7fc9962761c6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:50:41 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:50:41 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:50:41 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebffbb9a-3651-4756-93c3-89282370d2e4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:50:41 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[64750b19-e851-4a49-8624-9ad58a451f76]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:50:41 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7e96ec4c-0c12-40a6-b8e5-b466b4efa195 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Running cmd (subprocess): nvme version {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:50:41 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7e96ec4c-0c12-40a6-b8e5-b466b4efa195 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] 'nvme version' failed. Not Retrying. {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 15:50:41 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7e96ec4c-0c12-40a6-b8e5-b466b4efa195 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] nvme not present on system {{(pid=75176) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 15:50:41 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:50:41 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 15:50:41 user nova-compute[75176]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 15:50:41 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bbd1731-f3a3-4500-8114-99b14fabf525]: (4, '') {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:50:41 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.lightos [None req-7e96ec4c-0c12-40a6-b8e5-b466b4efa195 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75176) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 15:50:41 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.lightos [None req-7e96ec4c-0c12-40a6-b8e5-b466b4efa195 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75176) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 15:50:41 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.lightos [None req-7e96ec4c-0c12-40a6-b8e5-b466b4efa195 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] LIGHTOS: no hostnqn found. {{(pid=75176) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 15:50:41 user nova-compute[75176]: DEBUG os_brick.utils [None req-7e96ec4c-0c12-40a6-b8e5-b466b4efa195 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:edc924a949b2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 15:50:41 user nova-compute[75176]: DEBUG nova.virt.block_device [None req-7e96ec4c-0c12-40a6-b8e5-b466b4efa195 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] [instance: 6161cab2-eb1f-44cb-bbd5-077e6db42f77] Updating existing volume attachment record: 05e7e8ce-a451-425f-8f0a-025f4e3595f7 {{(pid=75176) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 15:50:42 user nova-compute[75176]: DEBUG nova.network.neutron [None req-7e96ec4c-0c12-40a6-b8e5-b466b4efa195 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] [instance: 6161cab2-eb1f-44cb-bbd5-077e6db42f77] Successfully created port: f2811544-4cf2-4302-b012-8bf1881b9b6c {{(pid=75176) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 15:50:42 user nova-compute[75176]: DEBUG nova.compute.manager [req-ec8fffae-31d5-4e1a-a68f-32347ae914a2 req-cec9ae6e-6e22-4455-984c-6e9ecce4861c service nova] [instance: cbefda8d-d285-404b-9817-49deada49d0b] Received event network-changed-b402b4bc-60ff-48fa-9fff-f9ec26d82fa0 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:50:42 user nova-compute[75176]: DEBUG nova.compute.manager [req-ec8fffae-31d5-4e1a-a68f-32347ae914a2 req-cec9ae6e-6e22-4455-984c-6e9ecce4861c service nova] [instance: cbefda8d-d285-404b-9817-49deada49d0b] Refreshing instance network info cache due to event network-changed-b402b4bc-60ff-48fa-9fff-f9ec26d82fa0. {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 15:50:42 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-ec8fffae-31d5-4e1a-a68f-32347ae914a2 req-cec9ae6e-6e22-4455-984c-6e9ecce4861c service nova] Acquiring lock "refresh_cache-cbefda8d-d285-404b-9817-49deada49d0b" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:50:42 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-ec8fffae-31d5-4e1a-a68f-32347ae914a2 req-cec9ae6e-6e22-4455-984c-6e9ecce4861c service nova] Acquired lock "refresh_cache-cbefda8d-d285-404b-9817-49deada49d0b" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:50:42 user nova-compute[75176]: DEBUG nova.network.neutron [req-ec8fffae-31d5-4e1a-a68f-32347ae914a2 req-cec9ae6e-6e22-4455-984c-6e9ecce4861c service nova] [instance: cbefda8d-d285-404b-9817-49deada49d0b] Refreshing network info cache for port b402b4bc-60ff-48fa-9fff-f9ec26d82fa0 {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 15:50:42 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-397396a5-90bd-4e2f-aa7f-71782337a76a tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Acquiring lock "6d061df5-8dbc-4fc1-9935-d46efc934b58" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:50:42 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-397396a5-90bd-4e2f-aa7f-71782337a76a tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Lock "6d061df5-8dbc-4fc1-9935-d46efc934b58" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:50:42 user nova-compute[75176]: DEBUG nova.network.neutron [req-ec8fffae-31d5-4e1a-a68f-32347ae914a2 req-cec9ae6e-6e22-4455-984c-6e9ecce4861c service nova] [instance: cbefda8d-d285-404b-9817-49deada49d0b] Updated VIF entry in instance network info cache for port b402b4bc-60ff-48fa-9fff-f9ec26d82fa0. {{(pid=75176) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 15:50:42 user nova-compute[75176]: DEBUG nova.network.neutron [req-ec8fffae-31d5-4e1a-a68f-32347ae914a2 req-cec9ae6e-6e22-4455-984c-6e9ecce4861c service nova] [instance: cbefda8d-d285-404b-9817-49deada49d0b] Updating instance_info_cache with network_info: [{"id": "b402b4bc-60ff-48fa-9fff-f9ec26d82fa0", "address": "fa:16:3e:b8:33:b8", "network": {"id": "7ab60343-57be-427d-9037-6ecf0eaf5de0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1508138843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a194f81f7e104be7940d1d05f71bbad9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb402b4bc-60", "ovs_interfaceid": "b402b4bc-60ff-48fa-9fff-f9ec26d82fa0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:50:42 user nova-compute[75176]: INFO nova.compute.manager [None req-397396a5-90bd-4e2f-aa7f-71782337a76a tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] [instance: 6d061df5-8dbc-4fc1-9935-d46efc934b58] Detaching volume 370d91ef-d3c5-4019-b447-3f8134556e11
Nov 28 15:50:43 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-ec8fffae-31d5-4e1a-a68f-32347ae914a2 req-cec9ae6e-6e22-4455-984c-6e9ecce4861c service nova] Releasing lock "refresh_cache-cbefda8d-d285-404b-9817-49deada49d0b" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:50:43 user nova-compute[75176]: INFO nova.virt.block_device [None req-397396a5-90bd-4e2f-aa7f-71782337a76a tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] [instance: 6d061df5-8dbc-4fc1-9935-d46efc934b58] Attempting to driver detach volume 370d91ef-d3c5-4019-b447-3f8134556e11 from mountpoint /dev/vdb
Nov 28 15:50:43 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-397396a5-90bd-4e2f-aa7f-71782337a76a tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Attempting to detach device vdb from instance 6d061df5-8dbc-4fc1-9935-d46efc934b58 from the persistent domain config. {{(pid=75176) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 15:50:43 user nova-compute[75176]: DEBUG nova.virt.libvirt.guest [None req-397396a5-90bd-4e2f-aa7f-71782337a76a tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 15:50:43 user nova-compute[75176]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 15:50:43 user nova-compute[75176]:   <source dev="/dev/sdb"/>
Nov 28 15:50:43 user nova-compute[75176]:   <target dev="vdb" bus="virtio"/>
Nov 28 15:50:43 user nova-compute[75176]:   <serial>370d91ef-d3c5-4019-b447-3f8134556e11</serial>
Nov 28 15:50:43 user nova-compute[75176]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 15:50:43 user nova-compute[75176]: </disk>
Nov 28 15:50:43 user nova-compute[75176]:  {{(pid=75176) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 15:50:43 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-397396a5-90bd-4e2f-aa7f-71782337a76a tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Successfully detached device vdb from instance 6d061df5-8dbc-4fc1-9935-d46efc934b58 from the persistent domain config.
Nov 28 15:50:43 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-397396a5-90bd-4e2f-aa7f-71782337a76a tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6d061df5-8dbc-4fc1-9935-d46efc934b58 from the live domain config. {{(pid=75176) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 15:50:43 user nova-compute[75176]: DEBUG nova.virt.libvirt.guest [None req-397396a5-90bd-4e2f-aa7f-71782337a76a tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 15:50:43 user nova-compute[75176]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 15:50:43 user nova-compute[75176]:   <source dev="/dev/sdb"/>
Nov 28 15:50:43 user nova-compute[75176]:   <target dev="vdb" bus="virtio"/>
Nov 28 15:50:43 user nova-compute[75176]:   <serial>370d91ef-d3c5-4019-b447-3f8134556e11</serial>
Nov 28 15:50:43 user nova-compute[75176]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 15:50:43 user nova-compute[75176]: </disk>
Nov 28 15:50:43 user nova-compute[75176]:  {{(pid=75176) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 15:50:43 user nova-compute[75176]: DEBUG nova.network.neutron [None req-7e96ec4c-0c12-40a6-b8e5-b466b4efa195 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] [instance: 6161cab2-eb1f-44cb-bbd5-077e6db42f77] Successfully updated port: f2811544-4cf2-4302-b012-8bf1881b9b6c {{(pid=75176) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 15:50:43 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-f43563d3-e4fb-4ca0-9f44-a308d7595f58 tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Acquiring lock "6d061df5-8dbc-4fc1-9935-d46efc934b58" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:50:43 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7e96ec4c-0c12-40a6-b8e5-b466b4efa195 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Acquiring lock "refresh_cache-6161cab2-eb1f-44cb-bbd5-077e6db42f77" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:50:43 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7e96ec4c-0c12-40a6-b8e5-b466b4efa195 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Acquired lock "refresh_cache-6161cab2-eb1f-44cb-bbd5-077e6db42f77" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:50:43 user nova-compute[75176]: DEBUG nova.network.neutron [None req-7e96ec4c-0c12-40a6-b8e5-b466b4efa195 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] [instance: 6161cab2-eb1f-44cb-bbd5-077e6db42f77] Building network info cache for instance {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 15:50:43 user nova-compute[75176]: DEBUG nova.compute.manager [req-3649b3a4-d02d-4f71-9b01-226c99d6ef57 req-e42fb263-4d66-4f38-80a7-c9b1cb1c44fd service nova] [instance: 6161cab2-eb1f-44cb-bbd5-077e6db42f77] Received event network-changed-f2811544-4cf2-4302-b012-8bf1881b9b6c {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:50:43 user nova-compute[75176]: DEBUG nova.compute.manager [req-3649b3a4-d02d-4f71-9b01-226c99d6ef57 req-e42fb263-4d66-4f38-80a7-c9b1cb1c44fd service nova] [instance: 6161cab2-eb1f-44cb-bbd5-077e6db42f77] Refreshing instance network info cache due to event network-changed-f2811544-4cf2-4302-b012-8bf1881b9b6c. {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 15:50:43 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-3649b3a4-d02d-4f71-9b01-226c99d6ef57 req-e42fb263-4d66-4f38-80a7-c9b1cb1c44fd service nova] Acquiring lock "refresh_cache-6161cab2-eb1f-44cb-bbd5-077e6db42f77" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:50:43 user nova-compute[75176]: DEBUG nova.network.neutron [None req-7e96ec4c-0c12-40a6-b8e5-b466b4efa195 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] [instance: 6161cab2-eb1f-44cb-bbd5-077e6db42f77] Instance cache missing network info. {{(pid=75176) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 15:50:43 user nova-compute[75176]: DEBUG nova.network.neutron [None req-7e96ec4c-0c12-40a6-b8e5-b466b4efa195 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] [instance: 6161cab2-eb1f-44cb-bbd5-077e6db42f77] Updating instance_info_cache with network_info: [{"id": "f2811544-4cf2-4302-b012-8bf1881b9b6c", "address": "fa:16:3e:2a:df:42", "network": {"id": "8b63f2d3-0683-4832-abc5-e4c796cf12ab", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-877608435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3704b38a2bd44cb78c28d3f6d86d9e60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2811544-4c", "ovs_interfaceid": "f2811544-4cf2-4302-b012-8bf1881b9b6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:50:43 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7e96ec4c-0c12-40a6-b8e5-b466b4efa195 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Releasing lock "refresh_cache-6161cab2-eb1f-44cb-bbd5-077e6db42f77" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:50:43 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7e96ec4c-0c12-40a6-b8e5-b466b4efa195 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] [instance: 6161cab2-eb1f-44cb-bbd5-077e6db42f77] Instance network_info: |[{"id": "f2811544-4cf2-4302-b012-8bf1881b9b6c", "address": "fa:16:3e:2a:df:42", "network": {"id": "8b63f2d3-0683-4832-abc5-e4c796cf12ab", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-877608435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3704b38a2bd44cb78c28d3f6d86d9e60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2811544-4c", "ovs_interfaceid": "f2811544-4cf2-4302-b012-8bf1881b9b6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75176) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 15:50:43 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-3649b3a4-d02d-4f71-9b01-226c99d6ef57 req-e42fb263-4d66-4f38-80a7-c9b1cb1c44fd service nova] Acquired lock "refresh_cache-6161cab2-eb1f-44cb-bbd5-077e6db42f77" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:50:43 user nova-compute[75176]: DEBUG nova.network.neutron [req-3649b3a4-d02d-4f71-9b01-226c99d6ef57 req-e42fb263-4d66-4f38-80a7-c9b1cb1c44fd service nova] [instance: 6161cab2-eb1f-44cb-bbd5-077e6db42f77] Refreshing network info cache for port f2811544-4cf2-4302-b012-8bf1881b9b6c {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 15:50:43 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-397396a5-90bd-4e2f-aa7f-71782337a76a tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6d061df5-8dbc-4fc1-9935-d46efc934b58 {{(pid=75176) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 15:50:43 user nova-compute[75176]: DEBUG nova.network.neutron [req-3649b3a4-d02d-4f71-9b01-226c99d6ef57 req-e42fb263-4d66-4f38-80a7-c9b1cb1c44fd service nova] [instance: 6161cab2-eb1f-44cb-bbd5-077e6db42f77] Updated VIF entry in instance network info cache for port f2811544-4cf2-4302-b012-8bf1881b9b6c. {{(pid=75176) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 15:50:43 user nova-compute[75176]: DEBUG nova.network.neutron [req-3649b3a4-d02d-4f71-9b01-226c99d6ef57 req-e42fb263-4d66-4f38-80a7-c9b1cb1c44fd service nova] [instance: 6161cab2-eb1f-44cb-bbd5-077e6db42f77] Updating instance_info_cache with network_info: [{"id": "f2811544-4cf2-4302-b012-8bf1881b9b6c", "address": "fa:16:3e:2a:df:42", "network": {"id": "8b63f2d3-0683-4832-abc5-e4c796cf12ab", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-877608435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3704b38a2bd44cb78c28d3f6d86d9e60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2811544-4c", "ovs_interfaceid": "f2811544-4cf2-4302-b012-8bf1881b9b6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:50:44 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-3649b3a4-d02d-4f71-9b01-226c99d6ef57 req-e42fb263-4d66-4f38-80a7-c9b1cb1c44fd service nova] Releasing lock "refresh_cache-6161cab2-eb1f-44cb-bbd5-077e6db42f77" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:50:44 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:50:45 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-2dbdbf93-f193-4dd3-becd-1b299134aff4 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Acquiring lock "cbefda8d-d285-404b-9817-49deada49d0b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:50:45 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-2dbdbf93-f193-4dd3-becd-1b299134aff4 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Lock "cbefda8d-d285-404b-9817-49deada49d0b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:50:45 user nova-compute[75176]: DEBUG nova.objects.instance [None req-2dbdbf93-f193-4dd3-becd-1b299134aff4 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Lazy-loading 'flavor' on Instance uuid cbefda8d-d285-404b-9817-49deada49d0b {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:50:45 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-2dbdbf93-f193-4dd3-becd-1b299134aff4 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Lock "cbefda8d-d285-404b-9817-49deada49d0b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.074s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:50:45 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-2dbdbf93-f193-4dd3-becd-1b299134aff4 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Acquiring lock "cbefda8d-d285-404b-9817-49deada49d0b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:50:45 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-2dbdbf93-f193-4dd3-becd-1b299134aff4 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Lock "cbefda8d-d285-404b-9817-49deada49d0b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:50:45 user nova-compute[75176]: INFO nova.compute.manager [None req-2dbdbf93-f193-4dd3-becd-1b299134aff4 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] [instance: cbefda8d-d285-404b-9817-49deada49d0b] Attaching volume 437b8e96-e7f7-4c0e-a48b-1a36613eb5ec to /dev/vdb
Nov 28 15:50:45 user nova-compute[75176]: DEBUG os_brick.utils [None req-2dbdbf93-f193-4dd3-becd-1b299134aff4 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 15:50:45 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:50:45 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:50:45 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:50:45 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f27011a-36e7-4e43-8258-84b675fafa66]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:edc924a949b2\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:50:45 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:50:45 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:50:45 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b1e3df9-4468-461b-b204-5f9ec31a3ba4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:50:45 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:50:45 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:50:45 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1133e9e-f61d-41c8-a4fe-ef45e5b7c436]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:50:45 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5c0c4d1-c344-4d8d-a85c-e57dce54b51d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:50:45 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-2dbdbf93-f193-4dd3-becd-1b299134aff4 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Running cmd (subprocess): nvme version {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:50:45 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-2dbdbf93-f193-4dd3-becd-1b299134aff4 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] 'nvme version' failed. Not Retrying. {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 15:50:45 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2dbdbf93-f193-4dd3-becd-1b299134aff4 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] nvme not present on system {{(pid=75176) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 15:50:45 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:50:45 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 15:50:45 user nova-compute[75176]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 15:50:45 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f3ad54f-0a59-4492-bb20-5d03817f4daa]: (4, '') {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:50:45 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.lightos [None req-2dbdbf93-f193-4dd3-becd-1b299134aff4 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75176) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 15:50:45 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.lightos [None req-2dbdbf93-f193-4dd3-becd-1b299134aff4 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75176) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 15:50:45 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.lightos [None req-2dbdbf93-f193-4dd3-becd-1b299134aff4 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] LIGHTOS: no hostnqn found. {{(pid=75176) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 15:50:45 user nova-compute[75176]: DEBUG os_brick.utils [None req-2dbdbf93-f193-4dd3-becd-1b299134aff4 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:edc924a949b2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 15:50:45 user nova-compute[75176]: DEBUG nova.virt.block_device [None req-2dbdbf93-f193-4dd3-becd-1b299134aff4 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] [instance: cbefda8d-d285-404b-9817-49deada49d0b] Updating existing volume attachment record: 32541eab-08b3-4929-bf2f-6ef10a73368a {{(pid=75176) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 15:50:48 user nova-compute[75176]: DEBUG nova.compute.manager [None req-caa5e99b-27ed-4f9e-89c9-71c91ae743cb tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: f66ead7d-98f4-4822-9dce-f2ea0206a58d] Checking state {{(pid=75176) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 15:50:48 user nova-compute[75176]: INFO nova.compute.manager [None req-caa5e99b-27ed-4f9e-89c9-71c91ae743cb tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: f66ead7d-98f4-4822-9dce-f2ea0206a58d] instance snapshotting
Nov 28 15:50:48 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-caa5e99b-27ed-4f9e-89c9-71c91ae743cb tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: f66ead7d-98f4-4822-9dce-f2ea0206a58d] Beginning live snapshot process
Nov 28 15:50:48 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-caa5e99b-27ed-4f9e-89c9-71c91ae743cb tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66ead7d-98f4-4822-9dce-f2ea0206a58d/disk --force-share --output=json -f qcow2 {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:50:48 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-caa5e99b-27ed-4f9e-89c9-71c91ae743cb tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66ead7d-98f4-4822-9dce-f2ea0206a58d/disk --force-share --output=json -f qcow2" returned: 0 in 0.355s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:50:48 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-caa5e99b-27ed-4f9e-89c9-71c91ae743cb tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66ead7d-98f4-4822-9dce-f2ea0206a58d/disk --force-share --output=json -f qcow2 {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:50:48 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-caa5e99b-27ed-4f9e-89c9-71c91ae743cb tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66ead7d-98f4-4822-9dce-f2ea0206a58d/disk --force-share --output=json -f qcow2" returned: 0 in 0.203s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:50:48 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-caa5e99b-27ed-4f9e-89c9-71c91ae743cb tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:50:49 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-caa5e99b-27ed-4f9e-89c9-71c91ae743cb tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json" returned: 0 in 0.176s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:50:49 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-caa5e99b-27ed-4f9e-89c9-71c91ae743cb tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmppxkymcoj/8e7e05520c4647718cd5d986ca00aa7e.delta 1073741824 {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:50:49 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:50:49 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-caa5e99b-27ed-4f9e-89c9-71c91ae743cb tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmppxkymcoj/8e7e05520c4647718cd5d986ca00aa7e.delta 1073741824" returned: 0 in 0.053s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:50:49 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-caa5e99b-27ed-4f9e-89c9-71c91ae743cb tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: f66ead7d-98f4-4822-9dce-f2ea0206a58d] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 28 15:50:49 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7e96ec4c-0c12-40a6-b8e5-b466b4efa195 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] [instance: 6161cab2-eb1f-44cb-bbd5-077e6db42f77] Start spawning the instance on the hypervisor. {{(pid=75176) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 15:50:49 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-7e96ec4c-0c12-40a6-b8e5-b466b4efa195 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] [instance: 6161cab2-eb1f-44cb-bbd5-077e6db42f77] Creating instance directory {{(pid=75176) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 15:50:49 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-7e96ec4c-0c12-40a6-b8e5-b466b4efa195 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] [instance: 6161cab2-eb1f-44cb-bbd5-077e6db42f77] Creating image(s)
Nov 28 15:50:49 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-7e96ec4c-0c12-40a6-b8e5-b466b4efa195 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] [instance: 6161cab2-eb1f-44cb-bbd5-077e6db42f77] Did not create local disks {{(pid=75176) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 28 15:50:49 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-7e96ec4c-0c12-40a6-b8e5-b466b4efa195 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] [instance: 6161cab2-eb1f-44cb-bbd5-077e6db42f77] Ensure instance console log exists: /opt/stack/data/nova/instances/6161cab2-eb1f-44cb-bbd5-077e6db42f77/console.log {{(pid=75176) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 15:50:49 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7e96ec4c-0c12-40a6-b8e5-b466b4efa195 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:50:49 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7e96ec4c-0c12-40a6-b8e5-b466b4efa195 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:50:49 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7e96ec4c-0c12-40a6-b8e5-b466b4efa195 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:50:49 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-7e96ec4c-0c12-40a6-b8e5-b466b4efa195 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] [instance: 6161cab2-eb1f-44cb-bbd5-077e6db42f77] Start _get_guest_xml network_info=[{"id": "f2811544-4cf2-4302-b012-8bf1881b9b6c", "address": "fa:16:3e:2a:df:42", "network": {"id": "8b63f2d3-0683-4832-abc5-e4c796cf12ab", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-877608435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3704b38a2bd44cb78c28d3f6d86d9e60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2811544-4c", "ovs_interfaceid": "f2811544-4cf2-4302-b012-8bf1881b9b6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zMZSixul', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '6161cab2-eb1f-44cb-bbd5-077e6db42f77', 'attached_at': '', 'detached_at': '', 'volume_id': 'd3e5eacd-1738-4959-be40-6d99da8776fc', 'serial': 'd3e5eacd-1738-4959-be40-6d99da8776fc'}, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'delete_on_termination': True, 'mount_device': '/dev/vda', 'attachment_id': '05e7e8ce-a451-425f-8f0a-025f4e3595f7', 'volume_type': None} {{(pid=75176) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 15:50:49 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-7e96ec4c-0c12-40a6-b8e5-b466b4efa195 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 15:50:49 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-7e96ec4c-0c12-40a6-b8e5-b466b4efa195 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 15:50:49 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-7e96ec4c-0c12-40a6-b8e5-b466b4efa195 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75176) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 15:50:49 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-7e96ec4c-0c12-40a6-b8e5-b466b4efa195 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] CPU controller missing on host. {{(pid=75176) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 15:50:49 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-7e96ec4c-0c12-40a6-b8e5-b466b4efa195 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75176) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 15:50:49 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-7e96ec4c-0c12-40a6-b8e5-b466b4efa195 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] CPU controller found on host. {{(pid=75176) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 15:50:49 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-7e96ec4c-0c12-40a6-b8e5-b466b4efa195 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75176) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 15:50:49 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-7e96ec4c-0c12-40a6-b8e5-b466b4efa195 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T15:35:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 15:50:49 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-7e96ec4c-0c12-40a6-b8e5-b466b4efa195 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Flavor limits 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 15:50:49 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-7e96ec4c-0c12-40a6-b8e5-b466b4efa195 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Image limits 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 15:50:49 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-7e96ec4c-0c12-40a6-b8e5-b466b4efa195 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Flavor pref 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 15:50:49 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-7e96ec4c-0c12-40a6-b8e5-b466b4efa195 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Image pref 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 15:50:49 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-7e96ec4c-0c12-40a6-b8e5-b466b4efa195 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 15:50:49 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-7e96ec4c-0c12-40a6-b8e5-b466b4efa195 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 15:50:49 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-7e96ec4c-0c12-40a6-b8e5-b466b4efa195 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75176) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 15:50:49 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-7e96ec4c-0c12-40a6-b8e5-b466b4efa195 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Got 1 possible topologies {{(pid=75176) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 15:50:49 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-7e96ec4c-0c12-40a6-b8e5-b466b4efa195 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 15:50:49 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-7e96ec4c-0c12-40a6-b8e5-b466b4efa195 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 15:50:49 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7e96ec4c-0c12-40a6-b8e5-b466b4efa195 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] [instance: 6161cab2-eb1f-44cb-bbd5-077e6db42f77] Calling os-brick to attach iSCSI Volume {{(pid=75176) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 15:50:49 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e96ec4c-0c12-40a6-b8e5-b466b4efa195 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c1b8a00>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zMZSixul', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 15:50:49 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-7e96ec4c-0c12-40a6-b8e5-b466b4efa195 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 15:50:49 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-7e96ec4c-0c12-40a6-b8e5-b466b4efa195 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 15:50:49 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-7e96ec4c-0c12-40a6-b8e5-b466b4efa195 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 15:50:49 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-7e96ec4c-0c12-40a6-b8e5-b466b4efa195 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 15:50:49 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-7e96ec4c-0c12-40a6-b8e5-b466b4efa195 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 15:50:49 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-7e96ec4c-0c12-40a6-b8e5-b466b4efa195 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 15:50:49 user nova-compute[75176]: INFO os_brick.initiator.connectors.iscsi [None req-7e96ec4c-0c12-40a6-b8e5-b466b4efa195 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 15:50:49 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc -p 172.16.0.220:3260 {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:50:49 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:50:49 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf90cfa3-7522-42e8-82be-3ccf8216e72a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:50:49 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e96ec4c-0c12-40a6-b8e5-b466b4efa195 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 15:50:49 user nova-compute[75176]:  {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:50:49 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc -p 172.16.0.220:3260 --interface default --op new {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:50:49 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:50:49 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b2a4a17-b316-4d7d-8c44-4c110392c915]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc] added\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:50:49 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e96ec4c-0c12-40a6-b8e5-b466b4efa195 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc] added
Nov 28 15:50:49 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:50:49 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:50:49 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:50:49 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[f580c22f-a775-4b73-83d8-bb15a7ad33f2]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:50:49 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e96ec4c-0c12-40a6-b8e5-b466b4efa195 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:50:49 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:50:49 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:50:49 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[e47b7cab-1e6d-4511-b110-1b9bf6f1cc1f]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:50:49 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e96ec4c-0c12-40a6-b8e5-b466b4efa195 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:50:49 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zMZSixul {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:50:49 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zMZSixul" returned: 0 in 0.018s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:50:49 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[952e7400-bee0-4f84-adeb-5bb12bf9e7b6]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:50:49 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e96ec4c-0c12-40a6-b8e5-b466b4efa195 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zMZSixul'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:50:49 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:50:49 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:50:49 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[e81d247f-4253-4172-8a33-97f35a22e8ea]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:50:49 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e96ec4c-0c12-40a6-b8e5-b466b4efa195 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:50:49 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:50:49 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:50:49 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[aef327c6-e492-48e1-a36d-08231c4bbbbb]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8452525c-6845-4edb-bf69-1e2ffe0ef2eb (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36b14046-bbe0-45c6-add0-ab16578b41d3 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:370d91ef-d3c5-4019-b447-3f8134556e11 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21587566-b951-4b3e-8024-b6c2d2da35af (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07de7953-293c-4762-b695-ed3190c934d5 (non-flash)\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:50:49 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e96ec4c-0c12-40a6-b8e5-b466b4efa195 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8452525c-6845-4edb-bf69-1e2ffe0ef2eb (non-flash)
Nov 28 15:50:49 user nova-compute[75176]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36b14046-bbe0-45c6-add0-ab16578b41d3 (non-flash)
Nov 28 15:50:49 user nova-compute[75176]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:370d91ef-d3c5-4019-b447-3f8134556e11 (non-flash)
Nov 28 15:50:49 user nova-compute[75176]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21587566-b951-4b3e-8024-b6c2d2da35af (non-flash)
Nov 28 15:50:49 user nova-compute[75176]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07de7953-293c-4762-b695-ed3190c934d5 (non-flash)
Nov 28 15:50:49 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:50:49 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e96ec4c-0c12-40a6-b8e5-b466b4efa195 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8452525c-6845-4edb-bf69-1e2ffe0ef2eb (non-flash)
Nov 28 15:50:49 user nova-compute[75176]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36b14046-bbe0-45c6-add0-ab16578b41d3 (non-flash)
Nov 28 15:50:49 user nova-compute[75176]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:370d91ef-d3c5-4019-b447-3f8134556e11 (non-flash)
Nov 28 15:50:49 user nova-compute[75176]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21587566-b951-4b3e-8024-b6c2d2da35af (non-flash)
Nov 28 15:50:49 user nova-compute[75176]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07de7953-293c-4762-b695-ed3190c934d5 (non-flash)
Nov 28 15:50:49 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 15:50:49 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc -p 172.16.0.220:3260 --login {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:50:49 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:50:49 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab729baa-2e65-49b4-999e-5d50282693e5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:50:49 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e96ec4c-0c12-40a6-b8e5-b466b4efa195 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc, portal: 172.16.0.220,3260]
Nov 28 15:50:49 user nova-compute[75176]: Login to [iface: default, target: iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc, portal: 172.16.0.220,3260] successful.
Nov 28 15:50:49 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:50:49 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:50:49 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:50:49 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f7b59a1-1d6e-432e-ba95-42326c6be2c5]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:50:49 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e96ec4c-0c12-40a6-b8e5-b466b4efa195 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:50:49 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:50:49 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:50:49 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6cfde28-c09b-4bb0-9b43-f7b50f4ef451]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8452525c-6845-4edb-bf69-1e2ffe0ef2eb (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36b14046-bbe0-45c6-add0-ab16578b41d3 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:370d91ef-d3c5-4019-b447-3f8134556e11 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21587566-b951-4b3e-8024-b6c2d2da35af (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07de7953-293c-4762-b695-ed3190c934d5 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc (non-flash)\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:50:49 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e96ec4c-0c12-40a6-b8e5-b466b4efa195 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8452525c-6845-4edb-bf69-1e2ffe0ef2eb (non-flash)
Nov 28 15:50:49 user nova-compute[75176]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36b14046-bbe0-45c6-add0-ab16578b41d3 (non-flash)
Nov 28 15:50:49 user nova-compute[75176]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:370d91ef-d3c5-4019-b447-3f8134556e11 (non-flash)
Nov 28 15:50:49 user nova-compute[75176]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21587566-b951-4b3e-8024-b6c2d2da35af (non-flash)
Nov 28 15:50:49 user nova-compute[75176]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07de7953-293c-4762-b695-ed3190c934d5 (non-flash)
Nov 28 15:50:49 user nova-compute[75176]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc (non-flash)
Nov 28 15:50:49 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:50:49 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e96ec4c-0c12-40a6-b8e5-b466b4efa195 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8452525c-6845-4edb-bf69-1e2ffe0ef2eb (non-flash)
Nov 28 15:50:49 user nova-compute[75176]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36b14046-bbe0-45c6-add0-ab16578b41d3 (non-flash)
Nov 28 15:50:49 user nova-compute[75176]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:370d91ef-d3c5-4019-b447-3f8134556e11 (non-flash)
Nov 28 15:50:49 user nova-compute[75176]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21587566-b951-4b3e-8024-b6c2d2da35af (non-flash)
Nov 28 15:50:49 user nova-compute[75176]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07de7953-293c-4762-b695-ed3190c934d5 (non-flash)
Nov 28 15:50:49 user nova-compute[75176]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc (non-flash)
Nov 28 15:50:49 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 15:50:49 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-7e96ec4c-0c12-40a6-b8e5-b466b4efa195 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.297s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 15:50:49 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e96ec4c-0c12-40a6-b8e5-b466b4efa195 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Connected to 172.16.0.220:3260 {{(pid=75176) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 15:50:49 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-7e96ec4c-0c12-40a6-b8e5-b466b4efa195 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] HCTL ('38', '-', '-', 0) found on session 37 with lun 0 {{(pid=75176) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 15:50:49 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-7e96ec4c-0c12-40a6-b8e5-b466b4efa195 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75176) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 15:50:49 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:50:49 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.022s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:50:49 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[1152154e-c8d9-4862-99a9-7ebf223ff3de]: (4, ('- - 0', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:50:49 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-7e96ec4c-0c12-40a6-b8e5-b466b4efa195 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Searching for a device in session 37 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75176) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 15:50:49 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e96ec4c-0c12-40a6-b8e5-b466b4efa195 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zMZSixul', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75176) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 15:50:49 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:50:49 user nova-compute[75176]: DEBUG nova.virt.libvirt.guest [None req-caa5e99b-27ed-4f9e-89c9-71c91ae743cb tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75176) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 15:50:50 user nova-compute[75176]: DEBUG nova.virt.libvirt.guest [None req-caa5e99b-27ed-4f9e-89c9-71c91ae743cb tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75176) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 15:50:50 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-caa5e99b-27ed-4f9e-89c9-71c91ae743cb tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: f66ead7d-98f4-4822-9dce-f2ea0206a58d] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 28 15:50:50 user nova-compute[75176]: DEBUG nova.privsep.utils [None req-caa5e99b-27ed-4f9e-89c9-71c91ae743cb tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75176) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 28 15:50:50 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-caa5e99b-27ed-4f9e-89c9-71c91ae743cb tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmppxkymcoj/8e7e05520c4647718cd5d986ca00aa7e.delta /opt/stack/data/nova/instances/snapshots/tmppxkymcoj/8e7e05520c4647718cd5d986ca00aa7e {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:50:50 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:50:50 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-7e96ec4c-0c12-40a6-b8e5-b466b4efa195 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.338s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 15:50:50 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e96ec4c-0c12-40a6-b8e5-b466b4efa195 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] <== connect_volume: return (1341ms) {'type': 'block', 'scsi_wwn': '23238666262633737', 'path': '/dev/sdg'} {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 15:50:50 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7e96ec4c-0c12-40a6-b8e5-b466b4efa195 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] [instance: 6161cab2-eb1f-44cb-bbd5-077e6db42f77] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23238666262633737', 'path': '/dev/sdg'} {{(pid=75176) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 15:50:50 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-7e96ec4c-0c12-40a6-b8e5-b466b4efa195 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T15:50:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-572538979',display_name='tempest-ServerActionsTestOtherA-server-572538979',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-572538979',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOMWl0O1/eKbWND/zyjGraAKxeAyZ2R2+QgHiQ80zmzsi5uDkOgtIp8e2HjbFwlKUWmHgZppW6LnrIueD7TS7l/EkNAyCl7Y/pD0TSC3H7ZDLxYbZaFDAxH/uT7EnME+ig==',key_name='tempest-keypair-740685341',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3704b38a2bd44cb78c28d3f6d86d9e60',ramdisk_id='',reservation_id='r-s3c8yj7d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-680502445',owner_user_name='tempest-ServerActionsTestOtherA-680502445-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T15:50:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d028b79a105b485dbb0178c9da162640',uuid=6161cab2-eb1f-44cb-bbd5-077e6db42f77,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f2811544-4cf2-4302-b012-8bf1881b9b6c", "address": "fa:16:3e:2a:df:42", "network": {"id": "8b63f2d3-0683-4832-abc5-e4c796cf12ab", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-877608435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3704b38a2bd44cb78c28d3f6d86d9e60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2811544-4c", "ovs_interfaceid": "f2811544-4cf2-4302-b012-8bf1881b9b6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75176) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 15:50:50 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-7e96ec4c-0c12-40a6-b8e5-b466b4efa195 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Converting VIF {"id": "f2811544-4cf2-4302-b012-8bf1881b9b6c", "address": "fa:16:3e:2a:df:42", "network": {"id": "8b63f2d3-0683-4832-abc5-e4c796cf12ab", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-877608435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3704b38a2bd44cb78c28d3f6d86d9e60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2811544-4c", "ovs_interfaceid": "f2811544-4cf2-4302-b012-8bf1881b9b6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:50:50 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-7e96ec4c-0c12-40a6-b8e5-b466b4efa195 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2a:df:42,bridge_name='br-int',has_traffic_filtering=True,id=f2811544-4cf2-4302-b012-8bf1881b9b6c,network=Network(8b63f2d3-0683-4832-abc5-e4c796cf12ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2811544-4c') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:50:50 user nova-compute[75176]: DEBUG nova.objects.instance [None req-7e96ec4c-0c12-40a6-b8e5-b466b4efa195 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Lazy-loading 'pci_devices' on Instance uuid 6161cab2-eb1f-44cb-bbd5-077e6db42f77 {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:50:50 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-7e96ec4c-0c12-40a6-b8e5-b466b4efa195 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] [instance: 6161cab2-eb1f-44cb-bbd5-077e6db42f77] End _get_guest_xml xml=<domain type="kvm">
Nov 28 15:50:50 user nova-compute[75176]:   <uuid>6161cab2-eb1f-44cb-bbd5-077e6db42f77</uuid>
Nov 28 15:50:50 user nova-compute[75176]:   <name>instance-00000022</name>
Nov 28 15:50:50 user nova-compute[75176]:   <memory>524288</memory>
Nov 28 15:50:50 user nova-compute[75176]:   <vcpu>1</vcpu>
Nov 28 15:50:50 user nova-compute[75176]:   <metadata>
Nov 28 15:50:50 user nova-compute[75176]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 15:50:50 user nova-compute[75176]:       <nova:package version="0.0.0"/>
Nov 28 15:50:50 user nova-compute[75176]:       <nova:name>tempest-ServerActionsTestOtherA-server-572538979</nova:name>
Nov 28 15:50:50 user nova-compute[75176]:       <nova:creationTime>2023-11-28 15:50:49</nova:creationTime>
Nov 28 15:50:50 user nova-compute[75176]:       <nova:flavor name="m1.tiny">
Nov 28 15:50:50 user nova-compute[75176]:         <nova:memory>512</nova:memory>
Nov 28 15:50:50 user nova-compute[75176]:         <nova:disk>1</nova:disk>
Nov 28 15:50:50 user nova-compute[75176]:         <nova:swap>0</nova:swap>
Nov 28 15:50:50 user nova-compute[75176]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 15:50:50 user nova-compute[75176]:         <nova:vcpus>1</nova:vcpus>
Nov 28 15:50:50 user nova-compute[75176]:       </nova:flavor>
Nov 28 15:50:50 user nova-compute[75176]:       <nova:owner>
Nov 28 15:50:50 user nova-compute[75176]:         <nova:user uuid="d028b79a105b485dbb0178c9da162640">tempest-ServerActionsTestOtherA-680502445-project-member</nova:user>
Nov 28 15:50:50 user nova-compute[75176]:         <nova:project uuid="3704b38a2bd44cb78c28d3f6d86d9e60">tempest-ServerActionsTestOtherA-680502445</nova:project>
Nov 28 15:50:50 user nova-compute[75176]:       </nova:owner>
Nov 28 15:50:50 user nova-compute[75176]:       <nova:ports>
Nov 28 15:50:50 user nova-compute[75176]:         <nova:port uuid="f2811544-4cf2-4302-b012-8bf1881b9b6c">
Nov 28 15:50:50 user nova-compute[75176]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 28 15:50:50 user nova-compute[75176]:         </nova:port>
Nov 28 15:50:50 user nova-compute[75176]:       </nova:ports>
Nov 28 15:50:50 user nova-compute[75176]:     </nova:instance>
Nov 28 15:50:50 user nova-compute[75176]:   </metadata>
Nov 28 15:50:50 user nova-compute[75176]:   <sysinfo type="smbios">
Nov 28 15:50:50 user nova-compute[75176]:     <system>
Nov 28 15:50:50 user nova-compute[75176]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 15:50:50 user nova-compute[75176]:       <entry name="product">OpenStack Nova</entry>
Nov 28 15:50:50 user nova-compute[75176]:       <entry name="version">0.0.0</entry>
Nov 28 15:50:50 user nova-compute[75176]:       <entry name="serial">6161cab2-eb1f-44cb-bbd5-077e6db42f77</entry>
Nov 28 15:50:50 user nova-compute[75176]:       <entry name="uuid">6161cab2-eb1f-44cb-bbd5-077e6db42f77</entry>
Nov 28 15:50:50 user nova-compute[75176]:       <entry name="family">Virtual Machine</entry>
Nov 28 15:50:50 user nova-compute[75176]:     </system>
Nov 28 15:50:50 user nova-compute[75176]:   </sysinfo>
Nov 28 15:50:50 user nova-compute[75176]:   <os>
Nov 28 15:50:50 user nova-compute[75176]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 15:50:50 user nova-compute[75176]:     <boot dev="hd"/>
Nov 28 15:50:50 user nova-compute[75176]:     <smbios mode="sysinfo"/>
Nov 28 15:50:50 user nova-compute[75176]:   </os>
Nov 28 15:50:50 user nova-compute[75176]:   <features>
Nov 28 15:50:50 user nova-compute[75176]:     <acpi/>
Nov 28 15:50:50 user nova-compute[75176]:     <apic/>
Nov 28 15:50:50 user nova-compute[75176]:     <vmcoreinfo/>
Nov 28 15:50:50 user nova-compute[75176]:   </features>
Nov 28 15:50:50 user nova-compute[75176]:   <clock offset="utc">
Nov 28 15:50:50 user nova-compute[75176]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 15:50:50 user nova-compute[75176]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 15:50:50 user nova-compute[75176]:     <timer name="hpet" present="no"/>
Nov 28 15:50:50 user nova-compute[75176]:   </clock>
Nov 28 15:50:50 user nova-compute[75176]:   <cpu mode="custom" match="exact">
Nov 28 15:50:50 user nova-compute[75176]:     <model>Nehalem</model>
Nov 28 15:50:50 user nova-compute[75176]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 15:50:50 user nova-compute[75176]:   </cpu>
Nov 28 15:50:50 user nova-compute[75176]:   <devices>
Nov 28 15:50:50 user nova-compute[75176]:     <disk type="block" device="disk">
Nov 28 15:50:50 user nova-compute[75176]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 15:50:50 user nova-compute[75176]:       <source dev="/dev/sdg"/>
Nov 28 15:50:50 user nova-compute[75176]:       <target dev="vda" bus="virtio"/>
Nov 28 15:50:50 user nova-compute[75176]:       <serial>d3e5eacd-1738-4959-be40-6d99da8776fc</serial>
Nov 28 15:50:50 user nova-compute[75176]:     </disk>
Nov 28 15:50:50 user nova-compute[75176]:     <interface type="ethernet">
Nov 28 15:50:50 user nova-compute[75176]:       <mac address="fa:16:3e:2a:df:42"/>
Nov 28 15:50:50 user nova-compute[75176]:       <model type="virtio"/>
Nov 28 15:50:50 user nova-compute[75176]:       <mtu size="1442"/>
Nov 28 15:50:50 user nova-compute[75176]:       <target dev="tapf2811544-4c"/>
Nov 28 15:50:50 user nova-compute[75176]:     </interface>
Nov 28 15:50:50 user nova-compute[75176]:     <serial type="pty">
Nov 28 15:50:50 user nova-compute[75176]:       <log file="/opt/stack/data/nova/instances/6161cab2-eb1f-44cb-bbd5-077e6db42f77/console.log" append="off"/>
Nov 28 15:50:50 user nova-compute[75176]:     </serial>
Nov 28 15:50:50 user nova-compute[75176]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 15:50:50 user nova-compute[75176]:     <video>
Nov 28 15:50:50 user nova-compute[75176]:       <model type="virtio"/>
Nov 28 15:50:50 user nova-compute[75176]:     </video>
Nov 28 15:50:50 user nova-compute[75176]:     <rng model="virtio">
Nov 28 15:50:50 user nova-compute[75176]:       <backend model="random">/dev/urandom</backend>
Nov 28 15:50:50 user nova-compute[75176]:     </rng>
Nov 28 15:50:50 user nova-compute[75176]:     <controller type="usb" index="0" model="none"/>
Nov 28 15:50:50 user nova-compute[75176]:     <memballoon model="virtio">
Nov 28 15:50:50 user nova-compute[75176]:       <stats period="10"/>
Nov 28 15:50:50 user nova-compute[75176]:     </memballoon>
Nov 28 15:50:50 user nova-compute[75176]:   </devices>
Nov 28 15:50:50 user nova-compute[75176]: </domain>
Nov 28 15:50:50 user nova-compute[75176]:  {{(pid=75176) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 15:50:50 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-7e96ec4c-0c12-40a6-b8e5-b466b4efa195 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T15:50:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-572538979',display_name='tempest-ServerActionsTestOtherA-server-572538979',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-572538979',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOMWl0O1/eKbWND/zyjGraAKxeAyZ2R2+QgHiQ80zmzsi5uDkOgtIp8e2HjbFwlKUWmHgZppW6LnrIueD7TS7l/EkNAyCl7Y/pD0TSC3H7ZDLxYbZaFDAxH/uT7EnME+ig==',key_name='tempest-keypair-740685341',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3704b38a2bd44cb78c28d3f6d86d9e60',ramdisk_id='',reservation_id='r-s3c8yj7d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-680502445',owner_user_name='tempest-ServerActionsTestOtherA-680502445-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T15:50:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d028b79a105b485dbb0178c9da162640',uuid=6161cab2-eb1f-44cb-bbd5-077e6db42f77,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f2811544-4cf2-4302-b012-8bf1881b9b6c", "address": "fa:16:3e:2a:df:42", "network": {"id": "8b63f2d3-0683-4832-abc5-e4c796cf12ab", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-877608435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3704b38a2bd44cb78c28d3f6d86d9e60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2811544-4c", "ovs_interfaceid": "f2811544-4cf2-4302-b012-8bf1881b9b6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 15:50:50 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-7e96ec4c-0c12-40a6-b8e5-b466b4efa195 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Converting VIF {"id": "f2811544-4cf2-4302-b012-8bf1881b9b6c", "address": "fa:16:3e:2a:df:42", "network": {"id": "8b63f2d3-0683-4832-abc5-e4c796cf12ab", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-877608435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3704b38a2bd44cb78c28d3f6d86d9e60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2811544-4c", "ovs_interfaceid": "f2811544-4cf2-4302-b012-8bf1881b9b6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:50:50 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-7e96ec4c-0c12-40a6-b8e5-b466b4efa195 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2a:df:42,bridge_name='br-int',has_traffic_filtering=True,id=f2811544-4cf2-4302-b012-8bf1881b9b6c,network=Network(8b63f2d3-0683-4832-abc5-e4c796cf12ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2811544-4c') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:50:50 user nova-compute[75176]: DEBUG os_vif [None req-7e96ec4c-0c12-40a6-b8e5-b466b4efa195 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2a:df:42,bridge_name='br-int',has_traffic_filtering=True,id=f2811544-4cf2-4302-b012-8bf1881b9b6c,network=Network(8b63f2d3-0683-4832-abc5-e4c796cf12ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2811544-4c') {{(pid=75176) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 15:50:50 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:50:50 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:50:50 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 15:50:50 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:50:50 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '139691a1-84a4-5877-a52a-7e8d4cdf6301', '_type': 'linux-noop'}}, row=False) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:50:50 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:50:50 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:50:50 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:50:50 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf2811544-4c, may_exist=True, interface_attrs={}) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:50:50 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf2811544-4c, col_values=(('qos', UUID('acc97370-5cd9-4149-8553-898f52578a5d')),), if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:50:50 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf2811544-4c, col_values=(('external_ids', {'iface-id': 'f2811544-4cf2-4302-b012-8bf1881b9b6c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2a:df:42', 'vm-uuid': '6161cab2-eb1f-44cb-bbd5-077e6db42f77'}),), if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:50:50 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:50:50 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:50:50 user nova-compute[75176]: INFO os_vif [None req-7e96ec4c-0c12-40a6-b8e5-b466b4efa195 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2a:df:42,bridge_name='br-int',has_traffic_filtering=True,id=f2811544-4cf2-4302-b012-8bf1881b9b6c,network=Network(8b63f2d3-0683-4832-abc5-e4c796cf12ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2811544-4c')
Nov 28 15:50:50 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-7e96ec4c-0c12-40a6-b8e5-b466b4efa195 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] No BDM found with device name vda, not building metadata. {{(pid=75176) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 15:50:50 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-7e96ec4c-0c12-40a6-b8e5-b466b4efa195 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] No VIF found with MAC fa:16:3e:2a:df:42, not building metadata {{(pid=75176) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 15:50:50 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-caa5e99b-27ed-4f9e-89c9-71c91ae743cb tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmppxkymcoj/8e7e05520c4647718cd5d986ca00aa7e.delta /opt/stack/data/nova/instances/snapshots/tmppxkymcoj/8e7e05520c4647718cd5d986ca00aa7e" returned: 0 in 0.389s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:50:50 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-caa5e99b-27ed-4f9e-89c9-71c91ae743cb tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: f66ead7d-98f4-4822-9dce-f2ea0206a58d] Snapshot extracted, beginning image upload
Nov 28 15:50:51 user nova-compute[75176]: INFO nova.compute.manager [None req-cb489ceb-22f0-4548-a434-b9d9ef4a40d8 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] [instance: 8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7] Rescuing
Nov 28 15:50:51 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-cb489ceb-22f0-4548-a434-b9d9ef4a40d8 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Acquiring lock "refresh_cache-8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:50:51 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-cb489ceb-22f0-4548-a434-b9d9ef4a40d8 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Acquired lock "refresh_cache-8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:50:51 user nova-compute[75176]: DEBUG nova.network.neutron [None req-cb489ceb-22f0-4548-a434-b9d9ef4a40d8 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] [instance: 8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7] Building network info cache for instance {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 15:50:52 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:50:52 user nova-compute[75176]: DEBUG nova.network.neutron [None req-cb489ceb-22f0-4548-a434-b9d9ef4a40d8 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] [instance: 8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7] Updating instance_info_cache with network_info: [{"id": "dcbed8eb-5414-44c1-a7d9-2358d4549f99", "address": "fa:16:3e:fd:e1:90", "network": {"id": "d47c1797-a66f-4f2d-b83e-903b5bd3251c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1416388789-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd2856ce0a2545cda0b796eb0be10a40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcbed8eb-54", "ovs_interfaceid": "dcbed8eb-5414-44c1-a7d9-2358d4549f99", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:50:52 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-cb489ceb-22f0-4548-a434-b9d9ef4a40d8 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Releasing lock "refresh_cache-8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:50:52 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:50:52 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:50:52 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:50:52 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:50:52 user nova-compute[75176]: DEBUG nova.compute.manager [req-e790e67c-2da8-4a3d-8358-9c77cf00dbb0 req-b141e215-609e-4121-b796-19cb345ee301 service nova] [instance: 6161cab2-eb1f-44cb-bbd5-077e6db42f77] Received event network-vif-plugged-f2811544-4cf2-4302-b012-8bf1881b9b6c {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:50:52 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-e790e67c-2da8-4a3d-8358-9c77cf00dbb0 req-b141e215-609e-4121-b796-19cb345ee301 service nova] Acquiring lock "6161cab2-eb1f-44cb-bbd5-077e6db42f77-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:50:52 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-e790e67c-2da8-4a3d-8358-9c77cf00dbb0 req-b141e215-609e-4121-b796-19cb345ee301 service nova] Lock "6161cab2-eb1f-44cb-bbd5-077e6db42f77-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:50:52 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-e790e67c-2da8-4a3d-8358-9c77cf00dbb0 req-b141e215-609e-4121-b796-19cb345ee301 service nova] Lock "6161cab2-eb1f-44cb-bbd5-077e6db42f77-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:50:52 user nova-compute[75176]: DEBUG nova.compute.manager [req-e790e67c-2da8-4a3d-8358-9c77cf00dbb0 req-b141e215-609e-4121-b796-19cb345ee301 service nova] [instance: 6161cab2-eb1f-44cb-bbd5-077e6db42f77] No waiting events found dispatching network-vif-plugged-f2811544-4cf2-4302-b012-8bf1881b9b6c {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:50:52 user nova-compute[75176]: WARNING nova.compute.manager [req-e790e67c-2da8-4a3d-8358-9c77cf00dbb0 req-b141e215-609e-4121-b796-19cb345ee301 service nova] [instance: 6161cab2-eb1f-44cb-bbd5-077e6db42f77] Received unexpected event network-vif-plugged-f2811544-4cf2-4302-b012-8bf1881b9b6c for instance with vm_state building and task_state spawning.
Nov 28 15:50:52 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:50:52 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:50:52 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:50:52 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:50:53 user nova-compute[75176]: INFO nova.virt.libvirt.driver [-] [instance: 8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7] Instance destroyed successfully.
Nov 28 15:50:53 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-cb489ceb-22f0-4548-a434-b9d9ef4a40d8 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] [instance: 8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7] Attempting rescue
Nov 28 15:50:53 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-cb489ceb-22f0-4548-a434-b9d9ef4a40d8 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75176) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 28 15:50:53 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-cb489ceb-22f0-4548-a434-b9d9ef4a40d8 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] [instance: 8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7] Instance directory exists: not creating {{(pid=75176) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 28 15:50:53 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-cb489ceb-22f0-4548-a434-b9d9ef4a40d8 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] [instance: 8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7] Creating image(s)
Nov 28 15:50:53 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-cb489ceb-22f0-4548-a434-b9d9ef4a40d8 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Acquiring lock "/opt/stack/data/nova/instances/8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:50:53 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-cb489ceb-22f0-4548-a434-b9d9ef4a40d8 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Lock "/opt/stack/data/nova/instances/8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:50:53 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-cb489ceb-22f0-4548-a434-b9d9ef4a40d8 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Lock "/opt/stack/data/nova/instances/8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:50:53 user nova-compute[75176]: DEBUG nova.objects.instance [None req-cb489ceb-22f0-4548-a434-b9d9ef4a40d8 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Lazy-loading 'trusted_certs' on Instance uuid 8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7 {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:50:53 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-cb489ceb-22f0-4548-a434-b9d9ef4a40d8 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Acquiring lock "5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:50:53 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-cb489ceb-22f0-4548-a434-b9d9ef4a40d8 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Lock "5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:50:53 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-cb489ceb-22f0-4548-a434-b9d9ef4a40d8 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:50:53 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-cb489ceb-22f0-4548-a434-b9d9ef4a40d8 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json" returned: 0 in 0.235s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:50:53 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-cb489ceb-22f0-4548-a434-b9d9ef4a40d8 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2,backing_fmt=raw /opt/stack/data/nova/instances/8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7/disk.rescue {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:50:53 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-cb489ceb-22f0-4548-a434-b9d9ef4a40d8 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2,backing_fmt=raw /opt/stack/data/nova/instances/8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7/disk.rescue" returned: 0 in 0.049s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:50:53 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-cb489ceb-22f0-4548-a434-b9d9ef4a40d8 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Lock "5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.293s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:50:53 user nova-compute[75176]: DEBUG nova.objects.instance [None req-cb489ceb-22f0-4548-a434-b9d9ef4a40d8 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Lazy-loading 'migration_context' on Instance uuid 8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7 {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:50:53 user nova-compute[75176]: DEBUG nova.objects.base [None req-cb489ceb-22f0-4548-a434-b9d9ef4a40d8 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Object Instance<8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75176) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 15:50:53 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-cb489ceb-22f0-4548-a434-b9d9ef4a40d8 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] [instance: 8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7] Created local disks {{(pid=75176) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 15:50:53 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-cb489ceb-22f0-4548-a434-b9d9ef4a40d8 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] [instance: 8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7] Start _get_guest_xml network_info=[{"id": "dcbed8eb-5414-44c1-a7d9-2358d4549f99", "address": "fa:16:3e:fd:e1:90", "network": {"id": "d47c1797-a66f-4f2d-b83e-903b5bd3251c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1416388789-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1416388789-network", "vif_mac": "fa:16:3e:fd:e1:90"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd2856ce0a2545cda0b796eb0be10a40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcbed8eb-54", "ovs_interfaceid": "dcbed8eb-5414-44c1-a7d9-2358d4549f99", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T15:35:12Z,direct_url=<?>,disk_format='qcow2',id=1f41819e-c93f-4dc7-b253-37a27bbbbc74,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1b91c5d0672c4224a48df2e1f92688e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T15:35:13Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '1f41819e-c93f-4dc7-b253-37a27bbbbc74', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75176) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 15:50:53 user nova-compute[75176]: DEBUG nova.objects.instance [None req-cb489ceb-22f0-4548-a434-b9d9ef4a40d8 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Lazy-loading 'resources' on Instance uuid 8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7 {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:50:53 user nova-compute[75176]: DEBUG nova.objects.base [None req-cb489ceb-22f0-4548-a434-b9d9ef4a40d8 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Object Instance<8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75176) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 15:50:53 user nova-compute[75176]: DEBUG nova.objects.instance [None req-cb489ceb-22f0-4548-a434-b9d9ef4a40d8 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Lazy-loading 'numa_topology' on Instance uuid 8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7 {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:50:53 user nova-compute[75176]: DEBUG nova.objects.base [None req-cb489ceb-22f0-4548-a434-b9d9ef4a40d8 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Object Instance<8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75176) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 15:50:53 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-cb489ceb-22f0-4548-a434-b9d9ef4a40d8 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 15:50:53 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-cb489ceb-22f0-4548-a434-b9d9ef4a40d8 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 15:50:53 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-cb489ceb-22f0-4548-a434-b9d9ef4a40d8 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75176) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 15:50:53 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-cb489ceb-22f0-4548-a434-b9d9ef4a40d8 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] CPU controller missing on host. {{(pid=75176) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 15:50:53 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2dbdbf93-f193-4dd3-becd-1b299134aff4 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] [instance: cbefda8d-d285-404b-9817-49deada49d0b] Calling os-brick to attach iSCSI Volume {{(pid=75176) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 15:50:53 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dbdbf93-f193-4dd3-becd-1b299134aff4 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c1b8a00>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:437b8e96-e7f7-4c0e-a48b-1a36613eb5ec', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aGUZDJNL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 15:50:53 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-2dbdbf93-f193-4dd3-becd-1b299134aff4 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 15:50:53 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-2dbdbf93-f193-4dd3-becd-1b299134aff4 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 15:50:53 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-2dbdbf93-f193-4dd3-becd-1b299134aff4 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 15:50:53 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-2dbdbf93-f193-4dd3-becd-1b299134aff4 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 15:50:53 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-2dbdbf93-f193-4dd3-becd-1b299134aff4 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:437b8e96-e7f7-4c0e-a48b-1a36613eb5ec" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 15:50:53 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-2dbdbf93-f193-4dd3-becd-1b299134aff4 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:437b8e96-e7f7-4c0e-a48b-1a36613eb5ec" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 15:50:53 user nova-compute[75176]: INFO os_brick.initiator.connectors.iscsi [None req-2dbdbf93-f193-4dd3-becd-1b299134aff4 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 15:50:53 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-cb489ceb-22f0-4548-a434-b9d9ef4a40d8 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75176) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 15:50:53 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-cb489ceb-22f0-4548-a434-b9d9ef4a40d8 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] CPU controller found on host. {{(pid=75176) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 15:50:53 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-cb489ceb-22f0-4548-a434-b9d9ef4a40d8 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75176) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 15:50:53 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-cb489ceb-22f0-4548-a434-b9d9ef4a40d8 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T15:35:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T15:35:12Z,direct_url=<?>,disk_format='qcow2',id=1f41819e-c93f-4dc7-b253-37a27bbbbc74,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1b91c5d0672c4224a48df2e1f92688e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T15:35:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 15:50:53 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-cb489ceb-22f0-4548-a434-b9d9ef4a40d8 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Flavor limits 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 15:50:53 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-cb489ceb-22f0-4548-a434-b9d9ef4a40d8 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Image limits 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 15:50:53 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-cb489ceb-22f0-4548-a434-b9d9ef4a40d8 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Flavor pref 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 15:50:53 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-cb489ceb-22f0-4548-a434-b9d9ef4a40d8 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Image pref 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 15:50:53 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-cb489ceb-22f0-4548-a434-b9d9ef4a40d8 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 15:50:53 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-cb489ceb-22f0-4548-a434-b9d9ef4a40d8 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 15:50:53 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-cb489ceb-22f0-4548-a434-b9d9ef4a40d8 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75176) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 15:50:53 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-cb489ceb-22f0-4548-a434-b9d9ef4a40d8 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Got 1 possible topologies {{(pid=75176) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 15:50:53 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-cb489ceb-22f0-4548-a434-b9d9ef4a40d8 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 15:50:53 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-cb489ceb-22f0-4548-a434-b9d9ef4a40d8 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 15:50:53 user nova-compute[75176]: DEBUG nova.objects.instance [None req-cb489ceb-22f0-4548-a434-b9d9ef4a40d8 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Lazy-loading 'vcpu_model' on Instance uuid 8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7 {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:50:53 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:437b8e96-e7f7-4c0e-a48b-1a36613eb5ec -p 172.16.0.220:3260 {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:50:53 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:437b8e96-e7f7-4c0e-a48b-1a36613eb5ec -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:50:53 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[b40e3731-af8e-4e8f-88da-78f2626f3818]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:50:53 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dbdbf93-f193-4dd3-becd-1b299134aff4 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 15:50:53 user nova-compute[75176]:  {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:50:53 user nova-compute[75176]: DEBUG nova.objects.base [None req-cb489ceb-22f0-4548-a434-b9d9ef4a40d8 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Object Instance<8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75176) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 15:50:53 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-cb489ceb-22f0-4548-a434-b9d9ef4a40d8 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T15:49:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-912460137',display_name='tempest-ServerRescueNegativeTestJSON-server-912460137',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-912460137',id=32,image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-28T15:49:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fd2856ce0a2545cda0b796eb0be10a40',ramdisk_id='',reservation_id='r-buh2xw1r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1263291627',owner_user_name='tempest-ServerRescueNegativeTestJSON-1263291627-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T15:49:11Z,user_data=None,user_id='b7bd0e1b307f4d339ca2e540e063f028',uuid=8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dcbed8eb-5414-44c1-a7d9-2358d4549f99", "address": "fa:16:3e:fd:e1:90", "network": {"id": "d47c1797-a66f-4f2d-b83e-903b5bd3251c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1416388789-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1416388789-network", "vif_mac": "fa:16:3e:fd:e1:90"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd2856ce0a2545cda0b796eb0be10a40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcbed8eb-54", "ovs_interfaceid": "dcbed8eb-5414-44c1-a7d9-2358d4549f99", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75176) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 15:50:53 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-cb489ceb-22f0-4548-a434-b9d9ef4a40d8 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Converting VIF {"id": "dcbed8eb-5414-44c1-a7d9-2358d4549f99", "address": "fa:16:3e:fd:e1:90", "network": {"id": "d47c1797-a66f-4f2d-b83e-903b5bd3251c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1416388789-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1416388789-network", "vif_mac": "fa:16:3e:fd:e1:90"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd2856ce0a2545cda0b796eb0be10a40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcbed8eb-54", "ovs_interfaceid": "dcbed8eb-5414-44c1-a7d9-2358d4549f99", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:50:53 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-cb489ceb-22f0-4548-a434-b9d9ef4a40d8 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fd:e1:90,bridge_name='br-int',has_traffic_filtering=True,id=dcbed8eb-5414-44c1-a7d9-2358d4549f99,network=Network(d47c1797-a66f-4f2d-b83e-903b5bd3251c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdcbed8eb-54') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:50:53 user nova-compute[75176]: DEBUG nova.objects.instance [None req-cb489ceb-22f0-4548-a434-b9d9ef4a40d8 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Lazy-loading 'pci_devices' on Instance uuid 8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7 {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:50:53 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:437b8e96-e7f7-4c0e-a48b-1a36613eb5ec -p 172.16.0.220:3260 --interface default --op new {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:50:53 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:437b8e96-e7f7-4c0e-a48b-1a36613eb5ec -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:50:53 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[14082782-ca19-459b-941d-13e5196a8032]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:437b8e96-e7f7-4c0e-a48b-1a36613eb5ec] added\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:50:53 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dbdbf93-f193-4dd3-becd-1b299134aff4 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:437b8e96-e7f7-4c0e-a48b-1a36613eb5ec] added
Nov 28 15:50:53 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:50:53 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:437b8e96-e7f7-4c0e-a48b-1a36613eb5ec -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:50:53 user nova-compute[75176]: DEBUG nova.objects.base [None req-cb489ceb-22f0-4548-a434-b9d9ef4a40d8 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Object Instance<8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75176) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 15:50:53 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-cb489ceb-22f0-4548-a434-b9d9ef4a40d8 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] [instance: 8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7] End _get_guest_xml xml=<domain type="kvm">
Nov 28 15:50:53 user nova-compute[75176]:   <uuid>8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7</uuid>
Nov 28 15:50:53 user nova-compute[75176]:   <name>instance-00000020</name>
Nov 28 15:50:53 user nova-compute[75176]:   <memory>524288</memory>
Nov 28 15:50:53 user nova-compute[75176]:   <vcpu>1</vcpu>
Nov 28 15:50:53 user nova-compute[75176]:   <metadata>
Nov 28 15:50:53 user nova-compute[75176]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 15:50:53 user nova-compute[75176]:       <nova:package version="0.0.0"/>
Nov 28 15:50:53 user nova-compute[75176]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-912460137</nova:name>
Nov 28 15:50:53 user nova-compute[75176]:       <nova:creationTime>2023-11-28 15:50:53</nova:creationTime>
Nov 28 15:50:53 user nova-compute[75176]:       <nova:flavor name="m1.tiny">
Nov 28 15:50:53 user nova-compute[75176]:         <nova:memory>512</nova:memory>
Nov 28 15:50:53 user nova-compute[75176]:         <nova:disk>1</nova:disk>
Nov 28 15:50:53 user nova-compute[75176]:         <nova:swap>0</nova:swap>
Nov 28 15:50:53 user nova-compute[75176]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 15:50:53 user nova-compute[75176]:         <nova:vcpus>1</nova:vcpus>
Nov 28 15:50:53 user nova-compute[75176]:       </nova:flavor>
Nov 28 15:50:53 user nova-compute[75176]:       <nova:owner>
Nov 28 15:50:53 user nova-compute[75176]:         <nova:user uuid="b7bd0e1b307f4d339ca2e540e063f028">tempest-ServerRescueNegativeTestJSON-1263291627-project-member</nova:user>
Nov 28 15:50:53 user nova-compute[75176]:         <nova:project uuid="fd2856ce0a2545cda0b796eb0be10a40">tempest-ServerRescueNegativeTestJSON-1263291627</nova:project>
Nov 28 15:50:53 user nova-compute[75176]:       </nova:owner>
Nov 28 15:50:53 user nova-compute[75176]:       <nova:root type="image" uuid="1f41819e-c93f-4dc7-b253-37a27bbbbc74"/>
Nov 28 15:50:53 user nova-compute[75176]:       <nova:ports>
Nov 28 15:50:53 user nova-compute[75176]:         <nova:port uuid="dcbed8eb-5414-44c1-a7d9-2358d4549f99">
Nov 28 15:50:53 user nova-compute[75176]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 28 15:50:53 user nova-compute[75176]:         </nova:port>
Nov 28 15:50:53 user nova-compute[75176]:       </nova:ports>
Nov 28 15:50:53 user nova-compute[75176]:     </nova:instance>
Nov 28 15:50:53 user nova-compute[75176]:   </metadata>
Nov 28 15:50:53 user nova-compute[75176]:   <sysinfo type="smbios">
Nov 28 15:50:53 user nova-compute[75176]:     <system>
Nov 28 15:50:53 user nova-compute[75176]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 15:50:53 user nova-compute[75176]:       <entry name="product">OpenStack Nova</entry>
Nov 28 15:50:53 user nova-compute[75176]:       <entry name="version">0.0.0</entry>
Nov 28 15:50:53 user nova-compute[75176]:       <entry name="serial">8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7</entry>
Nov 28 15:50:53 user nova-compute[75176]:       <entry name="uuid">8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7</entry>
Nov 28 15:50:53 user nova-compute[75176]:       <entry name="family">Virtual Machine</entry>
Nov 28 15:50:53 user nova-compute[75176]:     </system>
Nov 28 15:50:53 user nova-compute[75176]:   </sysinfo>
Nov 28 15:50:53 user nova-compute[75176]:   <os>
Nov 28 15:50:53 user nova-compute[75176]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 15:50:53 user nova-compute[75176]:     <smbios mode="sysinfo"/>
Nov 28 15:50:53 user nova-compute[75176]:   </os>
Nov 28 15:50:53 user nova-compute[75176]:   <features>
Nov 28 15:50:53 user nova-compute[75176]:     <acpi/>
Nov 28 15:50:53 user nova-compute[75176]:     <apic/>
Nov 28 15:50:53 user nova-compute[75176]:     <vmcoreinfo/>
Nov 28 15:50:53 user nova-compute[75176]:   </features>
Nov 28 15:50:53 user nova-compute[75176]:   <clock offset="utc">
Nov 28 15:50:53 user nova-compute[75176]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 15:50:53 user nova-compute[75176]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 15:50:53 user nova-compute[75176]:     <timer name="hpet" present="no"/>
Nov 28 15:50:53 user nova-compute[75176]:   </clock>
Nov 28 15:50:53 user nova-compute[75176]:   <cpu mode="custom" match="exact">
Nov 28 15:50:53 user nova-compute[75176]:     <model>Nehalem</model>
Nov 28 15:50:53 user nova-compute[75176]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 15:50:53 user nova-compute[75176]:   </cpu>
Nov 28 15:50:53 user nova-compute[75176]:   <devices>
Nov 28 15:50:53 user nova-compute[75176]:     <disk type="file" device="disk">
Nov 28 15:50:53 user nova-compute[75176]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 15:50:53 user nova-compute[75176]:       <source file="/opt/stack/data/nova/instances/8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7/disk.rescue"/>
Nov 28 15:50:53 user nova-compute[75176]:       <target dev="vda" bus="virtio"/>
Nov 28 15:50:53 user nova-compute[75176]:     </disk>
Nov 28 15:50:53 user nova-compute[75176]:     <disk type="file" device="disk">
Nov 28 15:50:53 user nova-compute[75176]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 15:50:53 user nova-compute[75176]:       <source file="/opt/stack/data/nova/instances/8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7/disk"/>
Nov 28 15:50:53 user nova-compute[75176]:       <target dev="vdb" bus="virtio"/>
Nov 28 15:50:53 user nova-compute[75176]:     </disk>
Nov 28 15:50:53 user nova-compute[75176]:     <interface type="ethernet">
Nov 28 15:50:53 user nova-compute[75176]:       <mac address="fa:16:3e:fd:e1:90"/>
Nov 28 15:50:53 user nova-compute[75176]:       <model type="virtio"/>
Nov 28 15:50:53 user nova-compute[75176]:       <mtu size="1442"/>
Nov 28 15:50:53 user nova-compute[75176]:       <target dev="tapdcbed8eb-54"/>
Nov 28 15:50:53 user nova-compute[75176]:     </interface>
Nov 28 15:50:53 user nova-compute[75176]:     <serial type="pty">
Nov 28 15:50:53 user nova-compute[75176]:       <log file="/opt/stack/data/nova/instances/8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7/console.log" append="off"/>
Nov 28 15:50:53 user nova-compute[75176]:     </serial>
Nov 28 15:50:53 user nova-compute[75176]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 15:50:53 user nova-compute[75176]:     <video>
Nov 28 15:50:53 user nova-compute[75176]:       <model type="virtio"/>
Nov 28 15:50:53 user nova-compute[75176]:     </video>
Nov 28 15:50:53 user nova-compute[75176]:     <rng model="virtio">
Nov 28 15:50:53 user nova-compute[75176]:       <backend model="random">/dev/urandom</backend>
Nov 28 15:50:53 user nova-compute[75176]:     </rng>
Nov 28 15:50:53 user nova-compute[75176]:     <controller type="usb" index="0" model="none"/>
Nov 28 15:50:53 user nova-compute[75176]:     <memballoon model="virtio">
Nov 28 15:50:53 user nova-compute[75176]:       <stats period="10"/>
Nov 28 15:50:53 user nova-compute[75176]:     </memballoon>
Nov 28 15:50:53 user nova-compute[75176]:   </devices>
Nov 28 15:50:53 user nova-compute[75176]: </domain>
Nov 28 15:50:53 user nova-compute[75176]:  {{(pid=75176) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 15:50:53 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:437b8e96-e7f7-4c0e-a48b-1a36613eb5ec -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:50:53 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[182ea595-d125-4210-823e-c7658ef29991]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:50:53 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dbdbf93-f193-4dd3-becd-1b299134aff4 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:50:53 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:437b8e96-e7f7-4c0e-a48b-1a36613eb5ec -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:50:53 user nova-compute[75176]: INFO nova.virt.libvirt.driver [-] [instance: 8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7] Instance destroyed successfully.
Nov 28 15:50:53 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:437b8e96-e7f7-4c0e-a48b-1a36613eb5ec -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:50:53 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[c386cdce-e70b-4fec-aebc-cfba23189361]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:50:53 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dbdbf93-f193-4dd3-becd-1b299134aff4 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:50:53 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:437b8e96-e7f7-4c0e-a48b-1a36613eb5ec -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aGUZDJNL {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:50:53 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:437b8e96-e7f7-4c0e-a48b-1a36613eb5ec -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aGUZDJNL" returned: 0 in 0.018s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:50:53 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[98c35830-0f87-42a6-abfc-cb81bb34a19a]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:50:53 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dbdbf93-f193-4dd3-becd-1b299134aff4 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'aGUZDJNL'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:50:53 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-caa5e99b-27ed-4f9e-89c9-71c91ae743cb tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: f66ead7d-98f4-4822-9dce-f2ea0206a58d] Snapshot image upload complete
Nov 28 15:50:53 user nova-compute[75176]: INFO nova.compute.manager [None req-caa5e99b-27ed-4f9e-89c9-71c91ae743cb tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: f66ead7d-98f4-4822-9dce-f2ea0206a58d] Took 5.48 seconds to snapshot the instance on the hypervisor.
Nov 28 15:50:53 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:437b8e96-e7f7-4c0e-a48b-1a36613eb5ec -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:50:53 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:437b8e96-e7f7-4c0e-a48b-1a36613eb5ec -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:50:53 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[81c31e9a-7f2c-46c1-a41d-03077254f998]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:50:53 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dbdbf93-f193-4dd3-becd-1b299134aff4 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:50:53 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:50:53 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-cb489ceb-22f0-4548-a434-b9d9ef4a40d8 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] No BDM found with device name vda, not building metadata. {{(pid=75176) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 15:50:53 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-cb489ceb-22f0-4548-a434-b9d9ef4a40d8 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75176) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 15:50:53 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-cb489ceb-22f0-4548-a434-b9d9ef4a40d8 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] No VIF found with MAC fa:16:3e:fd:e1:90, not building metadata {{(pid=75176) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 15:50:53 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:50:53 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1bae5df-9177-4102-84f8-04212407d6cc]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8452525c-6845-4edb-bf69-1e2ffe0ef2eb (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36b14046-bbe0-45c6-add0-ab16578b41d3 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:370d91ef-d3c5-4019-b447-3f8134556e11 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21587566-b951-4b3e-8024-b6c2d2da35af (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07de7953-293c-4762-b695-ed3190c934d5 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc (non-flash)\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:50:53 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dbdbf93-f193-4dd3-becd-1b299134aff4 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8452525c-6845-4edb-bf69-1e2ffe0ef2eb (non-flash)
Nov 28 15:50:53 user nova-compute[75176]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36b14046-bbe0-45c6-add0-ab16578b41d3 (non-flash)
Nov 28 15:50:53 user nova-compute[75176]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:370d91ef-d3c5-4019-b447-3f8134556e11 (non-flash)
Nov 28 15:50:53 user nova-compute[75176]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21587566-b951-4b3e-8024-b6c2d2da35af (non-flash)
Nov 28 15:50:53 user nova-compute[75176]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07de7953-293c-4762-b695-ed3190c934d5 (non-flash)
Nov 28 15:50:53 user nova-compute[75176]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc (non-flash)
Nov 28 15:50:53 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:50:53 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dbdbf93-f193-4dd3-becd-1b299134aff4 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8452525c-6845-4edb-bf69-1e2ffe0ef2eb (non-flash)
Nov 28 15:50:53 user nova-compute[75176]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36b14046-bbe0-45c6-add0-ab16578b41d3 (non-flash)
Nov 28 15:50:53 user nova-compute[75176]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:370d91ef-d3c5-4019-b447-3f8134556e11 (non-flash)
Nov 28 15:50:53 user nova-compute[75176]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21587566-b951-4b3e-8024-b6c2d2da35af (non-flash)
Nov 28 15:50:53 user nova-compute[75176]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07de7953-293c-4762-b695-ed3190c934d5 (non-flash)
Nov 28 15:50:53 user nova-compute[75176]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc (non-flash)
Nov 28 15:50:53 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 15:50:53 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:437b8e96-e7f7-4c0e-a48b-1a36613eb5ec -p 172.16.0.220:3260 --login {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:50:53 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:437b8e96-e7f7-4c0e-a48b-1a36613eb5ec -p 172.16.0.220:3260 --login" returned: 0 in 0.090s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:50:53 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[29874484-ee6e-482f-a83a-6d5df86a5a75]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:437b8e96-e7f7-4c0e-a48b-1a36613eb5ec, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:437b8e96-e7f7-4c0e-a48b-1a36613eb5ec, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:50:53 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dbdbf93-f193-4dd3-becd-1b299134aff4 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:437b8e96-e7f7-4c0e-a48b-1a36613eb5ec, portal: 172.16.0.220,3260]
Nov 28 15:50:53 user nova-compute[75176]: Login to [iface: default, target: iqn.2010-10.org.openstack:437b8e96-e7f7-4c0e-a48b-1a36613eb5ec, portal: 172.16.0.220,3260] successful.
Nov 28 15:50:53 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:50:53 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:437b8e96-e7f7-4c0e-a48b-1a36613eb5ec -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:50:53 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:437b8e96-e7f7-4c0e-a48b-1a36613eb5ec -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:50:53 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[4acd9f27-b174-4d9d-9237-8426e6eb796f]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:50:53 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dbdbf93-f193-4dd3-becd-1b299134aff4 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:50:53 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:50:53 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:50:53 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[d829a4be-af4d-4ded-88f5-f9757d39b671]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8452525c-6845-4edb-bf69-1e2ffe0ef2eb (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36b14046-bbe0-45c6-add0-ab16578b41d3 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:370d91ef-d3c5-4019-b447-3f8134556e11 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21587566-b951-4b3e-8024-b6c2d2da35af (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07de7953-293c-4762-b695-ed3190c934d5 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:437b8e96-e7f7-4c0e-a48b-1a36613eb5ec (non-flash)\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:50:53 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dbdbf93-f193-4dd3-becd-1b299134aff4 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8452525c-6845-4edb-bf69-1e2ffe0ef2eb (non-flash)
Nov 28 15:50:53 user nova-compute[75176]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36b14046-bbe0-45c6-add0-ab16578b41d3 (non-flash)
Nov 28 15:50:53 user nova-compute[75176]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:370d91ef-d3c5-4019-b447-3f8134556e11 (non-flash)
Nov 28 15:50:53 user nova-compute[75176]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21587566-b951-4b3e-8024-b6c2d2da35af (non-flash)
Nov 28 15:50:53 user nova-compute[75176]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07de7953-293c-4762-b695-ed3190c934d5 (non-flash)
Nov 28 15:50:53 user nova-compute[75176]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc (non-flash)
Nov 28 15:50:53 user nova-compute[75176]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:437b8e96-e7f7-4c0e-a48b-1a36613eb5ec (non-flash)
Nov 28 15:50:53 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:50:53 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dbdbf93-f193-4dd3-becd-1b299134aff4 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8452525c-6845-4edb-bf69-1e2ffe0ef2eb (non-flash)
Nov 28 15:50:53 user nova-compute[75176]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36b14046-bbe0-45c6-add0-ab16578b41d3 (non-flash)
Nov 28 15:50:53 user nova-compute[75176]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:370d91ef-d3c5-4019-b447-3f8134556e11 (non-flash)
Nov 28 15:50:53 user nova-compute[75176]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21587566-b951-4b3e-8024-b6c2d2da35af (non-flash)
Nov 28 15:50:53 user nova-compute[75176]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07de7953-293c-4762-b695-ed3190c934d5 (non-flash)
Nov 28 15:50:53 user nova-compute[75176]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc (non-flash)
Nov 28 15:50:53 user nova-compute[75176]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:437b8e96-e7f7-4c0e-a48b-1a36613eb5ec (non-flash)
Nov 28 15:50:53 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 15:50:53 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-2dbdbf93-f193-4dd3-becd-1b299134aff4 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:437b8e96-e7f7-4c0e-a48b-1a36613eb5ec" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.339s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 15:50:53 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dbdbf93-f193-4dd3-becd-1b299134aff4 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Connected to 172.16.0.220:3260 {{(pid=75176) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 15:50:53 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-2dbdbf93-f193-4dd3-becd-1b299134aff4 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] HCTL ('39', '-', '-', 0) found on session 38 with lun 0 {{(pid=75176) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 15:50:53 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-2dbdbf93-f193-4dd3-becd-1b299134aff4 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=75176) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 15:50:53 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:50:53 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.018s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:50:53 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa0c5613-a242-4cb6-a56b-33fee94c77ba]: (4, ('- - 0', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:50:53 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-2dbdbf93-f193-4dd3-becd-1b299134aff4 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Searching for a device in session 38 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=75176) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 15:50:53 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dbdbf93-f193-4dd3-becd-1b299134aff4 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:437b8e96-e7f7-4c0e-a48b-1a36613eb5ec', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aGUZDJNL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75176) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 15:50:54 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:50:54 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7e96ec4c-0c12-40a6-b8e5-b466b4efa195 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] [instance: 6161cab2-eb1f-44cb-bbd5-077e6db42f77] Instance event wait completed in 0 seconds for  {{(pid=75176) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 15:50:54 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-7e96ec4c-0c12-40a6-b8e5-b466b4efa195 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] [instance: 6161cab2-eb1f-44cb-bbd5-077e6db42f77] Guest created on hypervisor {{(pid=75176) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 15:50:54 user nova-compute[75176]: INFO nova.virt.libvirt.driver [-] [instance: 6161cab2-eb1f-44cb-bbd5-077e6db42f77] Instance spawned successfully.
Nov 28 15:50:54 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-7e96ec4c-0c12-40a6-b8e5-b466b4efa195 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] [instance: 6161cab2-eb1f-44cb-bbd5-077e6db42f77] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 15:50:54 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-7e96ec4c-0c12-40a6-b8e5-b466b4efa195 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] [instance: 6161cab2-eb1f-44cb-bbd5-077e6db42f77] Found default for hw_cdrom_bus of ide {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:50:54 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-7e96ec4c-0c12-40a6-b8e5-b466b4efa195 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] [instance: 6161cab2-eb1f-44cb-bbd5-077e6db42f77] Found default for hw_disk_bus of virtio {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:50:54 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-7e96ec4c-0c12-40a6-b8e5-b466b4efa195 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] [instance: 6161cab2-eb1f-44cb-bbd5-077e6db42f77] Found default for hw_input_bus of None {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:50:54 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-7e96ec4c-0c12-40a6-b8e5-b466b4efa195 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] [instance: 6161cab2-eb1f-44cb-bbd5-077e6db42f77] Found default for hw_pointer_model of None {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:50:54 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-7e96ec4c-0c12-40a6-b8e5-b466b4efa195 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] [instance: 6161cab2-eb1f-44cb-bbd5-077e6db42f77] Found default for hw_video_model of virtio {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:50:54 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-7e96ec4c-0c12-40a6-b8e5-b466b4efa195 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] [instance: 6161cab2-eb1f-44cb-bbd5-077e6db42f77] Found default for hw_vif_model of virtio {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:50:54 user nova-compute[75176]: DEBUG nova.compute.manager [req-a9b4cf14-a177-4e46-ba44-6374b6bf70d4 req-c8425643-d4a7-48d9-ba40-5156ca2bea6c service nova] [instance: 6161cab2-eb1f-44cb-bbd5-077e6db42f77] Received event network-vif-plugged-f2811544-4cf2-4302-b012-8bf1881b9b6c {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:50:54 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-a9b4cf14-a177-4e46-ba44-6374b6bf70d4 req-c8425643-d4a7-48d9-ba40-5156ca2bea6c service nova] Acquiring lock "6161cab2-eb1f-44cb-bbd5-077e6db42f77-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:50:54 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-a9b4cf14-a177-4e46-ba44-6374b6bf70d4 req-c8425643-d4a7-48d9-ba40-5156ca2bea6c service nova] Lock "6161cab2-eb1f-44cb-bbd5-077e6db42f77-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:50:54 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-a9b4cf14-a177-4e46-ba44-6374b6bf70d4 req-c8425643-d4a7-48d9-ba40-5156ca2bea6c service nova] Lock "6161cab2-eb1f-44cb-bbd5-077e6db42f77-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:50:54 user nova-compute[75176]: DEBUG nova.compute.manager [req-a9b4cf14-a177-4e46-ba44-6374b6bf70d4 req-c8425643-d4a7-48d9-ba40-5156ca2bea6c service nova] [instance: 6161cab2-eb1f-44cb-bbd5-077e6db42f77] No waiting events found dispatching network-vif-plugged-f2811544-4cf2-4302-b012-8bf1881b9b6c {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:50:54 user nova-compute[75176]: WARNING nova.compute.manager [req-a9b4cf14-a177-4e46-ba44-6374b6bf70d4 req-c8425643-d4a7-48d9-ba40-5156ca2bea6c service nova] [instance: 6161cab2-eb1f-44cb-bbd5-077e6db42f77] Received unexpected event network-vif-plugged-f2811544-4cf2-4302-b012-8bf1881b9b6c for instance with vm_state building and task_state spawning.
Nov 28 15:50:54 user nova-compute[75176]: DEBUG nova.compute.manager [req-a9b4cf14-a177-4e46-ba44-6374b6bf70d4 req-c8425643-d4a7-48d9-ba40-5156ca2bea6c service nova] [instance: 8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7] Received event network-vif-unplugged-dcbed8eb-5414-44c1-a7d9-2358d4549f99 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:50:54 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-a9b4cf14-a177-4e46-ba44-6374b6bf70d4 req-c8425643-d4a7-48d9-ba40-5156ca2bea6c service nova] Acquiring lock "8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:50:54 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-a9b4cf14-a177-4e46-ba44-6374b6bf70d4 req-c8425643-d4a7-48d9-ba40-5156ca2bea6c service nova] Lock "8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:50:54 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-a9b4cf14-a177-4e46-ba44-6374b6bf70d4 req-c8425643-d4a7-48d9-ba40-5156ca2bea6c service nova] Lock "8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:50:54 user nova-compute[75176]: DEBUG nova.compute.manager [req-a9b4cf14-a177-4e46-ba44-6374b6bf70d4 req-c8425643-d4a7-48d9-ba40-5156ca2bea6c service nova] [instance: 8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7] No waiting events found dispatching network-vif-unplugged-dcbed8eb-5414-44c1-a7d9-2358d4549f99 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:50:54 user nova-compute[75176]: WARNING nova.compute.manager [req-a9b4cf14-a177-4e46-ba44-6374b6bf70d4 req-c8425643-d4a7-48d9-ba40-5156ca2bea6c service nova] [instance: 8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7] Received unexpected event network-vif-unplugged-dcbed8eb-5414-44c1-a7d9-2358d4549f99 for instance with vm_state active and task_state rescuing.
Nov 28 15:50:54 user nova-compute[75176]: DEBUG nova.compute.manager [req-a9b4cf14-a177-4e46-ba44-6374b6bf70d4 req-c8425643-d4a7-48d9-ba40-5156ca2bea6c service nova] [instance: 8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7] Received event network-vif-plugged-dcbed8eb-5414-44c1-a7d9-2358d4549f99 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:50:54 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-a9b4cf14-a177-4e46-ba44-6374b6bf70d4 req-c8425643-d4a7-48d9-ba40-5156ca2bea6c service nova] Acquiring lock "8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:50:54 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-a9b4cf14-a177-4e46-ba44-6374b6bf70d4 req-c8425643-d4a7-48d9-ba40-5156ca2bea6c service nova] Lock "8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:50:54 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-a9b4cf14-a177-4e46-ba44-6374b6bf70d4 req-c8425643-d4a7-48d9-ba40-5156ca2bea6c service nova] Lock "8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:50:54 user nova-compute[75176]: DEBUG nova.compute.manager [req-a9b4cf14-a177-4e46-ba44-6374b6bf70d4 req-c8425643-d4a7-48d9-ba40-5156ca2bea6c service nova] [instance: 8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7] No waiting events found dispatching network-vif-plugged-dcbed8eb-5414-44c1-a7d9-2358d4549f99 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:50:54 user nova-compute[75176]: WARNING nova.compute.manager [req-a9b4cf14-a177-4e46-ba44-6374b6bf70d4 req-c8425643-d4a7-48d9-ba40-5156ca2bea6c service nova] [instance: 8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7] Received unexpected event network-vif-plugged-dcbed8eb-5414-44c1-a7d9-2358d4549f99 for instance with vm_state active and task_state rescuing.
Nov 28 15:50:54 user nova-compute[75176]: INFO nova.compute.manager [None req-7e96ec4c-0c12-40a6-b8e5-b466b4efa195 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] [instance: 6161cab2-eb1f-44cb-bbd5-077e6db42f77] Took 5.29 seconds to spawn the instance on the hypervisor.
Nov 28 15:50:54 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7e96ec4c-0c12-40a6-b8e5-b466b4efa195 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] [instance: 6161cab2-eb1f-44cb-bbd5-077e6db42f77] Checking state {{(pid=75176) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 15:50:54 user nova-compute[75176]: INFO nova.compute.manager [None req-7e96ec4c-0c12-40a6-b8e5-b466b4efa195 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] [instance: 6161cab2-eb1f-44cb-bbd5-077e6db42f77] Took 14.35 seconds to build instance.
Nov 28 15:50:54 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7e96ec4c-0c12-40a6-b8e5-b466b4efa195 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Lock "6161cab2-eb1f-44cb-bbd5-077e6db42f77" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.465s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:50:54 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:50:54 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:50:54 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-2dbdbf93-f193-4dd3-becd-1b299134aff4 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.380s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 15:50:54 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dbdbf93-f193-4dd3-becd-1b299134aff4 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] <== connect_volume: return (1382ms) {'type': 'block', 'scsi_wwn': '26162303333663432', 'path': '/dev/sdh'} {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 15:50:54 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2dbdbf93-f193-4dd3-becd-1b299134aff4 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] [instance: cbefda8d-d285-404b-9817-49deada49d0b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26162303333663432', 'path': '/dev/sdh'} {{(pid=75176) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 15:50:54 user nova-compute[75176]: DEBUG nova.objects.instance [None req-2dbdbf93-f193-4dd3-becd-1b299134aff4 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Lazy-loading 'flavor' on Instance uuid cbefda8d-d285-404b-9817-49deada49d0b {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:50:54 user nova-compute[75176]: DEBUG nova.virt.libvirt.guest [None req-2dbdbf93-f193-4dd3-becd-1b299134aff4 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 15:50:54 user nova-compute[75176]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 15:50:54 user nova-compute[75176]:   <source dev="/dev/sdh"/>
Nov 28 15:50:54 user nova-compute[75176]:   <target dev="vdb" bus="virtio"/>
Nov 28 15:50:54 user nova-compute[75176]:   <serial>437b8e96-e7f7-4c0e-a48b-1a36613eb5ec</serial>
Nov 28 15:50:54 user nova-compute[75176]: </disk>
Nov 28 15:50:54 user nova-compute[75176]:  {{(pid=75176) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 15:50:54 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:50:55 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:50:55 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:50:55 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:50:55 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:50:55 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-2dbdbf93-f193-4dd3-becd-1b299134aff4 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] No BDM found with device name vda, not building metadata. {{(pid=75176) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 15:50:55 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-2dbdbf93-f193-4dd3-becd-1b299134aff4 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75176) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 15:50:55 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-2dbdbf93-f193-4dd3-becd-1b299134aff4 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] No VIF found with MAC fa:16:3e:b8:33:b8, not building metadata {{(pid=75176) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 15:50:55 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-2dbdbf93-f193-4dd3-becd-1b299134aff4 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Lock "cbefda8d-d285-404b-9817-49deada49d0b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.006s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:50:55 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:50:55 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:50:56 user nova-compute[75176]: DEBUG nova.compute.manager [req-8ccc40e0-b364-4b2d-9a81-66763c4d63cf req-b477fb7e-6c0d-4082-b447-0979fe2ac219 service nova] [instance: 8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7] Received event network-vif-plugged-dcbed8eb-5414-44c1-a7d9-2358d4549f99 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:50:56 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-8ccc40e0-b364-4b2d-9a81-66763c4d63cf req-b477fb7e-6c0d-4082-b447-0979fe2ac219 service nova] Acquiring lock "8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:50:56 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-8ccc40e0-b364-4b2d-9a81-66763c4d63cf req-b477fb7e-6c0d-4082-b447-0979fe2ac219 service nova] Lock "8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:50:56 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-8ccc40e0-b364-4b2d-9a81-66763c4d63cf req-b477fb7e-6c0d-4082-b447-0979fe2ac219 service nova] Lock "8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:50:56 user nova-compute[75176]: DEBUG nova.compute.manager [req-8ccc40e0-b364-4b2d-9a81-66763c4d63cf req-b477fb7e-6c0d-4082-b447-0979fe2ac219 service nova] [instance: 8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7] No waiting events found dispatching network-vif-plugged-dcbed8eb-5414-44c1-a7d9-2358d4549f99 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:50:56 user nova-compute[75176]: WARNING nova.compute.manager [req-8ccc40e0-b364-4b2d-9a81-66763c4d63cf req-b477fb7e-6c0d-4082-b447-0979fe2ac219 service nova] [instance: 8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7] Received unexpected event network-vif-plugged-dcbed8eb-5414-44c1-a7d9-2358d4549f99 for instance with vm_state active and task_state rescuing.
Nov 28 15:50:56 user nova-compute[75176]: DEBUG nova.compute.manager [req-8ccc40e0-b364-4b2d-9a81-66763c4d63cf req-b477fb7e-6c0d-4082-b447-0979fe2ac219 service nova] [instance: 8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7] Received event network-vif-plugged-dcbed8eb-5414-44c1-a7d9-2358d4549f99 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:50:56 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-8ccc40e0-b364-4b2d-9a81-66763c4d63cf req-b477fb7e-6c0d-4082-b447-0979fe2ac219 service nova] Acquiring lock "8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:50:56 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-8ccc40e0-b364-4b2d-9a81-66763c4d63cf req-b477fb7e-6c0d-4082-b447-0979fe2ac219 service nova] Lock "8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:50:56 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-8ccc40e0-b364-4b2d-9a81-66763c4d63cf req-b477fb7e-6c0d-4082-b447-0979fe2ac219 service nova] Lock "8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:50:56 user nova-compute[75176]: DEBUG nova.compute.manager [req-8ccc40e0-b364-4b2d-9a81-66763c4d63cf req-b477fb7e-6c0d-4082-b447-0979fe2ac219 service nova] [instance: 8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7] No waiting events found dispatching network-vif-plugged-dcbed8eb-5414-44c1-a7d9-2358d4549f99 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:50:56 user nova-compute[75176]: WARNING nova.compute.manager [req-8ccc40e0-b364-4b2d-9a81-66763c4d63cf req-b477fb7e-6c0d-4082-b447-0979fe2ac219 service nova] [instance: 8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7] Received unexpected event network-vif-plugged-dcbed8eb-5414-44c1-a7d9-2358d4549f99 for instance with vm_state active and task_state rescuing.
Nov 28 15:50:56 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-f6039dae-1827-48dc-b42e-5d0a7b032d83 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Acquiring lock "cbefda8d-d285-404b-9817-49deada49d0b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:50:56 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-f6039dae-1827-48dc-b42e-5d0a7b032d83 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Lock "cbefda8d-d285-404b-9817-49deada49d0b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:50:56 user nova-compute[75176]: INFO nova.compute.manager [None req-f6039dae-1827-48dc-b42e-5d0a7b032d83 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] [instance: cbefda8d-d285-404b-9817-49deada49d0b] Detaching volume 437b8e96-e7f7-4c0e-a48b-1a36613eb5ec
Nov 28 15:50:56 user nova-compute[75176]: INFO nova.virt.block_device [None req-f6039dae-1827-48dc-b42e-5d0a7b032d83 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] [instance: cbefda8d-d285-404b-9817-49deada49d0b] Attempting to driver detach volume 437b8e96-e7f7-4c0e-a48b-1a36613eb5ec from mountpoint /dev/vdb
Nov 28 15:50:56 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-f6039dae-1827-48dc-b42e-5d0a7b032d83 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Attempting to detach device vdb from instance cbefda8d-d285-404b-9817-49deada49d0b from the persistent domain config. {{(pid=75176) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 15:50:56 user nova-compute[75176]: DEBUG nova.virt.libvirt.guest [None req-f6039dae-1827-48dc-b42e-5d0a7b032d83 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 15:50:56 user nova-compute[75176]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 15:50:56 user nova-compute[75176]:   <source dev="/dev/sdh"/>
Nov 28 15:50:56 user nova-compute[75176]:   <target dev="vdb" bus="virtio"/>
Nov 28 15:50:56 user nova-compute[75176]:   <serial>437b8e96-e7f7-4c0e-a48b-1a36613eb5ec</serial>
Nov 28 15:50:56 user nova-compute[75176]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 15:50:56 user nova-compute[75176]: </disk>
Nov 28 15:50:56 user nova-compute[75176]:  {{(pid=75176) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 15:50:56 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-f6039dae-1827-48dc-b42e-5d0a7b032d83 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Successfully detached device vdb from instance cbefda8d-d285-404b-9817-49deada49d0b from the persistent domain config.
Nov 28 15:50:56 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-f6039dae-1827-48dc-b42e-5d0a7b032d83 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance cbefda8d-d285-404b-9817-49deada49d0b from the live domain config. {{(pid=75176) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 15:50:56 user nova-compute[75176]: DEBUG nova.virt.libvirt.guest [None req-f6039dae-1827-48dc-b42e-5d0a7b032d83 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 15:50:56 user nova-compute[75176]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 15:50:56 user nova-compute[75176]:   <source dev="/dev/sdh"/>
Nov 28 15:50:56 user nova-compute[75176]:   <target dev="vdb" bus="virtio"/>
Nov 28 15:50:56 user nova-compute[75176]:   <serial>437b8e96-e7f7-4c0e-a48b-1a36613eb5ec</serial>
Nov 28 15:50:56 user nova-compute[75176]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 15:50:56 user nova-compute[75176]: </disk>
Nov 28 15:50:56 user nova-compute[75176]:  {{(pid=75176) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 15:50:57 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-f6039dae-1827-48dc-b42e-5d0a7b032d83 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance cbefda8d-d285-404b-9817-49deada49d0b {{(pid=75176) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 15:50:57 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:50:57 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:50:57 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:50:57 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75176) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 15:50:57 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:50:57 user nova-compute[75176]: DEBUG nova.compute.manager [None req-cb489ceb-22f0-4548-a434-b9d9ef4a40d8 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] [instance: 8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7] Checking state {{(pid=75176) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 15:50:59 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:50:59 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:50:59 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Starting heal instance info cache {{(pid=75176) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 15:50:59 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Rebuilding the list of instances to heal {{(pid=75176) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 15:50:59 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] [instance: 6d061df5-8dbc-4fc1-9935-d46efc934b58] Skipping network cache update for instance because it is being deleted. {{(pid=75176) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9939}}
Nov 28 15:50:59 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquiring lock "refresh_cache-2e8507b7-fccf-4196-b589-bf2b74f165ec" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:50:59 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquired lock "refresh_cache-2e8507b7-fccf-4196-b589-bf2b74f165ec" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:50:59 user nova-compute[75176]: DEBUG nova.network.neutron [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] [instance: 2e8507b7-fccf-4196-b589-bf2b74f165ec] Forcefully refreshing network info cache for instance {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 15:50:59 user nova-compute[75176]: DEBUG nova.objects.instance [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lazy-loading 'info_cache' on Instance uuid 2e8507b7-fccf-4196-b589-bf2b74f165ec {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:51:00 user nova-compute[75176]: DEBUG nova.network.neutron [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] [instance: 2e8507b7-fccf-4196-b589-bf2b74f165ec] Updating instance_info_cache with network_info: [{"id": "3dc67fc3-7fcf-4655-8dbd-22febf2be39e", "address": "fa:16:3e:04:68:53", "network": {"id": "8b63f2d3-0683-4832-abc5-e4c796cf12ab", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-877608435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3704b38a2bd44cb78c28d3f6d86d9e60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dc67fc3-7f", "ovs_interfaceid": "3dc67fc3-7fcf-4655-8dbd-22febf2be39e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:51:00 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Releasing lock "refresh_cache-2e8507b7-fccf-4196-b589-bf2b74f165ec" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:51:00 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] [instance: 2e8507b7-fccf-4196-b589-bf2b74f165ec] Updated the network info_cache for instance {{(pid=75176) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 15:51:00 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:51:00 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:51:00 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:51:00 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:51:00 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Auditing locally available compute resources for user (node: user) {{(pid=75176) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 15:51:00 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:51:00 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55febf04-14ea-4903-8692-c7cc6115de75/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:51:00 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:51:01 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55febf04-14ea-4903-8692-c7cc6115de75/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:51:01 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55febf04-14ea-4903-8692-c7cc6115de75/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:51:01 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55febf04-14ea-4903-8692-c7cc6115de75/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:51:01 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e8507b7-fccf-4196-b589-bf2b74f165ec/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:51:01 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e8507b7-fccf-4196-b589-bf2b74f165ec/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:51:01 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e8507b7-fccf-4196-b589-bf2b74f165ec/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:51:01 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e8507b7-fccf-4196-b589-bf2b74f165ec/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:51:01 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e8a6e1b-4f71-494a-8f44-f9643c658021/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:51:01 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e8a6e1b-4f71-494a-8f44-f9643c658021/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:51:01 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e8a6e1b-4f71-494a-8f44-f9643c658021/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:51:02 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e8a6e1b-4f71-494a-8f44-f9643c658021/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:51:02 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbefda8d-d285-404b-9817-49deada49d0b/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:51:02 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbefda8d-d285-404b-9817-49deada49d0b/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:51:02 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbefda8d-d285-404b-9817-49deada49d0b/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:51:02 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbefda8d-d285-404b-9817-49deada49d0b/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:51:02 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d061df5-8dbc-4fc1-9935-d46efc934b58/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:51:02 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d061df5-8dbc-4fc1-9935-d46efc934b58/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:51:02 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d061df5-8dbc-4fc1-9935-d46efc934b58/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:51:02 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d061df5-8dbc-4fc1-9935-d46efc934b58/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:51:02 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75176) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 15:51:02 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75176) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 15:51:02 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6ebcc53-802a-4515-ba41-3e8e1129235f/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:51:03 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6ebcc53-802a-4515-ba41-3e8e1129235f/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:51:03 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6ebcc53-802a-4515-ba41-3e8e1129235f/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:51:03 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6ebcc53-802a-4515-ba41-3e8e1129235f/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:51:03 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75176) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 15:51:03 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66ead7d-98f4-4822-9dce-f2ea0206a58d/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:51:03 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66ead7d-98f4-4822-9dce-f2ea0206a58d/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:51:03 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66ead7d-98f4-4822-9dce-f2ea0206a58d/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:51:03 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-397396a5-90bd-4e2f-aa7f-71782337a76a tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 6d061df5-8dbc-4fc1-9935-d46efc934b58 is timed out.
Nov 28 15:51:03 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-397396a5-90bd-4e2f-aa7f-71782337a76a tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Successfully detached device vdb from instance 6d061df5-8dbc-4fc1-9935-d46efc934b58 from the live domain config.
Nov 28 15:51:03 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-397396a5-90bd-4e2f-aa7f-71782337a76a tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] [instance: 6d061df5-8dbc-4fc1-9935-d46efc934b58] calling os-brick to detach iSCSI Volume {{(pid=75176) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 15:51:03 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-397396a5-90bd-4e2f-aa7f-71782337a76a tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c1b8a00>, {'target_iqn': 'iqn.2010-10.org.openstack:370d91ef-d3c5-4019-b447-3f8134556e11', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CrMsKZpx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 15:51:03 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-397396a5-90bd-4e2f-aa7f-71782337a76a tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 15:51:03 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-397396a5-90bd-4e2f-aa7f-71782337a76a tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 15:51:03 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-397396a5-90bd-4e2f-aa7f-71782337a76a tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 15:51:03 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:51:03 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:51:03 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd352740-9f8a-4bb9-9c35-425f35520a9c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8452525c-6845-4edb-bf69-1e2ffe0ef2eb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:36b14046-bbe0-45c6-add0-ab16578b41d3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:370d91ef-d3c5-4019-b447-3f8134556e11\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:21587566-b951-4b3e-8024-b6c2d2da35af\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:437b8e96-e7f7-4c0e-a48b-1a36613eb5ec\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:07de7953-293c-4762-b695-ed3190c934d5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:51:03 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-397396a5-90bd-4e2f-aa7f-71782337a76a tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 15:51:03 user nova-compute[75176]: No targets found.
Nov 28 15:51:03 user nova-compute[75176]: iSNS:
Nov 28 15:51:03 user nova-compute[75176]: No targets found.
Nov 28 15:51:03 user nova-compute[75176]: STATIC:
Nov 28 15:51:03 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:8452525c-6845-4edb-bf69-1e2ffe0ef2eb
Nov 28 15:51:03 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:51:03 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:51:03 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:36b14046-bbe0-45c6-add0-ab16578b41d3
Nov 28 15:51:03 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:51:03 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:51:03 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:370d91ef-d3c5-4019-b447-3f8134556e11
Nov 28 15:51:03 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:51:03 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:51:03 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc
Nov 28 15:51:03 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:51:03 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:51:03 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:21587566-b951-4b3e-8024-b6c2d2da35af
Nov 28 15:51:03 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:51:03 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:51:03 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:437b8e96-e7f7-4c0e-a48b-1a36613eb5ec
Nov 28 15:51:03 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:51:03 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:51:03 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:07de7953-293c-4762-b695-ed3190c934d5
Nov 28 15:51:03 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:51:03 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:51:03 user nova-compute[75176]: FIRMWARE:
Nov 28 15:51:03 user nova-compute[75176]: No targets found.
Nov 28 15:51:03 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:51:03 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-397396a5-90bd-4e2f-aa7f-71782337a76a tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 15:51:03 user nova-compute[75176]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 15:51:03 user nova-compute[75176]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75176) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 15:51:03 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-397396a5-90bd-4e2f-aa7f-71782337a76a tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:370d91ef-d3c5-4019-b447-3f8134556e11', 0)] {{(pid=75176) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 15:51:03 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:51:03 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:51:03 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[48712510-04f4-4ebb-974d-1633454fdb5a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:07de7953-293c-4762-b695-ed3190c934d5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:21587566-b951-4b3e-8024-b6c2d2da35af\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:36b14046-bbe0-45c6-add0-ab16578b41d3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:370d91ef-d3c5-4019-b447-3f8134556e11\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:437b8e96-e7f7-4c0e-a48b-1a36613eb5ec\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8452525c-6845-4edb-bf69-1e2ffe0ef2eb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:51:03 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:51:03 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:51:03 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[c30eddcf-24b2-4bfc-8b19-28b566c29542]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8452525c-6845-4edb-bf69-1e2ffe0ef2eb (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36b14046-bbe0-45c6-add0-ab16578b41d3 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:370d91ef-d3c5-4019-b447-3f8134556e11 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21587566-b951-4b3e-8024-b6c2d2da35af (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07de7953-293c-4762-b695-ed3190c934d5 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:437b8e96-e7f7-4c0e-a48b-1a36613eb5ec (non-flash)\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:51:03 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-397396a5-90bd-4e2f-aa7f-71782337a76a tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8452525c-6845-4edb-bf69-1e2ffe0ef2eb (non-flash)
Nov 28 15:51:03 user nova-compute[75176]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36b14046-bbe0-45c6-add0-ab16578b41d3 (non-flash)
Nov 28 15:51:03 user nova-compute[75176]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:370d91ef-d3c5-4019-b447-3f8134556e11 (non-flash)
Nov 28 15:51:03 user nova-compute[75176]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21587566-b951-4b3e-8024-b6c2d2da35af (non-flash)
Nov 28 15:51:03 user nova-compute[75176]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07de7953-293c-4762-b695-ed3190c934d5 (non-flash)
Nov 28 15:51:03 user nova-compute[75176]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc (non-flash)
Nov 28 15:51:03 user nova-compute[75176]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:437b8e96-e7f7-4c0e-a48b-1a36613eb5ec (non-flash)
Nov 28 15:51:03 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:51:03 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-397396a5-90bd-4e2f-aa7f-71782337a76a tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8452525c-6845-4edb-bf69-1e2ffe0ef2eb (non-flash)
Nov 28 15:51:03 user nova-compute[75176]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36b14046-bbe0-45c6-add0-ab16578b41d3 (non-flash)
Nov 28 15:51:03 user nova-compute[75176]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:370d91ef-d3c5-4019-b447-3f8134556e11 (non-flash)
Nov 28 15:51:03 user nova-compute[75176]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21587566-b951-4b3e-8024-b6c2d2da35af (non-flash)
Nov 28 15:51:03 user nova-compute[75176]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07de7953-293c-4762-b695-ed3190c934d5 (non-flash)
Nov 28 15:51:03 user nova-compute[75176]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc (non-flash)
Nov 28 15:51:03 user nova-compute[75176]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:437b8e96-e7f7-4c0e-a48b-1a36613eb5ec (non-flash)
Nov 28 15:51:03 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 15:51:03 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-397396a5-90bd-4e2f-aa7f-71782337a76a tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f464c660940>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:370d91ef-d3c5-4019-b447-3f8134556e11'): ({'sdb'}, set())}) {{(pid=75176) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 15:51:03 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-397396a5-90bd-4e2f-aa7f-71782337a76a tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Removing single pathed devices sdb {{(pid=75176) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 15:51:03 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:51:03 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:51:03 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[135e20f0-427a-40e0-a937-7eb9136f7a07]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:51:03 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:51:03 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:51:03 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7935fee-4f6b-4437-ba81-6c73d25b3250]: (4, ('ok\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:51:03 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66ead7d-98f4-4822-9dce-f2ea0206a58d/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:51:03 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-397396a5-90bd-4e2f-aa7f-71782337a76a tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Flushing IO for device /dev/sdb {{(pid=75176) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 15:51:03 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:51:03 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e465c9f-e8ab-4a28-bf74-2936a272a0e2/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:51:03 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:51:03 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef6b88bb-c79c-4e23-8fd1-af2f0d94d9a2]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:51:03 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-397396a5-90bd-4e2f-aa7f-71782337a76a tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75176) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 15:51:03 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:51:03 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.037s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:51:03 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2ca25f3-d2ff-445a-aeb9-a20fd5b3ab92]: (4, ('1', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:51:03 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-397396a5-90bd-4e2f-aa7f-71782337a76a tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75176) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 15:51:03 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-397396a5-90bd-4e2f-aa7f-71782337a76a tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] SCSI volumes sdb have been removed. {{(pid=75176) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 15:51:03 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-397396a5-90bd-4e2f-aa7f-71782337a76a tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:370d91ef-d3c5-4019-b447-3f8134556e11')] {{(pid=75176) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 15:51:03 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:370d91ef-d3c5-4019-b447-3f8134556e11 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:51:03 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:370d91ef-d3c5-4019-b447-3f8134556e11 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:51:03 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[09832610-bbda-44d2-9fb0-23a20c377cb6]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:51:03 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-397396a5-90bd-4e2f-aa7f-71782337a76a tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:51:03 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:370d91ef-d3c5-4019-b447-3f8134556e11 -p 172.16.0.220:3260 --logout {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:51:03 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:370d91ef-d3c5-4019-b447-3f8134556e11 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:51:03 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[41c64d6a-c006-41c7-a889-705693c0a82f]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:370d91ef-d3c5-4019-b447-3f8134556e11, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:370d91ef-d3c5-4019-b447-3f8134556e11, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:51:03 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-397396a5-90bd-4e2f-aa7f-71782337a76a tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:370d91ef-d3c5-4019-b447-3f8134556e11, portal: 172.16.0.220,3260]
Nov 28 15:51:03 user nova-compute[75176]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:370d91ef-d3c5-4019-b447-3f8134556e11, portal: 172.16.0.220,3260] successful.
Nov 28 15:51:03 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:51:03 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:370d91ef-d3c5-4019-b447-3f8134556e11 -p 172.16.0.220:3260 --op delete {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:51:03 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e465c9f-e8ab-4a28-bf74-2936a272a0e2/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:51:03 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e465c9f-e8ab-4a28-bf74-2936a272a0e2/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:51:03 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:370d91ef-d3c5-4019-b447-3f8134556e11 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:51:03 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[f30bc80b-9c17-45bf-9952-b1d8191447ac]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:51:03 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-397396a5-90bd-4e2f-aa7f-71782337a76a tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:51:03 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-397396a5-90bd-4e2f-aa7f-71782337a76a tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.378s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 15:51:03 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-397396a5-90bd-4e2f-aa7f-71782337a76a tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] <== disconnect_volume: return (380ms) None {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 15:51:03 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-397396a5-90bd-4e2f-aa7f-71782337a76a tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] [instance: 6d061df5-8dbc-4fc1-9935-d46efc934b58] Disconnected iSCSI Volume {{(pid=75176) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 15:51:04 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e465c9f-e8ab-4a28-bf74-2936a272a0e2/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:51:04 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] skipping disk /dev/sdf (vdc) as it is a volume {{(pid=75176) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 15:51:04 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=75176) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 15:51:04 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7/disk.rescue --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:51:04 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:51:04 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:51:04 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7/disk.rescue --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:51:04 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7/disk.rescue --force-share --output=json" returned: 0 in 0.195s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:51:04 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:51:04 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:51:04 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:51:04 user nova-compute[75176]: DEBUG nova.objects.instance [None req-397396a5-90bd-4e2f-aa7f-71782337a76a tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Lazy-loading 'flavor' on Instance uuid 6d061df5-8dbc-4fc1-9935-d46efc934b58 {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:51:04 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-397396a5-90bd-4e2f-aa7f-71782337a76a tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Lock "6d061df5-8dbc-4fc1-9935-d46efc934b58" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.851s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:51:04 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-f43563d3-e4fb-4ca0-9f44-a308d7595f58 tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Lock "6d061df5-8dbc-4fc1-9935-d46efc934b58" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.700s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:51:04 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-f43563d3-e4fb-4ca0-9f44-a308d7595f58 tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Acquiring lock "6d061df5-8dbc-4fc1-9935-d46efc934b58-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:51:04 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-f43563d3-e4fb-4ca0-9f44-a308d7595f58 tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Lock "6d061df5-8dbc-4fc1-9935-d46efc934b58-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:51:04 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-f43563d3-e4fb-4ca0-9f44-a308d7595f58 tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Lock "6d061df5-8dbc-4fc1-9935-d46efc934b58-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:51:04 user nova-compute[75176]: INFO nova.compute.manager [None req-f43563d3-e4fb-4ca0-9f44-a308d7595f58 tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] [instance: 6d061df5-8dbc-4fc1-9935-d46efc934b58] Terminating instance
Nov 28 15:51:04 user nova-compute[75176]: DEBUG nova.compute.manager [None req-f43563d3-e4fb-4ca0-9f44-a308d7595f58 tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] [instance: 6d061df5-8dbc-4fc1-9935-d46efc934b58] Start destroying the instance on the hypervisor. {{(pid=75176) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 15:51:04 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:51:04 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:51:04 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:51:05 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:51:05 user nova-compute[75176]: DEBUG nova.compute.manager [req-6f230e81-9ecb-4491-96b4-b93fec5304fa req-24c7ecb5-4c98-4e40-b63a-a4c14ef6b55f service nova] [instance: 6d061df5-8dbc-4fc1-9935-d46efc934b58] Received event network-vif-unplugged-6912fd20-0a10-42ab-935d-148644fca89b {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:51:05 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-6f230e81-9ecb-4491-96b4-b93fec5304fa req-24c7ecb5-4c98-4e40-b63a-a4c14ef6b55f service nova] Acquiring lock "6d061df5-8dbc-4fc1-9935-d46efc934b58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:51:05 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-6f230e81-9ecb-4491-96b4-b93fec5304fa req-24c7ecb5-4c98-4e40-b63a-a4c14ef6b55f service nova] Lock "6d061df5-8dbc-4fc1-9935-d46efc934b58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:51:05 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-6f230e81-9ecb-4491-96b4-b93fec5304fa req-24c7ecb5-4c98-4e40-b63a-a4c14ef6b55f service nova] Lock "6d061df5-8dbc-4fc1-9935-d46efc934b58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:51:05 user nova-compute[75176]: DEBUG nova.compute.manager [req-6f230e81-9ecb-4491-96b4-b93fec5304fa req-24c7ecb5-4c98-4e40-b63a-a4c14ef6b55f service nova] [instance: 6d061df5-8dbc-4fc1-9935-d46efc934b58] No waiting events found dispatching network-vif-unplugged-6912fd20-0a10-42ab-935d-148644fca89b {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:51:05 user nova-compute[75176]: DEBUG nova.compute.manager [req-6f230e81-9ecb-4491-96b4-b93fec5304fa req-24c7ecb5-4c98-4e40-b63a-a4c14ef6b55f service nova] [instance: 6d061df5-8dbc-4fc1-9935-d46efc934b58] Received event network-vif-unplugged-6912fd20-0a10-42ab-935d-148644fca89b for instance with task_state deleting. {{(pid=75176) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 15:51:05 user nova-compute[75176]: INFO nova.virt.libvirt.driver [-] [instance: 6d061df5-8dbc-4fc1-9935-d46efc934b58] Instance destroyed successfully.
Nov 28 15:51:05 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 15:51:05 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 15:51:05 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Hypervisor/Node resource view: name=user free_ram=7284MB free_disk=25.12875747680664GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75176) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 15:51:05 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:51:05 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:51:05 user nova-compute[75176]: DEBUG nova.objects.instance [None req-f43563d3-e4fb-4ca0-9f44-a308d7595f58 tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Lazy-loading 'resources' on Instance uuid 6d061df5-8dbc-4fc1-9935-d46efc934b58 {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:51:05 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-f43563d3-e4fb-4ca0-9f44-a308d7595f58 tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T15:48:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1273199637',display_name='tempest-VolumesSnapshotTestJSON-instance-1273199637',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1273199637',id=28,image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLWtNGYkqWiD928l3ftSnYSOANR278BSmNrLe+mPNcMBy2+95Ap31KqVLPeL83gUlz+8R5SfiaSPtCa2BU3WpGMIb1OcUc3iLCPkP1Jkh7IbaNU+XV7puCVu7g88Usb6NA==',key_name='tempest-keypair-1769904179',keypairs=<?>,launch_index=0,launched_at=2023-11-28T15:48:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3669019a110245d19a8ac85b5b20d2bd',ramdisk_id='',reservation_id='r-nrfg00sn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-2135242619',owner_user_name='tempest-VolumesSnapshotTestJSON-2135242619-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T15:48:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d8d2394765354c83942d4eafbb437794',uuid=6d061df5-8dbc-4fc1-9935-d46efc934b58,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6912fd20-0a10-42ab-935d-148644fca89b", "address": "fa:16:3e:31:cd:96", "network": {"id": "0478f649-0c69-414b-84c3-3ef4604d6062", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-695624980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3669019a110245d19a8ac85b5b20d2bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6912fd20-0a", "ovs_interfaceid": "6912fd20-0a10-42ab-935d-148644fca89b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 15:51:05 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-f43563d3-e4fb-4ca0-9f44-a308d7595f58 tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Converting VIF {"id": "6912fd20-0a10-42ab-935d-148644fca89b", "address": "fa:16:3e:31:cd:96", "network": {"id": "0478f649-0c69-414b-84c3-3ef4604d6062", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-695624980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3669019a110245d19a8ac85b5b20d2bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6912fd20-0a", "ovs_interfaceid": "6912fd20-0a10-42ab-935d-148644fca89b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:51:05 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-f43563d3-e4fb-4ca0-9f44-a308d7595f58 tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:31:cd:96,bridge_name='br-int',has_traffic_filtering=True,id=6912fd20-0a10-42ab-935d-148644fca89b,network=Network(0478f649-0c69-414b-84c3-3ef4604d6062),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6912fd20-0a') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:51:05 user nova-compute[75176]: DEBUG os_vif [None req-f43563d3-e4fb-4ca0-9f44-a308d7595f58 tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:31:cd:96,bridge_name='br-int',has_traffic_filtering=True,id=6912fd20-0a10-42ab-935d-148644fca89b,network=Network(0478f649-0c69-414b-84c3-3ef4604d6062),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6912fd20-0a') {{(pid=75176) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 15:51:05 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:51:05 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6912fd20-0a, bridge=br-int, if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:51:05 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:51:05 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:51:05 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:51:05 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1c2b23b8-209f-4ac1-9cc7-cfbf0ffe725c) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:51:05 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:51:05 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:51:05 user nova-compute[75176]: INFO os_vif [None req-f43563d3-e4fb-4ca0-9f44-a308d7595f58 tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:31:cd:96,bridge_name='br-int',has_traffic_filtering=True,id=6912fd20-0a10-42ab-935d-148644fca89b,network=Network(0478f649-0c69-414b-84c3-3ef4604d6062),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6912fd20-0a')
Nov 28 15:51:05 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f43563d3-e4fb-4ca0-9f44-a308d7595f58 tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] [instance: 6d061df5-8dbc-4fc1-9935-d46efc934b58] calling os-brick to detach iSCSI Volume {{(pid=75176) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 15:51:05 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-f43563d3-e4fb-4ca0-9f44-a308d7595f58 tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c1b8a00>, {'target_iqn': 'iqn.2010-10.org.openstack:370d91ef-d3c5-4019-b447-3f8134556e11', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CrMsKZpx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 15:51:05 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-f43563d3-e4fb-4ca0-9f44-a308d7595f58 tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 15:51:05 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-f43563d3-e4fb-4ca0-9f44-a308d7595f58 tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 15:51:05 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-f43563d3-e4fb-4ca0-9f44-a308d7595f58 tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 15:51:05 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:51:06 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:51:06 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[4347dffa-d53e-42ea-821d-765226b0b779]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8452525c-6845-4edb-bf69-1e2ffe0ef2eb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:36b14046-bbe0-45c6-add0-ab16578b41d3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:21587566-b951-4b3e-8024-b6c2d2da35af\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:437b8e96-e7f7-4c0e-a48b-1a36613eb5ec\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:07de7953-293c-4762-b695-ed3190c934d5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:51:06 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-f43563d3-e4fb-4ca0-9f44-a308d7595f58 tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 15:51:06 user nova-compute[75176]: No targets found.
Nov 28 15:51:06 user nova-compute[75176]: iSNS:
Nov 28 15:51:06 user nova-compute[75176]: No targets found.
Nov 28 15:51:06 user nova-compute[75176]: STATIC:
Nov 28 15:51:06 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:8452525c-6845-4edb-bf69-1e2ffe0ef2eb
Nov 28 15:51:06 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:51:06 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:51:06 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:36b14046-bbe0-45c6-add0-ab16578b41d3
Nov 28 15:51:06 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:51:06 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:51:06 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc
Nov 28 15:51:06 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:51:06 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:51:06 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:21587566-b951-4b3e-8024-b6c2d2da35af
Nov 28 15:51:06 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:51:06 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:51:06 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:437b8e96-e7f7-4c0e-a48b-1a36613eb5ec
Nov 28 15:51:06 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:51:06 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:51:06 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:07de7953-293c-4762-b695-ed3190c934d5
Nov 28 15:51:06 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:51:06 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:51:06 user nova-compute[75176]: FIRMWARE:
Nov 28 15:51:06 user nova-compute[75176]: No targets found.
Nov 28 15:51:06 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:51:06 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-f43563d3-e4fb-4ca0-9f44-a308d7595f58 tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 15:51:06 user nova-compute[75176]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 15:51:06 user nova-compute[75176]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75176) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 15:51:06 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-f43563d3-e4fb-4ca0-9f44-a308d7595f58 tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:370d91ef-d3c5-4019-b447-3f8134556e11', 0)] {{(pid=75176) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 15:51:06 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:51:06 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:51:06 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcb63e3f-4ad4-4134-ad23-71538e796011]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:07de7953-293c-4762-b695-ed3190c934d5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:21587566-b951-4b3e-8024-b6c2d2da35af\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:36b14046-bbe0-45c6-add0-ab16578b41d3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:437b8e96-e7f7-4c0e-a48b-1a36613eb5ec\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8452525c-6845-4edb-bf69-1e2ffe0ef2eb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:51:06 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:51:06 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:51:06 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[070e30b7-96a4-4a7a-8595-cb87a46c64c8]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8452525c-6845-4edb-bf69-1e2ffe0ef2eb (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36b14046-bbe0-45c6-add0-ab16578b41d3 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21587566-b951-4b3e-8024-b6c2d2da35af (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07de7953-293c-4762-b695-ed3190c934d5 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:437b8e96-e7f7-4c0e-a48b-1a36613eb5ec (non-flash)\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:51:06 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-f43563d3-e4fb-4ca0-9f44-a308d7595f58 tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8452525c-6845-4edb-bf69-1e2ffe0ef2eb (non-flash)
Nov 28 15:51:06 user nova-compute[75176]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36b14046-bbe0-45c6-add0-ab16578b41d3 (non-flash)
Nov 28 15:51:06 user nova-compute[75176]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21587566-b951-4b3e-8024-b6c2d2da35af (non-flash)
Nov 28 15:51:06 user nova-compute[75176]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07de7953-293c-4762-b695-ed3190c934d5 (non-flash)
Nov 28 15:51:06 user nova-compute[75176]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc (non-flash)
Nov 28 15:51:06 user nova-compute[75176]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:437b8e96-e7f7-4c0e-a48b-1a36613eb5ec (non-flash)
Nov 28 15:51:06 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:51:06 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-f43563d3-e4fb-4ca0-9f44-a308d7595f58 tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8452525c-6845-4edb-bf69-1e2ffe0ef2eb (non-flash)
Nov 28 15:51:06 user nova-compute[75176]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36b14046-bbe0-45c6-add0-ab16578b41d3 (non-flash)
Nov 28 15:51:06 user nova-compute[75176]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21587566-b951-4b3e-8024-b6c2d2da35af (non-flash)
Nov 28 15:51:06 user nova-compute[75176]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07de7953-293c-4762-b695-ed3190c934d5 (non-flash)
Nov 28 15:51:06 user nova-compute[75176]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc (non-flash)
Nov 28 15:51:06 user nova-compute[75176]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:437b8e96-e7f7-4c0e-a48b-1a36613eb5ec (non-flash)
Nov 28 15:51:06 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 15:51:06 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-f43563d3-e4fb-4ca0-9f44-a308d7595f58 tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f464c0d2a70>, {}) {{(pid=75176) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 15:51:06 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-f43563d3-e4fb-4ca0-9f44-a308d7595f58 tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Disconnecting from: [] {{(pid=75176) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 15:51:06 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-f43563d3-e4fb-4ca0-9f44-a308d7595f58 tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.089s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 15:51:06 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-f43563d3-e4fb-4ca0-9f44-a308d7595f58 tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] <== disconnect_volume: return (91ms) None {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 15:51:06 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f43563d3-e4fb-4ca0-9f44-a308d7595f58 tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] [instance: 6d061df5-8dbc-4fc1-9935-d46efc934b58] Disconnected iSCSI Volume {{(pid=75176) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 15:51:06 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-f43563d3-e4fb-4ca0-9f44-a308d7595f58 tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] [instance: 6d061df5-8dbc-4fc1-9935-d46efc934b58] Deleting instance files /opt/stack/data/nova/instances/6d061df5-8dbc-4fc1-9935-d46efc934b58_del
Nov 28 15:51:06 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-f43563d3-e4fb-4ca0-9f44-a308d7595f58 tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] [instance: 6d061df5-8dbc-4fc1-9935-d46efc934b58] Deletion of /opt/stack/data/nova/instances/6d061df5-8dbc-4fc1-9935-d46efc934b58_del complete
Nov 28 15:51:06 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance 2e8507b7-fccf-4196-b589-bf2b74f165ec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:51:06 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance 1e8a6e1b-4f71-494a-8f44-f9643c658021 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:51:06 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance a6ebcc53-802a-4515-ba41-3e8e1129235f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:51:06 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance 42579ef7-54dc-4165-a144-61e80fdd5626 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:51:06 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance 6d061df5-8dbc-4fc1-9935-d46efc934b58 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:51:06 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance cbefda8d-d285-404b-9817-49deada49d0b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:51:06 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance f66ead7d-98f4-4822-9dce-f2ea0206a58d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:51:06 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance 55febf04-14ea-4903-8692-c7cc6115de75 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:51:06 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance 8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:51:06 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance e8b9c885-42ba-4f74-86b2-d091ebd08ed5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:51:06 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance 0e465c9f-e8ab-4a28-bf74-2936a272a0e2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:51:06 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance 6161cab2-eb1f-44cb-bbd5-077e6db42f77 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:51:06 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75176) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 15:51:06 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75176) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 15:51:06 user nova-compute[75176]: INFO nova.compute.manager [None req-f43563d3-e4fb-4ca0-9f44-a308d7595f58 tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] [instance: 6d061df5-8dbc-4fc1-9935-d46efc934b58] Took 1.32 seconds to destroy the instance on the hypervisor.
Nov 28 15:51:06 user nova-compute[75176]: DEBUG oslo.service.loopingcall [None req-f43563d3-e4fb-4ca0-9f44-a308d7595f58 tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75176) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 15:51:06 user nova-compute[75176]: DEBUG nova.compute.manager [-] [instance: 6d061df5-8dbc-4fc1-9935-d46efc934b58] Deallocating network for instance {{(pid=75176) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 15:51:06 user nova-compute[75176]: DEBUG nova.network.neutron [-] [instance: 6d061df5-8dbc-4fc1-9935-d46efc934b58] deallocate_for_instance() {{(pid=75176) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 15:51:06 user nova-compute[75176]: DEBUG nova.compute.provider_tree [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Inventory has not changed in ProviderTree for provider: b37848d8-f401-4155-a029-b0ffa09ff85b {{(pid=75176) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 15:51:06 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Inventory has not changed for provider b37848d8-f401-4155-a029-b0ffa09ff85b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75176) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 15:51:06 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Compute_service record updated for user:user {{(pid=75176) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 15:51:06 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.564s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:51:06 user nova-compute[75176]: DEBUG nova.network.neutron [-] [instance: 6d061df5-8dbc-4fc1-9935-d46efc934b58] Updating instance_info_cache with network_info: [] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:51:06 user nova-compute[75176]: INFO nova.compute.manager [-] [instance: 6d061df5-8dbc-4fc1-9935-d46efc934b58] Took 0.68 seconds to deallocate network for instance.
Nov 28 15:51:06 user nova-compute[75176]: WARNING nova.volume.cinder [None req-f43563d3-e4fb-4ca0-9f44-a308d7595f58 tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Attachment 727d33b4-56c5-4dce-959c-ad91e2f01a76 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 727d33b4-56c5-4dce-959c-ad91e2f01a76. (HTTP 404) (Request-ID: req-a832fb33-c4d9-4399-9973-7d1e47800e31)
Nov 28 15:51:06 user nova-compute[75176]: INFO nova.compute.manager [None req-f43563d3-e4fb-4ca0-9f44-a308d7595f58 tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] [instance: 6d061df5-8dbc-4fc1-9935-d46efc934b58] Took 0.04 seconds to detach 1 volumes for instance.
Nov 28 15:51:06 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-f43563d3-e4fb-4ca0-9f44-a308d7595f58 tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:51:06 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-f43563d3-e4fb-4ca0-9f44-a308d7595f58 tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:51:07 user nova-compute[75176]: DEBUG nova.compute.manager [req-8711fb67-10f9-4316-9485-1490e5c3cd19 req-4b293709-71fe-47d8-a721-6cf38eb41c97 service nova] [instance: 6d061df5-8dbc-4fc1-9935-d46efc934b58] Received event network-vif-plugged-6912fd20-0a10-42ab-935d-148644fca89b {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:51:07 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-8711fb67-10f9-4316-9485-1490e5c3cd19 req-4b293709-71fe-47d8-a721-6cf38eb41c97 service nova] Acquiring lock "6d061df5-8dbc-4fc1-9935-d46efc934b58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:51:07 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-8711fb67-10f9-4316-9485-1490e5c3cd19 req-4b293709-71fe-47d8-a721-6cf38eb41c97 service nova] Lock "6d061df5-8dbc-4fc1-9935-d46efc934b58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:51:07 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-8711fb67-10f9-4316-9485-1490e5c3cd19 req-4b293709-71fe-47d8-a721-6cf38eb41c97 service nova] Lock "6d061df5-8dbc-4fc1-9935-d46efc934b58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:51:07 user nova-compute[75176]: DEBUG nova.compute.manager [req-8711fb67-10f9-4316-9485-1490e5c3cd19 req-4b293709-71fe-47d8-a721-6cf38eb41c97 service nova] [instance: 6d061df5-8dbc-4fc1-9935-d46efc934b58] No waiting events found dispatching network-vif-plugged-6912fd20-0a10-42ab-935d-148644fca89b {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:51:07 user nova-compute[75176]: WARNING nova.compute.manager [req-8711fb67-10f9-4316-9485-1490e5c3cd19 req-4b293709-71fe-47d8-a721-6cf38eb41c97 service nova] [instance: 6d061df5-8dbc-4fc1-9935-d46efc934b58] Received unexpected event network-vif-plugged-6912fd20-0a10-42ab-935d-148644fca89b for instance with vm_state deleted and task_state None.
Nov 28 15:51:07 user nova-compute[75176]: DEBUG nova.compute.manager [req-8711fb67-10f9-4316-9485-1490e5c3cd19 req-4b293709-71fe-47d8-a721-6cf38eb41c97 service nova] [instance: 6d061df5-8dbc-4fc1-9935-d46efc934b58] Received event network-vif-deleted-6912fd20-0a10-42ab-935d-148644fca89b {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:51:07 user nova-compute[75176]: DEBUG nova.compute.provider_tree [None req-f43563d3-e4fb-4ca0-9f44-a308d7595f58 tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Inventory has not changed in ProviderTree for provider: b37848d8-f401-4155-a029-b0ffa09ff85b {{(pid=75176) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 15:51:07 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-f43563d3-e4fb-4ca0-9f44-a308d7595f58 tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Inventory has not changed for provider b37848d8-f401-4155-a029-b0ffa09ff85b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75176) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 15:51:07 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-f43563d3-e4fb-4ca0-9f44-a308d7595f58 tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.376s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:51:07 user nova-compute[75176]: INFO nova.scheduler.client.report [None req-f43563d3-e4fb-4ca0-9f44-a308d7595f58 tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Deleted allocations for instance 6d061df5-8dbc-4fc1-9935-d46efc934b58
Nov 28 15:51:07 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-f43563d3-e4fb-4ca0-9f44-a308d7595f58 tempest-VolumesSnapshotTestJSON-2135242619 tempest-VolumesSnapshotTestJSON-2135242619-project-member] Lock "6d061df5-8dbc-4fc1-9935-d46efc934b58" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.624s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:51:10 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:51:11 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:51:14 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:51:15 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:51:17 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-f6039dae-1827-48dc-b42e-5d0a7b032d83 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance cbefda8d-d285-404b-9817-49deada49d0b is timed out.
Nov 28 15:51:17 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-f6039dae-1827-48dc-b42e-5d0a7b032d83 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Successfully detached device vdb from instance cbefda8d-d285-404b-9817-49deada49d0b from the live domain config.
Nov 28 15:51:17 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f6039dae-1827-48dc-b42e-5d0a7b032d83 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] [instance: cbefda8d-d285-404b-9817-49deada49d0b] calling os-brick to detach iSCSI Volume {{(pid=75176) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 15:51:17 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6039dae-1827-48dc-b42e-5d0a7b032d83 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c1b8a00>, {'target_iqn': 'iqn.2010-10.org.openstack:437b8e96-e7f7-4c0e-a48b-1a36613eb5ec', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aGUZDJNL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 15:51:17 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-f6039dae-1827-48dc-b42e-5d0a7b032d83 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 15:51:17 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-f6039dae-1827-48dc-b42e-5d0a7b032d83 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 15:51:17 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-f6039dae-1827-48dc-b42e-5d0a7b032d83 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 15:51:17 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:51:17 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:51:17 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[60c8325e-aceb-4cf4-9f74-ecf1ca0ae336]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8452525c-6845-4edb-bf69-1e2ffe0ef2eb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:36b14046-bbe0-45c6-add0-ab16578b41d3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:21587566-b951-4b3e-8024-b6c2d2da35af\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:437b8e96-e7f7-4c0e-a48b-1a36613eb5ec\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:07de7953-293c-4762-b695-ed3190c934d5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:51:17 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6039dae-1827-48dc-b42e-5d0a7b032d83 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 15:51:17 user nova-compute[75176]: No targets found.
Nov 28 15:51:17 user nova-compute[75176]: iSNS:
Nov 28 15:51:17 user nova-compute[75176]: No targets found.
Nov 28 15:51:17 user nova-compute[75176]: STATIC:
Nov 28 15:51:17 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:8452525c-6845-4edb-bf69-1e2ffe0ef2eb
Nov 28 15:51:17 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:51:17 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:51:17 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:36b14046-bbe0-45c6-add0-ab16578b41d3
Nov 28 15:51:17 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:51:17 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:51:17 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc
Nov 28 15:51:17 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:51:17 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:51:17 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:21587566-b951-4b3e-8024-b6c2d2da35af
Nov 28 15:51:17 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:51:17 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:51:17 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:437b8e96-e7f7-4c0e-a48b-1a36613eb5ec
Nov 28 15:51:17 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:51:17 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:51:17 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:07de7953-293c-4762-b695-ed3190c934d5
Nov 28 15:51:17 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:51:17 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:51:17 user nova-compute[75176]: FIRMWARE:
Nov 28 15:51:17 user nova-compute[75176]: No targets found.
Nov 28 15:51:17 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:51:17 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6039dae-1827-48dc-b42e-5d0a7b032d83 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 15:51:17 user nova-compute[75176]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 15:51:17 user nova-compute[75176]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75176) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 15:51:17 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6039dae-1827-48dc-b42e-5d0a7b032d83 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:437b8e96-e7f7-4c0e-a48b-1a36613eb5ec', 0)] {{(pid=75176) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 15:51:17 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:51:17 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:51:17 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[66fd83c7-8381-42da-be6d-11ca7c0cd3ea]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:07de7953-293c-4762-b695-ed3190c934d5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:21587566-b951-4b3e-8024-b6c2d2da35af\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:36b14046-bbe0-45c6-add0-ab16578b41d3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:437b8e96-e7f7-4c0e-a48b-1a36613eb5ec\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8452525c-6845-4edb-bf69-1e2ffe0ef2eb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:51:17 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:51:17 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:51:17 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4da06a1-4380-46e6-8a1d-3fef195695cf]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8452525c-6845-4edb-bf69-1e2ffe0ef2eb (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36b14046-bbe0-45c6-add0-ab16578b41d3 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21587566-b951-4b3e-8024-b6c2d2da35af (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07de7953-293c-4762-b695-ed3190c934d5 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:437b8e96-e7f7-4c0e-a48b-1a36613eb5ec (non-flash)\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:51:17 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6039dae-1827-48dc-b42e-5d0a7b032d83 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8452525c-6845-4edb-bf69-1e2ffe0ef2eb (non-flash)
Nov 28 15:51:17 user nova-compute[75176]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36b14046-bbe0-45c6-add0-ab16578b41d3 (non-flash)
Nov 28 15:51:17 user nova-compute[75176]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21587566-b951-4b3e-8024-b6c2d2da35af (non-flash)
Nov 28 15:51:17 user nova-compute[75176]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07de7953-293c-4762-b695-ed3190c934d5 (non-flash)
Nov 28 15:51:17 user nova-compute[75176]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc (non-flash)
Nov 28 15:51:17 user nova-compute[75176]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:437b8e96-e7f7-4c0e-a48b-1a36613eb5ec (non-flash)
Nov 28 15:51:17 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:51:17 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6039dae-1827-48dc-b42e-5d0a7b032d83 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8452525c-6845-4edb-bf69-1e2ffe0ef2eb (non-flash)
Nov 28 15:51:17 user nova-compute[75176]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36b14046-bbe0-45c6-add0-ab16578b41d3 (non-flash)
Nov 28 15:51:17 user nova-compute[75176]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21587566-b951-4b3e-8024-b6c2d2da35af (non-flash)
Nov 28 15:51:17 user nova-compute[75176]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07de7953-293c-4762-b695-ed3190c934d5 (non-flash)
Nov 28 15:51:17 user nova-compute[75176]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc (non-flash)
Nov 28 15:51:17 user nova-compute[75176]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:437b8e96-e7f7-4c0e-a48b-1a36613eb5ec (non-flash)
Nov 28 15:51:17 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 15:51:17 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6039dae-1827-48dc-b42e-5d0a7b032d83 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f46441652d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:437b8e96-e7f7-4c0e-a48b-1a36613eb5ec'): ({'sdh'}, set())}) {{(pid=75176) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 15:51:17 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-f6039dae-1827-48dc-b42e-5d0a7b032d83 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Removing single pathed devices sdh {{(pid=75176) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 15:51:17 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:51:17 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:51:17 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[89e654f0-b98c-42bf-a89a-aebfacf03888]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:51:17 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:51:17 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.020s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:51:17 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d13bee7-6722-4c48-9813-34790f8bf479]: (4, ('ok\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:51:17 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-f6039dae-1827-48dc-b42e-5d0a7b032d83 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Flushing IO for device /dev/sdh {{(pid=75176) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 15:51:17 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:51:17 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.012s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:51:17 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e2dda72-0308-407a-b336-bce744997fc9]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:51:17 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-f6039dae-1827-48dc-b42e-5d0a7b032d83 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=75176) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 15:51:17 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:51:17 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.045s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:51:17 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[83c5ab59-0b5e-4d50-a1c7-3f7e03accf83]: (4, ('1', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:51:17 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-f6039dae-1827-48dc-b42e-5d0a7b032d83 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=75176) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 15:51:17 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-f6039dae-1827-48dc-b42e-5d0a7b032d83 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] SCSI volumes sdh have been removed. {{(pid=75176) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 15:51:17 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6039dae-1827-48dc-b42e-5d0a7b032d83 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:437b8e96-e7f7-4c0e-a48b-1a36613eb5ec')] {{(pid=75176) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 15:51:17 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:437b8e96-e7f7-4c0e-a48b-1a36613eb5ec -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:51:17 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:437b8e96-e7f7-4c0e-a48b-1a36613eb5ec -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:51:17 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e767f19-e142-4036-b63d-7c2cd790756c]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:51:17 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6039dae-1827-48dc-b42e-5d0a7b032d83 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:51:17 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:437b8e96-e7f7-4c0e-a48b-1a36613eb5ec -p 172.16.0.220:3260 --logout {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:51:17 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:437b8e96-e7f7-4c0e-a48b-1a36613eb5ec -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:51:17 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ec46d4c-dfec-471e-89fe-55786b937f61]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:437b8e96-e7f7-4c0e-a48b-1a36613eb5ec, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:437b8e96-e7f7-4c0e-a48b-1a36613eb5ec, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:51:17 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6039dae-1827-48dc-b42e-5d0a7b032d83 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:437b8e96-e7f7-4c0e-a48b-1a36613eb5ec, portal: 172.16.0.220,3260]
Nov 28 15:51:17 user nova-compute[75176]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:437b8e96-e7f7-4c0e-a48b-1a36613eb5ec, portal: 172.16.0.220,3260] successful.
Nov 28 15:51:17 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:51:17 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:437b8e96-e7f7-4c0e-a48b-1a36613eb5ec -p 172.16.0.220:3260 --op delete {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:51:17 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:437b8e96-e7f7-4c0e-a48b-1a36613eb5ec -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:51:17 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[71a1f08c-b6f9-42f5-bcf9-8a19295a794f]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:51:17 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6039dae-1827-48dc-b42e-5d0a7b032d83 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:51:17 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-f6039dae-1827-48dc-b42e-5d0a7b032d83 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.312s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 15:51:17 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6039dae-1827-48dc-b42e-5d0a7b032d83 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] <== disconnect_volume: return (312ms) None {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 15:51:17 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f6039dae-1827-48dc-b42e-5d0a7b032d83 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] [instance: cbefda8d-d285-404b-9817-49deada49d0b] Disconnected iSCSI Volume {{(pid=75176) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 15:51:18 user nova-compute[75176]: DEBUG nova.objects.instance [None req-f6039dae-1827-48dc-b42e-5d0a7b032d83 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Lazy-loading 'flavor' on Instance uuid cbefda8d-d285-404b-9817-49deada49d0b {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:51:18 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-f6039dae-1827-48dc-b42e-5d0a7b032d83 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Lock "cbefda8d-d285-404b-9817-49deada49d0b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.690s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:51:19 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:51:20 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:51:24 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:51:25 user nova-compute[75176]: DEBUG nova.compute.manager [req-9d4e183c-e7bd-4b6b-8c53-628ad31a24dc req-b9d00dd6-1cbe-4968-81b0-ab6d9c070fb6 service nova] [instance: a6ebcc53-802a-4515-ba41-3e8e1129235f] Received event network-changed-1beb8fcc-a604-4b25-8e50-63325edade24 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:51:25 user nova-compute[75176]: DEBUG nova.compute.manager [req-9d4e183c-e7bd-4b6b-8c53-628ad31a24dc req-b9d00dd6-1cbe-4968-81b0-ab6d9c070fb6 service nova] [instance: a6ebcc53-802a-4515-ba41-3e8e1129235f] Refreshing instance network info cache due to event network-changed-1beb8fcc-a604-4b25-8e50-63325edade24. {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 15:51:25 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-9d4e183c-e7bd-4b6b-8c53-628ad31a24dc req-b9d00dd6-1cbe-4968-81b0-ab6d9c070fb6 service nova] Acquiring lock "refresh_cache-a6ebcc53-802a-4515-ba41-3e8e1129235f" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:51:25 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-9d4e183c-e7bd-4b6b-8c53-628ad31a24dc req-b9d00dd6-1cbe-4968-81b0-ab6d9c070fb6 service nova] Acquired lock "refresh_cache-a6ebcc53-802a-4515-ba41-3e8e1129235f" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:51:25 user nova-compute[75176]: DEBUG nova.network.neutron [req-9d4e183c-e7bd-4b6b-8c53-628ad31a24dc req-b9d00dd6-1cbe-4968-81b0-ab6d9c070fb6 service nova] [instance: a6ebcc53-802a-4515-ba41-3e8e1129235f] Refreshing network info cache for port 1beb8fcc-a604-4b25-8e50-63325edade24 {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 15:51:25 user nova-compute[75176]: DEBUG nova.network.neutron [req-9d4e183c-e7bd-4b6b-8c53-628ad31a24dc req-b9d00dd6-1cbe-4968-81b0-ab6d9c070fb6 service nova] [instance: a6ebcc53-802a-4515-ba41-3e8e1129235f] Updated VIF entry in instance network info cache for port 1beb8fcc-a604-4b25-8e50-63325edade24. {{(pid=75176) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 15:51:25 user nova-compute[75176]: DEBUG nova.network.neutron [req-9d4e183c-e7bd-4b6b-8c53-628ad31a24dc req-b9d00dd6-1cbe-4968-81b0-ab6d9c070fb6 service nova] [instance: a6ebcc53-802a-4515-ba41-3e8e1129235f] Updating instance_info_cache with network_info: [{"id": "1beb8fcc-a604-4b25-8e50-63325edade24", "address": "fa:16:3e:84:1e:fa", "network": {"id": "b06b85af-96d9-41cb-9ad2-7fc0523761e7", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-850315220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc1dfeef484e4627a0061d9d36fd2b40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1beb8fcc-a6", "ovs_interfaceid": "1beb8fcc-a604-4b25-8e50-63325edade24", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:51:25 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-9d4e183c-e7bd-4b6b-8c53-628ad31a24dc req-b9d00dd6-1cbe-4968-81b0-ab6d9c070fb6 service nova] Releasing lock "refresh_cache-a6ebcc53-802a-4515-ba41-3e8e1129235f" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:51:25 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:51:26 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-72eda9dd-a88c-4f28-8be3-a61cbecb4838 tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Acquiring lock "a6ebcc53-802a-4515-ba41-3e8e1129235f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:51:26 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-72eda9dd-a88c-4f28-8be3-a61cbecb4838 tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Lock "a6ebcc53-802a-4515-ba41-3e8e1129235f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:51:26 user nova-compute[75176]: INFO nova.compute.manager [None req-72eda9dd-a88c-4f28-8be3-a61cbecb4838 tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] [instance: a6ebcc53-802a-4515-ba41-3e8e1129235f] Detaching volume 36b14046-bbe0-45c6-add0-ab16578b41d3
Nov 28 15:51:26 user nova-compute[75176]: INFO nova.virt.block_device [None req-72eda9dd-a88c-4f28-8be3-a61cbecb4838 tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] [instance: a6ebcc53-802a-4515-ba41-3e8e1129235f] Attempting to driver detach volume 36b14046-bbe0-45c6-add0-ab16578b41d3 from mountpoint /dev/vdb
Nov 28 15:51:26 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-72eda9dd-a88c-4f28-8be3-a61cbecb4838 tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Attempting to detach device vdb from instance a6ebcc53-802a-4515-ba41-3e8e1129235f from the persistent domain config. {{(pid=75176) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 15:51:26 user nova-compute[75176]: DEBUG nova.virt.libvirt.guest [None req-72eda9dd-a88c-4f28-8be3-a61cbecb4838 tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 15:51:26 user nova-compute[75176]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 15:51:26 user nova-compute[75176]:   <source dev="/dev/sde"/>
Nov 28 15:51:26 user nova-compute[75176]:   <target dev="vdb" bus="virtio"/>
Nov 28 15:51:26 user nova-compute[75176]:   <serial>36b14046-bbe0-45c6-add0-ab16578b41d3</serial>
Nov 28 15:51:26 user nova-compute[75176]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 15:51:26 user nova-compute[75176]: </disk>
Nov 28 15:51:26 user nova-compute[75176]:  {{(pid=75176) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 15:51:26 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-72eda9dd-a88c-4f28-8be3-a61cbecb4838 tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Successfully detached device vdb from instance a6ebcc53-802a-4515-ba41-3e8e1129235f from the persistent domain config.
Nov 28 15:51:26 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-72eda9dd-a88c-4f28-8be3-a61cbecb4838 tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a6ebcc53-802a-4515-ba41-3e8e1129235f from the live domain config. {{(pid=75176) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 15:51:26 user nova-compute[75176]: DEBUG nova.virt.libvirt.guest [None req-72eda9dd-a88c-4f28-8be3-a61cbecb4838 tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 15:51:26 user nova-compute[75176]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 15:51:26 user nova-compute[75176]:   <source dev="/dev/sde"/>
Nov 28 15:51:26 user nova-compute[75176]:   <target dev="vdb" bus="virtio"/>
Nov 28 15:51:26 user nova-compute[75176]:   <serial>36b14046-bbe0-45c6-add0-ab16578b41d3</serial>
Nov 28 15:51:26 user nova-compute[75176]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 15:51:26 user nova-compute[75176]: </disk>
Nov 28 15:51:26 user nova-compute[75176]:  {{(pid=75176) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 15:51:26 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-72eda9dd-a88c-4f28-8be3-a61cbecb4838 tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a6ebcc53-802a-4515-ba41-3e8e1129235f {{(pid=75176) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 15:51:27 user nova-compute[75176]: DEBUG nova.compute.manager [req-3f5ebb6d-061f-45a9-82f3-6b47349c3acb req-2f9ec9ed-ac14-4eae-8b97-87b6e2225061 service nova] [instance: a6ebcc53-802a-4515-ba41-3e8e1129235f] Received event network-changed-1beb8fcc-a604-4b25-8e50-63325edade24 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:51:27 user nova-compute[75176]: DEBUG nova.compute.manager [req-3f5ebb6d-061f-45a9-82f3-6b47349c3acb req-2f9ec9ed-ac14-4eae-8b97-87b6e2225061 service nova] [instance: a6ebcc53-802a-4515-ba41-3e8e1129235f] Refreshing instance network info cache due to event network-changed-1beb8fcc-a604-4b25-8e50-63325edade24. {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 15:51:27 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-3f5ebb6d-061f-45a9-82f3-6b47349c3acb req-2f9ec9ed-ac14-4eae-8b97-87b6e2225061 service nova] Acquiring lock "refresh_cache-a6ebcc53-802a-4515-ba41-3e8e1129235f" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:51:27 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-3f5ebb6d-061f-45a9-82f3-6b47349c3acb req-2f9ec9ed-ac14-4eae-8b97-87b6e2225061 service nova] Acquired lock "refresh_cache-a6ebcc53-802a-4515-ba41-3e8e1129235f" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:51:27 user nova-compute[75176]: DEBUG nova.network.neutron [req-3f5ebb6d-061f-45a9-82f3-6b47349c3acb req-2f9ec9ed-ac14-4eae-8b97-87b6e2225061 service nova] [instance: a6ebcc53-802a-4515-ba41-3e8e1129235f] Refreshing network info cache for port 1beb8fcc-a604-4b25-8e50-63325edade24 {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 15:51:27 user nova-compute[75176]: DEBUG nova.network.neutron [req-3f5ebb6d-061f-45a9-82f3-6b47349c3acb req-2f9ec9ed-ac14-4eae-8b97-87b6e2225061 service nova] [instance: a6ebcc53-802a-4515-ba41-3e8e1129235f] Updated VIF entry in instance network info cache for port 1beb8fcc-a604-4b25-8e50-63325edade24. {{(pid=75176) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 15:51:27 user nova-compute[75176]: DEBUG nova.network.neutron [req-3f5ebb6d-061f-45a9-82f3-6b47349c3acb req-2f9ec9ed-ac14-4eae-8b97-87b6e2225061 service nova] [instance: a6ebcc53-802a-4515-ba41-3e8e1129235f] Updating instance_info_cache with network_info: [{"id": "1beb8fcc-a604-4b25-8e50-63325edade24", "address": "fa:16:3e:84:1e:fa", "network": {"id": "b06b85af-96d9-41cb-9ad2-7fc0523761e7", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-850315220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc1dfeef484e4627a0061d9d36fd2b40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1beb8fcc-a6", "ovs_interfaceid": "1beb8fcc-a604-4b25-8e50-63325edade24", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:51:27 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-3f5ebb6d-061f-45a9-82f3-6b47349c3acb req-2f9ec9ed-ac14-4eae-8b97-87b6e2225061 service nova] Releasing lock "refresh_cache-a6ebcc53-802a-4515-ba41-3e8e1129235f" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:51:29 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:51:30 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:51:33 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:51:35 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:51:40 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:51:40 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:51:40 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75176) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 15:51:40 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75176) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 15:51:40 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75176) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 15:51:40 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:51:41 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-d668d506-a2d3-4f09-b630-41596a28efbb tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] Acquiring lock "ca1558cf-b235-4a20-8d12-45f1ca16fe41" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:51:41 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-d668d506-a2d3-4f09-b630-41596a28efbb tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] Lock "ca1558cf-b235-4a20-8d12-45f1ca16fe41" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:51:41 user nova-compute[75176]: INFO nova.compute.manager [None req-d668d506-a2d3-4f09-b630-41596a28efbb tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] [instance: ca1558cf-b235-4a20-8d12-45f1ca16fe41] Unshelving
Nov 28 15:51:41 user nova-compute[75176]: INFO nova.virt.block_device [None req-d668d506-a2d3-4f09-b630-41596a28efbb tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] [instance: ca1558cf-b235-4a20-8d12-45f1ca16fe41] Booting with volume 22933c6e-3d8f-44f5-bc41-dee97c587055 at /dev/vda
Nov 28 15:51:41 user nova-compute[75176]: DEBUG os_brick.utils [None req-d668d506-a2d3-4f09-b630-41596a28efbb tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 15:51:41 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:51:41 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:51:41 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[84b8a72b-3403-4575-87b6-f084bc840e43]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:edc924a949b2\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:51:41 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:51:41 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:51:41 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[825edab4-a145-4030-baf1-eb417ae4a047]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:51:41 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:51:41 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:51:41 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[8303df8d-857e-4dda-b68b-9ca502fe451d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:51:41 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcc7f02d-32f6-45cc-b28d-185dfda93de5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:51:41 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-d668d506-a2d3-4f09-b630-41596a28efbb tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] Running cmd (subprocess): nvme version {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:51:41 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-d668d506-a2d3-4f09-b630-41596a28efbb tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] 'nvme version' failed. Not Retrying. {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 15:51:41 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d668d506-a2d3-4f09-b630-41596a28efbb tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] nvme not present on system {{(pid=75176) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 15:51:41 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:51:41 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 15:51:41 user nova-compute[75176]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 15:51:41 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[f35a9a7b-c563-4612-a140-7dbb057e68ce]: (4, '') {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:51:41 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.lightos [None req-d668d506-a2d3-4f09-b630-41596a28efbb tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75176) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 15:51:41 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.lightos [None req-d668d506-a2d3-4f09-b630-41596a28efbb tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75176) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 15:51:41 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.lightos [None req-d668d506-a2d3-4f09-b630-41596a28efbb tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] LIGHTOS: no hostnqn found. {{(pid=75176) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 15:51:41 user nova-compute[75176]: DEBUG os_brick.utils [None req-d668d506-a2d3-4f09-b630-41596a28efbb tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:edc924a949b2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 15:51:41 user nova-compute[75176]: DEBUG nova.virt.block_device [None req-d668d506-a2d3-4f09-b630-41596a28efbb tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] [instance: ca1558cf-b235-4a20-8d12-45f1ca16fe41] Updating existing volume attachment record: 0f891720-e06e-49e7-9e4f-8670428943b6 {{(pid=75176) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 15:51:45 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:51:46 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-72eda9dd-a88c-4f28-8be3-a61cbecb4838 tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a6ebcc53-802a-4515-ba41-3e8e1129235f is timed out.
Nov 28 15:51:46 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-72eda9dd-a88c-4f28-8be3-a61cbecb4838 tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Successfully detached device vdb from instance a6ebcc53-802a-4515-ba41-3e8e1129235f from the live domain config.
Nov 28 15:51:46 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-72eda9dd-a88c-4f28-8be3-a61cbecb4838 tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] [instance: a6ebcc53-802a-4515-ba41-3e8e1129235f] calling os-brick to detach iSCSI Volume {{(pid=75176) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 15:51:46 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-72eda9dd-a88c-4f28-8be3-a61cbecb4838 tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c1b8a00>, {'target_iqn': 'iqn.2010-10.org.openstack:36b14046-bbe0-45c6-add0-ab16578b41d3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'coLtfdCj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 15:51:46 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-72eda9dd-a88c-4f28-8be3-a61cbecb4838 tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 15:51:46 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-72eda9dd-a88c-4f28-8be3-a61cbecb4838 tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 15:51:46 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-72eda9dd-a88c-4f28-8be3-a61cbecb4838 tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 15:51:46 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:51:46 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:51:46 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[a27092cc-f966-4da1-956f-ed99d5468206]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8452525c-6845-4edb-bf69-1e2ffe0ef2eb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:36b14046-bbe0-45c6-add0-ab16578b41d3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:21587566-b951-4b3e-8024-b6c2d2da35af\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:07de7953-293c-4762-b695-ed3190c934d5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:51:46 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-72eda9dd-a88c-4f28-8be3-a61cbecb4838 tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 15:51:46 user nova-compute[75176]: No targets found.
Nov 28 15:51:46 user nova-compute[75176]: iSNS:
Nov 28 15:51:46 user nova-compute[75176]: No targets found.
Nov 28 15:51:46 user nova-compute[75176]: STATIC:
Nov 28 15:51:46 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:8452525c-6845-4edb-bf69-1e2ffe0ef2eb
Nov 28 15:51:46 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:51:46 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:51:46 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:36b14046-bbe0-45c6-add0-ab16578b41d3
Nov 28 15:51:46 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:51:46 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:51:46 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc
Nov 28 15:51:46 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:51:46 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:51:46 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:21587566-b951-4b3e-8024-b6c2d2da35af
Nov 28 15:51:46 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:51:46 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:51:46 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:07de7953-293c-4762-b695-ed3190c934d5
Nov 28 15:51:46 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:51:46 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:51:46 user nova-compute[75176]: FIRMWARE:
Nov 28 15:51:46 user nova-compute[75176]: No targets found.
Nov 28 15:51:46 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:51:46 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-72eda9dd-a88c-4f28-8be3-a61cbecb4838 tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 15:51:46 user nova-compute[75176]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 15:51:46 user nova-compute[75176]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75176) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 15:51:46 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-72eda9dd-a88c-4f28-8be3-a61cbecb4838 tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:36b14046-bbe0-45c6-add0-ab16578b41d3', 0)] {{(pid=75176) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 15:51:46 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:51:46 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:51:46 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[49d1d1bf-25da-4bb1-a618-25ede173d51b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:07de7953-293c-4762-b695-ed3190c934d5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:21587566-b951-4b3e-8024-b6c2d2da35af\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:36b14046-bbe0-45c6-add0-ab16578b41d3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8452525c-6845-4edb-bf69-1e2ffe0ef2eb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:51:46 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:51:46 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:51:46 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2cfa34b-0de0-4fc8-9d18-bb6f59481843]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8452525c-6845-4edb-bf69-1e2ffe0ef2eb (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36b14046-bbe0-45c6-add0-ab16578b41d3 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21587566-b951-4b3e-8024-b6c2d2da35af (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07de7953-293c-4762-b695-ed3190c934d5 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc (non-flash)\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:51:46 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-72eda9dd-a88c-4f28-8be3-a61cbecb4838 tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8452525c-6845-4edb-bf69-1e2ffe0ef2eb (non-flash)
Nov 28 15:51:46 user nova-compute[75176]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36b14046-bbe0-45c6-add0-ab16578b41d3 (non-flash)
Nov 28 15:51:46 user nova-compute[75176]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21587566-b951-4b3e-8024-b6c2d2da35af (non-flash)
Nov 28 15:51:46 user nova-compute[75176]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07de7953-293c-4762-b695-ed3190c934d5 (non-flash)
Nov 28 15:51:46 user nova-compute[75176]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc (non-flash)
Nov 28 15:51:46 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:51:46 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-72eda9dd-a88c-4f28-8be3-a61cbecb4838 tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8452525c-6845-4edb-bf69-1e2ffe0ef2eb (non-flash)
Nov 28 15:51:46 user nova-compute[75176]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36b14046-bbe0-45c6-add0-ab16578b41d3 (non-flash)
Nov 28 15:51:46 user nova-compute[75176]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21587566-b951-4b3e-8024-b6c2d2da35af (non-flash)
Nov 28 15:51:46 user nova-compute[75176]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07de7953-293c-4762-b695-ed3190c934d5 (non-flash)
Nov 28 15:51:46 user nova-compute[75176]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc (non-flash)
Nov 28 15:51:46 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 15:51:46 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-72eda9dd-a88c-4f28-8be3-a61cbecb4838 tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f462c6af520>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:36b14046-bbe0-45c6-add0-ab16578b41d3'): ({'sde'}, set())}) {{(pid=75176) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 15:51:46 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-72eda9dd-a88c-4f28-8be3-a61cbecb4838 tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Removing single pathed devices sde {{(pid=75176) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 15:51:46 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:51:46 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:51:46 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[28dba9b1-0b2e-42f9-bd80-219bb43313c4]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:51:46 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:51:47 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:51:47 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[5851211f-a622-4f09-ad5c-12c6c2c78a82]: (4, ('ok\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:51:47 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-72eda9dd-a88c-4f28-8be3-a61cbecb4838 tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Flushing IO for device /dev/sde {{(pid=75176) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 15:51:47 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:51:47 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:51:47 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[4184b73d-a6ec-43d0-949e-fc1485e21c2b]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:51:47 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-72eda9dd-a88c-4f28-8be3-a61cbecb4838 tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75176) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 15:51:47 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:51:47 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.055s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:51:47 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[20b260c8-a018-4437-977a-c91cd8c38d4f]: (4, ('1', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:51:47 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-72eda9dd-a88c-4f28-8be3-a61cbecb4838 tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75176) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 15:51:47 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-72eda9dd-a88c-4f28-8be3-a61cbecb4838 tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] SCSI volumes sde have been removed. {{(pid=75176) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 15:51:47 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-72eda9dd-a88c-4f28-8be3-a61cbecb4838 tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:36b14046-bbe0-45c6-add0-ab16578b41d3')] {{(pid=75176) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 15:51:47 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36b14046-bbe0-45c6-add0-ab16578b41d3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:51:47 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36b14046-bbe0-45c6-add0-ab16578b41d3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:51:47 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[1de9ed7e-1f08-453c-ae9b-5d1751dfce86]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:51:47 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-72eda9dd-a88c-4f28-8be3-a61cbecb4838 tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:51:47 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36b14046-bbe0-45c6-add0-ab16578b41d3 -p 172.16.0.220:3260 --logout {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:51:47 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-93c0d78d-efe6-4227-a781-df7704707500 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Acquiring lock "cbefda8d-d285-404b-9817-49deada49d0b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:51:47 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-93c0d78d-efe6-4227-a781-df7704707500 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Lock "cbefda8d-d285-404b-9817-49deada49d0b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:51:47 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-93c0d78d-efe6-4227-a781-df7704707500 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Acquiring lock "cbefda8d-d285-404b-9817-49deada49d0b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:51:47 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-93c0d78d-efe6-4227-a781-df7704707500 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Lock "cbefda8d-d285-404b-9817-49deada49d0b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:51:47 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-93c0d78d-efe6-4227-a781-df7704707500 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Lock "cbefda8d-d285-404b-9817-49deada49d0b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:51:47 user nova-compute[75176]: INFO nova.compute.manager [None req-93c0d78d-efe6-4227-a781-df7704707500 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] [instance: cbefda8d-d285-404b-9817-49deada49d0b] Terminating instance
Nov 28 15:51:47 user nova-compute[75176]: DEBUG nova.compute.manager [None req-93c0d78d-efe6-4227-a781-df7704707500 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] [instance: cbefda8d-d285-404b-9817-49deada49d0b] Start destroying the instance on the hypervisor. {{(pid=75176) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 15:51:47 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36b14046-bbe0-45c6-add0-ab16578b41d3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.088s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:51:47 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[dddffb0c-0efc-447b-a47b-80913309c7c0]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:36b14046-bbe0-45c6-add0-ab16578b41d3, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:36b14046-bbe0-45c6-add0-ab16578b41d3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:51:47 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-72eda9dd-a88c-4f28-8be3-a61cbecb4838 tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:36b14046-bbe0-45c6-add0-ab16578b41d3, portal: 172.16.0.220,3260]
Nov 28 15:51:47 user nova-compute[75176]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:36b14046-bbe0-45c6-add0-ab16578b41d3, portal: 172.16.0.220,3260] successful.
Nov 28 15:51:47 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:51:47 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36b14046-bbe0-45c6-add0-ab16578b41d3 -p 172.16.0.220:3260 --op delete {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:51:47 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:51:47 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36b14046-bbe0-45c6-add0-ab16578b41d3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:51:47 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a81c03c-8aae-499d-99f3-19aa02f8b116]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:51:47 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-72eda9dd-a88c-4f28-8be3-a61cbecb4838 tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:51:47 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-72eda9dd-a88c-4f28-8be3-a61cbecb4838 tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.384s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 15:51:47 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-72eda9dd-a88c-4f28-8be3-a61cbecb4838 tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] <== disconnect_volume: return (387ms) None {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 15:51:47 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-72eda9dd-a88c-4f28-8be3-a61cbecb4838 tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] [instance: a6ebcc53-802a-4515-ba41-3e8e1129235f] Disconnected iSCSI Volume {{(pid=75176) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 15:51:47 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:51:47 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:51:47 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:51:47 user nova-compute[75176]: DEBUG nova.compute.manager [req-a84a90c3-cef2-4f24-a823-dd2168ff976d req-61778fd5-c41d-42d0-8e31-7c48f7348f39 service nova] [instance: cbefda8d-d285-404b-9817-49deada49d0b] Received event network-vif-unplugged-b402b4bc-60ff-48fa-9fff-f9ec26d82fa0 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:51:47 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-a84a90c3-cef2-4f24-a823-dd2168ff976d req-61778fd5-c41d-42d0-8e31-7c48f7348f39 service nova] Acquiring lock "cbefda8d-d285-404b-9817-49deada49d0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:51:47 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-a84a90c3-cef2-4f24-a823-dd2168ff976d req-61778fd5-c41d-42d0-8e31-7c48f7348f39 service nova] Lock "cbefda8d-d285-404b-9817-49deada49d0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:51:47 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-a84a90c3-cef2-4f24-a823-dd2168ff976d req-61778fd5-c41d-42d0-8e31-7c48f7348f39 service nova] Lock "cbefda8d-d285-404b-9817-49deada49d0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:51:47 user nova-compute[75176]: DEBUG nova.compute.manager [req-a84a90c3-cef2-4f24-a823-dd2168ff976d req-61778fd5-c41d-42d0-8e31-7c48f7348f39 service nova] [instance: cbefda8d-d285-404b-9817-49deada49d0b] No waiting events found dispatching network-vif-unplugged-b402b4bc-60ff-48fa-9fff-f9ec26d82fa0 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:51:47 user nova-compute[75176]: DEBUG nova.compute.manager [req-a84a90c3-cef2-4f24-a823-dd2168ff976d req-61778fd5-c41d-42d0-8e31-7c48f7348f39 service nova] [instance: cbefda8d-d285-404b-9817-49deada49d0b] Received event network-vif-unplugged-b402b4bc-60ff-48fa-9fff-f9ec26d82fa0 for instance with task_state deleting. {{(pid=75176) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 15:51:47 user nova-compute[75176]: INFO nova.virt.libvirt.driver [-] [instance: cbefda8d-d285-404b-9817-49deada49d0b] Instance destroyed successfully.
Nov 28 15:51:47 user nova-compute[75176]: DEBUG nova.objects.instance [None req-93c0d78d-efe6-4227-a781-df7704707500 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Lazy-loading 'resources' on Instance uuid cbefda8d-d285-404b-9817-49deada49d0b {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:51:47 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-93c0d78d-efe6-4227-a781-df7704707500 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T15:48:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-457527942',display_name='tempest-AttachVolumeNegativeTest-server-457527942',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-457527942',id=29,image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM1xb1w6vkpWoAyAdn1haqlReexF6NyUKIxeUkA+iAyXdDoS8pSd0LDNx6z1XpYl+y9RfN/9vW8FFzLTu1EmkfynQSX+ueIX7y+hYerPPhHmZDwfjuXiZHVuYWw/l9lptQ==',key_name='tempest-keypair-1426689179',keypairs=<?>,launch_index=0,launched_at=2023-11-28T15:48:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a194f81f7e104be7940d1d05f71bbad9',ramdisk_id='',reservation_id='r-lj7bv023',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1403590572',owner_user_name='tempest-AttachVolumeNegativeTest-1403590572-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T15:48:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f9a745552d974e05a9e0befc68eb7f6e',uuid=cbefda8d-d285-404b-9817-49deada49d0b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b402b4bc-60ff-48fa-9fff-f9ec26d82fa0", "address": "fa:16:3e:b8:33:b8", "network": {"id": "7ab60343-57be-427d-9037-6ecf0eaf5de0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1508138843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a194f81f7e104be7940d1d05f71bbad9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb402b4bc-60", "ovs_interfaceid": "b402b4bc-60ff-48fa-9fff-f9ec26d82fa0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 15:51:47 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-93c0d78d-efe6-4227-a781-df7704707500 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Converting VIF {"id": "b402b4bc-60ff-48fa-9fff-f9ec26d82fa0", "address": "fa:16:3e:b8:33:b8", "network": {"id": "7ab60343-57be-427d-9037-6ecf0eaf5de0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1508138843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a194f81f7e104be7940d1d05f71bbad9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb402b4bc-60", "ovs_interfaceid": "b402b4bc-60ff-48fa-9fff-f9ec26d82fa0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:51:47 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-93c0d78d-efe6-4227-a781-df7704707500 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b8:33:b8,bridge_name='br-int',has_traffic_filtering=True,id=b402b4bc-60ff-48fa-9fff-f9ec26d82fa0,network=Network(7ab60343-57be-427d-9037-6ecf0eaf5de0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb402b4bc-60') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:51:47 user nova-compute[75176]: DEBUG os_vif [None req-93c0d78d-efe6-4227-a781-df7704707500 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b8:33:b8,bridge_name='br-int',has_traffic_filtering=True,id=b402b4bc-60ff-48fa-9fff-f9ec26d82fa0,network=Network(7ab60343-57be-427d-9037-6ecf0eaf5de0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb402b4bc-60') {{(pid=75176) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 15:51:47 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:51:47 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb402b4bc-60, bridge=br-int, if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:51:47 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:51:47 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:51:47 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:51:47 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=414ffea0-f067-49ae-b412-f95b0e69577c) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:51:47 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:51:47 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:51:47 user nova-compute[75176]: INFO os_vif [None req-93c0d78d-efe6-4227-a781-df7704707500 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b8:33:b8,bridge_name='br-int',has_traffic_filtering=True,id=b402b4bc-60ff-48fa-9fff-f9ec26d82fa0,network=Network(7ab60343-57be-427d-9037-6ecf0eaf5de0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb402b4bc-60')
Nov 28 15:51:47 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-93c0d78d-efe6-4227-a781-df7704707500 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] [instance: cbefda8d-d285-404b-9817-49deada49d0b] Deleting instance files /opt/stack/data/nova/instances/cbefda8d-d285-404b-9817-49deada49d0b_del
Nov 28 15:51:47 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-93c0d78d-efe6-4227-a781-df7704707500 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] [instance: cbefda8d-d285-404b-9817-49deada49d0b] Deletion of /opt/stack/data/nova/instances/cbefda8d-d285-404b-9817-49deada49d0b_del complete
Nov 28 15:51:48 user nova-compute[75176]: INFO nova.compute.manager [None req-93c0d78d-efe6-4227-a781-df7704707500 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] [instance: cbefda8d-d285-404b-9817-49deada49d0b] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 28 15:51:48 user nova-compute[75176]: DEBUG oslo.service.loopingcall [None req-93c0d78d-efe6-4227-a781-df7704707500 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75176) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 15:51:48 user nova-compute[75176]: DEBUG nova.compute.manager [-] [instance: cbefda8d-d285-404b-9817-49deada49d0b] Deallocating network for instance {{(pid=75176) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 15:51:48 user nova-compute[75176]: DEBUG nova.network.neutron [-] [instance: cbefda8d-d285-404b-9817-49deada49d0b] deallocate_for_instance() {{(pid=75176) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 15:51:48 user nova-compute[75176]: DEBUG nova.network.neutron [-] [instance: cbefda8d-d285-404b-9817-49deada49d0b] Updating instance_info_cache with network_info: [] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:51:48 user nova-compute[75176]: INFO nova.compute.manager [-] [instance: cbefda8d-d285-404b-9817-49deada49d0b] Took 0.81 seconds to deallocate network for instance.
Nov 28 15:51:48 user nova-compute[75176]: DEBUG nova.compute.manager [req-0b2e40e5-b02d-4a17-9ddc-fdbf1beb8192 req-eba67b17-1f11-4c27-a51c-6c9ccc3a4def service nova] [instance: cbefda8d-d285-404b-9817-49deada49d0b] Received event network-vif-deleted-b402b4bc-60ff-48fa-9fff-f9ec26d82fa0 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:51:48 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-93c0d78d-efe6-4227-a781-df7704707500 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:51:48 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-93c0d78d-efe6-4227-a781-df7704707500 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:51:49 user nova-compute[75176]: DEBUG nova.compute.provider_tree [None req-93c0d78d-efe6-4227-a781-df7704707500 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Inventory has not changed in ProviderTree for provider: b37848d8-f401-4155-a029-b0ffa09ff85b {{(pid=75176) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 15:51:49 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-93c0d78d-efe6-4227-a781-df7704707500 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Inventory has not changed for provider b37848d8-f401-4155-a029-b0ffa09ff85b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75176) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 15:51:49 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-93c0d78d-efe6-4227-a781-df7704707500 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.410s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:51:49 user nova-compute[75176]: INFO nova.scheduler.client.report [None req-93c0d78d-efe6-4227-a781-df7704707500 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Deleted allocations for instance cbefda8d-d285-404b-9817-49deada49d0b
Nov 28 15:51:49 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-93c0d78d-efe6-4227-a781-df7704707500 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Lock "cbefda8d-d285-404b-9817-49deada49d0b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.334s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:51:49 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:51:49 user nova-compute[75176]: DEBUG nova.compute.manager [req-21b5c134-b6b3-4237-a6ac-ca2183b84a77 req-161cccd8-189d-46a4-818a-40a6c7803202 service nova] [instance: cbefda8d-d285-404b-9817-49deada49d0b] Received event network-vif-plugged-b402b4bc-60ff-48fa-9fff-f9ec26d82fa0 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:51:49 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-21b5c134-b6b3-4237-a6ac-ca2183b84a77 req-161cccd8-189d-46a4-818a-40a6c7803202 service nova] Acquiring lock "cbefda8d-d285-404b-9817-49deada49d0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:51:49 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-21b5c134-b6b3-4237-a6ac-ca2183b84a77 req-161cccd8-189d-46a4-818a-40a6c7803202 service nova] Lock "cbefda8d-d285-404b-9817-49deada49d0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:51:49 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-21b5c134-b6b3-4237-a6ac-ca2183b84a77 req-161cccd8-189d-46a4-818a-40a6c7803202 service nova] Lock "cbefda8d-d285-404b-9817-49deada49d0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:51:49 user nova-compute[75176]: DEBUG nova.compute.manager [req-21b5c134-b6b3-4237-a6ac-ca2183b84a77 req-161cccd8-189d-46a4-818a-40a6c7803202 service nova] [instance: cbefda8d-d285-404b-9817-49deada49d0b] No waiting events found dispatching network-vif-plugged-b402b4bc-60ff-48fa-9fff-f9ec26d82fa0 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:51:49 user nova-compute[75176]: WARNING nova.compute.manager [req-21b5c134-b6b3-4237-a6ac-ca2183b84a77 req-161cccd8-189d-46a4-818a-40a6c7803202 service nova] [instance: cbefda8d-d285-404b-9817-49deada49d0b] Received unexpected event network-vif-plugged-b402b4bc-60ff-48fa-9fff-f9ec26d82fa0 for instance with vm_state deleted and task_state None.
Nov 28 15:51:49 user nova-compute[75176]: DEBUG nova.objects.instance [None req-72eda9dd-a88c-4f28-8be3-a61cbecb4838 tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Lazy-loading 'flavor' on Instance uuid a6ebcc53-802a-4515-ba41-3e8e1129235f {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:51:49 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-72eda9dd-a88c-4f28-8be3-a61cbecb4838 tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Lock "a6ebcc53-802a-4515-ba41-3e8e1129235f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 23.505s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:51:49 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-d668d506-a2d3-4f09-b630-41596a28efbb tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:51:49 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-d668d506-a2d3-4f09-b630-41596a28efbb tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:51:49 user nova-compute[75176]: DEBUG nova.objects.instance [None req-d668d506-a2d3-4f09-b630-41596a28efbb tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] Lazy-loading 'pci_requests' on Instance uuid ca1558cf-b235-4a20-8d12-45f1ca16fe41 {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:51:49 user nova-compute[75176]: DEBUG nova.objects.instance [None req-d668d506-a2d3-4f09-b630-41596a28efbb tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] Lazy-loading 'numa_topology' on Instance uuid ca1558cf-b235-4a20-8d12-45f1ca16fe41 {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:51:49 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-d668d506-a2d3-4f09-b630-41596a28efbb tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75176) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 15:51:49 user nova-compute[75176]: INFO nova.compute.claims [None req-d668d506-a2d3-4f09-b630-41596a28efbb tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] [instance: ca1558cf-b235-4a20-8d12-45f1ca16fe41] Claim successful on node user
Nov 28 15:51:50 user nova-compute[75176]: DEBUG nova.compute.provider_tree [None req-d668d506-a2d3-4f09-b630-41596a28efbb tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] Inventory has not changed in ProviderTree for provider: b37848d8-f401-4155-a029-b0ffa09ff85b {{(pid=75176) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 15:51:50 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-d668d506-a2d3-4f09-b630-41596a28efbb tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] Inventory has not changed for provider b37848d8-f401-4155-a029-b0ffa09ff85b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75176) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 15:51:50 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-d668d506-a2d3-4f09-b630-41596a28efbb tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.457s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:51:50 user nova-compute[75176]: INFO nova.network.neutron [None req-d668d506-a2d3-4f09-b630-41596a28efbb tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] [instance: ca1558cf-b235-4a20-8d12-45f1ca16fe41] Updating port 2791b548-7207-402c-9f65-c078be714ef5 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 28 15:51:51 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-d668d506-a2d3-4f09-b630-41596a28efbb tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] Acquiring lock "refresh_cache-ca1558cf-b235-4a20-8d12-45f1ca16fe41" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:51:51 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-d668d506-a2d3-4f09-b630-41596a28efbb tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] Acquired lock "refresh_cache-ca1558cf-b235-4a20-8d12-45f1ca16fe41" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:51:51 user nova-compute[75176]: DEBUG nova.network.neutron [None req-d668d506-a2d3-4f09-b630-41596a28efbb tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] [instance: ca1558cf-b235-4a20-8d12-45f1ca16fe41] Building network info cache for instance {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 15:51:51 user nova-compute[75176]: DEBUG nova.compute.manager [req-7ea110bf-e504-49a6-8ab6-b289376ea017 req-96b4dc76-3255-4ca4-9d33-647b579ec271 service nova] [instance: ca1558cf-b235-4a20-8d12-45f1ca16fe41] Received event network-changed-2791b548-7207-402c-9f65-c078be714ef5 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:51:51 user nova-compute[75176]: DEBUG nova.compute.manager [req-7ea110bf-e504-49a6-8ab6-b289376ea017 req-96b4dc76-3255-4ca4-9d33-647b579ec271 service nova] [instance: ca1558cf-b235-4a20-8d12-45f1ca16fe41] Refreshing instance network info cache due to event network-changed-2791b548-7207-402c-9f65-c078be714ef5. {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 15:51:51 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-7ea110bf-e504-49a6-8ab6-b289376ea017 req-96b4dc76-3255-4ca4-9d33-647b579ec271 service nova] Acquiring lock "refresh_cache-ca1558cf-b235-4a20-8d12-45f1ca16fe41" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:51:51 user nova-compute[75176]: DEBUG nova.network.neutron [None req-d668d506-a2d3-4f09-b630-41596a28efbb tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] [instance: ca1558cf-b235-4a20-8d12-45f1ca16fe41] Updating instance_info_cache with network_info: [{"id": "2791b548-7207-402c-9f65-c078be714ef5", "address": "fa:16:3e:08:ec:9f", "network": {"id": "1f00fd98-3cd0-4c8c-912a-bc29124e1940", "bridge": "br-int", "label": "tempest-TestShelveInstance-1334429215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a8b3f118afd469f9c82ec2574586aaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2791b548-72", "ovs_interfaceid": "2791b548-7207-402c-9f65-c078be714ef5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:51:51 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-d668d506-a2d3-4f09-b630-41596a28efbb tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] Releasing lock "refresh_cache-ca1558cf-b235-4a20-8d12-45f1ca16fe41" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:51:51 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-d668d506-a2d3-4f09-b630-41596a28efbb tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] [instance: ca1558cf-b235-4a20-8d12-45f1ca16fe41] Creating instance directory {{(pid=75176) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 15:51:51 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-d668d506-a2d3-4f09-b630-41596a28efbb tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] [instance: ca1558cf-b235-4a20-8d12-45f1ca16fe41] Creating image(s)
Nov 28 15:51:51 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-d668d506-a2d3-4f09-b630-41596a28efbb tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] [instance: ca1558cf-b235-4a20-8d12-45f1ca16fe41] Did not create local disks {{(pid=75176) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 28 15:51:51 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-d668d506-a2d3-4f09-b630-41596a28efbb tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] [instance: ca1558cf-b235-4a20-8d12-45f1ca16fe41] Ensure instance console log exists: /opt/stack/data/nova/instances/ca1558cf-b235-4a20-8d12-45f1ca16fe41/console.log {{(pid=75176) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 15:51:51 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-d668d506-a2d3-4f09-b630-41596a28efbb tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:51:51 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-d668d506-a2d3-4f09-b630-41596a28efbb tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:51:51 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-d668d506-a2d3-4f09-b630-41596a28efbb tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:51:51 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-d668d506-a2d3-4f09-b630-41596a28efbb tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] [instance: ca1558cf-b235-4a20-8d12-45f1ca16fe41] Start _get_guest_xml network_info=[{"id": "2791b548-7207-402c-9f65-c078be714ef5", "address": "fa:16:3e:08:ec:9f", "network": {"id": "1f00fd98-3cd0-4c8c-912a-bc29124e1940", "bridge": "br-int", "label": "tempest-TestShelveInstance-1334429215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a8b3f118afd469f9c82ec2574586aaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2791b548-72", "ovs_interfaceid": "2791b548-7207-402c-9f65-c078be714ef5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:22933c6e-3d8f-44f5-bc41-dee97c587055', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ujGDYdRg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ca1558cf-b235-4a20-8d12-45f1ca16fe41', 'attached_at': '', 'detached_at': '', 'volume_id': '22933c6e-3d8f-44f5-bc41-dee97c587055', 'serial': '22933c6e-3d8f-44f5-bc41-dee97c587055'}, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'delete_on_termination': True, 'mount_device': '/dev/vda', 'attachment_id': '0f891720-e06e-49e7-9e4f-8670428943b6', 'volume_type': None} {{(pid=75176) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 15:51:51 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-7ea110bf-e504-49a6-8ab6-b289376ea017 req-96b4dc76-3255-4ca4-9d33-647b579ec271 service nova] Acquired lock "refresh_cache-ca1558cf-b235-4a20-8d12-45f1ca16fe41" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:51:51 user nova-compute[75176]: DEBUG nova.network.neutron [req-7ea110bf-e504-49a6-8ab6-b289376ea017 req-96b4dc76-3255-4ca4-9d33-647b579ec271 service nova] [instance: ca1558cf-b235-4a20-8d12-45f1ca16fe41] Refreshing network info cache for port 2791b548-7207-402c-9f65-c078be714ef5 {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 15:51:51 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-d668d506-a2d3-4f09-b630-41596a28efbb tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 15:51:51 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-d668d506-a2d3-4f09-b630-41596a28efbb tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 15:51:51 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-d668d506-a2d3-4f09-b630-41596a28efbb tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75176) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 15:51:51 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-d668d506-a2d3-4f09-b630-41596a28efbb tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] CPU controller missing on host. {{(pid=75176) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 15:51:51 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-d668d506-a2d3-4f09-b630-41596a28efbb tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75176) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 15:51:51 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-d668d506-a2d3-4f09-b630-41596a28efbb tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] CPU controller found on host. {{(pid=75176) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 15:51:51 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-d668d506-a2d3-4f09-b630-41596a28efbb tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75176) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 15:51:51 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-d668d506-a2d3-4f09-b630-41596a28efbb tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T15:35:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 15:51:51 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-d668d506-a2d3-4f09-b630-41596a28efbb tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] Flavor limits 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 15:51:51 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-d668d506-a2d3-4f09-b630-41596a28efbb tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] Image limits 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 15:51:51 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-d668d506-a2d3-4f09-b630-41596a28efbb tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] Flavor pref 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 15:51:51 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-d668d506-a2d3-4f09-b630-41596a28efbb tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] Image pref 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 15:51:51 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-d668d506-a2d3-4f09-b630-41596a28efbb tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 15:51:51 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-d668d506-a2d3-4f09-b630-41596a28efbb tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 15:51:51 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-d668d506-a2d3-4f09-b630-41596a28efbb tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75176) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 15:51:51 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-d668d506-a2d3-4f09-b630-41596a28efbb tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] Got 1 possible topologies {{(pid=75176) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 15:51:51 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-d668d506-a2d3-4f09-b630-41596a28efbb tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 15:51:51 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-d668d506-a2d3-4f09-b630-41596a28efbb tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 15:51:51 user nova-compute[75176]: DEBUG nova.objects.instance [None req-d668d506-a2d3-4f09-b630-41596a28efbb tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] Lazy-loading 'vcpu_model' on Instance uuid ca1558cf-b235-4a20-8d12-45f1ca16fe41 {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:51:51 user nova-compute[75176]: DEBUG nova.objects.base [None req-d668d506-a2d3-4f09-b630-41596a28efbb tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] Object Instance<ca1558cf-b235-4a20-8d12-45f1ca16fe41> lazy-loaded attributes: pci_requests,vcpu_model {{(pid=75176) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 15:51:51 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d668d506-a2d3-4f09-b630-41596a28efbb tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] [instance: ca1558cf-b235-4a20-8d12-45f1ca16fe41] Calling os-brick to attach iSCSI Volume {{(pid=75176) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 15:51:51 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-d668d506-a2d3-4f09-b630-41596a28efbb tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c1b8a00>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:22933c6e-3d8f-44f5-bc41-dee97c587055', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ujGDYdRg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 15:51:51 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-d668d506-a2d3-4f09-b630-41596a28efbb tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 15:51:51 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-d668d506-a2d3-4f09-b630-41596a28efbb tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 15:51:51 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-d668d506-a2d3-4f09-b630-41596a28efbb tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 15:51:51 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-d668d506-a2d3-4f09-b630-41596a28efbb tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 15:51:51 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-d668d506-a2d3-4f09-b630-41596a28efbb tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:22933c6e-3d8f-44f5-bc41-dee97c587055" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 15:51:51 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-d668d506-a2d3-4f09-b630-41596a28efbb tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:22933c6e-3d8f-44f5-bc41-dee97c587055" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 15:51:51 user nova-compute[75176]: INFO os_brick.initiator.connectors.iscsi [None req-d668d506-a2d3-4f09-b630-41596a28efbb tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 15:51:51 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22933c6e-3d8f-44f5-bc41-dee97c587055 -p 172.16.0.220:3260 {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:51:52 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22933c6e-3d8f-44f5-bc41-dee97c587055 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:51:52 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[90dc83c4-a1c3-4f26-b02c-d1c5f019ccdc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:51:52 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-d668d506-a2d3-4f09-b630-41596a28efbb tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 15:51:52 user nova-compute[75176]:  {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:51:52 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22933c6e-3d8f-44f5-bc41-dee97c587055 -p 172.16.0.220:3260 --interface default --op new {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:51:52 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22933c6e-3d8f-44f5-bc41-dee97c587055 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:51:52 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[b78d4498-3028-48a8-9dac-26ebca0c51cd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:22933c6e-3d8f-44f5-bc41-dee97c587055] added\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:51:52 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-d668d506-a2d3-4f09-b630-41596a28efbb tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:22933c6e-3d8f-44f5-bc41-dee97c587055] added
Nov 28 15:51:52 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:51:52 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22933c6e-3d8f-44f5-bc41-dee97c587055 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:51:52 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22933c6e-3d8f-44f5-bc41-dee97c587055 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:51:52 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[b05a1371-40fc-48f2-bfc6-89259de461d4]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:51:52 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-d668d506-a2d3-4f09-b630-41596a28efbb tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:51:52 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22933c6e-3d8f-44f5-bc41-dee97c587055 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:51:52 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22933c6e-3d8f-44f5-bc41-dee97c587055 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:51:52 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9553339-b5f3-493b-868a-1bf59ad47ac2]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:51:52 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-d668d506-a2d3-4f09-b630-41596a28efbb tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:51:52 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22933c6e-3d8f-44f5-bc41-dee97c587055 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ujGDYdRg {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:51:52 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22933c6e-3d8f-44f5-bc41-dee97c587055 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ujGDYdRg" returned: 0 in 0.020s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:51:52 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cbec6ee-c130-4f83-bcf4-6eca5dc5458c]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:51:52 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-d668d506-a2d3-4f09-b630-41596a28efbb tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ujGDYdRg'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:51:52 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22933c6e-3d8f-44f5-bc41-dee97c587055 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:51:52 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22933c6e-3d8f-44f5-bc41-dee97c587055 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:51:52 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3936235-2c2e-4e27-9c08-646365594a0f]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:51:52 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-d668d506-a2d3-4f09-b630-41596a28efbb tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:51:52 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:51:52 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:51:52 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[48ec965b-5f55-4bc4-ae4f-e0984dac9f73]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8452525c-6845-4edb-bf69-1e2ffe0ef2eb (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21587566-b951-4b3e-8024-b6c2d2da35af (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07de7953-293c-4762-b695-ed3190c934d5 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc (non-flash)\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:51:52 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-d668d506-a2d3-4f09-b630-41596a28efbb tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8452525c-6845-4edb-bf69-1e2ffe0ef2eb (non-flash)
Nov 28 15:51:52 user nova-compute[75176]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21587566-b951-4b3e-8024-b6c2d2da35af (non-flash)
Nov 28 15:51:52 user nova-compute[75176]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07de7953-293c-4762-b695-ed3190c934d5 (non-flash)
Nov 28 15:51:52 user nova-compute[75176]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc (non-flash)
Nov 28 15:51:52 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:51:52 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-d668d506-a2d3-4f09-b630-41596a28efbb tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8452525c-6845-4edb-bf69-1e2ffe0ef2eb (non-flash)
Nov 28 15:51:52 user nova-compute[75176]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21587566-b951-4b3e-8024-b6c2d2da35af (non-flash)
Nov 28 15:51:52 user nova-compute[75176]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07de7953-293c-4762-b695-ed3190c934d5 (non-flash)
Nov 28 15:51:52 user nova-compute[75176]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc (non-flash)
Nov 28 15:51:52 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 15:51:52 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22933c6e-3d8f-44f5-bc41-dee97c587055 -p 172.16.0.220:3260 --login {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:51:52 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22933c6e-3d8f-44f5-bc41-dee97c587055 -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:51:52 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[8802dbcd-06a8-49dd-9d65-2d639a06b1d8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:22933c6e-3d8f-44f5-bc41-dee97c587055, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:22933c6e-3d8f-44f5-bc41-dee97c587055, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:51:52 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-d668d506-a2d3-4f09-b630-41596a28efbb tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:22933c6e-3d8f-44f5-bc41-dee97c587055, portal: 172.16.0.220,3260]
Nov 28 15:51:52 user nova-compute[75176]: Login to [iface: default, target: iqn.2010-10.org.openstack:22933c6e-3d8f-44f5-bc41-dee97c587055, portal: 172.16.0.220,3260] successful.
Nov 28 15:51:52 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:51:52 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22933c6e-3d8f-44f5-bc41-dee97c587055 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:51:52 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22933c6e-3d8f-44f5-bc41-dee97c587055 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:51:52 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3e0362a-aa49-4a46-bc46-19ab0ed90f5a]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:51:52 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-d668d506-a2d3-4f09-b630-41596a28efbb tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:51:52 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:51:52 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:51:52 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[620c50f0-ed98-4d87-bfd2-31c9e783445b]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8452525c-6845-4edb-bf69-1e2ffe0ef2eb (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21587566-b951-4b3e-8024-b6c2d2da35af (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07de7953-293c-4762-b695-ed3190c934d5 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22933c6e-3d8f-44f5-bc41-dee97c587055 (non-flash)\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:51:52 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-d668d506-a2d3-4f09-b630-41596a28efbb tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8452525c-6845-4edb-bf69-1e2ffe0ef2eb (non-flash)
Nov 28 15:51:52 user nova-compute[75176]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21587566-b951-4b3e-8024-b6c2d2da35af (non-flash)
Nov 28 15:51:52 user nova-compute[75176]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07de7953-293c-4762-b695-ed3190c934d5 (non-flash)
Nov 28 15:51:52 user nova-compute[75176]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc (non-flash)
Nov 28 15:51:52 user nova-compute[75176]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22933c6e-3d8f-44f5-bc41-dee97c587055 (non-flash)
Nov 28 15:51:52 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:51:52 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-d668d506-a2d3-4f09-b630-41596a28efbb tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8452525c-6845-4edb-bf69-1e2ffe0ef2eb (non-flash)
Nov 28 15:51:52 user nova-compute[75176]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21587566-b951-4b3e-8024-b6c2d2da35af (non-flash)
Nov 28 15:51:52 user nova-compute[75176]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07de7953-293c-4762-b695-ed3190c934d5 (non-flash)
Nov 28 15:51:52 user nova-compute[75176]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc (non-flash)
Nov 28 15:51:52 user nova-compute[75176]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22933c6e-3d8f-44f5-bc41-dee97c587055 (non-flash)
Nov 28 15:51:52 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 15:51:52 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-d668d506-a2d3-4f09-b630-41596a28efbb tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:22933c6e-3d8f-44f5-bc41-dee97c587055" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.330s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 15:51:52 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-d668d506-a2d3-4f09-b630-41596a28efbb tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] Connected to 172.16.0.220:3260 {{(pid=75176) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 15:51:52 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-d668d506-a2d3-4f09-b630-41596a28efbb tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] HCTL ('33', '-', '-', 0) found on session 39 with lun 0 {{(pid=75176) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 15:51:52 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-d668d506-a2d3-4f09-b630-41596a28efbb tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75176) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 15:51:52 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:51:52 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:51:52 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[4927c72c-bbf4-4891-8314-e2226bb938d7]: (4, ('- - 0', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:51:52 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-d668d506-a2d3-4f09-b630-41596a28efbb tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] Searching for a device in session 39 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75176) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 15:51:52 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-d668d506-a2d3-4f09-b630-41596a28efbb tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:22933c6e-3d8f-44f5-bc41-dee97c587055', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ujGDYdRg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75176) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 15:51:52 user nova-compute[75176]: DEBUG nova.network.neutron [req-7ea110bf-e504-49a6-8ab6-b289376ea017 req-96b4dc76-3255-4ca4-9d33-647b579ec271 service nova] [instance: ca1558cf-b235-4a20-8d12-45f1ca16fe41] Updated VIF entry in instance network info cache for port 2791b548-7207-402c-9f65-c078be714ef5. {{(pid=75176) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 15:51:52 user nova-compute[75176]: DEBUG nova.network.neutron [req-7ea110bf-e504-49a6-8ab6-b289376ea017 req-96b4dc76-3255-4ca4-9d33-647b579ec271 service nova] [instance: ca1558cf-b235-4a20-8d12-45f1ca16fe41] Updating instance_info_cache with network_info: [{"id": "2791b548-7207-402c-9f65-c078be714ef5", "address": "fa:16:3e:08:ec:9f", "network": {"id": "1f00fd98-3cd0-4c8c-912a-bc29124e1940", "bridge": "br-int", "label": "tempest-TestShelveInstance-1334429215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a8b3f118afd469f9c82ec2574586aaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2791b548-72", "ovs_interfaceid": "2791b548-7207-402c-9f65-c078be714ef5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:51:52 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-7ea110bf-e504-49a6-8ab6-b289376ea017 req-96b4dc76-3255-4ca4-9d33-647b579ec271 service nova] Releasing lock "refresh_cache-ca1558cf-b235-4a20-8d12-45f1ca16fe41" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:51:52 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:51:53 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-d668d506-a2d3-4f09-b630-41596a28efbb tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.368s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 15:51:53 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-d668d506-a2d3-4f09-b630-41596a28efbb tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] <== connect_volume: return (1370ms) {'type': 'block', 'scsi_wwn': '23366336565616637', 'path': '/dev/sdb'} {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 15:51:53 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d668d506-a2d3-4f09-b630-41596a28efbb tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] [instance: ca1558cf-b235-4a20-8d12-45f1ca16fe41] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23366336565616637', 'path': '/dev/sdb'} {{(pid=75176) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 15:51:53 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-d668d506-a2d3-4f09-b630-41596a28efbb tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-28T15:47:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1092777141',display_name='tempest-TestShelveInstance-server-1092777141',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1092777141',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-2062365153',keypairs=<?>,launch_index=0,launched_at=2023-11-28T15:48:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='7a8b3f118afd469f9c82ec2574586aaf',ramdisk_id='',reservation_id='r-0ue1lblf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-801353787',owner_user_name='tempest-TestShelveInstance-801353787-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T15:51:42Z,user_data=None,user_id='4753cf25a4c14e8aacd55309ff7e988d',uuid=ca1558cf-b235-4a20-8d12-45f1ca16fe41,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "2791b548-7207-402c-9f65-c078be714ef5", "address": "fa:16:3e:08:ec:9f", "network": {"id": "1f00fd98-3cd0-4c8c-912a-bc29124e1940", "bridge": "br-int", "label": "tempest-TestShelveInstance-1334429215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a8b3f118afd469f9c82ec2574586aaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2791b548-72", "ovs_interfaceid": "2791b548-7207-402c-9f65-c078be714ef5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75176) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 15:51:53 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-d668d506-a2d3-4f09-b630-41596a28efbb tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] Converting VIF {"id": "2791b548-7207-402c-9f65-c078be714ef5", "address": "fa:16:3e:08:ec:9f", "network": {"id": "1f00fd98-3cd0-4c8c-912a-bc29124e1940", "bridge": "br-int", "label": "tempest-TestShelveInstance-1334429215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a8b3f118afd469f9c82ec2574586aaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2791b548-72", "ovs_interfaceid": "2791b548-7207-402c-9f65-c078be714ef5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:51:53 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-d668d506-a2d3-4f09-b630-41596a28efbb tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:ec:9f,bridge_name='br-int',has_traffic_filtering=True,id=2791b548-7207-402c-9f65-c078be714ef5,network=Network(1f00fd98-3cd0-4c8c-912a-bc29124e1940),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2791b548-72') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:51:53 user nova-compute[75176]: DEBUG nova.objects.instance [None req-d668d506-a2d3-4f09-b630-41596a28efbb tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] Lazy-loading 'pci_devices' on Instance uuid ca1558cf-b235-4a20-8d12-45f1ca16fe41 {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:51:53 user nova-compute[75176]: DEBUG nova.objects.base [None req-d668d506-a2d3-4f09-b630-41596a28efbb tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] Object Instance<ca1558cf-b235-4a20-8d12-45f1ca16fe41> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices {{(pid=75176) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 15:51:53 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-d668d506-a2d3-4f09-b630-41596a28efbb tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] [instance: ca1558cf-b235-4a20-8d12-45f1ca16fe41] End _get_guest_xml xml=<domain type="kvm">
Nov 28 15:51:53 user nova-compute[75176]:   <uuid>ca1558cf-b235-4a20-8d12-45f1ca16fe41</uuid>
Nov 28 15:51:53 user nova-compute[75176]:   <name>instance-0000001a</name>
Nov 28 15:51:53 user nova-compute[75176]:   <memory>524288</memory>
Nov 28 15:51:53 user nova-compute[75176]:   <vcpu>1</vcpu>
Nov 28 15:51:53 user nova-compute[75176]:   <metadata>
Nov 28 15:51:53 user nova-compute[75176]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 15:51:53 user nova-compute[75176]:       <nova:package version="0.0.0"/>
Nov 28 15:51:53 user nova-compute[75176]:       <nova:name>tempest-TestShelveInstance-server-1092777141</nova:name>
Nov 28 15:51:53 user nova-compute[75176]:       <nova:creationTime>2023-11-28 15:51:51</nova:creationTime>
Nov 28 15:51:53 user nova-compute[75176]:       <nova:flavor name="m1.tiny">
Nov 28 15:51:53 user nova-compute[75176]:         <nova:memory>512</nova:memory>
Nov 28 15:51:53 user nova-compute[75176]:         <nova:disk>1</nova:disk>
Nov 28 15:51:53 user nova-compute[75176]:         <nova:swap>0</nova:swap>
Nov 28 15:51:53 user nova-compute[75176]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 15:51:53 user nova-compute[75176]:         <nova:vcpus>1</nova:vcpus>
Nov 28 15:51:53 user nova-compute[75176]:       </nova:flavor>
Nov 28 15:51:53 user nova-compute[75176]:       <nova:owner>
Nov 28 15:51:53 user nova-compute[75176]:         <nova:user uuid="4753cf25a4c14e8aacd55309ff7e988d">tempest-TestShelveInstance-801353787-project-member</nova:user>
Nov 28 15:51:53 user nova-compute[75176]:         <nova:project uuid="7a8b3f118afd469f9c82ec2574586aaf">tempest-TestShelveInstance-801353787</nova:project>
Nov 28 15:51:53 user nova-compute[75176]:       </nova:owner>
Nov 28 15:51:53 user nova-compute[75176]:       <nova:ports>
Nov 28 15:51:53 user nova-compute[75176]:         <nova:port uuid="2791b548-7207-402c-9f65-c078be714ef5">
Nov 28 15:51:53 user nova-compute[75176]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 28 15:51:53 user nova-compute[75176]:         </nova:port>
Nov 28 15:51:53 user nova-compute[75176]:       </nova:ports>
Nov 28 15:51:53 user nova-compute[75176]:     </nova:instance>
Nov 28 15:51:53 user nova-compute[75176]:   </metadata>
Nov 28 15:51:53 user nova-compute[75176]:   <sysinfo type="smbios">
Nov 28 15:51:53 user nova-compute[75176]:     <system>
Nov 28 15:51:53 user nova-compute[75176]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 15:51:53 user nova-compute[75176]:       <entry name="product">OpenStack Nova</entry>
Nov 28 15:51:53 user nova-compute[75176]:       <entry name="version">0.0.0</entry>
Nov 28 15:51:53 user nova-compute[75176]:       <entry name="serial">ca1558cf-b235-4a20-8d12-45f1ca16fe41</entry>
Nov 28 15:51:53 user nova-compute[75176]:       <entry name="uuid">ca1558cf-b235-4a20-8d12-45f1ca16fe41</entry>
Nov 28 15:51:53 user nova-compute[75176]:       <entry name="family">Virtual Machine</entry>
Nov 28 15:51:53 user nova-compute[75176]:     </system>
Nov 28 15:51:53 user nova-compute[75176]:   </sysinfo>
Nov 28 15:51:53 user nova-compute[75176]:   <os>
Nov 28 15:51:53 user nova-compute[75176]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 15:51:53 user nova-compute[75176]:     <boot dev="hd"/>
Nov 28 15:51:53 user nova-compute[75176]:     <smbios mode="sysinfo"/>
Nov 28 15:51:53 user nova-compute[75176]:   </os>
Nov 28 15:51:53 user nova-compute[75176]:   <features>
Nov 28 15:51:53 user nova-compute[75176]:     <acpi/>
Nov 28 15:51:53 user nova-compute[75176]:     <apic/>
Nov 28 15:51:53 user nova-compute[75176]:     <vmcoreinfo/>
Nov 28 15:51:53 user nova-compute[75176]:   </features>
Nov 28 15:51:53 user nova-compute[75176]:   <clock offset="utc">
Nov 28 15:51:53 user nova-compute[75176]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 15:51:53 user nova-compute[75176]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 15:51:53 user nova-compute[75176]:     <timer name="hpet" present="no"/>
Nov 28 15:51:53 user nova-compute[75176]:   </clock>
Nov 28 15:51:53 user nova-compute[75176]:   <cpu mode="custom" match="exact">
Nov 28 15:51:53 user nova-compute[75176]:     <model>Nehalem</model>
Nov 28 15:51:53 user nova-compute[75176]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 15:51:53 user nova-compute[75176]:   </cpu>
Nov 28 15:51:53 user nova-compute[75176]:   <devices>
Nov 28 15:51:53 user nova-compute[75176]:     <disk type="block" device="disk">
Nov 28 15:51:53 user nova-compute[75176]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 15:51:53 user nova-compute[75176]:       <source dev="/dev/sdb"/>
Nov 28 15:51:53 user nova-compute[75176]:       <target dev="vda" bus="virtio"/>
Nov 28 15:51:53 user nova-compute[75176]:       <serial>22933c6e-3d8f-44f5-bc41-dee97c587055</serial>
Nov 28 15:51:53 user nova-compute[75176]:     </disk>
Nov 28 15:51:53 user nova-compute[75176]:     <interface type="ethernet">
Nov 28 15:51:53 user nova-compute[75176]:       <mac address="fa:16:3e:08:ec:9f"/>
Nov 28 15:51:53 user nova-compute[75176]:       <model type="virtio"/>
Nov 28 15:51:53 user nova-compute[75176]:       <mtu size="1442"/>
Nov 28 15:51:53 user nova-compute[75176]:       <target dev="tap2791b548-72"/>
Nov 28 15:51:53 user nova-compute[75176]:     </interface>
Nov 28 15:51:53 user nova-compute[75176]:     <serial type="pty">
Nov 28 15:51:53 user nova-compute[75176]:       <log file="/opt/stack/data/nova/instances/ca1558cf-b235-4a20-8d12-45f1ca16fe41/console.log" append="off"/>
Nov 28 15:51:53 user nova-compute[75176]:     </serial>
Nov 28 15:51:53 user nova-compute[75176]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 15:51:53 user nova-compute[75176]:     <video>
Nov 28 15:51:53 user nova-compute[75176]:       <model type="virtio"/>
Nov 28 15:51:53 user nova-compute[75176]:     </video>
Nov 28 15:51:53 user nova-compute[75176]:     <rng model="virtio">
Nov 28 15:51:53 user nova-compute[75176]:       <backend model="random">/dev/urandom</backend>
Nov 28 15:51:53 user nova-compute[75176]:     </rng>
Nov 28 15:51:53 user nova-compute[75176]:     <controller type="usb" index="0" model="none"/>
Nov 28 15:51:53 user nova-compute[75176]:     <memballoon model="virtio">
Nov 28 15:51:53 user nova-compute[75176]:       <stats period="10"/>
Nov 28 15:51:53 user nova-compute[75176]:     </memballoon>
Nov 28 15:51:53 user nova-compute[75176]:   </devices>
Nov 28 15:51:53 user nova-compute[75176]: </domain>
Nov 28 15:51:53 user nova-compute[75176]:  {{(pid=75176) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 15:51:53 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-d668d506-a2d3-4f09-b630-41596a28efbb tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-28T15:47:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1092777141',display_name='tempest-TestShelveInstance-server-1092777141',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1092777141',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-2062365153',keypairs=<?>,launch_index=0,launched_at=2023-11-28T15:48:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='7a8b3f118afd469f9c82ec2574586aaf',ramdisk_id='',reservation_id='r-0ue1lblf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-801353787',owner_user_name='tempest-TestShelveInstance-801353787-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T15:51:42Z,user_data=None,user_id='4753cf25a4c14e8aacd55309ff7e988d',uuid=ca1558cf-b235-4a20-8d12-45f1ca16fe41,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "2791b548-7207-402c-9f65-c078be714ef5", "address": "fa:16:3e:08:ec:9f", "network": {"id": "1f00fd98-3cd0-4c8c-912a-bc29124e1940", "bridge": "br-int", "label": "tempest-TestShelveInstance-1334429215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a8b3f118afd469f9c82ec2574586aaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2791b548-72", "ovs_interfaceid": "2791b548-7207-402c-9f65-c078be714ef5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 15:51:53 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-d668d506-a2d3-4f09-b630-41596a28efbb tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] Converting VIF {"id": "2791b548-7207-402c-9f65-c078be714ef5", "address": "fa:16:3e:08:ec:9f", "network": {"id": "1f00fd98-3cd0-4c8c-912a-bc29124e1940", "bridge": "br-int", "label": "tempest-TestShelveInstance-1334429215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a8b3f118afd469f9c82ec2574586aaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2791b548-72", "ovs_interfaceid": "2791b548-7207-402c-9f65-c078be714ef5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:51:53 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-d668d506-a2d3-4f09-b630-41596a28efbb tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:ec:9f,bridge_name='br-int',has_traffic_filtering=True,id=2791b548-7207-402c-9f65-c078be714ef5,network=Network(1f00fd98-3cd0-4c8c-912a-bc29124e1940),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2791b548-72') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:51:53 user nova-compute[75176]: DEBUG os_vif [None req-d668d506-a2d3-4f09-b630-41596a28efbb tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:ec:9f,bridge_name='br-int',has_traffic_filtering=True,id=2791b548-7207-402c-9f65-c078be714ef5,network=Network(1f00fd98-3cd0-4c8c-912a-bc29124e1940),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2791b548-72') {{(pid=75176) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 15:51:53 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:51:53 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:51:53 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 15:51:53 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:51:53 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6845c186-3373-5c94-93fd-d4b7aef5e53e', '_type': 'linux-noop'}}, row=False) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:51:53 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:51:53 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:51:53 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:51:53 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2791b548-72, may_exist=True, interface_attrs={}) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:51:53 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2791b548-72, col_values=(('qos', UUID('c4993875-b0a3-43dc-a359-df1d70d9303c')),), if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:51:53 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2791b548-72, col_values=(('external_ids', {'iface-id': '2791b548-7207-402c-9f65-c078be714ef5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:08:ec:9f', 'vm-uuid': 'ca1558cf-b235-4a20-8d12-45f1ca16fe41'}),), if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:51:53 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:51:53 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:51:53 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:51:53 user nova-compute[75176]: INFO os_vif [None req-d668d506-a2d3-4f09-b630-41596a28efbb tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:ec:9f,bridge_name='br-int',has_traffic_filtering=True,id=2791b548-7207-402c-9f65-c078be714ef5,network=Network(1f00fd98-3cd0-4c8c-912a-bc29124e1940),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2791b548-72')
Nov 28 15:51:53 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-d668d506-a2d3-4f09-b630-41596a28efbb tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] No BDM found with device name vda, not building metadata. {{(pid=75176) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 15:51:53 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-d668d506-a2d3-4f09-b630-41596a28efbb tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] No VIF found with MAC fa:16:3e:08:ec:9f, not building metadata {{(pid=75176) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 15:51:54 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:51:54 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:51:54 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:51:54 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:51:55 user nova-compute[75176]: DEBUG nova.compute.manager [req-a78226a2-7d6a-4d17-96fd-436f5a43dc0e req-ba707928-77f1-4864-b4b4-6cf5b56c43ff service nova] [instance: ca1558cf-b235-4a20-8d12-45f1ca16fe41] Received event network-vif-plugged-2791b548-7207-402c-9f65-c078be714ef5 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:51:55 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-a78226a2-7d6a-4d17-96fd-436f5a43dc0e req-ba707928-77f1-4864-b4b4-6cf5b56c43ff service nova] Acquiring lock "ca1558cf-b235-4a20-8d12-45f1ca16fe41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:51:55 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-a78226a2-7d6a-4d17-96fd-436f5a43dc0e req-ba707928-77f1-4864-b4b4-6cf5b56c43ff service nova] Lock "ca1558cf-b235-4a20-8d12-45f1ca16fe41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:51:55 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-a78226a2-7d6a-4d17-96fd-436f5a43dc0e req-ba707928-77f1-4864-b4b4-6cf5b56c43ff service nova] Lock "ca1558cf-b235-4a20-8d12-45f1ca16fe41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:51:55 user nova-compute[75176]: DEBUG nova.compute.manager [req-a78226a2-7d6a-4d17-96fd-436f5a43dc0e req-ba707928-77f1-4864-b4b4-6cf5b56c43ff service nova] [instance: ca1558cf-b235-4a20-8d12-45f1ca16fe41] No waiting events found dispatching network-vif-plugged-2791b548-7207-402c-9f65-c078be714ef5 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:51:55 user nova-compute[75176]: WARNING nova.compute.manager [req-a78226a2-7d6a-4d17-96fd-436f5a43dc0e req-ba707928-77f1-4864-b4b4-6cf5b56c43ff service nova] [instance: ca1558cf-b235-4a20-8d12-45f1ca16fe41] Received unexpected event network-vif-plugged-2791b548-7207-402c-9f65-c078be714ef5 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 28 15:51:55 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:51:55 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:51:55 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:51:55 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-73c068bc-30c1-4110-a5ab-af2d1fa9c1b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Acquiring lock "dc4e6d39-adfb-4d26-afef-46f316ff7846" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:51:55 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-73c068bc-30c1-4110-a5ab-af2d1fa9c1b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Lock "dc4e6d39-adfb-4d26-afef-46f316ff7846" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:51:55 user nova-compute[75176]: DEBUG nova.compute.manager [None req-73c068bc-30c1-4110-a5ab-af2d1fa9c1b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: dc4e6d39-adfb-4d26-afef-46f316ff7846] Starting instance... {{(pid=75176) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 15:51:55 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-73c068bc-30c1-4110-a5ab-af2d1fa9c1b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:51:55 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-73c068bc-30c1-4110-a5ab-af2d1fa9c1b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:51:55 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-73c068bc-30c1-4110-a5ab-af2d1fa9c1b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75176) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 15:51:55 user nova-compute[75176]: INFO nova.compute.claims [None req-73c068bc-30c1-4110-a5ab-af2d1fa9c1b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: dc4e6d39-adfb-4d26-afef-46f316ff7846] Claim successful on node user
Nov 28 15:51:56 user nova-compute[75176]: DEBUG nova.compute.provider_tree [None req-73c068bc-30c1-4110-a5ab-af2d1fa9c1b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Inventory has not changed in ProviderTree for provider: b37848d8-f401-4155-a029-b0ffa09ff85b {{(pid=75176) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 15:51:56 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-73c068bc-30c1-4110-a5ab-af2d1fa9c1b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Inventory has not changed for provider b37848d8-f401-4155-a029-b0ffa09ff85b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75176) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 15:51:56 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-73c068bc-30c1-4110-a5ab-af2d1fa9c1b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.497s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:51:56 user nova-compute[75176]: DEBUG nova.compute.manager [None req-73c068bc-30c1-4110-a5ab-af2d1fa9c1b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: dc4e6d39-adfb-4d26-afef-46f316ff7846] Start building networks asynchronously for instance. {{(pid=75176) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 15:51:56 user nova-compute[75176]: DEBUG nova.compute.manager [None req-73c068bc-30c1-4110-a5ab-af2d1fa9c1b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: dc4e6d39-adfb-4d26-afef-46f316ff7846] Allocating IP information in the background. {{(pid=75176) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 15:51:56 user nova-compute[75176]: DEBUG nova.network.neutron [None req-73c068bc-30c1-4110-a5ab-af2d1fa9c1b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: dc4e6d39-adfb-4d26-afef-46f316ff7846] allocate_for_instance() {{(pid=75176) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 15:51:56 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-73c068bc-30c1-4110-a5ab-af2d1fa9c1b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: dc4e6d39-adfb-4d26-afef-46f316ff7846] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 15:51:56 user nova-compute[75176]: DEBUG nova.compute.manager [None req-73c068bc-30c1-4110-a5ab-af2d1fa9c1b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: dc4e6d39-adfb-4d26-afef-46f316ff7846] Start building block device mappings for instance. {{(pid=75176) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 15:51:56 user nova-compute[75176]: DEBUG nova.policy [None req-73c068bc-30c1-4110-a5ab-af2d1fa9c1b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f24cedac95a44bb5a9ee54cc4713945c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf05c8836b8a40de8e64c2d046ed71ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75176) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 15:51:56 user nova-compute[75176]: INFO nova.virt.block_device [None req-73c068bc-30c1-4110-a5ab-af2d1fa9c1b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: dc4e6d39-adfb-4d26-afef-46f316ff7846] Booting with blank volume at /dev/vda
Nov 28 15:51:56 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:51:57 user nova-compute[75176]: DEBUG nova.network.neutron [None req-73c068bc-30c1-4110-a5ab-af2d1fa9c1b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: dc4e6d39-adfb-4d26-afef-46f316ff7846] Successfully created port: 65eb3123-182c-40fd-b20c-48b19b833f14 {{(pid=75176) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 15:51:57 user nova-compute[75176]: DEBUG nova.compute.manager [None req-d668d506-a2d3-4f09-b630-41596a28efbb tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] [instance: ca1558cf-b235-4a20-8d12-45f1ca16fe41] Instance event wait completed in 0 seconds for  {{(pid=75176) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 15:51:57 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-d668d506-a2d3-4f09-b630-41596a28efbb tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] [instance: ca1558cf-b235-4a20-8d12-45f1ca16fe41] Guest created on hypervisor {{(pid=75176) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 15:51:57 user nova-compute[75176]: INFO nova.virt.libvirt.driver [-] [instance: ca1558cf-b235-4a20-8d12-45f1ca16fe41] Instance spawned successfully.
Nov 28 15:51:57 user nova-compute[75176]: DEBUG nova.compute.manager [None req-d668d506-a2d3-4f09-b630-41596a28efbb tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] [instance: ca1558cf-b235-4a20-8d12-45f1ca16fe41] Checking state {{(pid=75176) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 15:51:57 user nova-compute[75176]: DEBUG nova.compute.manager [req-aaf0154b-0b76-4867-949f-932206931ba9 req-38fb5c3a-8e0a-4f66-836d-de43defaa9c7 service nova] [instance: ca1558cf-b235-4a20-8d12-45f1ca16fe41] Received event network-vif-plugged-2791b548-7207-402c-9f65-c078be714ef5 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:51:57 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-aaf0154b-0b76-4867-949f-932206931ba9 req-38fb5c3a-8e0a-4f66-836d-de43defaa9c7 service nova] Acquiring lock "ca1558cf-b235-4a20-8d12-45f1ca16fe41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:51:57 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-aaf0154b-0b76-4867-949f-932206931ba9 req-38fb5c3a-8e0a-4f66-836d-de43defaa9c7 service nova] Lock "ca1558cf-b235-4a20-8d12-45f1ca16fe41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:51:57 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-aaf0154b-0b76-4867-949f-932206931ba9 req-38fb5c3a-8e0a-4f66-836d-de43defaa9c7 service nova] Lock "ca1558cf-b235-4a20-8d12-45f1ca16fe41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:51:57 user nova-compute[75176]: DEBUG nova.compute.manager [req-aaf0154b-0b76-4867-949f-932206931ba9 req-38fb5c3a-8e0a-4f66-836d-de43defaa9c7 service nova] [instance: ca1558cf-b235-4a20-8d12-45f1ca16fe41] No waiting events found dispatching network-vif-plugged-2791b548-7207-402c-9f65-c078be714ef5 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:51:57 user nova-compute[75176]: WARNING nova.compute.manager [req-aaf0154b-0b76-4867-949f-932206931ba9 req-38fb5c3a-8e0a-4f66-836d-de43defaa9c7 service nova] [instance: ca1558cf-b235-4a20-8d12-45f1ca16fe41] Received unexpected event network-vif-plugged-2791b548-7207-402c-9f65-c078be714ef5 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 28 15:51:57 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-d668d506-a2d3-4f09-b630-41596a28efbb tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] Lock "ca1558cf-b235-4a20-8d12-45f1ca16fe41" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 15.849s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:51:57 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:51:57 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75176) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 15:51:57 user nova-compute[75176]: DEBUG nova.network.neutron [None req-73c068bc-30c1-4110-a5ab-af2d1fa9c1b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: dc4e6d39-adfb-4d26-afef-46f316ff7846] Successfully updated port: 65eb3123-182c-40fd-b20c-48b19b833f14 {{(pid=75176) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 15:51:57 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-73c068bc-30c1-4110-a5ab-af2d1fa9c1b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Acquiring lock "refresh_cache-dc4e6d39-adfb-4d26-afef-46f316ff7846" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:51:57 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-73c068bc-30c1-4110-a5ab-af2d1fa9c1b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Acquired lock "refresh_cache-dc4e6d39-adfb-4d26-afef-46f316ff7846" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:51:57 user nova-compute[75176]: DEBUG nova.network.neutron [None req-73c068bc-30c1-4110-a5ab-af2d1fa9c1b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: dc4e6d39-adfb-4d26-afef-46f316ff7846] Building network info cache for instance {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 15:51:57 user nova-compute[75176]: DEBUG nova.compute.manager [req-5d10a13e-4933-4ff0-8f56-f75f636bc827 req-6f067fec-06dc-4496-a756-2672c0bdc0bf service nova] [instance: dc4e6d39-adfb-4d26-afef-46f316ff7846] Received event network-changed-65eb3123-182c-40fd-b20c-48b19b833f14 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:51:57 user nova-compute[75176]: DEBUG nova.compute.manager [req-5d10a13e-4933-4ff0-8f56-f75f636bc827 req-6f067fec-06dc-4496-a756-2672c0bdc0bf service nova] [instance: dc4e6d39-adfb-4d26-afef-46f316ff7846] Refreshing instance network info cache due to event network-changed-65eb3123-182c-40fd-b20c-48b19b833f14. {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 15:51:57 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-5d10a13e-4933-4ff0-8f56-f75f636bc827 req-6f067fec-06dc-4496-a756-2672c0bdc0bf service nova] Acquiring lock "refresh_cache-dc4e6d39-adfb-4d26-afef-46f316ff7846" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:51:57 user nova-compute[75176]: DEBUG nova.network.neutron [None req-73c068bc-30c1-4110-a5ab-af2d1fa9c1b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: dc4e6d39-adfb-4d26-afef-46f316ff7846] Instance cache missing network info. {{(pid=75176) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 15:51:58 user nova-compute[75176]: DEBUG nova.network.neutron [None req-73c068bc-30c1-4110-a5ab-af2d1fa9c1b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: dc4e6d39-adfb-4d26-afef-46f316ff7846] Updating instance_info_cache with network_info: [{"id": "65eb3123-182c-40fd-b20c-48b19b833f14", "address": "fa:16:3e:59:4a:59", "network": {"id": "998766cd-2e8e-4e39-add9-286086640993", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-989265510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf05c8836b8a40de8e64c2d046ed71ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65eb3123-18", "ovs_interfaceid": "65eb3123-182c-40fd-b20c-48b19b833f14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:51:58 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-73c068bc-30c1-4110-a5ab-af2d1fa9c1b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Releasing lock "refresh_cache-dc4e6d39-adfb-4d26-afef-46f316ff7846" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:51:58 user nova-compute[75176]: DEBUG nova.compute.manager [None req-73c068bc-30c1-4110-a5ab-af2d1fa9c1b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: dc4e6d39-adfb-4d26-afef-46f316ff7846] Instance network_info: |[{"id": "65eb3123-182c-40fd-b20c-48b19b833f14", "address": "fa:16:3e:59:4a:59", "network": {"id": "998766cd-2e8e-4e39-add9-286086640993", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-989265510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf05c8836b8a40de8e64c2d046ed71ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65eb3123-18", "ovs_interfaceid": "65eb3123-182c-40fd-b20c-48b19b833f14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75176) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 15:51:58 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-5d10a13e-4933-4ff0-8f56-f75f636bc827 req-6f067fec-06dc-4496-a756-2672c0bdc0bf service nova] Acquired lock "refresh_cache-dc4e6d39-adfb-4d26-afef-46f316ff7846" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:51:58 user nova-compute[75176]: DEBUG nova.network.neutron [req-5d10a13e-4933-4ff0-8f56-f75f636bc827 req-6f067fec-06dc-4496-a756-2672c0bdc0bf service nova] [instance: dc4e6d39-adfb-4d26-afef-46f316ff7846] Refreshing network info cache for port 65eb3123-182c-40fd-b20c-48b19b833f14 {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 15:51:58 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:51:58 user nova-compute[75176]: DEBUG nova.network.neutron [req-5d10a13e-4933-4ff0-8f56-f75f636bc827 req-6f067fec-06dc-4496-a756-2672c0bdc0bf service nova] [instance: dc4e6d39-adfb-4d26-afef-46f316ff7846] Updated VIF entry in instance network info cache for port 65eb3123-182c-40fd-b20c-48b19b833f14. {{(pid=75176) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 15:51:58 user nova-compute[75176]: DEBUG nova.network.neutron [req-5d10a13e-4933-4ff0-8f56-f75f636bc827 req-6f067fec-06dc-4496-a756-2672c0bdc0bf service nova] [instance: dc4e6d39-adfb-4d26-afef-46f316ff7846] Updating instance_info_cache with network_info: [{"id": "65eb3123-182c-40fd-b20c-48b19b833f14", "address": "fa:16:3e:59:4a:59", "network": {"id": "998766cd-2e8e-4e39-add9-286086640993", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-989265510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf05c8836b8a40de8e64c2d046ed71ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65eb3123-18", "ovs_interfaceid": "65eb3123-182c-40fd-b20c-48b19b833f14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:51:58 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-5d10a13e-4933-4ff0-8f56-f75f636bc827 req-6f067fec-06dc-4496-a756-2672c0bdc0bf service nova] Releasing lock "refresh_cache-dc4e6d39-adfb-4d26-afef-46f316ff7846" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:51:58 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:51:59 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:51:59 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:52:01 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:52:01 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Starting heal instance info cache {{(pid=75176) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 15:52:01 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquiring lock "refresh_cache-1e8a6e1b-4f71-494a-8f44-f9643c658021" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:52:01 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquired lock "refresh_cache-1e8a6e1b-4f71-494a-8f44-f9643c658021" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:52:01 user nova-compute[75176]: DEBUG nova.network.neutron [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] [instance: 1e8a6e1b-4f71-494a-8f44-f9643c658021] Forcefully refreshing network info cache for instance {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 15:52:02 user nova-compute[75176]: DEBUG os_brick.utils [None req-73c068bc-30c1-4110-a5ab-af2d1fa9c1b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 15:52:02 user nova-compute[75176]: DEBUG nova.network.neutron [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] [instance: 1e8a6e1b-4f71-494a-8f44-f9643c658021] Updating instance_info_cache with network_info: [{"id": "34bebf25-27db-4839-9184-30d78a0ee582", "address": "fa:16:3e:90:a9:7c", "network": {"id": "51143aa0-7498-4dfc-8425-9046ee5aa4fc", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-351796020-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13ce3926a76541f7a32ada5070b10be1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34bebf25-27", "ovs_interfaceid": "34bebf25-27db-4839-9184-30d78a0ee582", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:52:02 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:52:02 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Releasing lock "refresh_cache-1e8a6e1b-4f71-494a-8f44-f9643c658021" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:52:02 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] [instance: 1e8a6e1b-4f71-494a-8f44-f9643c658021] Updated the network info_cache for instance {{(pid=75176) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 15:52:02 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:52:02 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[6338e027-8e2e-4121-90d5-0869871a419e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:edc924a949b2\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:52:02 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:52:02 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:52:02 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[e04e8ec0-30f2-487c-82fd-800d914986ad]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:52:02 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:52:02 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:52:02 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[719910f8-423b-467c-b935-3304fc502285]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:52:02 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e70e7da-aaae-459e-9f04-d0d0ceecef39]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:52:02 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-73c068bc-30c1-4110-a5ab-af2d1fa9c1b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Running cmd (subprocess): nvme version {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:52:02 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-73c068bc-30c1-4110-a5ab-af2d1fa9c1b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] 'nvme version' failed. Not Retrying. {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 15:52:02 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.nvmeof [None req-73c068bc-30c1-4110-a5ab-af2d1fa9c1b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] nvme not present on system {{(pid=75176) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 15:52:02 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:52:02 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 15:52:02 user nova-compute[75176]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 15:52:02 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[53166fc9-173a-4f38-85da-38c77ff1e60f]: (4, '') {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:52:02 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.lightos [None req-73c068bc-30c1-4110-a5ab-af2d1fa9c1b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75176) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 15:52:02 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.lightos [None req-73c068bc-30c1-4110-a5ab-af2d1fa9c1b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75176) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 15:52:02 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.lightos [None req-73c068bc-30c1-4110-a5ab-af2d1fa9c1b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] LIGHTOS: no hostnqn found. {{(pid=75176) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 15:52:02 user nova-compute[75176]: DEBUG os_brick.utils [None req-73c068bc-30c1-4110-a5ab-af2d1fa9c1b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] <== get_connector_properties: return (145ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:edc924a949b2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 15:52:02 user nova-compute[75176]: DEBUG nova.virt.block_device [None req-73c068bc-30c1-4110-a5ab-af2d1fa9c1b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: dc4e6d39-adfb-4d26-afef-46f316ff7846] Updating existing volume attachment record: d43d734a-766e-4e5f-8cdf-f713cdc1aa30 {{(pid=75176) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 15:52:02 user nova-compute[75176]: DEBUG nova.compute.manager [req-9bcf7bbf-1436-4d00-9b70-9ce4e3fb4eaa req-53e217d2-cfef-4538-b79a-7f9cee692a70 service nova] [instance: e8b9c885-42ba-4f74-86b2-d091ebd08ed5] Received event network-changed-62fa1256-2b2c-4740-b93c-9e98a0a738f8 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:52:02 user nova-compute[75176]: DEBUG nova.compute.manager [req-9bcf7bbf-1436-4d00-9b70-9ce4e3fb4eaa req-53e217d2-cfef-4538-b79a-7f9cee692a70 service nova] [instance: e8b9c885-42ba-4f74-86b2-d091ebd08ed5] Refreshing instance network info cache due to event network-changed-62fa1256-2b2c-4740-b93c-9e98a0a738f8. {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 15:52:02 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-9bcf7bbf-1436-4d00-9b70-9ce4e3fb4eaa req-53e217d2-cfef-4538-b79a-7f9cee692a70 service nova] Acquiring lock "refresh_cache-e8b9c885-42ba-4f74-86b2-d091ebd08ed5" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:52:02 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-9bcf7bbf-1436-4d00-9b70-9ce4e3fb4eaa req-53e217d2-cfef-4538-b79a-7f9cee692a70 service nova] Acquired lock "refresh_cache-e8b9c885-42ba-4f74-86b2-d091ebd08ed5" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:52:02 user nova-compute[75176]: DEBUG nova.network.neutron [req-9bcf7bbf-1436-4d00-9b70-9ce4e3fb4eaa req-53e217d2-cfef-4538-b79a-7f9cee692a70 service nova] [instance: e8b9c885-42ba-4f74-86b2-d091ebd08ed5] Refreshing network info cache for port 62fa1256-2b2c-4740-b93c-9e98a0a738f8 {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 15:52:02 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:52:02 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:52:02 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:52:02 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:52:02 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Auditing locally available compute resources for user (node: user) {{(pid=75176) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 15:52:02 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-bfbf12f9-fd99-44c8-b287-edaeead988b9 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Acquiring lock "0e465c9f-e8ab-4a28-bf74-2936a272a0e2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:52:02 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-bfbf12f9-fd99-44c8-b287-edaeead988b9 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Lock "0e465c9f-e8ab-4a28-bf74-2936a272a0e2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:52:02 user nova-compute[75176]: INFO nova.compute.manager [None req-bfbf12f9-fd99-44c8-b287-edaeead988b9 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] [instance: 0e465c9f-e8ab-4a28-bf74-2936a272a0e2] Detaching volume 07de7953-293c-4762-b695-ed3190c934d5
Nov 28 15:52:02 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55febf04-14ea-4903-8692-c7cc6115de75/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:52:03 user nova-compute[75176]: INFO nova.virt.block_device [None req-bfbf12f9-fd99-44c8-b287-edaeead988b9 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] [instance: 0e465c9f-e8ab-4a28-bf74-2936a272a0e2] Attempting to driver detach volume 07de7953-293c-4762-b695-ed3190c934d5 from mountpoint /dev/vdc
Nov 28 15:52:03 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-bfbf12f9-fd99-44c8-b287-edaeead988b9 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Attempting to detach device vdc from instance 0e465c9f-e8ab-4a28-bf74-2936a272a0e2 from the persistent domain config. {{(pid=75176) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 15:52:03 user nova-compute[75176]: DEBUG nova.virt.libvirt.guest [None req-bfbf12f9-fd99-44c8-b287-edaeead988b9 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 15:52:03 user nova-compute[75176]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 15:52:03 user nova-compute[75176]:   <source dev="/dev/sdf"/>
Nov 28 15:52:03 user nova-compute[75176]:   <target dev="vdc" bus="virtio"/>
Nov 28 15:52:03 user nova-compute[75176]:   <serial>07de7953-293c-4762-b695-ed3190c934d5</serial>
Nov 28 15:52:03 user nova-compute[75176]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 28 15:52:03 user nova-compute[75176]: </disk>
Nov 28 15:52:03 user nova-compute[75176]:  {{(pid=75176) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 15:52:03 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-bfbf12f9-fd99-44c8-b287-edaeead988b9 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Successfully detached device vdc from instance 0e465c9f-e8ab-4a28-bf74-2936a272a0e2 from the persistent domain config.
Nov 28 15:52:03 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-bfbf12f9-fd99-44c8-b287-edaeead988b9 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 0e465c9f-e8ab-4a28-bf74-2936a272a0e2 from the live domain config. {{(pid=75176) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 15:52:03 user nova-compute[75176]: DEBUG nova.virt.libvirt.guest [None req-bfbf12f9-fd99-44c8-b287-edaeead988b9 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 15:52:03 user nova-compute[75176]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 15:52:03 user nova-compute[75176]:   <source dev="/dev/sdf"/>
Nov 28 15:52:03 user nova-compute[75176]:   <target dev="vdc" bus="virtio"/>
Nov 28 15:52:03 user nova-compute[75176]:   <serial>07de7953-293c-4762-b695-ed3190c934d5</serial>
Nov 28 15:52:03 user nova-compute[75176]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 28 15:52:03 user nova-compute[75176]: </disk>
Nov 28 15:52:03 user nova-compute[75176]:  {{(pid=75176) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 15:52:03 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55febf04-14ea-4903-8692-c7cc6115de75/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:52:03 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55febf04-14ea-4903-8692-c7cc6115de75/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:52:03 user nova-compute[75176]: DEBUG nova.network.neutron [req-9bcf7bbf-1436-4d00-9b70-9ce4e3fb4eaa req-53e217d2-cfef-4538-b79a-7f9cee692a70 service nova] [instance: e8b9c885-42ba-4f74-86b2-d091ebd08ed5] Updated VIF entry in instance network info cache for port 62fa1256-2b2c-4740-b93c-9e98a0a738f8. {{(pid=75176) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 15:52:03 user nova-compute[75176]: DEBUG nova.network.neutron [req-9bcf7bbf-1436-4d00-9b70-9ce4e3fb4eaa req-53e217d2-cfef-4538-b79a-7f9cee692a70 service nova] [instance: e8b9c885-42ba-4f74-86b2-d091ebd08ed5] Updating instance_info_cache with network_info: [{"id": "62fa1256-2b2c-4740-b93c-9e98a0a738f8", "address": "fa:16:3e:a4:c5:51", "network": {"id": "5ec264ad-3459-468c-bdbf-c6a4ef016951", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1574289626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07c7783cc16049208421204910982c79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62fa1256-2b", "ovs_interfaceid": "62fa1256-2b2c-4740-b93c-9e98a0a738f8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:52:03 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-9bcf7bbf-1436-4d00-9b70-9ce4e3fb4eaa req-53e217d2-cfef-4538-b79a-7f9cee692a70 service nova] Releasing lock "refresh_cache-e8b9c885-42ba-4f74-86b2-d091ebd08ed5" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:52:03 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-5bbf62eb-0e5d-4342-b82b-f81830c4cc64 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Acquiring lock "e8b9c885-42ba-4f74-86b2-d091ebd08ed5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:52:03 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-5bbf62eb-0e5d-4342-b82b-f81830c4cc64 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Lock "e8b9c885-42ba-4f74-86b2-d091ebd08ed5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:52:03 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-5bbf62eb-0e5d-4342-b82b-f81830c4cc64 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Acquiring lock "e8b9c885-42ba-4f74-86b2-d091ebd08ed5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:52:03 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-5bbf62eb-0e5d-4342-b82b-f81830c4cc64 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Lock "e8b9c885-42ba-4f74-86b2-d091ebd08ed5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:52:03 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-5bbf62eb-0e5d-4342-b82b-f81830c4cc64 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Lock "e8b9c885-42ba-4f74-86b2-d091ebd08ed5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:52:03 user nova-compute[75176]: INFO nova.compute.manager [None req-5bbf62eb-0e5d-4342-b82b-f81830c4cc64 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: e8b9c885-42ba-4f74-86b2-d091ebd08ed5] Terminating instance
Nov 28 15:52:03 user nova-compute[75176]: DEBUG nova.compute.manager [None req-5bbf62eb-0e5d-4342-b82b-f81830c4cc64 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: e8b9c885-42ba-4f74-86b2-d091ebd08ed5] Start destroying the instance on the hypervisor. {{(pid=75176) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 15:52:03 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55febf04-14ea-4903-8692-c7cc6115de75/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:52:03 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e8507b7-fccf-4196-b589-bf2b74f165ec/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:52:03 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:52:03 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:52:03 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-bfbf12f9-fd99-44c8-b287-edaeead988b9 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 0e465c9f-e8ab-4a28-bf74-2936a272a0e2 {{(pid=75176) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 15:52:03 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e8507b7-fccf-4196-b589-bf2b74f165ec/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:52:03 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e8507b7-fccf-4196-b589-bf2b74f165ec/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:52:03 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:52:03 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:52:03 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e8507b7-fccf-4196-b589-bf2b74f165ec/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:52:03 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e8a6e1b-4f71-494a-8f44-f9643c658021/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:52:04 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e8a6e1b-4f71-494a-8f44-f9643c658021/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:52:04 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e8a6e1b-4f71-494a-8f44-f9643c658021/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:52:04 user nova-compute[75176]: INFO nova.virt.libvirt.driver [-] [instance: e8b9c885-42ba-4f74-86b2-d091ebd08ed5] Instance destroyed successfully.
Nov 28 15:52:04 user nova-compute[75176]: DEBUG nova.objects.instance [None req-5bbf62eb-0e5d-4342-b82b-f81830c4cc64 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Lazy-loading 'resources' on Instance uuid e8b9c885-42ba-4f74-86b2-d091ebd08ed5 {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:52:04 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-5bbf62eb-0e5d-4342-b82b-f81830c4cc64 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T15:50:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-270334912',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-270334912',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-270334912',id=33,image_ref='eb338f00-fd5b-4aea-be71-a4b5c50587a4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC+7of0XZ2pVt3UTAIB2O/FT+MuXYP9jChLC/UhmN4hFIqlf8XSIqfTRCD6jjN2Fp/f0rjgDE8+xXfdaq4hGvkqkZyvOmwWqBAtkdUVie2yexc6iZr/uNEiZVn4SwxQ2CQ==',key_name='tempest-keypair-1562696194',keypairs=<?>,launch_index=0,launched_at=2023-11-28T15:50:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='07c7783cc16049208421204910982c79',ramdisk_id='',reservation_id='r-hytihj8m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1695196118',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1695196118-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-1695196118',owner_user_name='tempest-TestVolumeBootPattern-1695196118-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T15:50:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='081bf84d24194b81be4e0a6638db9b66',uuid=e8b9c885-42ba-4f74-86b2-d091ebd08ed5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "62fa1256-2b2c-4740-b93c-9e98a0a738f8", "address": "fa:16:3e:a4:c5:51", "network": {"id": "5ec264ad-3459-468c-bdbf-c6a4ef016951", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1574289626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07c7783cc16049208421204910982c79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62fa1256-2b", "ovs_interfaceid": "62fa1256-2b2c-4740-b93c-9e98a0a738f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 15:52:04 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-5bbf62eb-0e5d-4342-b82b-f81830c4cc64 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Converting VIF {"id": "62fa1256-2b2c-4740-b93c-9e98a0a738f8", "address": "fa:16:3e:a4:c5:51", "network": {"id": "5ec264ad-3459-468c-bdbf-c6a4ef016951", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1574289626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07c7783cc16049208421204910982c79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62fa1256-2b", "ovs_interfaceid": "62fa1256-2b2c-4740-b93c-9e98a0a738f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:52:04 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-5bbf62eb-0e5d-4342-b82b-f81830c4cc64 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:c5:51,bridge_name='br-int',has_traffic_filtering=True,id=62fa1256-2b2c-4740-b93c-9e98a0a738f8,network=Network(5ec264ad-3459-468c-bdbf-c6a4ef016951),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62fa1256-2b') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:52:04 user nova-compute[75176]: DEBUG os_vif [None req-5bbf62eb-0e5d-4342-b82b-f81830c4cc64 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:c5:51,bridge_name='br-int',has_traffic_filtering=True,id=62fa1256-2b2c-4740-b93c-9e98a0a738f8,network=Network(5ec264ad-3459-468c-bdbf-c6a4ef016951),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62fa1256-2b') {{(pid=75176) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 15:52:04 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:52:04 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap62fa1256-2b, bridge=br-int, if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:52:04 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:52:04 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:52:04 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:52:04 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4d6d6a94-77d7-4df5-8c9d-574889bf74c6) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:52:04 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:52:04 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:52:04 user nova-compute[75176]: INFO os_vif [None req-5bbf62eb-0e5d-4342-b82b-f81830c4cc64 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:c5:51,bridge_name='br-int',has_traffic_filtering=True,id=62fa1256-2b2c-4740-b93c-9e98a0a738f8,network=Network(5ec264ad-3459-468c-bdbf-c6a4ef016951),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62fa1256-2b')
Nov 28 15:52:04 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5bbf62eb-0e5d-4342-b82b-f81830c4cc64 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: e8b9c885-42ba-4f74-86b2-d091ebd08ed5] calling os-brick to detach iSCSI Volume {{(pid=75176) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 15:52:04 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bbf62eb-0e5d-4342-b82b-f81830c4cc64 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c1b8a00>, {'target_iqn': 'iqn.2010-10.org.openstack:21587566-b951-4b3e-8024-b6c2d2da35af', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sApFNrwe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 15:52:04 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-5bbf62eb-0e5d-4342-b82b-f81830c4cc64 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 15:52:04 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-5bbf62eb-0e5d-4342-b82b-f81830c4cc64 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 15:52:04 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-5bbf62eb-0e5d-4342-b82b-f81830c4cc64 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 15:52:04 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:52:04 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:52:04 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a274113-4502-43ec-9529-81bd97f06739]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8452525c-6845-4edb-bf69-1e2ffe0ef2eb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:21587566-b951-4b3e-8024-b6c2d2da35af\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:07de7953-293c-4762-b695-ed3190c934d5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:22933c6e-3d8f-44f5-bc41-dee97c587055\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:52:04 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bbf62eb-0e5d-4342-b82b-f81830c4cc64 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 15:52:04 user nova-compute[75176]: No targets found.
Nov 28 15:52:04 user nova-compute[75176]: iSNS:
Nov 28 15:52:04 user nova-compute[75176]: No targets found.
Nov 28 15:52:04 user nova-compute[75176]: STATIC:
Nov 28 15:52:04 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:8452525c-6845-4edb-bf69-1e2ffe0ef2eb
Nov 28 15:52:04 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:52:04 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:52:04 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc
Nov 28 15:52:04 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:52:04 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:52:04 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:21587566-b951-4b3e-8024-b6c2d2da35af
Nov 28 15:52:04 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:52:04 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:52:04 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:07de7953-293c-4762-b695-ed3190c934d5
Nov 28 15:52:04 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:52:04 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:52:04 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:22933c6e-3d8f-44f5-bc41-dee97c587055
Nov 28 15:52:04 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:52:04 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:52:04 user nova-compute[75176]: FIRMWARE:
Nov 28 15:52:04 user nova-compute[75176]: No targets found.
Nov 28 15:52:04 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:52:04 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bbf62eb-0e5d-4342-b82b-f81830c4cc64 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 15:52:04 user nova-compute[75176]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 15:52:04 user nova-compute[75176]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75176) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 15:52:04 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bbf62eb-0e5d-4342-b82b-f81830c4cc64 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:21587566-b951-4b3e-8024-b6c2d2da35af', 0)] {{(pid=75176) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 15:52:04 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:52:04 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e8a6e1b-4f71-494a-8f44-f9643c658021/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:52:04 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75176) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 15:52:04 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:52:04 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[a090cefa-fa9f-4689-8ce6-a869ce248a0f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:07de7953-293c-4762-b695-ed3190c934d5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:21587566-b951-4b3e-8024-b6c2d2da35af\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:22933c6e-3d8f-44f5-bc41-dee97c587055\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8452525c-6845-4edb-bf69-1e2ffe0ef2eb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:52:04 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:52:04 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75176) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 15:52:04 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6ebcc53-802a-4515-ba41-3e8e1129235f/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:52:04 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:52:04 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[16e72ac9-4b11-4a9b-b60e-d44b88dbdd3f]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8452525c-6845-4edb-bf69-1e2ffe0ef2eb (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21587566-b951-4b3e-8024-b6c2d2da35af (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07de7953-293c-4762-b695-ed3190c934d5 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22933c6e-3d8f-44f5-bc41-dee97c587055 (non-flash)\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:52:04 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bbf62eb-0e5d-4342-b82b-f81830c4cc64 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8452525c-6845-4edb-bf69-1e2ffe0ef2eb (non-flash)
Nov 28 15:52:04 user nova-compute[75176]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21587566-b951-4b3e-8024-b6c2d2da35af (non-flash)
Nov 28 15:52:04 user nova-compute[75176]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07de7953-293c-4762-b695-ed3190c934d5 (non-flash)
Nov 28 15:52:04 user nova-compute[75176]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc (non-flash)
Nov 28 15:52:04 user nova-compute[75176]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22933c6e-3d8f-44f5-bc41-dee97c587055 (non-flash)
Nov 28 15:52:04 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:52:04 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bbf62eb-0e5d-4342-b82b-f81830c4cc64 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8452525c-6845-4edb-bf69-1e2ffe0ef2eb (non-flash)
Nov 28 15:52:04 user nova-compute[75176]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21587566-b951-4b3e-8024-b6c2d2da35af (non-flash)
Nov 28 15:52:04 user nova-compute[75176]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07de7953-293c-4762-b695-ed3190c934d5 (non-flash)
Nov 28 15:52:04 user nova-compute[75176]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc (non-flash)
Nov 28 15:52:04 user nova-compute[75176]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22933c6e-3d8f-44f5-bc41-dee97c587055 (non-flash)
Nov 28 15:52:04 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 15:52:04 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bbf62eb-0e5d-4342-b82b-f81830c4cc64 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f464c6ea0e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:21587566-b951-4b3e-8024-b6c2d2da35af'): ({'sdd'}, set())}) {{(pid=75176) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 15:52:04 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-5bbf62eb-0e5d-4342-b82b-f81830c4cc64 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Removing single pathed devices sdd {{(pid=75176) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 15:52:04 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:52:04 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:52:04 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:52:04 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[f10c8cb1-cde9-4af4-8f4d-9d66a423c4b1]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:52:04 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:52:04 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:52:04 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ccfbe35-56f4-4845-bdd2-615e34c48413]: (4, ('ok\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:52:04 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-5bbf62eb-0e5d-4342-b82b-f81830c4cc64 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Flushing IO for device /dev/sdd {{(pid=75176) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 15:52:04 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:52:04 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.021s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:52:04 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[95397f07-cce0-4231-af6d-55362cd3784b]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:52:04 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-5bbf62eb-0e5d-4342-b82b-f81830c4cc64 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75176) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 15:52:04 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:52:04 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6ebcc53-802a-4515-ba41-3e8e1129235f/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:52:04 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6ebcc53-802a-4515-ba41-3e8e1129235f/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:52:04 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.043s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:52:04 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad9f5179-ee10-4443-a17f-c3b7ae3688ad]: (4, ('1', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:52:04 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-5bbf62eb-0e5d-4342-b82b-f81830c4cc64 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75176) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 15:52:04 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-5bbf62eb-0e5d-4342-b82b-f81830c4cc64 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] SCSI volumes sdd have been removed. {{(pid=75176) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 15:52:04 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bbf62eb-0e5d-4342-b82b-f81830c4cc64 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:21587566-b951-4b3e-8024-b6c2d2da35af')] {{(pid=75176) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 15:52:04 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21587566-b951-4b3e-8024-b6c2d2da35af -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:52:04 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21587566-b951-4b3e-8024-b6c2d2da35af -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:52:04 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ab8c49c-0c25-4f2b-95a9-89ceaa2777bc]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:52:04 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bbf62eb-0e5d-4342-b82b-f81830c4cc64 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:52:04 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21587566-b951-4b3e-8024-b6c2d2da35af -p 172.16.0.220:3260 --logout {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:52:04 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21587566-b951-4b3e-8024-b6c2d2da35af -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:52:04 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[29b14223-4fe0-4f13-9d35-fa4a0d450dfa]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:21587566-b951-4b3e-8024-b6c2d2da35af, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:21587566-b951-4b3e-8024-b6c2d2da35af, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:52:04 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bbf62eb-0e5d-4342-b82b-f81830c4cc64 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:21587566-b951-4b3e-8024-b6c2d2da35af, portal: 172.16.0.220,3260]
Nov 28 15:52:04 user nova-compute[75176]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:21587566-b951-4b3e-8024-b6c2d2da35af, portal: 172.16.0.220,3260] successful.
Nov 28 15:52:04 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:52:04 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21587566-b951-4b3e-8024-b6c2d2da35af -p 172.16.0.220:3260 --op delete {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:52:04 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21587566-b951-4b3e-8024-b6c2d2da35af -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:52:04 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[8008f8f4-96cb-4c91-a6ed-5eca118a52b0]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:52:04 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bbf62eb-0e5d-4342-b82b-f81830c4cc64 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:52:04 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-5bbf62eb-0e5d-4342-b82b-f81830c4cc64 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.439s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 15:52:04 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bbf62eb-0e5d-4342-b82b-f81830c4cc64 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] <== disconnect_volume: return (442ms) None {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 15:52:04 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5bbf62eb-0e5d-4342-b82b-f81830c4cc64 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: e8b9c885-42ba-4f74-86b2-d091ebd08ed5] Disconnected iSCSI Volume {{(pid=75176) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 15:52:04 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-5bbf62eb-0e5d-4342-b82b-f81830c4cc64 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: e8b9c885-42ba-4f74-86b2-d091ebd08ed5] Deleting instance files /opt/stack/data/nova/instances/e8b9c885-42ba-4f74-86b2-d091ebd08ed5_del
Nov 28 15:52:04 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-5bbf62eb-0e5d-4342-b82b-f81830c4cc64 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: e8b9c885-42ba-4f74-86b2-d091ebd08ed5] Deletion of /opt/stack/data/nova/instances/e8b9c885-42ba-4f74-86b2-d091ebd08ed5_del complete
Nov 28 15:52:04 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6ebcc53-802a-4515-ba41-3e8e1129235f/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:52:04 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66ead7d-98f4-4822-9dce-f2ea0206a58d/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:52:04 user nova-compute[75176]: DEBUG nova.compute.manager [req-98be7b6e-567d-45fd-98cd-a67f6ae4e7ea req-7c3f867c-1e1e-4eb6-ae4a-0a582ef228b3 service nova] [instance: e8b9c885-42ba-4f74-86b2-d091ebd08ed5] Received event network-vif-unplugged-62fa1256-2b2c-4740-b93c-9e98a0a738f8 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:52:04 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-98be7b6e-567d-45fd-98cd-a67f6ae4e7ea req-7c3f867c-1e1e-4eb6-ae4a-0a582ef228b3 service nova] Acquiring lock "e8b9c885-42ba-4f74-86b2-d091ebd08ed5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:52:04 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-98be7b6e-567d-45fd-98cd-a67f6ae4e7ea req-7c3f867c-1e1e-4eb6-ae4a-0a582ef228b3 service nova] Lock "e8b9c885-42ba-4f74-86b2-d091ebd08ed5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:52:04 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-98be7b6e-567d-45fd-98cd-a67f6ae4e7ea req-7c3f867c-1e1e-4eb6-ae4a-0a582ef228b3 service nova] Lock "e8b9c885-42ba-4f74-86b2-d091ebd08ed5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:52:04 user nova-compute[75176]: DEBUG nova.compute.manager [req-98be7b6e-567d-45fd-98cd-a67f6ae4e7ea req-7c3f867c-1e1e-4eb6-ae4a-0a582ef228b3 service nova] [instance: e8b9c885-42ba-4f74-86b2-d091ebd08ed5] No waiting events found dispatching network-vif-unplugged-62fa1256-2b2c-4740-b93c-9e98a0a738f8 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:52:04 user nova-compute[75176]: DEBUG nova.compute.manager [req-98be7b6e-567d-45fd-98cd-a67f6ae4e7ea req-7c3f867c-1e1e-4eb6-ae4a-0a582ef228b3 service nova] [instance: e8b9c885-42ba-4f74-86b2-d091ebd08ed5] Received event network-vif-unplugged-62fa1256-2b2c-4740-b93c-9e98a0a738f8 for instance with task_state deleting. {{(pid=75176) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 15:52:04 user nova-compute[75176]: DEBUG nova.compute.manager [req-98be7b6e-567d-45fd-98cd-a67f6ae4e7ea req-7c3f867c-1e1e-4eb6-ae4a-0a582ef228b3 service nova] [instance: e8b9c885-42ba-4f74-86b2-d091ebd08ed5] Received event network-vif-plugged-62fa1256-2b2c-4740-b93c-9e98a0a738f8 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:52:04 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-98be7b6e-567d-45fd-98cd-a67f6ae4e7ea req-7c3f867c-1e1e-4eb6-ae4a-0a582ef228b3 service nova] Acquiring lock "e8b9c885-42ba-4f74-86b2-d091ebd08ed5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:52:04 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-98be7b6e-567d-45fd-98cd-a67f6ae4e7ea req-7c3f867c-1e1e-4eb6-ae4a-0a582ef228b3 service nova] Lock "e8b9c885-42ba-4f74-86b2-d091ebd08ed5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:52:04 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-98be7b6e-567d-45fd-98cd-a67f6ae4e7ea req-7c3f867c-1e1e-4eb6-ae4a-0a582ef228b3 service nova] Lock "e8b9c885-42ba-4f74-86b2-d091ebd08ed5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:52:04 user nova-compute[75176]: DEBUG nova.compute.manager [req-98be7b6e-567d-45fd-98cd-a67f6ae4e7ea req-7c3f867c-1e1e-4eb6-ae4a-0a582ef228b3 service nova] [instance: e8b9c885-42ba-4f74-86b2-d091ebd08ed5] No waiting events found dispatching network-vif-plugged-62fa1256-2b2c-4740-b93c-9e98a0a738f8 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:52:04 user nova-compute[75176]: WARNING nova.compute.manager [req-98be7b6e-567d-45fd-98cd-a67f6ae4e7ea req-7c3f867c-1e1e-4eb6-ae4a-0a582ef228b3 service nova] [instance: e8b9c885-42ba-4f74-86b2-d091ebd08ed5] Received unexpected event network-vif-plugged-62fa1256-2b2c-4740-b93c-9e98a0a738f8 for instance with vm_state active and task_state deleting.
Nov 28 15:52:04 user nova-compute[75176]: INFO nova.compute.manager [None req-5bbf62eb-0e5d-4342-b82b-f81830c4cc64 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: e8b9c885-42ba-4f74-86b2-d091ebd08ed5] Took 1.40 seconds to destroy the instance on the hypervisor.
Nov 28 15:52:04 user nova-compute[75176]: DEBUG oslo.service.loopingcall [None req-5bbf62eb-0e5d-4342-b82b-f81830c4cc64 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75176) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 15:52:04 user nova-compute[75176]: DEBUG nova.compute.manager [-] [instance: e8b9c885-42ba-4f74-86b2-d091ebd08ed5] Deallocating network for instance {{(pid=75176) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 15:52:04 user nova-compute[75176]: DEBUG nova.network.neutron [-] [instance: e8b9c885-42ba-4f74-86b2-d091ebd08ed5] deallocate_for_instance() {{(pid=75176) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 15:52:04 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66ead7d-98f4-4822-9dce-f2ea0206a58d/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:52:04 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66ead7d-98f4-4822-9dce-f2ea0206a58d/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:52:05 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66ead7d-98f4-4822-9dce-f2ea0206a58d/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:52:05 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e465c9f-e8ab-4a28-bf74-2936a272a0e2/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:52:05 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e465c9f-e8ab-4a28-bf74-2936a272a0e2/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:52:05 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e465c9f-e8ab-4a28-bf74-2936a272a0e2/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:52:05 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e465c9f-e8ab-4a28-bf74-2936a272a0e2/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:52:05 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=75176) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 15:52:05 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7/disk.rescue --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:52:05 user nova-compute[75176]: DEBUG nova.network.neutron [-] [instance: e8b9c885-42ba-4f74-86b2-d091ebd08ed5] Updating instance_info_cache with network_info: [] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:52:05 user nova-compute[75176]: INFO nova.compute.manager [-] [instance: e8b9c885-42ba-4f74-86b2-d091ebd08ed5] Took 0.85 seconds to deallocate network for instance.
Nov 28 15:52:05 user nova-compute[75176]: DEBUG nova.compute.manager [req-9c6ed2e5-18ff-4f95-9f6a-add7dd4e3c48 req-e3b54016-0419-4ff6-9ec0-0d46eedc108c service nova] [instance: e8b9c885-42ba-4f74-86b2-d091ebd08ed5] Received event network-vif-deleted-62fa1256-2b2c-4740-b93c-9e98a0a738f8 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:52:05 user nova-compute[75176]: INFO nova.compute.manager [req-9c6ed2e5-18ff-4f95-9f6a-add7dd4e3c48 req-e3b54016-0419-4ff6-9ec0-0d46eedc108c service nova] [instance: e8b9c885-42ba-4f74-86b2-d091ebd08ed5] Neutron deleted interface 62fa1256-2b2c-4740-b93c-9e98a0a738f8; detaching it from the instance and deleting it from the info cache
Nov 28 15:52:05 user nova-compute[75176]: DEBUG nova.network.neutron [req-9c6ed2e5-18ff-4f95-9f6a-add7dd4e3c48 req-e3b54016-0419-4ff6-9ec0-0d46eedc108c service nova] [instance: e8b9c885-42ba-4f74-86b2-d091ebd08ed5] Updating instance_info_cache with network_info: [] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:52:05 user nova-compute[75176]: DEBUG nova.compute.manager [req-9c6ed2e5-18ff-4f95-9f6a-add7dd4e3c48 req-e3b54016-0419-4ff6-9ec0-0d46eedc108c service nova] [instance: e8b9c885-42ba-4f74-86b2-d091ebd08ed5] Detach interface failed, port_id=62fa1256-2b2c-4740-b93c-9e98a0a738f8, reason: Instance e8b9c885-42ba-4f74-86b2-d091ebd08ed5 could not be found. {{(pid=75176) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 28 15:52:05 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7/disk.rescue --force-share --output=json" returned: 0 in 0.203s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:52:05 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7/disk.rescue --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:52:05 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7/disk.rescue --force-share --output=json" returned: 0 in 0.210s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:52:05 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:52:06 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:52:06 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:52:06 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:52:06 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75176) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 15:52:06 user nova-compute[75176]: INFO nova.compute.manager [None req-5bbf62eb-0e5d-4342-b82b-f81830c4cc64 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: e8b9c885-42ba-4f74-86b2-d091ebd08ed5] Took 1.13 seconds to detach 1 volumes for instance.
Nov 28 15:52:06 user nova-compute[75176]: DEBUG nova.compute.manager [None req-5bbf62eb-0e5d-4342-b82b-f81830c4cc64 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: e8b9c885-42ba-4f74-86b2-d091ebd08ed5] Deleting volume: 21587566-b951-4b3e-8024-b6c2d2da35af {{(pid=75176) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 28 15:52:06 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 15:52:06 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 15:52:06 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Hypervisor/Node resource view: name=user free_ram=7312MB free_disk=25.172836303710938GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75176) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 15:52:06 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:52:06 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:52:06 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-5bbf62eb-0e5d-4342-b82b-f81830c4cc64 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:52:06 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance 2e8507b7-fccf-4196-b589-bf2b74f165ec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:52:06 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance 1e8a6e1b-4f71-494a-8f44-f9643c658021 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:52:06 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance a6ebcc53-802a-4515-ba41-3e8e1129235f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:52:06 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance 42579ef7-54dc-4165-a144-61e80fdd5626 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:52:06 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance f66ead7d-98f4-4822-9dce-f2ea0206a58d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:52:06 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance 55febf04-14ea-4903-8692-c7cc6115de75 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:52:06 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance 8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:52:06 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance e8b9c885-42ba-4f74-86b2-d091ebd08ed5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:52:06 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance 0e465c9f-e8ab-4a28-bf74-2936a272a0e2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:52:06 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance 6161cab2-eb1f-44cb-bbd5-077e6db42f77 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:52:06 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance ca1558cf-b235-4a20-8d12-45f1ca16fe41 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:52:06 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance dc4e6d39-adfb-4d26-afef-46f316ff7846 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:52:06 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75176) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 15:52:06 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75176) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 15:52:07 user nova-compute[75176]: DEBUG nova.compute.provider_tree [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Inventory has not changed in ProviderTree for provider: b37848d8-f401-4155-a029-b0ffa09ff85b {{(pid=75176) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 15:52:07 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Inventory has not changed for provider b37848d8-f401-4155-a029-b0ffa09ff85b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75176) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 15:52:07 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Compute_service record updated for user:user {{(pid=75176) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 15:52:07 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.580s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:52:07 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-5bbf62eb-0e5d-4342-b82b-f81830c4cc64 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.432s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:52:07 user nova-compute[75176]: DEBUG nova.compute.provider_tree [None req-5bbf62eb-0e5d-4342-b82b-f81830c4cc64 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Inventory has not changed in ProviderTree for provider: b37848d8-f401-4155-a029-b0ffa09ff85b {{(pid=75176) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 15:52:07 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-5bbf62eb-0e5d-4342-b82b-f81830c4cc64 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Inventory has not changed for provider b37848d8-f401-4155-a029-b0ffa09ff85b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75176) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 15:52:07 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-5bbf62eb-0e5d-4342-b82b-f81830c4cc64 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.397s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:52:07 user nova-compute[75176]: INFO nova.scheduler.client.report [None req-5bbf62eb-0e5d-4342-b82b-f81830c4cc64 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Deleted allocations for instance e8b9c885-42ba-4f74-86b2-d091ebd08ed5
Nov 28 15:52:07 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-5bbf62eb-0e5d-4342-b82b-f81830c4cc64 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Lock "e8b9c885-42ba-4f74-86b2-d091ebd08ed5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.527s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:52:09 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:52:09 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:52:10 user nova-compute[75176]: DEBUG nova.compute.manager [None req-73c068bc-30c1-4110-a5ab-af2d1fa9c1b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: dc4e6d39-adfb-4d26-afef-46f316ff7846] Start spawning the instance on the hypervisor. {{(pid=75176) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 15:52:10 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-73c068bc-30c1-4110-a5ab-af2d1fa9c1b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: dc4e6d39-adfb-4d26-afef-46f316ff7846] Creating instance directory {{(pid=75176) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 15:52:10 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-73c068bc-30c1-4110-a5ab-af2d1fa9c1b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: dc4e6d39-adfb-4d26-afef-46f316ff7846] Creating image(s)
Nov 28 15:52:10 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-73c068bc-30c1-4110-a5ab-af2d1fa9c1b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: dc4e6d39-adfb-4d26-afef-46f316ff7846] Did not create local disks {{(pid=75176) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 28 15:52:10 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-73c068bc-30c1-4110-a5ab-af2d1fa9c1b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: dc4e6d39-adfb-4d26-afef-46f316ff7846] Ensure instance console log exists: /opt/stack/data/nova/instances/dc4e6d39-adfb-4d26-afef-46f316ff7846/console.log {{(pid=75176) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 15:52:10 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-73c068bc-30c1-4110-a5ab-af2d1fa9c1b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:52:10 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-73c068bc-30c1-4110-a5ab-af2d1fa9c1b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:52:10 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-73c068bc-30c1-4110-a5ab-af2d1fa9c1b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:52:10 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-73c068bc-30c1-4110-a5ab-af2d1fa9c1b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: dc4e6d39-adfb-4d26-afef-46f316ff7846] Start _get_guest_xml network_info=[{"id": "65eb3123-182c-40fd-b20c-48b19b833f14", "address": "fa:16:3e:59:4a:59", "network": {"id": "998766cd-2e8e-4e39-add9-286086640993", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-989265510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf05c8836b8a40de8e64c2d046ed71ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65eb3123-18", "ovs_interfaceid": "65eb3123-182c-40fd-b20c-48b19b833f14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T15:35:12Z,direct_url=<?>,disk_format='qcow2',id=1f41819e-c93f-4dc7-b253-37a27bbbbc74,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1b91c5d0672c4224a48df2e1f92688e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T15:35:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sIJbvTel', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'dc4e6d39-adfb-4d26-afef-46f316ff7846', 'attached_at': '', 'detached_at': '', 'volume_id': '9c4d9db6-5ee1-419c-8f2e-2a758e9798b6', 'serial': '9c4d9db6-5ee1-419c-8f2e-2a758e9798b6'}, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'delete_on_termination': False, 'mount_device': '/dev/vda', 'attachment_id': 'd43d734a-766e-4e5f-8cdf-f713cdc1aa30', 'volume_type': None} {{(pid=75176) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 15:52:10 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-73c068bc-30c1-4110-a5ab-af2d1fa9c1b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 15:52:10 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-73c068bc-30c1-4110-a5ab-af2d1fa9c1b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 15:52:10 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-73c068bc-30c1-4110-a5ab-af2d1fa9c1b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75176) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 15:52:10 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-73c068bc-30c1-4110-a5ab-af2d1fa9c1b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] CPU controller missing on host. {{(pid=75176) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 15:52:10 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-73c068bc-30c1-4110-a5ab-af2d1fa9c1b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75176) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 15:52:10 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-73c068bc-30c1-4110-a5ab-af2d1fa9c1b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] CPU controller found on host. {{(pid=75176) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 15:52:10 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-73c068bc-30c1-4110-a5ab-af2d1fa9c1b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75176) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 15:52:10 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-73c068bc-30c1-4110-a5ab-af2d1fa9c1b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T15:35:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T15:35:12Z,direct_url=<?>,disk_format='qcow2',id=1f41819e-c93f-4dc7-b253-37a27bbbbc74,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1b91c5d0672c4224a48df2e1f92688e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T15:35:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 15:52:10 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-73c068bc-30c1-4110-a5ab-af2d1fa9c1b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Flavor limits 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 15:52:10 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-73c068bc-30c1-4110-a5ab-af2d1fa9c1b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Image limits 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 15:52:10 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-73c068bc-30c1-4110-a5ab-af2d1fa9c1b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Flavor pref 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 15:52:10 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-73c068bc-30c1-4110-a5ab-af2d1fa9c1b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Image pref 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 15:52:10 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-73c068bc-30c1-4110-a5ab-af2d1fa9c1b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 15:52:10 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-73c068bc-30c1-4110-a5ab-af2d1fa9c1b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 15:52:10 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-73c068bc-30c1-4110-a5ab-af2d1fa9c1b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75176) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 15:52:10 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-73c068bc-30c1-4110-a5ab-af2d1fa9c1b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Got 1 possible topologies {{(pid=75176) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 15:52:10 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-73c068bc-30c1-4110-a5ab-af2d1fa9c1b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 15:52:10 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-73c068bc-30c1-4110-a5ab-af2d1fa9c1b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 15:52:10 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-73c068bc-30c1-4110-a5ab-af2d1fa9c1b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: dc4e6d39-adfb-4d26-afef-46f316ff7846] Calling os-brick to attach iSCSI Volume {{(pid=75176) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 15:52:10 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-73c068bc-30c1-4110-a5ab-af2d1fa9c1b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c1b8a00>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sIJbvTel', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 15:52:10 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-73c068bc-30c1-4110-a5ab-af2d1fa9c1b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 15:52:10 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-73c068bc-30c1-4110-a5ab-af2d1fa9c1b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 15:52:10 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-73c068bc-30c1-4110-a5ab-af2d1fa9c1b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 15:52:10 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-73c068bc-30c1-4110-a5ab-af2d1fa9c1b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 15:52:10 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-73c068bc-30c1-4110-a5ab-af2d1fa9c1b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 15:52:10 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-73c068bc-30c1-4110-a5ab-af2d1fa9c1b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 15:52:10 user nova-compute[75176]: INFO os_brick.initiator.connectors.iscsi [None req-73c068bc-30c1-4110-a5ab-af2d1fa9c1b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 15:52:10 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 -p 172.16.0.220:3260 {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:52:10 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:52:10 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[e878522c-3717-4786-bb8c-000ce8919a8d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:52:10 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-73c068bc-30c1-4110-a5ab-af2d1fa9c1b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 15:52:10 user nova-compute[75176]:  {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:52:10 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 -p 172.16.0.220:3260 --interface default --op new {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:52:10 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:52:10 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f2ece0c-b2a4-401d-a288-e966cfc25e5c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6] added\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:52:10 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-73c068bc-30c1-4110-a5ab-af2d1fa9c1b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6] added
Nov 28 15:52:10 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:52:10 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:52:10 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:52:10 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d1ef5df-0d1e-4cba-b448-0b798d6d4e99]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:52:10 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-73c068bc-30c1-4110-a5ab-af2d1fa9c1b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:52:10 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:52:10 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:52:10 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[63bf2a24-8854-4bdf-8e9f-ccb68efe1ff7]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:52:10 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-73c068bc-30c1-4110-a5ab-af2d1fa9c1b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:52:10 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sIJbvTel {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:52:10 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sIJbvTel" returned: 0 in 0.017s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:52:10 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[967780bf-d17b-49f1-91da-1eb7792345b3]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:52:10 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-73c068bc-30c1-4110-a5ab-af2d1fa9c1b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sIJbvTel'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:52:10 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:52:10 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:52:10 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[55d7ae28-6d21-4285-bf31-56e3ffd4d158]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:52:10 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-73c068bc-30c1-4110-a5ab-af2d1fa9c1b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:52:10 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:52:10 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:52:10 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e50f618-eac4-43ac-bc4c-549affa2db13]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8452525c-6845-4edb-bf69-1e2ffe0ef2eb (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07de7953-293c-4762-b695-ed3190c934d5 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22933c6e-3d8f-44f5-bc41-dee97c587055 (non-flash)\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:52:10 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-73c068bc-30c1-4110-a5ab-af2d1fa9c1b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8452525c-6845-4edb-bf69-1e2ffe0ef2eb (non-flash)
Nov 28 15:52:10 user nova-compute[75176]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07de7953-293c-4762-b695-ed3190c934d5 (non-flash)
Nov 28 15:52:10 user nova-compute[75176]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc (non-flash)
Nov 28 15:52:10 user nova-compute[75176]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22933c6e-3d8f-44f5-bc41-dee97c587055 (non-flash)
Nov 28 15:52:10 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:52:10 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-73c068bc-30c1-4110-a5ab-af2d1fa9c1b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8452525c-6845-4edb-bf69-1e2ffe0ef2eb (non-flash)
Nov 28 15:52:10 user nova-compute[75176]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07de7953-293c-4762-b695-ed3190c934d5 (non-flash)
Nov 28 15:52:10 user nova-compute[75176]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc (non-flash)
Nov 28 15:52:10 user nova-compute[75176]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22933c6e-3d8f-44f5-bc41-dee97c587055 (non-flash)
Nov 28 15:52:10 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 15:52:10 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 -p 172.16.0.220:3260 --login {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:52:10 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:52:10 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd34e96b-e92d-4ddf-9fb7-d607b24a1918]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:52:10 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-73c068bc-30c1-4110-a5ab-af2d1fa9c1b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6, portal: 172.16.0.220,3260]
Nov 28 15:52:10 user nova-compute[75176]: Login to [iface: default, target: iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6, portal: 172.16.0.220,3260] successful.
Nov 28 15:52:10 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:52:10 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:52:10 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:52:10 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d5dd8fb-4048-4b5d-b92c-87e0efddaa6a]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:52:10 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-73c068bc-30c1-4110-a5ab-af2d1fa9c1b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:52:10 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:52:10 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:52:10 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[16a7a461-d8a1-4a82-a887-f657501b8f25]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8452525c-6845-4edb-bf69-1e2ffe0ef2eb (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07de7953-293c-4762-b695-ed3190c934d5 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22933c6e-3d8f-44f5-bc41-dee97c587055 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 (non-flash)\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:52:10 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-73c068bc-30c1-4110-a5ab-af2d1fa9c1b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8452525c-6845-4edb-bf69-1e2ffe0ef2eb (non-flash)
Nov 28 15:52:10 user nova-compute[75176]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07de7953-293c-4762-b695-ed3190c934d5 (non-flash)
Nov 28 15:52:10 user nova-compute[75176]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc (non-flash)
Nov 28 15:52:10 user nova-compute[75176]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22933c6e-3d8f-44f5-bc41-dee97c587055 (non-flash)
Nov 28 15:52:10 user nova-compute[75176]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 (non-flash)
Nov 28 15:52:10 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:52:10 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-73c068bc-30c1-4110-a5ab-af2d1fa9c1b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8452525c-6845-4edb-bf69-1e2ffe0ef2eb (non-flash)
Nov 28 15:52:10 user nova-compute[75176]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07de7953-293c-4762-b695-ed3190c934d5 (non-flash)
Nov 28 15:52:10 user nova-compute[75176]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc (non-flash)
Nov 28 15:52:10 user nova-compute[75176]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22933c6e-3d8f-44f5-bc41-dee97c587055 (non-flash)
Nov 28 15:52:10 user nova-compute[75176]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 (non-flash)
Nov 28 15:52:10 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 15:52:10 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-73c068bc-30c1-4110-a5ab-af2d1fa9c1b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.323s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 15:52:10 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-73c068bc-30c1-4110-a5ab-af2d1fa9c1b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Connected to 172.16.0.220:3260 {{(pid=75176) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 15:52:10 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-73c068bc-30c1-4110-a5ab-af2d1fa9c1b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] HCTL ('35', '-', '-', 0) found on session 40 with lun 0 {{(pid=75176) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 15:52:10 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-73c068bc-30c1-4110-a5ab-af2d1fa9c1b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75176) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 15:52:10 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:52:10 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:52:10 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb72435f-efbe-4572-9f68-0ccac6b55253]: (4, ('- - 0', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:52:10 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-73c068bc-30c1-4110-a5ab-af2d1fa9c1b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Searching for a device in session 40 and hctl ['35', '*', '*', 0] yield: None {{(pid=75176) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 15:52:11 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-73c068bc-30c1-4110-a5ab-af2d1fa9c1b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Searching for a device in session 40 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75176) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 15:52:11 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-73c068bc-30c1-4110-a5ab-af2d1fa9c1b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sIJbvTel', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75176) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 15:52:11 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-73c068bc-30c1-4110-a5ab-af2d1fa9c1b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.356s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 15:52:11 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-73c068bc-30c1-4110-a5ab-af2d1fa9c1b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] <== connect_volume: return (1357ms) {'type': 'block', 'scsi_wwn': '23662623662626433', 'path': '/dev/sdd'} {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 15:52:11 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-73c068bc-30c1-4110-a5ab-af2d1fa9c1b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: dc4e6d39-adfb-4d26-afef-46f316ff7846] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23662623662626433', 'path': '/dev/sdd'} {{(pid=75176) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 15:52:11 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-73c068bc-30c1-4110-a5ab-af2d1fa9c1b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T15:51:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1353594468',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1353594468',id=35,image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bf05c8836b8a40de8e64c2d046ed71ff',ramdisk_id='',reservation_id='r-0xcr01a0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1648409789',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T15:51:57Z,user_data=None,user_id='f24cedac95a44bb5a9ee54cc4713945c',uuid=dc4e6d39-adfb-4d26-afef-46f316ff7846,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "65eb3123-182c-40fd-b20c-48b19b833f14", "address": "fa:16:3e:59:4a:59", "network": {"id": "998766cd-2e8e-4e39-add9-286086640993", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-989265510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf05c8836b8a40de8e64c2d046ed71ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65eb3123-18", "ovs_interfaceid": "65eb3123-182c-40fd-b20c-48b19b833f14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75176) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 15:52:11 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-73c068bc-30c1-4110-a5ab-af2d1fa9c1b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Converting VIF {"id": "65eb3123-182c-40fd-b20c-48b19b833f14", "address": "fa:16:3e:59:4a:59", "network": {"id": "998766cd-2e8e-4e39-add9-286086640993", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-989265510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf05c8836b8a40de8e64c2d046ed71ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65eb3123-18", "ovs_interfaceid": "65eb3123-182c-40fd-b20c-48b19b833f14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:52:11 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-73c068bc-30c1-4110-a5ab-af2d1fa9c1b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:4a:59,bridge_name='br-int',has_traffic_filtering=True,id=65eb3123-182c-40fd-b20c-48b19b833f14,network=Network(998766cd-2e8e-4e39-add9-286086640993),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65eb3123-18') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:52:11 user nova-compute[75176]: DEBUG nova.objects.instance [None req-73c068bc-30c1-4110-a5ab-af2d1fa9c1b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Lazy-loading 'pci_devices' on Instance uuid dc4e6d39-adfb-4d26-afef-46f316ff7846 {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:52:11 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-73c068bc-30c1-4110-a5ab-af2d1fa9c1b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: dc4e6d39-adfb-4d26-afef-46f316ff7846] End _get_guest_xml xml=<domain type="kvm">
Nov 28 15:52:11 user nova-compute[75176]:   <uuid>dc4e6d39-adfb-4d26-afef-46f316ff7846</uuid>
Nov 28 15:52:11 user nova-compute[75176]:   <name>instance-00000023</name>
Nov 28 15:52:11 user nova-compute[75176]:   <memory>524288</memory>
Nov 28 15:52:11 user nova-compute[75176]:   <vcpu>1</vcpu>
Nov 28 15:52:11 user nova-compute[75176]:   <metadata>
Nov 28 15:52:11 user nova-compute[75176]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 15:52:11 user nova-compute[75176]:       <nova:package version="0.0.0"/>
Nov 28 15:52:11 user nova-compute[75176]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1353594468</nova:name>
Nov 28 15:52:11 user nova-compute[75176]:       <nova:creationTime>2023-11-28 15:52:10</nova:creationTime>
Nov 28 15:52:11 user nova-compute[75176]:       <nova:flavor name="m1.tiny">
Nov 28 15:52:11 user nova-compute[75176]:         <nova:memory>512</nova:memory>
Nov 28 15:52:11 user nova-compute[75176]:         <nova:disk>1</nova:disk>
Nov 28 15:52:11 user nova-compute[75176]:         <nova:swap>0</nova:swap>
Nov 28 15:52:11 user nova-compute[75176]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 15:52:11 user nova-compute[75176]:         <nova:vcpus>1</nova:vcpus>
Nov 28 15:52:11 user nova-compute[75176]:       </nova:flavor>
Nov 28 15:52:11 user nova-compute[75176]:       <nova:owner>
Nov 28 15:52:11 user nova-compute[75176]:         <nova:user uuid="f24cedac95a44bb5a9ee54cc4713945c">tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member</nova:user>
Nov 28 15:52:11 user nova-compute[75176]:         <nova:project uuid="bf05c8836b8a40de8e64c2d046ed71ff">tempest-ServerBootFromVolumeStableRescueTest-1648409789</nova:project>
Nov 28 15:52:11 user nova-compute[75176]:       </nova:owner>
Nov 28 15:52:11 user nova-compute[75176]:       <nova:root type="image" uuid="1f41819e-c93f-4dc7-b253-37a27bbbbc74"/>
Nov 28 15:52:11 user nova-compute[75176]:       <nova:ports>
Nov 28 15:52:11 user nova-compute[75176]:         <nova:port uuid="65eb3123-182c-40fd-b20c-48b19b833f14">
Nov 28 15:52:11 user nova-compute[75176]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 28 15:52:11 user nova-compute[75176]:         </nova:port>
Nov 28 15:52:11 user nova-compute[75176]:       </nova:ports>
Nov 28 15:52:11 user nova-compute[75176]:     </nova:instance>
Nov 28 15:52:11 user nova-compute[75176]:   </metadata>
Nov 28 15:52:11 user nova-compute[75176]:   <sysinfo type="smbios">
Nov 28 15:52:11 user nova-compute[75176]:     <system>
Nov 28 15:52:11 user nova-compute[75176]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 15:52:11 user nova-compute[75176]:       <entry name="product">OpenStack Nova</entry>
Nov 28 15:52:11 user nova-compute[75176]:       <entry name="version">0.0.0</entry>
Nov 28 15:52:11 user nova-compute[75176]:       <entry name="serial">dc4e6d39-adfb-4d26-afef-46f316ff7846</entry>
Nov 28 15:52:11 user nova-compute[75176]:       <entry name="uuid">dc4e6d39-adfb-4d26-afef-46f316ff7846</entry>
Nov 28 15:52:11 user nova-compute[75176]:       <entry name="family">Virtual Machine</entry>
Nov 28 15:52:11 user nova-compute[75176]:     </system>
Nov 28 15:52:11 user nova-compute[75176]:   </sysinfo>
Nov 28 15:52:11 user nova-compute[75176]:   <os>
Nov 28 15:52:11 user nova-compute[75176]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 15:52:11 user nova-compute[75176]:     <boot dev="hd"/>
Nov 28 15:52:11 user nova-compute[75176]:     <smbios mode="sysinfo"/>
Nov 28 15:52:11 user nova-compute[75176]:   </os>
Nov 28 15:52:11 user nova-compute[75176]:   <features>
Nov 28 15:52:11 user nova-compute[75176]:     <acpi/>
Nov 28 15:52:11 user nova-compute[75176]:     <apic/>
Nov 28 15:52:11 user nova-compute[75176]:     <vmcoreinfo/>
Nov 28 15:52:11 user nova-compute[75176]:   </features>
Nov 28 15:52:11 user nova-compute[75176]:   <clock offset="utc">
Nov 28 15:52:11 user nova-compute[75176]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 15:52:11 user nova-compute[75176]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 15:52:11 user nova-compute[75176]:     <timer name="hpet" present="no"/>
Nov 28 15:52:11 user nova-compute[75176]:   </clock>
Nov 28 15:52:11 user nova-compute[75176]:   <cpu mode="custom" match="exact">
Nov 28 15:52:11 user nova-compute[75176]:     <model>Nehalem</model>
Nov 28 15:52:11 user nova-compute[75176]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 15:52:11 user nova-compute[75176]:   </cpu>
Nov 28 15:52:11 user nova-compute[75176]:   <devices>
Nov 28 15:52:11 user nova-compute[75176]:     <disk type="block" device="disk">
Nov 28 15:52:11 user nova-compute[75176]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 15:52:11 user nova-compute[75176]:       <source dev="/dev/sdd"/>
Nov 28 15:52:11 user nova-compute[75176]:       <target dev="vda" bus="virtio"/>
Nov 28 15:52:11 user nova-compute[75176]:       <serial>9c4d9db6-5ee1-419c-8f2e-2a758e9798b6</serial>
Nov 28 15:52:11 user nova-compute[75176]:     </disk>
Nov 28 15:52:11 user nova-compute[75176]:     <interface type="ethernet">
Nov 28 15:52:11 user nova-compute[75176]:       <mac address="fa:16:3e:59:4a:59"/>
Nov 28 15:52:11 user nova-compute[75176]:       <model type="virtio"/>
Nov 28 15:52:11 user nova-compute[75176]:       <mtu size="1442"/>
Nov 28 15:52:11 user nova-compute[75176]:       <target dev="tap65eb3123-18"/>
Nov 28 15:52:11 user nova-compute[75176]:     </interface>
Nov 28 15:52:11 user nova-compute[75176]:     <serial type="pty">
Nov 28 15:52:11 user nova-compute[75176]:       <log file="/opt/stack/data/nova/instances/dc4e6d39-adfb-4d26-afef-46f316ff7846/console.log" append="off"/>
Nov 28 15:52:11 user nova-compute[75176]:     </serial>
Nov 28 15:52:11 user nova-compute[75176]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 15:52:11 user nova-compute[75176]:     <video>
Nov 28 15:52:11 user nova-compute[75176]:       <model type="virtio"/>
Nov 28 15:52:11 user nova-compute[75176]:     </video>
Nov 28 15:52:11 user nova-compute[75176]:     <rng model="virtio">
Nov 28 15:52:11 user nova-compute[75176]:       <backend model="random">/dev/urandom</backend>
Nov 28 15:52:11 user nova-compute[75176]:     </rng>
Nov 28 15:52:11 user nova-compute[75176]:     <controller type="usb" index="0" model="none"/>
Nov 28 15:52:11 user nova-compute[75176]:     <memballoon model="virtio">
Nov 28 15:52:11 user nova-compute[75176]:       <stats period="10"/>
Nov 28 15:52:11 user nova-compute[75176]:     </memballoon>
Nov 28 15:52:11 user nova-compute[75176]:   </devices>
Nov 28 15:52:11 user nova-compute[75176]: </domain>
Nov 28 15:52:11 user nova-compute[75176]:  {{(pid=75176) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 15:52:11 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-73c068bc-30c1-4110-a5ab-af2d1fa9c1b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T15:51:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1353594468',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1353594468',id=35,image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bf05c8836b8a40de8e64c2d046ed71ff',ramdisk_id='',reservation_id='r-0xcr01a0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1648409789',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T15:51:57Z,user_data=None,user_id='f24cedac95a44bb5a9ee54cc4713945c',uuid=dc4e6d39-adfb-4d26-afef-46f316ff7846,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "65eb3123-182c-40fd-b20c-48b19b833f14", "address": "fa:16:3e:59:4a:59", "network": {"id": "998766cd-2e8e-4e39-add9-286086640993", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-989265510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf05c8836b8a40de8e64c2d046ed71ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65eb3123-18", "ovs_interfaceid": "65eb3123-182c-40fd-b20c-48b19b833f14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 15:52:11 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-73c068bc-30c1-4110-a5ab-af2d1fa9c1b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Converting VIF {"id": "65eb3123-182c-40fd-b20c-48b19b833f14", "address": "fa:16:3e:59:4a:59", "network": {"id": "998766cd-2e8e-4e39-add9-286086640993", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-989265510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf05c8836b8a40de8e64c2d046ed71ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65eb3123-18", "ovs_interfaceid": "65eb3123-182c-40fd-b20c-48b19b833f14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:52:11 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-73c068bc-30c1-4110-a5ab-af2d1fa9c1b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:4a:59,bridge_name='br-int',has_traffic_filtering=True,id=65eb3123-182c-40fd-b20c-48b19b833f14,network=Network(998766cd-2e8e-4e39-add9-286086640993),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65eb3123-18') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:52:11 user nova-compute[75176]: DEBUG os_vif [None req-73c068bc-30c1-4110-a5ab-af2d1fa9c1b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:4a:59,bridge_name='br-int',has_traffic_filtering=True,id=65eb3123-182c-40fd-b20c-48b19b833f14,network=Network(998766cd-2e8e-4e39-add9-286086640993),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65eb3123-18') {{(pid=75176) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 15:52:11 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:52:11 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:52:11 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 15:52:11 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:52:11 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0c53104c-6091-59d1-b5fe-104fbbc719bb', '_type': 'linux-noop'}}, row=False) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:52:11 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:52:11 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:52:11 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:52:11 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap65eb3123-18, may_exist=True, interface_attrs={}) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:52:11 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap65eb3123-18, col_values=(('qos', UUID('3464fc32-305b-4f4e-97e7-1a8d6b813df2')),), if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:52:11 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap65eb3123-18, col_values=(('external_ids', {'iface-id': '65eb3123-182c-40fd-b20c-48b19b833f14', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:59:4a:59', 'vm-uuid': 'dc4e6d39-adfb-4d26-afef-46f316ff7846'}),), if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:52:11 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:52:11 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:52:11 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:52:11 user nova-compute[75176]: INFO os_vif [None req-73c068bc-30c1-4110-a5ab-af2d1fa9c1b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:4a:59,bridge_name='br-int',has_traffic_filtering=True,id=65eb3123-182c-40fd-b20c-48b19b833f14,network=Network(998766cd-2e8e-4e39-add9-286086640993),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65eb3123-18')
Nov 28 15:52:11 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-73c068bc-30c1-4110-a5ab-af2d1fa9c1b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] No BDM found with device name vda, not building metadata. {{(pid=75176) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 15:52:11 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-73c068bc-30c1-4110-a5ab-af2d1fa9c1b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] No VIF found with MAC fa:16:3e:59:4a:59, not building metadata {{(pid=75176) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 15:52:12 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:52:12 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:52:12 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:52:12 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:52:13 user nova-compute[75176]: DEBUG nova.compute.manager [req-bfff0f4c-e68c-4918-b95d-15c2508f1d4d req-47b56db1-8eb3-4e84-a85c-bf0f8926394d service nova] [instance: dc4e6d39-adfb-4d26-afef-46f316ff7846] Received event network-vif-plugged-65eb3123-182c-40fd-b20c-48b19b833f14 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:52:13 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-bfff0f4c-e68c-4918-b95d-15c2508f1d4d req-47b56db1-8eb3-4e84-a85c-bf0f8926394d service nova] Acquiring lock "dc4e6d39-adfb-4d26-afef-46f316ff7846-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:52:13 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-bfff0f4c-e68c-4918-b95d-15c2508f1d4d req-47b56db1-8eb3-4e84-a85c-bf0f8926394d service nova] Lock "dc4e6d39-adfb-4d26-afef-46f316ff7846-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:52:13 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-bfff0f4c-e68c-4918-b95d-15c2508f1d4d req-47b56db1-8eb3-4e84-a85c-bf0f8926394d service nova] Lock "dc4e6d39-adfb-4d26-afef-46f316ff7846-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:52:13 user nova-compute[75176]: DEBUG nova.compute.manager [req-bfff0f4c-e68c-4918-b95d-15c2508f1d4d req-47b56db1-8eb3-4e84-a85c-bf0f8926394d service nova] [instance: dc4e6d39-adfb-4d26-afef-46f316ff7846] No waiting events found dispatching network-vif-plugged-65eb3123-182c-40fd-b20c-48b19b833f14 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:52:13 user nova-compute[75176]: WARNING nova.compute.manager [req-bfff0f4c-e68c-4918-b95d-15c2508f1d4d req-47b56db1-8eb3-4e84-a85c-bf0f8926394d service nova] [instance: dc4e6d39-adfb-4d26-afef-46f316ff7846] Received unexpected event network-vif-plugged-65eb3123-182c-40fd-b20c-48b19b833f14 for instance with vm_state building and task_state spawning.
Nov 28 15:52:13 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:52:13 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:52:14 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:52:14 user nova-compute[75176]: DEBUG nova.compute.manager [None req-73c068bc-30c1-4110-a5ab-af2d1fa9c1b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: dc4e6d39-adfb-4d26-afef-46f316ff7846] Instance event wait completed in 0 seconds for  {{(pid=75176) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 15:52:14 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-73c068bc-30c1-4110-a5ab-af2d1fa9c1b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: dc4e6d39-adfb-4d26-afef-46f316ff7846] Guest created on hypervisor {{(pid=75176) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 15:52:14 user nova-compute[75176]: INFO nova.virt.libvirt.driver [-] [instance: dc4e6d39-adfb-4d26-afef-46f316ff7846] Instance spawned successfully.
Nov 28 15:52:14 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-73c068bc-30c1-4110-a5ab-af2d1fa9c1b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: dc4e6d39-adfb-4d26-afef-46f316ff7846] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 15:52:15 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-73c068bc-30c1-4110-a5ab-af2d1fa9c1b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: dc4e6d39-adfb-4d26-afef-46f316ff7846] Found default for hw_cdrom_bus of ide {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:52:15 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-73c068bc-30c1-4110-a5ab-af2d1fa9c1b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: dc4e6d39-adfb-4d26-afef-46f316ff7846] Found default for hw_disk_bus of virtio {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:52:15 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-73c068bc-30c1-4110-a5ab-af2d1fa9c1b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: dc4e6d39-adfb-4d26-afef-46f316ff7846] Found default for hw_input_bus of None {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:52:15 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-73c068bc-30c1-4110-a5ab-af2d1fa9c1b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: dc4e6d39-adfb-4d26-afef-46f316ff7846] Found default for hw_pointer_model of None {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:52:15 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-73c068bc-30c1-4110-a5ab-af2d1fa9c1b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: dc4e6d39-adfb-4d26-afef-46f316ff7846] Found default for hw_video_model of virtio {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:52:15 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-73c068bc-30c1-4110-a5ab-af2d1fa9c1b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: dc4e6d39-adfb-4d26-afef-46f316ff7846] Found default for hw_vif_model of virtio {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:52:15 user nova-compute[75176]: INFO nova.compute.manager [None req-73c068bc-30c1-4110-a5ab-af2d1fa9c1b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: dc4e6d39-adfb-4d26-afef-46f316ff7846] Took 5.03 seconds to spawn the instance on the hypervisor.
Nov 28 15:52:15 user nova-compute[75176]: DEBUG nova.compute.manager [None req-73c068bc-30c1-4110-a5ab-af2d1fa9c1b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: dc4e6d39-adfb-4d26-afef-46f316ff7846] Checking state {{(pid=75176) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 15:52:15 user nova-compute[75176]: DEBUG nova.compute.manager [req-04b3256a-e461-41fd-afc6-6eb7502a0706 req-d3032218-bceb-4c14-9efe-c6ddc8e06ff3 service nova] [instance: dc4e6d39-adfb-4d26-afef-46f316ff7846] Received event network-vif-plugged-65eb3123-182c-40fd-b20c-48b19b833f14 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:52:15 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-04b3256a-e461-41fd-afc6-6eb7502a0706 req-d3032218-bceb-4c14-9efe-c6ddc8e06ff3 service nova] Acquiring lock "dc4e6d39-adfb-4d26-afef-46f316ff7846-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:52:15 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-04b3256a-e461-41fd-afc6-6eb7502a0706 req-d3032218-bceb-4c14-9efe-c6ddc8e06ff3 service nova] Lock "dc4e6d39-adfb-4d26-afef-46f316ff7846-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:52:15 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-04b3256a-e461-41fd-afc6-6eb7502a0706 req-d3032218-bceb-4c14-9efe-c6ddc8e06ff3 service nova] Lock "dc4e6d39-adfb-4d26-afef-46f316ff7846-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:52:15 user nova-compute[75176]: DEBUG nova.compute.manager [req-04b3256a-e461-41fd-afc6-6eb7502a0706 req-d3032218-bceb-4c14-9efe-c6ddc8e06ff3 service nova] [instance: dc4e6d39-adfb-4d26-afef-46f316ff7846] No waiting events found dispatching network-vif-plugged-65eb3123-182c-40fd-b20c-48b19b833f14 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:52:15 user nova-compute[75176]: WARNING nova.compute.manager [req-04b3256a-e461-41fd-afc6-6eb7502a0706 req-d3032218-bceb-4c14-9efe-c6ddc8e06ff3 service nova] [instance: dc4e6d39-adfb-4d26-afef-46f316ff7846] Received unexpected event network-vif-plugged-65eb3123-182c-40fd-b20c-48b19b833f14 for instance with vm_state building and task_state spawning.
Nov 28 15:52:15 user nova-compute[75176]: INFO nova.compute.manager [None req-73c068bc-30c1-4110-a5ab-af2d1fa9c1b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: dc4e6d39-adfb-4d26-afef-46f316ff7846] Took 19.25 seconds to build instance.
Nov 28 15:52:15 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-73c068bc-30c1-4110-a5ab-af2d1fa9c1b1 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Lock "dc4e6d39-adfb-4d26-afef-46f316ff7846" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.391s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:52:16 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:52:18 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:52:19 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:52:19 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-b70f5f64-7872-4c19-ad0b-97612c383acb tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Acquiring lock "a6ebcc53-802a-4515-ba41-3e8e1129235f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:52:19 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-b70f5f64-7872-4c19-ad0b-97612c383acb tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Lock "a6ebcc53-802a-4515-ba41-3e8e1129235f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:52:19 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-b70f5f64-7872-4c19-ad0b-97612c383acb tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Acquiring lock "a6ebcc53-802a-4515-ba41-3e8e1129235f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:52:19 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-b70f5f64-7872-4c19-ad0b-97612c383acb tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Lock "a6ebcc53-802a-4515-ba41-3e8e1129235f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:52:19 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-b70f5f64-7872-4c19-ad0b-97612c383acb tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Lock "a6ebcc53-802a-4515-ba41-3e8e1129235f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:52:19 user nova-compute[75176]: INFO nova.compute.manager [None req-b70f5f64-7872-4c19-ad0b-97612c383acb tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] [instance: a6ebcc53-802a-4515-ba41-3e8e1129235f] Terminating instance
Nov 28 15:52:19 user nova-compute[75176]: DEBUG nova.compute.manager [None req-b70f5f64-7872-4c19-ad0b-97612c383acb tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] [instance: a6ebcc53-802a-4515-ba41-3e8e1129235f] Start destroying the instance on the hypervisor. {{(pid=75176) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 15:52:20 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:52:20 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:52:20 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:52:20 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:52:20 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:52:20 user nova-compute[75176]: DEBUG nova.compute.manager [req-203fa6be-46e5-4768-81fc-8730aed6d605 req-63d35c13-1c43-45a4-a102-3b809270985b service nova] [instance: a6ebcc53-802a-4515-ba41-3e8e1129235f] Received event network-vif-unplugged-1beb8fcc-a604-4b25-8e50-63325edade24 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:52:20 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-203fa6be-46e5-4768-81fc-8730aed6d605 req-63d35c13-1c43-45a4-a102-3b809270985b service nova] Acquiring lock "a6ebcc53-802a-4515-ba41-3e8e1129235f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:52:20 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-203fa6be-46e5-4768-81fc-8730aed6d605 req-63d35c13-1c43-45a4-a102-3b809270985b service nova] Lock "a6ebcc53-802a-4515-ba41-3e8e1129235f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:52:20 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-203fa6be-46e5-4768-81fc-8730aed6d605 req-63d35c13-1c43-45a4-a102-3b809270985b service nova] Lock "a6ebcc53-802a-4515-ba41-3e8e1129235f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:52:20 user nova-compute[75176]: DEBUG nova.compute.manager [req-203fa6be-46e5-4768-81fc-8730aed6d605 req-63d35c13-1c43-45a4-a102-3b809270985b service nova] [instance: a6ebcc53-802a-4515-ba41-3e8e1129235f] No waiting events found dispatching network-vif-unplugged-1beb8fcc-a604-4b25-8e50-63325edade24 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:52:20 user nova-compute[75176]: DEBUG nova.compute.manager [req-203fa6be-46e5-4768-81fc-8730aed6d605 req-63d35c13-1c43-45a4-a102-3b809270985b service nova] [instance: a6ebcc53-802a-4515-ba41-3e8e1129235f] Received event network-vif-unplugged-1beb8fcc-a604-4b25-8e50-63325edade24 for instance with task_state deleting. {{(pid=75176) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 15:52:20 user nova-compute[75176]: INFO nova.virt.libvirt.driver [-] [instance: a6ebcc53-802a-4515-ba41-3e8e1129235f] Instance destroyed successfully.
Nov 28 15:52:20 user nova-compute[75176]: DEBUG nova.objects.instance [None req-b70f5f64-7872-4c19-ad0b-97612c383acb tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Lazy-loading 'resources' on Instance uuid a6ebcc53-802a-4515-ba41-3e8e1129235f {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:52:20 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-b70f5f64-7872-4c19-ad0b-97612c383acb tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T15:47:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1971119919',display_name='tempest-TestMinimumBasicScenario-server-1971119919',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1971119919',id=25,image_ref='717fdded-f041-4509-a46a-c43a9760030f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPrHG5XKFRVI9bg17IWBz1s26wkAwdLQFgPmyk02mA0wQ4ISd3UFPcE0mNMthjYTq+NqvG2FgGKdnAgmzT19pfZn0CA/D+CpmY17NezaGKpfIuqLp9UpWLE39cYMVn+Vdw==',key_name='tempest-TestMinimumBasicScenario-118055100',keypairs=<?>,launch_index=0,launched_at=2023-11-28T15:47:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bc1dfeef484e4627a0061d9d36fd2b40',ramdisk_id='',reservation_id='r-sepa4lyv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='717fdded-f041-4509-a46a-c43a9760030f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-438096803',owner_user_name='tempest-TestMinimumBasicScenario-438096803-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T15:49:41Z,user_data=None,user_id='54766bbdce4346c0bd508451478b50aa',uuid=a6ebcc53-802a-4515-ba41-3e8e1129235f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1beb8fcc-a604-4b25-8e50-63325edade24", "address": "fa:16:3e:84:1e:fa", "network": {"id": "b06b85af-96d9-41cb-9ad2-7fc0523761e7", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-850315220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc1dfeef484e4627a0061d9d36fd2b40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1beb8fcc-a6", "ovs_interfaceid": "1beb8fcc-a604-4b25-8e50-63325edade24", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 15:52:20 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-b70f5f64-7872-4c19-ad0b-97612c383acb tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Converting VIF {"id": "1beb8fcc-a604-4b25-8e50-63325edade24", "address": "fa:16:3e:84:1e:fa", "network": {"id": "b06b85af-96d9-41cb-9ad2-7fc0523761e7", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-850315220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc1dfeef484e4627a0061d9d36fd2b40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1beb8fcc-a6", "ovs_interfaceid": "1beb8fcc-a604-4b25-8e50-63325edade24", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:52:20 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-b70f5f64-7872-4c19-ad0b-97612c383acb tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:84:1e:fa,bridge_name='br-int',has_traffic_filtering=True,id=1beb8fcc-a604-4b25-8e50-63325edade24,network=Network(b06b85af-96d9-41cb-9ad2-7fc0523761e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1beb8fcc-a6') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:52:20 user nova-compute[75176]: DEBUG os_vif [None req-b70f5f64-7872-4c19-ad0b-97612c383acb tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:84:1e:fa,bridge_name='br-int',has_traffic_filtering=True,id=1beb8fcc-a604-4b25-8e50-63325edade24,network=Network(b06b85af-96d9-41cb-9ad2-7fc0523761e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1beb8fcc-a6') {{(pid=75176) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 15:52:20 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:52:20 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1beb8fcc-a6, bridge=br-int, if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:52:20 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:52:20 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:52:20 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:52:20 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=972e4d69-4a8d-461f-ba27-0546d8b3bf2f) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:52:20 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:52:20 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:52:20 user nova-compute[75176]: INFO os_vif [None req-b70f5f64-7872-4c19-ad0b-97612c383acb tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:84:1e:fa,bridge_name='br-int',has_traffic_filtering=True,id=1beb8fcc-a604-4b25-8e50-63325edade24,network=Network(b06b85af-96d9-41cb-9ad2-7fc0523761e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1beb8fcc-a6')
Nov 28 15:52:20 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-b70f5f64-7872-4c19-ad0b-97612c383acb tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] [instance: a6ebcc53-802a-4515-ba41-3e8e1129235f] Deleting instance files /opt/stack/data/nova/instances/a6ebcc53-802a-4515-ba41-3e8e1129235f_del
Nov 28 15:52:20 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-b70f5f64-7872-4c19-ad0b-97612c383acb tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] [instance: a6ebcc53-802a-4515-ba41-3e8e1129235f] Deletion of /opt/stack/data/nova/instances/a6ebcc53-802a-4515-ba41-3e8e1129235f_del complete
Nov 28 15:52:20 user nova-compute[75176]: INFO nova.compute.manager [None req-b70f5f64-7872-4c19-ad0b-97612c383acb tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] [instance: a6ebcc53-802a-4515-ba41-3e8e1129235f] Took 0.93 seconds to destroy the instance on the hypervisor.
Nov 28 15:52:20 user nova-compute[75176]: DEBUG oslo.service.loopingcall [None req-b70f5f64-7872-4c19-ad0b-97612c383acb tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75176) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 15:52:20 user nova-compute[75176]: DEBUG nova.compute.manager [-] [instance: a6ebcc53-802a-4515-ba41-3e8e1129235f] Deallocating network for instance {{(pid=75176) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 15:52:20 user nova-compute[75176]: DEBUG nova.network.neutron [-] [instance: a6ebcc53-802a-4515-ba41-3e8e1129235f] deallocate_for_instance() {{(pid=75176) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 15:52:21 user nova-compute[75176]: DEBUG nova.network.neutron [-] [instance: a6ebcc53-802a-4515-ba41-3e8e1129235f] Updating instance_info_cache with network_info: [] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:52:21 user nova-compute[75176]: INFO nova.compute.manager [-] [instance: a6ebcc53-802a-4515-ba41-3e8e1129235f] Took 0.46 seconds to deallocate network for instance.
Nov 28 15:52:21 user nova-compute[75176]: DEBUG nova.compute.manager [req-7a541107-0672-49aa-922b-feb563ead8e2 req-a0d68642-5a7a-4a89-91d0-7c1d07565ba6 service nova] [instance: a6ebcc53-802a-4515-ba41-3e8e1129235f] Received event network-vif-deleted-1beb8fcc-a604-4b25-8e50-63325edade24 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:52:21 user nova-compute[75176]: INFO nova.compute.manager [req-7a541107-0672-49aa-922b-feb563ead8e2 req-a0d68642-5a7a-4a89-91d0-7c1d07565ba6 service nova] [instance: a6ebcc53-802a-4515-ba41-3e8e1129235f] Neutron deleted interface 1beb8fcc-a604-4b25-8e50-63325edade24; detaching it from the instance and deleting it from the info cache
Nov 28 15:52:21 user nova-compute[75176]: DEBUG nova.network.neutron [req-7a541107-0672-49aa-922b-feb563ead8e2 req-a0d68642-5a7a-4a89-91d0-7c1d07565ba6 service nova] [instance: a6ebcc53-802a-4515-ba41-3e8e1129235f] Updating instance_info_cache with network_info: [] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:52:21 user nova-compute[75176]: DEBUG nova.compute.manager [req-7a541107-0672-49aa-922b-feb563ead8e2 req-a0d68642-5a7a-4a89-91d0-7c1d07565ba6 service nova] [instance: a6ebcc53-802a-4515-ba41-3e8e1129235f] Detach interface failed, port_id=1beb8fcc-a604-4b25-8e50-63325edade24, reason: Instance a6ebcc53-802a-4515-ba41-3e8e1129235f could not be found. {{(pid=75176) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 28 15:52:21 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-b70f5f64-7872-4c19-ad0b-97612c383acb tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:52:21 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-b70f5f64-7872-4c19-ad0b-97612c383acb tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:52:21 user nova-compute[75176]: DEBUG nova.compute.provider_tree [None req-b70f5f64-7872-4c19-ad0b-97612c383acb tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Inventory has not changed in ProviderTree for provider: b37848d8-f401-4155-a029-b0ffa09ff85b {{(pid=75176) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 15:52:21 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-b70f5f64-7872-4c19-ad0b-97612c383acb tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Inventory has not changed for provider b37848d8-f401-4155-a029-b0ffa09ff85b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75176) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 15:52:21 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-b70f5f64-7872-4c19-ad0b-97612c383acb tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.356s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:52:21 user nova-compute[75176]: INFO nova.scheduler.client.report [None req-b70f5f64-7872-4c19-ad0b-97612c383acb tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Deleted allocations for instance a6ebcc53-802a-4515-ba41-3e8e1129235f
Nov 28 15:52:21 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-b70f5f64-7872-4c19-ad0b-97612c383acb tempest-TestMinimumBasicScenario-438096803 tempest-TestMinimumBasicScenario-438096803-project-member] Lock "a6ebcc53-802a-4515-ba41-3e8e1129235f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.950s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:52:22 user nova-compute[75176]: DEBUG nova.compute.manager [req-287f7cfd-adc1-4715-9032-1975f2a67f08 req-abdf7faa-cad8-4bad-856b-4d45e12fd7a9 service nova] [instance: a6ebcc53-802a-4515-ba41-3e8e1129235f] Received event network-vif-plugged-1beb8fcc-a604-4b25-8e50-63325edade24 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:52:22 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-287f7cfd-adc1-4715-9032-1975f2a67f08 req-abdf7faa-cad8-4bad-856b-4d45e12fd7a9 service nova] Acquiring lock "a6ebcc53-802a-4515-ba41-3e8e1129235f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:52:22 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-287f7cfd-adc1-4715-9032-1975f2a67f08 req-abdf7faa-cad8-4bad-856b-4d45e12fd7a9 service nova] Lock "a6ebcc53-802a-4515-ba41-3e8e1129235f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:52:22 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-287f7cfd-adc1-4715-9032-1975f2a67f08 req-abdf7faa-cad8-4bad-856b-4d45e12fd7a9 service nova] Lock "a6ebcc53-802a-4515-ba41-3e8e1129235f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:52:22 user nova-compute[75176]: DEBUG nova.compute.manager [req-287f7cfd-adc1-4715-9032-1975f2a67f08 req-abdf7faa-cad8-4bad-856b-4d45e12fd7a9 service nova] [instance: a6ebcc53-802a-4515-ba41-3e8e1129235f] No waiting events found dispatching network-vif-plugged-1beb8fcc-a604-4b25-8e50-63325edade24 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:52:22 user nova-compute[75176]: WARNING nova.compute.manager [req-287f7cfd-adc1-4715-9032-1975f2a67f08 req-abdf7faa-cad8-4bad-856b-4d45e12fd7a9 service nova] [instance: a6ebcc53-802a-4515-ba41-3e8e1129235f] Received unexpected event network-vif-plugged-1beb8fcc-a604-4b25-8e50-63325edade24 for instance with vm_state deleted and task_state None.
Nov 28 15:52:23 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-bfbf12f9-fd99-44c8-b287-edaeead988b9 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 0e465c9f-e8ab-4a28-bf74-2936a272a0e2 is timed out.
Nov 28 15:52:23 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-bfbf12f9-fd99-44c8-b287-edaeead988b9 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Successfully detached device vdc from instance 0e465c9f-e8ab-4a28-bf74-2936a272a0e2 from the live domain config.
Nov 28 15:52:23 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bfbf12f9-fd99-44c8-b287-edaeead988b9 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] [instance: 0e465c9f-e8ab-4a28-bf74-2936a272a0e2] calling os-brick to detach iSCSI Volume {{(pid=75176) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 15:52:23 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfbf12f9-fd99-44c8-b287-edaeead988b9 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c1b8a00>, {'target_iqn': 'iqn.2010-10.org.openstack:07de7953-293c-4762-b695-ed3190c934d5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tdMblYUX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 15:52:23 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-bfbf12f9-fd99-44c8-b287-edaeead988b9 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 15:52:23 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-bfbf12f9-fd99-44c8-b287-edaeead988b9 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 15:52:23 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-bfbf12f9-fd99-44c8-b287-edaeead988b9 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 15:52:23 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:52:23 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:52:23 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[71b3e00d-8223-40df-8805-4dd804a105b8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8452525c-6845-4edb-bf69-1e2ffe0ef2eb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:07de7953-293c-4762-b695-ed3190c934d5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:22933c6e-3d8f-44f5-bc41-dee97c587055\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:52:23 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfbf12f9-fd99-44c8-b287-edaeead988b9 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 15:52:23 user nova-compute[75176]: No targets found.
Nov 28 15:52:23 user nova-compute[75176]: iSNS:
Nov 28 15:52:23 user nova-compute[75176]: No targets found.
Nov 28 15:52:23 user nova-compute[75176]: STATIC:
Nov 28 15:52:23 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:8452525c-6845-4edb-bf69-1e2ffe0ef2eb
Nov 28 15:52:23 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:52:23 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:52:23 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6
Nov 28 15:52:23 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:52:23 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:52:23 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc
Nov 28 15:52:23 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:52:23 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:52:23 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:07de7953-293c-4762-b695-ed3190c934d5
Nov 28 15:52:23 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:52:23 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:52:23 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:22933c6e-3d8f-44f5-bc41-dee97c587055
Nov 28 15:52:23 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:52:23 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:52:23 user nova-compute[75176]: FIRMWARE:
Nov 28 15:52:23 user nova-compute[75176]: No targets found.
Nov 28 15:52:23 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:52:23 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfbf12f9-fd99-44c8-b287-edaeead988b9 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 15:52:23 user nova-compute[75176]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 15:52:23 user nova-compute[75176]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75176) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 15:52:23 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfbf12f9-fd99-44c8-b287-edaeead988b9 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:07de7953-293c-4762-b695-ed3190c934d5', 0)] {{(pid=75176) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 15:52:23 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:52:23 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:52:23 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[400b960e-912b-421a-b8f7-e454ff45a147]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:07de7953-293c-4762-b695-ed3190c934d5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:22933c6e-3d8f-44f5-bc41-dee97c587055\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8452525c-6845-4edb-bf69-1e2ffe0ef2eb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:52:23 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:52:23 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:52:23 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[1221e9e9-c2ba-471a-85db-1f7c4b5d2e4e]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8452525c-6845-4edb-bf69-1e2ffe0ef2eb (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07de7953-293c-4762-b695-ed3190c934d5 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22933c6e-3d8f-44f5-bc41-dee97c587055 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 (non-flash)\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:52:23 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfbf12f9-fd99-44c8-b287-edaeead988b9 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8452525c-6845-4edb-bf69-1e2ffe0ef2eb (non-flash)
Nov 28 15:52:23 user nova-compute[75176]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07de7953-293c-4762-b695-ed3190c934d5 (non-flash)
Nov 28 15:52:23 user nova-compute[75176]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc (non-flash)
Nov 28 15:52:23 user nova-compute[75176]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22933c6e-3d8f-44f5-bc41-dee97c587055 (non-flash)
Nov 28 15:52:23 user nova-compute[75176]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 (non-flash)
Nov 28 15:52:23 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:52:23 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfbf12f9-fd99-44c8-b287-edaeead988b9 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8452525c-6845-4edb-bf69-1e2ffe0ef2eb (non-flash)
Nov 28 15:52:23 user nova-compute[75176]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07de7953-293c-4762-b695-ed3190c934d5 (non-flash)
Nov 28 15:52:23 user nova-compute[75176]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc (non-flash)
Nov 28 15:52:23 user nova-compute[75176]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22933c6e-3d8f-44f5-bc41-dee97c587055 (non-flash)
Nov 28 15:52:23 user nova-compute[75176]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 (non-flash)
Nov 28 15:52:23 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 15:52:23 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfbf12f9-fd99-44c8-b287-edaeead988b9 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f464c0860e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:07de7953-293c-4762-b695-ed3190c934d5'): ({'sdf'}, set())}) {{(pid=75176) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 15:52:23 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-bfbf12f9-fd99-44c8-b287-edaeead988b9 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Removing single pathed devices sdf {{(pid=75176) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 15:52:23 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:52:23 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:52:23 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8fb7fce-26a8-4661-afe8-029fb5641937]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:52:23 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:52:23 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:52:23 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[89328eaa-5031-41e5-bb6a-5138fce27af4]: (4, ('ok\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:52:23 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-bfbf12f9-fd99-44c8-b287-edaeead988b9 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Flushing IO for device /dev/sdf {{(pid=75176) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 15:52:23 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:52:23 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:52:23 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[36e9f3f1-676d-4cb8-8d4d-cbed103d63fe]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:52:23 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-bfbf12f9-fd99-44c8-b287-edaeead988b9 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75176) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 15:52:23 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:52:23 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.050s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:52:23 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[daa4d2c9-2be8-49da-ba06-b06a1dc8b65e]: (4, ('1', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:52:23 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-bfbf12f9-fd99-44c8-b287-edaeead988b9 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75176) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 15:52:23 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-bfbf12f9-fd99-44c8-b287-edaeead988b9 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] SCSI volumes sdf have been removed. {{(pid=75176) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 15:52:23 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfbf12f9-fd99-44c8-b287-edaeead988b9 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:07de7953-293c-4762-b695-ed3190c934d5')] {{(pid=75176) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 15:52:23 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07de7953-293c-4762-b695-ed3190c934d5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:52:23 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07de7953-293c-4762-b695-ed3190c934d5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:52:23 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[5526438e-d9d4-444f-af32-0ce634f68f97]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:52:23 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfbf12f9-fd99-44c8-b287-edaeead988b9 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:52:23 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07de7953-293c-4762-b695-ed3190c934d5 -p 172.16.0.220:3260 --logout {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:52:23 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07de7953-293c-4762-b695-ed3190c934d5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:52:23 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[31437f9a-f969-42ab-8ffd-926eddc269a2]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:07de7953-293c-4762-b695-ed3190c934d5, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:07de7953-293c-4762-b695-ed3190c934d5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:52:23 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfbf12f9-fd99-44c8-b287-edaeead988b9 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:07de7953-293c-4762-b695-ed3190c934d5, portal: 172.16.0.220,3260]
Nov 28 15:52:23 user nova-compute[75176]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:07de7953-293c-4762-b695-ed3190c934d5, portal: 172.16.0.220,3260] successful.
Nov 28 15:52:23 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:52:23 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07de7953-293c-4762-b695-ed3190c934d5 -p 172.16.0.220:3260 --op delete {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:52:23 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07de7953-293c-4762-b695-ed3190c934d5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:52:23 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff696e1a-4c83-486d-a5e6-a9be26f3c6b3]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:52:23 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfbf12f9-fd99-44c8-b287-edaeead988b9 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:52:23 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-bfbf12f9-fd99-44c8-b287-edaeead988b9 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.331s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 15:52:23 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfbf12f9-fd99-44c8-b287-edaeead988b9 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] <== disconnect_volume: return (333ms) None {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 15:52:23 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bfbf12f9-fd99-44c8-b287-edaeead988b9 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] [instance: 0e465c9f-e8ab-4a28-bf74-2936a272a0e2] Disconnected iSCSI Volume {{(pid=75176) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 15:52:24 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:52:24 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:52:24 user nova-compute[75176]: DEBUG nova.objects.instance [None req-bfbf12f9-fd99-44c8-b287-edaeead988b9 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Lazy-loading 'flavor' on Instance uuid 0e465c9f-e8ab-4a28-bf74-2936a272a0e2 {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:52:24 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-bfbf12f9-fd99-44c8-b287-edaeead988b9 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Lock "0e465c9f-e8ab-4a28-bf74-2936a272a0e2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.864s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:52:25 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:52:26 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:52:29 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:52:29 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:52:30 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:52:30 user nova-compute[75176]: DEBUG nova.compute.manager [req-a83ebeee-f0a2-4651-8f5c-8d54620b3e63 req-33e22eae-d690-4cb6-9985-217f489390b1 service nova] [instance: 2e8507b7-fccf-4196-b589-bf2b74f165ec] Received event network-changed-3dc67fc3-7fcf-4655-8dbd-22febf2be39e {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:52:30 user nova-compute[75176]: DEBUG nova.compute.manager [req-a83ebeee-f0a2-4651-8f5c-8d54620b3e63 req-33e22eae-d690-4cb6-9985-217f489390b1 service nova] [instance: 2e8507b7-fccf-4196-b589-bf2b74f165ec] Refreshing instance network info cache due to event network-changed-3dc67fc3-7fcf-4655-8dbd-22febf2be39e. {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 15:52:30 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-a83ebeee-f0a2-4651-8f5c-8d54620b3e63 req-33e22eae-d690-4cb6-9985-217f489390b1 service nova] Acquiring lock "refresh_cache-2e8507b7-fccf-4196-b589-bf2b74f165ec" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:52:30 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-a83ebeee-f0a2-4651-8f5c-8d54620b3e63 req-33e22eae-d690-4cb6-9985-217f489390b1 service nova] Acquired lock "refresh_cache-2e8507b7-fccf-4196-b589-bf2b74f165ec" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:52:30 user nova-compute[75176]: DEBUG nova.network.neutron [req-a83ebeee-f0a2-4651-8f5c-8d54620b3e63 req-33e22eae-d690-4cb6-9985-217f489390b1 service nova] [instance: 2e8507b7-fccf-4196-b589-bf2b74f165ec] Refreshing network info cache for port 3dc67fc3-7fcf-4655-8dbd-22febf2be39e {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 15:52:31 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:52:32 user nova-compute[75176]: DEBUG nova.network.neutron [req-a83ebeee-f0a2-4651-8f5c-8d54620b3e63 req-33e22eae-d690-4cb6-9985-217f489390b1 service nova] [instance: 2e8507b7-fccf-4196-b589-bf2b74f165ec] Updated VIF entry in instance network info cache for port 3dc67fc3-7fcf-4655-8dbd-22febf2be39e. {{(pid=75176) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 15:52:32 user nova-compute[75176]: DEBUG nova.network.neutron [req-a83ebeee-f0a2-4651-8f5c-8d54620b3e63 req-33e22eae-d690-4cb6-9985-217f489390b1 service nova] [instance: 2e8507b7-fccf-4196-b589-bf2b74f165ec] Updating instance_info_cache with network_info: [{"id": "3dc67fc3-7fcf-4655-8dbd-22febf2be39e", "address": "fa:16:3e:04:68:53", "network": {"id": "8b63f2d3-0683-4832-abc5-e4c796cf12ab", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-877608435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3704b38a2bd44cb78c28d3f6d86d9e60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dc67fc3-7f", "ovs_interfaceid": "3dc67fc3-7fcf-4655-8dbd-22febf2be39e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:52:32 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-a83ebeee-f0a2-4651-8f5c-8d54620b3e63 req-33e22eae-d690-4cb6-9985-217f489390b1 service nova] Releasing lock "refresh_cache-2e8507b7-fccf-4196-b589-bf2b74f165ec" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:52:33 user nova-compute[75176]: DEBUG nova.compute.manager [req-f2e3bae7-548f-4078-8d87-ed1d026701d7 req-cac149f8-d1dc-4849-a227-4055beca74be service nova] [instance: 6161cab2-eb1f-44cb-bbd5-077e6db42f77] Received event network-changed-f2811544-4cf2-4302-b012-8bf1881b9b6c {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:52:33 user nova-compute[75176]: DEBUG nova.compute.manager [req-f2e3bae7-548f-4078-8d87-ed1d026701d7 req-cac149f8-d1dc-4849-a227-4055beca74be service nova] [instance: 6161cab2-eb1f-44cb-bbd5-077e6db42f77] Refreshing instance network info cache due to event network-changed-f2811544-4cf2-4302-b012-8bf1881b9b6c. {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 15:52:33 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-f2e3bae7-548f-4078-8d87-ed1d026701d7 req-cac149f8-d1dc-4849-a227-4055beca74be service nova] Acquiring lock "refresh_cache-6161cab2-eb1f-44cb-bbd5-077e6db42f77" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:52:33 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-f2e3bae7-548f-4078-8d87-ed1d026701d7 req-cac149f8-d1dc-4849-a227-4055beca74be service nova] Acquired lock "refresh_cache-6161cab2-eb1f-44cb-bbd5-077e6db42f77" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:52:33 user nova-compute[75176]: DEBUG nova.network.neutron [req-f2e3bae7-548f-4078-8d87-ed1d026701d7 req-cac149f8-d1dc-4849-a227-4055beca74be service nova] [instance: 6161cab2-eb1f-44cb-bbd5-077e6db42f77] Refreshing network info cache for port f2811544-4cf2-4302-b012-8bf1881b9b6c {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 15:52:33 user nova-compute[75176]: DEBUG nova.network.neutron [req-f2e3bae7-548f-4078-8d87-ed1d026701d7 req-cac149f8-d1dc-4849-a227-4055beca74be service nova] [instance: 6161cab2-eb1f-44cb-bbd5-077e6db42f77] Updated VIF entry in instance network info cache for port f2811544-4cf2-4302-b012-8bf1881b9b6c. {{(pid=75176) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 15:52:33 user nova-compute[75176]: DEBUG nova.network.neutron [req-f2e3bae7-548f-4078-8d87-ed1d026701d7 req-cac149f8-d1dc-4849-a227-4055beca74be service nova] [instance: 6161cab2-eb1f-44cb-bbd5-077e6db42f77] Updating instance_info_cache with network_info: [{"id": "f2811544-4cf2-4302-b012-8bf1881b9b6c", "address": "fa:16:3e:2a:df:42", "network": {"id": "8b63f2d3-0683-4832-abc5-e4c796cf12ab", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-877608435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3704b38a2bd44cb78c28d3f6d86d9e60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2811544-4c", "ovs_interfaceid": "f2811544-4cf2-4302-b012-8bf1881b9b6c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:52:33 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-f2e3bae7-548f-4078-8d87-ed1d026701d7 req-cac149f8-d1dc-4849-a227-4055beca74be service nova] Releasing lock "refresh_cache-6161cab2-eb1f-44cb-bbd5-077e6db42f77" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:52:33 user nova-compute[75176]: DEBUG nova.compute.manager [None req-3494fde8-2f23-4569-b8ef-621d14f2b0d7 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] [instance: 6161cab2-eb1f-44cb-bbd5-077e6db42f77] Stashing vm_state: active {{(pid=75176) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 28 15:52:33 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-3494fde8-2f23-4569-b8ef-621d14f2b0d7 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:52:33 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-3494fde8-2f23-4569-b8ef-621d14f2b0d7 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:52:33 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-3494fde8-2f23-4569-b8ef-621d14f2b0d7 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75176) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 15:52:33 user nova-compute[75176]: INFO nova.compute.claims [None req-3494fde8-2f23-4569-b8ef-621d14f2b0d7 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] [instance: 6161cab2-eb1f-44cb-bbd5-077e6db42f77] Claim successful on node user
Nov 28 15:52:33 user nova-compute[75176]: INFO nova.compute.resource_tracker [None req-3494fde8-2f23-4569-b8ef-621d14f2b0d7 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] [instance: 6161cab2-eb1f-44cb-bbd5-077e6db42f77] Updating resource usage from migration 23477e3c-9f13-4dc8-9ae1-cce32657b62b
Nov 28 15:52:34 user nova-compute[75176]: DEBUG nova.compute.provider_tree [None req-3494fde8-2f23-4569-b8ef-621d14f2b0d7 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Inventory has not changed in ProviderTree for provider: b37848d8-f401-4155-a029-b0ffa09ff85b {{(pid=75176) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 15:52:34 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-3494fde8-2f23-4569-b8ef-621d14f2b0d7 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Inventory has not changed for provider b37848d8-f401-4155-a029-b0ffa09ff85b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75176) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 15:52:34 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-3494fde8-2f23-4569-b8ef-621d14f2b0d7 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.529s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:52:34 user nova-compute[75176]: INFO nova.compute.manager [None req-3494fde8-2f23-4569-b8ef-621d14f2b0d7 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] [instance: 6161cab2-eb1f-44cb-bbd5-077e6db42f77] Migrating
Nov 28 15:52:34 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-3494fde8-2f23-4569-b8ef-621d14f2b0d7 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Acquiring lock "refresh_cache-6161cab2-eb1f-44cb-bbd5-077e6db42f77" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:52:34 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-3494fde8-2f23-4569-b8ef-621d14f2b0d7 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Acquired lock "refresh_cache-6161cab2-eb1f-44cb-bbd5-077e6db42f77" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:52:34 user nova-compute[75176]: DEBUG nova.network.neutron [None req-3494fde8-2f23-4569-b8ef-621d14f2b0d7 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] [instance: 6161cab2-eb1f-44cb-bbd5-077e6db42f77] Building network info cache for instance {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 15:52:34 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:52:34 user nova-compute[75176]: DEBUG nova.network.neutron [None req-3494fde8-2f23-4569-b8ef-621d14f2b0d7 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] [instance: 6161cab2-eb1f-44cb-bbd5-077e6db42f77] Updating instance_info_cache with network_info: [{"id": "f2811544-4cf2-4302-b012-8bf1881b9b6c", "address": "fa:16:3e:2a:df:42", "network": {"id": "8b63f2d3-0683-4832-abc5-e4c796cf12ab", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-877608435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3704b38a2bd44cb78c28d3f6d86d9e60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2811544-4c", "ovs_interfaceid": "f2811544-4cf2-4302-b012-8bf1881b9b6c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:52:34 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-3494fde8-2f23-4569-b8ef-621d14f2b0d7 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Releasing lock "refresh_cache-6161cab2-eb1f-44cb-bbd5-077e6db42f77" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:52:34 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-3494fde8-2f23-4569-b8ef-621d14f2b0d7 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] [instance: 6161cab2-eb1f-44cb-bbd5-077e6db42f77] Starting migrate_disk_and_power_off {{(pid=75176) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11484}}
Nov 28 15:52:34 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:52:34 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:52:35 user nova-compute[75176]: DEBUG nova.compute.manager [req-4ffef708-ab75-4279-97e0-ecc6d948b466 req-c317cb1e-ded7-4db4-8b0e-3c3a5c9f19d7 service nova] [instance: 6161cab2-eb1f-44cb-bbd5-077e6db42f77] Received event network-vif-unplugged-f2811544-4cf2-4302-b012-8bf1881b9b6c {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:52:35 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-4ffef708-ab75-4279-97e0-ecc6d948b466 req-c317cb1e-ded7-4db4-8b0e-3c3a5c9f19d7 service nova] Acquiring lock "6161cab2-eb1f-44cb-bbd5-077e6db42f77-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:52:35 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-4ffef708-ab75-4279-97e0-ecc6d948b466 req-c317cb1e-ded7-4db4-8b0e-3c3a5c9f19d7 service nova] Lock "6161cab2-eb1f-44cb-bbd5-077e6db42f77-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:52:35 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-4ffef708-ab75-4279-97e0-ecc6d948b466 req-c317cb1e-ded7-4db4-8b0e-3c3a5c9f19d7 service nova] Lock "6161cab2-eb1f-44cb-bbd5-077e6db42f77-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:52:35 user nova-compute[75176]: DEBUG nova.compute.manager [req-4ffef708-ab75-4279-97e0-ecc6d948b466 req-c317cb1e-ded7-4db4-8b0e-3c3a5c9f19d7 service nova] [instance: 6161cab2-eb1f-44cb-bbd5-077e6db42f77] No waiting events found dispatching network-vif-unplugged-f2811544-4cf2-4302-b012-8bf1881b9b6c {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:52:35 user nova-compute[75176]: WARNING nova.compute.manager [req-4ffef708-ab75-4279-97e0-ecc6d948b466 req-c317cb1e-ded7-4db4-8b0e-3c3a5c9f19d7 service nova] [instance: 6161cab2-eb1f-44cb-bbd5-077e6db42f77] Received unexpected event network-vif-unplugged-f2811544-4cf2-4302-b012-8bf1881b9b6c for instance with vm_state active and task_state resize_migrating.
Nov 28 15:52:35 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:52:35 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:52:35 user nova-compute[75176]: INFO nova.virt.libvirt.driver [-] [instance: 6161cab2-eb1f-44cb-bbd5-077e6db42f77] Instance destroyed successfully.
Nov 28 15:52:35 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-3494fde8-2f23-4569-b8ef-621d14f2b0d7 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T15:50:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-572538979',display_name='tempest-ServerActionsTestOtherA-server-572538979',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-572538979',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOMWl0O1/eKbWND/zyjGraAKxeAyZ2R2+QgHiQ80zmzsi5uDkOgtIp8e2HjbFwlKUWmHgZppW6LnrIueD7TS7l/EkNAyCl7Y/pD0TSC3H7ZDLxYbZaFDAxH/uT7EnME+ig==',key_name='tempest-keypair-740685341',keypairs=<?>,launch_index=0,launched_at=2023-11-28T15:50:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3704b38a2bd44cb78c28d3f6d86d9e60',ramdisk_id='',reservation_id='r-s3c8yj7d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-680502445',owner_user_name='tempest-ServerActionsTestOtherA-680502445-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T15:52:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d028b79a105b485dbb0178c9da162640',uuid=6161cab2-eb1f-44cb-bbd5-077e6db42f77,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f2811544-4cf2-4302-b012-8bf1881b9b6c", "address": "fa:16:3e:2a:df:42", "network": {"id": "8b63f2d3-0683-4832-abc5-e4c796cf12ab", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-877608435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-877608435-network", "vif_mac": "fa:16:3e:2a:df:42"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3704b38a2bd44cb78c28d3f6d86d9e60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2811544-4c", "ovs_interfaceid": "f2811544-4cf2-4302-b012-8bf1881b9b6c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 15:52:35 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-3494fde8-2f23-4569-b8ef-621d14f2b0d7 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Converting VIF {"id": "f2811544-4cf2-4302-b012-8bf1881b9b6c", "address": "fa:16:3e:2a:df:42", "network": {"id": "8b63f2d3-0683-4832-abc5-e4c796cf12ab", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-877608435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-877608435-network", "vif_mac": "fa:16:3e:2a:df:42"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3704b38a2bd44cb78c28d3f6d86d9e60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2811544-4c", "ovs_interfaceid": "f2811544-4cf2-4302-b012-8bf1881b9b6c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:52:35 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-3494fde8-2f23-4569-b8ef-621d14f2b0d7 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2a:df:42,bridge_name='br-int',has_traffic_filtering=True,id=f2811544-4cf2-4302-b012-8bf1881b9b6c,network=Network(8b63f2d3-0683-4832-abc5-e4c796cf12ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2811544-4c') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:52:35 user nova-compute[75176]: DEBUG os_vif [None req-3494fde8-2f23-4569-b8ef-621d14f2b0d7 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2a:df:42,bridge_name='br-int',has_traffic_filtering=True,id=f2811544-4cf2-4302-b012-8bf1881b9b6c,network=Network(8b63f2d3-0683-4832-abc5-e4c796cf12ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2811544-4c') {{(pid=75176) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 15:52:35 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:52:35 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf2811544-4c, bridge=br-int, if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:52:35 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:52:35 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:52:35 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:52:35 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=acc97370-5cd9-4149-8553-898f52578a5d) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:52:35 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:52:35 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:52:35 user nova-compute[75176]: INFO os_vif [None req-3494fde8-2f23-4569-b8ef-621d14f2b0d7 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2a:df:42,bridge_name='br-int',has_traffic_filtering=True,id=f2811544-4cf2-4302-b012-8bf1881b9b6c,network=Network(8b63f2d3-0683-4832-abc5-e4c796cf12ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2811544-4c')
Nov 28 15:52:35 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3494fde8-2f23-4569-b8ef-621d14f2b0d7 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] [instance: 6161cab2-eb1f-44cb-bbd5-077e6db42f77] calling os-brick to detach iSCSI Volume {{(pid=75176) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 15:52:35 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-3494fde8-2f23-4569-b8ef-621d14f2b0d7 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c1b8a00>, {'target_iqn': 'iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zMZSixul', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 15:52:35 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-3494fde8-2f23-4569-b8ef-621d14f2b0d7 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 15:52:35 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-3494fde8-2f23-4569-b8ef-621d14f2b0d7 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 15:52:35 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-3494fde8-2f23-4569-b8ef-621d14f2b0d7 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 15:52:35 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:52:35 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:52:35 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[08edc258-091e-4780-b145-cbc508bdaf11]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8452525c-6845-4edb-bf69-1e2ffe0ef2eb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:22933c6e-3d8f-44f5-bc41-dee97c587055\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:52:35 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-3494fde8-2f23-4569-b8ef-621d14f2b0d7 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 15:52:35 user nova-compute[75176]: No targets found.
Nov 28 15:52:35 user nova-compute[75176]: iSNS:
Nov 28 15:52:35 user nova-compute[75176]: No targets found.
Nov 28 15:52:35 user nova-compute[75176]: STATIC:
Nov 28 15:52:35 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:8452525c-6845-4edb-bf69-1e2ffe0ef2eb
Nov 28 15:52:35 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:52:35 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:52:35 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6
Nov 28 15:52:35 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:52:35 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:52:35 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc
Nov 28 15:52:35 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:52:35 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:52:35 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:22933c6e-3d8f-44f5-bc41-dee97c587055
Nov 28 15:52:35 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:52:35 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:52:35 user nova-compute[75176]: FIRMWARE:
Nov 28 15:52:35 user nova-compute[75176]: No targets found.
Nov 28 15:52:35 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:52:35 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-3494fde8-2f23-4569-b8ef-621d14f2b0d7 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 15:52:35 user nova-compute[75176]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 15:52:35 user nova-compute[75176]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75176) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 15:52:35 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-3494fde8-2f23-4569-b8ef-621d14f2b0d7 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc', 0)] {{(pid=75176) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 15:52:35 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:52:35 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:52:35 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[604f6cda-5996-4e7d-8240-bbebc6f6b756]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:22933c6e-3d8f-44f5-bc41-dee97c587055\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8452525c-6845-4edb-bf69-1e2ffe0ef2eb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:52:35 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:52:35 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:52:35 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[5367b869-011d-4cc0-87c6-a1210e90cd2e]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8452525c-6845-4edb-bf69-1e2ffe0ef2eb (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22933c6e-3d8f-44f5-bc41-dee97c587055 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 (non-flash)\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:52:35 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-3494fde8-2f23-4569-b8ef-621d14f2b0d7 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8452525c-6845-4edb-bf69-1e2ffe0ef2eb (non-flash)
Nov 28 15:52:35 user nova-compute[75176]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc (non-flash)
Nov 28 15:52:35 user nova-compute[75176]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22933c6e-3d8f-44f5-bc41-dee97c587055 (non-flash)
Nov 28 15:52:35 user nova-compute[75176]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 (non-flash)
Nov 28 15:52:35 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:52:35 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-3494fde8-2f23-4569-b8ef-621d14f2b0d7 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8452525c-6845-4edb-bf69-1e2ffe0ef2eb (non-flash)
Nov 28 15:52:35 user nova-compute[75176]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc (non-flash)
Nov 28 15:52:35 user nova-compute[75176]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22933c6e-3d8f-44f5-bc41-dee97c587055 (non-flash)
Nov 28 15:52:35 user nova-compute[75176]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 (non-flash)
Nov 28 15:52:35 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 15:52:35 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-3494fde8-2f23-4569-b8ef-621d14f2b0d7 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f464c085b40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc'): ({'sdg'}, set())}) {{(pid=75176) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 15:52:35 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-3494fde8-2f23-4569-b8ef-621d14f2b0d7 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Removing single pathed devices sdg {{(pid=75176) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 15:52:35 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:52:35 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:52:35 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a2663d8-deba-4524-b4ee-b7d844a423dd]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:52:35 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:52:35 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.021s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:52:35 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bf16fbe-d985-438e-983a-296bbbba2a75]: (4, ('ok\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:52:35 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-3494fde8-2f23-4569-b8ef-621d14f2b0d7 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Flushing IO for device /dev/sdg {{(pid=75176) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 15:52:35 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:52:35 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.013s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:52:35 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3b4fdda-71f7-4879-9ee9-5a5a079d020c]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:52:35 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-3494fde8-2f23-4569-b8ef-621d14f2b0d7 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75176) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 15:52:35 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:52:35 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-e6b9b6a1-d5b7-4685-a47b-620f759ae894 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] Acquiring lock "742bfe1e-6885-4aba-9f7f-c07a5d904175" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:52:35 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-e6b9b6a1-d5b7-4685-a47b-620f759ae894 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] Lock "742bfe1e-6885-4aba-9f7f-c07a5d904175" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:52:35 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.049s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:52:35 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[4961751a-5952-4ac7-8dc3-994634959d23]: (4, ('1', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:52:35 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-3494fde8-2f23-4569-b8ef-621d14f2b0d7 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75176) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 15:52:35 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-3494fde8-2f23-4569-b8ef-621d14f2b0d7 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] SCSI volumes sdg have been removed. {{(pid=75176) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 15:52:35 user nova-compute[75176]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO8903fc9b-28fbbc77aac0ae57', '/dev/disk/by-id/scsi-23238666262633737', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_8903fc9b') {{(pid=85736) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 28 15:52:35 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[359cbf86-8354-4321-95a7-fd8944dc1b2a]: (4, None) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:52:35 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-3494fde8-2f23-4569-b8ef-621d14f2b0d7 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc')] {{(pid=75176) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 15:52:35 user nova-compute[75176]: DEBUG nova.compute.manager [None req-e6b9b6a1-d5b7-4685-a47b-620f759ae894 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] [instance: 742bfe1e-6885-4aba-9f7f-c07a5d904175] Starting instance... {{(pid=75176) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 15:52:35 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:52:35 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:52:35 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bea9fc0-f70a-4bee-8cea-ee497b02a446]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:52:35 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-3494fde8-2f23-4569-b8ef-621d14f2b0d7 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:52:35 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc -p 172.16.0.220:3260 --logout {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:52:35 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:52:35 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f41e65d-c8f0-4a0d-bf07-c73c527fe4c8]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:52:35 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-3494fde8-2f23-4569-b8ef-621d14f2b0d7 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc, portal: 172.16.0.220,3260]
Nov 28 15:52:35 user nova-compute[75176]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc, portal: 172.16.0.220,3260] successful.
Nov 28 15:52:35 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:52:35 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc -p 172.16.0.220:3260 --op delete {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:52:35 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:52:35 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[22b623e5-139b-4466-a01a-e73d7ce08d7f]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:52:35 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-3494fde8-2f23-4569-b8ef-621d14f2b0d7 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:52:35 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-3494fde8-2f23-4569-b8ef-621d14f2b0d7 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.361s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 15:52:35 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-3494fde8-2f23-4569-b8ef-621d14f2b0d7 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] <== disconnect_volume: return (362ms) None {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 15:52:35 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3494fde8-2f23-4569-b8ef-621d14f2b0d7 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] [instance: 6161cab2-eb1f-44cb-bbd5-077e6db42f77] Disconnected iSCSI Volume {{(pid=75176) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 15:52:35 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-e6b9b6a1-d5b7-4685-a47b-620f759ae894 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:52:35 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-e6b9b6a1-d5b7-4685-a47b-620f759ae894 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:52:35 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-3494fde8-2f23-4569-b8ef-621d14f2b0d7 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] skipping disk /dev/sdg (vda) as it is a volume {{(pid=75176) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 15:52:35 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-e6b9b6a1-d5b7-4685-a47b-620f759ae894 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75176) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 15:52:35 user nova-compute[75176]: INFO nova.compute.claims [None req-e6b9b6a1-d5b7-4685-a47b-620f759ae894 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] [instance: 742bfe1e-6885-4aba-9f7f-c07a5d904175] Claim successful on node user
Nov 28 15:52:36 user nova-compute[75176]: DEBUG nova.compute.provider_tree [None req-e6b9b6a1-d5b7-4685-a47b-620f759ae894 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] Inventory has not changed in ProviderTree for provider: b37848d8-f401-4155-a029-b0ffa09ff85b {{(pid=75176) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 15:52:36 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-e6b9b6a1-d5b7-4685-a47b-620f759ae894 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] Inventory has not changed for provider b37848d8-f401-4155-a029-b0ffa09ff85b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75176) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 15:52:36 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-e6b9b6a1-d5b7-4685-a47b-620f759ae894 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.469s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:52:36 user nova-compute[75176]: DEBUG nova.compute.manager [None req-e6b9b6a1-d5b7-4685-a47b-620f759ae894 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] [instance: 742bfe1e-6885-4aba-9f7f-c07a5d904175] Start building networks asynchronously for instance. {{(pid=75176) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 15:52:36 user nova-compute[75176]: DEBUG nova.compute.manager [None req-e6b9b6a1-d5b7-4685-a47b-620f759ae894 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] [instance: 742bfe1e-6885-4aba-9f7f-c07a5d904175] Allocating IP information in the background. {{(pid=75176) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 15:52:36 user nova-compute[75176]: DEBUG nova.network.neutron [None req-e6b9b6a1-d5b7-4685-a47b-620f759ae894 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] [instance: 742bfe1e-6885-4aba-9f7f-c07a5d904175] allocate_for_instance() {{(pid=75176) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 15:52:36 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-e6b9b6a1-d5b7-4685-a47b-620f759ae894 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] [instance: 742bfe1e-6885-4aba-9f7f-c07a5d904175] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 15:52:36 user nova-compute[75176]: DEBUG nova.compute.manager [None req-e6b9b6a1-d5b7-4685-a47b-620f759ae894 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] [instance: 742bfe1e-6885-4aba-9f7f-c07a5d904175] Start building block device mappings for instance. {{(pid=75176) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 15:52:36 user nova-compute[75176]: DEBUG nova.policy [None req-e6b9b6a1-d5b7-4685-a47b-620f759ae894 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0ba38ecd6e8f440cbad7d11e95de1e62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8967023e58840afa09d5959d29a0285', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75176) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 15:52:36 user nova-compute[75176]: DEBUG nova.compute.manager [None req-e6b9b6a1-d5b7-4685-a47b-620f759ae894 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] [instance: 742bfe1e-6885-4aba-9f7f-c07a5d904175] Start spawning the instance on the hypervisor. {{(pid=75176) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 15:52:36 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-e6b9b6a1-d5b7-4685-a47b-620f759ae894 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] [instance: 742bfe1e-6885-4aba-9f7f-c07a5d904175] Creating instance directory {{(pid=75176) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 15:52:36 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-e6b9b6a1-d5b7-4685-a47b-620f759ae894 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] [instance: 742bfe1e-6885-4aba-9f7f-c07a5d904175] Creating image(s)
Nov 28 15:52:36 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-e6b9b6a1-d5b7-4685-a47b-620f759ae894 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] Acquiring lock "/opt/stack/data/nova/instances/742bfe1e-6885-4aba-9f7f-c07a5d904175/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:52:36 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-e6b9b6a1-d5b7-4685-a47b-620f759ae894 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] Lock "/opt/stack/data/nova/instances/742bfe1e-6885-4aba-9f7f-c07a5d904175/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:52:36 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-e6b9b6a1-d5b7-4685-a47b-620f759ae894 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] Lock "/opt/stack/data/nova/instances/742bfe1e-6885-4aba-9f7f-c07a5d904175/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:52:36 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-e6b9b6a1-d5b7-4685-a47b-620f759ae894 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:52:36 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-e6b9b6a1-d5b7-4685-a47b-620f759ae894 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json" returned: 0 in 0.179s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:52:36 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-e6b9b6a1-d5b7-4685-a47b-620f759ae894 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] Acquiring lock "5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:52:36 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-e6b9b6a1-d5b7-4685-a47b-620f759ae894 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] Lock "5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:52:36 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-e6b9b6a1-d5b7-4685-a47b-620f759ae894 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:52:37 user nova-compute[75176]: DEBUG nova.network.neutron [None req-3494fde8-2f23-4569-b8ef-621d14f2b0d7 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] [instance: 6161cab2-eb1f-44cb-bbd5-077e6db42f77] Port f2811544-4cf2-4302-b012-8bf1881b9b6c binding to destination host user is already ACTIVE {{(pid=75176) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 28 15:52:37 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-e6b9b6a1-d5b7-4685-a47b-620f759ae894 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json" returned: 0 in 0.184s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:52:37 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-e6b9b6a1-d5b7-4685-a47b-620f759ae894 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2,backing_fmt=raw /opt/stack/data/nova/instances/742bfe1e-6885-4aba-9f7f-c07a5d904175/disk 1073741824 {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:52:37 user nova-compute[75176]: DEBUG nova.compute.manager [req-fa50669b-89f8-4675-aa13-aeb05c55ac94 req-85bcb59a-2e7a-4f3f-bf23-dc43c751a55f service nova] [instance: 6161cab2-eb1f-44cb-bbd5-077e6db42f77] Received event network-vif-plugged-f2811544-4cf2-4302-b012-8bf1881b9b6c {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:52:37 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-fa50669b-89f8-4675-aa13-aeb05c55ac94 req-85bcb59a-2e7a-4f3f-bf23-dc43c751a55f service nova] Acquiring lock "6161cab2-eb1f-44cb-bbd5-077e6db42f77-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:52:37 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-fa50669b-89f8-4675-aa13-aeb05c55ac94 req-85bcb59a-2e7a-4f3f-bf23-dc43c751a55f service nova] Lock "6161cab2-eb1f-44cb-bbd5-077e6db42f77-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:52:37 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-fa50669b-89f8-4675-aa13-aeb05c55ac94 req-85bcb59a-2e7a-4f3f-bf23-dc43c751a55f service nova] Lock "6161cab2-eb1f-44cb-bbd5-077e6db42f77-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:52:37 user nova-compute[75176]: DEBUG nova.compute.manager [req-fa50669b-89f8-4675-aa13-aeb05c55ac94 req-85bcb59a-2e7a-4f3f-bf23-dc43c751a55f service nova] [instance: 6161cab2-eb1f-44cb-bbd5-077e6db42f77] No waiting events found dispatching network-vif-plugged-f2811544-4cf2-4302-b012-8bf1881b9b6c {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:52:37 user nova-compute[75176]: WARNING nova.compute.manager [req-fa50669b-89f8-4675-aa13-aeb05c55ac94 req-85bcb59a-2e7a-4f3f-bf23-dc43c751a55f service nova] [instance: 6161cab2-eb1f-44cb-bbd5-077e6db42f77] Received unexpected event network-vif-plugged-f2811544-4cf2-4302-b012-8bf1881b9b6c for instance with vm_state active and task_state resize_migrating.
Nov 28 15:52:37 user nova-compute[75176]: DEBUG nova.network.neutron [None req-e6b9b6a1-d5b7-4685-a47b-620f759ae894 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] [instance: 742bfe1e-6885-4aba-9f7f-c07a5d904175] Successfully created port: 0b7a1072-6ad0-4907-a951-67975f1497b5 {{(pid=75176) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 15:52:37 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-e6b9b6a1-d5b7-4685-a47b-620f759ae894 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2,backing_fmt=raw /opt/stack/data/nova/instances/742bfe1e-6885-4aba-9f7f-c07a5d904175/disk 1073741824" returned: 0 in 0.090s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:52:37 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-e6b9b6a1-d5b7-4685-a47b-620f759ae894 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] Lock "5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.281s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:52:37 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-e6b9b6a1-d5b7-4685-a47b-620f759ae894 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:52:37 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-3494fde8-2f23-4569-b8ef-621d14f2b0d7 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Acquiring lock "6161cab2-eb1f-44cb-bbd5-077e6db42f77-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:52:37 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-3494fde8-2f23-4569-b8ef-621d14f2b0d7 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Lock "6161cab2-eb1f-44cb-bbd5-077e6db42f77-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:52:37 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-3494fde8-2f23-4569-b8ef-621d14f2b0d7 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Lock "6161cab2-eb1f-44cb-bbd5-077e6db42f77-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:52:37 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-3494fde8-2f23-4569-b8ef-621d14f2b0d7 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Acquiring lock "refresh_cache-6161cab2-eb1f-44cb-bbd5-077e6db42f77" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:52:37 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-3494fde8-2f23-4569-b8ef-621d14f2b0d7 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Acquired lock "refresh_cache-6161cab2-eb1f-44cb-bbd5-077e6db42f77" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:52:37 user nova-compute[75176]: DEBUG nova.network.neutron [None req-3494fde8-2f23-4569-b8ef-621d14f2b0d7 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] [instance: 6161cab2-eb1f-44cb-bbd5-077e6db42f77] Building network info cache for instance {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 15:52:37 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-e6b9b6a1-d5b7-4685-a47b-620f759ae894 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json" returned: 0 in 0.188s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:52:37 user nova-compute[75176]: DEBUG nova.virt.disk.api [None req-e6b9b6a1-d5b7-4685-a47b-620f759ae894 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] Checking if we can resize image /opt/stack/data/nova/instances/742bfe1e-6885-4aba-9f7f-c07a5d904175/disk. size=1073741824 {{(pid=75176) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 15:52:37 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-e6b9b6a1-d5b7-4685-a47b-620f759ae894 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/742bfe1e-6885-4aba-9f7f-c07a5d904175/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:52:37 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-e6b9b6a1-d5b7-4685-a47b-620f759ae894 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/742bfe1e-6885-4aba-9f7f-c07a5d904175/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:52:37 user nova-compute[75176]: DEBUG nova.virt.disk.api [None req-e6b9b6a1-d5b7-4685-a47b-620f759ae894 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] Cannot resize image /opt/stack/data/nova/instances/742bfe1e-6885-4aba-9f7f-c07a5d904175/disk to a smaller size. {{(pid=75176) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 15:52:37 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-e6b9b6a1-d5b7-4685-a47b-620f759ae894 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] [instance: 742bfe1e-6885-4aba-9f7f-c07a5d904175] Created local disks {{(pid=75176) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 15:52:37 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-e6b9b6a1-d5b7-4685-a47b-620f759ae894 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] [instance: 742bfe1e-6885-4aba-9f7f-c07a5d904175] Ensure instance console log exists: /opt/stack/data/nova/instances/742bfe1e-6885-4aba-9f7f-c07a5d904175/console.log {{(pid=75176) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 15:52:37 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-e6b9b6a1-d5b7-4685-a47b-620f759ae894 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:52:37 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-e6b9b6a1-d5b7-4685-a47b-620f759ae894 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:52:37 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-e6b9b6a1-d5b7-4685-a47b-620f759ae894 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:52:37 user nova-compute[75176]: DEBUG nova.network.neutron [None req-3494fde8-2f23-4569-b8ef-621d14f2b0d7 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] [instance: 6161cab2-eb1f-44cb-bbd5-077e6db42f77] Updating instance_info_cache with network_info: [{"id": "f2811544-4cf2-4302-b012-8bf1881b9b6c", "address": "fa:16:3e:2a:df:42", "network": {"id": "8b63f2d3-0683-4832-abc5-e4c796cf12ab", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-877608435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3704b38a2bd44cb78c28d3f6d86d9e60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2811544-4c", "ovs_interfaceid": "f2811544-4cf2-4302-b012-8bf1881b9b6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:52:37 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-3494fde8-2f23-4569-b8ef-621d14f2b0d7 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Releasing lock "refresh_cache-6161cab2-eb1f-44cb-bbd5-077e6db42f77" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:52:37 user nova-compute[75176]: DEBUG nova.network.neutron [None req-e6b9b6a1-d5b7-4685-a47b-620f759ae894 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] [instance: 742bfe1e-6885-4aba-9f7f-c07a5d904175] Successfully updated port: 0b7a1072-6ad0-4907-a951-67975f1497b5 {{(pid=75176) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 15:52:37 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-e6b9b6a1-d5b7-4685-a47b-620f759ae894 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] Acquiring lock "refresh_cache-742bfe1e-6885-4aba-9f7f-c07a5d904175" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:52:37 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-e6b9b6a1-d5b7-4685-a47b-620f759ae894 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] Acquired lock "refresh_cache-742bfe1e-6885-4aba-9f7f-c07a5d904175" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:52:37 user nova-compute[75176]: DEBUG nova.network.neutron [None req-e6b9b6a1-d5b7-4685-a47b-620f759ae894 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] [instance: 742bfe1e-6885-4aba-9f7f-c07a5d904175] Building network info cache for instance {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 15:52:37 user nova-compute[75176]: DEBUG nova.compute.manager [req-52de5a07-cea2-435a-aa93-70c72d316f4b req-b72a6cd8-7b2e-4c09-a241-83d90d3d8ea7 service nova] [instance: 742bfe1e-6885-4aba-9f7f-c07a5d904175] Received event network-changed-0b7a1072-6ad0-4907-a951-67975f1497b5 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:52:37 user nova-compute[75176]: DEBUG nova.compute.manager [req-52de5a07-cea2-435a-aa93-70c72d316f4b req-b72a6cd8-7b2e-4c09-a241-83d90d3d8ea7 service nova] [instance: 742bfe1e-6885-4aba-9f7f-c07a5d904175] Refreshing instance network info cache due to event network-changed-0b7a1072-6ad0-4907-a951-67975f1497b5. {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 15:52:37 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-52de5a07-cea2-435a-aa93-70c72d316f4b req-b72a6cd8-7b2e-4c09-a241-83d90d3d8ea7 service nova] Acquiring lock "refresh_cache-742bfe1e-6885-4aba-9f7f-c07a5d904175" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:52:37 user nova-compute[75176]: DEBUG os_brick.utils [None req-3494fde8-2f23-4569-b8ef-621d14f2b0d7 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 15:52:37 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:52:37 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:52:37 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ebaf829-6339-4eb8-a898-bd73149ec60e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:edc924a949b2\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:52:37 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:52:37 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:52:37 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e0cf5e0-3785-4aa5-8b3c-cd8289e3ac5c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:52:37 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:52:37 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:52:37 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[2347ce62-d5a6-4a8f-8eb2-452862682e88]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:52:37 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[54e89d2c-2fc4-4f7f-9ddc-7c9df75b842c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:52:37 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-3494fde8-2f23-4569-b8ef-621d14f2b0d7 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Running cmd (subprocess): nvme version {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:52:37 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-3494fde8-2f23-4569-b8ef-621d14f2b0d7 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] 'nvme version' failed. Not Retrying. {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 15:52:37 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3494fde8-2f23-4569-b8ef-621d14f2b0d7 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] nvme not present on system {{(pid=75176) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 15:52:37 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:52:38 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 15:52:38 user nova-compute[75176]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 15:52:38 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaed6e71-1fef-43c7-9949-29eaddf84ad0]: (4, '') {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:52:38 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.lightos [None req-3494fde8-2f23-4569-b8ef-621d14f2b0d7 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75176) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 15:52:38 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.lightos [None req-3494fde8-2f23-4569-b8ef-621d14f2b0d7 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75176) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 15:52:38 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.lightos [None req-3494fde8-2f23-4569-b8ef-621d14f2b0d7 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] LIGHTOS: no hostnqn found. {{(pid=75176) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 15:52:38 user nova-compute[75176]: DEBUG os_brick.utils [None req-3494fde8-2f23-4569-b8ef-621d14f2b0d7 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:edc924a949b2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 15:52:38 user nova-compute[75176]: DEBUG nova.network.neutron [None req-e6b9b6a1-d5b7-4685-a47b-620f759ae894 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] [instance: 742bfe1e-6885-4aba-9f7f-c07a5d904175] Instance cache missing network info. {{(pid=75176) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 15:52:38 user nova-compute[75176]: DEBUG nova.network.neutron [None req-e6b9b6a1-d5b7-4685-a47b-620f759ae894 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] [instance: 742bfe1e-6885-4aba-9f7f-c07a5d904175] Updating instance_info_cache with network_info: [{"id": "0b7a1072-6ad0-4907-a951-67975f1497b5", "address": "fa:16:3e:c7:5d:87", "network": {"id": "d512a3da-3880-40f2-9c54-9130a3dc1f6c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1594970670-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e8967023e58840afa09d5959d29a0285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b7a1072-6a", "ovs_interfaceid": "0b7a1072-6ad0-4907-a951-67975f1497b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:52:38 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-e6b9b6a1-d5b7-4685-a47b-620f759ae894 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] Releasing lock "refresh_cache-742bfe1e-6885-4aba-9f7f-c07a5d904175" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:52:38 user nova-compute[75176]: DEBUG nova.compute.manager [None req-e6b9b6a1-d5b7-4685-a47b-620f759ae894 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] [instance: 742bfe1e-6885-4aba-9f7f-c07a5d904175] Instance network_info: |[{"id": "0b7a1072-6ad0-4907-a951-67975f1497b5", "address": "fa:16:3e:c7:5d:87", "network": {"id": "d512a3da-3880-40f2-9c54-9130a3dc1f6c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1594970670-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e8967023e58840afa09d5959d29a0285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b7a1072-6a", "ovs_interfaceid": "0b7a1072-6ad0-4907-a951-67975f1497b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75176) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 15:52:38 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-52de5a07-cea2-435a-aa93-70c72d316f4b req-b72a6cd8-7b2e-4c09-a241-83d90d3d8ea7 service nova] Acquired lock "refresh_cache-742bfe1e-6885-4aba-9f7f-c07a5d904175" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:52:38 user nova-compute[75176]: DEBUG nova.network.neutron [req-52de5a07-cea2-435a-aa93-70c72d316f4b req-b72a6cd8-7b2e-4c09-a241-83d90d3d8ea7 service nova] [instance: 742bfe1e-6885-4aba-9f7f-c07a5d904175] Refreshing network info cache for port 0b7a1072-6ad0-4907-a951-67975f1497b5 {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 15:52:38 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-e6b9b6a1-d5b7-4685-a47b-620f759ae894 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] [instance: 742bfe1e-6885-4aba-9f7f-c07a5d904175] Start _get_guest_xml network_info=[{"id": "0b7a1072-6ad0-4907-a951-67975f1497b5", "address": "fa:16:3e:c7:5d:87", "network": {"id": "d512a3da-3880-40f2-9c54-9130a3dc1f6c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1594970670-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e8967023e58840afa09d5959d29a0285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b7a1072-6a", "ovs_interfaceid": "0b7a1072-6ad0-4907-a951-67975f1497b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T15:35:12Z,direct_url=<?>,disk_format='qcow2',id=1f41819e-c93f-4dc7-b253-37a27bbbbc74,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1b91c5d0672c4224a48df2e1f92688e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T15:35:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'size': 0, 'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'image_id': '1f41819e-c93f-4dc7-b253-37a27bbbbc74'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75176) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 15:52:38 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-e6b9b6a1-d5b7-4685-a47b-620f759ae894 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 15:52:38 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-e6b9b6a1-d5b7-4685-a47b-620f759ae894 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 15:52:38 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-e6b9b6a1-d5b7-4685-a47b-620f759ae894 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75176) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 15:52:38 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-e6b9b6a1-d5b7-4685-a47b-620f759ae894 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] CPU controller missing on host. {{(pid=75176) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 15:52:38 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-e6b9b6a1-d5b7-4685-a47b-620f759ae894 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75176) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 15:52:38 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-e6b9b6a1-d5b7-4685-a47b-620f759ae894 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] CPU controller found on host. {{(pid=75176) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 15:52:38 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-e6b9b6a1-d5b7-4685-a47b-620f759ae894 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75176) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 15:52:38 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-e6b9b6a1-d5b7-4685-a47b-620f759ae894 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T15:35:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T15:35:12Z,direct_url=<?>,disk_format='qcow2',id=1f41819e-c93f-4dc7-b253-37a27bbbbc74,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1b91c5d0672c4224a48df2e1f92688e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T15:35:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 15:52:38 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-e6b9b6a1-d5b7-4685-a47b-620f759ae894 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] Flavor limits 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 15:52:38 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-e6b9b6a1-d5b7-4685-a47b-620f759ae894 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] Image limits 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 15:52:38 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-e6b9b6a1-d5b7-4685-a47b-620f759ae894 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] Flavor pref 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 15:52:38 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-e6b9b6a1-d5b7-4685-a47b-620f759ae894 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] Image pref 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 15:52:38 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-e6b9b6a1-d5b7-4685-a47b-620f759ae894 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 15:52:38 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-e6b9b6a1-d5b7-4685-a47b-620f759ae894 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 15:52:38 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-e6b9b6a1-d5b7-4685-a47b-620f759ae894 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75176) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 15:52:38 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-e6b9b6a1-d5b7-4685-a47b-620f759ae894 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] Got 1 possible topologies {{(pid=75176) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 15:52:38 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-e6b9b6a1-d5b7-4685-a47b-620f759ae894 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 15:52:38 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-e6b9b6a1-d5b7-4685-a47b-620f759ae894 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 15:52:38 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-e6b9b6a1-d5b7-4685-a47b-620f759ae894 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T15:52:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1282306666',display_name='tempest-TestServerVolumeAttachmentScenario-server-1282306666',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1282306666',id=36,image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCUqclveht6BjAO09SxfLKX5af4yrHLLMMkUAd6M2Oexq680bHnAwVqg80BFu6CFjfE0NOZAACtenEwpm0AYqV/VfHtc+CSA83+PUdNSZzB3R1lp7Mcfb+TXITKkKAyX2A==',key_name='tempest-keypair-608680231',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e8967023e58840afa09d5959d29a0285',ramdisk_id='',reservation_id='r-5tqc630u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1079141498',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1079141498-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T15:52:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0ba38ecd6e8f440cbad7d11e95de1e62',uuid=742bfe1e-6885-4aba-9f7f-c07a5d904175,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0b7a1072-6ad0-4907-a951-67975f1497b5", "address": "fa:16:3e:c7:5d:87", "network": {"id": "d512a3da-3880-40f2-9c54-9130a3dc1f6c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1594970670-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e8967023e58840afa09d5959d29a0285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b7a1072-6a", "ovs_interfaceid": "0b7a1072-6ad0-4907-a951-67975f1497b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75176) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 15:52:38 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-e6b9b6a1-d5b7-4685-a47b-620f759ae894 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] Converting VIF {"id": "0b7a1072-6ad0-4907-a951-67975f1497b5", "address": "fa:16:3e:c7:5d:87", "network": {"id": "d512a3da-3880-40f2-9c54-9130a3dc1f6c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1594970670-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e8967023e58840afa09d5959d29a0285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b7a1072-6a", "ovs_interfaceid": "0b7a1072-6ad0-4907-a951-67975f1497b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:52:38 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-e6b9b6a1-d5b7-4685-a47b-620f759ae894 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:5d:87,bridge_name='br-int',has_traffic_filtering=True,id=0b7a1072-6ad0-4907-a951-67975f1497b5,network=Network(d512a3da-3880-40f2-9c54-9130a3dc1f6c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b7a1072-6a') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:52:38 user nova-compute[75176]: DEBUG nova.objects.instance [None req-e6b9b6a1-d5b7-4685-a47b-620f759ae894 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] Lazy-loading 'pci_devices' on Instance uuid 742bfe1e-6885-4aba-9f7f-c07a5d904175 {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:52:38 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-e6b9b6a1-d5b7-4685-a47b-620f759ae894 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] [instance: 742bfe1e-6885-4aba-9f7f-c07a5d904175] End _get_guest_xml xml=<domain type="kvm">
Nov 28 15:52:38 user nova-compute[75176]:   <uuid>742bfe1e-6885-4aba-9f7f-c07a5d904175</uuid>
Nov 28 15:52:38 user nova-compute[75176]:   <name>instance-00000024</name>
Nov 28 15:52:38 user nova-compute[75176]:   <memory>524288</memory>
Nov 28 15:52:38 user nova-compute[75176]:   <vcpu>1</vcpu>
Nov 28 15:52:38 user nova-compute[75176]:   <metadata>
Nov 28 15:52:38 user nova-compute[75176]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 15:52:38 user nova-compute[75176]:       <nova:package version="0.0.0"/>
Nov 28 15:52:38 user nova-compute[75176]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-1282306666</nova:name>
Nov 28 15:52:38 user nova-compute[75176]:       <nova:creationTime>2023-11-28 15:52:38</nova:creationTime>
Nov 28 15:52:38 user nova-compute[75176]:       <nova:flavor name="m1.tiny">
Nov 28 15:52:38 user nova-compute[75176]:         <nova:memory>512</nova:memory>
Nov 28 15:52:38 user nova-compute[75176]:         <nova:disk>1</nova:disk>
Nov 28 15:52:38 user nova-compute[75176]:         <nova:swap>0</nova:swap>
Nov 28 15:52:38 user nova-compute[75176]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 15:52:38 user nova-compute[75176]:         <nova:vcpus>1</nova:vcpus>
Nov 28 15:52:38 user nova-compute[75176]:       </nova:flavor>
Nov 28 15:52:38 user nova-compute[75176]:       <nova:owner>
Nov 28 15:52:38 user nova-compute[75176]:         <nova:user uuid="0ba38ecd6e8f440cbad7d11e95de1e62">tempest-TestServerVolumeAttachmentScenario-1079141498-project-member</nova:user>
Nov 28 15:52:38 user nova-compute[75176]:         <nova:project uuid="e8967023e58840afa09d5959d29a0285">tempest-TestServerVolumeAttachmentScenario-1079141498</nova:project>
Nov 28 15:52:38 user nova-compute[75176]:       </nova:owner>
Nov 28 15:52:38 user nova-compute[75176]:       <nova:root type="image" uuid="1f41819e-c93f-4dc7-b253-37a27bbbbc74"/>
Nov 28 15:52:38 user nova-compute[75176]:       <nova:ports>
Nov 28 15:52:38 user nova-compute[75176]:         <nova:port uuid="0b7a1072-6ad0-4907-a951-67975f1497b5">
Nov 28 15:52:38 user nova-compute[75176]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 28 15:52:38 user nova-compute[75176]:         </nova:port>
Nov 28 15:52:38 user nova-compute[75176]:       </nova:ports>
Nov 28 15:52:38 user nova-compute[75176]:     </nova:instance>
Nov 28 15:52:38 user nova-compute[75176]:   </metadata>
Nov 28 15:52:38 user nova-compute[75176]:   <sysinfo type="smbios">
Nov 28 15:52:38 user nova-compute[75176]:     <system>
Nov 28 15:52:38 user nova-compute[75176]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 15:52:38 user nova-compute[75176]:       <entry name="product">OpenStack Nova</entry>
Nov 28 15:52:38 user nova-compute[75176]:       <entry name="version">0.0.0</entry>
Nov 28 15:52:38 user nova-compute[75176]:       <entry name="serial">742bfe1e-6885-4aba-9f7f-c07a5d904175</entry>
Nov 28 15:52:38 user nova-compute[75176]:       <entry name="uuid">742bfe1e-6885-4aba-9f7f-c07a5d904175</entry>
Nov 28 15:52:38 user nova-compute[75176]:       <entry name="family">Virtual Machine</entry>
Nov 28 15:52:38 user nova-compute[75176]:     </system>
Nov 28 15:52:38 user nova-compute[75176]:   </sysinfo>
Nov 28 15:52:38 user nova-compute[75176]:   <os>
Nov 28 15:52:38 user nova-compute[75176]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 15:52:38 user nova-compute[75176]:     <boot dev="hd"/>
Nov 28 15:52:38 user nova-compute[75176]:     <smbios mode="sysinfo"/>
Nov 28 15:52:38 user nova-compute[75176]:   </os>
Nov 28 15:52:38 user nova-compute[75176]:   <features>
Nov 28 15:52:38 user nova-compute[75176]:     <acpi/>
Nov 28 15:52:38 user nova-compute[75176]:     <apic/>
Nov 28 15:52:38 user nova-compute[75176]:     <vmcoreinfo/>
Nov 28 15:52:38 user nova-compute[75176]:   </features>
Nov 28 15:52:38 user nova-compute[75176]:   <clock offset="utc">
Nov 28 15:52:38 user nova-compute[75176]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 15:52:38 user nova-compute[75176]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 15:52:38 user nova-compute[75176]:     <timer name="hpet" present="no"/>
Nov 28 15:52:38 user nova-compute[75176]:   </clock>
Nov 28 15:52:38 user nova-compute[75176]:   <cpu mode="custom" match="exact">
Nov 28 15:52:38 user nova-compute[75176]:     <model>Nehalem</model>
Nov 28 15:52:38 user nova-compute[75176]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 15:52:38 user nova-compute[75176]:   </cpu>
Nov 28 15:52:38 user nova-compute[75176]:   <devices>
Nov 28 15:52:38 user nova-compute[75176]:     <disk type="file" device="disk">
Nov 28 15:52:38 user nova-compute[75176]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 15:52:38 user nova-compute[75176]:       <source file="/opt/stack/data/nova/instances/742bfe1e-6885-4aba-9f7f-c07a5d904175/disk"/>
Nov 28 15:52:38 user nova-compute[75176]:       <target dev="vda" bus="virtio"/>
Nov 28 15:52:38 user nova-compute[75176]:     </disk>
Nov 28 15:52:38 user nova-compute[75176]:     <interface type="ethernet">
Nov 28 15:52:38 user nova-compute[75176]:       <mac address="fa:16:3e:c7:5d:87"/>
Nov 28 15:52:38 user nova-compute[75176]:       <model type="virtio"/>
Nov 28 15:52:38 user nova-compute[75176]:       <mtu size="1442"/>
Nov 28 15:52:38 user nova-compute[75176]:       <target dev="tap0b7a1072-6a"/>
Nov 28 15:52:38 user nova-compute[75176]:     </interface>
Nov 28 15:52:38 user nova-compute[75176]:     <serial type="pty">
Nov 28 15:52:38 user nova-compute[75176]:       <log file="/opt/stack/data/nova/instances/742bfe1e-6885-4aba-9f7f-c07a5d904175/console.log" append="off"/>
Nov 28 15:52:38 user nova-compute[75176]:     </serial>
Nov 28 15:52:38 user nova-compute[75176]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 15:52:38 user nova-compute[75176]:     <video>
Nov 28 15:52:38 user nova-compute[75176]:       <model type="virtio"/>
Nov 28 15:52:38 user nova-compute[75176]:     </video>
Nov 28 15:52:38 user nova-compute[75176]:     <rng model="virtio">
Nov 28 15:52:38 user nova-compute[75176]:       <backend model="random">/dev/urandom</backend>
Nov 28 15:52:38 user nova-compute[75176]:     </rng>
Nov 28 15:52:38 user nova-compute[75176]:     <controller type="usb" index="0" model="none"/>
Nov 28 15:52:38 user nova-compute[75176]:     <memballoon model="virtio">
Nov 28 15:52:38 user nova-compute[75176]:       <stats period="10"/>
Nov 28 15:52:38 user nova-compute[75176]:     </memballoon>
Nov 28 15:52:38 user nova-compute[75176]:   </devices>
Nov 28 15:52:38 user nova-compute[75176]: </domain>
Nov 28 15:52:38 user nova-compute[75176]:  {{(pid=75176) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 15:52:38 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-e6b9b6a1-d5b7-4685-a47b-620f759ae894 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T15:52:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1282306666',display_name='tempest-TestServerVolumeAttachmentScenario-server-1282306666',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1282306666',id=36,image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCUqclveht6BjAO09SxfLKX5af4yrHLLMMkUAd6M2Oexq680bHnAwVqg80BFu6CFjfE0NOZAACtenEwpm0AYqV/VfHtc+CSA83+PUdNSZzB3R1lp7Mcfb+TXITKkKAyX2A==',key_name='tempest-keypair-608680231',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e8967023e58840afa09d5959d29a0285',ramdisk_id='',reservation_id='r-5tqc630u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1079141498',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1079141498-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T15:52:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0ba38ecd6e8f440cbad7d11e95de1e62',uuid=742bfe1e-6885-4aba-9f7f-c07a5d904175,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0b7a1072-6ad0-4907-a951-67975f1497b5", "address": "fa:16:3e:c7:5d:87", "network": {"id": "d512a3da-3880-40f2-9c54-9130a3dc1f6c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1594970670-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e8967023e58840afa09d5959d29a0285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b7a1072-6a", "ovs_interfaceid": "0b7a1072-6ad0-4907-a951-67975f1497b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 15:52:38 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-e6b9b6a1-d5b7-4685-a47b-620f759ae894 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] Converting VIF {"id": "0b7a1072-6ad0-4907-a951-67975f1497b5", "address": "fa:16:3e:c7:5d:87", "network": {"id": "d512a3da-3880-40f2-9c54-9130a3dc1f6c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1594970670-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e8967023e58840afa09d5959d29a0285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b7a1072-6a", "ovs_interfaceid": "0b7a1072-6ad0-4907-a951-67975f1497b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:52:38 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-e6b9b6a1-d5b7-4685-a47b-620f759ae894 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:5d:87,bridge_name='br-int',has_traffic_filtering=True,id=0b7a1072-6ad0-4907-a951-67975f1497b5,network=Network(d512a3da-3880-40f2-9c54-9130a3dc1f6c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b7a1072-6a') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:52:38 user nova-compute[75176]: DEBUG os_vif [None req-e6b9b6a1-d5b7-4685-a47b-620f759ae894 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:5d:87,bridge_name='br-int',has_traffic_filtering=True,id=0b7a1072-6ad0-4907-a951-67975f1497b5,network=Network(d512a3da-3880-40f2-9c54-9130a3dc1f6c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b7a1072-6a') {{(pid=75176) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 15:52:38 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:52:38 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:52:38 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 15:52:38 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:52:38 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5e908355-fda5-5b19-82a9-636c31b3d0ff', '_type': 'linux-noop'}}, row=False) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:52:38 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:52:38 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:52:38 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:52:38 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0b7a1072-6a, may_exist=True, interface_attrs={}) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:52:38 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0b7a1072-6a, col_values=(('qos', UUID('430934ea-239a-40a8-8796-d1acba311d8f')),), if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:52:38 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0b7a1072-6a, col_values=(('external_ids', {'iface-id': '0b7a1072-6ad0-4907-a951-67975f1497b5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c7:5d:87', 'vm-uuid': '742bfe1e-6885-4aba-9f7f-c07a5d904175'}),), if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:52:38 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:52:38 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:52:38 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:52:38 user nova-compute[75176]: INFO os_vif [None req-e6b9b6a1-d5b7-4685-a47b-620f759ae894 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:5d:87,bridge_name='br-int',has_traffic_filtering=True,id=0b7a1072-6ad0-4907-a951-67975f1497b5,network=Network(d512a3da-3880-40f2-9c54-9130a3dc1f6c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b7a1072-6a')
Nov 28 15:52:38 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-e6b9b6a1-d5b7-4685-a47b-620f759ae894 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] No BDM found with device name vda, not building metadata. {{(pid=75176) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 15:52:38 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-e6b9b6a1-d5b7-4685-a47b-620f759ae894 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] No VIF found with MAC fa:16:3e:c7:5d:87, not building metadata {{(pid=75176) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 15:52:38 user nova-compute[75176]: DEBUG nova.network.neutron [req-52de5a07-cea2-435a-aa93-70c72d316f4b req-b72a6cd8-7b2e-4c09-a241-83d90d3d8ea7 service nova] [instance: 742bfe1e-6885-4aba-9f7f-c07a5d904175] Updated VIF entry in instance network info cache for port 0b7a1072-6ad0-4907-a951-67975f1497b5. {{(pid=75176) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 15:52:38 user nova-compute[75176]: DEBUG nova.network.neutron [req-52de5a07-cea2-435a-aa93-70c72d316f4b req-b72a6cd8-7b2e-4c09-a241-83d90d3d8ea7 service nova] [instance: 742bfe1e-6885-4aba-9f7f-c07a5d904175] Updating instance_info_cache with network_info: [{"id": "0b7a1072-6ad0-4907-a951-67975f1497b5", "address": "fa:16:3e:c7:5d:87", "network": {"id": "d512a3da-3880-40f2-9c54-9130a3dc1f6c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1594970670-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e8967023e58840afa09d5959d29a0285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b7a1072-6a", "ovs_interfaceid": "0b7a1072-6ad0-4907-a951-67975f1497b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:52:38 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-52de5a07-cea2-435a-aa93-70c72d316f4b req-b72a6cd8-7b2e-4c09-a241-83d90d3d8ea7 service nova] Releasing lock "refresh_cache-742bfe1e-6885-4aba-9f7f-c07a5d904175" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:52:39 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:52:39 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:52:39 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:52:39 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:52:39 user nova-compute[75176]: DEBUG nova.compute.manager [req-8ec04a6a-fb32-4f97-abd1-80a5f8beafea req-351c887a-03b1-4789-bf21-fec1375e1e16 service nova] [instance: 742bfe1e-6885-4aba-9f7f-c07a5d904175] Received event network-vif-plugged-0b7a1072-6ad0-4907-a951-67975f1497b5 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:52:39 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-8ec04a6a-fb32-4f97-abd1-80a5f8beafea req-351c887a-03b1-4789-bf21-fec1375e1e16 service nova] Acquiring lock "742bfe1e-6885-4aba-9f7f-c07a5d904175-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:52:39 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-8ec04a6a-fb32-4f97-abd1-80a5f8beafea req-351c887a-03b1-4789-bf21-fec1375e1e16 service nova] Lock "742bfe1e-6885-4aba-9f7f-c07a5d904175-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:52:39 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-8ec04a6a-fb32-4f97-abd1-80a5f8beafea req-351c887a-03b1-4789-bf21-fec1375e1e16 service nova] Lock "742bfe1e-6885-4aba-9f7f-c07a5d904175-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:52:39 user nova-compute[75176]: DEBUG nova.compute.manager [req-8ec04a6a-fb32-4f97-abd1-80a5f8beafea req-351c887a-03b1-4789-bf21-fec1375e1e16 service nova] [instance: 742bfe1e-6885-4aba-9f7f-c07a5d904175] No waiting events found dispatching network-vif-plugged-0b7a1072-6ad0-4907-a951-67975f1497b5 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:52:39 user nova-compute[75176]: WARNING nova.compute.manager [req-8ec04a6a-fb32-4f97-abd1-80a5f8beafea req-351c887a-03b1-4789-bf21-fec1375e1e16 service nova] [instance: 742bfe1e-6885-4aba-9f7f-c07a5d904175] Received unexpected event network-vif-plugged-0b7a1072-6ad0-4907-a951-67975f1497b5 for instance with vm_state building and task_state spawning.
Nov 28 15:52:40 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:52:40 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:52:40 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-23c04da6-7e02-46a4-b06b-2be112af3b6a tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Acquiring lock "193235b9-8ef5-41d0-a9ab-4f1679d30266" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:52:40 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-23c04da6-7e02-46a4-b06b-2be112af3b6a tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Lock "193235b9-8ef5-41d0-a9ab-4f1679d30266" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:52:40 user nova-compute[75176]: DEBUG nova.compute.manager [None req-23c04da6-7e02-46a4-b06b-2be112af3b6a tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] [instance: 193235b9-8ef5-41d0-a9ab-4f1679d30266] Starting instance... {{(pid=75176) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 15:52:40 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-23c04da6-7e02-46a4-b06b-2be112af3b6a tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:52:40 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-23c04da6-7e02-46a4-b06b-2be112af3b6a tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:52:40 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-23c04da6-7e02-46a4-b06b-2be112af3b6a tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75176) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 15:52:40 user nova-compute[75176]: INFO nova.compute.claims [None req-23c04da6-7e02-46a4-b06b-2be112af3b6a tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] [instance: 193235b9-8ef5-41d0-a9ab-4f1679d30266] Claim successful on node user
Nov 28 15:52:41 user nova-compute[75176]: DEBUG nova.compute.provider_tree [None req-23c04da6-7e02-46a4-b06b-2be112af3b6a tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Inventory has not changed in ProviderTree for provider: b37848d8-f401-4155-a029-b0ffa09ff85b {{(pid=75176) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 15:52:41 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-23c04da6-7e02-46a4-b06b-2be112af3b6a tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Inventory has not changed for provider b37848d8-f401-4155-a029-b0ffa09ff85b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75176) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 15:52:41 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-23c04da6-7e02-46a4-b06b-2be112af3b6a tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.487s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:52:41 user nova-compute[75176]: DEBUG nova.compute.manager [None req-23c04da6-7e02-46a4-b06b-2be112af3b6a tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] [instance: 193235b9-8ef5-41d0-a9ab-4f1679d30266] Start building networks asynchronously for instance. {{(pid=75176) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 15:52:41 user nova-compute[75176]: DEBUG nova.compute.manager [None req-23c04da6-7e02-46a4-b06b-2be112af3b6a tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] [instance: 193235b9-8ef5-41d0-a9ab-4f1679d30266] Allocating IP information in the background. {{(pid=75176) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 15:52:41 user nova-compute[75176]: DEBUG nova.network.neutron [None req-23c04da6-7e02-46a4-b06b-2be112af3b6a tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] [instance: 193235b9-8ef5-41d0-a9ab-4f1679d30266] allocate_for_instance() {{(pid=75176) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 15:52:41 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-23c04da6-7e02-46a4-b06b-2be112af3b6a tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] [instance: 193235b9-8ef5-41d0-a9ab-4f1679d30266] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 15:52:41 user nova-compute[75176]: DEBUG nova.compute.manager [None req-23c04da6-7e02-46a4-b06b-2be112af3b6a tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] [instance: 193235b9-8ef5-41d0-a9ab-4f1679d30266] Start building block device mappings for instance. {{(pid=75176) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 15:52:41 user nova-compute[75176]: DEBUG nova.policy [None req-23c04da6-7e02-46a4-b06b-2be112af3b6a tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f9a745552d974e05a9e0befc68eb7f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a194f81f7e104be7940d1d05f71bbad9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75176) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 15:52:41 user nova-compute[75176]: DEBUG nova.compute.manager [None req-23c04da6-7e02-46a4-b06b-2be112af3b6a tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] [instance: 193235b9-8ef5-41d0-a9ab-4f1679d30266] Start spawning the instance on the hypervisor. {{(pid=75176) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 15:52:41 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-23c04da6-7e02-46a4-b06b-2be112af3b6a tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] [instance: 193235b9-8ef5-41d0-a9ab-4f1679d30266] Creating instance directory {{(pid=75176) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 15:52:41 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-23c04da6-7e02-46a4-b06b-2be112af3b6a tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] [instance: 193235b9-8ef5-41d0-a9ab-4f1679d30266] Creating image(s)
Nov 28 15:52:41 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-23c04da6-7e02-46a4-b06b-2be112af3b6a tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Acquiring lock "/opt/stack/data/nova/instances/193235b9-8ef5-41d0-a9ab-4f1679d30266/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:52:41 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-23c04da6-7e02-46a4-b06b-2be112af3b6a tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Lock "/opt/stack/data/nova/instances/193235b9-8ef5-41d0-a9ab-4f1679d30266/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:52:41 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-23c04da6-7e02-46a4-b06b-2be112af3b6a tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Lock "/opt/stack/data/nova/instances/193235b9-8ef5-41d0-a9ab-4f1679d30266/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.011s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:52:41 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-23c04da6-7e02-46a4-b06b-2be112af3b6a tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:52:41 user nova-compute[75176]: DEBUG nova.compute.manager [None req-e6b9b6a1-d5b7-4685-a47b-620f759ae894 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] [instance: 742bfe1e-6885-4aba-9f7f-c07a5d904175] Instance event wait completed in 0 seconds for  {{(pid=75176) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 15:52:42 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-e6b9b6a1-d5b7-4685-a47b-620f759ae894 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] [instance: 742bfe1e-6885-4aba-9f7f-c07a5d904175] Guest created on hypervisor {{(pid=75176) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 15:52:42 user nova-compute[75176]: INFO nova.virt.libvirt.driver [-] [instance: 742bfe1e-6885-4aba-9f7f-c07a5d904175] Instance spawned successfully.
Nov 28 15:52:42 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-e6b9b6a1-d5b7-4685-a47b-620f759ae894 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] [instance: 742bfe1e-6885-4aba-9f7f-c07a5d904175] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 15:52:42 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-23c04da6-7e02-46a4-b06b-2be112af3b6a tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json" returned: 0 in 0.183s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:52:42 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-23c04da6-7e02-46a4-b06b-2be112af3b6a tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Acquiring lock "5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:52:42 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-23c04da6-7e02-46a4-b06b-2be112af3b6a tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Lock "5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:52:42 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-23c04da6-7e02-46a4-b06b-2be112af3b6a tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:52:42 user nova-compute[75176]: DEBUG nova.compute.manager [req-fd145bac-739e-40c9-813b-ab9b658c259d req-f025452c-3acb-40d6-8481-c987771a8c58 service nova] [instance: 742bfe1e-6885-4aba-9f7f-c07a5d904175] Received event network-vif-plugged-0b7a1072-6ad0-4907-a951-67975f1497b5 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:52:42 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-fd145bac-739e-40c9-813b-ab9b658c259d req-f025452c-3acb-40d6-8481-c987771a8c58 service nova] Acquiring lock "742bfe1e-6885-4aba-9f7f-c07a5d904175-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:52:42 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-fd145bac-739e-40c9-813b-ab9b658c259d req-f025452c-3acb-40d6-8481-c987771a8c58 service nova] Lock "742bfe1e-6885-4aba-9f7f-c07a5d904175-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:52:42 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-fd145bac-739e-40c9-813b-ab9b658c259d req-f025452c-3acb-40d6-8481-c987771a8c58 service nova] Lock "742bfe1e-6885-4aba-9f7f-c07a5d904175-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:52:42 user nova-compute[75176]: DEBUG nova.compute.manager [req-fd145bac-739e-40c9-813b-ab9b658c259d req-f025452c-3acb-40d6-8481-c987771a8c58 service nova] [instance: 742bfe1e-6885-4aba-9f7f-c07a5d904175] No waiting events found dispatching network-vif-plugged-0b7a1072-6ad0-4907-a951-67975f1497b5 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:52:42 user nova-compute[75176]: WARNING nova.compute.manager [req-fd145bac-739e-40c9-813b-ab9b658c259d req-f025452c-3acb-40d6-8481-c987771a8c58 service nova] [instance: 742bfe1e-6885-4aba-9f7f-c07a5d904175] Received unexpected event network-vif-plugged-0b7a1072-6ad0-4907-a951-67975f1497b5 for instance with vm_state building and task_state spawning.
Nov 28 15:52:42 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-e6b9b6a1-d5b7-4685-a47b-620f759ae894 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] [instance: 742bfe1e-6885-4aba-9f7f-c07a5d904175] Found default for hw_cdrom_bus of ide {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:52:42 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-e6b9b6a1-d5b7-4685-a47b-620f759ae894 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] [instance: 742bfe1e-6885-4aba-9f7f-c07a5d904175] Found default for hw_disk_bus of virtio {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:52:42 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-e6b9b6a1-d5b7-4685-a47b-620f759ae894 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] [instance: 742bfe1e-6885-4aba-9f7f-c07a5d904175] Found default for hw_input_bus of None {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:52:42 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-e6b9b6a1-d5b7-4685-a47b-620f759ae894 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] [instance: 742bfe1e-6885-4aba-9f7f-c07a5d904175] Found default for hw_pointer_model of None {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:52:42 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-e6b9b6a1-d5b7-4685-a47b-620f759ae894 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] [instance: 742bfe1e-6885-4aba-9f7f-c07a5d904175] Found default for hw_video_model of virtio {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:52:42 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-e6b9b6a1-d5b7-4685-a47b-620f759ae894 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] [instance: 742bfe1e-6885-4aba-9f7f-c07a5d904175] Found default for hw_vif_model of virtio {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:52:42 user nova-compute[75176]: INFO nova.compute.manager [None req-e6b9b6a1-d5b7-4685-a47b-620f759ae894 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] [instance: 742bfe1e-6885-4aba-9f7f-c07a5d904175] Took 5.50 seconds to spawn the instance on the hypervisor.
Nov 28 15:52:42 user nova-compute[75176]: DEBUG nova.compute.manager [None req-e6b9b6a1-d5b7-4685-a47b-620f759ae894 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] [instance: 742bfe1e-6885-4aba-9f7f-c07a5d904175] Checking state {{(pid=75176) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 15:52:42 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-23c04da6-7e02-46a4-b06b-2be112af3b6a tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json" returned: 0 in 0.184s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:52:42 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-23c04da6-7e02-46a4-b06b-2be112af3b6a tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2,backing_fmt=raw /opt/stack/data/nova/instances/193235b9-8ef5-41d0-a9ab-4f1679d30266/disk 1073741824 {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:52:42 user nova-compute[75176]: INFO nova.compute.manager [None req-e6b9b6a1-d5b7-4685-a47b-620f759ae894 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] [instance: 742bfe1e-6885-4aba-9f7f-c07a5d904175] Took 6.35 seconds to build instance.
Nov 28 15:52:42 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-23c04da6-7e02-46a4-b06b-2be112af3b6a tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2,backing_fmt=raw /opt/stack/data/nova/instances/193235b9-8ef5-41d0-a9ab-4f1679d30266/disk 1073741824" returned: 0 in 0.059s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:52:42 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-23c04da6-7e02-46a4-b06b-2be112af3b6a tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Lock "5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.247s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:52:42 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-23c04da6-7e02-46a4-b06b-2be112af3b6a tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:52:42 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-e6b9b6a1-d5b7-4685-a47b-620f759ae894 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] Lock "742bfe1e-6885-4aba-9f7f-c07a5d904175" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.558s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:52:42 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-23c04da6-7e02-46a4-b06b-2be112af3b6a tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json" returned: 0 in 0.201s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:52:42 user nova-compute[75176]: DEBUG nova.virt.disk.api [None req-23c04da6-7e02-46a4-b06b-2be112af3b6a tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Checking if we can resize image /opt/stack/data/nova/instances/193235b9-8ef5-41d0-a9ab-4f1679d30266/disk. size=1073741824 {{(pid=75176) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 15:52:42 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-23c04da6-7e02-46a4-b06b-2be112af3b6a tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/193235b9-8ef5-41d0-a9ab-4f1679d30266/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:52:42 user nova-compute[75176]: DEBUG nova.network.neutron [None req-23c04da6-7e02-46a4-b06b-2be112af3b6a tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] [instance: 193235b9-8ef5-41d0-a9ab-4f1679d30266] Successfully created port: 44024d49-7b6d-415a-a9eb-fe53b53da379 {{(pid=75176) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 15:52:42 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-23c04da6-7e02-46a4-b06b-2be112af3b6a tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/193235b9-8ef5-41d0-a9ab-4f1679d30266/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:52:42 user nova-compute[75176]: DEBUG nova.virt.disk.api [None req-23c04da6-7e02-46a4-b06b-2be112af3b6a tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Cannot resize image /opt/stack/data/nova/instances/193235b9-8ef5-41d0-a9ab-4f1679d30266/disk to a smaller size. {{(pid=75176) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 15:52:42 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-23c04da6-7e02-46a4-b06b-2be112af3b6a tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] [instance: 193235b9-8ef5-41d0-a9ab-4f1679d30266] Created local disks {{(pid=75176) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 15:52:42 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-23c04da6-7e02-46a4-b06b-2be112af3b6a tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] [instance: 193235b9-8ef5-41d0-a9ab-4f1679d30266] Ensure instance console log exists: /opt/stack/data/nova/instances/193235b9-8ef5-41d0-a9ab-4f1679d30266/console.log {{(pid=75176) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 15:52:42 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-23c04da6-7e02-46a4-b06b-2be112af3b6a tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:52:42 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-23c04da6-7e02-46a4-b06b-2be112af3b6a tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:52:42 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-23c04da6-7e02-46a4-b06b-2be112af3b6a tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:52:43 user nova-compute[75176]: DEBUG nova.network.neutron [None req-23c04da6-7e02-46a4-b06b-2be112af3b6a tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] [instance: 193235b9-8ef5-41d0-a9ab-4f1679d30266] Successfully updated port: 44024d49-7b6d-415a-a9eb-fe53b53da379 {{(pid=75176) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 15:52:43 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-23c04da6-7e02-46a4-b06b-2be112af3b6a tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Acquiring lock "refresh_cache-193235b9-8ef5-41d0-a9ab-4f1679d30266" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:52:43 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-23c04da6-7e02-46a4-b06b-2be112af3b6a tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Acquired lock "refresh_cache-193235b9-8ef5-41d0-a9ab-4f1679d30266" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:52:43 user nova-compute[75176]: DEBUG nova.network.neutron [None req-23c04da6-7e02-46a4-b06b-2be112af3b6a tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] [instance: 193235b9-8ef5-41d0-a9ab-4f1679d30266] Building network info cache for instance {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 15:52:43 user nova-compute[75176]: DEBUG nova.compute.manager [req-d29f0b90-7c35-4020-b830-2bd3aaee4f1a req-541fc837-3262-461e-b055-c38a0d983fae service nova] [instance: 193235b9-8ef5-41d0-a9ab-4f1679d30266] Received event network-changed-44024d49-7b6d-415a-a9eb-fe53b53da379 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:52:43 user nova-compute[75176]: DEBUG nova.compute.manager [req-d29f0b90-7c35-4020-b830-2bd3aaee4f1a req-541fc837-3262-461e-b055-c38a0d983fae service nova] [instance: 193235b9-8ef5-41d0-a9ab-4f1679d30266] Refreshing instance network info cache due to event network-changed-44024d49-7b6d-415a-a9eb-fe53b53da379. {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 15:52:43 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-d29f0b90-7c35-4020-b830-2bd3aaee4f1a req-541fc837-3262-461e-b055-c38a0d983fae service nova] Acquiring lock "refresh_cache-193235b9-8ef5-41d0-a9ab-4f1679d30266" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:52:43 user nova-compute[75176]: DEBUG nova.network.neutron [None req-23c04da6-7e02-46a4-b06b-2be112af3b6a tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] [instance: 193235b9-8ef5-41d0-a9ab-4f1679d30266] Instance cache missing network info. {{(pid=75176) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 15:52:43 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:52:43 user nova-compute[75176]: DEBUG nova.network.neutron [None req-23c04da6-7e02-46a4-b06b-2be112af3b6a tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] [instance: 193235b9-8ef5-41d0-a9ab-4f1679d30266] Updating instance_info_cache with network_info: [{"id": "44024d49-7b6d-415a-a9eb-fe53b53da379", "address": "fa:16:3e:21:d9:11", "network": {"id": "7ab60343-57be-427d-9037-6ecf0eaf5de0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1508138843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a194f81f7e104be7940d1d05f71bbad9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44024d49-7b", "ovs_interfaceid": "44024d49-7b6d-415a-a9eb-fe53b53da379", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:52:43 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-23c04da6-7e02-46a4-b06b-2be112af3b6a tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Releasing lock "refresh_cache-193235b9-8ef5-41d0-a9ab-4f1679d30266" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:52:43 user nova-compute[75176]: DEBUG nova.compute.manager [None req-23c04da6-7e02-46a4-b06b-2be112af3b6a tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] [instance: 193235b9-8ef5-41d0-a9ab-4f1679d30266] Instance network_info: |[{"id": "44024d49-7b6d-415a-a9eb-fe53b53da379", "address": "fa:16:3e:21:d9:11", "network": {"id": "7ab60343-57be-427d-9037-6ecf0eaf5de0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1508138843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a194f81f7e104be7940d1d05f71bbad9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44024d49-7b", "ovs_interfaceid": "44024d49-7b6d-415a-a9eb-fe53b53da379", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75176) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 15:52:43 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-d29f0b90-7c35-4020-b830-2bd3aaee4f1a req-541fc837-3262-461e-b055-c38a0d983fae service nova] Acquired lock "refresh_cache-193235b9-8ef5-41d0-a9ab-4f1679d30266" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:52:43 user nova-compute[75176]: DEBUG nova.network.neutron [req-d29f0b90-7c35-4020-b830-2bd3aaee4f1a req-541fc837-3262-461e-b055-c38a0d983fae service nova] [instance: 193235b9-8ef5-41d0-a9ab-4f1679d30266] Refreshing network info cache for port 44024d49-7b6d-415a-a9eb-fe53b53da379 {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 15:52:43 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-23c04da6-7e02-46a4-b06b-2be112af3b6a tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] [instance: 193235b9-8ef5-41d0-a9ab-4f1679d30266] Start _get_guest_xml network_info=[{"id": "44024d49-7b6d-415a-a9eb-fe53b53da379", "address": "fa:16:3e:21:d9:11", "network": {"id": "7ab60343-57be-427d-9037-6ecf0eaf5de0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1508138843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a194f81f7e104be7940d1d05f71bbad9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44024d49-7b", "ovs_interfaceid": "44024d49-7b6d-415a-a9eb-fe53b53da379", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T15:35:12Z,direct_url=<?>,disk_format='qcow2',id=1f41819e-c93f-4dc7-b253-37a27bbbbc74,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1b91c5d0672c4224a48df2e1f92688e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T15:35:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'size': 0, 'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'image_id': '1f41819e-c93f-4dc7-b253-37a27bbbbc74'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75176) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 15:52:43 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-23c04da6-7e02-46a4-b06b-2be112af3b6a tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 15:52:43 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-23c04da6-7e02-46a4-b06b-2be112af3b6a tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 15:52:43 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-23c04da6-7e02-46a4-b06b-2be112af3b6a tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75176) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 15:52:43 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-23c04da6-7e02-46a4-b06b-2be112af3b6a tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] CPU controller missing on host. {{(pid=75176) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 15:52:43 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-23c04da6-7e02-46a4-b06b-2be112af3b6a tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75176) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 15:52:43 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-23c04da6-7e02-46a4-b06b-2be112af3b6a tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] CPU controller found on host. {{(pid=75176) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 15:52:43 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-23c04da6-7e02-46a4-b06b-2be112af3b6a tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75176) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 15:52:43 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-23c04da6-7e02-46a4-b06b-2be112af3b6a tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T15:35:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T15:35:12Z,direct_url=<?>,disk_format='qcow2',id=1f41819e-c93f-4dc7-b253-37a27bbbbc74,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1b91c5d0672c4224a48df2e1f92688e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T15:35:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 15:52:43 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-23c04da6-7e02-46a4-b06b-2be112af3b6a tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Flavor limits 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 15:52:43 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-23c04da6-7e02-46a4-b06b-2be112af3b6a tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Image limits 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 15:52:43 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-23c04da6-7e02-46a4-b06b-2be112af3b6a tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Flavor pref 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 15:52:43 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-23c04da6-7e02-46a4-b06b-2be112af3b6a tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Image pref 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 15:52:43 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-23c04da6-7e02-46a4-b06b-2be112af3b6a tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 15:52:43 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-23c04da6-7e02-46a4-b06b-2be112af3b6a tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 15:52:43 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-23c04da6-7e02-46a4-b06b-2be112af3b6a tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75176) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 15:52:43 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-23c04da6-7e02-46a4-b06b-2be112af3b6a tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Got 1 possible topologies {{(pid=75176) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 15:52:43 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-23c04da6-7e02-46a4-b06b-2be112af3b6a tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 15:52:43 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-23c04da6-7e02-46a4-b06b-2be112af3b6a tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 15:52:43 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-23c04da6-7e02-46a4-b06b-2be112af3b6a tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T15:52:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1794209844',display_name='tempest-AttachVolumeNegativeTest-server-1794209844',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1794209844',id=37,image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGTxOfm1fi485fQCGM3mKeM4YdfflWo/HXai7jroVO5LkpL83smiyElCp44L7mLApfObOe8GGAjuxze4bn039XfAA4CeC5yfefDRI08N7t9fss1PS6g7R3hmYI3Xbtp5tQ==',key_name='tempest-keypair-2084612264',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a194f81f7e104be7940d1d05f71bbad9',ramdisk_id='',reservation_id='r-3kktfock',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1403590572',owner_user_name='tempest-AttachVolumeNegativeTest-1403590572-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T15:52:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f9a745552d974e05a9e0befc68eb7f6e',uuid=193235b9-8ef5-41d0-a9ab-4f1679d30266,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "44024d49-7b6d-415a-a9eb-fe53b53da379", "address": "fa:16:3e:21:d9:11", "network": {"id": "7ab60343-57be-427d-9037-6ecf0eaf5de0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1508138843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a194f81f7e104be7940d1d05f71bbad9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44024d49-7b", "ovs_interfaceid": "44024d49-7b6d-415a-a9eb-fe53b53da379", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75176) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 15:52:43 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-23c04da6-7e02-46a4-b06b-2be112af3b6a tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Converting VIF {"id": "44024d49-7b6d-415a-a9eb-fe53b53da379", "address": "fa:16:3e:21:d9:11", "network": {"id": "7ab60343-57be-427d-9037-6ecf0eaf5de0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1508138843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a194f81f7e104be7940d1d05f71bbad9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44024d49-7b", "ovs_interfaceid": "44024d49-7b6d-415a-a9eb-fe53b53da379", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:52:43 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-23c04da6-7e02-46a4-b06b-2be112af3b6a tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:d9:11,bridge_name='br-int',has_traffic_filtering=True,id=44024d49-7b6d-415a-a9eb-fe53b53da379,network=Network(7ab60343-57be-427d-9037-6ecf0eaf5de0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap44024d49-7b') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:52:43 user nova-compute[75176]: DEBUG nova.objects.instance [None req-23c04da6-7e02-46a4-b06b-2be112af3b6a tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Lazy-loading 'pci_devices' on Instance uuid 193235b9-8ef5-41d0-a9ab-4f1679d30266 {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:52:43 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-23c04da6-7e02-46a4-b06b-2be112af3b6a tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] [instance: 193235b9-8ef5-41d0-a9ab-4f1679d30266] End _get_guest_xml xml=<domain type="kvm">
Nov 28 15:52:43 user nova-compute[75176]:   <uuid>193235b9-8ef5-41d0-a9ab-4f1679d30266</uuid>
Nov 28 15:52:43 user nova-compute[75176]:   <name>instance-00000025</name>
Nov 28 15:52:43 user nova-compute[75176]:   <memory>524288</memory>
Nov 28 15:52:43 user nova-compute[75176]:   <vcpu>1</vcpu>
Nov 28 15:52:43 user nova-compute[75176]:   <metadata>
Nov 28 15:52:43 user nova-compute[75176]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 15:52:43 user nova-compute[75176]:       <nova:package version="0.0.0"/>
Nov 28 15:52:43 user nova-compute[75176]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1794209844</nova:name>
Nov 28 15:52:43 user nova-compute[75176]:       <nova:creationTime>2023-11-28 15:52:43</nova:creationTime>
Nov 28 15:52:43 user nova-compute[75176]:       <nova:flavor name="m1.tiny">
Nov 28 15:52:43 user nova-compute[75176]:         <nova:memory>512</nova:memory>
Nov 28 15:52:43 user nova-compute[75176]:         <nova:disk>1</nova:disk>
Nov 28 15:52:43 user nova-compute[75176]:         <nova:swap>0</nova:swap>
Nov 28 15:52:43 user nova-compute[75176]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 15:52:43 user nova-compute[75176]:         <nova:vcpus>1</nova:vcpus>
Nov 28 15:52:43 user nova-compute[75176]:       </nova:flavor>
Nov 28 15:52:43 user nova-compute[75176]:       <nova:owner>
Nov 28 15:52:43 user nova-compute[75176]:         <nova:user uuid="f9a745552d974e05a9e0befc68eb7f6e">tempest-AttachVolumeNegativeTest-1403590572-project-member</nova:user>
Nov 28 15:52:43 user nova-compute[75176]:         <nova:project uuid="a194f81f7e104be7940d1d05f71bbad9">tempest-AttachVolumeNegativeTest-1403590572</nova:project>
Nov 28 15:52:43 user nova-compute[75176]:       </nova:owner>
Nov 28 15:52:43 user nova-compute[75176]:       <nova:root type="image" uuid="1f41819e-c93f-4dc7-b253-37a27bbbbc74"/>
Nov 28 15:52:43 user nova-compute[75176]:       <nova:ports>
Nov 28 15:52:43 user nova-compute[75176]:         <nova:port uuid="44024d49-7b6d-415a-a9eb-fe53b53da379">
Nov 28 15:52:43 user nova-compute[75176]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 28 15:52:43 user nova-compute[75176]:         </nova:port>
Nov 28 15:52:43 user nova-compute[75176]:       </nova:ports>
Nov 28 15:52:43 user nova-compute[75176]:     </nova:instance>
Nov 28 15:52:43 user nova-compute[75176]:   </metadata>
Nov 28 15:52:43 user nova-compute[75176]:   <sysinfo type="smbios">
Nov 28 15:52:43 user nova-compute[75176]:     <system>
Nov 28 15:52:43 user nova-compute[75176]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 15:52:43 user nova-compute[75176]:       <entry name="product">OpenStack Nova</entry>
Nov 28 15:52:43 user nova-compute[75176]:       <entry name="version">0.0.0</entry>
Nov 28 15:52:43 user nova-compute[75176]:       <entry name="serial">193235b9-8ef5-41d0-a9ab-4f1679d30266</entry>
Nov 28 15:52:43 user nova-compute[75176]:       <entry name="uuid">193235b9-8ef5-41d0-a9ab-4f1679d30266</entry>
Nov 28 15:52:43 user nova-compute[75176]:       <entry name="family">Virtual Machine</entry>
Nov 28 15:52:43 user nova-compute[75176]:     </system>
Nov 28 15:52:43 user nova-compute[75176]:   </sysinfo>
Nov 28 15:52:43 user nova-compute[75176]:   <os>
Nov 28 15:52:43 user nova-compute[75176]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 15:52:43 user nova-compute[75176]:     <boot dev="hd"/>
Nov 28 15:52:43 user nova-compute[75176]:     <smbios mode="sysinfo"/>
Nov 28 15:52:43 user nova-compute[75176]:   </os>
Nov 28 15:52:43 user nova-compute[75176]:   <features>
Nov 28 15:52:43 user nova-compute[75176]:     <acpi/>
Nov 28 15:52:43 user nova-compute[75176]:     <apic/>
Nov 28 15:52:43 user nova-compute[75176]:     <vmcoreinfo/>
Nov 28 15:52:43 user nova-compute[75176]:   </features>
Nov 28 15:52:43 user nova-compute[75176]:   <clock offset="utc">
Nov 28 15:52:43 user nova-compute[75176]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 15:52:43 user nova-compute[75176]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 15:52:43 user nova-compute[75176]:     <timer name="hpet" present="no"/>
Nov 28 15:52:43 user nova-compute[75176]:   </clock>
Nov 28 15:52:43 user nova-compute[75176]:   <cpu mode="custom" match="exact">
Nov 28 15:52:43 user nova-compute[75176]:     <model>Nehalem</model>
Nov 28 15:52:43 user nova-compute[75176]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 15:52:43 user nova-compute[75176]:   </cpu>
Nov 28 15:52:43 user nova-compute[75176]:   <devices>
Nov 28 15:52:43 user nova-compute[75176]:     <disk type="file" device="disk">
Nov 28 15:52:43 user nova-compute[75176]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 15:52:43 user nova-compute[75176]:       <source file="/opt/stack/data/nova/instances/193235b9-8ef5-41d0-a9ab-4f1679d30266/disk"/>
Nov 28 15:52:43 user nova-compute[75176]:       <target dev="vda" bus="virtio"/>
Nov 28 15:52:43 user nova-compute[75176]:     </disk>
Nov 28 15:52:43 user nova-compute[75176]:     <interface type="ethernet">
Nov 28 15:52:43 user nova-compute[75176]:       <mac address="fa:16:3e:21:d9:11"/>
Nov 28 15:52:43 user nova-compute[75176]:       <model type="virtio"/>
Nov 28 15:52:43 user nova-compute[75176]:       <mtu size="1442"/>
Nov 28 15:52:43 user nova-compute[75176]:       <target dev="tap44024d49-7b"/>
Nov 28 15:52:43 user nova-compute[75176]:     </interface>
Nov 28 15:52:43 user nova-compute[75176]:     <serial type="pty">
Nov 28 15:52:43 user nova-compute[75176]:       <log file="/opt/stack/data/nova/instances/193235b9-8ef5-41d0-a9ab-4f1679d30266/console.log" append="off"/>
Nov 28 15:52:43 user nova-compute[75176]:     </serial>
Nov 28 15:52:43 user nova-compute[75176]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 15:52:43 user nova-compute[75176]:     <video>
Nov 28 15:52:43 user nova-compute[75176]:       <model type="virtio"/>
Nov 28 15:52:43 user nova-compute[75176]:     </video>
Nov 28 15:52:43 user nova-compute[75176]:     <rng model="virtio">
Nov 28 15:52:43 user nova-compute[75176]:       <backend model="random">/dev/urandom</backend>
Nov 28 15:52:43 user nova-compute[75176]:     </rng>
Nov 28 15:52:43 user nova-compute[75176]:     <controller type="usb" index="0" model="none"/>
Nov 28 15:52:43 user nova-compute[75176]:     <memballoon model="virtio">
Nov 28 15:52:43 user nova-compute[75176]:       <stats period="10"/>
Nov 28 15:52:43 user nova-compute[75176]:     </memballoon>
Nov 28 15:52:43 user nova-compute[75176]:   </devices>
Nov 28 15:52:43 user nova-compute[75176]: </domain>
Nov 28 15:52:43 user nova-compute[75176]:  {{(pid=75176) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 15:52:43 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-23c04da6-7e02-46a4-b06b-2be112af3b6a tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T15:52:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1794209844',display_name='tempest-AttachVolumeNegativeTest-server-1794209844',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1794209844',id=37,image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGTxOfm1fi485fQCGM3mKeM4YdfflWo/HXai7jroVO5LkpL83smiyElCp44L7mLApfObOe8GGAjuxze4bn039XfAA4CeC5yfefDRI08N7t9fss1PS6g7R3hmYI3Xbtp5tQ==',key_name='tempest-keypair-2084612264',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a194f81f7e104be7940d1d05f71bbad9',ramdisk_id='',reservation_id='r-3kktfock',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1403590572',owner_user_name='tempest-AttachVolumeNegativeTest-1403590572-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T15:52:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f9a745552d974e05a9e0befc68eb7f6e',uuid=193235b9-8ef5-41d0-a9ab-4f1679d30266,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "44024d49-7b6d-415a-a9eb-fe53b53da379", "address": "fa:16:3e:21:d9:11", "network": {"id": "7ab60343-57be-427d-9037-6ecf0eaf5de0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1508138843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a194f81f7e104be7940d1d05f71bbad9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44024d49-7b", "ovs_interfaceid": "44024d49-7b6d-415a-a9eb-fe53b53da379", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 15:52:43 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-23c04da6-7e02-46a4-b06b-2be112af3b6a tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Converting VIF {"id": "44024d49-7b6d-415a-a9eb-fe53b53da379", "address": "fa:16:3e:21:d9:11", "network": {"id": "7ab60343-57be-427d-9037-6ecf0eaf5de0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1508138843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a194f81f7e104be7940d1d05f71bbad9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44024d49-7b", "ovs_interfaceid": "44024d49-7b6d-415a-a9eb-fe53b53da379", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:52:43 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-23c04da6-7e02-46a4-b06b-2be112af3b6a tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:d9:11,bridge_name='br-int',has_traffic_filtering=True,id=44024d49-7b6d-415a-a9eb-fe53b53da379,network=Network(7ab60343-57be-427d-9037-6ecf0eaf5de0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap44024d49-7b') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:52:43 user nova-compute[75176]: DEBUG os_vif [None req-23c04da6-7e02-46a4-b06b-2be112af3b6a tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:d9:11,bridge_name='br-int',has_traffic_filtering=True,id=44024d49-7b6d-415a-a9eb-fe53b53da379,network=Network(7ab60343-57be-427d-9037-6ecf0eaf5de0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap44024d49-7b') {{(pid=75176) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 15:52:43 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:52:43 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:52:43 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 15:52:43 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:52:43 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '71aabe99-312f-5000-bcbe-1d27fb91f08b', '_type': 'linux-noop'}}, row=False) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:52:43 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:52:43 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:52:43 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:52:43 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap44024d49-7b, may_exist=True, interface_attrs={}) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:52:43 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap44024d49-7b, col_values=(('qos', UUID('13084b03-3a8f-45c8-9765-f6e8f0e8c07f')),), if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:52:43 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap44024d49-7b, col_values=(('external_ids', {'iface-id': '44024d49-7b6d-415a-a9eb-fe53b53da379', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:21:d9:11', 'vm-uuid': '193235b9-8ef5-41d0-a9ab-4f1679d30266'}),), if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:52:43 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:52:43 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:52:43 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:52:43 user nova-compute[75176]: INFO os_vif [None req-23c04da6-7e02-46a4-b06b-2be112af3b6a tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:d9:11,bridge_name='br-int',has_traffic_filtering=True,id=44024d49-7b6d-415a-a9eb-fe53b53da379,network=Network(7ab60343-57be-427d-9037-6ecf0eaf5de0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap44024d49-7b')
Nov 28 15:52:43 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-23c04da6-7e02-46a4-b06b-2be112af3b6a tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] No BDM found with device name vda, not building metadata. {{(pid=75176) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 15:52:43 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-23c04da6-7e02-46a4-b06b-2be112af3b6a tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] No VIF found with MAC fa:16:3e:21:d9:11, not building metadata {{(pid=75176) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 15:52:44 user nova-compute[75176]: DEBUG nova.network.neutron [req-d29f0b90-7c35-4020-b830-2bd3aaee4f1a req-541fc837-3262-461e-b055-c38a0d983fae service nova] [instance: 193235b9-8ef5-41d0-a9ab-4f1679d30266] Updated VIF entry in instance network info cache for port 44024d49-7b6d-415a-a9eb-fe53b53da379. {{(pid=75176) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 15:52:44 user nova-compute[75176]: DEBUG nova.network.neutron [req-d29f0b90-7c35-4020-b830-2bd3aaee4f1a req-541fc837-3262-461e-b055-c38a0d983fae service nova] [instance: 193235b9-8ef5-41d0-a9ab-4f1679d30266] Updating instance_info_cache with network_info: [{"id": "44024d49-7b6d-415a-a9eb-fe53b53da379", "address": "fa:16:3e:21:d9:11", "network": {"id": "7ab60343-57be-427d-9037-6ecf0eaf5de0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1508138843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a194f81f7e104be7940d1d05f71bbad9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44024d49-7b", "ovs_interfaceid": "44024d49-7b6d-415a-a9eb-fe53b53da379", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:52:44 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-d29f0b90-7c35-4020-b830-2bd3aaee4f1a req-541fc837-3262-461e-b055-c38a0d983fae service nova] Releasing lock "refresh_cache-193235b9-8ef5-41d0-a9ab-4f1679d30266" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:52:44 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:52:45 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:52:45 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:52:45 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:52:45 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:52:45 user nova-compute[75176]: DEBUG nova.compute.manager [req-1baa88e1-2eae-4ce1-b534-e3487f55e2b7 req-228f8d47-0bff-4007-9fc2-7a3f7fc4df5d service nova] [instance: 193235b9-8ef5-41d0-a9ab-4f1679d30266] Received event network-vif-plugged-44024d49-7b6d-415a-a9eb-fe53b53da379 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:52:45 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-1baa88e1-2eae-4ce1-b534-e3487f55e2b7 req-228f8d47-0bff-4007-9fc2-7a3f7fc4df5d service nova] Acquiring lock "193235b9-8ef5-41d0-a9ab-4f1679d30266-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:52:45 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-1baa88e1-2eae-4ce1-b534-e3487f55e2b7 req-228f8d47-0bff-4007-9fc2-7a3f7fc4df5d service nova] Lock "193235b9-8ef5-41d0-a9ab-4f1679d30266-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:52:45 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-1baa88e1-2eae-4ce1-b534-e3487f55e2b7 req-228f8d47-0bff-4007-9fc2-7a3f7fc4df5d service nova] Lock "193235b9-8ef5-41d0-a9ab-4f1679d30266-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:52:45 user nova-compute[75176]: DEBUG nova.compute.manager [req-1baa88e1-2eae-4ce1-b534-e3487f55e2b7 req-228f8d47-0bff-4007-9fc2-7a3f7fc4df5d service nova] [instance: 193235b9-8ef5-41d0-a9ab-4f1679d30266] No waiting events found dispatching network-vif-plugged-44024d49-7b6d-415a-a9eb-fe53b53da379 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:52:45 user nova-compute[75176]: WARNING nova.compute.manager [req-1baa88e1-2eae-4ce1-b534-e3487f55e2b7 req-228f8d47-0bff-4007-9fc2-7a3f7fc4df5d service nova] [instance: 193235b9-8ef5-41d0-a9ab-4f1679d30266] Received unexpected event network-vif-plugged-44024d49-7b6d-415a-a9eb-fe53b53da379 for instance with vm_state building and task_state spawning.
Nov 28 15:52:45 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:52:45 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:52:45 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:52:45 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-3494fde8-2f23-4569-b8ef-621d14f2b0d7 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] [instance: 6161cab2-eb1f-44cb-bbd5-077e6db42f77] Starting finish_migration {{(pid=75176) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11671}}
Nov 28 15:52:45 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-3494fde8-2f23-4569-b8ef-621d14f2b0d7 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] [instance: 6161cab2-eb1f-44cb-bbd5-077e6db42f77] Instance directory exists: not creating {{(pid=75176) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 28 15:52:45 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-3494fde8-2f23-4569-b8ef-621d14f2b0d7 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] [instance: 6161cab2-eb1f-44cb-bbd5-077e6db42f77] Creating image(s)
Nov 28 15:52:45 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-3494fde8-2f23-4569-b8ef-621d14f2b0d7 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] [instance: 6161cab2-eb1f-44cb-bbd5-077e6db42f77] Did not create local disks {{(pid=75176) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 28 15:52:45 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-3494fde8-2f23-4569-b8ef-621d14f2b0d7 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] [instance: 6161cab2-eb1f-44cb-bbd5-077e6db42f77] Ensure instance console log exists: /opt/stack/data/nova/instances/6161cab2-eb1f-44cb-bbd5-077e6db42f77/console.log {{(pid=75176) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 15:52:45 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-3494fde8-2f23-4569-b8ef-621d14f2b0d7 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:52:45 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-3494fde8-2f23-4569-b8ef-621d14f2b0d7 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:52:45 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-3494fde8-2f23-4569-b8ef-621d14f2b0d7 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:52:45 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-3494fde8-2f23-4569-b8ef-621d14f2b0d7 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] [instance: 6161cab2-eb1f-44cb-bbd5-077e6db42f77] Start _get_guest_xml network_info=[{"id": "f2811544-4cf2-4302-b012-8bf1881b9b6c", "address": "fa:16:3e:2a:df:42", "network": {"id": "8b63f2d3-0683-4832-abc5-e4c796cf12ab", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-877608435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-877608435-network", "vif_mac": "fa:16:3e:2a:df:42"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3704b38a2bd44cb78c28d3f6d86d9e60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2811544-4c", "ovs_interfaceid": "f2811544-4cf2-4302-b012-8bf1881b9b6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zMZSixul', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '6161cab2-eb1f-44cb-bbd5-077e6db42f77', 'attached_at': '2023-11-28T15:52:46.000000', 'detached_at': '', 'volume_id': 'd3e5eacd-1738-4959-be40-6d99da8776fc', 'serial': 'd3e5eacd-1738-4959-be40-6d99da8776fc'}, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'delete_on_termination': True, 'mount_device': '/dev/vda', 'attachment_id': '53618b8b-faf0-4428-b311-5f902bfe22fd', 'volume_type': None} {{(pid=75176) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 15:52:45 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-3494fde8-2f23-4569-b8ef-621d14f2b0d7 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 15:52:45 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-3494fde8-2f23-4569-b8ef-621d14f2b0d7 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 15:52:45 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-3494fde8-2f23-4569-b8ef-621d14f2b0d7 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75176) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 15:52:45 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-3494fde8-2f23-4569-b8ef-621d14f2b0d7 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] CPU controller missing on host. {{(pid=75176) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 15:52:45 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-3494fde8-2f23-4569-b8ef-621d14f2b0d7 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75176) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 15:52:45 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-3494fde8-2f23-4569-b8ef-621d14f2b0d7 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] CPU controller found on host. {{(pid=75176) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 15:52:45 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-3494fde8-2f23-4569-b8ef-621d14f2b0d7 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75176) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 15:52:45 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-3494fde8-2f23-4569-b8ef-621d14f2b0d7 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T15:35:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 15:52:45 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-3494fde8-2f23-4569-b8ef-621d14f2b0d7 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Flavor limits 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 15:52:45 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-3494fde8-2f23-4569-b8ef-621d14f2b0d7 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Image limits 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 15:52:45 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-3494fde8-2f23-4569-b8ef-621d14f2b0d7 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Flavor pref 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 15:52:45 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-3494fde8-2f23-4569-b8ef-621d14f2b0d7 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Image pref 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 15:52:45 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-3494fde8-2f23-4569-b8ef-621d14f2b0d7 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 15:52:45 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-3494fde8-2f23-4569-b8ef-621d14f2b0d7 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 15:52:45 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-3494fde8-2f23-4569-b8ef-621d14f2b0d7 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75176) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 15:52:45 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-3494fde8-2f23-4569-b8ef-621d14f2b0d7 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Got 1 possible topologies {{(pid=75176) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 15:52:45 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-3494fde8-2f23-4569-b8ef-621d14f2b0d7 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 15:52:45 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-3494fde8-2f23-4569-b8ef-621d14f2b0d7 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 15:52:45 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3494fde8-2f23-4569-b8ef-621d14f2b0d7 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] [instance: 6161cab2-eb1f-44cb-bbd5-077e6db42f77] Calling os-brick to attach iSCSI Volume {{(pid=75176) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 15:52:45 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-3494fde8-2f23-4569-b8ef-621d14f2b0d7 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c1b8a00>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zMZSixul', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 15:52:45 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-3494fde8-2f23-4569-b8ef-621d14f2b0d7 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 15:52:45 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-3494fde8-2f23-4569-b8ef-621d14f2b0d7 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 15:52:45 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-3494fde8-2f23-4569-b8ef-621d14f2b0d7 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 15:52:45 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-3494fde8-2f23-4569-b8ef-621d14f2b0d7 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 15:52:45 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-3494fde8-2f23-4569-b8ef-621d14f2b0d7 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 15:52:45 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-3494fde8-2f23-4569-b8ef-621d14f2b0d7 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 15:52:45 user nova-compute[75176]: INFO os_brick.initiator.connectors.iscsi [None req-3494fde8-2f23-4569-b8ef-621d14f2b0d7 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 15:52:45 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc -p 172.16.0.220:3260 {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:52:45 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:52:45 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[867b0e61-116c-4816-90e3-626faa49206f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:52:45 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-3494fde8-2f23-4569-b8ef-621d14f2b0d7 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 15:52:45 user nova-compute[75176]:  {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:52:45 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc -p 172.16.0.220:3260 --interface default --op new {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:52:45 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:52:45 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[7830da23-743d-4d58-ab61-c1c18c8d04e1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc] added\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:52:45 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-3494fde8-2f23-4569-b8ef-621d14f2b0d7 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc] added
Nov 28 15:52:45 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:52:45 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:52:45 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:52:45 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[22ac9e48-57ab-42a4-a1ca-3e1e70bbf22f]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:52:45 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-3494fde8-2f23-4569-b8ef-621d14f2b0d7 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:52:45 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:52:45 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:52:45 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[94e78b54-27ea-4b90-9f89-7f440d12f9ee]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:52:45 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-3494fde8-2f23-4569-b8ef-621d14f2b0d7 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:52:45 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zMZSixul {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:52:45 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zMZSixul" returned: 0 in 0.018s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:52:45 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[1da8c0af-4550-4007-b203-5fe84f31707a]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:52:45 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-3494fde8-2f23-4569-b8ef-621d14f2b0d7 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zMZSixul'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:52:45 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:52:45 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:52:45 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb02329d-f321-4102-ba7e-977f2939a98c]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:52:45 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-3494fde8-2f23-4569-b8ef-621d14f2b0d7 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:52:45 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:52:46 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:52:46 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2c434b7-1af9-4f10-ab29-213d4f4a9702]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8452525c-6845-4edb-bf69-1e2ffe0ef2eb (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22933c6e-3d8f-44f5-bc41-dee97c587055 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 (non-flash)\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:52:46 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-3494fde8-2f23-4569-b8ef-621d14f2b0d7 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8452525c-6845-4edb-bf69-1e2ffe0ef2eb (non-flash)
Nov 28 15:52:46 user nova-compute[75176]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22933c6e-3d8f-44f5-bc41-dee97c587055 (non-flash)
Nov 28 15:52:46 user nova-compute[75176]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 (non-flash)
Nov 28 15:52:46 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:52:46 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-3494fde8-2f23-4569-b8ef-621d14f2b0d7 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8452525c-6845-4edb-bf69-1e2ffe0ef2eb (non-flash)
Nov 28 15:52:46 user nova-compute[75176]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22933c6e-3d8f-44f5-bc41-dee97c587055 (non-flash)
Nov 28 15:52:46 user nova-compute[75176]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 (non-flash)
Nov 28 15:52:46 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 15:52:46 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc -p 172.16.0.220:3260 --login {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:52:46 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:52:46 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[71b36d7f-b232-4825-b6c0-5ddbc13f2175]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:52:46 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-3494fde8-2f23-4569-b8ef-621d14f2b0d7 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc, portal: 172.16.0.220,3260]
Nov 28 15:52:46 user nova-compute[75176]: Login to [iface: default, target: iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc, portal: 172.16.0.220,3260] successful.
Nov 28 15:52:46 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:52:46 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:52:46 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:52:46 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[fadf17c0-fa0f-4c51-85c4-0547f1df03d8]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:52:46 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-3494fde8-2f23-4569-b8ef-621d14f2b0d7 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:52:46 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:52:46 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:52:46 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c01da39-0d96-44c1-b501-cfc35f76e9fa]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8452525c-6845-4edb-bf69-1e2ffe0ef2eb (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22933c6e-3d8f-44f5-bc41-dee97c587055 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc (non-flash)\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:52:46 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-3494fde8-2f23-4569-b8ef-621d14f2b0d7 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8452525c-6845-4edb-bf69-1e2ffe0ef2eb (non-flash)
Nov 28 15:52:46 user nova-compute[75176]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22933c6e-3d8f-44f5-bc41-dee97c587055 (non-flash)
Nov 28 15:52:46 user nova-compute[75176]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 (non-flash)
Nov 28 15:52:46 user nova-compute[75176]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc (non-flash)
Nov 28 15:52:46 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:52:46 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-3494fde8-2f23-4569-b8ef-621d14f2b0d7 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8452525c-6845-4edb-bf69-1e2ffe0ef2eb (non-flash)
Nov 28 15:52:46 user nova-compute[75176]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22933c6e-3d8f-44f5-bc41-dee97c587055 (non-flash)
Nov 28 15:52:46 user nova-compute[75176]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 (non-flash)
Nov 28 15:52:46 user nova-compute[75176]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc (non-flash)
Nov 28 15:52:46 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 15:52:46 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-3494fde8-2f23-4569-b8ef-621d14f2b0d7 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.304s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 15:52:46 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-3494fde8-2f23-4569-b8ef-621d14f2b0d7 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Connected to 172.16.0.220:3260 {{(pid=75176) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 15:52:46 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-3494fde8-2f23-4569-b8ef-621d14f2b0d7 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] HCTL ('36', '-', '-', 0) found on session 41 with lun 0 {{(pid=75176) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 15:52:46 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-3494fde8-2f23-4569-b8ef-621d14f2b0d7 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75176) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 15:52:46 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:52:46 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.030s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:52:46 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1652c69-2cb0-43a5-8665-c34f31b99b98]: (4, ('- - 0', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:52:46 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-3494fde8-2f23-4569-b8ef-621d14f2b0d7 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Searching for a device in session 41 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75176) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 15:52:46 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-3494fde8-2f23-4569-b8ef-621d14f2b0d7 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zMZSixul', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75176) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 15:52:47 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-3494fde8-2f23-4569-b8ef-621d14f2b0d7 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.354s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 15:52:47 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-3494fde8-2f23-4569-b8ef-621d14f2b0d7 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] <== connect_volume: return (1355ms) {'type': 'block', 'scsi_wwn': '23238666262633737', 'path': '/dev/sde'} {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 15:52:47 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3494fde8-2f23-4569-b8ef-621d14f2b0d7 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] [instance: 6161cab2-eb1f-44cb-bbd5-077e6db42f77] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23238666262633737', 'path': '/dev/sde'} {{(pid=75176) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 15:52:47 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-3494fde8-2f23-4569-b8ef-621d14f2b0d7 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T15:50:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-572538979',display_name='tempest-ServerActionsTestOtherA-server-572538979',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-572538979',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOMWl0O1/eKbWND/zyjGraAKxeAyZ2R2+QgHiQ80zmzsi5uDkOgtIp8e2HjbFwlKUWmHgZppW6LnrIueD7TS7l/EkNAyCl7Y/pD0TSC3H7ZDLxYbZaFDAxH/uT7EnME+ig==',key_name='tempest-keypair-740685341',keypairs=<?>,launch_index=0,launched_at=2023-11-28T15:50:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3704b38a2bd44cb78c28d3f6d86d9e60',ramdisk_id='',reservation_id='r-s3c8yj7d',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-680502445',owner_user_name='tempest-ServerActionsTestOtherA-680502445-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T15:52:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d028b79a105b485dbb0178c9da162640',uuid=6161cab2-eb1f-44cb-bbd5-077e6db42f77,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f2811544-4cf2-4302-b012-8bf1881b9b6c", "address": "fa:16:3e:2a:df:42", "network": {"id": "8b63f2d3-0683-4832-abc5-e4c796cf12ab", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-877608435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-877608435-network", "vif_mac": "fa:16:3e:2a:df:42"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3704b38a2bd44cb78c28d3f6d86d9e60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2811544-4c", "ovs_interfaceid": "f2811544-4cf2-4302-b012-8bf1881b9b6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75176) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 15:52:47 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-3494fde8-2f23-4569-b8ef-621d14f2b0d7 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Converting VIF {"id": "f2811544-4cf2-4302-b012-8bf1881b9b6c", "address": "fa:16:3e:2a:df:42", "network": {"id": "8b63f2d3-0683-4832-abc5-e4c796cf12ab", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-877608435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-877608435-network", "vif_mac": "fa:16:3e:2a:df:42"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3704b38a2bd44cb78c28d3f6d86d9e60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2811544-4c", "ovs_interfaceid": "f2811544-4cf2-4302-b012-8bf1881b9b6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:52:47 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-3494fde8-2f23-4569-b8ef-621d14f2b0d7 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2a:df:42,bridge_name='br-int',has_traffic_filtering=True,id=f2811544-4cf2-4302-b012-8bf1881b9b6c,network=Network(8b63f2d3-0683-4832-abc5-e4c796cf12ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2811544-4c') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:52:47 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-3494fde8-2f23-4569-b8ef-621d14f2b0d7 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] [instance: 6161cab2-eb1f-44cb-bbd5-077e6db42f77] End _get_guest_xml xml=<domain type="kvm">
Nov 28 15:52:47 user nova-compute[75176]:   <uuid>6161cab2-eb1f-44cb-bbd5-077e6db42f77</uuid>
Nov 28 15:52:47 user nova-compute[75176]:   <name>instance-00000022</name>
Nov 28 15:52:47 user nova-compute[75176]:   <memory>2097152</memory>
Nov 28 15:52:47 user nova-compute[75176]:   <vcpu>1</vcpu>
Nov 28 15:52:47 user nova-compute[75176]:   <metadata>
Nov 28 15:52:47 user nova-compute[75176]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 15:52:47 user nova-compute[75176]:       <nova:package version="0.0.0"/>
Nov 28 15:52:47 user nova-compute[75176]:       <nova:name>tempest-ServerActionsTestOtherA-server-572538979</nova:name>
Nov 28 15:52:47 user nova-compute[75176]:       <nova:creationTime>2023-11-28 15:52:45</nova:creationTime>
Nov 28 15:52:47 user nova-compute[75176]:       <nova:flavor name="m1.small">
Nov 28 15:52:47 user nova-compute[75176]:         <nova:memory>2048</nova:memory>
Nov 28 15:52:47 user nova-compute[75176]:         <nova:disk>20</nova:disk>
Nov 28 15:52:47 user nova-compute[75176]:         <nova:swap>0</nova:swap>
Nov 28 15:52:47 user nova-compute[75176]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 15:52:47 user nova-compute[75176]:         <nova:vcpus>1</nova:vcpus>
Nov 28 15:52:47 user nova-compute[75176]:       </nova:flavor>
Nov 28 15:52:47 user nova-compute[75176]:       <nova:owner>
Nov 28 15:52:47 user nova-compute[75176]:         <nova:user uuid="d028b79a105b485dbb0178c9da162640">tempest-ServerActionsTestOtherA-680502445-project-member</nova:user>
Nov 28 15:52:47 user nova-compute[75176]:         <nova:project uuid="3704b38a2bd44cb78c28d3f6d86d9e60">tempest-ServerActionsTestOtherA-680502445</nova:project>
Nov 28 15:52:47 user nova-compute[75176]:       </nova:owner>
Nov 28 15:52:47 user nova-compute[75176]:       <nova:ports>
Nov 28 15:52:47 user nova-compute[75176]:         <nova:port uuid="f2811544-4cf2-4302-b012-8bf1881b9b6c">
Nov 28 15:52:47 user nova-compute[75176]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 28 15:52:47 user nova-compute[75176]:         </nova:port>
Nov 28 15:52:47 user nova-compute[75176]:       </nova:ports>
Nov 28 15:52:47 user nova-compute[75176]:     </nova:instance>
Nov 28 15:52:47 user nova-compute[75176]:   </metadata>
Nov 28 15:52:47 user nova-compute[75176]:   <sysinfo type="smbios">
Nov 28 15:52:47 user nova-compute[75176]:     <system>
Nov 28 15:52:47 user nova-compute[75176]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 15:52:47 user nova-compute[75176]:       <entry name="product">OpenStack Nova</entry>
Nov 28 15:52:47 user nova-compute[75176]:       <entry name="version">0.0.0</entry>
Nov 28 15:52:47 user nova-compute[75176]:       <entry name="serial">6161cab2-eb1f-44cb-bbd5-077e6db42f77</entry>
Nov 28 15:52:47 user nova-compute[75176]:       <entry name="uuid">6161cab2-eb1f-44cb-bbd5-077e6db42f77</entry>
Nov 28 15:52:47 user nova-compute[75176]:       <entry name="family">Virtual Machine</entry>
Nov 28 15:52:47 user nova-compute[75176]:     </system>
Nov 28 15:52:47 user nova-compute[75176]:   </sysinfo>
Nov 28 15:52:47 user nova-compute[75176]:   <os>
Nov 28 15:52:47 user nova-compute[75176]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 15:52:47 user nova-compute[75176]:     <boot dev="hd"/>
Nov 28 15:52:47 user nova-compute[75176]:     <smbios mode="sysinfo"/>
Nov 28 15:52:47 user nova-compute[75176]:   </os>
Nov 28 15:52:47 user nova-compute[75176]:   <features>
Nov 28 15:52:47 user nova-compute[75176]:     <acpi/>
Nov 28 15:52:47 user nova-compute[75176]:     <apic/>
Nov 28 15:52:47 user nova-compute[75176]:     <vmcoreinfo/>
Nov 28 15:52:47 user nova-compute[75176]:   </features>
Nov 28 15:52:47 user nova-compute[75176]:   <clock offset="utc">
Nov 28 15:52:47 user nova-compute[75176]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 15:52:47 user nova-compute[75176]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 15:52:47 user nova-compute[75176]:     <timer name="hpet" present="no"/>
Nov 28 15:52:47 user nova-compute[75176]:   </clock>
Nov 28 15:52:47 user nova-compute[75176]:   <cpu mode="custom" match="exact">
Nov 28 15:52:47 user nova-compute[75176]:     <model>Nehalem</model>
Nov 28 15:52:47 user nova-compute[75176]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 15:52:47 user nova-compute[75176]:   </cpu>
Nov 28 15:52:47 user nova-compute[75176]:   <devices>
Nov 28 15:52:47 user nova-compute[75176]:     <disk type="block" device="disk">
Nov 28 15:52:47 user nova-compute[75176]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 15:52:47 user nova-compute[75176]:       <source dev="/dev/sde"/>
Nov 28 15:52:47 user nova-compute[75176]:       <target dev="vda" bus="virtio"/>
Nov 28 15:52:47 user nova-compute[75176]:       <serial>d3e5eacd-1738-4959-be40-6d99da8776fc</serial>
Nov 28 15:52:47 user nova-compute[75176]:     </disk>
Nov 28 15:52:47 user nova-compute[75176]:     <interface type="ethernet">
Nov 28 15:52:47 user nova-compute[75176]:       <mac address="fa:16:3e:2a:df:42"/>
Nov 28 15:52:47 user nova-compute[75176]:       <model type="virtio"/>
Nov 28 15:52:47 user nova-compute[75176]:       <mtu size="1442"/>
Nov 28 15:52:47 user nova-compute[75176]:       <target dev="tapf2811544-4c"/>
Nov 28 15:52:47 user nova-compute[75176]:     </interface>
Nov 28 15:52:47 user nova-compute[75176]:     <serial type="pty">
Nov 28 15:52:47 user nova-compute[75176]:       <log file="/opt/stack/data/nova/instances/6161cab2-eb1f-44cb-bbd5-077e6db42f77/console.log" append="off"/>
Nov 28 15:52:47 user nova-compute[75176]:     </serial>
Nov 28 15:52:47 user nova-compute[75176]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 15:52:47 user nova-compute[75176]:     <video>
Nov 28 15:52:47 user nova-compute[75176]:       <model type="virtio"/>
Nov 28 15:52:47 user nova-compute[75176]:     </video>
Nov 28 15:52:47 user nova-compute[75176]:     <rng model="virtio">
Nov 28 15:52:47 user nova-compute[75176]:       <backend model="random">/dev/urandom</backend>
Nov 28 15:52:47 user nova-compute[75176]:     </rng>
Nov 28 15:52:47 user nova-compute[75176]:     <controller type="usb" index="0" model="none"/>
Nov 28 15:52:47 user nova-compute[75176]:     <memballoon model="virtio">
Nov 28 15:52:47 user nova-compute[75176]:       <stats period="10"/>
Nov 28 15:52:47 user nova-compute[75176]:     </memballoon>
Nov 28 15:52:47 user nova-compute[75176]:   </devices>
Nov 28 15:52:47 user nova-compute[75176]: </domain>
Nov 28 15:52:47 user nova-compute[75176]:  {{(pid=75176) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 15:52:47 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-3494fde8-2f23-4569-b8ef-621d14f2b0d7 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T15:50:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-572538979',display_name='tempest-ServerActionsTestOtherA-server-572538979',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-572538979',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOMWl0O1/eKbWND/zyjGraAKxeAyZ2R2+QgHiQ80zmzsi5uDkOgtIp8e2HjbFwlKUWmHgZppW6LnrIueD7TS7l/EkNAyCl7Y/pD0TSC3H7ZDLxYbZaFDAxH/uT7EnME+ig==',key_name='tempest-keypair-740685341',keypairs=<?>,launch_index=0,launched_at=2023-11-28T15:50:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3704b38a2bd44cb78c28d3f6d86d9e60',ramdisk_id='',reservation_id='r-s3c8yj7d',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-680502445',owner_user_name='tempest-ServerActionsTestOtherA-680502445-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T15:52:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d028b79a105b485dbb0178c9da162640',uuid=6161cab2-eb1f-44cb-bbd5-077e6db42f77,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f2811544-4cf2-4302-b012-8bf1881b9b6c", "address": "fa:16:3e:2a:df:42", "network": {"id": "8b63f2d3-0683-4832-abc5-e4c796cf12ab", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-877608435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-877608435-network", "vif_mac": "fa:16:3e:2a:df:42"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3704b38a2bd44cb78c28d3f6d86d9e60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2811544-4c", "ovs_interfaceid": "f2811544-4cf2-4302-b012-8bf1881b9b6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 15:52:47 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-3494fde8-2f23-4569-b8ef-621d14f2b0d7 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Converting VIF {"id": "f2811544-4cf2-4302-b012-8bf1881b9b6c", "address": "fa:16:3e:2a:df:42", "network": {"id": "8b63f2d3-0683-4832-abc5-e4c796cf12ab", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-877608435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-877608435-network", "vif_mac": "fa:16:3e:2a:df:42"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3704b38a2bd44cb78c28d3f6d86d9e60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2811544-4c", "ovs_interfaceid": "f2811544-4cf2-4302-b012-8bf1881b9b6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:52:47 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-3494fde8-2f23-4569-b8ef-621d14f2b0d7 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2a:df:42,bridge_name='br-int',has_traffic_filtering=True,id=f2811544-4cf2-4302-b012-8bf1881b9b6c,network=Network(8b63f2d3-0683-4832-abc5-e4c796cf12ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2811544-4c') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:52:47 user nova-compute[75176]: DEBUG os_vif [None req-3494fde8-2f23-4569-b8ef-621d14f2b0d7 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2a:df:42,bridge_name='br-int',has_traffic_filtering=True,id=f2811544-4cf2-4302-b012-8bf1881b9b6c,network=Network(8b63f2d3-0683-4832-abc5-e4c796cf12ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2811544-4c') {{(pid=75176) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 15:52:47 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:52:47 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:52:47 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 15:52:47 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:52:47 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '139691a1-84a4-5877-a52a-7e8d4cdf6301', '_type': 'linux-noop'}}, row=False) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:52:47 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:52:47 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:52:47 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:52:47 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf2811544-4c, may_exist=True, interface_attrs={}) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:52:47 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf2811544-4c, col_values=(('qos', UUID('70202cbb-ad90-469b-9b6a-97de42634b0d')),), if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:52:47 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf2811544-4c, col_values=(('external_ids', {'iface-id': 'f2811544-4cf2-4302-b012-8bf1881b9b6c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2a:df:42', 'vm-uuid': '6161cab2-eb1f-44cb-bbd5-077e6db42f77'}),), if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:52:47 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:52:47 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:52:47 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:52:47 user nova-compute[75176]: INFO os_vif [None req-3494fde8-2f23-4569-b8ef-621d14f2b0d7 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2a:df:42,bridge_name='br-int',has_traffic_filtering=True,id=f2811544-4cf2-4302-b012-8bf1881b9b6c,network=Network(8b63f2d3-0683-4832-abc5-e4c796cf12ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2811544-4c')
Nov 28 15:52:47 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-3494fde8-2f23-4569-b8ef-621d14f2b0d7 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] No BDM found with device name vda, not building metadata. {{(pid=75176) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 15:52:47 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-3494fde8-2f23-4569-b8ef-621d14f2b0d7 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] No VIF found with MAC fa:16:3e:2a:df:42, not building metadata {{(pid=75176) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 15:52:47 user nova-compute[75176]: DEBUG nova.compute.manager [None req-23c04da6-7e02-46a4-b06b-2be112af3b6a tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] [instance: 193235b9-8ef5-41d0-a9ab-4f1679d30266] Instance event wait completed in 0 seconds for  {{(pid=75176) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 15:52:47 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-23c04da6-7e02-46a4-b06b-2be112af3b6a tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] [instance: 193235b9-8ef5-41d0-a9ab-4f1679d30266] Guest created on hypervisor {{(pid=75176) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 15:52:47 user nova-compute[75176]: DEBUG nova.compute.manager [req-9a25e0ef-4e26-409b-8cb1-3e73e916c8e7 req-2e493e9d-191f-4c99-9b2a-3824546760f3 service nova] [instance: 193235b9-8ef5-41d0-a9ab-4f1679d30266] Received event network-vif-plugged-44024d49-7b6d-415a-a9eb-fe53b53da379 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:52:47 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-9a25e0ef-4e26-409b-8cb1-3e73e916c8e7 req-2e493e9d-191f-4c99-9b2a-3824546760f3 service nova] Acquiring lock "193235b9-8ef5-41d0-a9ab-4f1679d30266-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:52:47 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-9a25e0ef-4e26-409b-8cb1-3e73e916c8e7 req-2e493e9d-191f-4c99-9b2a-3824546760f3 service nova] Lock "193235b9-8ef5-41d0-a9ab-4f1679d30266-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:52:47 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-9a25e0ef-4e26-409b-8cb1-3e73e916c8e7 req-2e493e9d-191f-4c99-9b2a-3824546760f3 service nova] Lock "193235b9-8ef5-41d0-a9ab-4f1679d30266-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:52:47 user nova-compute[75176]: DEBUG nova.compute.manager [req-9a25e0ef-4e26-409b-8cb1-3e73e916c8e7 req-2e493e9d-191f-4c99-9b2a-3824546760f3 service nova] [instance: 193235b9-8ef5-41d0-a9ab-4f1679d30266] No waiting events found dispatching network-vif-plugged-44024d49-7b6d-415a-a9eb-fe53b53da379 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:52:47 user nova-compute[75176]: WARNING nova.compute.manager [req-9a25e0ef-4e26-409b-8cb1-3e73e916c8e7 req-2e493e9d-191f-4c99-9b2a-3824546760f3 service nova] [instance: 193235b9-8ef5-41d0-a9ab-4f1679d30266] Received unexpected event network-vif-plugged-44024d49-7b6d-415a-a9eb-fe53b53da379 for instance with vm_state building and task_state spawning.
Nov 28 15:52:47 user nova-compute[75176]: INFO nova.virt.libvirt.driver [-] [instance: 193235b9-8ef5-41d0-a9ab-4f1679d30266] Instance spawned successfully.
Nov 28 15:52:47 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-23c04da6-7e02-46a4-b06b-2be112af3b6a tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] [instance: 193235b9-8ef5-41d0-a9ab-4f1679d30266] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 15:52:47 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-23c04da6-7e02-46a4-b06b-2be112af3b6a tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] [instance: 193235b9-8ef5-41d0-a9ab-4f1679d30266] Found default for hw_cdrom_bus of ide {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:52:47 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-23c04da6-7e02-46a4-b06b-2be112af3b6a tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] [instance: 193235b9-8ef5-41d0-a9ab-4f1679d30266] Found default for hw_disk_bus of virtio {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:52:47 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-23c04da6-7e02-46a4-b06b-2be112af3b6a tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] [instance: 193235b9-8ef5-41d0-a9ab-4f1679d30266] Found default for hw_input_bus of None {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:52:47 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-23c04da6-7e02-46a4-b06b-2be112af3b6a tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] [instance: 193235b9-8ef5-41d0-a9ab-4f1679d30266] Found default for hw_pointer_model of None {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:52:47 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-23c04da6-7e02-46a4-b06b-2be112af3b6a tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] [instance: 193235b9-8ef5-41d0-a9ab-4f1679d30266] Found default for hw_video_model of virtio {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:52:47 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-23c04da6-7e02-46a4-b06b-2be112af3b6a tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] [instance: 193235b9-8ef5-41d0-a9ab-4f1679d30266] Found default for hw_vif_model of virtio {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:52:47 user nova-compute[75176]: INFO nova.compute.manager [None req-23c04da6-7e02-46a4-b06b-2be112af3b6a tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] [instance: 193235b9-8ef5-41d0-a9ab-4f1679d30266] Took 5.73 seconds to spawn the instance on the hypervisor.
Nov 28 15:52:47 user nova-compute[75176]: DEBUG nova.compute.manager [None req-23c04da6-7e02-46a4-b06b-2be112af3b6a tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] [instance: 193235b9-8ef5-41d0-a9ab-4f1679d30266] Checking state {{(pid=75176) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 15:52:47 user nova-compute[75176]: INFO nova.compute.manager [None req-23c04da6-7e02-46a4-b06b-2be112af3b6a tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] [instance: 193235b9-8ef5-41d0-a9ab-4f1679d30266] Took 6.72 seconds to build instance.
Nov 28 15:52:47 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-23c04da6-7e02-46a4-b06b-2be112af3b6a tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Lock "193235b9-8ef5-41d0-a9ab-4f1679d30266" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.817s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:52:48 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:52:48 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:52:48 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:52:48 user nova-compute[75176]: DEBUG nova.compute.manager [req-c784f236-0d21-4d22-bbc8-eaf7f72f0f19 req-bc8a9bf4-ad25-46ad-8d4d-6b0085d1a3e6 service nova] [instance: 6161cab2-eb1f-44cb-bbd5-077e6db42f77] Received event network-vif-plugged-f2811544-4cf2-4302-b012-8bf1881b9b6c {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:52:48 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-c784f236-0d21-4d22-bbc8-eaf7f72f0f19 req-bc8a9bf4-ad25-46ad-8d4d-6b0085d1a3e6 service nova] Acquiring lock "6161cab2-eb1f-44cb-bbd5-077e6db42f77-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:52:48 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-c784f236-0d21-4d22-bbc8-eaf7f72f0f19 req-bc8a9bf4-ad25-46ad-8d4d-6b0085d1a3e6 service nova] Lock "6161cab2-eb1f-44cb-bbd5-077e6db42f77-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:52:48 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-c784f236-0d21-4d22-bbc8-eaf7f72f0f19 req-bc8a9bf4-ad25-46ad-8d4d-6b0085d1a3e6 service nova] Lock "6161cab2-eb1f-44cb-bbd5-077e6db42f77-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:52:48 user nova-compute[75176]: DEBUG nova.compute.manager [req-c784f236-0d21-4d22-bbc8-eaf7f72f0f19 req-bc8a9bf4-ad25-46ad-8d4d-6b0085d1a3e6 service nova] [instance: 6161cab2-eb1f-44cb-bbd5-077e6db42f77] No waiting events found dispatching network-vif-plugged-f2811544-4cf2-4302-b012-8bf1881b9b6c {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:52:48 user nova-compute[75176]: WARNING nova.compute.manager [req-c784f236-0d21-4d22-bbc8-eaf7f72f0f19 req-bc8a9bf4-ad25-46ad-8d4d-6b0085d1a3e6 service nova] [instance: 6161cab2-eb1f-44cb-bbd5-077e6db42f77] Received unexpected event network-vif-plugged-f2811544-4cf2-4302-b012-8bf1881b9b6c for instance with vm_state active and task_state resize_finish.
Nov 28 15:52:48 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:52:49 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:52:50 user nova-compute[75176]: DEBUG nova.compute.manager [None req-3494fde8-2f23-4569-b8ef-621d14f2b0d7 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] [instance: 6161cab2-eb1f-44cb-bbd5-077e6db42f77] Instance event wait completed in 0 seconds for  {{(pid=75176) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 15:52:50 user nova-compute[75176]: INFO nova.virt.libvirt.driver [-] [instance: 6161cab2-eb1f-44cb-bbd5-077e6db42f77] Instance running successfully.
Nov 28 15:52:50 user nova-compute[75176]: DEBUG nova.virt.libvirt.guest [None req-3494fde8-2f23-4569-b8ef-621d14f2b0d7 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] [instance: 6161cab2-eb1f-44cb-bbd5-077e6db42f77] Failed to set time: agent not configured {{(pid=75176) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 28 15:52:50 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-3494fde8-2f23-4569-b8ef-621d14f2b0d7 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] [instance: 6161cab2-eb1f-44cb-bbd5-077e6db42f77] finish_migration finished successfully. {{(pid=75176) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11766}}
Nov 28 15:52:50 user nova-compute[75176]: DEBUG nova.compute.manager [req-f8f2cdda-9664-4a91-8377-408477eab730 req-d2eec1b8-2a91-4f0d-8b96-fdeddb8e9403 service nova] [instance: 6161cab2-eb1f-44cb-bbd5-077e6db42f77] Received event network-vif-plugged-f2811544-4cf2-4302-b012-8bf1881b9b6c {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:52:50 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-f8f2cdda-9664-4a91-8377-408477eab730 req-d2eec1b8-2a91-4f0d-8b96-fdeddb8e9403 service nova] Acquiring lock "6161cab2-eb1f-44cb-bbd5-077e6db42f77-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:52:50 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-f8f2cdda-9664-4a91-8377-408477eab730 req-d2eec1b8-2a91-4f0d-8b96-fdeddb8e9403 service nova] Lock "6161cab2-eb1f-44cb-bbd5-077e6db42f77-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:52:50 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-f8f2cdda-9664-4a91-8377-408477eab730 req-d2eec1b8-2a91-4f0d-8b96-fdeddb8e9403 service nova] Lock "6161cab2-eb1f-44cb-bbd5-077e6db42f77-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:52:50 user nova-compute[75176]: DEBUG nova.compute.manager [req-f8f2cdda-9664-4a91-8377-408477eab730 req-d2eec1b8-2a91-4f0d-8b96-fdeddb8e9403 service nova] [instance: 6161cab2-eb1f-44cb-bbd5-077e6db42f77] No waiting events found dispatching network-vif-plugged-f2811544-4cf2-4302-b012-8bf1881b9b6c {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:52:50 user nova-compute[75176]: WARNING nova.compute.manager [req-f8f2cdda-9664-4a91-8377-408477eab730 req-d2eec1b8-2a91-4f0d-8b96-fdeddb8e9403 service nova] [instance: 6161cab2-eb1f-44cb-bbd5-077e6db42f77] Received unexpected event network-vif-plugged-f2811544-4cf2-4302-b012-8bf1881b9b6c for instance with vm_state active and task_state resize_finish.
Nov 28 15:52:52 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:52:53 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-6b72d453-e4a5-4907-be7b-2ea9737f82d3 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Acquiring lock "0e465c9f-e8ab-4a28-bf74-2936a272a0e2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:52:53 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-6b72d453-e4a5-4907-be7b-2ea9737f82d3 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Lock "0e465c9f-e8ab-4a28-bf74-2936a272a0e2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:52:53 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-6b72d453-e4a5-4907-be7b-2ea9737f82d3 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Acquiring lock "0e465c9f-e8ab-4a28-bf74-2936a272a0e2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:52:53 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-6b72d453-e4a5-4907-be7b-2ea9737f82d3 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Lock "0e465c9f-e8ab-4a28-bf74-2936a272a0e2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:52:53 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-6b72d453-e4a5-4907-be7b-2ea9737f82d3 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Lock "0e465c9f-e8ab-4a28-bf74-2936a272a0e2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:52:53 user nova-compute[75176]: INFO nova.compute.manager [None req-6b72d453-e4a5-4907-be7b-2ea9737f82d3 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] [instance: 0e465c9f-e8ab-4a28-bf74-2936a272a0e2] Terminating instance
Nov 28 15:52:53 user nova-compute[75176]: DEBUG nova.compute.manager [None req-6b72d453-e4a5-4907-be7b-2ea9737f82d3 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] [instance: 0e465c9f-e8ab-4a28-bf74-2936a272a0e2] Start destroying the instance on the hypervisor. {{(pid=75176) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 15:52:53 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:52:53 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:52:53 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:52:53 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:52:53 user nova-compute[75176]: DEBUG nova.compute.manager [req-4af4f6e0-0d83-4ae8-8a50-4ab2f3a65f4a req-f96c4290-b52b-4685-bc42-612d90cf46e0 service nova] [instance: 0e465c9f-e8ab-4a28-bf74-2936a272a0e2] Received event network-vif-unplugged-86effed2-558e-4427-82be-761ca28e6d8c {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:52:53 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-4af4f6e0-0d83-4ae8-8a50-4ab2f3a65f4a req-f96c4290-b52b-4685-bc42-612d90cf46e0 service nova] Acquiring lock "0e465c9f-e8ab-4a28-bf74-2936a272a0e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:52:53 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-4af4f6e0-0d83-4ae8-8a50-4ab2f3a65f4a req-f96c4290-b52b-4685-bc42-612d90cf46e0 service nova] Lock "0e465c9f-e8ab-4a28-bf74-2936a272a0e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:52:53 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-4af4f6e0-0d83-4ae8-8a50-4ab2f3a65f4a req-f96c4290-b52b-4685-bc42-612d90cf46e0 service nova] Lock "0e465c9f-e8ab-4a28-bf74-2936a272a0e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:52:53 user nova-compute[75176]: DEBUG nova.compute.manager [req-4af4f6e0-0d83-4ae8-8a50-4ab2f3a65f4a req-f96c4290-b52b-4685-bc42-612d90cf46e0 service nova] [instance: 0e465c9f-e8ab-4a28-bf74-2936a272a0e2] No waiting events found dispatching network-vif-unplugged-86effed2-558e-4427-82be-761ca28e6d8c {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:52:53 user nova-compute[75176]: DEBUG nova.compute.manager [req-4af4f6e0-0d83-4ae8-8a50-4ab2f3a65f4a req-f96c4290-b52b-4685-bc42-612d90cf46e0 service nova] [instance: 0e465c9f-e8ab-4a28-bf74-2936a272a0e2] Received event network-vif-unplugged-86effed2-558e-4427-82be-761ca28e6d8c for instance with task_state deleting. {{(pid=75176) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 15:52:54 user nova-compute[75176]: INFO nova.virt.libvirt.driver [-] [instance: 0e465c9f-e8ab-4a28-bf74-2936a272a0e2] Instance destroyed successfully.
Nov 28 15:52:54 user nova-compute[75176]: DEBUG nova.objects.instance [None req-6b72d453-e4a5-4907-be7b-2ea9737f82d3 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Lazy-loading 'resources' on Instance uuid 0e465c9f-e8ab-4a28-bf74-2936a272a0e2 {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:52:54 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-6b72d453-e4a5-4907-be7b-2ea9737f82d3 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-28T15:46:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-447740496',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-447740496',id=23,image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF/pYrzcTrtQ3nwooZBOWnAPi4M5mz16IJrnTqwXqwCVaE4JIJYdwHlVPfsp02/e05TmymOA0Zx46jNuNLVfWRTBx9AVrbXibAt/hO6ZnAPzuudKre3uKffG2AkKZrLXTw==',key_name='tempest-keypair-1203625989',keypairs=<?>,launch_index=0,launched_at=2023-11-28T15:50:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='169fdaea89d4431aa6adacdbb76f3546',ramdisk_id='',reservation_id='r-avjj7pv9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1264107218',owner_user_name='tempest-AttachVolumeShelveTestJSON-1264107218-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T15:50:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3146d6b1e7324ebaa62ade09f1d1c68f',uuid=0e465c9f-e8ab-4a28-bf74-2936a272a0e2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "86effed2-558e-4427-82be-761ca28e6d8c", "address": "fa:16:3e:95:66:57", "network": {"id": "5d0ae041-a67d-4a54-bd53-104c4f44209d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-938551772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "169fdaea89d4431aa6adacdbb76f3546", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86effed2-55", "ovs_interfaceid": "86effed2-558e-4427-82be-761ca28e6d8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 15:52:54 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-6b72d453-e4a5-4907-be7b-2ea9737f82d3 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Converting VIF {"id": "86effed2-558e-4427-82be-761ca28e6d8c", "address": "fa:16:3e:95:66:57", "network": {"id": "5d0ae041-a67d-4a54-bd53-104c4f44209d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-938551772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "169fdaea89d4431aa6adacdbb76f3546", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86effed2-55", "ovs_interfaceid": "86effed2-558e-4427-82be-761ca28e6d8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:52:54 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-6b72d453-e4a5-4907-be7b-2ea9737f82d3 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:66:57,bridge_name='br-int',has_traffic_filtering=True,id=86effed2-558e-4427-82be-761ca28e6d8c,network=Network(5d0ae041-a67d-4a54-bd53-104c4f44209d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86effed2-55') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:52:54 user nova-compute[75176]: DEBUG os_vif [None req-6b72d453-e4a5-4907-be7b-2ea9737f82d3 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:66:57,bridge_name='br-int',has_traffic_filtering=True,id=86effed2-558e-4427-82be-761ca28e6d8c,network=Network(5d0ae041-a67d-4a54-bd53-104c4f44209d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86effed2-55') {{(pid=75176) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 15:52:54 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:52:54 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap86effed2-55, bridge=br-int, if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:52:54 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:52:54 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:52:54 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=088dde16-ec7a-4c5f-8fb9-706c0bf0655c) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:52:54 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:52:54 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:52:54 user nova-compute[75176]: INFO os_vif [None req-6b72d453-e4a5-4907-be7b-2ea9737f82d3 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:66:57,bridge_name='br-int',has_traffic_filtering=True,id=86effed2-558e-4427-82be-761ca28e6d8c,network=Network(5d0ae041-a67d-4a54-bd53-104c4f44209d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86effed2-55')
Nov 28 15:52:54 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-6b72d453-e4a5-4907-be7b-2ea9737f82d3 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] [instance: 0e465c9f-e8ab-4a28-bf74-2936a272a0e2] Deleting instance files /opt/stack/data/nova/instances/0e465c9f-e8ab-4a28-bf74-2936a272a0e2_del
Nov 28 15:52:54 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-6b72d453-e4a5-4907-be7b-2ea9737f82d3 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] [instance: 0e465c9f-e8ab-4a28-bf74-2936a272a0e2] Deletion of /opt/stack/data/nova/instances/0e465c9f-e8ab-4a28-bf74-2936a272a0e2_del complete
Nov 28 15:52:54 user nova-compute[75176]: INFO nova.compute.manager [None req-6b72d453-e4a5-4907-be7b-2ea9737f82d3 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] [instance: 0e465c9f-e8ab-4a28-bf74-2936a272a0e2] Took 1.24 seconds to destroy the instance on the hypervisor.
Nov 28 15:52:54 user nova-compute[75176]: DEBUG oslo.service.loopingcall [None req-6b72d453-e4a5-4907-be7b-2ea9737f82d3 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75176) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 15:52:54 user nova-compute[75176]: DEBUG nova.compute.manager [-] [instance: 0e465c9f-e8ab-4a28-bf74-2936a272a0e2] Deallocating network for instance {{(pid=75176) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 15:52:54 user nova-compute[75176]: DEBUG nova.network.neutron [-] [instance: 0e465c9f-e8ab-4a28-bf74-2936a272a0e2] deallocate_for_instance() {{(pid=75176) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 15:52:55 user nova-compute[75176]: DEBUG nova.network.neutron [-] [instance: 0e465c9f-e8ab-4a28-bf74-2936a272a0e2] Updating instance_info_cache with network_info: [] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:52:55 user nova-compute[75176]: INFO nova.compute.manager [-] [instance: 0e465c9f-e8ab-4a28-bf74-2936a272a0e2] Took 1.10 seconds to deallocate network for instance.
Nov 28 15:52:55 user nova-compute[75176]: DEBUG nova.compute.manager [req-fcff73c9-8c58-40c9-93bf-194ec4ba3b7a req-d968aef7-1d69-4734-9a27-58a8f1338f8d service nova] [instance: 0e465c9f-e8ab-4a28-bf74-2936a272a0e2] Received event network-vif-deleted-86effed2-558e-4427-82be-761ca28e6d8c {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:52:55 user nova-compute[75176]: DEBUG nova.compute.manager [req-ddb3403c-611d-49c5-b252-1980e8e1377b req-9c306de7-aca4-4baa-b240-ce4c083e6428 service nova] [instance: 0e465c9f-e8ab-4a28-bf74-2936a272a0e2] Received event network-vif-plugged-86effed2-558e-4427-82be-761ca28e6d8c {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:52:55 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-ddb3403c-611d-49c5-b252-1980e8e1377b req-9c306de7-aca4-4baa-b240-ce4c083e6428 service nova] Acquiring lock "0e465c9f-e8ab-4a28-bf74-2936a272a0e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:52:55 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-ddb3403c-611d-49c5-b252-1980e8e1377b req-9c306de7-aca4-4baa-b240-ce4c083e6428 service nova] Lock "0e465c9f-e8ab-4a28-bf74-2936a272a0e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:52:55 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-ddb3403c-611d-49c5-b252-1980e8e1377b req-9c306de7-aca4-4baa-b240-ce4c083e6428 service nova] Lock "0e465c9f-e8ab-4a28-bf74-2936a272a0e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:52:55 user nova-compute[75176]: DEBUG nova.compute.manager [req-ddb3403c-611d-49c5-b252-1980e8e1377b req-9c306de7-aca4-4baa-b240-ce4c083e6428 service nova] [instance: 0e465c9f-e8ab-4a28-bf74-2936a272a0e2] No waiting events found dispatching network-vif-plugged-86effed2-558e-4427-82be-761ca28e6d8c {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:52:55 user nova-compute[75176]: WARNING nova.compute.manager [req-ddb3403c-611d-49c5-b252-1980e8e1377b req-9c306de7-aca4-4baa-b240-ce4c083e6428 service nova] [instance: 0e465c9f-e8ab-4a28-bf74-2936a272a0e2] Received unexpected event network-vif-plugged-86effed2-558e-4427-82be-761ca28e6d8c for instance with vm_state active and task_state deleting.
Nov 28 15:52:55 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-6b72d453-e4a5-4907-be7b-2ea9737f82d3 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:52:55 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-6b72d453-e4a5-4907-be7b-2ea9737f82d3 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:52:56 user nova-compute[75176]: DEBUG nova.compute.provider_tree [None req-6b72d453-e4a5-4907-be7b-2ea9737f82d3 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Inventory has not changed in ProviderTree for provider: b37848d8-f401-4155-a029-b0ffa09ff85b {{(pid=75176) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 15:52:56 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-6b72d453-e4a5-4907-be7b-2ea9737f82d3 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Inventory has not changed for provider b37848d8-f401-4155-a029-b0ffa09ff85b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75176) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 15:52:56 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:52:56 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:52:56 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-6b72d453-e4a5-4907-be7b-2ea9737f82d3 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.635s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:52:56 user nova-compute[75176]: INFO nova.scheduler.client.report [None req-6b72d453-e4a5-4907-be7b-2ea9737f82d3 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Deleted allocations for instance 0e465c9f-e8ab-4a28-bf74-2936a272a0e2
Nov 28 15:52:56 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-6b72d453-e4a5-4907-be7b-2ea9737f82d3 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Lock "0e465c9f-e8ab-4a28-bf74-2936a272a0e2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.266s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:52:57 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:52:57 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:52:58 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-3b79e616-7083-4fda-be0c-1a4e936d6129 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Acquiring lock "42579ef7-54dc-4165-a144-61e80fdd5626" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:52:58 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-3b79e616-7083-4fda-be0c-1a4e936d6129 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Lock "42579ef7-54dc-4165-a144-61e80fdd5626" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:52:58 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-3b79e616-7083-4fda-be0c-1a4e936d6129 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Acquiring lock "42579ef7-54dc-4165-a144-61e80fdd5626-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:52:58 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-3b79e616-7083-4fda-be0c-1a4e936d6129 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Lock "42579ef7-54dc-4165-a144-61e80fdd5626-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:52:58 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-3b79e616-7083-4fda-be0c-1a4e936d6129 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Lock "42579ef7-54dc-4165-a144-61e80fdd5626-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:52:58 user nova-compute[75176]: INFO nova.compute.manager [None req-3b79e616-7083-4fda-be0c-1a4e936d6129 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: 42579ef7-54dc-4165-a144-61e80fdd5626] Terminating instance
Nov 28 15:52:58 user nova-compute[75176]: DEBUG nova.compute.manager [None req-3b79e616-7083-4fda-be0c-1a4e936d6129 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: 42579ef7-54dc-4165-a144-61e80fdd5626] Start destroying the instance on the hypervisor. {{(pid=75176) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 15:52:58 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:52:58 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:52:58 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:52:58 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:52:58 user nova-compute[75176]: DEBUG nova.compute.manager [req-0f87a521-a1b9-4b51-92cc-d66a66b6a079 req-22fb54a8-784f-4060-9314-c7512cfb2dfb service nova] [instance: 42579ef7-54dc-4165-a144-61e80fdd5626] Received event network-vif-unplugged-c60779ce-eea1-4d7d-9195-4c1c4921a5fb {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:52:58 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-0f87a521-a1b9-4b51-92cc-d66a66b6a079 req-22fb54a8-784f-4060-9314-c7512cfb2dfb service nova] Acquiring lock "42579ef7-54dc-4165-a144-61e80fdd5626-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:52:58 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-0f87a521-a1b9-4b51-92cc-d66a66b6a079 req-22fb54a8-784f-4060-9314-c7512cfb2dfb service nova] Lock "42579ef7-54dc-4165-a144-61e80fdd5626-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:52:58 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-0f87a521-a1b9-4b51-92cc-d66a66b6a079 req-22fb54a8-784f-4060-9314-c7512cfb2dfb service nova] Lock "42579ef7-54dc-4165-a144-61e80fdd5626-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:52:58 user nova-compute[75176]: DEBUG nova.compute.manager [req-0f87a521-a1b9-4b51-92cc-d66a66b6a079 req-22fb54a8-784f-4060-9314-c7512cfb2dfb service nova] [instance: 42579ef7-54dc-4165-a144-61e80fdd5626] No waiting events found dispatching network-vif-unplugged-c60779ce-eea1-4d7d-9195-4c1c4921a5fb {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:52:58 user nova-compute[75176]: DEBUG nova.compute.manager [req-0f87a521-a1b9-4b51-92cc-d66a66b6a079 req-22fb54a8-784f-4060-9314-c7512cfb2dfb service nova] [instance: 42579ef7-54dc-4165-a144-61e80fdd5626] Received event network-vif-unplugged-c60779ce-eea1-4d7d-9195-4c1c4921a5fb for instance with task_state deleting. {{(pid=75176) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 15:52:58 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7c01924b-5071-4fea-aedd-a70760c411cf tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] Acquiring lock "1e8a6e1b-4f71-494a-8f44-f9643c658021" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:52:58 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7c01924b-5071-4fea-aedd-a70760c411cf tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] Lock "1e8a6e1b-4f71-494a-8f44-f9643c658021" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:52:58 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7c01924b-5071-4fea-aedd-a70760c411cf tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] Acquiring lock "1e8a6e1b-4f71-494a-8f44-f9643c658021-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:52:58 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7c01924b-5071-4fea-aedd-a70760c411cf tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] Lock "1e8a6e1b-4f71-494a-8f44-f9643c658021-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:52:58 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7c01924b-5071-4fea-aedd-a70760c411cf tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] Lock "1e8a6e1b-4f71-494a-8f44-f9643c658021-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:52:58 user nova-compute[75176]: INFO nova.compute.manager [None req-7c01924b-5071-4fea-aedd-a70760c411cf tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] [instance: 1e8a6e1b-4f71-494a-8f44-f9643c658021] Terminating instance
Nov 28 15:52:58 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7c01924b-5071-4fea-aedd-a70760c411cf tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] [instance: 1e8a6e1b-4f71-494a-8f44-f9643c658021] Start destroying the instance on the hypervisor. {{(pid=75176) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 15:52:58 user nova-compute[75176]: INFO nova.virt.libvirt.driver [-] [instance: 42579ef7-54dc-4165-a144-61e80fdd5626] Instance destroyed successfully.
Nov 28 15:52:58 user nova-compute[75176]: DEBUG nova.objects.instance [None req-3b79e616-7083-4fda-be0c-1a4e936d6129 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Lazy-loading 'resources' on Instance uuid 42579ef7-54dc-4165-a144-61e80fdd5626 {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:52:58 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:52:58 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-3b79e616-7083-4fda-be0c-1a4e936d6129 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T15:48:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1575944035',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1575944035',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1575944035',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCbenEEWjXrLPvri/j1bdPyiyqrJRmRMAdi7hUTEC0T2nCGTikp77R+EDjNHnXzYPrHqzBqe6Ldu/dqSmsIZWIpiqT5NtZgFvXAji1sOrvffB/TZAa2hdFESwhP/dCBRNA==',key_name='tempest-keypair-456872669',keypairs=<?>,launch_index=0,launched_at=2023-11-28T15:48:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='07c7783cc16049208421204910982c79',ramdisk_id='',reservation_id='r-3qrjmp63',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1695196118',owner_user_name='tempest-TestVolumeBootPattern-1695196118-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T15:48:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='081bf84d24194b81be4e0a6638db9b66',uuid=42579ef7-54dc-4165-a144-61e80fdd5626,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c60779ce-eea1-4d7d-9195-4c1c4921a5fb", "address": "fa:16:3e:ba:f7:78", "network": {"id": "5ec264ad-3459-468c-bdbf-c6a4ef016951", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1574289626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07c7783cc16049208421204910982c79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc60779ce-ee", "ovs_interfaceid": "c60779ce-eea1-4d7d-9195-4c1c4921a5fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 15:52:58 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-3b79e616-7083-4fda-be0c-1a4e936d6129 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Converting VIF {"id": "c60779ce-eea1-4d7d-9195-4c1c4921a5fb", "address": "fa:16:3e:ba:f7:78", "network": {"id": "5ec264ad-3459-468c-bdbf-c6a4ef016951", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1574289626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07c7783cc16049208421204910982c79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc60779ce-ee", "ovs_interfaceid": "c60779ce-eea1-4d7d-9195-4c1c4921a5fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:52:58 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-3b79e616-7083-4fda-be0c-1a4e936d6129 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ba:f7:78,bridge_name='br-int',has_traffic_filtering=True,id=c60779ce-eea1-4d7d-9195-4c1c4921a5fb,network=Network(5ec264ad-3459-468c-bdbf-c6a4ef016951),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc60779ce-ee') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:52:58 user nova-compute[75176]: DEBUG os_vif [None req-3b79e616-7083-4fda-be0c-1a4e936d6129 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ba:f7:78,bridge_name='br-int',has_traffic_filtering=True,id=c60779ce-eea1-4d7d-9195-4c1c4921a5fb,network=Network(5ec264ad-3459-468c-bdbf-c6a4ef016951),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc60779ce-ee') {{(pid=75176) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 15:52:58 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:52:58 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc60779ce-ee, bridge=br-int, if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:52:58 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:52:58 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:52:58 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:52:58 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:52:58 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:52:58 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bd58e6bb-c6e2-4478-bfd3-325c9c2bd533) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:52:58 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:52:58 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:52:58 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:52:59 user nova-compute[75176]: INFO os_vif [None req-3b79e616-7083-4fda-be0c-1a4e936d6129 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ba:f7:78,bridge_name='br-int',has_traffic_filtering=True,id=c60779ce-eea1-4d7d-9195-4c1c4921a5fb,network=Network(5ec264ad-3459-468c-bdbf-c6a4ef016951),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc60779ce-ee')
Nov 28 15:52:59 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b79e616-7083-4fda-be0c-1a4e936d6129 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: 42579ef7-54dc-4165-a144-61e80fdd5626] calling os-brick to detach iSCSI Volume {{(pid=75176) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 15:52:59 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b79e616-7083-4fda-be0c-1a4e936d6129 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c1b8a00>, {'target_iqn': 'iqn.2010-10.org.openstack:8452525c-6845-4edb-bf69-1e2ffe0ef2eb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OyWVuqAt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 15:52:59 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-3b79e616-7083-4fda-be0c-1a4e936d6129 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 15:52:59 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-3b79e616-7083-4fda-be0c-1a4e936d6129 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 15:52:59 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-3b79e616-7083-4fda-be0c-1a4e936d6129 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 15:52:59 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:52:59 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:52:59 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:52:59 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.036s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:52:59 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b4888b9-9609-418d-bc39-2a8d1d532437]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8452525c-6845-4edb-bf69-1e2ffe0ef2eb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:22933c6e-3d8f-44f5-bc41-dee97c587055\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:52:59 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b79e616-7083-4fda-be0c-1a4e936d6129 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 15:52:59 user nova-compute[75176]: No targets found.
Nov 28 15:52:59 user nova-compute[75176]: iSNS:
Nov 28 15:52:59 user nova-compute[75176]: No targets found.
Nov 28 15:52:59 user nova-compute[75176]: STATIC:
Nov 28 15:52:59 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:8452525c-6845-4edb-bf69-1e2ffe0ef2eb
Nov 28 15:52:59 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:52:59 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:52:59 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6
Nov 28 15:52:59 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:52:59 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:52:59 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc
Nov 28 15:52:59 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:52:59 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:52:59 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:22933c6e-3d8f-44f5-bc41-dee97c587055
Nov 28 15:52:59 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:52:59 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:52:59 user nova-compute[75176]: FIRMWARE:
Nov 28 15:52:59 user nova-compute[75176]: No targets found.
Nov 28 15:52:59 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:52:59 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b79e616-7083-4fda-be0c-1a4e936d6129 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 15:52:59 user nova-compute[75176]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 15:52:59 user nova-compute[75176]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75176) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 15:52:59 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b79e616-7083-4fda-be0c-1a4e936d6129 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8452525c-6845-4edb-bf69-1e2ffe0ef2eb', 0)] {{(pid=75176) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 15:52:59 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:52:59 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:52:59 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[726f0a62-13a6-433a-8c81-7bf02103e447]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:22933c6e-3d8f-44f5-bc41-dee97c587055\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8452525c-6845-4edb-bf69-1e2ffe0ef2eb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:52:59 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:52:59 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:52:59 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bced17d-33ff-49c8-9503-8338b7a2242b]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8452525c-6845-4edb-bf69-1e2ffe0ef2eb (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22933c6e-3d8f-44f5-bc41-dee97c587055 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc (non-flash)\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:52:59 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b79e616-7083-4fda-be0c-1a4e936d6129 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8452525c-6845-4edb-bf69-1e2ffe0ef2eb (non-flash)
Nov 28 15:52:59 user nova-compute[75176]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22933c6e-3d8f-44f5-bc41-dee97c587055 (non-flash)
Nov 28 15:52:59 user nova-compute[75176]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 (non-flash)
Nov 28 15:52:59 user nova-compute[75176]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc (non-flash)
Nov 28 15:52:59 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:52:59 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b79e616-7083-4fda-be0c-1a4e936d6129 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8452525c-6845-4edb-bf69-1e2ffe0ef2eb (non-flash)
Nov 28 15:52:59 user nova-compute[75176]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22933c6e-3d8f-44f5-bc41-dee97c587055 (non-flash)
Nov 28 15:52:59 user nova-compute[75176]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 (non-flash)
Nov 28 15:52:59 user nova-compute[75176]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc (non-flash)
Nov 28 15:52:59 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 15:52:59 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b79e616-7083-4fda-be0c-1a4e936d6129 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f462c6416c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8452525c-6845-4edb-bf69-1e2ffe0ef2eb'): ({'sdc'}, set())}) {{(pid=75176) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 15:52:59 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-3b79e616-7083-4fda-be0c-1a4e936d6129 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Removing single pathed devices sdc {{(pid=75176) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 15:52:59 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:52:59 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:52:59 user nova-compute[75176]: DEBUG nova.compute.manager [req-d8fc6d78-b560-477f-917f-50e7fb893c4c req-3d026506-7f75-460f-86fc-1ed75d5ad68b service nova] [instance: 1e8a6e1b-4f71-494a-8f44-f9643c658021] Received event network-vif-unplugged-34bebf25-27db-4839-9184-30d78a0ee582 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:52:59 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-d8fc6d78-b560-477f-917f-50e7fb893c4c req-3d026506-7f75-460f-86fc-1ed75d5ad68b service nova] Acquiring lock "1e8a6e1b-4f71-494a-8f44-f9643c658021-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:52:59 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-d8fc6d78-b560-477f-917f-50e7fb893c4c req-3d026506-7f75-460f-86fc-1ed75d5ad68b service nova] Lock "1e8a6e1b-4f71-494a-8f44-f9643c658021-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:52:59 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-d8fc6d78-b560-477f-917f-50e7fb893c4c req-3d026506-7f75-460f-86fc-1ed75d5ad68b service nova] Lock "1e8a6e1b-4f71-494a-8f44-f9643c658021-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:52:59 user nova-compute[75176]: DEBUG nova.compute.manager [req-d8fc6d78-b560-477f-917f-50e7fb893c4c req-3d026506-7f75-460f-86fc-1ed75d5ad68b service nova] [instance: 1e8a6e1b-4f71-494a-8f44-f9643c658021] No waiting events found dispatching network-vif-unplugged-34bebf25-27db-4839-9184-30d78a0ee582 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:52:59 user nova-compute[75176]: DEBUG nova.compute.manager [req-d8fc6d78-b560-477f-917f-50e7fb893c4c req-3d026506-7f75-460f-86fc-1ed75d5ad68b service nova] [instance: 1e8a6e1b-4f71-494a-8f44-f9643c658021] Received event network-vif-unplugged-34bebf25-27db-4839-9184-30d78a0ee582 for instance with task_state deleting. {{(pid=75176) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 15:52:59 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[65742906-dfa0-4a4d-80da-de48d6f817a8]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:52:59 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:52:59 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.032s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:52:59 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[db9ff11a-aee6-4646-b9d7-9bb7ed9c40eb]: (4, ('ok\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:52:59 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-3b79e616-7083-4fda-be0c-1a4e936d6129 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Flushing IO for device /dev/sdc {{(pid=75176) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 15:52:59 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:52:59 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.023s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:52:59 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f39d53a-77b0-4b68-8e8d-72a260db3bea]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:52:59 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-3b79e616-7083-4fda-be0c-1a4e936d6129 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75176) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 15:52:59 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:52:59 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.050s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:52:59 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c479102-25fa-4d28-9a01-f472fd744134]: (4, ('1', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:52:59 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-3b79e616-7083-4fda-be0c-1a4e936d6129 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75176) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 15:52:59 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-3b79e616-7083-4fda-be0c-1a4e936d6129 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] SCSI volumes sdc have been removed. {{(pid=75176) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 15:52:59 user nova-compute[75176]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOac8cdea0-b53097c36a7f7fce', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_ac8cdea0', '/dev/disk/by-id/scsi-26235333039376333') {{(pid=85736) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 28 15:52:59 user nova-compute[75176]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIOac8cdea0-b53097c36a7f7fce
Nov 28 15:52:59 user nova-compute[75176]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_ac8cdea0
Nov 28 15:52:59 user nova-compute[75176]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-26235333039376333
Nov 28 15:52:59 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[73c25063-c2af-48bd-9748-7b0ac2f5b715]: (4, None) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:52:59 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b79e616-7083-4fda-be0c-1a4e936d6129 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8452525c-6845-4edb-bf69-1e2ffe0ef2eb')] {{(pid=75176) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 15:52:59 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8452525c-6845-4edb-bf69-1e2ffe0ef2eb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:52:59 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8452525c-6845-4edb-bf69-1e2ffe0ef2eb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:52:59 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fe659ed-8c56-490c-ad97-ab33865de3f4]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:52:59 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b79e616-7083-4fda-be0c-1a4e936d6129 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:52:59 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8452525c-6845-4edb-bf69-1e2ffe0ef2eb -p 172.16.0.220:3260 --logout {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:52:59 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:52:59 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8452525c-6845-4edb-bf69-1e2ffe0ef2eb -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:52:59 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[c09f4851-8884-441c-95e3-704db49a72aa]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:8452525c-6845-4edb-bf69-1e2ffe0ef2eb, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:8452525c-6845-4edb-bf69-1e2ffe0ef2eb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:52:59 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b79e616-7083-4fda-be0c-1a4e936d6129 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:8452525c-6845-4edb-bf69-1e2ffe0ef2eb, portal: 172.16.0.220,3260]
Nov 28 15:52:59 user nova-compute[75176]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:8452525c-6845-4edb-bf69-1e2ffe0ef2eb, portal: 172.16.0.220,3260] successful.
Nov 28 15:52:59 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:52:59 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8452525c-6845-4edb-bf69-1e2ffe0ef2eb -p 172.16.0.220:3260 --op delete {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:52:59 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8452525c-6845-4edb-bf69-1e2ffe0ef2eb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:52:59 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[d039b3ab-21d9-4551-ac06-780efeaff575]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:52:59 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b79e616-7083-4fda-be0c-1a4e936d6129 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:52:59 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-3b79e616-7083-4fda-be0c-1a4e936d6129 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.410s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 15:52:59 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b79e616-7083-4fda-be0c-1a4e936d6129 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] <== disconnect_volume: return (412ms) None {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 15:52:59 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b79e616-7083-4fda-be0c-1a4e936d6129 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: 42579ef7-54dc-4165-a144-61e80fdd5626] Disconnected iSCSI Volume {{(pid=75176) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 15:52:59 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-3b79e616-7083-4fda-be0c-1a4e936d6129 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: 42579ef7-54dc-4165-a144-61e80fdd5626] Deleting instance files /opt/stack/data/nova/instances/42579ef7-54dc-4165-a144-61e80fdd5626_del
Nov 28 15:52:59 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-3b79e616-7083-4fda-be0c-1a4e936d6129 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: 42579ef7-54dc-4165-a144-61e80fdd5626] Deletion of /opt/stack/data/nova/instances/42579ef7-54dc-4165-a144-61e80fdd5626_del complete
Nov 28 15:52:59 user nova-compute[75176]: INFO nova.compute.manager [None req-3b79e616-7083-4fda-be0c-1a4e936d6129 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: 42579ef7-54dc-4165-a144-61e80fdd5626] Took 1.37 seconds to destroy the instance on the hypervisor.
Nov 28 15:52:59 user nova-compute[75176]: DEBUG oslo.service.loopingcall [None req-3b79e616-7083-4fda-be0c-1a4e936d6129 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75176) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 15:52:59 user nova-compute[75176]: DEBUG nova.compute.manager [-] [instance: 42579ef7-54dc-4165-a144-61e80fdd5626] Deallocating network for instance {{(pid=75176) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 15:52:59 user nova-compute[75176]: DEBUG nova.network.neutron [-] [instance: 42579ef7-54dc-4165-a144-61e80fdd5626] deallocate_for_instance() {{(pid=75176) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 15:52:59 user nova-compute[75176]: INFO nova.virt.libvirt.driver [-] [instance: 1e8a6e1b-4f71-494a-8f44-f9643c658021] Instance destroyed successfully.
Nov 28 15:52:59 user nova-compute[75176]: DEBUG nova.objects.instance [None req-7c01924b-5071-4fea-aedd-a70760c411cf tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] Lazy-loading 'resources' on Instance uuid 1e8a6e1b-4f71-494a-8f44-f9643c658021 {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:52:59 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-7c01924b-5071-4fea-aedd-a70760c411cf tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T15:44:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-16302077',display_name='tempest-ServersNegativeTestJSON-server-16302077',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-16302077',id=18,image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-28T15:44:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='13ce3926a76541f7a32ada5070b10be1',ramdisk_id='',reservation_id='r-po4ou88g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-417711709',owner_user_name='tempest-ServersNegativeTestJSON-417711709-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T15:44:23Z,user_data=None,user_id='8fdbce92609048169853a846340eb9fe',uuid=1e8a6e1b-4f71-494a-8f44-f9643c658021,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "34bebf25-27db-4839-9184-30d78a0ee582", "address": "fa:16:3e:90:a9:7c", "network": {"id": "51143aa0-7498-4dfc-8425-9046ee5aa4fc", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-351796020-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13ce3926a76541f7a32ada5070b10be1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34bebf25-27", "ovs_interfaceid": "34bebf25-27db-4839-9184-30d78a0ee582", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 15:52:59 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-7c01924b-5071-4fea-aedd-a70760c411cf tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] Converting VIF {"id": "34bebf25-27db-4839-9184-30d78a0ee582", "address": "fa:16:3e:90:a9:7c", "network": {"id": "51143aa0-7498-4dfc-8425-9046ee5aa4fc", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-351796020-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13ce3926a76541f7a32ada5070b10be1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34bebf25-27", "ovs_interfaceid": "34bebf25-27db-4839-9184-30d78a0ee582", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:52:59 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-7c01924b-5071-4fea-aedd-a70760c411cf tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:90:a9:7c,bridge_name='br-int',has_traffic_filtering=True,id=34bebf25-27db-4839-9184-30d78a0ee582,network=Network(51143aa0-7498-4dfc-8425-9046ee5aa4fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34bebf25-27') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:52:59 user nova-compute[75176]: DEBUG os_vif [None req-7c01924b-5071-4fea-aedd-a70760c411cf tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:90:a9:7c,bridge_name='br-int',has_traffic_filtering=True,id=34bebf25-27db-4839-9184-30d78a0ee582,network=Network(51143aa0-7498-4dfc-8425-9046ee5aa4fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34bebf25-27') {{(pid=75176) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 15:52:59 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:52:59 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap34bebf25-27, bridge=br-int, if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:52:59 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:52:59 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:52:59 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:52:59 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8c049b59-06a1-49df-96ad-90c2c1da2733) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:52:59 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:52:59 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:52:59 user nova-compute[75176]: INFO os_vif [None req-7c01924b-5071-4fea-aedd-a70760c411cf tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:90:a9:7c,bridge_name='br-int',has_traffic_filtering=True,id=34bebf25-27db-4839-9184-30d78a0ee582,network=Network(51143aa0-7498-4dfc-8425-9046ee5aa4fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34bebf25-27')
Nov 28 15:52:59 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-7c01924b-5071-4fea-aedd-a70760c411cf tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] [instance: 1e8a6e1b-4f71-494a-8f44-f9643c658021] Deleting instance files /opt/stack/data/nova/instances/1e8a6e1b-4f71-494a-8f44-f9643c658021_del
Nov 28 15:52:59 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-7c01924b-5071-4fea-aedd-a70760c411cf tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] [instance: 1e8a6e1b-4f71-494a-8f44-f9643c658021] Deletion of /opt/stack/data/nova/instances/1e8a6e1b-4f71-494a-8f44-f9643c658021_del complete
Nov 28 15:52:59 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:52:59 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:52:59 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:52:59 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75176) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 15:52:59 user nova-compute[75176]: INFO nova.compute.manager [None req-7c01924b-5071-4fea-aedd-a70760c411cf tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] [instance: 1e8a6e1b-4f71-494a-8f44-f9643c658021] Took 0.90 seconds to destroy the instance on the hypervisor.
Nov 28 15:52:59 user nova-compute[75176]: DEBUG oslo.service.loopingcall [None req-7c01924b-5071-4fea-aedd-a70760c411cf tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75176) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 15:52:59 user nova-compute[75176]: DEBUG nova.compute.manager [-] [instance: 1e8a6e1b-4f71-494a-8f44-f9643c658021] Deallocating network for instance {{(pid=75176) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 15:52:59 user nova-compute[75176]: DEBUG nova.network.neutron [-] [instance: 1e8a6e1b-4f71-494a-8f44-f9643c658021] deallocate_for_instance() {{(pid=75176) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 15:53:00 user nova-compute[75176]: DEBUG nova.network.neutron [-] [instance: 1e8a6e1b-4f71-494a-8f44-f9643c658021] Updating instance_info_cache with network_info: [] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:53:00 user nova-compute[75176]: INFO nova.compute.manager [-] [instance: 1e8a6e1b-4f71-494a-8f44-f9643c658021] Took 0.70 seconds to deallocate network for instance.
Nov 28 15:53:00 user nova-compute[75176]: DEBUG nova.network.neutron [-] [instance: 42579ef7-54dc-4165-a144-61e80fdd5626] Updating instance_info_cache with network_info: [] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:53:00 user nova-compute[75176]: INFO nova.compute.manager [-] [instance: 42579ef7-54dc-4165-a144-61e80fdd5626] Took 0.93 seconds to deallocate network for instance.
Nov 28 15:53:00 user nova-compute[75176]: DEBUG nova.compute.manager [req-50d6582f-d59a-4134-99c8-ebb68ef03948 req-f16e21b9-6517-4cef-81f8-443b180492e0 service nova] [instance: 42579ef7-54dc-4165-a144-61e80fdd5626] Received event network-vif-deleted-c60779ce-eea1-4d7d-9195-4c1c4921a5fb {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:53:00 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7c01924b-5071-4fea-aedd-a70760c411cf tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:53:00 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7c01924b-5071-4fea-aedd-a70760c411cf tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:53:00 user nova-compute[75176]: DEBUG nova.compute.manager [req-387c3c78-41d3-4af9-b5e8-088e8c834723 req-7f3ceb5e-a642-4113-8abd-e0f0fa3e2881 service nova] [instance: 42579ef7-54dc-4165-a144-61e80fdd5626] Received event network-vif-plugged-c60779ce-eea1-4d7d-9195-4c1c4921a5fb {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:53:00 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-387c3c78-41d3-4af9-b5e8-088e8c834723 req-7f3ceb5e-a642-4113-8abd-e0f0fa3e2881 service nova] Acquiring lock "42579ef7-54dc-4165-a144-61e80fdd5626-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:53:00 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-387c3c78-41d3-4af9-b5e8-088e8c834723 req-7f3ceb5e-a642-4113-8abd-e0f0fa3e2881 service nova] Lock "42579ef7-54dc-4165-a144-61e80fdd5626-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:53:00 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-387c3c78-41d3-4af9-b5e8-088e8c834723 req-7f3ceb5e-a642-4113-8abd-e0f0fa3e2881 service nova] Lock "42579ef7-54dc-4165-a144-61e80fdd5626-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:53:00 user nova-compute[75176]: DEBUG nova.compute.manager [req-387c3c78-41d3-4af9-b5e8-088e8c834723 req-7f3ceb5e-a642-4113-8abd-e0f0fa3e2881 service nova] [instance: 42579ef7-54dc-4165-a144-61e80fdd5626] No waiting events found dispatching network-vif-plugged-c60779ce-eea1-4d7d-9195-4c1c4921a5fb {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:53:00 user nova-compute[75176]: WARNING nova.compute.manager [req-387c3c78-41d3-4af9-b5e8-088e8c834723 req-7f3ceb5e-a642-4113-8abd-e0f0fa3e2881 service nova] [instance: 42579ef7-54dc-4165-a144-61e80fdd5626] Received unexpected event network-vif-plugged-c60779ce-eea1-4d7d-9195-4c1c4921a5fb for instance with vm_state active and task_state deleting.
Nov 28 15:53:00 user nova-compute[75176]: DEBUG nova.compute.manager [req-387c3c78-41d3-4af9-b5e8-088e8c834723 req-7f3ceb5e-a642-4113-8abd-e0f0fa3e2881 service nova] [instance: 1e8a6e1b-4f71-494a-8f44-f9643c658021] Received event network-vif-deleted-34bebf25-27db-4839-9184-30d78a0ee582 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:53:00 user nova-compute[75176]: DEBUG nova.compute.provider_tree [None req-7c01924b-5071-4fea-aedd-a70760c411cf tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] Inventory has not changed in ProviderTree for provider: b37848d8-f401-4155-a029-b0ffa09ff85b {{(pid=75176) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 15:53:00 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-7c01924b-5071-4fea-aedd-a70760c411cf tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] Inventory has not changed for provider b37848d8-f401-4155-a029-b0ffa09ff85b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75176) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 15:53:00 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7c01924b-5071-4fea-aedd-a70760c411cf tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.350s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:53:00 user nova-compute[75176]: INFO nova.scheduler.client.report [None req-7c01924b-5071-4fea-aedd-a70760c411cf tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] Deleted allocations for instance 1e8a6e1b-4f71-494a-8f44-f9643c658021
Nov 28 15:53:00 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7c01924b-5071-4fea-aedd-a70760c411cf tempest-ServersNegativeTestJSON-417711709 tempest-ServersNegativeTestJSON-417711709-project-member] Lock "1e8a6e1b-4f71-494a-8f44-f9643c658021" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.178s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:53:01 user nova-compute[75176]: DEBUG nova.compute.manager [req-fd3f1f02-e34a-4fe1-b73c-d508709291be req-accf22db-331f-4fca-b3bc-df5c2a1b9db2 service nova] [instance: 1e8a6e1b-4f71-494a-8f44-f9643c658021] Received event network-vif-plugged-34bebf25-27db-4839-9184-30d78a0ee582 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:53:01 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-fd3f1f02-e34a-4fe1-b73c-d508709291be req-accf22db-331f-4fca-b3bc-df5c2a1b9db2 service nova] Acquiring lock "1e8a6e1b-4f71-494a-8f44-f9643c658021-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:53:01 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-fd3f1f02-e34a-4fe1-b73c-d508709291be req-accf22db-331f-4fca-b3bc-df5c2a1b9db2 service nova] Lock "1e8a6e1b-4f71-494a-8f44-f9643c658021-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:53:01 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-fd3f1f02-e34a-4fe1-b73c-d508709291be req-accf22db-331f-4fca-b3bc-df5c2a1b9db2 service nova] Lock "1e8a6e1b-4f71-494a-8f44-f9643c658021-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:53:01 user nova-compute[75176]: DEBUG nova.compute.manager [req-fd3f1f02-e34a-4fe1-b73c-d508709291be req-accf22db-331f-4fca-b3bc-df5c2a1b9db2 service nova] [instance: 1e8a6e1b-4f71-494a-8f44-f9643c658021] No waiting events found dispatching network-vif-plugged-34bebf25-27db-4839-9184-30d78a0ee582 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:53:01 user nova-compute[75176]: WARNING nova.compute.manager [req-fd3f1f02-e34a-4fe1-b73c-d508709291be req-accf22db-331f-4fca-b3bc-df5c2a1b9db2 service nova] [instance: 1e8a6e1b-4f71-494a-8f44-f9643c658021] Received unexpected event network-vif-plugged-34bebf25-27db-4839-9184-30d78a0ee582 for instance with vm_state deleted and task_state None.
Nov 28 15:53:01 user nova-compute[75176]: INFO nova.compute.manager [None req-3b79e616-7083-4fda-be0c-1a4e936d6129 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: 42579ef7-54dc-4165-a144-61e80fdd5626] Took 0.99 seconds to detach 1 volumes for instance.
Nov 28 15:53:01 user nova-compute[75176]: DEBUG nova.compute.manager [None req-3b79e616-7083-4fda-be0c-1a4e936d6129 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: 42579ef7-54dc-4165-a144-61e80fdd5626] Deleting volume: 8452525c-6845-4edb-bf69-1e2ffe0ef2eb {{(pid=75176) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 28 15:53:01 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-3b79e616-7083-4fda-be0c-1a4e936d6129 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:53:01 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-3b79e616-7083-4fda-be0c-1a4e936d6129 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:53:01 user nova-compute[75176]: DEBUG nova.compute.provider_tree [None req-3b79e616-7083-4fda-be0c-1a4e936d6129 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Inventory has not changed in ProviderTree for provider: b37848d8-f401-4155-a029-b0ffa09ff85b {{(pid=75176) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 15:53:01 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-3b79e616-7083-4fda-be0c-1a4e936d6129 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Inventory has not changed for provider b37848d8-f401-4155-a029-b0ffa09ff85b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75176) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 15:53:02 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-3b79e616-7083-4fda-be0c-1a4e936d6129 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.489s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:53:02 user nova-compute[75176]: INFO nova.scheduler.client.report [None req-3b79e616-7083-4fda-be0c-1a4e936d6129 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Deleted allocations for instance 42579ef7-54dc-4165-a144-61e80fdd5626
Nov 28 15:53:02 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-3b79e616-7083-4fda-be0c-1a4e936d6129 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Lock "42579ef7-54dc-4165-a144-61e80fdd5626" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.031s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:53:02 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:53:02 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Starting heal instance info cache {{(pid=75176) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 15:53:02 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquiring lock "refresh_cache-f66ead7d-98f4-4822-9dce-f2ea0206a58d" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:53:02 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquired lock "refresh_cache-f66ead7d-98f4-4822-9dce-f2ea0206a58d" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:53:02 user nova-compute[75176]: DEBUG nova.network.neutron [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] [instance: f66ead7d-98f4-4822-9dce-f2ea0206a58d] Forcefully refreshing network info cache for instance {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 15:53:03 user nova-compute[75176]: DEBUG nova.network.neutron [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] [instance: f66ead7d-98f4-4822-9dce-f2ea0206a58d] Updating instance_info_cache with network_info: [{"id": "30bb2de8-1609-4cd8-8bb1-e32f2c4bfa81", "address": "fa:16:3e:22:f2:8e", "network": {"id": "998766cd-2e8e-4e39-add9-286086640993", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-989265510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf05c8836b8a40de8e64c2d046ed71ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30bb2de8-16", "ovs_interfaceid": "30bb2de8-1609-4cd8-8bb1-e32f2c4bfa81", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:53:03 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Releasing lock "refresh_cache-f66ead7d-98f4-4822-9dce-f2ea0206a58d" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:53:03 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] [instance: f66ead7d-98f4-4822-9dce-f2ea0206a58d] Updated the network info_cache for instance {{(pid=75176) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 15:53:04 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:53:04 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:53:04 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:53:04 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:53:04 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:53:04 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:53:04 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Auditing locally available compute resources for user (node: user) {{(pid=75176) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 15:53:04 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55febf04-14ea-4903-8692-c7cc6115de75/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:53:05 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55febf04-14ea-4903-8692-c7cc6115de75/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:53:05 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55febf04-14ea-4903-8692-c7cc6115de75/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:53:05 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55febf04-14ea-4903-8692-c7cc6115de75/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:53:05 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/193235b9-8ef5-41d0-a9ab-4f1679d30266/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:53:05 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/193235b9-8ef5-41d0-a9ab-4f1679d30266/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:53:05 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/193235b9-8ef5-41d0-a9ab-4f1679d30266/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:53:05 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/193235b9-8ef5-41d0-a9ab-4f1679d30266/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:53:05 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e8507b7-fccf-4196-b589-bf2b74f165ec/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:53:05 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e8507b7-fccf-4196-b589-bf2b74f165ec/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:53:05 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e8507b7-fccf-4196-b589-bf2b74f165ec/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:53:05 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e8507b7-fccf-4196-b589-bf2b74f165ec/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:53:05 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/742bfe1e-6885-4aba-9f7f-c07a5d904175/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:53:06 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/742bfe1e-6885-4aba-9f7f-c07a5d904175/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:53:06 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/742bfe1e-6885-4aba-9f7f-c07a5d904175/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:53:06 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/742bfe1e-6885-4aba-9f7f-c07a5d904175/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:53:06 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75176) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 15:53:06 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75176) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 15:53:06 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66ead7d-98f4-4822-9dce-f2ea0206a58d/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:53:06 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66ead7d-98f4-4822-9dce-f2ea0206a58d/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:53:06 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66ead7d-98f4-4822-9dce-f2ea0206a58d/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:53:06 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66ead7d-98f4-4822-9dce-f2ea0206a58d/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:53:06 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7/disk.rescue --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:53:06 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:53:06 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7/disk.rescue --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:53:07 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:53:07 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:53:07 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:53:07 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:53:07 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:53:07 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75176) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 15:53:07 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 15:53:07 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 15:53:07 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Hypervisor/Node resource view: name=user free_ram=7523MB free_disk=25.188846588134766GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75176) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 15:53:07 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:53:07 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:53:07 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Applying migration context for instance 6161cab2-eb1f-44cb-bbd5-077e6db42f77 as it has an incoming, in-progress migration 23477e3c-9f13-4dc8-9ae1-cce32657b62b. Migration status is finished {{(pid=75176) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 28 15:53:07 user nova-compute[75176]: INFO nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] [instance: 6161cab2-eb1f-44cb-bbd5-077e6db42f77] Updating resource usage from migration 23477e3c-9f13-4dc8-9ae1-cce32657b62b
Nov 28 15:53:07 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance 2e8507b7-fccf-4196-b589-bf2b74f165ec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:53:07 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance f66ead7d-98f4-4822-9dce-f2ea0206a58d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:53:07 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance 55febf04-14ea-4903-8692-c7cc6115de75 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:53:07 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance 8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:53:07 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance ca1558cf-b235-4a20-8d12-45f1ca16fe41 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:53:07 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance dc4e6d39-adfb-4d26-afef-46f316ff7846 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:53:07 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Migration 23477e3c-9f13-4dc8-9ae1-cce32657b62b is active on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 28 15:53:07 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance 6161cab2-eb1f-44cb-bbd5-077e6db42f77 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:53:07 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance 742bfe1e-6885-4aba-9f7f-c07a5d904175 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:53:07 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance 193235b9-8ef5-41d0-a9ab-4f1679d30266 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:53:07 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75176) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 15:53:07 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75176) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 15:53:08 user nova-compute[75176]: DEBUG nova.compute.provider_tree [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Inventory has not changed in ProviderTree for provider: b37848d8-f401-4155-a029-b0ffa09ff85b {{(pid=75176) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 15:53:08 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Inventory has not changed for provider b37848d8-f401-4155-a029-b0ffa09ff85b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75176) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 15:53:08 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Compute_service record updated for user:user {{(pid=75176) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 15:53:08 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.470s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:53:09 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:53:09 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:53:11 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:53:12 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:53:14 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:53:14 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:53:16 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:53:19 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:53:19 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:53:21 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:53:23 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:53:24 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:53:24 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:53:27 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:53:29 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:53:29 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:53:29 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:53:32 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-a1ef7d87-df6d-48a0-ac15-19f60beb56fc tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Acquiring lock "ecabea76-6c29-412d-bf77-989917b449a9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:53:32 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-a1ef7d87-df6d-48a0-ac15-19f60beb56fc tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Lock "ecabea76-6c29-412d-bf77-989917b449a9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:53:32 user nova-compute[75176]: DEBUG nova.compute.manager [None req-a1ef7d87-df6d-48a0-ac15-19f60beb56fc tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] [instance: ecabea76-6c29-412d-bf77-989917b449a9] Starting instance... {{(pid=75176) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 15:53:32 user nova-compute[75176]: DEBUG nova.compute.manager [req-910b3a3f-78e5-44e4-87f2-afb2dbed3bbd req-5e07eeea-5ab7-402d-b241-7a8998a100d3 service nova] [instance: ca1558cf-b235-4a20-8d12-45f1ca16fe41] Received event network-changed-2791b548-7207-402c-9f65-c078be714ef5 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:53:32 user nova-compute[75176]: DEBUG nova.compute.manager [req-910b3a3f-78e5-44e4-87f2-afb2dbed3bbd req-5e07eeea-5ab7-402d-b241-7a8998a100d3 service nova] [instance: ca1558cf-b235-4a20-8d12-45f1ca16fe41] Refreshing instance network info cache due to event network-changed-2791b548-7207-402c-9f65-c078be714ef5. {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 15:53:32 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-910b3a3f-78e5-44e4-87f2-afb2dbed3bbd req-5e07eeea-5ab7-402d-b241-7a8998a100d3 service nova] Acquiring lock "refresh_cache-ca1558cf-b235-4a20-8d12-45f1ca16fe41" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:53:32 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-910b3a3f-78e5-44e4-87f2-afb2dbed3bbd req-5e07eeea-5ab7-402d-b241-7a8998a100d3 service nova] Acquired lock "refresh_cache-ca1558cf-b235-4a20-8d12-45f1ca16fe41" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:53:32 user nova-compute[75176]: DEBUG nova.network.neutron [req-910b3a3f-78e5-44e4-87f2-afb2dbed3bbd req-5e07eeea-5ab7-402d-b241-7a8998a100d3 service nova] [instance: ca1558cf-b235-4a20-8d12-45f1ca16fe41] Refreshing network info cache for port 2791b548-7207-402c-9f65-c078be714ef5 {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 15:53:32 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-a1ef7d87-df6d-48a0-ac15-19f60beb56fc tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:53:32 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-a1ef7d87-df6d-48a0-ac15-19f60beb56fc tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:53:32 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-a1ef7d87-df6d-48a0-ac15-19f60beb56fc tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75176) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 15:53:32 user nova-compute[75176]: INFO nova.compute.claims [None req-a1ef7d87-df6d-48a0-ac15-19f60beb56fc tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] [instance: ecabea76-6c29-412d-bf77-989917b449a9] Claim successful on node user
Nov 28 15:53:32 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-d5a3385a-47e8-4d01-951d-c05d571ca05b tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] Acquiring lock "ca1558cf-b235-4a20-8d12-45f1ca16fe41" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:53:32 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-d5a3385a-47e8-4d01-951d-c05d571ca05b tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] Lock "ca1558cf-b235-4a20-8d12-45f1ca16fe41" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:53:32 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-d5a3385a-47e8-4d01-951d-c05d571ca05b tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] Acquiring lock "ca1558cf-b235-4a20-8d12-45f1ca16fe41-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:53:32 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-d5a3385a-47e8-4d01-951d-c05d571ca05b tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] Lock "ca1558cf-b235-4a20-8d12-45f1ca16fe41-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:53:32 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-d5a3385a-47e8-4d01-951d-c05d571ca05b tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] Lock "ca1558cf-b235-4a20-8d12-45f1ca16fe41-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:53:32 user nova-compute[75176]: INFO nova.compute.manager [None req-d5a3385a-47e8-4d01-951d-c05d571ca05b tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] [instance: ca1558cf-b235-4a20-8d12-45f1ca16fe41] Terminating instance
Nov 28 15:53:32 user nova-compute[75176]: DEBUG nova.compute.manager [None req-d5a3385a-47e8-4d01-951d-c05d571ca05b tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] [instance: ca1558cf-b235-4a20-8d12-45f1ca16fe41] Start destroying the instance on the hypervisor. {{(pid=75176) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 15:53:32 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:53:32 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:53:32 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:53:32 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:53:32 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:53:33 user nova-compute[75176]: DEBUG nova.compute.provider_tree [None req-a1ef7d87-df6d-48a0-ac15-19f60beb56fc tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Inventory has not changed in ProviderTree for provider: b37848d8-f401-4155-a029-b0ffa09ff85b {{(pid=75176) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 15:53:33 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-a1ef7d87-df6d-48a0-ac15-19f60beb56fc tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Inventory has not changed for provider b37848d8-f401-4155-a029-b0ffa09ff85b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75176) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 15:53:33 user nova-compute[75176]: DEBUG nova.network.neutron [req-910b3a3f-78e5-44e4-87f2-afb2dbed3bbd req-5e07eeea-5ab7-402d-b241-7a8998a100d3 service nova] [instance: ca1558cf-b235-4a20-8d12-45f1ca16fe41] Updated VIF entry in instance network info cache for port 2791b548-7207-402c-9f65-c078be714ef5. {{(pid=75176) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 15:53:33 user nova-compute[75176]: DEBUG nova.network.neutron [req-910b3a3f-78e5-44e4-87f2-afb2dbed3bbd req-5e07eeea-5ab7-402d-b241-7a8998a100d3 service nova] [instance: ca1558cf-b235-4a20-8d12-45f1ca16fe41] Updating instance_info_cache with network_info: [{"id": "2791b548-7207-402c-9f65-c078be714ef5", "address": "fa:16:3e:08:ec:9f", "network": {"id": "1f00fd98-3cd0-4c8c-912a-bc29124e1940", "bridge": "br-int", "label": "tempest-TestShelveInstance-1334429215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a8b3f118afd469f9c82ec2574586aaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2791b548-72", "ovs_interfaceid": "2791b548-7207-402c-9f65-c078be714ef5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:53:33 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-a1ef7d87-df6d-48a0-ac15-19f60beb56fc tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.486s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:53:33 user nova-compute[75176]: DEBUG nova.compute.manager [None req-a1ef7d87-df6d-48a0-ac15-19f60beb56fc tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] [instance: ecabea76-6c29-412d-bf77-989917b449a9] Start building networks asynchronously for instance. {{(pid=75176) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 15:53:33 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-910b3a3f-78e5-44e4-87f2-afb2dbed3bbd req-5e07eeea-5ab7-402d-b241-7a8998a100d3 service nova] Releasing lock "refresh_cache-ca1558cf-b235-4a20-8d12-45f1ca16fe41" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:53:33 user nova-compute[75176]: DEBUG nova.compute.manager [None req-a1ef7d87-df6d-48a0-ac15-19f60beb56fc tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] [instance: ecabea76-6c29-412d-bf77-989917b449a9] Allocating IP information in the background. {{(pid=75176) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 15:53:33 user nova-compute[75176]: DEBUG nova.network.neutron [None req-a1ef7d87-df6d-48a0-ac15-19f60beb56fc tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] [instance: ecabea76-6c29-412d-bf77-989917b449a9] allocate_for_instance() {{(pid=75176) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 15:53:33 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-a1ef7d87-df6d-48a0-ac15-19f60beb56fc tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] [instance: ecabea76-6c29-412d-bf77-989917b449a9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 15:53:33 user nova-compute[75176]: DEBUG nova.compute.manager [None req-a1ef7d87-df6d-48a0-ac15-19f60beb56fc tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] [instance: ecabea76-6c29-412d-bf77-989917b449a9] Start building block device mappings for instance. {{(pid=75176) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 15:53:33 user nova-compute[75176]: DEBUG nova.policy [None req-a1ef7d87-df6d-48a0-ac15-19f60beb56fc tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0dcee22ed63f40fab2ee0e42f5f38e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a10ba40c844955b63cb8603dd548cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75176) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 15:53:33 user nova-compute[75176]: DEBUG nova.compute.manager [None req-a1ef7d87-df6d-48a0-ac15-19f60beb56fc tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] [instance: ecabea76-6c29-412d-bf77-989917b449a9] Start spawning the instance on the hypervisor. {{(pid=75176) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 15:53:33 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-a1ef7d87-df6d-48a0-ac15-19f60beb56fc tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] [instance: ecabea76-6c29-412d-bf77-989917b449a9] Creating instance directory {{(pid=75176) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 15:53:33 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-a1ef7d87-df6d-48a0-ac15-19f60beb56fc tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] [instance: ecabea76-6c29-412d-bf77-989917b449a9] Creating image(s)
Nov 28 15:53:33 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-a1ef7d87-df6d-48a0-ac15-19f60beb56fc tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Acquiring lock "/opt/stack/data/nova/instances/ecabea76-6c29-412d-bf77-989917b449a9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:53:33 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-a1ef7d87-df6d-48a0-ac15-19f60beb56fc tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Lock "/opt/stack/data/nova/instances/ecabea76-6c29-412d-bf77-989917b449a9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:53:33 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-a1ef7d87-df6d-48a0-ac15-19f60beb56fc tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Lock "/opt/stack/data/nova/instances/ecabea76-6c29-412d-bf77-989917b449a9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:53:33 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-a1ef7d87-df6d-48a0-ac15-19f60beb56fc tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:53:33 user nova-compute[75176]: INFO nova.virt.libvirt.driver [-] [instance: ca1558cf-b235-4a20-8d12-45f1ca16fe41] Instance destroyed successfully.
Nov 28 15:53:33 user nova-compute[75176]: DEBUG nova.objects.instance [None req-d5a3385a-47e8-4d01-951d-c05d571ca05b tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] Lazy-loading 'resources' on Instance uuid ca1558cf-b235-4a20-8d12-45f1ca16fe41 {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:53:33 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-d5a3385a-47e8-4d01-951d-c05d571ca05b tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-28T15:47:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1092777141',display_name='tempest-TestShelveInstance-server-1092777141',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1092777141',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPlWOjLW2NpfEDLiMEuh38MSf6V/+wJUiKnArs/gZG1j8jp3V+GFd/BW0+XH7hYqoFiR47yFKC6ZOU1dYUI6qcGVEhOBdCmxl100xpeAUerFPsLxDciq8AgBllG8Awa1CQ==',key_name='tempest-TestShelveInstance-2062365153',keypairs=<?>,launch_index=0,launched_at=2023-11-28T15:51:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7a8b3f118afd469f9c82ec2574586aaf',ramdisk_id='',reservation_id='r-0ue1lblf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-801353787',owner_user_name='tempest-TestShelveInstance-801353787-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T15:51:57Z,user_data=None,user_id='4753cf25a4c14e8aacd55309ff7e988d',uuid=ca1558cf-b235-4a20-8d12-45f1ca16fe41,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2791b548-7207-402c-9f65-c078be714ef5", "address": "fa:16:3e:08:ec:9f", "network": {"id": "1f00fd98-3cd0-4c8c-912a-bc29124e1940", "bridge": "br-int", "label": "tempest-TestShelveInstance-1334429215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a8b3f118afd469f9c82ec2574586aaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2791b548-72", "ovs_interfaceid": "2791b548-7207-402c-9f65-c078be714ef5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 15:53:33 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-d5a3385a-47e8-4d01-951d-c05d571ca05b tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] Converting VIF {"id": "2791b548-7207-402c-9f65-c078be714ef5", "address": "fa:16:3e:08:ec:9f", "network": {"id": "1f00fd98-3cd0-4c8c-912a-bc29124e1940", "bridge": "br-int", "label": "tempest-TestShelveInstance-1334429215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a8b3f118afd469f9c82ec2574586aaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2791b548-72", "ovs_interfaceid": "2791b548-7207-402c-9f65-c078be714ef5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:53:33 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-d5a3385a-47e8-4d01-951d-c05d571ca05b tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:ec:9f,bridge_name='br-int',has_traffic_filtering=True,id=2791b548-7207-402c-9f65-c078be714ef5,network=Network(1f00fd98-3cd0-4c8c-912a-bc29124e1940),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2791b548-72') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:53:33 user nova-compute[75176]: DEBUG os_vif [None req-d5a3385a-47e8-4d01-951d-c05d571ca05b tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:ec:9f,bridge_name='br-int',has_traffic_filtering=True,id=2791b548-7207-402c-9f65-c078be714ef5,network=Network(1f00fd98-3cd0-4c8c-912a-bc29124e1940),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2791b548-72') {{(pid=75176) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 15:53:33 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:53:33 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2791b548-72, bridge=br-int, if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:53:33 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:53:33 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:53:33 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:53:33 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c4993875-b0a3-43dc-a359-df1d70d9303c) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:53:33 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:53:33 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:53:33 user nova-compute[75176]: INFO os_vif [None req-d5a3385a-47e8-4d01-951d-c05d571ca05b tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:ec:9f,bridge_name='br-int',has_traffic_filtering=True,id=2791b548-7207-402c-9f65-c078be714ef5,network=Network(1f00fd98-3cd0-4c8c-912a-bc29124e1940),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2791b548-72')
Nov 28 15:53:33 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d5a3385a-47e8-4d01-951d-c05d571ca05b tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] [instance: ca1558cf-b235-4a20-8d12-45f1ca16fe41] calling os-brick to detach iSCSI Volume {{(pid=75176) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 15:53:33 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a3385a-47e8-4d01-951d-c05d571ca05b tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c1b8a00>, {'target_iqn': 'iqn.2010-10.org.openstack:22933c6e-3d8f-44f5-bc41-dee97c587055', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ujGDYdRg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 15:53:33 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-d5a3385a-47e8-4d01-951d-c05d571ca05b tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 15:53:33 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-d5a3385a-47e8-4d01-951d-c05d571ca05b tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 15:53:33 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-d5a3385a-47e8-4d01-951d-c05d571ca05b tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 15:53:33 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:53:33 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:53:33 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[41bb898f-eaea-4b5d-bc45-cceaa3228b07]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:22933c6e-3d8f-44f5-bc41-dee97c587055\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:53:33 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a3385a-47e8-4d01-951d-c05d571ca05b tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 15:53:33 user nova-compute[75176]: No targets found.
Nov 28 15:53:33 user nova-compute[75176]: iSNS:
Nov 28 15:53:33 user nova-compute[75176]: No targets found.
Nov 28 15:53:33 user nova-compute[75176]: STATIC:
Nov 28 15:53:33 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6
Nov 28 15:53:33 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:53:33 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:53:33 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc
Nov 28 15:53:33 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:53:33 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:53:33 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:22933c6e-3d8f-44f5-bc41-dee97c587055
Nov 28 15:53:33 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:53:33 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:53:33 user nova-compute[75176]: FIRMWARE:
Nov 28 15:53:33 user nova-compute[75176]: No targets found.
Nov 28 15:53:33 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:53:33 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a3385a-47e8-4d01-951d-c05d571ca05b tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 15:53:33 user nova-compute[75176]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 15:53:33 user nova-compute[75176]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75176) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 15:53:33 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a3385a-47e8-4d01-951d-c05d571ca05b tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:22933c6e-3d8f-44f5-bc41-dee97c587055', 0)] {{(pid=75176) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 15:53:33 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:53:33 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-a1ef7d87-df6d-48a0-ac15-19f60beb56fc tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json" returned: 0 in 0.188s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:53:33 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-a1ef7d87-df6d-48a0-ac15-19f60beb56fc tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Acquiring lock "5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:53:33 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-a1ef7d87-df6d-48a0-ac15-19f60beb56fc tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Lock "5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:53:33 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-a1ef7d87-df6d-48a0-ac15-19f60beb56fc tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:53:33 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:53:33 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[a018c37c-6509-4866-b3e6-40c1b777a1a6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:22933c6e-3d8f-44f5-bc41-dee97c587055\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:53:33 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:53:33 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:53:33 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfad275d-8753-4fb8-97f9-69d2be627a10]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22933c6e-3d8f-44f5-bc41-dee97c587055 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc (non-flash)\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:53:33 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a3385a-47e8-4d01-951d-c05d571ca05b tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22933c6e-3d8f-44f5-bc41-dee97c587055 (non-flash)
Nov 28 15:53:33 user nova-compute[75176]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 (non-flash)
Nov 28 15:53:33 user nova-compute[75176]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc (non-flash)
Nov 28 15:53:33 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:53:33 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a3385a-47e8-4d01-951d-c05d571ca05b tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22933c6e-3d8f-44f5-bc41-dee97c587055 (non-flash)
Nov 28 15:53:33 user nova-compute[75176]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 (non-flash)
Nov 28 15:53:33 user nova-compute[75176]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc (non-flash)
Nov 28 15:53:33 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 15:53:33 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a3385a-47e8-4d01-951d-c05d571ca05b tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f464d96be20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:22933c6e-3d8f-44f5-bc41-dee97c587055'): ({'sdb'}, set())}) {{(pid=75176) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 15:53:33 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-d5a3385a-47e8-4d01-951d-c05d571ca05b tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] Removing single pathed devices sdb {{(pid=75176) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 15:53:33 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:53:33 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:53:33 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[50f1b658-9f3d-406a-a10c-2d7501f9bfea]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:53:33 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:53:33 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:53:33 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[81e5a62b-4562-42b9-ad71-e0fe99e5ef50]: (4, ('ok\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:53:33 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-d5a3385a-47e8-4d01-951d-c05d571ca05b tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] Flushing IO for device /dev/sdb {{(pid=75176) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 15:53:33 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:53:33 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.022s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:53:33 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ea3c801-f13f-4ae7-aaaf-42108124b669]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:53:33 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-d5a3385a-47e8-4d01-951d-c05d571ca05b tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75176) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 15:53:33 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:53:33 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-a1ef7d87-df6d-48a0-ac15-19f60beb56fc tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json" returned: 0 in 0.183s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:53:33 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-a1ef7d87-df6d-48a0-ac15-19f60beb56fc tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2,backing_fmt=raw /opt/stack/data/nova/instances/ecabea76-6c29-412d-bf77-989917b449a9/disk 1073741824 {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:53:33 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:53:33 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbfcbba7-1330-4c54-bf3b-81f766b0b461]: (4, ('1', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:53:33 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-d5a3385a-47e8-4d01-951d-c05d571ca05b tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75176) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 15:53:33 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-d5a3385a-47e8-4d01-951d-c05d571ca05b tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] SCSI volumes sdb have been removed. {{(pid=75176) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 15:53:33 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a3385a-47e8-4d01-951d-c05d571ca05b tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:22933c6e-3d8f-44f5-bc41-dee97c587055')] {{(pid=75176) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 15:53:33 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22933c6e-3d8f-44f5-bc41-dee97c587055 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:53:33 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-a1ef7d87-df6d-48a0-ac15-19f60beb56fc tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2,backing_fmt=raw /opt/stack/data/nova/instances/ecabea76-6c29-412d-bf77-989917b449a9/disk 1073741824" returned: 0 in 0.065s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:53:33 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-a1ef7d87-df6d-48a0-ac15-19f60beb56fc tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Lock "5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.252s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:53:33 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-a1ef7d87-df6d-48a0-ac15-19f60beb56fc tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:53:33 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22933c6e-3d8f-44f5-bc41-dee97c587055 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:53:33 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8f0cdda-606a-4969-8e7f-53e5c8653d6c]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:53:33 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a3385a-47e8-4d01-951d-c05d571ca05b tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:53:33 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22933c6e-3d8f-44f5-bc41-dee97c587055 -p 172.16.0.220:3260 --logout {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:53:33 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22933c6e-3d8f-44f5-bc41-dee97c587055 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:53:33 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a0465d4-56c1-40f8-8fbf-01144ccb159f]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:22933c6e-3d8f-44f5-bc41-dee97c587055, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:22933c6e-3d8f-44f5-bc41-dee97c587055, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:53:33 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a3385a-47e8-4d01-951d-c05d571ca05b tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:22933c6e-3d8f-44f5-bc41-dee97c587055, portal: 172.16.0.220,3260]
Nov 28 15:53:33 user nova-compute[75176]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:22933c6e-3d8f-44f5-bc41-dee97c587055, portal: 172.16.0.220,3260] successful.
Nov 28 15:53:33 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:53:33 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22933c6e-3d8f-44f5-bc41-dee97c587055 -p 172.16.0.220:3260 --op delete {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:53:34 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22933c6e-3d8f-44f5-bc41-dee97c587055 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:53:34 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[59f5032a-df69-4c8e-85d2-4a5751366096]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:53:34 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a3385a-47e8-4d01-951d-c05d571ca05b tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:53:34 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-d5a3385a-47e8-4d01-951d-c05d571ca05b tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.421s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 15:53:34 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a3385a-47e8-4d01-951d-c05d571ca05b tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] <== disconnect_volume: return (422ms) None {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 15:53:34 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d5a3385a-47e8-4d01-951d-c05d571ca05b tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] [instance: ca1558cf-b235-4a20-8d12-45f1ca16fe41] Disconnected iSCSI Volume {{(pid=75176) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 15:53:34 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-d5a3385a-47e8-4d01-951d-c05d571ca05b tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] [instance: ca1558cf-b235-4a20-8d12-45f1ca16fe41] Deleting instance files /opt/stack/data/nova/instances/ca1558cf-b235-4a20-8d12-45f1ca16fe41_del
Nov 28 15:53:34 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-d5a3385a-47e8-4d01-951d-c05d571ca05b tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] [instance: ca1558cf-b235-4a20-8d12-45f1ca16fe41] Deletion of /opt/stack/data/nova/instances/ca1558cf-b235-4a20-8d12-45f1ca16fe41_del complete
Nov 28 15:53:34 user nova-compute[75176]: DEBUG nova.network.neutron [None req-a1ef7d87-df6d-48a0-ac15-19f60beb56fc tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] [instance: ecabea76-6c29-412d-bf77-989917b449a9] Successfully created port: 1c8a679e-a301-43a1-81fa-6a80def1bade {{(pid=75176) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 15:53:34 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-a1ef7d87-df6d-48a0-ac15-19f60beb56fc tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json" returned: 0 in 0.186s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:53:34 user nova-compute[75176]: DEBUG nova.virt.disk.api [None req-a1ef7d87-df6d-48a0-ac15-19f60beb56fc tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ecabea76-6c29-412d-bf77-989917b449a9/disk. size=1073741824 {{(pid=75176) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 15:53:34 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-a1ef7d87-df6d-48a0-ac15-19f60beb56fc tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecabea76-6c29-412d-bf77-989917b449a9/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:53:34 user nova-compute[75176]: INFO nova.compute.manager [None req-d5a3385a-47e8-4d01-951d-c05d571ca05b tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] [instance: ca1558cf-b235-4a20-8d12-45f1ca16fe41] Took 1.35 seconds to destroy the instance on the hypervisor.
Nov 28 15:53:34 user nova-compute[75176]: DEBUG oslo.service.loopingcall [None req-d5a3385a-47e8-4d01-951d-c05d571ca05b tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75176) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 15:53:34 user nova-compute[75176]: DEBUG nova.compute.manager [-] [instance: ca1558cf-b235-4a20-8d12-45f1ca16fe41] Deallocating network for instance {{(pid=75176) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 15:53:34 user nova-compute[75176]: DEBUG nova.network.neutron [-] [instance: ca1558cf-b235-4a20-8d12-45f1ca16fe41] deallocate_for_instance() {{(pid=75176) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 15:53:34 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-a1ef7d87-df6d-48a0-ac15-19f60beb56fc tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecabea76-6c29-412d-bf77-989917b449a9/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:53:34 user nova-compute[75176]: DEBUG nova.virt.disk.api [None req-a1ef7d87-df6d-48a0-ac15-19f60beb56fc tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Cannot resize image /opt/stack/data/nova/instances/ecabea76-6c29-412d-bf77-989917b449a9/disk to a smaller size. {{(pid=75176) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 15:53:34 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-a1ef7d87-df6d-48a0-ac15-19f60beb56fc tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] [instance: ecabea76-6c29-412d-bf77-989917b449a9] Created local disks {{(pid=75176) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 15:53:34 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-a1ef7d87-df6d-48a0-ac15-19f60beb56fc tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] [instance: ecabea76-6c29-412d-bf77-989917b449a9] Ensure instance console log exists: /opt/stack/data/nova/instances/ecabea76-6c29-412d-bf77-989917b449a9/console.log {{(pid=75176) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 15:53:34 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-a1ef7d87-df6d-48a0-ac15-19f60beb56fc tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:53:34 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-a1ef7d87-df6d-48a0-ac15-19f60beb56fc tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:53:34 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-a1ef7d87-df6d-48a0-ac15-19f60beb56fc tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:53:34 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:53:34 user nova-compute[75176]: DEBUG nova.network.neutron [-] [instance: ca1558cf-b235-4a20-8d12-45f1ca16fe41] Updating instance_info_cache with network_info: [] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:53:34 user nova-compute[75176]: INFO nova.compute.manager [-] [instance: ca1558cf-b235-4a20-8d12-45f1ca16fe41] Took 0.38 seconds to deallocate network for instance.
Nov 28 15:53:34 user nova-compute[75176]: DEBUG nova.compute.manager [req-e8cbed41-de91-4425-a52a-bf427c82e526 req-22b9fe47-9cc9-4bc4-860b-aa3ad0fcf2f7 service nova] [instance: ca1558cf-b235-4a20-8d12-45f1ca16fe41] Received event network-vif-deleted-2791b548-7207-402c-9f65-c078be714ef5 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:53:34 user nova-compute[75176]: INFO nova.compute.manager [req-e8cbed41-de91-4425-a52a-bf427c82e526 req-22b9fe47-9cc9-4bc4-860b-aa3ad0fcf2f7 service nova] [instance: ca1558cf-b235-4a20-8d12-45f1ca16fe41] Neutron deleted interface 2791b548-7207-402c-9f65-c078be714ef5; detaching it from the instance and deleting it from the info cache
Nov 28 15:53:34 user nova-compute[75176]: DEBUG nova.network.neutron [req-e8cbed41-de91-4425-a52a-bf427c82e526 req-22b9fe47-9cc9-4bc4-860b-aa3ad0fcf2f7 service nova] [instance: ca1558cf-b235-4a20-8d12-45f1ca16fe41] Updating instance_info_cache with network_info: [] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:53:34 user nova-compute[75176]: DEBUG nova.compute.manager [req-e8cbed41-de91-4425-a52a-bf427c82e526 req-22b9fe47-9cc9-4bc4-860b-aa3ad0fcf2f7 service nova] [instance: ca1558cf-b235-4a20-8d12-45f1ca16fe41] Detach interface failed, port_id=2791b548-7207-402c-9f65-c078be714ef5, reason: Instance ca1558cf-b235-4a20-8d12-45f1ca16fe41 could not be found. {{(pid=75176) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 28 15:53:34 user nova-compute[75176]: DEBUG nova.network.neutron [None req-a1ef7d87-df6d-48a0-ac15-19f60beb56fc tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] [instance: ecabea76-6c29-412d-bf77-989917b449a9] Successfully updated port: 1c8a679e-a301-43a1-81fa-6a80def1bade {{(pid=75176) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 15:53:34 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-a1ef7d87-df6d-48a0-ac15-19f60beb56fc tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Acquiring lock "refresh_cache-ecabea76-6c29-412d-bf77-989917b449a9" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:53:34 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-a1ef7d87-df6d-48a0-ac15-19f60beb56fc tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Acquired lock "refresh_cache-ecabea76-6c29-412d-bf77-989917b449a9" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:53:34 user nova-compute[75176]: DEBUG nova.network.neutron [None req-a1ef7d87-df6d-48a0-ac15-19f60beb56fc tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] [instance: ecabea76-6c29-412d-bf77-989917b449a9] Building network info cache for instance {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 15:53:34 user nova-compute[75176]: DEBUG nova.compute.manager [req-b02eec68-147c-4359-bf9d-3d4996ab32ce req-7b09d859-9c01-4182-a663-a0de6cd34f26 service nova] [instance: ecabea76-6c29-412d-bf77-989917b449a9] Received event network-changed-1c8a679e-a301-43a1-81fa-6a80def1bade {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:53:34 user nova-compute[75176]: DEBUG nova.compute.manager [req-b02eec68-147c-4359-bf9d-3d4996ab32ce req-7b09d859-9c01-4182-a663-a0de6cd34f26 service nova] [instance: ecabea76-6c29-412d-bf77-989917b449a9] Refreshing instance network info cache due to event network-changed-1c8a679e-a301-43a1-81fa-6a80def1bade. {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 15:53:34 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-b02eec68-147c-4359-bf9d-3d4996ab32ce req-7b09d859-9c01-4182-a663-a0de6cd34f26 service nova] Acquiring lock "refresh_cache-ecabea76-6c29-412d-bf77-989917b449a9" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:53:35 user nova-compute[75176]: DEBUG nova.network.neutron [None req-a1ef7d87-df6d-48a0-ac15-19f60beb56fc tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] [instance: ecabea76-6c29-412d-bf77-989917b449a9] Instance cache missing network info. {{(pid=75176) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 15:53:35 user nova-compute[75176]: DEBUG nova.network.neutron [None req-a1ef7d87-df6d-48a0-ac15-19f60beb56fc tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] [instance: ecabea76-6c29-412d-bf77-989917b449a9] Updating instance_info_cache with network_info: [{"id": "1c8a679e-a301-43a1-81fa-6a80def1bade", "address": "fa:16:3e:7e:b3:fc", "network": {"id": "1fd59c02-7617-4d0e-9456-84d6cc91ce3b", "bridge": "br-int", "label": "tempest-TestStampPattern-116968826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4a10ba40c844955b63cb8603dd548cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c8a679e-a3", "ovs_interfaceid": "1c8a679e-a301-43a1-81fa-6a80def1bade", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:53:35 user nova-compute[75176]: INFO nova.compute.manager [None req-d5a3385a-47e8-4d01-951d-c05d571ca05b tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] [instance: ca1558cf-b235-4a20-8d12-45f1ca16fe41] Took 0.77 seconds to detach 1 volumes for instance.
Nov 28 15:53:35 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-a1ef7d87-df6d-48a0-ac15-19f60beb56fc tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Releasing lock "refresh_cache-ecabea76-6c29-412d-bf77-989917b449a9" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:53:35 user nova-compute[75176]: DEBUG nova.compute.manager [None req-a1ef7d87-df6d-48a0-ac15-19f60beb56fc tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] [instance: ecabea76-6c29-412d-bf77-989917b449a9] Instance network_info: |[{"id": "1c8a679e-a301-43a1-81fa-6a80def1bade", "address": "fa:16:3e:7e:b3:fc", "network": {"id": "1fd59c02-7617-4d0e-9456-84d6cc91ce3b", "bridge": "br-int", "label": "tempest-TestStampPattern-116968826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4a10ba40c844955b63cb8603dd548cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c8a679e-a3", "ovs_interfaceid": "1c8a679e-a301-43a1-81fa-6a80def1bade", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75176) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 15:53:35 user nova-compute[75176]: DEBUG nova.compute.manager [None req-d5a3385a-47e8-4d01-951d-c05d571ca05b tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] [instance: ca1558cf-b235-4a20-8d12-45f1ca16fe41] Deleting volume: 22933c6e-3d8f-44f5-bc41-dee97c587055 {{(pid=75176) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 28 15:53:35 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-b02eec68-147c-4359-bf9d-3d4996ab32ce req-7b09d859-9c01-4182-a663-a0de6cd34f26 service nova] Acquired lock "refresh_cache-ecabea76-6c29-412d-bf77-989917b449a9" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:53:35 user nova-compute[75176]: DEBUG nova.network.neutron [req-b02eec68-147c-4359-bf9d-3d4996ab32ce req-7b09d859-9c01-4182-a663-a0de6cd34f26 service nova] [instance: ecabea76-6c29-412d-bf77-989917b449a9] Refreshing network info cache for port 1c8a679e-a301-43a1-81fa-6a80def1bade {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 15:53:35 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-a1ef7d87-df6d-48a0-ac15-19f60beb56fc tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] [instance: ecabea76-6c29-412d-bf77-989917b449a9] Start _get_guest_xml network_info=[{"id": "1c8a679e-a301-43a1-81fa-6a80def1bade", "address": "fa:16:3e:7e:b3:fc", "network": {"id": "1fd59c02-7617-4d0e-9456-84d6cc91ce3b", "bridge": "br-int", "label": "tempest-TestStampPattern-116968826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4a10ba40c844955b63cb8603dd548cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c8a679e-a3", "ovs_interfaceid": "1c8a679e-a301-43a1-81fa-6a80def1bade", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T15:35:12Z,direct_url=<?>,disk_format='qcow2',id=1f41819e-c93f-4dc7-b253-37a27bbbbc74,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1b91c5d0672c4224a48df2e1f92688e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T15:35:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'size': 0, 'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'image_id': '1f41819e-c93f-4dc7-b253-37a27bbbbc74'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75176) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 15:53:35 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-a1ef7d87-df6d-48a0-ac15-19f60beb56fc tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 15:53:35 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-a1ef7d87-df6d-48a0-ac15-19f60beb56fc tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 15:53:35 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-a1ef7d87-df6d-48a0-ac15-19f60beb56fc tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75176) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 15:53:35 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-a1ef7d87-df6d-48a0-ac15-19f60beb56fc tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] CPU controller missing on host. {{(pid=75176) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 15:53:35 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-a1ef7d87-df6d-48a0-ac15-19f60beb56fc tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75176) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 15:53:35 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-a1ef7d87-df6d-48a0-ac15-19f60beb56fc tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] CPU controller found on host. {{(pid=75176) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 15:53:35 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-a1ef7d87-df6d-48a0-ac15-19f60beb56fc tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75176) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 15:53:35 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-a1ef7d87-df6d-48a0-ac15-19f60beb56fc tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T15:35:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T15:35:12Z,direct_url=<?>,disk_format='qcow2',id=1f41819e-c93f-4dc7-b253-37a27bbbbc74,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1b91c5d0672c4224a48df2e1f92688e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T15:35:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 15:53:35 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-a1ef7d87-df6d-48a0-ac15-19f60beb56fc tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Flavor limits 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 15:53:35 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-a1ef7d87-df6d-48a0-ac15-19f60beb56fc tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Image limits 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 15:53:35 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-a1ef7d87-df6d-48a0-ac15-19f60beb56fc tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Flavor pref 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 15:53:35 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-a1ef7d87-df6d-48a0-ac15-19f60beb56fc tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Image pref 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 15:53:35 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-a1ef7d87-df6d-48a0-ac15-19f60beb56fc tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 15:53:35 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-a1ef7d87-df6d-48a0-ac15-19f60beb56fc tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 15:53:35 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-a1ef7d87-df6d-48a0-ac15-19f60beb56fc tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75176) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 15:53:35 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-a1ef7d87-df6d-48a0-ac15-19f60beb56fc tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Got 1 possible topologies {{(pid=75176) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 15:53:35 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-a1ef7d87-df6d-48a0-ac15-19f60beb56fc tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 15:53:35 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-a1ef7d87-df6d-48a0-ac15-19f60beb56fc tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 15:53:35 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-a1ef7d87-df6d-48a0-ac15-19f60beb56fc tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T15:53:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-545953161',display_name='tempest-TestStampPattern-server-545953161',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-545953161',id=38,image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJDBFhGQGpvl0PzqrMCTu0nZeD/U57w9NaBED1EztO7Blxs28QRqXvlfz9rV68t1LblFY2IOCQcQRNQ31eEMoYQx8drae7GcY4KAfy8XhLJfS2RIdXJ5ySbX/yQzldJoeQ==',key_name='tempest-TestStampPattern-557159962',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c4a10ba40c844955b63cb8603dd548cf',ramdisk_id='',reservation_id='r-5rp9008j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-286689652',owner_user_name='tempest-TestStampPattern-286689652-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T15:53:33Z,user_data=None,user_id='0dcee22ed63f40fab2ee0e42f5f38e13',uuid=ecabea76-6c29-412d-bf77-989917b449a9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1c8a679e-a301-43a1-81fa-6a80def1bade", "address": "fa:16:3e:7e:b3:fc", "network": {"id": "1fd59c02-7617-4d0e-9456-84d6cc91ce3b", "bridge": "br-int", "label": "tempest-TestStampPattern-116968826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4a10ba40c844955b63cb8603dd548cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c8a679e-a3", "ovs_interfaceid": "1c8a679e-a301-43a1-81fa-6a80def1bade", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75176) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 15:53:35 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-a1ef7d87-df6d-48a0-ac15-19f60beb56fc tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Converting VIF {"id": "1c8a679e-a301-43a1-81fa-6a80def1bade", "address": "fa:16:3e:7e:b3:fc", "network": {"id": "1fd59c02-7617-4d0e-9456-84d6cc91ce3b", "bridge": "br-int", "label": "tempest-TestStampPattern-116968826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4a10ba40c844955b63cb8603dd548cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c8a679e-a3", "ovs_interfaceid": "1c8a679e-a301-43a1-81fa-6a80def1bade", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:53:35 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-a1ef7d87-df6d-48a0-ac15-19f60beb56fc tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:b3:fc,bridge_name='br-int',has_traffic_filtering=True,id=1c8a679e-a301-43a1-81fa-6a80def1bade,network=Network(1fd59c02-7617-4d0e-9456-84d6cc91ce3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c8a679e-a3') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:53:35 user nova-compute[75176]: DEBUG nova.objects.instance [None req-a1ef7d87-df6d-48a0-ac15-19f60beb56fc tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Lazy-loading 'pci_devices' on Instance uuid ecabea76-6c29-412d-bf77-989917b449a9 {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:53:35 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-a1ef7d87-df6d-48a0-ac15-19f60beb56fc tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] [instance: ecabea76-6c29-412d-bf77-989917b449a9] End _get_guest_xml xml=<domain type="kvm">
Nov 28 15:53:35 user nova-compute[75176]:   <uuid>ecabea76-6c29-412d-bf77-989917b449a9</uuid>
Nov 28 15:53:35 user nova-compute[75176]:   <name>instance-00000026</name>
Nov 28 15:53:35 user nova-compute[75176]:   <memory>524288</memory>
Nov 28 15:53:35 user nova-compute[75176]:   <vcpu>1</vcpu>
Nov 28 15:53:35 user nova-compute[75176]:   <metadata>
Nov 28 15:53:35 user nova-compute[75176]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 15:53:35 user nova-compute[75176]:       <nova:package version="0.0.0"/>
Nov 28 15:53:35 user nova-compute[75176]:       <nova:name>tempest-TestStampPattern-server-545953161</nova:name>
Nov 28 15:53:35 user nova-compute[75176]:       <nova:creationTime>2023-11-28 15:53:35</nova:creationTime>
Nov 28 15:53:35 user nova-compute[75176]:       <nova:flavor name="m1.tiny">
Nov 28 15:53:35 user nova-compute[75176]:         <nova:memory>512</nova:memory>
Nov 28 15:53:35 user nova-compute[75176]:         <nova:disk>1</nova:disk>
Nov 28 15:53:35 user nova-compute[75176]:         <nova:swap>0</nova:swap>
Nov 28 15:53:35 user nova-compute[75176]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 15:53:35 user nova-compute[75176]:         <nova:vcpus>1</nova:vcpus>
Nov 28 15:53:35 user nova-compute[75176]:       </nova:flavor>
Nov 28 15:53:35 user nova-compute[75176]:       <nova:owner>
Nov 28 15:53:35 user nova-compute[75176]:         <nova:user uuid="0dcee22ed63f40fab2ee0e42f5f38e13">tempest-TestStampPattern-286689652-project-member</nova:user>
Nov 28 15:53:35 user nova-compute[75176]:         <nova:project uuid="c4a10ba40c844955b63cb8603dd548cf">tempest-TestStampPattern-286689652</nova:project>
Nov 28 15:53:35 user nova-compute[75176]:       </nova:owner>
Nov 28 15:53:35 user nova-compute[75176]:       <nova:root type="image" uuid="1f41819e-c93f-4dc7-b253-37a27bbbbc74"/>
Nov 28 15:53:35 user nova-compute[75176]:       <nova:ports>
Nov 28 15:53:35 user nova-compute[75176]:         <nova:port uuid="1c8a679e-a301-43a1-81fa-6a80def1bade">
Nov 28 15:53:35 user nova-compute[75176]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 28 15:53:35 user nova-compute[75176]:         </nova:port>
Nov 28 15:53:35 user nova-compute[75176]:       </nova:ports>
Nov 28 15:53:35 user nova-compute[75176]:     </nova:instance>
Nov 28 15:53:35 user nova-compute[75176]:   </metadata>
Nov 28 15:53:35 user nova-compute[75176]:   <sysinfo type="smbios">
Nov 28 15:53:35 user nova-compute[75176]:     <system>
Nov 28 15:53:35 user nova-compute[75176]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 15:53:35 user nova-compute[75176]:       <entry name="product">OpenStack Nova</entry>
Nov 28 15:53:35 user nova-compute[75176]:       <entry name="version">0.0.0</entry>
Nov 28 15:53:35 user nova-compute[75176]:       <entry name="serial">ecabea76-6c29-412d-bf77-989917b449a9</entry>
Nov 28 15:53:35 user nova-compute[75176]:       <entry name="uuid">ecabea76-6c29-412d-bf77-989917b449a9</entry>
Nov 28 15:53:35 user nova-compute[75176]:       <entry name="family">Virtual Machine</entry>
Nov 28 15:53:35 user nova-compute[75176]:     </system>
Nov 28 15:53:35 user nova-compute[75176]:   </sysinfo>
Nov 28 15:53:35 user nova-compute[75176]:   <os>
Nov 28 15:53:35 user nova-compute[75176]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 15:53:35 user nova-compute[75176]:     <boot dev="hd"/>
Nov 28 15:53:35 user nova-compute[75176]:     <smbios mode="sysinfo"/>
Nov 28 15:53:35 user nova-compute[75176]:   </os>
Nov 28 15:53:35 user nova-compute[75176]:   <features>
Nov 28 15:53:35 user nova-compute[75176]:     <acpi/>
Nov 28 15:53:35 user nova-compute[75176]:     <apic/>
Nov 28 15:53:35 user nova-compute[75176]:     <vmcoreinfo/>
Nov 28 15:53:35 user nova-compute[75176]:   </features>
Nov 28 15:53:35 user nova-compute[75176]:   <clock offset="utc">
Nov 28 15:53:35 user nova-compute[75176]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 15:53:35 user nova-compute[75176]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 15:53:35 user nova-compute[75176]:     <timer name="hpet" present="no"/>
Nov 28 15:53:35 user nova-compute[75176]:   </clock>
Nov 28 15:53:35 user nova-compute[75176]:   <cpu mode="custom" match="exact">
Nov 28 15:53:35 user nova-compute[75176]:     <model>Nehalem</model>
Nov 28 15:53:35 user nova-compute[75176]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 15:53:35 user nova-compute[75176]:   </cpu>
Nov 28 15:53:35 user nova-compute[75176]:   <devices>
Nov 28 15:53:35 user nova-compute[75176]:     <disk type="file" device="disk">
Nov 28 15:53:35 user nova-compute[75176]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 15:53:35 user nova-compute[75176]:       <source file="/opt/stack/data/nova/instances/ecabea76-6c29-412d-bf77-989917b449a9/disk"/>
Nov 28 15:53:35 user nova-compute[75176]:       <target dev="vda" bus="virtio"/>
Nov 28 15:53:35 user nova-compute[75176]:     </disk>
Nov 28 15:53:35 user nova-compute[75176]:     <interface type="ethernet">
Nov 28 15:53:35 user nova-compute[75176]:       <mac address="fa:16:3e:7e:b3:fc"/>
Nov 28 15:53:35 user nova-compute[75176]:       <model type="virtio"/>
Nov 28 15:53:35 user nova-compute[75176]:       <mtu size="1442"/>
Nov 28 15:53:35 user nova-compute[75176]:       <target dev="tap1c8a679e-a3"/>
Nov 28 15:53:35 user nova-compute[75176]:     </interface>
Nov 28 15:53:35 user nova-compute[75176]:     <serial type="pty">
Nov 28 15:53:35 user nova-compute[75176]:       <log file="/opt/stack/data/nova/instances/ecabea76-6c29-412d-bf77-989917b449a9/console.log" append="off"/>
Nov 28 15:53:35 user nova-compute[75176]:     </serial>
Nov 28 15:53:35 user nova-compute[75176]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 15:53:35 user nova-compute[75176]:     <video>
Nov 28 15:53:35 user nova-compute[75176]:       <model type="virtio"/>
Nov 28 15:53:35 user nova-compute[75176]:     </video>
Nov 28 15:53:35 user nova-compute[75176]:     <rng model="virtio">
Nov 28 15:53:35 user nova-compute[75176]:       <backend model="random">/dev/urandom</backend>
Nov 28 15:53:35 user nova-compute[75176]:     </rng>
Nov 28 15:53:35 user nova-compute[75176]:     <controller type="usb" index="0" model="none"/>
Nov 28 15:53:35 user nova-compute[75176]:     <memballoon model="virtio">
Nov 28 15:53:35 user nova-compute[75176]:       <stats period="10"/>
Nov 28 15:53:35 user nova-compute[75176]:     </memballoon>
Nov 28 15:53:35 user nova-compute[75176]:   </devices>
Nov 28 15:53:35 user nova-compute[75176]: </domain>
Nov 28 15:53:35 user nova-compute[75176]:  {{(pid=75176) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 15:53:35 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-a1ef7d87-df6d-48a0-ac15-19f60beb56fc tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T15:53:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-545953161',display_name='tempest-TestStampPattern-server-545953161',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-545953161',id=38,image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJDBFhGQGpvl0PzqrMCTu0nZeD/U57w9NaBED1EztO7Blxs28QRqXvlfz9rV68t1LblFY2IOCQcQRNQ31eEMoYQx8drae7GcY4KAfy8XhLJfS2RIdXJ5ySbX/yQzldJoeQ==',key_name='tempest-TestStampPattern-557159962',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c4a10ba40c844955b63cb8603dd548cf',ramdisk_id='',reservation_id='r-5rp9008j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-286689652',owner_user_name='tempest-TestStampPattern-286689652-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T15:53:33Z,user_data=None,user_id='0dcee22ed63f40fab2ee0e42f5f38e13',uuid=ecabea76-6c29-412d-bf77-989917b449a9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1c8a679e-a301-43a1-81fa-6a80def1bade", "address": "fa:16:3e:7e:b3:fc", "network": {"id": "1fd59c02-7617-4d0e-9456-84d6cc91ce3b", "bridge": "br-int", "label": "tempest-TestStampPattern-116968826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4a10ba40c844955b63cb8603dd548cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c8a679e-a3", "ovs_interfaceid": "1c8a679e-a301-43a1-81fa-6a80def1bade", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 15:53:35 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-a1ef7d87-df6d-48a0-ac15-19f60beb56fc tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Converting VIF {"id": "1c8a679e-a301-43a1-81fa-6a80def1bade", "address": "fa:16:3e:7e:b3:fc", "network": {"id": "1fd59c02-7617-4d0e-9456-84d6cc91ce3b", "bridge": "br-int", "label": "tempest-TestStampPattern-116968826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4a10ba40c844955b63cb8603dd548cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c8a679e-a3", "ovs_interfaceid": "1c8a679e-a301-43a1-81fa-6a80def1bade", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:53:35 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-a1ef7d87-df6d-48a0-ac15-19f60beb56fc tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:b3:fc,bridge_name='br-int',has_traffic_filtering=True,id=1c8a679e-a301-43a1-81fa-6a80def1bade,network=Network(1fd59c02-7617-4d0e-9456-84d6cc91ce3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c8a679e-a3') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:53:35 user nova-compute[75176]: DEBUG os_vif [None req-a1ef7d87-df6d-48a0-ac15-19f60beb56fc tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:b3:fc,bridge_name='br-int',has_traffic_filtering=True,id=1c8a679e-a301-43a1-81fa-6a80def1bade,network=Network(1fd59c02-7617-4d0e-9456-84d6cc91ce3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c8a679e-a3') {{(pid=75176) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 15:53:35 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:53:35 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:53:35 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 15:53:35 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:53:35 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '52f359e6-4f68-59d6-913f-ea1007a5ad26', '_type': 'linux-noop'}}, row=False) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:53:35 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:53:35 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:53:35 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:53:35 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1c8a679e-a3, may_exist=True, interface_attrs={}) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:53:35 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1c8a679e-a3, col_values=(('qos', UUID('791ca999-0e0f-41a8-bfd6-a71a2d382afc')),), if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:53:35 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1c8a679e-a3, col_values=(('external_ids', {'iface-id': '1c8a679e-a301-43a1-81fa-6a80def1bade', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7e:b3:fc', 'vm-uuid': 'ecabea76-6c29-412d-bf77-989917b449a9'}),), if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:53:35 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:53:35 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:53:35 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-d5a3385a-47e8-4d01-951d-c05d571ca05b tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:53:35 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-d5a3385a-47e8-4d01-951d-c05d571ca05b tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:53:35 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:53:35 user nova-compute[75176]: INFO os_vif [None req-a1ef7d87-df6d-48a0-ac15-19f60beb56fc tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:b3:fc,bridge_name='br-int',has_traffic_filtering=True,id=1c8a679e-a301-43a1-81fa-6a80def1bade,network=Network(1fd59c02-7617-4d0e-9456-84d6cc91ce3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c8a679e-a3')
Nov 28 15:53:35 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-a1ef7d87-df6d-48a0-ac15-19f60beb56fc tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] No BDM found with device name vda, not building metadata. {{(pid=75176) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 15:53:35 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-a1ef7d87-df6d-48a0-ac15-19f60beb56fc tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] No VIF found with MAC fa:16:3e:7e:b3:fc, not building metadata {{(pid=75176) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 15:53:35 user nova-compute[75176]: DEBUG nova.compute.provider_tree [None req-d5a3385a-47e8-4d01-951d-c05d571ca05b tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] Inventory has not changed in ProviderTree for provider: b37848d8-f401-4155-a029-b0ffa09ff85b {{(pid=75176) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 15:53:35 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-d5a3385a-47e8-4d01-951d-c05d571ca05b tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] Inventory has not changed for provider b37848d8-f401-4155-a029-b0ffa09ff85b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75176) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 15:53:35 user nova-compute[75176]: DEBUG nova.network.neutron [req-b02eec68-147c-4359-bf9d-3d4996ab32ce req-7b09d859-9c01-4182-a663-a0de6cd34f26 service nova] [instance: ecabea76-6c29-412d-bf77-989917b449a9] Updated VIF entry in instance network info cache for port 1c8a679e-a301-43a1-81fa-6a80def1bade. {{(pid=75176) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 15:53:35 user nova-compute[75176]: DEBUG nova.network.neutron [req-b02eec68-147c-4359-bf9d-3d4996ab32ce req-7b09d859-9c01-4182-a663-a0de6cd34f26 service nova] [instance: ecabea76-6c29-412d-bf77-989917b449a9] Updating instance_info_cache with network_info: [{"id": "1c8a679e-a301-43a1-81fa-6a80def1bade", "address": "fa:16:3e:7e:b3:fc", "network": {"id": "1fd59c02-7617-4d0e-9456-84d6cc91ce3b", "bridge": "br-int", "label": "tempest-TestStampPattern-116968826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4a10ba40c844955b63cb8603dd548cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c8a679e-a3", "ovs_interfaceid": "1c8a679e-a301-43a1-81fa-6a80def1bade", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:53:35 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-b02eec68-147c-4359-bf9d-3d4996ab32ce req-7b09d859-9c01-4182-a663-a0de6cd34f26 service nova] Releasing lock "refresh_cache-ecabea76-6c29-412d-bf77-989917b449a9" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:53:35 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-d5a3385a-47e8-4d01-951d-c05d571ca05b tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.369s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:53:35 user nova-compute[75176]: INFO nova.scheduler.client.report [None req-d5a3385a-47e8-4d01-951d-c05d571ca05b tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] Deleted allocations for instance ca1558cf-b235-4a20-8d12-45f1ca16fe41
Nov 28 15:53:35 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-d5a3385a-47e8-4d01-951d-c05d571ca05b tempest-TestShelveInstance-801353787 tempest-TestShelveInstance-801353787-project-member] Lock "ca1558cf-b235-4a20-8d12-45f1ca16fe41" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.160s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:53:36 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:53:36 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:53:36 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:53:37 user nova-compute[75176]: DEBUG nova.compute.manager [req-cf251c63-f39a-4e14-ae44-a7b981491d05 req-5da98fed-a921-4f32-a36e-e88d991b0642 service nova] [instance: ecabea76-6c29-412d-bf77-989917b449a9] Received event network-vif-plugged-1c8a679e-a301-43a1-81fa-6a80def1bade {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:53:37 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-cf251c63-f39a-4e14-ae44-a7b981491d05 req-5da98fed-a921-4f32-a36e-e88d991b0642 service nova] Acquiring lock "ecabea76-6c29-412d-bf77-989917b449a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:53:37 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-cf251c63-f39a-4e14-ae44-a7b981491d05 req-5da98fed-a921-4f32-a36e-e88d991b0642 service nova] Lock "ecabea76-6c29-412d-bf77-989917b449a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:53:37 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-cf251c63-f39a-4e14-ae44-a7b981491d05 req-5da98fed-a921-4f32-a36e-e88d991b0642 service nova] Lock "ecabea76-6c29-412d-bf77-989917b449a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:53:37 user nova-compute[75176]: DEBUG nova.compute.manager [req-cf251c63-f39a-4e14-ae44-a7b981491d05 req-5da98fed-a921-4f32-a36e-e88d991b0642 service nova] [instance: ecabea76-6c29-412d-bf77-989917b449a9] No waiting events found dispatching network-vif-plugged-1c8a679e-a301-43a1-81fa-6a80def1bade {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:53:37 user nova-compute[75176]: WARNING nova.compute.manager [req-cf251c63-f39a-4e14-ae44-a7b981491d05 req-5da98fed-a921-4f32-a36e-e88d991b0642 service nova] [instance: ecabea76-6c29-412d-bf77-989917b449a9] Received unexpected event network-vif-plugged-1c8a679e-a301-43a1-81fa-6a80def1bade for instance with vm_state building and task_state spawning.
Nov 28 15:53:37 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:53:37 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:53:37 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:53:38 user nova-compute[75176]: DEBUG nova.compute.manager [None req-a1ef7d87-df6d-48a0-ac15-19f60beb56fc tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] [instance: ecabea76-6c29-412d-bf77-989917b449a9] Instance event wait completed in 0 seconds for  {{(pid=75176) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 15:53:38 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-a1ef7d87-df6d-48a0-ac15-19f60beb56fc tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] [instance: ecabea76-6c29-412d-bf77-989917b449a9] Guest created on hypervisor {{(pid=75176) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 15:53:39 user nova-compute[75176]: INFO nova.virt.libvirt.driver [-] [instance: ecabea76-6c29-412d-bf77-989917b449a9] Instance spawned successfully.
Nov 28 15:53:39 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-a1ef7d87-df6d-48a0-ac15-19f60beb56fc tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] [instance: ecabea76-6c29-412d-bf77-989917b449a9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 15:53:39 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-a1ef7d87-df6d-48a0-ac15-19f60beb56fc tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] [instance: ecabea76-6c29-412d-bf77-989917b449a9] Found default for hw_cdrom_bus of ide {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:53:39 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-a1ef7d87-df6d-48a0-ac15-19f60beb56fc tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] [instance: ecabea76-6c29-412d-bf77-989917b449a9] Found default for hw_disk_bus of virtio {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:53:39 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-a1ef7d87-df6d-48a0-ac15-19f60beb56fc tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] [instance: ecabea76-6c29-412d-bf77-989917b449a9] Found default for hw_input_bus of None {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:53:39 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-a1ef7d87-df6d-48a0-ac15-19f60beb56fc tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] [instance: ecabea76-6c29-412d-bf77-989917b449a9] Found default for hw_pointer_model of None {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:53:39 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-a1ef7d87-df6d-48a0-ac15-19f60beb56fc tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] [instance: ecabea76-6c29-412d-bf77-989917b449a9] Found default for hw_video_model of virtio {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:53:39 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-a1ef7d87-df6d-48a0-ac15-19f60beb56fc tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] [instance: ecabea76-6c29-412d-bf77-989917b449a9] Found default for hw_vif_model of virtio {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:53:39 user nova-compute[75176]: INFO nova.compute.manager [None req-a1ef7d87-df6d-48a0-ac15-19f60beb56fc tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] [instance: ecabea76-6c29-412d-bf77-989917b449a9] Took 5.67 seconds to spawn the instance on the hypervisor.
Nov 28 15:53:39 user nova-compute[75176]: DEBUG nova.compute.manager [None req-a1ef7d87-df6d-48a0-ac15-19f60beb56fc tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] [instance: ecabea76-6c29-412d-bf77-989917b449a9] Checking state {{(pid=75176) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 15:53:39 user nova-compute[75176]: DEBUG nova.compute.manager [req-158270af-d7e7-4f53-b453-aa93698333f0 req-41340bfa-cf35-4a8e-b09b-b33a1ab26fc6 service nova] [instance: ecabea76-6c29-412d-bf77-989917b449a9] Received event network-vif-plugged-1c8a679e-a301-43a1-81fa-6a80def1bade {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:53:39 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-158270af-d7e7-4f53-b453-aa93698333f0 req-41340bfa-cf35-4a8e-b09b-b33a1ab26fc6 service nova] Acquiring lock "ecabea76-6c29-412d-bf77-989917b449a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:53:39 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-158270af-d7e7-4f53-b453-aa93698333f0 req-41340bfa-cf35-4a8e-b09b-b33a1ab26fc6 service nova] Lock "ecabea76-6c29-412d-bf77-989917b449a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:53:39 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-158270af-d7e7-4f53-b453-aa93698333f0 req-41340bfa-cf35-4a8e-b09b-b33a1ab26fc6 service nova] Lock "ecabea76-6c29-412d-bf77-989917b449a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:53:39 user nova-compute[75176]: DEBUG nova.compute.manager [req-158270af-d7e7-4f53-b453-aa93698333f0 req-41340bfa-cf35-4a8e-b09b-b33a1ab26fc6 service nova] [instance: ecabea76-6c29-412d-bf77-989917b449a9] No waiting events found dispatching network-vif-plugged-1c8a679e-a301-43a1-81fa-6a80def1bade {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:53:39 user nova-compute[75176]: WARNING nova.compute.manager [req-158270af-d7e7-4f53-b453-aa93698333f0 req-41340bfa-cf35-4a8e-b09b-b33a1ab26fc6 service nova] [instance: ecabea76-6c29-412d-bf77-989917b449a9] Received unexpected event network-vif-plugged-1c8a679e-a301-43a1-81fa-6a80def1bade for instance with vm_state building and task_state spawning.
Nov 28 15:53:39 user nova-compute[75176]: INFO nova.compute.manager [None req-a1ef7d87-df6d-48a0-ac15-19f60beb56fc tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] [instance: ecabea76-6c29-412d-bf77-989917b449a9] Took 6.48 seconds to build instance.
Nov 28 15:53:39 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-a1ef7d87-df6d-48a0-ac15-19f60beb56fc tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Lock "ecabea76-6c29-412d-bf77-989917b449a9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.580s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:53:39 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:53:40 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:53:44 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:53:44 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:53:45 user nova-compute[75176]: INFO nova.compute.manager [None req-cb54ef45-d1e9-4116-b777-974b16f6fdbf tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] [instance: 55febf04-14ea-4903-8692-c7cc6115de75] Rescuing
Nov 28 15:53:45 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-cb54ef45-d1e9-4116-b777-974b16f6fdbf tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Acquiring lock "refresh_cache-55febf04-14ea-4903-8692-c7cc6115de75" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:53:45 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-cb54ef45-d1e9-4116-b777-974b16f6fdbf tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Acquired lock "refresh_cache-55febf04-14ea-4903-8692-c7cc6115de75" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:53:45 user nova-compute[75176]: DEBUG nova.network.neutron [None req-cb54ef45-d1e9-4116-b777-974b16f6fdbf tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] [instance: 55febf04-14ea-4903-8692-c7cc6115de75] Building network info cache for instance {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 15:53:45 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:53:45 user nova-compute[75176]: DEBUG nova.network.neutron [None req-cb54ef45-d1e9-4116-b777-974b16f6fdbf tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] [instance: 55febf04-14ea-4903-8692-c7cc6115de75] Updating instance_info_cache with network_info: [{"id": "e287ec1a-3726-4719-94b2-79764f7abd31", "address": "fa:16:3e:0c:d1:2f", "network": {"id": "d47c1797-a66f-4f2d-b83e-903b5bd3251c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1416388789-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd2856ce0a2545cda0b796eb0be10a40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape287ec1a-37", "ovs_interfaceid": "e287ec1a-3726-4719-94b2-79764f7abd31", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:53:45 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-cb54ef45-d1e9-4116-b777-974b16f6fdbf tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Releasing lock "refresh_cache-55febf04-14ea-4903-8692-c7cc6115de75" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:53:45 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:53:45 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:53:46 user nova-compute[75176]: DEBUG nova.compute.manager [req-c10e7305-b4df-4eb8-91d5-e137b04b084d req-3b325a09-66ac-41ae-9f57-6989959e2cd2 service nova] [instance: 55febf04-14ea-4903-8692-c7cc6115de75] Received event network-vif-unplugged-e287ec1a-3726-4719-94b2-79764f7abd31 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:53:46 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-c10e7305-b4df-4eb8-91d5-e137b04b084d req-3b325a09-66ac-41ae-9f57-6989959e2cd2 service nova] Acquiring lock "55febf04-14ea-4903-8692-c7cc6115de75-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:53:46 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-c10e7305-b4df-4eb8-91d5-e137b04b084d req-3b325a09-66ac-41ae-9f57-6989959e2cd2 service nova] Lock "55febf04-14ea-4903-8692-c7cc6115de75-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:53:46 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-c10e7305-b4df-4eb8-91d5-e137b04b084d req-3b325a09-66ac-41ae-9f57-6989959e2cd2 service nova] Lock "55febf04-14ea-4903-8692-c7cc6115de75-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:53:46 user nova-compute[75176]: DEBUG nova.compute.manager [req-c10e7305-b4df-4eb8-91d5-e137b04b084d req-3b325a09-66ac-41ae-9f57-6989959e2cd2 service nova] [instance: 55febf04-14ea-4903-8692-c7cc6115de75] No waiting events found dispatching network-vif-unplugged-e287ec1a-3726-4719-94b2-79764f7abd31 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:53:46 user nova-compute[75176]: WARNING nova.compute.manager [req-c10e7305-b4df-4eb8-91d5-e137b04b084d req-3b325a09-66ac-41ae-9f57-6989959e2cd2 service nova] [instance: 55febf04-14ea-4903-8692-c7cc6115de75] Received unexpected event network-vif-unplugged-e287ec1a-3726-4719-94b2-79764f7abd31 for instance with vm_state active and task_state rescuing.
Nov 28 15:53:46 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:53:46 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:53:46 user nova-compute[75176]: INFO nova.virt.libvirt.driver [-] [instance: 55febf04-14ea-4903-8692-c7cc6115de75] Instance destroyed successfully.
Nov 28 15:53:46 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-cb54ef45-d1e9-4116-b777-974b16f6fdbf tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] [instance: 55febf04-14ea-4903-8692-c7cc6115de75] Attempting rescue
Nov 28 15:53:46 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-cb54ef45-d1e9-4116-b777-974b16f6fdbf tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75176) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 28 15:53:46 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-cb54ef45-d1e9-4116-b777-974b16f6fdbf tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] [instance: 55febf04-14ea-4903-8692-c7cc6115de75] Instance directory exists: not creating {{(pid=75176) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 28 15:53:46 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-cb54ef45-d1e9-4116-b777-974b16f6fdbf tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] [instance: 55febf04-14ea-4903-8692-c7cc6115de75] Creating image(s)
Nov 28 15:53:46 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-cb54ef45-d1e9-4116-b777-974b16f6fdbf tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Acquiring lock "/opt/stack/data/nova/instances/55febf04-14ea-4903-8692-c7cc6115de75/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:53:46 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-cb54ef45-d1e9-4116-b777-974b16f6fdbf tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Lock "/opt/stack/data/nova/instances/55febf04-14ea-4903-8692-c7cc6115de75/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:53:46 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-cb54ef45-d1e9-4116-b777-974b16f6fdbf tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Lock "/opt/stack/data/nova/instances/55febf04-14ea-4903-8692-c7cc6115de75/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:53:46 user nova-compute[75176]: DEBUG nova.objects.instance [None req-cb54ef45-d1e9-4116-b777-974b16f6fdbf tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Lazy-loading 'trusted_certs' on Instance uuid 55febf04-14ea-4903-8692-c7cc6115de75 {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:53:46 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-cb54ef45-d1e9-4116-b777-974b16f6fdbf tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Acquiring lock "5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:53:46 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-cb54ef45-d1e9-4116-b777-974b16f6fdbf tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Lock "5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:53:46 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-cb54ef45-d1e9-4116-b777-974b16f6fdbf tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:53:46 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-6597d1a9-3869-4ca0-9735-c7389fcf5a39 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Acquiring lock "2c154591-b130-4aa4-aad4-4c85324512df" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:53:46 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-6597d1a9-3869-4ca0-9735-c7389fcf5a39 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Lock "2c154591-b130-4aa4-aad4-4c85324512df" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:53:46 user nova-compute[75176]: DEBUG nova.compute.manager [None req-6597d1a9-3869-4ca0-9735-c7389fcf5a39 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] [instance: 2c154591-b130-4aa4-aad4-4c85324512df] Starting instance... {{(pid=75176) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 15:53:46 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-cb54ef45-d1e9-4116-b777-974b16f6fdbf tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json" returned: 0 in 0.203s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:53:46 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-cb54ef45-d1e9-4116-b777-974b16f6fdbf tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2,backing_fmt=raw /opt/stack/data/nova/instances/55febf04-14ea-4903-8692-c7cc6115de75/disk.rescue {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:53:46 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-cb54ef45-d1e9-4116-b777-974b16f6fdbf tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2,backing_fmt=raw /opt/stack/data/nova/instances/55febf04-14ea-4903-8692-c7cc6115de75/disk.rescue" returned: 0 in 0.057s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:53:46 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-cb54ef45-d1e9-4116-b777-974b16f6fdbf tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Lock "5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.264s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:53:46 user nova-compute[75176]: DEBUG nova.objects.instance [None req-cb54ef45-d1e9-4116-b777-974b16f6fdbf tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Lazy-loading 'migration_context' on Instance uuid 55febf04-14ea-4903-8692-c7cc6115de75 {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:53:46 user nova-compute[75176]: DEBUG nova.objects.base [None req-cb54ef45-d1e9-4116-b777-974b16f6fdbf tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Object Instance<55febf04-14ea-4903-8692-c7cc6115de75> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75176) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 15:53:46 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-cb54ef45-d1e9-4116-b777-974b16f6fdbf tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] [instance: 55febf04-14ea-4903-8692-c7cc6115de75] Created local disks {{(pid=75176) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 15:53:46 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-cb54ef45-d1e9-4116-b777-974b16f6fdbf tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] [instance: 55febf04-14ea-4903-8692-c7cc6115de75] Start _get_guest_xml network_info=[{"id": "e287ec1a-3726-4719-94b2-79764f7abd31", "address": "fa:16:3e:0c:d1:2f", "network": {"id": "d47c1797-a66f-4f2d-b83e-903b5bd3251c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1416388789-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1416388789-network", "vif_mac": "fa:16:3e:0c:d1:2f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd2856ce0a2545cda0b796eb0be10a40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape287ec1a-37", "ovs_interfaceid": "e287ec1a-3726-4719-94b2-79764f7abd31", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T15:35:12Z,direct_url=<?>,disk_format='qcow2',id=1f41819e-c93f-4dc7-b253-37a27bbbbc74,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1b91c5d0672c4224a48df2e1f92688e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T15:35:13Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '1f41819e-c93f-4dc7-b253-37a27bbbbc74', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75176) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 15:53:46 user nova-compute[75176]: DEBUG nova.objects.instance [None req-cb54ef45-d1e9-4116-b777-974b16f6fdbf tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Lazy-loading 'resources' on Instance uuid 55febf04-14ea-4903-8692-c7cc6115de75 {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:53:46 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-6597d1a9-3869-4ca0-9735-c7389fcf5a39 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:53:46 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-6597d1a9-3869-4ca0-9735-c7389fcf5a39 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.005s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:53:46 user nova-compute[75176]: DEBUG nova.objects.base [None req-cb54ef45-d1e9-4116-b777-974b16f6fdbf tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Object Instance<55febf04-14ea-4903-8692-c7cc6115de75> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75176) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 15:53:46 user nova-compute[75176]: DEBUG nova.objects.instance [None req-cb54ef45-d1e9-4116-b777-974b16f6fdbf tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Lazy-loading 'numa_topology' on Instance uuid 55febf04-14ea-4903-8692-c7cc6115de75 {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:53:46 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-6597d1a9-3869-4ca0-9735-c7389fcf5a39 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75176) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 15:53:46 user nova-compute[75176]: INFO nova.compute.claims [None req-6597d1a9-3869-4ca0-9735-c7389fcf5a39 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] [instance: 2c154591-b130-4aa4-aad4-4c85324512df] Claim successful on node user
Nov 28 15:53:47 user nova-compute[75176]: DEBUG nova.objects.base [None req-cb54ef45-d1e9-4116-b777-974b16f6fdbf tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Object Instance<55febf04-14ea-4903-8692-c7cc6115de75> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75176) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 15:53:47 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-cb54ef45-d1e9-4116-b777-974b16f6fdbf tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 15:53:47 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-cb54ef45-d1e9-4116-b777-974b16f6fdbf tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 15:53:47 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-cb54ef45-d1e9-4116-b777-974b16f6fdbf tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75176) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 15:53:47 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-cb54ef45-d1e9-4116-b777-974b16f6fdbf tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] CPU controller missing on host. {{(pid=75176) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 15:53:47 user nova-compute[75176]: INFO nova.compute.manager [None req-2e2179be-a97e-48b7-98c4-150f36073b24 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: dc4e6d39-adfb-4d26-afef-46f316ff7846] Rescuing
Nov 28 15:53:47 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-2e2179be-a97e-48b7-98c4-150f36073b24 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Acquiring lock "refresh_cache-dc4e6d39-adfb-4d26-afef-46f316ff7846" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:53:47 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-2e2179be-a97e-48b7-98c4-150f36073b24 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Acquired lock "refresh_cache-dc4e6d39-adfb-4d26-afef-46f316ff7846" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:53:47 user nova-compute[75176]: DEBUG nova.network.neutron [None req-2e2179be-a97e-48b7-98c4-150f36073b24 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: dc4e6d39-adfb-4d26-afef-46f316ff7846] Building network info cache for instance {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 15:53:47 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-cb54ef45-d1e9-4116-b777-974b16f6fdbf tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75176) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 15:53:47 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-cb54ef45-d1e9-4116-b777-974b16f6fdbf tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] CPU controller found on host. {{(pid=75176) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 15:53:47 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-cb54ef45-d1e9-4116-b777-974b16f6fdbf tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75176) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 15:53:47 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-cb54ef45-d1e9-4116-b777-974b16f6fdbf tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T15:35:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T15:35:12Z,direct_url=<?>,disk_format='qcow2',id=1f41819e-c93f-4dc7-b253-37a27bbbbc74,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1b91c5d0672c4224a48df2e1f92688e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T15:35:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 15:53:47 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-cb54ef45-d1e9-4116-b777-974b16f6fdbf tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Flavor limits 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 15:53:47 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-cb54ef45-d1e9-4116-b777-974b16f6fdbf tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Image limits 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 15:53:47 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-cb54ef45-d1e9-4116-b777-974b16f6fdbf tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Flavor pref 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 15:53:47 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-cb54ef45-d1e9-4116-b777-974b16f6fdbf tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Image pref 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 15:53:47 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-cb54ef45-d1e9-4116-b777-974b16f6fdbf tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 15:53:47 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-cb54ef45-d1e9-4116-b777-974b16f6fdbf tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 15:53:47 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-cb54ef45-d1e9-4116-b777-974b16f6fdbf tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75176) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 15:53:47 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-cb54ef45-d1e9-4116-b777-974b16f6fdbf tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Got 1 possible topologies {{(pid=75176) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 15:53:47 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-cb54ef45-d1e9-4116-b777-974b16f6fdbf tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 15:53:47 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-cb54ef45-d1e9-4116-b777-974b16f6fdbf tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 15:53:47 user nova-compute[75176]: DEBUG nova.objects.instance [None req-cb54ef45-d1e9-4116-b777-974b16f6fdbf tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Lazy-loading 'vcpu_model' on Instance uuid 55febf04-14ea-4903-8692-c7cc6115de75 {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:53:47 user nova-compute[75176]: DEBUG nova.objects.base [None req-cb54ef45-d1e9-4116-b777-974b16f6fdbf tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Object Instance<55febf04-14ea-4903-8692-c7cc6115de75> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75176) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 15:53:47 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-cb54ef45-d1e9-4116-b777-974b16f6fdbf tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T15:48:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1621955693',display_name='tempest-ServerRescueNegativeTestJSON-server-1621955693',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1621955693',id=31,image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-28T15:49:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fd2856ce0a2545cda0b796eb0be10a40',ramdisk_id='',reservation_id='r-r0jnkzy2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1263291627',owner_user_name='tempest-ServerRescueNegativeTestJSON-1263291627-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T15:49:11Z,user_data=None,user_id='b7bd0e1b307f4d339ca2e540e063f028',uuid=55febf04-14ea-4903-8692-c7cc6115de75,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e287ec1a-3726-4719-94b2-79764f7abd31", "address": "fa:16:3e:0c:d1:2f", "network": {"id": "d47c1797-a66f-4f2d-b83e-903b5bd3251c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1416388789-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1416388789-network", "vif_mac": "fa:16:3e:0c:d1:2f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd2856ce0a2545cda0b796eb0be10a40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape287ec1a-37", "ovs_interfaceid": "e287ec1a-3726-4719-94b2-79764f7abd31", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75176) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 15:53:47 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-cb54ef45-d1e9-4116-b777-974b16f6fdbf tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Converting VIF {"id": "e287ec1a-3726-4719-94b2-79764f7abd31", "address": "fa:16:3e:0c:d1:2f", "network": {"id": "d47c1797-a66f-4f2d-b83e-903b5bd3251c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1416388789-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1416388789-network", "vif_mac": "fa:16:3e:0c:d1:2f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd2856ce0a2545cda0b796eb0be10a40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape287ec1a-37", "ovs_interfaceid": "e287ec1a-3726-4719-94b2-79764f7abd31", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:53:47 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-cb54ef45-d1e9-4116-b777-974b16f6fdbf tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0c:d1:2f,bridge_name='br-int',has_traffic_filtering=True,id=e287ec1a-3726-4719-94b2-79764f7abd31,network=Network(d47c1797-a66f-4f2d-b83e-903b5bd3251c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape287ec1a-37') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:53:47 user nova-compute[75176]: DEBUG nova.objects.instance [None req-cb54ef45-d1e9-4116-b777-974b16f6fdbf tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Lazy-loading 'pci_devices' on Instance uuid 55febf04-14ea-4903-8692-c7cc6115de75 {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:53:47 user nova-compute[75176]: DEBUG nova.objects.base [None req-cb54ef45-d1e9-4116-b777-974b16f6fdbf tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Object Instance<55febf04-14ea-4903-8692-c7cc6115de75> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75176) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 15:53:47 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-cb54ef45-d1e9-4116-b777-974b16f6fdbf tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] [instance: 55febf04-14ea-4903-8692-c7cc6115de75] End _get_guest_xml xml=<domain type="kvm">
Nov 28 15:53:47 user nova-compute[75176]:   <uuid>55febf04-14ea-4903-8692-c7cc6115de75</uuid>
Nov 28 15:53:47 user nova-compute[75176]:   <name>instance-0000001f</name>
Nov 28 15:53:47 user nova-compute[75176]:   <memory>524288</memory>
Nov 28 15:53:47 user nova-compute[75176]:   <vcpu>1</vcpu>
Nov 28 15:53:47 user nova-compute[75176]:   <metadata>
Nov 28 15:53:47 user nova-compute[75176]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 15:53:47 user nova-compute[75176]:       <nova:package version="0.0.0"/>
Nov 28 15:53:47 user nova-compute[75176]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1621955693</nova:name>
Nov 28 15:53:47 user nova-compute[75176]:       <nova:creationTime>2023-11-28 15:53:47</nova:creationTime>
Nov 28 15:53:47 user nova-compute[75176]:       <nova:flavor name="m1.tiny">
Nov 28 15:53:47 user nova-compute[75176]:         <nova:memory>512</nova:memory>
Nov 28 15:53:47 user nova-compute[75176]:         <nova:disk>1</nova:disk>
Nov 28 15:53:47 user nova-compute[75176]:         <nova:swap>0</nova:swap>
Nov 28 15:53:47 user nova-compute[75176]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 15:53:47 user nova-compute[75176]:         <nova:vcpus>1</nova:vcpus>
Nov 28 15:53:47 user nova-compute[75176]:       </nova:flavor>
Nov 28 15:53:47 user nova-compute[75176]:       <nova:owner>
Nov 28 15:53:47 user nova-compute[75176]:         <nova:user uuid="b7bd0e1b307f4d339ca2e540e063f028">tempest-ServerRescueNegativeTestJSON-1263291627-project-member</nova:user>
Nov 28 15:53:47 user nova-compute[75176]:         <nova:project uuid="fd2856ce0a2545cda0b796eb0be10a40">tempest-ServerRescueNegativeTestJSON-1263291627</nova:project>
Nov 28 15:53:47 user nova-compute[75176]:       </nova:owner>
Nov 28 15:53:47 user nova-compute[75176]:       <nova:root type="image" uuid="1f41819e-c93f-4dc7-b253-37a27bbbbc74"/>
Nov 28 15:53:47 user nova-compute[75176]:       <nova:ports>
Nov 28 15:53:47 user nova-compute[75176]:         <nova:port uuid="e287ec1a-3726-4719-94b2-79764f7abd31">
Nov 28 15:53:47 user nova-compute[75176]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 28 15:53:47 user nova-compute[75176]:         </nova:port>
Nov 28 15:53:47 user nova-compute[75176]:       </nova:ports>
Nov 28 15:53:47 user nova-compute[75176]:     </nova:instance>
Nov 28 15:53:47 user nova-compute[75176]:   </metadata>
Nov 28 15:53:47 user nova-compute[75176]:   <sysinfo type="smbios">
Nov 28 15:53:47 user nova-compute[75176]:     <system>
Nov 28 15:53:47 user nova-compute[75176]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 15:53:47 user nova-compute[75176]:       <entry name="product">OpenStack Nova</entry>
Nov 28 15:53:47 user nova-compute[75176]:       <entry name="version">0.0.0</entry>
Nov 28 15:53:47 user nova-compute[75176]:       <entry name="serial">55febf04-14ea-4903-8692-c7cc6115de75</entry>
Nov 28 15:53:47 user nova-compute[75176]:       <entry name="uuid">55febf04-14ea-4903-8692-c7cc6115de75</entry>
Nov 28 15:53:47 user nova-compute[75176]:       <entry name="family">Virtual Machine</entry>
Nov 28 15:53:47 user nova-compute[75176]:     </system>
Nov 28 15:53:47 user nova-compute[75176]:   </sysinfo>
Nov 28 15:53:47 user nova-compute[75176]:   <os>
Nov 28 15:53:47 user nova-compute[75176]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 15:53:47 user nova-compute[75176]:     <smbios mode="sysinfo"/>
Nov 28 15:53:47 user nova-compute[75176]:   </os>
Nov 28 15:53:47 user nova-compute[75176]:   <features>
Nov 28 15:53:47 user nova-compute[75176]:     <acpi/>
Nov 28 15:53:47 user nova-compute[75176]:     <apic/>
Nov 28 15:53:47 user nova-compute[75176]:     <vmcoreinfo/>
Nov 28 15:53:47 user nova-compute[75176]:   </features>
Nov 28 15:53:47 user nova-compute[75176]:   <clock offset="utc">
Nov 28 15:53:47 user nova-compute[75176]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 15:53:47 user nova-compute[75176]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 15:53:47 user nova-compute[75176]:     <timer name="hpet" present="no"/>
Nov 28 15:53:47 user nova-compute[75176]:   </clock>
Nov 28 15:53:47 user nova-compute[75176]:   <cpu mode="custom" match="exact">
Nov 28 15:53:47 user nova-compute[75176]:     <model>Nehalem</model>
Nov 28 15:53:47 user nova-compute[75176]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 15:53:47 user nova-compute[75176]:   </cpu>
Nov 28 15:53:47 user nova-compute[75176]:   <devices>
Nov 28 15:53:47 user nova-compute[75176]:     <disk type="file" device="disk">
Nov 28 15:53:47 user nova-compute[75176]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 15:53:47 user nova-compute[75176]:       <source file="/opt/stack/data/nova/instances/55febf04-14ea-4903-8692-c7cc6115de75/disk.rescue"/>
Nov 28 15:53:47 user nova-compute[75176]:       <target dev="vda" bus="virtio"/>
Nov 28 15:53:47 user nova-compute[75176]:     </disk>
Nov 28 15:53:47 user nova-compute[75176]:     <disk type="file" device="disk">
Nov 28 15:53:47 user nova-compute[75176]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 15:53:47 user nova-compute[75176]:       <source file="/opt/stack/data/nova/instances/55febf04-14ea-4903-8692-c7cc6115de75/disk"/>
Nov 28 15:53:47 user nova-compute[75176]:       <target dev="vdb" bus="virtio"/>
Nov 28 15:53:47 user nova-compute[75176]:     </disk>
Nov 28 15:53:47 user nova-compute[75176]:     <interface type="ethernet">
Nov 28 15:53:47 user nova-compute[75176]:       <mac address="fa:16:3e:0c:d1:2f"/>
Nov 28 15:53:47 user nova-compute[75176]:       <model type="virtio"/>
Nov 28 15:53:47 user nova-compute[75176]:       <mtu size="1442"/>
Nov 28 15:53:47 user nova-compute[75176]:       <target dev="tape287ec1a-37"/>
Nov 28 15:53:47 user nova-compute[75176]:     </interface>
Nov 28 15:53:47 user nova-compute[75176]:     <serial type="pty">
Nov 28 15:53:47 user nova-compute[75176]:       <log file="/opt/stack/data/nova/instances/55febf04-14ea-4903-8692-c7cc6115de75/console.log" append="off"/>
Nov 28 15:53:47 user nova-compute[75176]:     </serial>
Nov 28 15:53:47 user nova-compute[75176]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 15:53:47 user nova-compute[75176]:     <video>
Nov 28 15:53:47 user nova-compute[75176]:       <model type="virtio"/>
Nov 28 15:53:47 user nova-compute[75176]:     </video>
Nov 28 15:53:47 user nova-compute[75176]:     <rng model="virtio">
Nov 28 15:53:47 user nova-compute[75176]:       <backend model="random">/dev/urandom</backend>
Nov 28 15:53:47 user nova-compute[75176]:     </rng>
Nov 28 15:53:47 user nova-compute[75176]:     <controller type="usb" index="0" model="none"/>
Nov 28 15:53:47 user nova-compute[75176]:     <memballoon model="virtio">
Nov 28 15:53:47 user nova-compute[75176]:       <stats period="10"/>
Nov 28 15:53:47 user nova-compute[75176]:     </memballoon>
Nov 28 15:53:47 user nova-compute[75176]:   </devices>
Nov 28 15:53:47 user nova-compute[75176]: </domain>
Nov 28 15:53:47 user nova-compute[75176]:  {{(pid=75176) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 15:53:47 user nova-compute[75176]: INFO nova.virt.libvirt.driver [-] [instance: 55febf04-14ea-4903-8692-c7cc6115de75] Instance destroyed successfully.
Nov 28 15:53:47 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-cb54ef45-d1e9-4116-b777-974b16f6fdbf tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] No BDM found with device name vda, not building metadata. {{(pid=75176) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 15:53:47 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-cb54ef45-d1e9-4116-b777-974b16f6fdbf tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75176) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 15:53:47 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-cb54ef45-d1e9-4116-b777-974b16f6fdbf tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] No VIF found with MAC fa:16:3e:0c:d1:2f, not building metadata {{(pid=75176) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 15:53:47 user nova-compute[75176]: DEBUG nova.compute.provider_tree [None req-6597d1a9-3869-4ca0-9735-c7389fcf5a39 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Inventory has not changed in ProviderTree for provider: b37848d8-f401-4155-a029-b0ffa09ff85b {{(pid=75176) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 15:53:47 user nova-compute[75176]: DEBUG nova.network.neutron [None req-2e2179be-a97e-48b7-98c4-150f36073b24 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: dc4e6d39-adfb-4d26-afef-46f316ff7846] Updating instance_info_cache with network_info: [{"id": "65eb3123-182c-40fd-b20c-48b19b833f14", "address": "fa:16:3e:59:4a:59", "network": {"id": "998766cd-2e8e-4e39-add9-286086640993", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-989265510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf05c8836b8a40de8e64c2d046ed71ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65eb3123-18", "ovs_interfaceid": "65eb3123-182c-40fd-b20c-48b19b833f14", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:53:47 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-6597d1a9-3869-4ca0-9735-c7389fcf5a39 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Inventory has not changed for provider b37848d8-f401-4155-a029-b0ffa09ff85b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75176) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 15:53:47 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-2e2179be-a97e-48b7-98c4-150f36073b24 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Releasing lock "refresh_cache-dc4e6d39-adfb-4d26-afef-46f316ff7846" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:53:47 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-6597d1a9-3869-4ca0-9735-c7389fcf5a39 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.605s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:53:47 user nova-compute[75176]: DEBUG nova.compute.manager [None req-6597d1a9-3869-4ca0-9735-c7389fcf5a39 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] [instance: 2c154591-b130-4aa4-aad4-4c85324512df] Start building networks asynchronously for instance. {{(pid=75176) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 15:53:47 user nova-compute[75176]: DEBUG nova.compute.manager [None req-6597d1a9-3869-4ca0-9735-c7389fcf5a39 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] [instance: 2c154591-b130-4aa4-aad4-4c85324512df] Allocating IP information in the background. {{(pid=75176) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 15:53:47 user nova-compute[75176]: DEBUG nova.network.neutron [None req-6597d1a9-3869-4ca0-9735-c7389fcf5a39 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] [instance: 2c154591-b130-4aa4-aad4-4c85324512df] allocate_for_instance() {{(pid=75176) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 15:53:47 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-6597d1a9-3869-4ca0-9735-c7389fcf5a39 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] [instance: 2c154591-b130-4aa4-aad4-4c85324512df] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 15:53:47 user nova-compute[75176]: DEBUG nova.compute.manager [None req-6597d1a9-3869-4ca0-9735-c7389fcf5a39 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] [instance: 2c154591-b130-4aa4-aad4-4c85324512df] Start building block device mappings for instance. {{(pid=75176) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 15:53:47 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:53:47 user nova-compute[75176]: DEBUG nova.policy [None req-6597d1a9-3869-4ca0-9735-c7389fcf5a39 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3146d6b1e7324ebaa62ade09f1d1c68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169fdaea89d4431aa6adacdbb76f3546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75176) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 15:53:47 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:53:47 user nova-compute[75176]: DEBUG nova.compute.manager [None req-6597d1a9-3869-4ca0-9735-c7389fcf5a39 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] [instance: 2c154591-b130-4aa4-aad4-4c85324512df] Start spawning the instance on the hypervisor. {{(pid=75176) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 15:53:47 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-6597d1a9-3869-4ca0-9735-c7389fcf5a39 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] [instance: 2c154591-b130-4aa4-aad4-4c85324512df] Creating instance directory {{(pid=75176) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 15:53:47 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-6597d1a9-3869-4ca0-9735-c7389fcf5a39 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] [instance: 2c154591-b130-4aa4-aad4-4c85324512df] Creating image(s)
Nov 28 15:53:47 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-6597d1a9-3869-4ca0-9735-c7389fcf5a39 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Acquiring lock "/opt/stack/data/nova/instances/2c154591-b130-4aa4-aad4-4c85324512df/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:53:47 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-6597d1a9-3869-4ca0-9735-c7389fcf5a39 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Lock "/opt/stack/data/nova/instances/2c154591-b130-4aa4-aad4-4c85324512df/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:53:47 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-6597d1a9-3869-4ca0-9735-c7389fcf5a39 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Lock "/opt/stack/data/nova/instances/2c154591-b130-4aa4-aad4-4c85324512df/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:53:47 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-6597d1a9-3869-4ca0-9735-c7389fcf5a39 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:53:47 user nova-compute[75176]: DEBUG nova.compute.manager [req-fa410a36-6671-4832-804a-52d1800fa534 req-8a4d3842-eebb-4c5d-a374-c9d6e7800bec service nova] [instance: dc4e6d39-adfb-4d26-afef-46f316ff7846] Received event network-vif-unplugged-65eb3123-182c-40fd-b20c-48b19b833f14 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:53:47 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-fa410a36-6671-4832-804a-52d1800fa534 req-8a4d3842-eebb-4c5d-a374-c9d6e7800bec service nova] Acquiring lock "dc4e6d39-adfb-4d26-afef-46f316ff7846-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:53:47 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-fa410a36-6671-4832-804a-52d1800fa534 req-8a4d3842-eebb-4c5d-a374-c9d6e7800bec service nova] Lock "dc4e6d39-adfb-4d26-afef-46f316ff7846-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:53:47 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-fa410a36-6671-4832-804a-52d1800fa534 req-8a4d3842-eebb-4c5d-a374-c9d6e7800bec service nova] Lock "dc4e6d39-adfb-4d26-afef-46f316ff7846-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:53:47 user nova-compute[75176]: DEBUG nova.compute.manager [req-fa410a36-6671-4832-804a-52d1800fa534 req-8a4d3842-eebb-4c5d-a374-c9d6e7800bec service nova] [instance: dc4e6d39-adfb-4d26-afef-46f316ff7846] No waiting events found dispatching network-vif-unplugged-65eb3123-182c-40fd-b20c-48b19b833f14 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:53:47 user nova-compute[75176]: WARNING nova.compute.manager [req-fa410a36-6671-4832-804a-52d1800fa534 req-8a4d3842-eebb-4c5d-a374-c9d6e7800bec service nova] [instance: dc4e6d39-adfb-4d26-afef-46f316ff7846] Received unexpected event network-vif-unplugged-65eb3123-182c-40fd-b20c-48b19b833f14 for instance with vm_state active and task_state rescuing.
Nov 28 15:53:48 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-6597d1a9-3869-4ca0-9735-c7389fcf5a39 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json" returned: 0 in 0.188s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:53:48 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-6597d1a9-3869-4ca0-9735-c7389fcf5a39 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Acquiring lock "5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:53:48 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-6597d1a9-3869-4ca0-9735-c7389fcf5a39 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Lock "5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:53:48 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-6597d1a9-3869-4ca0-9735-c7389fcf5a39 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:53:48 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:53:48 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-6597d1a9-3869-4ca0-9735-c7389fcf5a39 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json" returned: 0 in 0.174s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:53:48 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-6597d1a9-3869-4ca0-9735-c7389fcf5a39 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2,backing_fmt=raw /opt/stack/data/nova/instances/2c154591-b130-4aa4-aad4-4c85324512df/disk 1073741824 {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:53:48 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-6597d1a9-3869-4ca0-9735-c7389fcf5a39 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2,backing_fmt=raw /opt/stack/data/nova/instances/2c154591-b130-4aa4-aad4-4c85324512df/disk 1073741824" returned: 0 in 0.056s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:53:48 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-6597d1a9-3869-4ca0-9735-c7389fcf5a39 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Lock "5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.243s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:53:48 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-6597d1a9-3869-4ca0-9735-c7389fcf5a39 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:53:48 user nova-compute[75176]: DEBUG nova.compute.manager [req-bd3a6b1c-17fc-4699-b0c8-623ed0f67ef9 req-67030d4c-ed70-4aab-b53f-25fe8a6c1e01 service nova] [instance: 55febf04-14ea-4903-8692-c7cc6115de75] Received event network-vif-plugged-e287ec1a-3726-4719-94b2-79764f7abd31 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:53:48 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-bd3a6b1c-17fc-4699-b0c8-623ed0f67ef9 req-67030d4c-ed70-4aab-b53f-25fe8a6c1e01 service nova] Acquiring lock "55febf04-14ea-4903-8692-c7cc6115de75-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:53:48 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-bd3a6b1c-17fc-4699-b0c8-623ed0f67ef9 req-67030d4c-ed70-4aab-b53f-25fe8a6c1e01 service nova] Lock "55febf04-14ea-4903-8692-c7cc6115de75-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:53:48 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-bd3a6b1c-17fc-4699-b0c8-623ed0f67ef9 req-67030d4c-ed70-4aab-b53f-25fe8a6c1e01 service nova] Lock "55febf04-14ea-4903-8692-c7cc6115de75-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:53:48 user nova-compute[75176]: DEBUG nova.compute.manager [req-bd3a6b1c-17fc-4699-b0c8-623ed0f67ef9 req-67030d4c-ed70-4aab-b53f-25fe8a6c1e01 service nova] [instance: 55febf04-14ea-4903-8692-c7cc6115de75] No waiting events found dispatching network-vif-plugged-e287ec1a-3726-4719-94b2-79764f7abd31 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:53:48 user nova-compute[75176]: WARNING nova.compute.manager [req-bd3a6b1c-17fc-4699-b0c8-623ed0f67ef9 req-67030d4c-ed70-4aab-b53f-25fe8a6c1e01 service nova] [instance: 55febf04-14ea-4903-8692-c7cc6115de75] Received unexpected event network-vif-plugged-e287ec1a-3726-4719-94b2-79764f7abd31 for instance with vm_state active and task_state rescuing.
Nov 28 15:53:48 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-6597d1a9-3869-4ca0-9735-c7389fcf5a39 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json" returned: 0 in 0.178s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:53:48 user nova-compute[75176]: DEBUG nova.virt.disk.api [None req-6597d1a9-3869-4ca0-9735-c7389fcf5a39 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2c154591-b130-4aa4-aad4-4c85324512df/disk. size=1073741824 {{(pid=75176) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 15:53:48 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-6597d1a9-3869-4ca0-9735-c7389fcf5a39 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c154591-b130-4aa4-aad4-4c85324512df/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:53:48 user nova-compute[75176]: DEBUG nova.network.neutron [None req-6597d1a9-3869-4ca0-9735-c7389fcf5a39 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] [instance: 2c154591-b130-4aa4-aad4-4c85324512df] Successfully created port: c743768f-0b40-435a-8754-96784ae96dda {{(pid=75176) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 15:53:48 user nova-compute[75176]: INFO nova.virt.libvirt.driver [-] [instance: dc4e6d39-adfb-4d26-afef-46f316ff7846] Instance destroyed successfully.
Nov 28 15:53:48 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-2e2179be-a97e-48b7-98c4-150f36073b24 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: dc4e6d39-adfb-4d26-afef-46f316ff7846] Attempting a stable device rescue
Nov 28 15:53:48 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-6597d1a9-3869-4ca0-9735-c7389fcf5a39 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c154591-b130-4aa4-aad4-4c85324512df/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:53:48 user nova-compute[75176]: DEBUG nova.virt.disk.api [None req-6597d1a9-3869-4ca0-9735-c7389fcf5a39 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Cannot resize image /opt/stack/data/nova/instances/2c154591-b130-4aa4-aad4-4c85324512df/disk to a smaller size. {{(pid=75176) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 15:53:48 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-6597d1a9-3869-4ca0-9735-c7389fcf5a39 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] [instance: 2c154591-b130-4aa4-aad4-4c85324512df] Created local disks {{(pid=75176) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 15:53:48 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-6597d1a9-3869-4ca0-9735-c7389fcf5a39 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] [instance: 2c154591-b130-4aa4-aad4-4c85324512df] Ensure instance console log exists: /opt/stack/data/nova/instances/2c154591-b130-4aa4-aad4-4c85324512df/console.log {{(pid=75176) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 15:53:48 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-6597d1a9-3869-4ca0-9735-c7389fcf5a39 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:53:48 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-6597d1a9-3869-4ca0-9735-c7389fcf5a39 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:53:48 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-6597d1a9-3869-4ca0-9735-c7389fcf5a39 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:53:48 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-2e2179be-a97e-48b7-98c4-150f36073b24 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75176) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 28 15:53:48 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-2e2179be-a97e-48b7-98c4-150f36073b24 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: dc4e6d39-adfb-4d26-afef-46f316ff7846] Instance directory exists: not creating {{(pid=75176) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 28 15:53:48 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-2e2179be-a97e-48b7-98c4-150f36073b24 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: dc4e6d39-adfb-4d26-afef-46f316ff7846] Creating image(s)
Nov 28 15:53:48 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-2e2179be-a97e-48b7-98c4-150f36073b24 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Acquiring lock "/opt/stack/data/nova/instances/dc4e6d39-adfb-4d26-afef-46f316ff7846/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:53:48 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-2e2179be-a97e-48b7-98c4-150f36073b24 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Lock "/opt/stack/data/nova/instances/dc4e6d39-adfb-4d26-afef-46f316ff7846/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:53:48 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-2e2179be-a97e-48b7-98c4-150f36073b24 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Lock "/opt/stack/data/nova/instances/dc4e6d39-adfb-4d26-afef-46f316ff7846/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:53:48 user nova-compute[75176]: DEBUG nova.objects.instance [None req-2e2179be-a97e-48b7-98c4-150f36073b24 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Lazy-loading 'trusted_certs' on Instance uuid dc4e6d39-adfb-4d26-afef-46f316ff7846 {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:53:48 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-2e2179be-a97e-48b7-98c4-150f36073b24 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Acquiring lock "0ea5ae5a4cf6c6e5a33a1491e0598683d30f0840" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:53:48 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-2e2179be-a97e-48b7-98c4-150f36073b24 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Lock "0ea5ae5a4cf6c6e5a33a1491e0598683d30f0840" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:53:49 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-2e2179be-a97e-48b7-98c4-150f36073b24 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0ea5ae5a4cf6c6e5a33a1491e0598683d30f0840.part --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:53:49 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:53:49 user nova-compute[75176]: DEBUG nova.network.neutron [None req-6597d1a9-3869-4ca0-9735-c7389fcf5a39 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] [instance: 2c154591-b130-4aa4-aad4-4c85324512df] Successfully updated port: c743768f-0b40-435a-8754-96784ae96dda {{(pid=75176) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 15:53:50 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-6597d1a9-3869-4ca0-9735-c7389fcf5a39 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Acquiring lock "refresh_cache-2c154591-b130-4aa4-aad4-4c85324512df" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:53:50 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-6597d1a9-3869-4ca0-9735-c7389fcf5a39 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Acquired lock "refresh_cache-2c154591-b130-4aa4-aad4-4c85324512df" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:53:50 user nova-compute[75176]: DEBUG nova.network.neutron [None req-6597d1a9-3869-4ca0-9735-c7389fcf5a39 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] [instance: 2c154591-b130-4aa4-aad4-4c85324512df] Building network info cache for instance {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 15:53:50 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-2e2179be-a97e-48b7-98c4-150f36073b24 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0ea5ae5a4cf6c6e5a33a1491e0598683d30f0840.part --force-share --output=json" returned: 0 in 0.207s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:53:50 user nova-compute[75176]: DEBUG nova.virt.images [None req-2e2179be-a97e-48b7-98c4-150f36073b24 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] 2b9abb27-92da-4006-9477-5dcac3222ebc was qcow2, converting to raw {{(pid=75176) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 28 15:53:50 user nova-compute[75176]: DEBUG nova.privsep.utils [None req-2e2179be-a97e-48b7-98c4-150f36073b24 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75176) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 28 15:53:50 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-2e2179be-a97e-48b7-98c4-150f36073b24 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/0ea5ae5a4cf6c6e5a33a1491e0598683d30f0840.part /opt/stack/data/nova/instances/_base/0ea5ae5a4cf6c6e5a33a1491e0598683d30f0840.converted {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:53:50 user nova-compute[75176]: DEBUG nova.compute.manager [req-db8797dc-563f-4696-84ce-f3458e533234 req-6a3ff29c-b8ac-4e36-82b1-9df9647b2c34 service nova] [instance: dc4e6d39-adfb-4d26-afef-46f316ff7846] Received event network-vif-plugged-65eb3123-182c-40fd-b20c-48b19b833f14 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:53:50 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-db8797dc-563f-4696-84ce-f3458e533234 req-6a3ff29c-b8ac-4e36-82b1-9df9647b2c34 service nova] Acquiring lock "dc4e6d39-adfb-4d26-afef-46f316ff7846-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:53:50 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-db8797dc-563f-4696-84ce-f3458e533234 req-6a3ff29c-b8ac-4e36-82b1-9df9647b2c34 service nova] Lock "dc4e6d39-adfb-4d26-afef-46f316ff7846-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:53:50 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-db8797dc-563f-4696-84ce-f3458e533234 req-6a3ff29c-b8ac-4e36-82b1-9df9647b2c34 service nova] Lock "dc4e6d39-adfb-4d26-afef-46f316ff7846-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:53:50 user nova-compute[75176]: DEBUG nova.compute.manager [req-db8797dc-563f-4696-84ce-f3458e533234 req-6a3ff29c-b8ac-4e36-82b1-9df9647b2c34 service nova] [instance: dc4e6d39-adfb-4d26-afef-46f316ff7846] No waiting events found dispatching network-vif-plugged-65eb3123-182c-40fd-b20c-48b19b833f14 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:53:50 user nova-compute[75176]: WARNING nova.compute.manager [req-db8797dc-563f-4696-84ce-f3458e533234 req-6a3ff29c-b8ac-4e36-82b1-9df9647b2c34 service nova] [instance: dc4e6d39-adfb-4d26-afef-46f316ff7846] Received unexpected event network-vif-plugged-65eb3123-182c-40fd-b20c-48b19b833f14 for instance with vm_state active and task_state rescuing.
Nov 28 15:53:50 user nova-compute[75176]: DEBUG nova.compute.manager [req-db8797dc-563f-4696-84ce-f3458e533234 req-6a3ff29c-b8ac-4e36-82b1-9df9647b2c34 service nova] [instance: 2c154591-b130-4aa4-aad4-4c85324512df] Received event network-changed-c743768f-0b40-435a-8754-96784ae96dda {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:53:50 user nova-compute[75176]: DEBUG nova.compute.manager [req-db8797dc-563f-4696-84ce-f3458e533234 req-6a3ff29c-b8ac-4e36-82b1-9df9647b2c34 service nova] [instance: 2c154591-b130-4aa4-aad4-4c85324512df] Refreshing instance network info cache due to event network-changed-c743768f-0b40-435a-8754-96784ae96dda. {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 15:53:50 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-db8797dc-563f-4696-84ce-f3458e533234 req-6a3ff29c-b8ac-4e36-82b1-9df9647b2c34 service nova] Acquiring lock "refresh_cache-2c154591-b130-4aa4-aad4-4c85324512df" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:53:50 user nova-compute[75176]: DEBUG nova.network.neutron [None req-6597d1a9-3869-4ca0-9735-c7389fcf5a39 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] [instance: 2c154591-b130-4aa4-aad4-4c85324512df] Instance cache missing network info. {{(pid=75176) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 15:53:50 user nova-compute[75176]: DEBUG nova.compute.manager [req-6ca711a3-c4e9-420a-8302-76370f96e243 req-bbc24e99-bb82-48fe-9490-84596c506ed2 service nova] [instance: 55febf04-14ea-4903-8692-c7cc6115de75] Received event network-vif-plugged-e287ec1a-3726-4719-94b2-79764f7abd31 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:53:50 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-6ca711a3-c4e9-420a-8302-76370f96e243 req-bbc24e99-bb82-48fe-9490-84596c506ed2 service nova] Acquiring lock "55febf04-14ea-4903-8692-c7cc6115de75-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:53:50 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-6ca711a3-c4e9-420a-8302-76370f96e243 req-bbc24e99-bb82-48fe-9490-84596c506ed2 service nova] Lock "55febf04-14ea-4903-8692-c7cc6115de75-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:53:50 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-6ca711a3-c4e9-420a-8302-76370f96e243 req-bbc24e99-bb82-48fe-9490-84596c506ed2 service nova] Lock "55febf04-14ea-4903-8692-c7cc6115de75-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:53:50 user nova-compute[75176]: DEBUG nova.compute.manager [req-6ca711a3-c4e9-420a-8302-76370f96e243 req-bbc24e99-bb82-48fe-9490-84596c506ed2 service nova] [instance: 55febf04-14ea-4903-8692-c7cc6115de75] No waiting events found dispatching network-vif-plugged-e287ec1a-3726-4719-94b2-79764f7abd31 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:53:50 user nova-compute[75176]: WARNING nova.compute.manager [req-6ca711a3-c4e9-420a-8302-76370f96e243 req-bbc24e99-bb82-48fe-9490-84596c506ed2 service nova] [instance: 55febf04-14ea-4903-8692-c7cc6115de75] Received unexpected event network-vif-plugged-e287ec1a-3726-4719-94b2-79764f7abd31 for instance with vm_state active and task_state rescuing.
Nov 28 15:53:50 user nova-compute[75176]: DEBUG nova.compute.manager [req-6ca711a3-c4e9-420a-8302-76370f96e243 req-bbc24e99-bb82-48fe-9490-84596c506ed2 service nova] [instance: 55febf04-14ea-4903-8692-c7cc6115de75] Received event network-vif-plugged-e287ec1a-3726-4719-94b2-79764f7abd31 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:53:50 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-6ca711a3-c4e9-420a-8302-76370f96e243 req-bbc24e99-bb82-48fe-9490-84596c506ed2 service nova] Acquiring lock "55febf04-14ea-4903-8692-c7cc6115de75-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:53:50 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-6ca711a3-c4e9-420a-8302-76370f96e243 req-bbc24e99-bb82-48fe-9490-84596c506ed2 service nova] Lock "55febf04-14ea-4903-8692-c7cc6115de75-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:53:50 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-6ca711a3-c4e9-420a-8302-76370f96e243 req-bbc24e99-bb82-48fe-9490-84596c506ed2 service nova] Lock "55febf04-14ea-4903-8692-c7cc6115de75-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:53:50 user nova-compute[75176]: DEBUG nova.compute.manager [req-6ca711a3-c4e9-420a-8302-76370f96e243 req-bbc24e99-bb82-48fe-9490-84596c506ed2 service nova] [instance: 55febf04-14ea-4903-8692-c7cc6115de75] No waiting events found dispatching network-vif-plugged-e287ec1a-3726-4719-94b2-79764f7abd31 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:53:50 user nova-compute[75176]: WARNING nova.compute.manager [req-6ca711a3-c4e9-420a-8302-76370f96e243 req-bbc24e99-bb82-48fe-9490-84596c506ed2 service nova] [instance: 55febf04-14ea-4903-8692-c7cc6115de75] Received unexpected event network-vif-plugged-e287ec1a-3726-4719-94b2-79764f7abd31 for instance with vm_state active and task_state rescuing.
Nov 28 15:53:50 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:53:50 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-2e2179be-a97e-48b7-98c4-150f36073b24 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/0ea5ae5a4cf6c6e5a33a1491e0598683d30f0840.part /opt/stack/data/nova/instances/_base/0ea5ae5a4cf6c6e5a33a1491e0598683d30f0840.converted" returned: 0 in 0.533s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:53:50 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-2e2179be-a97e-48b7-98c4-150f36073b24 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0ea5ae5a4cf6c6e5a33a1491e0598683d30f0840.converted --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:53:50 user nova-compute[75176]: DEBUG nova.network.neutron [None req-6597d1a9-3869-4ca0-9735-c7389fcf5a39 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] [instance: 2c154591-b130-4aa4-aad4-4c85324512df] Updating instance_info_cache with network_info: [{"id": "c743768f-0b40-435a-8754-96784ae96dda", "address": "fa:16:3e:c1:2c:1c", "network": {"id": "5d0ae041-a67d-4a54-bd53-104c4f44209d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-938551772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "169fdaea89d4431aa6adacdbb76f3546", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc743768f-0b", "ovs_interfaceid": "c743768f-0b40-435a-8754-96784ae96dda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:53:50 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-6597d1a9-3869-4ca0-9735-c7389fcf5a39 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Releasing lock "refresh_cache-2c154591-b130-4aa4-aad4-4c85324512df" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:53:50 user nova-compute[75176]: DEBUG nova.compute.manager [None req-6597d1a9-3869-4ca0-9735-c7389fcf5a39 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] [instance: 2c154591-b130-4aa4-aad4-4c85324512df] Instance network_info: |[{"id": "c743768f-0b40-435a-8754-96784ae96dda", "address": "fa:16:3e:c1:2c:1c", "network": {"id": "5d0ae041-a67d-4a54-bd53-104c4f44209d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-938551772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "169fdaea89d4431aa6adacdbb76f3546", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc743768f-0b", "ovs_interfaceid": "c743768f-0b40-435a-8754-96784ae96dda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75176) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 15:53:50 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-db8797dc-563f-4696-84ce-f3458e533234 req-6a3ff29c-b8ac-4e36-82b1-9df9647b2c34 service nova] Acquired lock "refresh_cache-2c154591-b130-4aa4-aad4-4c85324512df" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:53:50 user nova-compute[75176]: DEBUG nova.network.neutron [req-db8797dc-563f-4696-84ce-f3458e533234 req-6a3ff29c-b8ac-4e36-82b1-9df9647b2c34 service nova] [instance: 2c154591-b130-4aa4-aad4-4c85324512df] Refreshing network info cache for port c743768f-0b40-435a-8754-96784ae96dda {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 15:53:50 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-6597d1a9-3869-4ca0-9735-c7389fcf5a39 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] [instance: 2c154591-b130-4aa4-aad4-4c85324512df] Start _get_guest_xml network_info=[{"id": "c743768f-0b40-435a-8754-96784ae96dda", "address": "fa:16:3e:c1:2c:1c", "network": {"id": "5d0ae041-a67d-4a54-bd53-104c4f44209d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-938551772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "169fdaea89d4431aa6adacdbb76f3546", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc743768f-0b", "ovs_interfaceid": "c743768f-0b40-435a-8754-96784ae96dda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T15:35:12Z,direct_url=<?>,disk_format='qcow2',id=1f41819e-c93f-4dc7-b253-37a27bbbbc74,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1b91c5d0672c4224a48df2e1f92688e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T15:35:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'size': 0, 'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'image_id': '1f41819e-c93f-4dc7-b253-37a27bbbbc74'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75176) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 15:53:50 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-6597d1a9-3869-4ca0-9735-c7389fcf5a39 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 15:53:50 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-6597d1a9-3869-4ca0-9735-c7389fcf5a39 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 15:53:50 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-6597d1a9-3869-4ca0-9735-c7389fcf5a39 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75176) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 15:53:50 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-6597d1a9-3869-4ca0-9735-c7389fcf5a39 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] CPU controller missing on host. {{(pid=75176) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 15:53:50 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-2e2179be-a97e-48b7-98c4-150f36073b24 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0ea5ae5a4cf6c6e5a33a1491e0598683d30f0840.converted --force-share --output=json" returned: 0 in 0.198s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:53:50 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-2e2179be-a97e-48b7-98c4-150f36073b24 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Lock "0ea5ae5a4cf6c6e5a33a1491e0598683d30f0840" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.185s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:53:50 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-2e2179be-a97e-48b7-98c4-150f36073b24 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Acquiring lock "0ea5ae5a4cf6c6e5a33a1491e0598683d30f0840" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:53:50 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-2e2179be-a97e-48b7-98c4-150f36073b24 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Lock "0ea5ae5a4cf6c6e5a33a1491e0598683d30f0840" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:53:50 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-2e2179be-a97e-48b7-98c4-150f36073b24 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0ea5ae5a4cf6c6e5a33a1491e0598683d30f0840 --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:53:50 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-6597d1a9-3869-4ca0-9735-c7389fcf5a39 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75176) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 15:53:50 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-6597d1a9-3869-4ca0-9735-c7389fcf5a39 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] CPU controller found on host. {{(pid=75176) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 15:53:50 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-6597d1a9-3869-4ca0-9735-c7389fcf5a39 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75176) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 15:53:50 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-6597d1a9-3869-4ca0-9735-c7389fcf5a39 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T15:35:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T15:35:12Z,direct_url=<?>,disk_format='qcow2',id=1f41819e-c93f-4dc7-b253-37a27bbbbc74,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1b91c5d0672c4224a48df2e1f92688e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T15:35:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 15:53:50 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-6597d1a9-3869-4ca0-9735-c7389fcf5a39 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Flavor limits 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 15:53:50 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-6597d1a9-3869-4ca0-9735-c7389fcf5a39 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Image limits 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 15:53:50 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-6597d1a9-3869-4ca0-9735-c7389fcf5a39 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Flavor pref 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 15:53:50 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-6597d1a9-3869-4ca0-9735-c7389fcf5a39 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Image pref 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 15:53:50 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-6597d1a9-3869-4ca0-9735-c7389fcf5a39 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 15:53:50 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-6597d1a9-3869-4ca0-9735-c7389fcf5a39 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 15:53:50 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-6597d1a9-3869-4ca0-9735-c7389fcf5a39 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75176) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 15:53:50 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-6597d1a9-3869-4ca0-9735-c7389fcf5a39 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Got 1 possible topologies {{(pid=75176) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 15:53:50 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-6597d1a9-3869-4ca0-9735-c7389fcf5a39 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 15:53:50 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-6597d1a9-3869-4ca0-9735-c7389fcf5a39 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 15:53:50 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-6597d1a9-3869-4ca0-9735-c7389fcf5a39 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T15:53:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-130212440',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-130212440',id=39,image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGX7gmaaJWlutz/TKDo+wkCFFen5sReDn+1HuisCX/yqohTszCj8BZs1uuq8QFCZ3S7ilSOTHvQUXrHX6M5+9jiqleMWZztv4BQdNTI6ilr9cn1OCtm55/Gf1FtOLQUPeg==',key_name='tempest-keypair-780187379',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='169fdaea89d4431aa6adacdbb76f3546',ramdisk_id='',reservation_id='r-cpedp58n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1264107218',owner_user_name='tempest-AttachVolumeShelveTestJSON-1264107218-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T15:53:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3146d6b1e7324ebaa62ade09f1d1c68f',uuid=2c154591-b130-4aa4-aad4-4c85324512df,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c743768f-0b40-435a-8754-96784ae96dda", "address": "fa:16:3e:c1:2c:1c", "network": {"id": "5d0ae041-a67d-4a54-bd53-104c4f44209d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-938551772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "169fdaea89d4431aa6adacdbb76f3546", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc743768f-0b", "ovs_interfaceid": "c743768f-0b40-435a-8754-96784ae96dda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75176) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 15:53:50 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-6597d1a9-3869-4ca0-9735-c7389fcf5a39 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Converting VIF {"id": "c743768f-0b40-435a-8754-96784ae96dda", "address": "fa:16:3e:c1:2c:1c", "network": {"id": "5d0ae041-a67d-4a54-bd53-104c4f44209d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-938551772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "169fdaea89d4431aa6adacdbb76f3546", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc743768f-0b", "ovs_interfaceid": "c743768f-0b40-435a-8754-96784ae96dda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:53:50 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-6597d1a9-3869-4ca0-9735-c7389fcf5a39 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:2c:1c,bridge_name='br-int',has_traffic_filtering=True,id=c743768f-0b40-435a-8754-96784ae96dda,network=Network(5d0ae041-a67d-4a54-bd53-104c4f44209d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc743768f-0b') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:53:51 user nova-compute[75176]: DEBUG nova.objects.instance [None req-6597d1a9-3869-4ca0-9735-c7389fcf5a39 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Lazy-loading 'pci_devices' on Instance uuid 2c154591-b130-4aa4-aad4-4c85324512df {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:53:51 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-6597d1a9-3869-4ca0-9735-c7389fcf5a39 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] [instance: 2c154591-b130-4aa4-aad4-4c85324512df] End _get_guest_xml xml=<domain type="kvm">
Nov 28 15:53:51 user nova-compute[75176]:   <uuid>2c154591-b130-4aa4-aad4-4c85324512df</uuid>
Nov 28 15:53:51 user nova-compute[75176]:   <name>instance-00000027</name>
Nov 28 15:53:51 user nova-compute[75176]:   <memory>524288</memory>
Nov 28 15:53:51 user nova-compute[75176]:   <vcpu>1</vcpu>
Nov 28 15:53:51 user nova-compute[75176]:   <metadata>
Nov 28 15:53:51 user nova-compute[75176]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 15:53:51 user nova-compute[75176]:       <nova:package version="0.0.0"/>
Nov 28 15:53:51 user nova-compute[75176]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-130212440</nova:name>
Nov 28 15:53:51 user nova-compute[75176]:       <nova:creationTime>2023-11-28 15:53:50</nova:creationTime>
Nov 28 15:53:51 user nova-compute[75176]:       <nova:flavor name="m1.tiny">
Nov 28 15:53:51 user nova-compute[75176]:         <nova:memory>512</nova:memory>
Nov 28 15:53:51 user nova-compute[75176]:         <nova:disk>1</nova:disk>
Nov 28 15:53:51 user nova-compute[75176]:         <nova:swap>0</nova:swap>
Nov 28 15:53:51 user nova-compute[75176]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 15:53:51 user nova-compute[75176]:         <nova:vcpus>1</nova:vcpus>
Nov 28 15:53:51 user nova-compute[75176]:       </nova:flavor>
Nov 28 15:53:51 user nova-compute[75176]:       <nova:owner>
Nov 28 15:53:51 user nova-compute[75176]:         <nova:user uuid="3146d6b1e7324ebaa62ade09f1d1c68f">tempest-AttachVolumeShelveTestJSON-1264107218-project-member</nova:user>
Nov 28 15:53:51 user nova-compute[75176]:         <nova:project uuid="169fdaea89d4431aa6adacdbb76f3546">tempest-AttachVolumeShelveTestJSON-1264107218</nova:project>
Nov 28 15:53:51 user nova-compute[75176]:       </nova:owner>
Nov 28 15:53:51 user nova-compute[75176]:       <nova:root type="image" uuid="1f41819e-c93f-4dc7-b253-37a27bbbbc74"/>
Nov 28 15:53:51 user nova-compute[75176]:       <nova:ports>
Nov 28 15:53:51 user nova-compute[75176]:         <nova:port uuid="c743768f-0b40-435a-8754-96784ae96dda">
Nov 28 15:53:51 user nova-compute[75176]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 28 15:53:51 user nova-compute[75176]:         </nova:port>
Nov 28 15:53:51 user nova-compute[75176]:       </nova:ports>
Nov 28 15:53:51 user nova-compute[75176]:     </nova:instance>
Nov 28 15:53:51 user nova-compute[75176]:   </metadata>
Nov 28 15:53:51 user nova-compute[75176]:   <sysinfo type="smbios">
Nov 28 15:53:51 user nova-compute[75176]:     <system>
Nov 28 15:53:51 user nova-compute[75176]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 15:53:51 user nova-compute[75176]:       <entry name="product">OpenStack Nova</entry>
Nov 28 15:53:51 user nova-compute[75176]:       <entry name="version">0.0.0</entry>
Nov 28 15:53:51 user nova-compute[75176]:       <entry name="serial">2c154591-b130-4aa4-aad4-4c85324512df</entry>
Nov 28 15:53:51 user nova-compute[75176]:       <entry name="uuid">2c154591-b130-4aa4-aad4-4c85324512df</entry>
Nov 28 15:53:51 user nova-compute[75176]:       <entry name="family">Virtual Machine</entry>
Nov 28 15:53:51 user nova-compute[75176]:     </system>
Nov 28 15:53:51 user nova-compute[75176]:   </sysinfo>
Nov 28 15:53:51 user nova-compute[75176]:   <os>
Nov 28 15:53:51 user nova-compute[75176]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 15:53:51 user nova-compute[75176]:     <boot dev="hd"/>
Nov 28 15:53:51 user nova-compute[75176]:     <smbios mode="sysinfo"/>
Nov 28 15:53:51 user nova-compute[75176]:   </os>
Nov 28 15:53:51 user nova-compute[75176]:   <features>
Nov 28 15:53:51 user nova-compute[75176]:     <acpi/>
Nov 28 15:53:51 user nova-compute[75176]:     <apic/>
Nov 28 15:53:51 user nova-compute[75176]:     <vmcoreinfo/>
Nov 28 15:53:51 user nova-compute[75176]:   </features>
Nov 28 15:53:51 user nova-compute[75176]:   <clock offset="utc">
Nov 28 15:53:51 user nova-compute[75176]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 15:53:51 user nova-compute[75176]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 15:53:51 user nova-compute[75176]:     <timer name="hpet" present="no"/>
Nov 28 15:53:51 user nova-compute[75176]:   </clock>
Nov 28 15:53:51 user nova-compute[75176]:   <cpu mode="custom" match="exact">
Nov 28 15:53:51 user nova-compute[75176]:     <model>Nehalem</model>
Nov 28 15:53:51 user nova-compute[75176]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 15:53:51 user nova-compute[75176]:   </cpu>
Nov 28 15:53:51 user nova-compute[75176]:   <devices>
Nov 28 15:53:51 user nova-compute[75176]:     <disk type="file" device="disk">
Nov 28 15:53:51 user nova-compute[75176]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 15:53:51 user nova-compute[75176]:       <source file="/opt/stack/data/nova/instances/2c154591-b130-4aa4-aad4-4c85324512df/disk"/>
Nov 28 15:53:51 user nova-compute[75176]:       <target dev="vda" bus="virtio"/>
Nov 28 15:53:51 user nova-compute[75176]:     </disk>
Nov 28 15:53:51 user nova-compute[75176]:     <interface type="ethernet">
Nov 28 15:53:51 user nova-compute[75176]:       <mac address="fa:16:3e:c1:2c:1c"/>
Nov 28 15:53:51 user nova-compute[75176]:       <model type="virtio"/>
Nov 28 15:53:51 user nova-compute[75176]:       <mtu size="1442"/>
Nov 28 15:53:51 user nova-compute[75176]:       <target dev="tapc743768f-0b"/>
Nov 28 15:53:51 user nova-compute[75176]:     </interface>
Nov 28 15:53:51 user nova-compute[75176]:     <serial type="pty">
Nov 28 15:53:51 user nova-compute[75176]:       <log file="/opt/stack/data/nova/instances/2c154591-b130-4aa4-aad4-4c85324512df/console.log" append="off"/>
Nov 28 15:53:51 user nova-compute[75176]:     </serial>
Nov 28 15:53:51 user nova-compute[75176]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 15:53:51 user nova-compute[75176]:     <video>
Nov 28 15:53:51 user nova-compute[75176]:       <model type="virtio"/>
Nov 28 15:53:51 user nova-compute[75176]:     </video>
Nov 28 15:53:51 user nova-compute[75176]:     <rng model="virtio">
Nov 28 15:53:51 user nova-compute[75176]:       <backend model="random">/dev/urandom</backend>
Nov 28 15:53:51 user nova-compute[75176]:     </rng>
Nov 28 15:53:51 user nova-compute[75176]:     <controller type="usb" index="0" model="none"/>
Nov 28 15:53:51 user nova-compute[75176]:     <memballoon model="virtio">
Nov 28 15:53:51 user nova-compute[75176]:       <stats period="10"/>
Nov 28 15:53:51 user nova-compute[75176]:     </memballoon>
Nov 28 15:53:51 user nova-compute[75176]:   </devices>
Nov 28 15:53:51 user nova-compute[75176]: </domain>
Nov 28 15:53:51 user nova-compute[75176]:  {{(pid=75176) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 15:53:51 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-6597d1a9-3869-4ca0-9735-c7389fcf5a39 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T15:53:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-130212440',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-130212440',id=39,image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGX7gmaaJWlutz/TKDo+wkCFFen5sReDn+1HuisCX/yqohTszCj8BZs1uuq8QFCZ3S7ilSOTHvQUXrHX6M5+9jiqleMWZztv4BQdNTI6ilr9cn1OCtm55/Gf1FtOLQUPeg==',key_name='tempest-keypair-780187379',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='169fdaea89d4431aa6adacdbb76f3546',ramdisk_id='',reservation_id='r-cpedp58n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1264107218',owner_user_name='tempest-AttachVolumeShelveTestJSON-1264107218-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T15:53:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3146d6b1e7324ebaa62ade09f1d1c68f',uuid=2c154591-b130-4aa4-aad4-4c85324512df,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c743768f-0b40-435a-8754-96784ae96dda", "address": "fa:16:3e:c1:2c:1c", "network": {"id": "5d0ae041-a67d-4a54-bd53-104c4f44209d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-938551772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "169fdaea89d4431aa6adacdbb76f3546", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc743768f-0b", "ovs_interfaceid": "c743768f-0b40-435a-8754-96784ae96dda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 15:53:51 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-6597d1a9-3869-4ca0-9735-c7389fcf5a39 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Converting VIF {"id": "c743768f-0b40-435a-8754-96784ae96dda", "address": "fa:16:3e:c1:2c:1c", "network": {"id": "5d0ae041-a67d-4a54-bd53-104c4f44209d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-938551772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "169fdaea89d4431aa6adacdbb76f3546", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc743768f-0b", "ovs_interfaceid": "c743768f-0b40-435a-8754-96784ae96dda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:53:51 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-6597d1a9-3869-4ca0-9735-c7389fcf5a39 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:2c:1c,bridge_name='br-int',has_traffic_filtering=True,id=c743768f-0b40-435a-8754-96784ae96dda,network=Network(5d0ae041-a67d-4a54-bd53-104c4f44209d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc743768f-0b') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:53:51 user nova-compute[75176]: DEBUG os_vif [None req-6597d1a9-3869-4ca0-9735-c7389fcf5a39 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:2c:1c,bridge_name='br-int',has_traffic_filtering=True,id=c743768f-0b40-435a-8754-96784ae96dda,network=Network(5d0ae041-a67d-4a54-bd53-104c4f44209d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc743768f-0b') {{(pid=75176) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 15:53:51 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:53:51 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:53:51 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 15:53:51 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:53:51 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2cbf83f5-63ba-5c1e-b1b9-40369d84d2bc', '_type': 'linux-noop'}}, row=False) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:53:51 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:53:51 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:53:51 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:53:51 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:53:51 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc743768f-0b, may_exist=True, interface_attrs={}) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:53:51 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc743768f-0b, col_values=(('qos', UUID('dd65c93c-9bd2-4fbb-a051-dbbb3f4a9f17')),), if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:53:51 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc743768f-0b, col_values=(('external_ids', {'iface-id': 'c743768f-0b40-435a-8754-96784ae96dda', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c1:2c:1c', 'vm-uuid': '2c154591-b130-4aa4-aad4-4c85324512df'}),), if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:53:51 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:53:51 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:53:51 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:53:51 user nova-compute[75176]: INFO os_vif [None req-6597d1a9-3869-4ca0-9735-c7389fcf5a39 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:2c:1c,bridge_name='br-int',has_traffic_filtering=True,id=c743768f-0b40-435a-8754-96784ae96dda,network=Network(5d0ae041-a67d-4a54-bd53-104c4f44209d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc743768f-0b')
Nov 28 15:53:51 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-2e2179be-a97e-48b7-98c4-150f36073b24 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0ea5ae5a4cf6c6e5a33a1491e0598683d30f0840 --force-share --output=json" returned: 0 in 0.253s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:53:51 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-2e2179be-a97e-48b7-98c4-150f36073b24 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0ea5ae5a4cf6c6e5a33a1491e0598683d30f0840,backing_fmt=raw /opt/stack/data/nova/instances/dc4e6d39-adfb-4d26-afef-46f316ff7846/disk.rescue {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:53:51 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-2e2179be-a97e-48b7-98c4-150f36073b24 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0ea5ae5a4cf6c6e5a33a1491e0598683d30f0840,backing_fmt=raw /opt/stack/data/nova/instances/dc4e6d39-adfb-4d26-afef-46f316ff7846/disk.rescue" returned: 0 in 0.078s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:53:51 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-2e2179be-a97e-48b7-98c4-150f36073b24 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Lock "0ea5ae5a4cf6c6e5a33a1491e0598683d30f0840" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.340s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:53:51 user nova-compute[75176]: DEBUG nova.objects.instance [None req-2e2179be-a97e-48b7-98c4-150f36073b24 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Lazy-loading 'migration_context' on Instance uuid dc4e6d39-adfb-4d26-afef-46f316ff7846 {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:53:51 user nova-compute[75176]: DEBUG nova.objects.base [None req-2e2179be-a97e-48b7-98c4-150f36073b24 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Object Instance<dc4e6d39-adfb-4d26-afef-46f316ff7846> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75176) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 15:53:51 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-2e2179be-a97e-48b7-98c4-150f36073b24 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: dc4e6d39-adfb-4d26-afef-46f316ff7846] Created local disks {{(pid=75176) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 15:53:51 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-2e2179be-a97e-48b7-98c4-150f36073b24 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: dc4e6d39-adfb-4d26-afef-46f316ff7846] Start _get_guest_xml network_info=[{"id": "65eb3123-182c-40fd-b20c-48b19b833f14", "address": "fa:16:3e:59:4a:59", "network": {"id": "998766cd-2e8e-4e39-add9-286086640993", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-989265510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-989265510-network", "vif_mac": "fa:16:3e:59:4a:59"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf05c8836b8a40de8e64c2d046ed71ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65eb3123-18", "ovs_interfaceid": "65eb3123-182c-40fd-b20c-48b19b833f14", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T15:35:12Z,direct_url=<?>,disk_format='qcow2',id=1f41819e-c93f-4dc7-b253-37a27bbbbc74,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1b91c5d0672c4224a48df2e1f92688e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T15:35:13Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '2b9abb27-92da-4006-9477-5dcac3222ebc', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sIJbvTel', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': 'dc4e6d39-adfb-4d26-afef-46f316ff7846', 'attached_at': '', 'detached_at': '', 'volume_id': '9c4d9db6-5ee1-419c-8f2e-2a758e9798b6', 'serial': '9c4d9db6-5ee1-419c-8f2e-2a758e9798b6'}, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'delete_on_termination': False, 'mount_device': '/dev/vda', 'attachment_id': 'd43d734a-766e-4e5f-8cdf-f713cdc1aa30', 'volume_type': None} {{(pid=75176) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 15:53:51 user nova-compute[75176]: DEBUG nova.objects.instance [None req-2e2179be-a97e-48b7-98c4-150f36073b24 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Lazy-loading 'resources' on Instance uuid dc4e6d39-adfb-4d26-afef-46f316ff7846 {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:53:51 user nova-compute[75176]: DEBUG nova.objects.base [None req-2e2179be-a97e-48b7-98c4-150f36073b24 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Object Instance<dc4e6d39-adfb-4d26-afef-46f316ff7846> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75176) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 15:53:51 user nova-compute[75176]: DEBUG nova.objects.instance [None req-2e2179be-a97e-48b7-98c4-150f36073b24 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Lazy-loading 'numa_topology' on Instance uuid dc4e6d39-adfb-4d26-afef-46f316ff7846 {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:53:51 user nova-compute[75176]: DEBUG nova.objects.base [None req-2e2179be-a97e-48b7-98c4-150f36073b24 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Object Instance<dc4e6d39-adfb-4d26-afef-46f316ff7846> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75176) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 15:53:51 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-6597d1a9-3869-4ca0-9735-c7389fcf5a39 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] No BDM found with device name vda, not building metadata. {{(pid=75176) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 15:53:51 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-6597d1a9-3869-4ca0-9735-c7389fcf5a39 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] No VIF found with MAC fa:16:3e:c1:2c:1c, not building metadata {{(pid=75176) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 15:53:51 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-2e2179be-a97e-48b7-98c4-150f36073b24 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 15:53:51 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-2e2179be-a97e-48b7-98c4-150f36073b24 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 15:53:51 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-2e2179be-a97e-48b7-98c4-150f36073b24 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75176) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 15:53:51 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-2e2179be-a97e-48b7-98c4-150f36073b24 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] CPU controller missing on host. {{(pid=75176) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 15:53:51 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-2e2179be-a97e-48b7-98c4-150f36073b24 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75176) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 15:53:51 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-2e2179be-a97e-48b7-98c4-150f36073b24 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] CPU controller found on host. {{(pid=75176) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 15:53:51 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-2e2179be-a97e-48b7-98c4-150f36073b24 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75176) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 15:53:51 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-2e2179be-a97e-48b7-98c4-150f36073b24 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T15:35:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T15:35:12Z,direct_url=<?>,disk_format='qcow2',id=1f41819e-c93f-4dc7-b253-37a27bbbbc74,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1b91c5d0672c4224a48df2e1f92688e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T15:35:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 15:53:51 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-2e2179be-a97e-48b7-98c4-150f36073b24 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Flavor limits 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 15:53:51 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-2e2179be-a97e-48b7-98c4-150f36073b24 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Image limits 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 15:53:51 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-2e2179be-a97e-48b7-98c4-150f36073b24 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Flavor pref 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 15:53:51 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-2e2179be-a97e-48b7-98c4-150f36073b24 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Image pref 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 15:53:51 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-2e2179be-a97e-48b7-98c4-150f36073b24 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 15:53:51 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-2e2179be-a97e-48b7-98c4-150f36073b24 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 15:53:51 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-2e2179be-a97e-48b7-98c4-150f36073b24 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75176) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 15:53:51 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-2e2179be-a97e-48b7-98c4-150f36073b24 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Got 1 possible topologies {{(pid=75176) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 15:53:51 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-2e2179be-a97e-48b7-98c4-150f36073b24 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 15:53:51 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-2e2179be-a97e-48b7-98c4-150f36073b24 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 15:53:51 user nova-compute[75176]: DEBUG nova.objects.instance [None req-2e2179be-a97e-48b7-98c4-150f36073b24 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Lazy-loading 'vcpu_model' on Instance uuid dc4e6d39-adfb-4d26-afef-46f316ff7846 {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:53:51 user nova-compute[75176]: DEBUG nova.objects.base [None req-2e2179be-a97e-48b7-98c4-150f36073b24 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Object Instance<dc4e6d39-adfb-4d26-afef-46f316ff7846> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75176) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 15:53:51 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e2179be-a97e-48b7-98c4-150f36073b24 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: dc4e6d39-adfb-4d26-afef-46f316ff7846] Calling os-brick to attach iSCSI Volume {{(pid=75176) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 15:53:51 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e2179be-a97e-48b7-98c4-150f36073b24 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c1b8a00>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sIJbvTel', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 15:53:51 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-2e2179be-a97e-48b7-98c4-150f36073b24 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 15:53:51 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-2e2179be-a97e-48b7-98c4-150f36073b24 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 15:53:51 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-2e2179be-a97e-48b7-98c4-150f36073b24 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 15:53:51 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-2e2179be-a97e-48b7-98c4-150f36073b24 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 15:53:51 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-2e2179be-a97e-48b7-98c4-150f36073b24 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 15:53:51 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-2e2179be-a97e-48b7-98c4-150f36073b24 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 15:53:51 user nova-compute[75176]: INFO os_brick.initiator.connectors.iscsi [None req-2e2179be-a97e-48b7-98c4-150f36073b24 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 15:53:51 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 -p 172.16.0.220:3260 {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:53:51 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 -p 172.16.0.220:3260" returned: 0 in 0.017s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:53:51 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[007b660e-6bed-4ab9-9f6c-186ed41c495e]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = sIJbvTel\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:53:51 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e2179be-a97e-48b7-98c4-150f36073b24 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 28 15:53:51 user nova-compute[75176]: node.name = iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6
Nov 28 15:53:51 user nova-compute[75176]: node.tpgt = -1
Nov 28 15:53:51 user nova-compute[75176]: node.startup = automatic
Nov 28 15:53:51 user nova-compute[75176]: node.leading_login = No
Nov 28 15:53:51 user nova-compute[75176]: iface.iscsi_ifacename = default
Nov 28 15:53:51 user nova-compute[75176]: iface.net_ifacename = <empty>
Nov 28 15:53:51 user nova-compute[75176]: iface.ipaddress = <empty>
Nov 28 15:53:51 user nova-compute[75176]: iface.prefix_len = 0
Nov 28 15:53:51 user nova-compute[75176]: iface.hwaddress = <empty>
Nov 28 15:53:51 user nova-compute[75176]: iface.transport_name = tcp
Nov 28 15:53:51 user nova-compute[75176]: iface.initiatorname = <empty>
Nov 28 15:53:51 user nova-compute[75176]: iface.state = <empty>
Nov 28 15:53:51 user nova-compute[75176]: iface.vlan_id = 0
Nov 28 15:53:51 user nova-compute[75176]: iface.vlan_priority = 0
Nov 28 15:53:51 user nova-compute[75176]: iface.vlan_state = <empty>
Nov 28 15:53:51 user nova-compute[75176]: iface.iface_num = 0
Nov 28 15:53:51 user nova-compute[75176]: iface.mtu = 0
Nov 28 15:53:51 user nova-compute[75176]: iface.port = 0
Nov 28 15:53:51 user nova-compute[75176]: iface.bootproto = <empty>
Nov 28 15:53:51 user nova-compute[75176]: iface.subnet_mask = <empty>
Nov 28 15:53:51 user nova-compute[75176]: iface.gateway = <empty>
Nov 28 15:53:51 user nova-compute[75176]: iface.dhcp_alt_client_id_state = <empty>
Nov 28 15:53:51 user nova-compute[75176]: iface.dhcp_alt_client_id = <empty>
Nov 28 15:53:51 user nova-compute[75176]: iface.dhcp_dns = <empty>
Nov 28 15:53:51 user nova-compute[75176]: iface.dhcp_learn_iqn = <empty>
Nov 28 15:53:51 user nova-compute[75176]: iface.dhcp_req_vendor_id_state = <empty>
Nov 28 15:53:51 user nova-compute[75176]: iface.dhcp_vendor_id_state = <empty>
Nov 28 15:53:51 user nova-compute[75176]: iface.dhcp_vendor_id = <empty>
Nov 28 15:53:51 user nova-compute[75176]: iface.dhcp_slp_da = <empty>
Nov 28 15:53:51 user nova-compute[75176]: iface.fragmentation = <empty>
Nov 28 15:53:51 user nova-compute[75176]: iface.gratuitous_arp = <empty>
Nov 28 15:53:51 user nova-compute[75176]: iface.incoming_forwarding = <empty>
Nov 28 15:53:51 user nova-compute[75176]: iface.tos_state = <empty>
Nov 28 15:53:51 user nova-compute[75176]: iface.tos = 0
Nov 28 15:53:51 user nova-compute[75176]: iface.ttl = 0
Nov 28 15:53:51 user nova-compute[75176]: iface.delayed_ack = <empty>
Nov 28 15:53:51 user nova-compute[75176]: iface.tcp_nagle = <empty>
Nov 28 15:53:51 user nova-compute[75176]: iface.tcp_wsf_state = <empty>
Nov 28 15:53:51 user nova-compute[75176]: iface.tcp_wsf = 0
Nov 28 15:53:51 user nova-compute[75176]: iface.tcp_timer_scale = 0
Nov 28 15:53:51 user nova-compute[75176]: iface.tcp_timestamp = <empty>
Nov 28 15:53:51 user nova-compute[75176]: iface.redirect = <empty>
Nov 28 15:53:51 user nova-compute[75176]: iface.def_task_mgmt_timeout = 0
Nov 28 15:53:51 user nova-compute[75176]: iface.header_digest = <empty>
Nov 28 15:53:51 user nova-compute[75176]: iface.data_digest = <empty>
Nov 28 15:53:51 user nova-compute[75176]: iface.immediate_data = <empty>
Nov 28 15:53:51 user nova-compute[75176]: iface.initial_r2t = <empty>
Nov 28 15:53:51 user nova-compute[75176]: iface.data_seq_inorder = <empty>
Nov 28 15:53:51 user nova-compute[75176]: iface.data_pdu_inorder = <empty>
Nov 28 15:53:51 user nova-compute[75176]: iface.erl = 0
Nov 28 15:53:51 user nova-compute[75176]: iface.max_receive_data_len = 0
Nov 28 15:53:51 user nova-compute[75176]: iface.first_burst_len = 0
Nov 28 15:53:51 user nova-compute[75176]: iface.max_outstanding_r2t = 0
Nov 28 15:53:51 user nova-compute[75176]: iface.max_burst_len = 0
Nov 28 15:53:51 user nova-compute[75176]: iface.chap_auth = <empty>
Nov 28 15:53:51 user nova-compute[75176]: iface.bidi_chap = <empty>
Nov 28 15:53:51 user nova-compute[75176]: iface.strict_login_compliance = <empty>
Nov 28 15:53:51 user nova-compute[75176]: iface.discovery_auth = <empty>
Nov 28 15:53:51 user nova-compute[75176]: iface.discovery_logout = <empty>
Nov 28 15:53:51 user nova-compute[75176]: node.discovery_address = <empty>
Nov 28 15:53:51 user nova-compute[75176]: node.discovery_port = 0
Nov 28 15:53:51 user nova-compute[75176]: node.discovery_type = static
Nov 28 15:53:51 user nova-compute[75176]: node.session.initial_cmdsn = 0
Nov 28 15:53:51 user nova-compute[75176]: node.session.initial_login_retry_max = 8
Nov 28 15:53:51 user nova-compute[75176]: node.session.xmit_thread_priority = -20
Nov 28 15:53:51 user nova-compute[75176]: node.session.cmds_max = 128
Nov 28 15:53:51 user nova-compute[75176]: node.session.queue_depth = 32
Nov 28 15:53:51 user nova-compute[75176]: node.session.nr_sessions = 1
Nov 28 15:53:51 user nova-compute[75176]: node.session.auth.authmethod = CHAP
Nov 28 15:53:51 user nova-compute[75176]: node.session.auth.username = sIJbvTel
Nov 28 15:53:51 user nova-compute[75176]: node.session.auth.password = ***
Nov 28 15:53:51 user nova-compute[75176]: node.session.auth.username_in = <empty>
Nov 28 15:53:51 user nova-compute[75176]: node.session.auth.password_in = <empty>
Nov 28 15:53:51 user nova-compute[75176]: node.session.auth.chap_algs = MD5
Nov 28 15:53:51 user nova-compute[75176]: node.session.timeo.replacement_timeout = 120
Nov 28 15:53:51 user nova-compute[75176]: node.session.err_timeo.abort_timeout = 15
Nov 28 15:53:51 user nova-compute[75176]: node.session.err_timeo.lu_reset_timeout = 30
Nov 28 15:53:51 user nova-compute[75176]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 28 15:53:51 user nova-compute[75176]: node.session.err_timeo.host_reset_timeout = 60
Nov 28 15:53:51 user nova-compute[75176]: node.session.iscsi.FastAbort = Yes
Nov 28 15:53:51 user nova-compute[75176]: node.session.iscsi.InitialR2T = No
Nov 28 15:53:51 user nova-compute[75176]: node.session.iscsi.ImmediateData = Yes
Nov 28 15:53:51 user nova-compute[75176]: node.session.iscsi.FirstBurstLength = 262144
Nov 28 15:53:51 user nova-compute[75176]: node.session.iscsi.MaxBurstLength = 16776192
Nov 28 15:53:51 user nova-compute[75176]: node.session.iscsi.DefaultTime2Retain = 0
Nov 28 15:53:51 user nova-compute[75176]: node.session.iscsi.DefaultTime2Wait = 2
Nov 28 15:53:51 user nova-compute[75176]: node.session.iscsi.MaxConnections = 1
Nov 28 15:53:51 user nova-compute[75176]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 28 15:53:51 user nova-compute[75176]: node.session.iscsi.ERL = 0
Nov 28 15:53:51 user nova-compute[75176]: node.session.scan = manual
Nov 28 15:53:51 user nova-compute[75176]: node.session.reopen_max = 0
Nov 28 15:53:51 user nova-compute[75176]: node.conn[0].address = 172.16.0.220
Nov 28 15:53:51 user nova-compute[75176]: node.conn[0].port = 3260
Nov 28 15:53:51 user nova-compute[75176]: node.conn[0].startup = manual
Nov 28 15:53:51 user nova-compute[75176]: node.conn[0].tcp.window_size = 524288
Nov 28 15:53:51 user nova-compute[75176]: node.conn[0].tcp.type_of_service = 0
Nov 28 15:53:51 user nova-compute[75176]: node.conn[0].timeo.logout_timeout = 15
Nov 28 15:53:51 user nova-compute[75176]: node.conn[0].timeo.login_timeout = 15
Nov 28 15:53:51 user nova-compute[75176]: node.conn[0].timeo.auth_timeout = 45
Nov 28 15:53:51 user nova-compute[75176]: node.conn[0].timeo.noop_out_interval = 5
Nov 28 15:53:51 user nova-compute[75176]: node.conn[0].timeo.noop_out_timeout = 5
Nov 28 15:53:51 user nova-compute[75176]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 28 15:53:51 user nova-compute[75176]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 28 15:53:51 user nova-compute[75176]: node.conn[0].iscsi.HeaderDigest = None
Nov 28 15:53:51 user nova-compute[75176]: node.conn[0].iscsi.DataDigest = None
Nov 28 15:53:51 user nova-compute[75176]: node.conn[0].iscsi.IFMarker = No
Nov 28 15:53:51 user nova-compute[75176]: node.conn[0].iscsi.OFMarker = No
Nov 28 15:53:51 user nova-compute[75176]: # END RECORD
Nov 28 15:53:51 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:53:51 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:53:51 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:53:51 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a680455-7d2a-4aae-8a15-7c876052733b]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:53:51 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e2179be-a97e-48b7-98c4-150f36073b24 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:53:51 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:53:51 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:53:51 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e322d46-90d3-4f71-a9a6-21272360d1a3]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:53:51 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e2179be-a97e-48b7-98c4-150f36073b24 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:53:51 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sIJbvTel {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:53:51 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sIJbvTel" returned: 0 in 0.017s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:53:51 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[867f0ba7-794d-4312-8d3c-61538efd02b6]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:53:51 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e2179be-a97e-48b7-98c4-150f36073b24 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sIJbvTel'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:53:51 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:53:51 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:53:51 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2fd7ca6-ff46-416a-815d-63d5e4d805a9]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:53:51 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e2179be-a97e-48b7-98c4-150f36073b24 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:53:51 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:53:51 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:53:51 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[e581baf6-fedc-4f3b-af6e-137d4530eafd]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc (non-flash)\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:53:51 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e2179be-a97e-48b7-98c4-150f36073b24 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 (non-flash)
Nov 28 15:53:51 user nova-compute[75176]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc (non-flash)
Nov 28 15:53:51 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:53:51 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e2179be-a97e-48b7-98c4-150f36073b24 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 (non-flash)
Nov 28 15:53:51 user nova-compute[75176]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc (non-flash)
Nov 28 15:53:51 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 15:53:51 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-2e2179be-a97e-48b7-98c4-150f36073b24 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.139s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 15:53:51 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e2179be-a97e-48b7-98c4-150f36073b24 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Connected to 172.16.0.220:3260 {{(pid=75176) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 15:53:51 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-2e2179be-a97e-48b7-98c4-150f36073b24 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] HCTL ('35', '0', '0', 0) found on session 40 with lun 0 {{(pid=75176) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 15:53:51 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-2e2179be-a97e-48b7-98c4-150f36073b24 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Scanning host 35 c: 0, t: 0, l: 0) {{(pid=75176) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 15:53:51 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:53:51 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.015s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:53:51 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eb2d291-8bd9-4f56-8a11-4ef80749fec1]: (4, ('0 0 0', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:53:51 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-2e2179be-a97e-48b7-98c4-150f36073b24 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Searching for a device in session 40 and hctl ('35', '0', '0', 0) yield: sdd {{(pid=75176) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 15:53:51 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e2179be-a97e-48b7-98c4-150f36073b24 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sIJbvTel', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75176) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 15:53:51 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-2e2179be-a97e-48b7-98c4-150f36073b24 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.166s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 15:53:51 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e2179be-a97e-48b7-98c4-150f36073b24 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] <== connect_volume: return (168ms) {'type': 'block', 'scsi_wwn': '23662623662626433', 'path': '/dev/sdd'} {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 15:53:51 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e2179be-a97e-48b7-98c4-150f36073b24 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: dc4e6d39-adfb-4d26-afef-46f316ff7846] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23662623662626433', 'path': '/dev/sdd'} {{(pid=75176) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 15:53:51 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-2e2179be-a97e-48b7-98c4-150f36073b24 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T15:51:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1353594468',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1353594468',id=35,image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-28T15:52:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bf05c8836b8a40de8e64c2d046ed71ff',ramdisk_id='',reservation_id='r-0xcr01a0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1648409789',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T15:52:15Z,user_data=None,user_id='f24cedac95a44bb5a9ee54cc4713945c',uuid=dc4e6d39-adfb-4d26-afef-46f316ff7846,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "65eb3123-182c-40fd-b20c-48b19b833f14", "address": "fa:16:3e:59:4a:59", "network": {"id": "998766cd-2e8e-4e39-add9-286086640993", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-989265510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-989265510-network", "vif_mac": "fa:16:3e:59:4a:59"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf05c8836b8a40de8e64c2d046ed71ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65eb3123-18", "ovs_interfaceid": "65eb3123-182c-40fd-b20c-48b19b833f14", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75176) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 15:53:51 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-2e2179be-a97e-48b7-98c4-150f36073b24 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Converting VIF {"id": "65eb3123-182c-40fd-b20c-48b19b833f14", "address": "fa:16:3e:59:4a:59", "network": {"id": "998766cd-2e8e-4e39-add9-286086640993", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-989265510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-989265510-network", "vif_mac": "fa:16:3e:59:4a:59"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf05c8836b8a40de8e64c2d046ed71ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65eb3123-18", "ovs_interfaceid": "65eb3123-182c-40fd-b20c-48b19b833f14", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:53:51 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-2e2179be-a97e-48b7-98c4-150f36073b24 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:59:4a:59,bridge_name='br-int',has_traffic_filtering=True,id=65eb3123-182c-40fd-b20c-48b19b833f14,network=Network(998766cd-2e8e-4e39-add9-286086640993),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65eb3123-18') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:53:51 user nova-compute[75176]: DEBUG nova.objects.instance [None req-2e2179be-a97e-48b7-98c4-150f36073b24 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Lazy-loading 'pci_devices' on Instance uuid dc4e6d39-adfb-4d26-afef-46f316ff7846 {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:53:51 user nova-compute[75176]: DEBUG nova.objects.base [None req-2e2179be-a97e-48b7-98c4-150f36073b24 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Object Instance<dc4e6d39-adfb-4d26-afef-46f316ff7846> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75176) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 15:53:51 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-2e2179be-a97e-48b7-98c4-150f36073b24 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: dc4e6d39-adfb-4d26-afef-46f316ff7846] End _get_guest_xml xml=<domain type="kvm">
Nov 28 15:53:51 user nova-compute[75176]:   <uuid>dc4e6d39-adfb-4d26-afef-46f316ff7846</uuid>
Nov 28 15:53:51 user nova-compute[75176]:   <name>instance-00000023</name>
Nov 28 15:53:51 user nova-compute[75176]:   <memory>524288</memory>
Nov 28 15:53:51 user nova-compute[75176]:   <vcpu>1</vcpu>
Nov 28 15:53:51 user nova-compute[75176]:   <metadata>
Nov 28 15:53:51 user nova-compute[75176]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 15:53:51 user nova-compute[75176]:       <nova:package version="0.0.0"/>
Nov 28 15:53:51 user nova-compute[75176]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1353594468</nova:name>
Nov 28 15:53:51 user nova-compute[75176]:       <nova:creationTime>2023-11-28 15:53:51</nova:creationTime>
Nov 28 15:53:51 user nova-compute[75176]:       <nova:flavor name="m1.tiny">
Nov 28 15:53:51 user nova-compute[75176]:         <nova:memory>512</nova:memory>
Nov 28 15:53:51 user nova-compute[75176]:         <nova:disk>1</nova:disk>
Nov 28 15:53:51 user nova-compute[75176]:         <nova:swap>0</nova:swap>
Nov 28 15:53:51 user nova-compute[75176]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 15:53:51 user nova-compute[75176]:         <nova:vcpus>1</nova:vcpus>
Nov 28 15:53:51 user nova-compute[75176]:       </nova:flavor>
Nov 28 15:53:51 user nova-compute[75176]:       <nova:owner>
Nov 28 15:53:51 user nova-compute[75176]:         <nova:user uuid="f24cedac95a44bb5a9ee54cc4713945c">tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member</nova:user>
Nov 28 15:53:51 user nova-compute[75176]:         <nova:project uuid="bf05c8836b8a40de8e64c2d046ed71ff">tempest-ServerBootFromVolumeStableRescueTest-1648409789</nova:project>
Nov 28 15:53:51 user nova-compute[75176]:       </nova:owner>
Nov 28 15:53:51 user nova-compute[75176]:       <nova:root type="image" uuid="1f41819e-c93f-4dc7-b253-37a27bbbbc74"/>
Nov 28 15:53:51 user nova-compute[75176]:       <nova:ports>
Nov 28 15:53:51 user nova-compute[75176]:         <nova:port uuid="65eb3123-182c-40fd-b20c-48b19b833f14">
Nov 28 15:53:51 user nova-compute[75176]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 28 15:53:51 user nova-compute[75176]:         </nova:port>
Nov 28 15:53:51 user nova-compute[75176]:       </nova:ports>
Nov 28 15:53:51 user nova-compute[75176]:     </nova:instance>
Nov 28 15:53:51 user nova-compute[75176]:   </metadata>
Nov 28 15:53:51 user nova-compute[75176]:   <sysinfo type="smbios">
Nov 28 15:53:51 user nova-compute[75176]:     <system>
Nov 28 15:53:51 user nova-compute[75176]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 15:53:51 user nova-compute[75176]:       <entry name="product">OpenStack Nova</entry>
Nov 28 15:53:51 user nova-compute[75176]:       <entry name="version">0.0.0</entry>
Nov 28 15:53:51 user nova-compute[75176]:       <entry name="serial">dc4e6d39-adfb-4d26-afef-46f316ff7846</entry>
Nov 28 15:53:51 user nova-compute[75176]:       <entry name="uuid">dc4e6d39-adfb-4d26-afef-46f316ff7846</entry>
Nov 28 15:53:51 user nova-compute[75176]:       <entry name="family">Virtual Machine</entry>
Nov 28 15:53:51 user nova-compute[75176]:     </system>
Nov 28 15:53:51 user nova-compute[75176]:   </sysinfo>
Nov 28 15:53:51 user nova-compute[75176]:   <os>
Nov 28 15:53:51 user nova-compute[75176]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 15:53:51 user nova-compute[75176]:     <smbios mode="sysinfo"/>
Nov 28 15:53:51 user nova-compute[75176]:   </os>
Nov 28 15:53:51 user nova-compute[75176]:   <features>
Nov 28 15:53:51 user nova-compute[75176]:     <acpi/>
Nov 28 15:53:51 user nova-compute[75176]:     <apic/>
Nov 28 15:53:51 user nova-compute[75176]:     <vmcoreinfo/>
Nov 28 15:53:51 user nova-compute[75176]:   </features>
Nov 28 15:53:51 user nova-compute[75176]:   <clock offset="utc">
Nov 28 15:53:51 user nova-compute[75176]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 15:53:51 user nova-compute[75176]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 15:53:51 user nova-compute[75176]:     <timer name="hpet" present="no"/>
Nov 28 15:53:51 user nova-compute[75176]:   </clock>
Nov 28 15:53:51 user nova-compute[75176]:   <cpu mode="custom" match="exact">
Nov 28 15:53:51 user nova-compute[75176]:     <model>Nehalem</model>
Nov 28 15:53:51 user nova-compute[75176]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 15:53:51 user nova-compute[75176]:   </cpu>
Nov 28 15:53:51 user nova-compute[75176]:   <devices>
Nov 28 15:53:51 user nova-compute[75176]:     <disk type="block" device="disk">
Nov 28 15:53:51 user nova-compute[75176]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 15:53:51 user nova-compute[75176]:       <source dev="/dev/sdd"/>
Nov 28 15:53:51 user nova-compute[75176]:       <target dev="vda" bus="virtio"/>
Nov 28 15:53:51 user nova-compute[75176]:       <serial>9c4d9db6-5ee1-419c-8f2e-2a758e9798b6</serial>
Nov 28 15:53:51 user nova-compute[75176]:     </disk>
Nov 28 15:53:51 user nova-compute[75176]:     <disk type="file" device="disk">
Nov 28 15:53:51 user nova-compute[75176]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 15:53:51 user nova-compute[75176]:       <source file="/opt/stack/data/nova/instances/dc4e6d39-adfb-4d26-afef-46f316ff7846/disk.rescue"/>
Nov 28 15:53:51 user nova-compute[75176]:       <target dev="vdb" bus="virtio"/>
Nov 28 15:53:51 user nova-compute[75176]:       <boot order="1"/>
Nov 28 15:53:51 user nova-compute[75176]:     </disk>
Nov 28 15:53:51 user nova-compute[75176]:     <interface type="ethernet">
Nov 28 15:53:51 user nova-compute[75176]:       <mac address="fa:16:3e:59:4a:59"/>
Nov 28 15:53:51 user nova-compute[75176]:       <model type="virtio"/>
Nov 28 15:53:51 user nova-compute[75176]:       <mtu size="1442"/>
Nov 28 15:53:51 user nova-compute[75176]:       <target dev="tap65eb3123-18"/>
Nov 28 15:53:51 user nova-compute[75176]:     </interface>
Nov 28 15:53:51 user nova-compute[75176]:     <serial type="pty">
Nov 28 15:53:51 user nova-compute[75176]:       <log file="/opt/stack/data/nova/instances/dc4e6d39-adfb-4d26-afef-46f316ff7846/console.log" append="off"/>
Nov 28 15:53:51 user nova-compute[75176]:     </serial>
Nov 28 15:53:51 user nova-compute[75176]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 15:53:51 user nova-compute[75176]:     <video>
Nov 28 15:53:51 user nova-compute[75176]:       <model type="virtio"/>
Nov 28 15:53:51 user nova-compute[75176]:     </video>
Nov 28 15:53:51 user nova-compute[75176]:     <rng model="virtio">
Nov 28 15:53:51 user nova-compute[75176]:       <backend model="random">/dev/urandom</backend>
Nov 28 15:53:51 user nova-compute[75176]:     </rng>
Nov 28 15:53:51 user nova-compute[75176]:     <controller type="usb" index="0" model="none"/>
Nov 28 15:53:51 user nova-compute[75176]:     <memballoon model="virtio">
Nov 28 15:53:51 user nova-compute[75176]:       <stats period="10"/>
Nov 28 15:53:51 user nova-compute[75176]:     </memballoon>
Nov 28 15:53:51 user nova-compute[75176]:   </devices>
Nov 28 15:53:51 user nova-compute[75176]: </domain>
Nov 28 15:53:51 user nova-compute[75176]:  {{(pid=75176) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 15:53:51 user nova-compute[75176]: INFO nova.virt.libvirt.driver [-] [instance: dc4e6d39-adfb-4d26-afef-46f316ff7846] Instance destroyed successfully.
Nov 28 15:53:51 user nova-compute[75176]: DEBUG nova.network.neutron [req-db8797dc-563f-4696-84ce-f3458e533234 req-6a3ff29c-b8ac-4e36-82b1-9df9647b2c34 service nova] [instance: 2c154591-b130-4aa4-aad4-4c85324512df] Updated VIF entry in instance network info cache for port c743768f-0b40-435a-8754-96784ae96dda. {{(pid=75176) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 15:53:51 user nova-compute[75176]: DEBUG nova.network.neutron [req-db8797dc-563f-4696-84ce-f3458e533234 req-6a3ff29c-b8ac-4e36-82b1-9df9647b2c34 service nova] [instance: 2c154591-b130-4aa4-aad4-4c85324512df] Updating instance_info_cache with network_info: [{"id": "c743768f-0b40-435a-8754-96784ae96dda", "address": "fa:16:3e:c1:2c:1c", "network": {"id": "5d0ae041-a67d-4a54-bd53-104c4f44209d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-938551772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "169fdaea89d4431aa6adacdbb76f3546", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc743768f-0b", "ovs_interfaceid": "c743768f-0b40-435a-8754-96784ae96dda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:53:51 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-2e2179be-a97e-48b7-98c4-150f36073b24 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] No BDM found with device name vda, not building metadata. {{(pid=75176) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 15:53:51 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-2e2179be-a97e-48b7-98c4-150f36073b24 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75176) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 15:53:51 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-2e2179be-a97e-48b7-98c4-150f36073b24 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] No VIF found with MAC fa:16:3e:59:4a:59, not building metadata {{(pid=75176) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 15:53:51 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-db8797dc-563f-4696-84ce-f3458e533234 req-6a3ff29c-b8ac-4e36-82b1-9df9647b2c34 service nova] Releasing lock "refresh_cache-2c154591-b130-4aa4-aad4-4c85324512df" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:53:51 user nova-compute[75176]: DEBUG nova.compute.manager [None req-cb54ef45-d1e9-4116-b777-974b16f6fdbf tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] [instance: 55febf04-14ea-4903-8692-c7cc6115de75] Checking state {{(pid=75176) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 15:53:53 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:53:53 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:53:53 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:53:53 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:53:53 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:53:53 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:53:53 user nova-compute[75176]: DEBUG nova.compute.manager [req-2ff5db86-0d3f-49bc-b412-a58e98a693ab req-15d68cd8-cc71-4543-849c-d53fd0b1c84c service nova] [instance: 2c154591-b130-4aa4-aad4-4c85324512df] Received event network-vif-plugged-c743768f-0b40-435a-8754-96784ae96dda {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:53:53 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-2ff5db86-0d3f-49bc-b412-a58e98a693ab req-15d68cd8-cc71-4543-849c-d53fd0b1c84c service nova] Acquiring lock "2c154591-b130-4aa4-aad4-4c85324512df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:53:53 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-2ff5db86-0d3f-49bc-b412-a58e98a693ab req-15d68cd8-cc71-4543-849c-d53fd0b1c84c service nova] Lock "2c154591-b130-4aa4-aad4-4c85324512df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:53:53 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-2ff5db86-0d3f-49bc-b412-a58e98a693ab req-15d68cd8-cc71-4543-849c-d53fd0b1c84c service nova] Lock "2c154591-b130-4aa4-aad4-4c85324512df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:53:53 user nova-compute[75176]: DEBUG nova.compute.manager [req-2ff5db86-0d3f-49bc-b412-a58e98a693ab req-15d68cd8-cc71-4543-849c-d53fd0b1c84c service nova] [instance: 2c154591-b130-4aa4-aad4-4c85324512df] No waiting events found dispatching network-vif-plugged-c743768f-0b40-435a-8754-96784ae96dda {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:53:53 user nova-compute[75176]: WARNING nova.compute.manager [req-2ff5db86-0d3f-49bc-b412-a58e98a693ab req-15d68cd8-cc71-4543-849c-d53fd0b1c84c service nova] [instance: 2c154591-b130-4aa4-aad4-4c85324512df] Received unexpected event network-vif-plugged-c743768f-0b40-435a-8754-96784ae96dda for instance with vm_state building and task_state spawning.
Nov 28 15:53:53 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:53:54 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:53:54 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:53:54 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:53:54 user nova-compute[75176]: DEBUG nova.compute.manager [req-92ca9a95-7c56-43de-83f8-da2459f5800e req-064711f1-126f-4cb5-bf92-29455b9cc30f service nova] [instance: dc4e6d39-adfb-4d26-afef-46f316ff7846] Received event network-vif-plugged-65eb3123-182c-40fd-b20c-48b19b833f14 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:53:54 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-92ca9a95-7c56-43de-83f8-da2459f5800e req-064711f1-126f-4cb5-bf92-29455b9cc30f service nova] Acquiring lock "dc4e6d39-adfb-4d26-afef-46f316ff7846-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:53:54 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-92ca9a95-7c56-43de-83f8-da2459f5800e req-064711f1-126f-4cb5-bf92-29455b9cc30f service nova] Lock "dc4e6d39-adfb-4d26-afef-46f316ff7846-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:53:54 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-92ca9a95-7c56-43de-83f8-da2459f5800e req-064711f1-126f-4cb5-bf92-29455b9cc30f service nova] Lock "dc4e6d39-adfb-4d26-afef-46f316ff7846-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:53:54 user nova-compute[75176]: DEBUG nova.compute.manager [req-92ca9a95-7c56-43de-83f8-da2459f5800e req-064711f1-126f-4cb5-bf92-29455b9cc30f service nova] [instance: dc4e6d39-adfb-4d26-afef-46f316ff7846] No waiting events found dispatching network-vif-plugged-65eb3123-182c-40fd-b20c-48b19b833f14 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:53:54 user nova-compute[75176]: WARNING nova.compute.manager [req-92ca9a95-7c56-43de-83f8-da2459f5800e req-064711f1-126f-4cb5-bf92-29455b9cc30f service nova] [instance: dc4e6d39-adfb-4d26-afef-46f316ff7846] Received unexpected event network-vif-plugged-65eb3123-182c-40fd-b20c-48b19b833f14 for instance with vm_state active and task_state rescuing.
Nov 28 15:53:54 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:53:54 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:53:54 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:53:54 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:53:54 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:53:54 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:53:54 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:53:54 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:53:55 user nova-compute[75176]: DEBUG nova.compute.manager [req-e862ee23-16f1-4308-9ef0-b9dfeebc3410 req-de0d60bc-f29a-4a8b-a7df-11bbe9c6191d service nova] [instance: 2c154591-b130-4aa4-aad4-4c85324512df] Received event network-vif-plugged-c743768f-0b40-435a-8754-96784ae96dda {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:53:55 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-e862ee23-16f1-4308-9ef0-b9dfeebc3410 req-de0d60bc-f29a-4a8b-a7df-11bbe9c6191d service nova] Acquiring lock "2c154591-b130-4aa4-aad4-4c85324512df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:53:55 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-e862ee23-16f1-4308-9ef0-b9dfeebc3410 req-de0d60bc-f29a-4a8b-a7df-11bbe9c6191d service nova] Lock "2c154591-b130-4aa4-aad4-4c85324512df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:53:55 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-e862ee23-16f1-4308-9ef0-b9dfeebc3410 req-de0d60bc-f29a-4a8b-a7df-11bbe9c6191d service nova] Lock "2c154591-b130-4aa4-aad4-4c85324512df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:53:55 user nova-compute[75176]: DEBUG nova.compute.manager [req-e862ee23-16f1-4308-9ef0-b9dfeebc3410 req-de0d60bc-f29a-4a8b-a7df-11bbe9c6191d service nova] [instance: 2c154591-b130-4aa4-aad4-4c85324512df] No waiting events found dispatching network-vif-plugged-c743768f-0b40-435a-8754-96784ae96dda {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:53:55 user nova-compute[75176]: WARNING nova.compute.manager [req-e862ee23-16f1-4308-9ef0-b9dfeebc3410 req-de0d60bc-f29a-4a8b-a7df-11bbe9c6191d service nova] [instance: 2c154591-b130-4aa4-aad4-4c85324512df] Received unexpected event network-vif-plugged-c743768f-0b40-435a-8754-96784ae96dda for instance with vm_state building and task_state spawning.
Nov 28 15:53:56 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:53:56 user nova-compute[75176]: DEBUG nova.compute.manager [req-23da4a40-8c57-4c91-aecc-0b28e8a5d536 req-cc898f18-a03b-4d0f-8a63-237e30097e54 service nova] [instance: dc4e6d39-adfb-4d26-afef-46f316ff7846] Received event network-vif-plugged-65eb3123-182c-40fd-b20c-48b19b833f14 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:53:56 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-23da4a40-8c57-4c91-aecc-0b28e8a5d536 req-cc898f18-a03b-4d0f-8a63-237e30097e54 service nova] Acquiring lock "dc4e6d39-adfb-4d26-afef-46f316ff7846-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:53:56 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-23da4a40-8c57-4c91-aecc-0b28e8a5d536 req-cc898f18-a03b-4d0f-8a63-237e30097e54 service nova] Lock "dc4e6d39-adfb-4d26-afef-46f316ff7846-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:53:56 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-23da4a40-8c57-4c91-aecc-0b28e8a5d536 req-cc898f18-a03b-4d0f-8a63-237e30097e54 service nova] Lock "dc4e6d39-adfb-4d26-afef-46f316ff7846-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:53:56 user nova-compute[75176]: DEBUG nova.compute.manager [req-23da4a40-8c57-4c91-aecc-0b28e8a5d536 req-cc898f18-a03b-4d0f-8a63-237e30097e54 service nova] [instance: dc4e6d39-adfb-4d26-afef-46f316ff7846] No waiting events found dispatching network-vif-plugged-65eb3123-182c-40fd-b20c-48b19b833f14 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:53:56 user nova-compute[75176]: WARNING nova.compute.manager [req-23da4a40-8c57-4c91-aecc-0b28e8a5d536 req-cc898f18-a03b-4d0f-8a63-237e30097e54 service nova] [instance: dc4e6d39-adfb-4d26-afef-46f316ff7846] Received unexpected event network-vif-plugged-65eb3123-182c-40fd-b20c-48b19b833f14 for instance with vm_state active and task_state rescuing.
Nov 28 15:53:56 user nova-compute[75176]: DEBUG nova.compute.manager [None req-6597d1a9-3869-4ca0-9735-c7389fcf5a39 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] [instance: 2c154591-b130-4aa4-aad4-4c85324512df] Instance event wait completed in 0 seconds for  {{(pid=75176) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 15:53:56 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-6597d1a9-3869-4ca0-9735-c7389fcf5a39 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] [instance: 2c154591-b130-4aa4-aad4-4c85324512df] Guest created on hypervisor {{(pid=75176) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 15:53:56 user nova-compute[75176]: DEBUG nova.compute.manager [None req-2e2179be-a97e-48b7-98c4-150f36073b24 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: dc4e6d39-adfb-4d26-afef-46f316ff7846] Checking state {{(pid=75176) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 15:53:56 user nova-compute[75176]: INFO nova.virt.libvirt.driver [-] [instance: 2c154591-b130-4aa4-aad4-4c85324512df] Instance spawned successfully.
Nov 28 15:53:56 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-6597d1a9-3869-4ca0-9735-c7389fcf5a39 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] [instance: 2c154591-b130-4aa4-aad4-4c85324512df] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 15:53:56 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-6597d1a9-3869-4ca0-9735-c7389fcf5a39 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] [instance: 2c154591-b130-4aa4-aad4-4c85324512df] Found default for hw_cdrom_bus of ide {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:53:56 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-6597d1a9-3869-4ca0-9735-c7389fcf5a39 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] [instance: 2c154591-b130-4aa4-aad4-4c85324512df] Found default for hw_disk_bus of virtio {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:53:56 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-6597d1a9-3869-4ca0-9735-c7389fcf5a39 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] [instance: 2c154591-b130-4aa4-aad4-4c85324512df] Found default for hw_input_bus of None {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:53:56 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-6597d1a9-3869-4ca0-9735-c7389fcf5a39 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] [instance: 2c154591-b130-4aa4-aad4-4c85324512df] Found default for hw_pointer_model of None {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:53:56 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-6597d1a9-3869-4ca0-9735-c7389fcf5a39 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] [instance: 2c154591-b130-4aa4-aad4-4c85324512df] Found default for hw_video_model of virtio {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:53:56 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-6597d1a9-3869-4ca0-9735-c7389fcf5a39 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] [instance: 2c154591-b130-4aa4-aad4-4c85324512df] Found default for hw_vif_model of virtio {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:53:57 user nova-compute[75176]: INFO nova.compute.manager [None req-6597d1a9-3869-4ca0-9735-c7389fcf5a39 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] [instance: 2c154591-b130-4aa4-aad4-4c85324512df] Took 9.19 seconds to spawn the instance on the hypervisor.
Nov 28 15:53:57 user nova-compute[75176]: DEBUG nova.compute.manager [None req-6597d1a9-3869-4ca0-9735-c7389fcf5a39 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] [instance: 2c154591-b130-4aa4-aad4-4c85324512df] Checking state {{(pid=75176) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 15:53:57 user nova-compute[75176]: INFO nova.compute.manager [None req-6597d1a9-3869-4ca0-9735-c7389fcf5a39 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] [instance: 2c154591-b130-4aa4-aad4-4c85324512df] Took 10.19 seconds to build instance.
Nov 28 15:53:57 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-6597d1a9-3869-4ca0-9735-c7389fcf5a39 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Lock "2c154591-b130-4aa4-aad4-4c85324512df" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.331s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:53:57 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:53:57 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:53:59 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:53:59 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:53:59 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:53:59 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75176) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 15:54:01 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:54:01 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-1b3ceb25-2589-4af3-a2d7-293e6b9ed349 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Acquiring lock "f1b1fc0f-1865-4020-91ee-25a5e16127cf" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:54:01 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-1b3ceb25-2589-4af3-a2d7-293e6b9ed349 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Lock "f1b1fc0f-1865-4020-91ee-25a5e16127cf" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:54:01 user nova-compute[75176]: DEBUG nova.compute.manager [None req-1b3ceb25-2589-4af3-a2d7-293e6b9ed349 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: f1b1fc0f-1865-4020-91ee-25a5e16127cf] Starting instance... {{(pid=75176) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 15:54:01 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:54:01 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-1b3ceb25-2589-4af3-a2d7-293e6b9ed349 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:54:01 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-1b3ceb25-2589-4af3-a2d7-293e6b9ed349 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:54:01 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-1b3ceb25-2589-4af3-a2d7-293e6b9ed349 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75176) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 15:54:01 user nova-compute[75176]: INFO nova.compute.claims [None req-1b3ceb25-2589-4af3-a2d7-293e6b9ed349 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: f1b1fc0f-1865-4020-91ee-25a5e16127cf] Claim successful on node user
Nov 28 15:54:02 user nova-compute[75176]: DEBUG nova.compute.provider_tree [None req-1b3ceb25-2589-4af3-a2d7-293e6b9ed349 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Inventory has not changed in ProviderTree for provider: b37848d8-f401-4155-a029-b0ffa09ff85b {{(pid=75176) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 15:54:02 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-1b3ceb25-2589-4af3-a2d7-293e6b9ed349 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Inventory has not changed for provider b37848d8-f401-4155-a029-b0ffa09ff85b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75176) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 15:54:02 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-1b3ceb25-2589-4af3-a2d7-293e6b9ed349 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.601s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:54:02 user nova-compute[75176]: DEBUG nova.compute.manager [None req-1b3ceb25-2589-4af3-a2d7-293e6b9ed349 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: f1b1fc0f-1865-4020-91ee-25a5e16127cf] Start building networks asynchronously for instance. {{(pid=75176) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 15:54:02 user nova-compute[75176]: DEBUG nova.compute.manager [None req-1b3ceb25-2589-4af3-a2d7-293e6b9ed349 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: f1b1fc0f-1865-4020-91ee-25a5e16127cf] Allocating IP information in the background. {{(pid=75176) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 15:54:02 user nova-compute[75176]: DEBUG nova.network.neutron [None req-1b3ceb25-2589-4af3-a2d7-293e6b9ed349 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: f1b1fc0f-1865-4020-91ee-25a5e16127cf] allocate_for_instance() {{(pid=75176) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 15:54:02 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-1b3ceb25-2589-4af3-a2d7-293e6b9ed349 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: f1b1fc0f-1865-4020-91ee-25a5e16127cf] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 15:54:02 user nova-compute[75176]: DEBUG nova.compute.manager [None req-1b3ceb25-2589-4af3-a2d7-293e6b9ed349 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: f1b1fc0f-1865-4020-91ee-25a5e16127cf] Start building block device mappings for instance. {{(pid=75176) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 15:54:02 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:54:02 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Starting heal instance info cache {{(pid=75176) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 15:54:02 user nova-compute[75176]: INFO nova.virt.block_device [None req-1b3ceb25-2589-4af3-a2d7-293e6b9ed349 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: f1b1fc0f-1865-4020-91ee-25a5e16127cf] Booting with volume 2389818d-1c3f-46d9-a70a-1330da1b94e0 at /dev/vda
Nov 28 15:54:02 user nova-compute[75176]: DEBUG os_brick.utils [None req-1b3ceb25-2589-4af3-a2d7-293e6b9ed349 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 15:54:02 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:54:02 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:54:02 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[60315846-7d85-4856-b7f9-475e578a5dae]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:edc924a949b2\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:54:02 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:54:02 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquiring lock "refresh_cache-55febf04-14ea-4903-8692-c7cc6115de75" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:54:02 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquired lock "refresh_cache-55febf04-14ea-4903-8692-c7cc6115de75" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:54:02 user nova-compute[75176]: DEBUG nova.network.neutron [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] [instance: 55febf04-14ea-4903-8692-c7cc6115de75] Forcefully refreshing network info cache for instance {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 15:54:02 user nova-compute[75176]: DEBUG nova.policy [None req-1b3ceb25-2589-4af3-a2d7-293e6b9ed349 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '081bf84d24194b81be4e0a6638db9b66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c7783cc16049208421204910982c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75176) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 15:54:02 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:54:02 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeb9082a-e825-42e5-a269-44f9327ab95a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:54:02 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:54:02 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:54:02 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd3a5b63-2833-41e7-b6e2-fd83d9d05e39]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:54:02 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5988020-5217-4ffd-84c2-3fe594a95059]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:54:02 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-1b3ceb25-2589-4af3-a2d7-293e6b9ed349 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Running cmd (subprocess): nvme version {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:54:02 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-1b3ceb25-2589-4af3-a2d7-293e6b9ed349 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] 'nvme version' failed. Not Retrying. {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 15:54:02 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1b3ceb25-2589-4af3-a2d7-293e6b9ed349 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] nvme not present on system {{(pid=75176) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 15:54:02 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:54:02 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 15:54:02 user nova-compute[75176]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 15:54:02 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[3611ab29-e357-4dfc-bb5f-f874a443d6d0]: (4, '') {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:54:02 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.lightos [None req-1b3ceb25-2589-4af3-a2d7-293e6b9ed349 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75176) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 15:54:02 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.lightos [None req-1b3ceb25-2589-4af3-a2d7-293e6b9ed349 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75176) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 15:54:02 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.lightos [None req-1b3ceb25-2589-4af3-a2d7-293e6b9ed349 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] LIGHTOS: no hostnqn found. {{(pid=75176) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 15:54:02 user nova-compute[75176]: DEBUG os_brick.utils [None req-1b3ceb25-2589-4af3-a2d7-293e6b9ed349 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] <== get_connector_properties: return (151ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:edc924a949b2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 15:54:02 user nova-compute[75176]: DEBUG nova.virt.block_device [None req-1b3ceb25-2589-4af3-a2d7-293e6b9ed349 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: f1b1fc0f-1865-4020-91ee-25a5e16127cf] Updating existing volume attachment record: f374fed5-c765-4d04-a5d5-f8ef61da0154 {{(pid=75176) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 15:54:03 user nova-compute[75176]: DEBUG nova.network.neutron [None req-1b3ceb25-2589-4af3-a2d7-293e6b9ed349 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: f1b1fc0f-1865-4020-91ee-25a5e16127cf] Successfully created port: be523c77-4157-491b-be90-3b45d62b5523 {{(pid=75176) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 15:54:03 user nova-compute[75176]: DEBUG nova.network.neutron [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] [instance: 55febf04-14ea-4903-8692-c7cc6115de75] Updating instance_info_cache with network_info: [{"id": "e287ec1a-3726-4719-94b2-79764f7abd31", "address": "fa:16:3e:0c:d1:2f", "network": {"id": "d47c1797-a66f-4f2d-b83e-903b5bd3251c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1416388789-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd2856ce0a2545cda0b796eb0be10a40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape287ec1a-37", "ovs_interfaceid": "e287ec1a-3726-4719-94b2-79764f7abd31", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:54:03 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Releasing lock "refresh_cache-55febf04-14ea-4903-8692-c7cc6115de75" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:54:03 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] [instance: 55febf04-14ea-4903-8692-c7cc6115de75] Updated the network info_cache for instance {{(pid=75176) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 15:54:04 user nova-compute[75176]: DEBUG nova.network.neutron [None req-1b3ceb25-2589-4af3-a2d7-293e6b9ed349 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: f1b1fc0f-1865-4020-91ee-25a5e16127cf] Successfully updated port: be523c77-4157-491b-be90-3b45d62b5523 {{(pid=75176) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 15:54:04 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-1b3ceb25-2589-4af3-a2d7-293e6b9ed349 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Acquiring lock "refresh_cache-f1b1fc0f-1865-4020-91ee-25a5e16127cf" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:54:04 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-1b3ceb25-2589-4af3-a2d7-293e6b9ed349 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Acquired lock "refresh_cache-f1b1fc0f-1865-4020-91ee-25a5e16127cf" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:54:04 user nova-compute[75176]: DEBUG nova.network.neutron [None req-1b3ceb25-2589-4af3-a2d7-293e6b9ed349 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: f1b1fc0f-1865-4020-91ee-25a5e16127cf] Building network info cache for instance {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 15:54:04 user nova-compute[75176]: DEBUG nova.compute.manager [req-31a371c3-a99a-437d-bd85-cc8f56fc1338 req-4cb567ba-9c1e-4d0a-8340-e7cf8bc3a497 service nova] [instance: f1b1fc0f-1865-4020-91ee-25a5e16127cf] Received event network-changed-be523c77-4157-491b-be90-3b45d62b5523 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:54:04 user nova-compute[75176]: DEBUG nova.compute.manager [req-31a371c3-a99a-437d-bd85-cc8f56fc1338 req-4cb567ba-9c1e-4d0a-8340-e7cf8bc3a497 service nova] [instance: f1b1fc0f-1865-4020-91ee-25a5e16127cf] Refreshing instance network info cache due to event network-changed-be523c77-4157-491b-be90-3b45d62b5523. {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 15:54:04 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-31a371c3-a99a-437d-bd85-cc8f56fc1338 req-4cb567ba-9c1e-4d0a-8340-e7cf8bc3a497 service nova] Acquiring lock "refresh_cache-f1b1fc0f-1865-4020-91ee-25a5e16127cf" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:54:04 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:54:04 user nova-compute[75176]: DEBUG nova.network.neutron [None req-1b3ceb25-2589-4af3-a2d7-293e6b9ed349 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: f1b1fc0f-1865-4020-91ee-25a5e16127cf] Instance cache missing network info. {{(pid=75176) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 15:54:04 user nova-compute[75176]: DEBUG nova.network.neutron [None req-1b3ceb25-2589-4af3-a2d7-293e6b9ed349 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: f1b1fc0f-1865-4020-91ee-25a5e16127cf] Updating instance_info_cache with network_info: [{"id": "be523c77-4157-491b-be90-3b45d62b5523", "address": "fa:16:3e:4e:dd:53", "network": {"id": "5ec264ad-3459-468c-bdbf-c6a4ef016951", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1574289626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07c7783cc16049208421204910982c79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe523c77-41", "ovs_interfaceid": "be523c77-4157-491b-be90-3b45d62b5523", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:54:04 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-1b3ceb25-2589-4af3-a2d7-293e6b9ed349 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Releasing lock "refresh_cache-f1b1fc0f-1865-4020-91ee-25a5e16127cf" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:54:04 user nova-compute[75176]: DEBUG nova.compute.manager [None req-1b3ceb25-2589-4af3-a2d7-293e6b9ed349 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: f1b1fc0f-1865-4020-91ee-25a5e16127cf] Instance network_info: |[{"id": "be523c77-4157-491b-be90-3b45d62b5523", "address": "fa:16:3e:4e:dd:53", "network": {"id": "5ec264ad-3459-468c-bdbf-c6a4ef016951", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1574289626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07c7783cc16049208421204910982c79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe523c77-41", "ovs_interfaceid": "be523c77-4157-491b-be90-3b45d62b5523", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75176) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 15:54:04 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-31a371c3-a99a-437d-bd85-cc8f56fc1338 req-4cb567ba-9c1e-4d0a-8340-e7cf8bc3a497 service nova] Acquired lock "refresh_cache-f1b1fc0f-1865-4020-91ee-25a5e16127cf" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:54:04 user nova-compute[75176]: DEBUG nova.network.neutron [req-31a371c3-a99a-437d-bd85-cc8f56fc1338 req-4cb567ba-9c1e-4d0a-8340-e7cf8bc3a497 service nova] [instance: f1b1fc0f-1865-4020-91ee-25a5e16127cf] Refreshing network info cache for port be523c77-4157-491b-be90-3b45d62b5523 {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 15:54:05 user nova-compute[75176]: DEBUG nova.network.neutron [req-31a371c3-a99a-437d-bd85-cc8f56fc1338 req-4cb567ba-9c1e-4d0a-8340-e7cf8bc3a497 service nova] [instance: f1b1fc0f-1865-4020-91ee-25a5e16127cf] Updated VIF entry in instance network info cache for port be523c77-4157-491b-be90-3b45d62b5523. {{(pid=75176) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 15:54:05 user nova-compute[75176]: DEBUG nova.network.neutron [req-31a371c3-a99a-437d-bd85-cc8f56fc1338 req-4cb567ba-9c1e-4d0a-8340-e7cf8bc3a497 service nova] [instance: f1b1fc0f-1865-4020-91ee-25a5e16127cf] Updating instance_info_cache with network_info: [{"id": "be523c77-4157-491b-be90-3b45d62b5523", "address": "fa:16:3e:4e:dd:53", "network": {"id": "5ec264ad-3459-468c-bdbf-c6a4ef016951", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1574289626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07c7783cc16049208421204910982c79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe523c77-41", "ovs_interfaceid": "be523c77-4157-491b-be90-3b45d62b5523", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:54:05 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-31a371c3-a99a-437d-bd85-cc8f56fc1338 req-4cb567ba-9c1e-4d0a-8340-e7cf8bc3a497 service nova] Releasing lock "refresh_cache-f1b1fc0f-1865-4020-91ee-25a5e16127cf" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:54:06 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:54:06 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:54:06 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:54:06 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:54:06 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:54:06 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Auditing locally available compute resources for user (node: user) {{(pid=75176) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 15:54:06 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55febf04-14ea-4903-8692-c7cc6115de75/disk.rescue --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:54:07 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55febf04-14ea-4903-8692-c7cc6115de75/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:54:07 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55febf04-14ea-4903-8692-c7cc6115de75/disk.rescue --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:54:07 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55febf04-14ea-4903-8692-c7cc6115de75/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:54:07 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55febf04-14ea-4903-8692-c7cc6115de75/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:54:07 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55febf04-14ea-4903-8692-c7cc6115de75/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:54:07 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55febf04-14ea-4903-8692-c7cc6115de75/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:54:07 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55febf04-14ea-4903-8692-c7cc6115de75/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:54:07 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/193235b9-8ef5-41d0-a9ab-4f1679d30266/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:54:07 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/193235b9-8ef5-41d0-a9ab-4f1679d30266/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:54:07 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/193235b9-8ef5-41d0-a9ab-4f1679d30266/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:54:08 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/193235b9-8ef5-41d0-a9ab-4f1679d30266/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:54:08 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e8507b7-fccf-4196-b589-bf2b74f165ec/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:54:08 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e8507b7-fccf-4196-b589-bf2b74f165ec/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:54:08 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e8507b7-fccf-4196-b589-bf2b74f165ec/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:54:08 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e8507b7-fccf-4196-b589-bf2b74f165ec/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:54:08 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c154591-b130-4aa4-aad4-4c85324512df/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:54:08 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c154591-b130-4aa4-aad4-4c85324512df/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:54:08 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c154591-b130-4aa4-aad4-4c85324512df/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:54:08 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c154591-b130-4aa4-aad4-4c85324512df/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:54:08 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecabea76-6c29-412d-bf77-989917b449a9/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:54:09 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecabea76-6c29-412d-bf77-989917b449a9/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:54:09 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecabea76-6c29-412d-bf77-989917b449a9/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:54:09 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecabea76-6c29-412d-bf77-989917b449a9/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:54:09 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/742bfe1e-6885-4aba-9f7f-c07a5d904175/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:54:09 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/742bfe1e-6885-4aba-9f7f-c07a5d904175/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:54:09 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/742bfe1e-6885-4aba-9f7f-c07a5d904175/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:54:09 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:54:09 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/742bfe1e-6885-4aba-9f7f-c07a5d904175/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:54:09 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75176) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 15:54:09 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75176) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 15:54:09 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc4e6d39-adfb-4d26-afef-46f316ff7846/disk.rescue --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:54:09 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc4e6d39-adfb-4d26-afef-46f316ff7846/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:54:09 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc4e6d39-adfb-4d26-afef-46f316ff7846/disk.rescue --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:54:09 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc4e6d39-adfb-4d26-afef-46f316ff7846/disk.rescue --force-share --output=json" returned: 0 in 0.218s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:54:09 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66ead7d-98f4-4822-9dce-f2ea0206a58d/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:54:10 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66ead7d-98f4-4822-9dce-f2ea0206a58d/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:54:10 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66ead7d-98f4-4822-9dce-f2ea0206a58d/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:54:10 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66ead7d-98f4-4822-9dce-f2ea0206a58d/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:54:10 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7/disk.rescue --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:54:10 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:54:10 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7/disk.rescue --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:54:10 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:54:10 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:54:10 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:54:10 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:54:11 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:54:11 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:54:11 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 15:54:11 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 15:54:11 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Hypervisor/Node resource view: name=user free_ram=7322MB free_disk=25.072071075439453GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75176) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 15:54:11 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:54:11 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:54:11 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Applying migration context for instance 6161cab2-eb1f-44cb-bbd5-077e6db42f77 as it has an incoming, in-progress migration 23477e3c-9f13-4dc8-9ae1-cce32657b62b. Migration status is finished {{(pid=75176) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 28 15:54:11 user nova-compute[75176]: INFO nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] [instance: 6161cab2-eb1f-44cb-bbd5-077e6db42f77] Updating resource usage from migration 23477e3c-9f13-4dc8-9ae1-cce32657b62b
Nov 28 15:54:11 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance 2e8507b7-fccf-4196-b589-bf2b74f165ec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:54:11 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance f66ead7d-98f4-4822-9dce-f2ea0206a58d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:54:11 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance 55febf04-14ea-4903-8692-c7cc6115de75 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:54:11 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance 8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:54:11 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance dc4e6d39-adfb-4d26-afef-46f316ff7846 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:54:11 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Migration 23477e3c-9f13-4dc8-9ae1-cce32657b62b is active on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 28 15:54:11 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance 6161cab2-eb1f-44cb-bbd5-077e6db42f77 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:54:11 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance 742bfe1e-6885-4aba-9f7f-c07a5d904175 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:54:11 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance 193235b9-8ef5-41d0-a9ab-4f1679d30266 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:54:11 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance ecabea76-6c29-412d-bf77-989917b449a9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:54:11 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance 2c154591-b130-4aa4-aad4-4c85324512df actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:54:11 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance f1b1fc0f-1865-4020-91ee-25a5e16127cf actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:54:11 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75176) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 15:54:11 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75176) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 15:54:12 user nova-compute[75176]: DEBUG nova.compute.provider_tree [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Inventory has not changed in ProviderTree for provider: b37848d8-f401-4155-a029-b0ffa09ff85b {{(pid=75176) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 15:54:12 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Inventory has not changed for provider b37848d8-f401-4155-a029-b0ffa09ff85b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75176) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 15:54:12 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Compute_service record updated for user:user {{(pid=75176) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 15:54:12 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.663s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:54:13 user nova-compute[75176]: DEBUG nova.compute.manager [None req-1b3ceb25-2589-4af3-a2d7-293e6b9ed349 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: f1b1fc0f-1865-4020-91ee-25a5e16127cf] Start spawning the instance on the hypervisor. {{(pid=75176) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 15:54:13 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-1b3ceb25-2589-4af3-a2d7-293e6b9ed349 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: f1b1fc0f-1865-4020-91ee-25a5e16127cf] Creating instance directory {{(pid=75176) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 15:54:13 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-1b3ceb25-2589-4af3-a2d7-293e6b9ed349 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: f1b1fc0f-1865-4020-91ee-25a5e16127cf] Creating image(s)
Nov 28 15:54:13 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-1b3ceb25-2589-4af3-a2d7-293e6b9ed349 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: f1b1fc0f-1865-4020-91ee-25a5e16127cf] Did not create local disks {{(pid=75176) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 28 15:54:13 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-1b3ceb25-2589-4af3-a2d7-293e6b9ed349 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: f1b1fc0f-1865-4020-91ee-25a5e16127cf] Ensure instance console log exists: /opt/stack/data/nova/instances/f1b1fc0f-1865-4020-91ee-25a5e16127cf/console.log {{(pid=75176) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 15:54:13 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-1b3ceb25-2589-4af3-a2d7-293e6b9ed349 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:54:13 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-1b3ceb25-2589-4af3-a2d7-293e6b9ed349 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:54:13 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-1b3ceb25-2589-4af3-a2d7-293e6b9ed349 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:54:13 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-1b3ceb25-2589-4af3-a2d7-293e6b9ed349 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: f1b1fc0f-1865-4020-91ee-25a5e16127cf] Start _get_guest_xml network_info=[{"id": "be523c77-4157-491b-be90-3b45d62b5523", "address": "fa:16:3e:4e:dd:53", "network": {"id": "5ec264ad-3459-468c-bdbf-c6a4ef016951", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1574289626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07c7783cc16049208421204910982c79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe523c77-41", "ovs_interfaceid": "be523c77-4157-491b-be90-3b45d62b5523", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tspqduOv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f1b1fc0f-1865-4020-91ee-25a5e16127cf', 'attached_at': '', 'detached_at': '', 'volume_id': '2389818d-1c3f-46d9-a70a-1330da1b94e0', 'serial': '2389818d-1c3f-46d9-a70a-1330da1b94e0'}, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'delete_on_termination': False, 'mount_device': '/dev/vda', 'attachment_id': 'f374fed5-c765-4d04-a5d5-f8ef61da0154', 'volume_type': None} {{(pid=75176) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 15:54:13 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-1b3ceb25-2589-4af3-a2d7-293e6b9ed349 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 15:54:13 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-1b3ceb25-2589-4af3-a2d7-293e6b9ed349 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 15:54:13 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-1b3ceb25-2589-4af3-a2d7-293e6b9ed349 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75176) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 15:54:13 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-1b3ceb25-2589-4af3-a2d7-293e6b9ed349 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] CPU controller missing on host. {{(pid=75176) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 15:54:13 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-1b3ceb25-2589-4af3-a2d7-293e6b9ed349 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75176) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 15:54:13 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-1b3ceb25-2589-4af3-a2d7-293e6b9ed349 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] CPU controller found on host. {{(pid=75176) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 15:54:13 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-1b3ceb25-2589-4af3-a2d7-293e6b9ed349 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75176) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 15:54:13 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-1b3ceb25-2589-4af3-a2d7-293e6b9ed349 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T15:35:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 15:54:13 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-1b3ceb25-2589-4af3-a2d7-293e6b9ed349 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Flavor limits 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 15:54:13 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-1b3ceb25-2589-4af3-a2d7-293e6b9ed349 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Image limits 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 15:54:13 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-1b3ceb25-2589-4af3-a2d7-293e6b9ed349 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Flavor pref 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 15:54:13 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-1b3ceb25-2589-4af3-a2d7-293e6b9ed349 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Image pref 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 15:54:13 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-1b3ceb25-2589-4af3-a2d7-293e6b9ed349 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 15:54:13 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-1b3ceb25-2589-4af3-a2d7-293e6b9ed349 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 15:54:13 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-1b3ceb25-2589-4af3-a2d7-293e6b9ed349 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75176) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 15:54:13 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-1b3ceb25-2589-4af3-a2d7-293e6b9ed349 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Got 1 possible topologies {{(pid=75176) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 15:54:13 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-1b3ceb25-2589-4af3-a2d7-293e6b9ed349 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 15:54:13 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-1b3ceb25-2589-4af3-a2d7-293e6b9ed349 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 15:54:13 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1b3ceb25-2589-4af3-a2d7-293e6b9ed349 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: f1b1fc0f-1865-4020-91ee-25a5e16127cf] Calling os-brick to attach iSCSI Volume {{(pid=75176) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 15:54:13 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b3ceb25-2589-4af3-a2d7-293e6b9ed349 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c1b8a00>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tspqduOv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 15:54:13 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-1b3ceb25-2589-4af3-a2d7-293e6b9ed349 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 15:54:13 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-1b3ceb25-2589-4af3-a2d7-293e6b9ed349 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 15:54:13 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-1b3ceb25-2589-4af3-a2d7-293e6b9ed349 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 15:54:13 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-1b3ceb25-2589-4af3-a2d7-293e6b9ed349 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 15:54:13 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-1b3ceb25-2589-4af3-a2d7-293e6b9ed349 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 15:54:13 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-1b3ceb25-2589-4af3-a2d7-293e6b9ed349 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 15:54:13 user nova-compute[75176]: INFO os_brick.initiator.connectors.iscsi [None req-1b3ceb25-2589-4af3-a2d7-293e6b9ed349 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 15:54:13 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0 -p 172.16.0.220:3260 {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:54:13 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:54:13 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[068b2bed-e619-4b0b-ad08-c834e1787c6f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:54:13 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b3ceb25-2589-4af3-a2d7-293e6b9ed349 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 15:54:13 user nova-compute[75176]:  {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:54:13 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0 -p 172.16.0.220:3260 --interface default --op new {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:54:13 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:54:13 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[113c8531-f471-45a3-b40b-36015aee667c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0] added\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:54:13 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b3ceb25-2589-4af3-a2d7-293e6b9ed349 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0] added
Nov 28 15:54:13 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:54:13 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:54:13 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:54:13 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[1825a137-a465-41a3-b2cb-946f48f7cb1c]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:54:13 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b3ceb25-2589-4af3-a2d7-293e6b9ed349 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:54:13 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:54:13 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:54:13 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f354d85-77f3-4e7b-82a0-0469a20e77ed]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:54:13 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b3ceb25-2589-4af3-a2d7-293e6b9ed349 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:54:13 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tspqduOv {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:54:13 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tspqduOv" returned: 0 in 0.017s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:54:13 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[107e57c2-a712-48ff-aa6a-dbe3ce2503af]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:54:13 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b3ceb25-2589-4af3-a2d7-293e6b9ed349 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tspqduOv'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:54:13 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:54:13 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:54:13 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[40a9fbfa-5e65-461f-ae13-ad87f42a1ca1]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:54:13 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b3ceb25-2589-4af3-a2d7-293e6b9ed349 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:54:13 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:54:13 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:54:13 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[73656f3e-64e0-4e32-aabc-83744ff46aac]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc (non-flash)\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:54:13 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b3ceb25-2589-4af3-a2d7-293e6b9ed349 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 (non-flash)
Nov 28 15:54:13 user nova-compute[75176]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc (non-flash)
Nov 28 15:54:13 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:54:13 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b3ceb25-2589-4af3-a2d7-293e6b9ed349 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 (non-flash)
Nov 28 15:54:13 user nova-compute[75176]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc (non-flash)
Nov 28 15:54:13 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 15:54:13 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0 -p 172.16.0.220:3260 --login {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:54:13 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:54:13 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cdae64e-ae99-4bc9-ae3d-6b7d936fe5c7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:54:13 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b3ceb25-2589-4af3-a2d7-293e6b9ed349 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0, portal: 172.16.0.220,3260]
Nov 28 15:54:13 user nova-compute[75176]: Login to [iface: default, target: iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0, portal: 172.16.0.220,3260] successful.
Nov 28 15:54:13 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:54:13 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:54:13 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:54:13 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ad9cfbe-10e9-41ea-a9b7-02674e69c4ca]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:54:13 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b3ceb25-2589-4af3-a2d7-293e6b9ed349 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:54:13 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:54:13 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:54:13 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[955d8cee-9941-4501-ac0d-5c2d69a11da9]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0 (non-flash)\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:54:13 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b3ceb25-2589-4af3-a2d7-293e6b9ed349 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 (non-flash)
Nov 28 15:54:13 user nova-compute[75176]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc (non-flash)
Nov 28 15:54:13 user nova-compute[75176]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0 (non-flash)
Nov 28 15:54:13 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:54:13 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b3ceb25-2589-4af3-a2d7-293e6b9ed349 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 (non-flash)
Nov 28 15:54:13 user nova-compute[75176]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc (non-flash)
Nov 28 15:54:13 user nova-compute[75176]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0 (non-flash)
Nov 28 15:54:13 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 15:54:13 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-1b3ceb25-2589-4af3-a2d7-293e6b9ed349 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.262s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 15:54:13 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b3ceb25-2589-4af3-a2d7-293e6b9ed349 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Connected to 172.16.0.220:3260 {{(pid=75176) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 15:54:13 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-1b3ceb25-2589-4af3-a2d7-293e6b9ed349 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] HCTL ('33', '-', '-', 0) found on session 42 with lun 0 {{(pid=75176) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 15:54:13 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-1b3ceb25-2589-4af3-a2d7-293e6b9ed349 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75176) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 15:54:13 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:54:13 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:54:13 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5373b33-5c07-4d7d-96a7-62c22bf95040]: (4, ('- - 0', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:54:13 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-1b3ceb25-2589-4af3-a2d7-293e6b9ed349 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Searching for a device in session 42 and hctl ['33', '*', '*', 0] yield: None {{(pid=75176) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 15:54:14 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-1b3ceb25-2589-4af3-a2d7-293e6b9ed349 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Searching for a device in session 42 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75176) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 15:54:14 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b3ceb25-2589-4af3-a2d7-293e6b9ed349 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tspqduOv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75176) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 15:54:14 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-1b3ceb25-2589-4af3-a2d7-293e6b9ed349 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.293s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 15:54:14 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b3ceb25-2589-4af3-a2d7-293e6b9ed349 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] <== connect_volume: return (1295ms) {'type': 'block', 'scsi_wwn': '23439633632613235', 'path': '/dev/sdb'} {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 15:54:14 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1b3ceb25-2589-4af3-a2d7-293e6b9ed349 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: f1b1fc0f-1865-4020-91ee-25a5e16127cf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23439633632613235', 'path': '/dev/sdb'} {{(pid=75176) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 15:54:14 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-1b3ceb25-2589-4af3-a2d7-293e6b9ed349 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T15:54:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1219018675',display_name='tempest-TestVolumeBootPattern-server-1219018675',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1219018675',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAT4j4MwMCXcgxPv2ypvh6Le18WUkR/7PQX0ERUSwv8uiHb35AkMlGdcRbKgULWyfAemfpuoTAyzTZycSyQIMMK+kqb2pUHOOT/5otX0G6BKfJMaYPfRy2E0NOlU0WUh/Q==',key_name='tempest-TestVolumeBootPattern-94664483',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='07c7783cc16049208421204910982c79',ramdisk_id='',reservation_id='r-57eqnllg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1695196118',owner_user_name='tempest-TestVolumeBootPattern-1695196118-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T15:54:03Z,user_data=None,user_id='081bf84d24194b81be4e0a6638db9b66',uuid=f1b1fc0f-1865-4020-91ee-25a5e16127cf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "be523c77-4157-491b-be90-3b45d62b5523", "address": "fa:16:3e:4e:dd:53", "network": {"id": "5ec264ad-3459-468c-bdbf-c6a4ef016951", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1574289626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07c7783cc16049208421204910982c79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe523c77-41", "ovs_interfaceid": "be523c77-4157-491b-be90-3b45d62b5523", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75176) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 15:54:14 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-1b3ceb25-2589-4af3-a2d7-293e6b9ed349 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Converting VIF {"id": "be523c77-4157-491b-be90-3b45d62b5523", "address": "fa:16:3e:4e:dd:53", "network": {"id": "5ec264ad-3459-468c-bdbf-c6a4ef016951", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1574289626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07c7783cc16049208421204910982c79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe523c77-41", "ovs_interfaceid": "be523c77-4157-491b-be90-3b45d62b5523", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:54:14 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-1b3ceb25-2589-4af3-a2d7-293e6b9ed349 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:dd:53,bridge_name='br-int',has_traffic_filtering=True,id=be523c77-4157-491b-be90-3b45d62b5523,network=Network(5ec264ad-3459-468c-bdbf-c6a4ef016951),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe523c77-41') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:54:14 user nova-compute[75176]: DEBUG nova.objects.instance [None req-1b3ceb25-2589-4af3-a2d7-293e6b9ed349 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Lazy-loading 'pci_devices' on Instance uuid f1b1fc0f-1865-4020-91ee-25a5e16127cf {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:54:14 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-1b3ceb25-2589-4af3-a2d7-293e6b9ed349 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: f1b1fc0f-1865-4020-91ee-25a5e16127cf] End _get_guest_xml xml=<domain type="kvm">
Nov 28 15:54:14 user nova-compute[75176]:   <uuid>f1b1fc0f-1865-4020-91ee-25a5e16127cf</uuid>
Nov 28 15:54:14 user nova-compute[75176]:   <name>instance-00000028</name>
Nov 28 15:54:14 user nova-compute[75176]:   <memory>524288</memory>
Nov 28 15:54:14 user nova-compute[75176]:   <vcpu>1</vcpu>
Nov 28 15:54:14 user nova-compute[75176]:   <metadata>
Nov 28 15:54:14 user nova-compute[75176]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 15:54:14 user nova-compute[75176]:       <nova:package version="0.0.0"/>
Nov 28 15:54:14 user nova-compute[75176]:       <nova:name>tempest-TestVolumeBootPattern-server-1219018675</nova:name>
Nov 28 15:54:14 user nova-compute[75176]:       <nova:creationTime>2023-11-28 15:54:13</nova:creationTime>
Nov 28 15:54:14 user nova-compute[75176]:       <nova:flavor name="m1.tiny">
Nov 28 15:54:14 user nova-compute[75176]:         <nova:memory>512</nova:memory>
Nov 28 15:54:14 user nova-compute[75176]:         <nova:disk>1</nova:disk>
Nov 28 15:54:14 user nova-compute[75176]:         <nova:swap>0</nova:swap>
Nov 28 15:54:14 user nova-compute[75176]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 15:54:14 user nova-compute[75176]:         <nova:vcpus>1</nova:vcpus>
Nov 28 15:54:14 user nova-compute[75176]:       </nova:flavor>
Nov 28 15:54:14 user nova-compute[75176]:       <nova:owner>
Nov 28 15:54:14 user nova-compute[75176]:         <nova:user uuid="081bf84d24194b81be4e0a6638db9b66">tempest-TestVolumeBootPattern-1695196118-project-member</nova:user>
Nov 28 15:54:14 user nova-compute[75176]:         <nova:project uuid="07c7783cc16049208421204910982c79">tempest-TestVolumeBootPattern-1695196118</nova:project>
Nov 28 15:54:14 user nova-compute[75176]:       </nova:owner>
Nov 28 15:54:14 user nova-compute[75176]:       <nova:ports>
Nov 28 15:54:14 user nova-compute[75176]:         <nova:port uuid="be523c77-4157-491b-be90-3b45d62b5523">
Nov 28 15:54:14 user nova-compute[75176]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 28 15:54:14 user nova-compute[75176]:         </nova:port>
Nov 28 15:54:14 user nova-compute[75176]:       </nova:ports>
Nov 28 15:54:14 user nova-compute[75176]:     </nova:instance>
Nov 28 15:54:14 user nova-compute[75176]:   </metadata>
Nov 28 15:54:14 user nova-compute[75176]:   <sysinfo type="smbios">
Nov 28 15:54:14 user nova-compute[75176]:     <system>
Nov 28 15:54:14 user nova-compute[75176]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 15:54:14 user nova-compute[75176]:       <entry name="product">OpenStack Nova</entry>
Nov 28 15:54:14 user nova-compute[75176]:       <entry name="version">0.0.0</entry>
Nov 28 15:54:14 user nova-compute[75176]:       <entry name="serial">f1b1fc0f-1865-4020-91ee-25a5e16127cf</entry>
Nov 28 15:54:14 user nova-compute[75176]:       <entry name="uuid">f1b1fc0f-1865-4020-91ee-25a5e16127cf</entry>
Nov 28 15:54:14 user nova-compute[75176]:       <entry name="family">Virtual Machine</entry>
Nov 28 15:54:14 user nova-compute[75176]:     </system>
Nov 28 15:54:14 user nova-compute[75176]:   </sysinfo>
Nov 28 15:54:14 user nova-compute[75176]:   <os>
Nov 28 15:54:14 user nova-compute[75176]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 15:54:14 user nova-compute[75176]:     <boot dev="hd"/>
Nov 28 15:54:14 user nova-compute[75176]:     <smbios mode="sysinfo"/>
Nov 28 15:54:14 user nova-compute[75176]:   </os>
Nov 28 15:54:14 user nova-compute[75176]:   <features>
Nov 28 15:54:14 user nova-compute[75176]:     <acpi/>
Nov 28 15:54:14 user nova-compute[75176]:     <apic/>
Nov 28 15:54:14 user nova-compute[75176]:     <vmcoreinfo/>
Nov 28 15:54:14 user nova-compute[75176]:   </features>
Nov 28 15:54:14 user nova-compute[75176]:   <clock offset="utc">
Nov 28 15:54:14 user nova-compute[75176]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 15:54:14 user nova-compute[75176]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 15:54:14 user nova-compute[75176]:     <timer name="hpet" present="no"/>
Nov 28 15:54:14 user nova-compute[75176]:   </clock>
Nov 28 15:54:14 user nova-compute[75176]:   <cpu mode="custom" match="exact">
Nov 28 15:54:14 user nova-compute[75176]:     <model>Nehalem</model>
Nov 28 15:54:14 user nova-compute[75176]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 15:54:14 user nova-compute[75176]:   </cpu>
Nov 28 15:54:14 user nova-compute[75176]:   <devices>
Nov 28 15:54:14 user nova-compute[75176]:     <disk type="block" device="disk">
Nov 28 15:54:14 user nova-compute[75176]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 15:54:14 user nova-compute[75176]:       <source dev="/dev/sdb"/>
Nov 28 15:54:14 user nova-compute[75176]:       <target dev="vda" bus="virtio"/>
Nov 28 15:54:14 user nova-compute[75176]:       <serial>2389818d-1c3f-46d9-a70a-1330da1b94e0</serial>
Nov 28 15:54:14 user nova-compute[75176]:     </disk>
Nov 28 15:54:14 user nova-compute[75176]:     <interface type="ethernet">
Nov 28 15:54:14 user nova-compute[75176]:       <mac address="fa:16:3e:4e:dd:53"/>
Nov 28 15:54:14 user nova-compute[75176]:       <model type="virtio"/>
Nov 28 15:54:14 user nova-compute[75176]:       <mtu size="1442"/>
Nov 28 15:54:14 user nova-compute[75176]:       <target dev="tapbe523c77-41"/>
Nov 28 15:54:14 user nova-compute[75176]:     </interface>
Nov 28 15:54:14 user nova-compute[75176]:     <serial type="pty">
Nov 28 15:54:14 user nova-compute[75176]:       <log file="/opt/stack/data/nova/instances/f1b1fc0f-1865-4020-91ee-25a5e16127cf/console.log" append="off"/>
Nov 28 15:54:14 user nova-compute[75176]:     </serial>
Nov 28 15:54:14 user nova-compute[75176]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 15:54:14 user nova-compute[75176]:     <video>
Nov 28 15:54:14 user nova-compute[75176]:       <model type="virtio"/>
Nov 28 15:54:14 user nova-compute[75176]:     </video>
Nov 28 15:54:14 user nova-compute[75176]:     <rng model="virtio">
Nov 28 15:54:14 user nova-compute[75176]:       <backend model="random">/dev/urandom</backend>
Nov 28 15:54:14 user nova-compute[75176]:     </rng>
Nov 28 15:54:14 user nova-compute[75176]:     <controller type="usb" index="0" model="none"/>
Nov 28 15:54:14 user nova-compute[75176]:     <memballoon model="virtio">
Nov 28 15:54:14 user nova-compute[75176]:       <stats period="10"/>
Nov 28 15:54:14 user nova-compute[75176]:     </memballoon>
Nov 28 15:54:14 user nova-compute[75176]:   </devices>
Nov 28 15:54:14 user nova-compute[75176]: </domain>
Nov 28 15:54:14 user nova-compute[75176]:  {{(pid=75176) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 15:54:14 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-1b3ceb25-2589-4af3-a2d7-293e6b9ed349 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T15:54:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1219018675',display_name='tempest-TestVolumeBootPattern-server-1219018675',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1219018675',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAT4j4MwMCXcgxPv2ypvh6Le18WUkR/7PQX0ERUSwv8uiHb35AkMlGdcRbKgULWyfAemfpuoTAyzTZycSyQIMMK+kqb2pUHOOT/5otX0G6BKfJMaYPfRy2E0NOlU0WUh/Q==',key_name='tempest-TestVolumeBootPattern-94664483',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='07c7783cc16049208421204910982c79',ramdisk_id='',reservation_id='r-57eqnllg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1695196118',owner_user_name='tempest-TestVolumeBootPattern-1695196118-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T15:54:03Z,user_data=None,user_id='081bf84d24194b81be4e0a6638db9b66',uuid=f1b1fc0f-1865-4020-91ee-25a5e16127cf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "be523c77-4157-491b-be90-3b45d62b5523", "address": "fa:16:3e:4e:dd:53", "network": {"id": "5ec264ad-3459-468c-bdbf-c6a4ef016951", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1574289626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07c7783cc16049208421204910982c79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe523c77-41", "ovs_interfaceid": "be523c77-4157-491b-be90-3b45d62b5523", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 15:54:14 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-1b3ceb25-2589-4af3-a2d7-293e6b9ed349 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Converting VIF {"id": "be523c77-4157-491b-be90-3b45d62b5523", "address": "fa:16:3e:4e:dd:53", "network": {"id": "5ec264ad-3459-468c-bdbf-c6a4ef016951", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1574289626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07c7783cc16049208421204910982c79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe523c77-41", "ovs_interfaceid": "be523c77-4157-491b-be90-3b45d62b5523", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:54:14 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-1b3ceb25-2589-4af3-a2d7-293e6b9ed349 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:dd:53,bridge_name='br-int',has_traffic_filtering=True,id=be523c77-4157-491b-be90-3b45d62b5523,network=Network(5ec264ad-3459-468c-bdbf-c6a4ef016951),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe523c77-41') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:54:14 user nova-compute[75176]: DEBUG os_vif [None req-1b3ceb25-2589-4af3-a2d7-293e6b9ed349 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:dd:53,bridge_name='br-int',has_traffic_filtering=True,id=be523c77-4157-491b-be90-3b45d62b5523,network=Network(5ec264ad-3459-468c-bdbf-c6a4ef016951),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe523c77-41') {{(pid=75176) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 15:54:14 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:54:14 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:54:14 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 15:54:14 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:54:14 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7f4a1848-a490-5a35-a41e-6f90e00678be', '_type': 'linux-noop'}}, row=False) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:54:14 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:54:14 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:54:14 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:54:14 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbe523c77-41, may_exist=True, interface_attrs={}) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:54:14 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbe523c77-41, col_values=(('qos', UUID('738473f3-7aed-4f69-8008-b6a42add6d7e')),), if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:54:14 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbe523c77-41, col_values=(('external_ids', {'iface-id': 'be523c77-4157-491b-be90-3b45d62b5523', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4e:dd:53', 'vm-uuid': 'f1b1fc0f-1865-4020-91ee-25a5e16127cf'}),), if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:54:14 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:54:14 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:54:14 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:54:14 user nova-compute[75176]: INFO os_vif [None req-1b3ceb25-2589-4af3-a2d7-293e6b9ed349 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:dd:53,bridge_name='br-int',has_traffic_filtering=True,id=be523c77-4157-491b-be90-3b45d62b5523,network=Network(5ec264ad-3459-468c-bdbf-c6a4ef016951),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe523c77-41')
Nov 28 15:54:14 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:54:14 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-1b3ceb25-2589-4af3-a2d7-293e6b9ed349 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] No BDM found with device name vda, not building metadata. {{(pid=75176) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 15:54:14 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-1b3ceb25-2589-4af3-a2d7-293e6b9ed349 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] No VIF found with MAC fa:16:3e:4e:dd:53, not building metadata {{(pid=75176) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 15:54:15 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:54:15 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:54:15 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:54:15 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:54:15 user nova-compute[75176]: DEBUG nova.compute.manager [req-65e29255-dc20-4eb6-b6b4-e2ea094e0539 req-46c93978-4ac5-491c-89aa-21b79a9d36b7 service nova] [instance: f1b1fc0f-1865-4020-91ee-25a5e16127cf] Received event network-vif-plugged-be523c77-4157-491b-be90-3b45d62b5523 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:54:15 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-65e29255-dc20-4eb6-b6b4-e2ea094e0539 req-46c93978-4ac5-491c-89aa-21b79a9d36b7 service nova] Acquiring lock "f1b1fc0f-1865-4020-91ee-25a5e16127cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:54:15 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-65e29255-dc20-4eb6-b6b4-e2ea094e0539 req-46c93978-4ac5-491c-89aa-21b79a9d36b7 service nova] Lock "f1b1fc0f-1865-4020-91ee-25a5e16127cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:54:15 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-65e29255-dc20-4eb6-b6b4-e2ea094e0539 req-46c93978-4ac5-491c-89aa-21b79a9d36b7 service nova] Lock "f1b1fc0f-1865-4020-91ee-25a5e16127cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:54:15 user nova-compute[75176]: DEBUG nova.compute.manager [req-65e29255-dc20-4eb6-b6b4-e2ea094e0539 req-46c93978-4ac5-491c-89aa-21b79a9d36b7 service nova] [instance: f1b1fc0f-1865-4020-91ee-25a5e16127cf] No waiting events found dispatching network-vif-plugged-be523c77-4157-491b-be90-3b45d62b5523 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:54:15 user nova-compute[75176]: WARNING nova.compute.manager [req-65e29255-dc20-4eb6-b6b4-e2ea094e0539 req-46c93978-4ac5-491c-89aa-21b79a9d36b7 service nova] [instance: f1b1fc0f-1865-4020-91ee-25a5e16127cf] Received unexpected event network-vif-plugged-be523c77-4157-491b-be90-3b45d62b5523 for instance with vm_state building and task_state spawning.
Nov 28 15:54:16 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:54:16 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:54:16 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:54:17 user nova-compute[75176]: DEBUG nova.compute.manager [None req-1b3ceb25-2589-4af3-a2d7-293e6b9ed349 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: f1b1fc0f-1865-4020-91ee-25a5e16127cf] Instance event wait completed in 0 seconds for  {{(pid=75176) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 15:54:17 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-1b3ceb25-2589-4af3-a2d7-293e6b9ed349 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: f1b1fc0f-1865-4020-91ee-25a5e16127cf] Guest created on hypervisor {{(pid=75176) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 15:54:17 user nova-compute[75176]: INFO nova.virt.libvirt.driver [-] [instance: f1b1fc0f-1865-4020-91ee-25a5e16127cf] Instance spawned successfully.
Nov 28 15:54:17 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-1b3ceb25-2589-4af3-a2d7-293e6b9ed349 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: f1b1fc0f-1865-4020-91ee-25a5e16127cf] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 15:54:18 user nova-compute[75176]: DEBUG nova.compute.manager [req-50903e7a-9570-4169-a46a-2957f1be576f req-faf43bff-fbb1-4b05-8840-d66e188f2271 service nova] [instance: f1b1fc0f-1865-4020-91ee-25a5e16127cf] Received event network-vif-plugged-be523c77-4157-491b-be90-3b45d62b5523 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:54:18 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-50903e7a-9570-4169-a46a-2957f1be576f req-faf43bff-fbb1-4b05-8840-d66e188f2271 service nova] Acquiring lock "f1b1fc0f-1865-4020-91ee-25a5e16127cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:54:18 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-50903e7a-9570-4169-a46a-2957f1be576f req-faf43bff-fbb1-4b05-8840-d66e188f2271 service nova] Lock "f1b1fc0f-1865-4020-91ee-25a5e16127cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:54:18 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-50903e7a-9570-4169-a46a-2957f1be576f req-faf43bff-fbb1-4b05-8840-d66e188f2271 service nova] Lock "f1b1fc0f-1865-4020-91ee-25a5e16127cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:54:18 user nova-compute[75176]: DEBUG nova.compute.manager [req-50903e7a-9570-4169-a46a-2957f1be576f req-faf43bff-fbb1-4b05-8840-d66e188f2271 service nova] [instance: f1b1fc0f-1865-4020-91ee-25a5e16127cf] No waiting events found dispatching network-vif-plugged-be523c77-4157-491b-be90-3b45d62b5523 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:54:18 user nova-compute[75176]: WARNING nova.compute.manager [req-50903e7a-9570-4169-a46a-2957f1be576f req-faf43bff-fbb1-4b05-8840-d66e188f2271 service nova] [instance: f1b1fc0f-1865-4020-91ee-25a5e16127cf] Received unexpected event network-vif-plugged-be523c77-4157-491b-be90-3b45d62b5523 for instance with vm_state building and task_state spawning.
Nov 28 15:54:18 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-1b3ceb25-2589-4af3-a2d7-293e6b9ed349 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: f1b1fc0f-1865-4020-91ee-25a5e16127cf] Found default for hw_cdrom_bus of ide {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:54:18 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-1b3ceb25-2589-4af3-a2d7-293e6b9ed349 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: f1b1fc0f-1865-4020-91ee-25a5e16127cf] Found default for hw_disk_bus of virtio {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:54:18 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-1b3ceb25-2589-4af3-a2d7-293e6b9ed349 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: f1b1fc0f-1865-4020-91ee-25a5e16127cf] Found default for hw_input_bus of None {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:54:18 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-1b3ceb25-2589-4af3-a2d7-293e6b9ed349 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: f1b1fc0f-1865-4020-91ee-25a5e16127cf] Found default for hw_pointer_model of None {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:54:18 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-1b3ceb25-2589-4af3-a2d7-293e6b9ed349 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: f1b1fc0f-1865-4020-91ee-25a5e16127cf] Found default for hw_video_model of virtio {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:54:18 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-1b3ceb25-2589-4af3-a2d7-293e6b9ed349 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: f1b1fc0f-1865-4020-91ee-25a5e16127cf] Found default for hw_vif_model of virtio {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:54:18 user nova-compute[75176]: INFO nova.compute.manager [None req-1b3ceb25-2589-4af3-a2d7-293e6b9ed349 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: f1b1fc0f-1865-4020-91ee-25a5e16127cf] Took 5.13 seconds to spawn the instance on the hypervisor.
Nov 28 15:54:18 user nova-compute[75176]: DEBUG nova.compute.manager [None req-1b3ceb25-2589-4af3-a2d7-293e6b9ed349 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: f1b1fc0f-1865-4020-91ee-25a5e16127cf] Checking state {{(pid=75176) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 15:54:18 user nova-compute[75176]: INFO nova.compute.manager [None req-1b3ceb25-2589-4af3-a2d7-293e6b9ed349 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: f1b1fc0f-1865-4020-91ee-25a5e16127cf] Took 16.55 seconds to build instance.
Nov 28 15:54:18 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-1b3ceb25-2589-4af3-a2d7-293e6b9ed349 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Lock "f1b1fc0f-1865-4020-91ee-25a5e16127cf" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.701s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:54:19 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:54:19 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:54:22 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-4bdf82ab-d0e5-4c5f-ab31-1d0aebf65fc7 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Acquiring lock "6161cab2-eb1f-44cb-bbd5-077e6db42f77" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:54:22 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-4bdf82ab-d0e5-4c5f-ab31-1d0aebf65fc7 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Lock "6161cab2-eb1f-44cb-bbd5-077e6db42f77" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:54:22 user nova-compute[75176]: DEBUG nova.compute.manager [None req-4bdf82ab-d0e5-4c5f-ab31-1d0aebf65fc7 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] [instance: 6161cab2-eb1f-44cb-bbd5-077e6db42f77] Going to confirm migration 2 {{(pid=75176) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4774}}
Nov 28 15:54:23 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-4bdf82ab-d0e5-4c5f-ab31-1d0aebf65fc7 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Acquiring lock "refresh_cache-6161cab2-eb1f-44cb-bbd5-077e6db42f77" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:54:23 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-4bdf82ab-d0e5-4c5f-ab31-1d0aebf65fc7 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Acquired lock "refresh_cache-6161cab2-eb1f-44cb-bbd5-077e6db42f77" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:54:23 user nova-compute[75176]: DEBUG nova.network.neutron [None req-4bdf82ab-d0e5-4c5f-ab31-1d0aebf65fc7 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] [instance: 6161cab2-eb1f-44cb-bbd5-077e6db42f77] Building network info cache for instance {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 15:54:23 user nova-compute[75176]: DEBUG nova.objects.instance [None req-4bdf82ab-d0e5-4c5f-ab31-1d0aebf65fc7 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Lazy-loading 'info_cache' on Instance uuid 6161cab2-eb1f-44cb-bbd5-077e6db42f77 {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:54:23 user nova-compute[75176]: DEBUG nova.network.neutron [None req-4bdf82ab-d0e5-4c5f-ab31-1d0aebf65fc7 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] [instance: 6161cab2-eb1f-44cb-bbd5-077e6db42f77] Updating instance_info_cache with network_info: [{"id": "f2811544-4cf2-4302-b012-8bf1881b9b6c", "address": "fa:16:3e:2a:df:42", "network": {"id": "8b63f2d3-0683-4832-abc5-e4c796cf12ab", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-877608435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3704b38a2bd44cb78c28d3f6d86d9e60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2811544-4c", "ovs_interfaceid": "f2811544-4cf2-4302-b012-8bf1881b9b6c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:54:23 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-4bdf82ab-d0e5-4c5f-ab31-1d0aebf65fc7 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Releasing lock "refresh_cache-6161cab2-eb1f-44cb-bbd5-077e6db42f77" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:54:23 user nova-compute[75176]: DEBUG nova.objects.instance [None req-4bdf82ab-d0e5-4c5f-ab31-1d0aebf65fc7 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Lazy-loading 'migration_context' on Instance uuid 6161cab2-eb1f-44cb-bbd5-077e6db42f77 {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:54:23 user nova-compute[75176]: DEBUG nova.objects.base [None req-4bdf82ab-d0e5-4c5f-ab31-1d0aebf65fc7 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Object Instance<6161cab2-eb1f-44cb-bbd5-077e6db42f77> lazy-loaded attributes: info_cache,migration_context {{(pid=75176) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 15:54:23 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-4bdf82ab-d0e5-4c5f-ab31-1d0aebf65fc7 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:54:23 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-4bdf82ab-d0e5-4c5f-ab31-1d0aebf65fc7 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:54:24 user nova-compute[75176]: DEBUG nova.compute.provider_tree [None req-4bdf82ab-d0e5-4c5f-ab31-1d0aebf65fc7 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Inventory has not changed in ProviderTree for provider: b37848d8-f401-4155-a029-b0ffa09ff85b {{(pid=75176) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 15:54:24 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-4bdf82ab-d0e5-4c5f-ab31-1d0aebf65fc7 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Inventory has not changed for provider b37848d8-f401-4155-a029-b0ffa09ff85b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75176) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 15:54:24 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-4bdf82ab-d0e5-4c5f-ab31-1d0aebf65fc7 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.524s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:54:24 user nova-compute[75176]: INFO nova.scheduler.client.report [None req-4bdf82ab-d0e5-4c5f-ab31-1d0aebf65fc7 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Deleted allocation for migration 23477e3c-9f13-4dc8-9ae1-cce32657b62b
Nov 28 15:54:24 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:54:24 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:54:24 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-4bdf82ab-d0e5-4c5f-ab31-1d0aebf65fc7 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Lock "6161cab2-eb1f-44cb-bbd5-077e6db42f77" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.523s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:54:26 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:54:26 user nova-compute[75176]: DEBUG nova.compute.manager [req-32343f10-b83f-4dcc-bacb-ebe8d34804b1 req-45e25a7a-6201-40d9-9eab-9f58d7dbd542 service nova] [instance: 742bfe1e-6885-4aba-9f7f-c07a5d904175] Received event network-changed-0b7a1072-6ad0-4907-a951-67975f1497b5 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:54:26 user nova-compute[75176]: DEBUG nova.compute.manager [req-32343f10-b83f-4dcc-bacb-ebe8d34804b1 req-45e25a7a-6201-40d9-9eab-9f58d7dbd542 service nova] [instance: 742bfe1e-6885-4aba-9f7f-c07a5d904175] Refreshing instance network info cache due to event network-changed-0b7a1072-6ad0-4907-a951-67975f1497b5. {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 15:54:26 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-32343f10-b83f-4dcc-bacb-ebe8d34804b1 req-45e25a7a-6201-40d9-9eab-9f58d7dbd542 service nova] Acquiring lock "refresh_cache-742bfe1e-6885-4aba-9f7f-c07a5d904175" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:54:26 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-32343f10-b83f-4dcc-bacb-ebe8d34804b1 req-45e25a7a-6201-40d9-9eab-9f58d7dbd542 service nova] Acquired lock "refresh_cache-742bfe1e-6885-4aba-9f7f-c07a5d904175" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:54:26 user nova-compute[75176]: DEBUG nova.network.neutron [req-32343f10-b83f-4dcc-bacb-ebe8d34804b1 req-45e25a7a-6201-40d9-9eab-9f58d7dbd542 service nova] [instance: 742bfe1e-6885-4aba-9f7f-c07a5d904175] Refreshing network info cache for port 0b7a1072-6ad0-4907-a951-67975f1497b5 {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 15:54:27 user nova-compute[75176]: DEBUG nova.network.neutron [req-32343f10-b83f-4dcc-bacb-ebe8d34804b1 req-45e25a7a-6201-40d9-9eab-9f58d7dbd542 service nova] [instance: 742bfe1e-6885-4aba-9f7f-c07a5d904175] Updated VIF entry in instance network info cache for port 0b7a1072-6ad0-4907-a951-67975f1497b5. {{(pid=75176) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 15:54:27 user nova-compute[75176]: DEBUG nova.network.neutron [req-32343f10-b83f-4dcc-bacb-ebe8d34804b1 req-45e25a7a-6201-40d9-9eab-9f58d7dbd542 service nova] [instance: 742bfe1e-6885-4aba-9f7f-c07a5d904175] Updating instance_info_cache with network_info: [{"id": "0b7a1072-6ad0-4907-a951-67975f1497b5", "address": "fa:16:3e:c7:5d:87", "network": {"id": "d512a3da-3880-40f2-9c54-9130a3dc1f6c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1594970670-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e8967023e58840afa09d5959d29a0285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b7a1072-6a", "ovs_interfaceid": "0b7a1072-6ad0-4907-a951-67975f1497b5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:54:27 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-32343f10-b83f-4dcc-bacb-ebe8d34804b1 req-45e25a7a-6201-40d9-9eab-9f58d7dbd542 service nova] Releasing lock "refresh_cache-742bfe1e-6885-4aba-9f7f-c07a5d904175" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:54:27 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-436926c0-b802-4fdb-8222-4c642a9d8060 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] Acquiring lock "742bfe1e-6885-4aba-9f7f-c07a5d904175" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:54:27 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-436926c0-b802-4fdb-8222-4c642a9d8060 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] Lock "742bfe1e-6885-4aba-9f7f-c07a5d904175" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:54:27 user nova-compute[75176]: DEBUG nova.objects.instance [None req-436926c0-b802-4fdb-8222-4c642a9d8060 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] Lazy-loading 'flavor' on Instance uuid 742bfe1e-6885-4aba-9f7f-c07a5d904175 {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:54:27 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-436926c0-b802-4fdb-8222-4c642a9d8060 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] Lock "742bfe1e-6885-4aba-9f7f-c07a5d904175" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:54:27 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-436926c0-b802-4fdb-8222-4c642a9d8060 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] Acquiring lock "742bfe1e-6885-4aba-9f7f-c07a5d904175" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:54:27 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-436926c0-b802-4fdb-8222-4c642a9d8060 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] Lock "742bfe1e-6885-4aba-9f7f-c07a5d904175" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:54:27 user nova-compute[75176]: INFO nova.compute.manager [None req-436926c0-b802-4fdb-8222-4c642a9d8060 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] [instance: 742bfe1e-6885-4aba-9f7f-c07a5d904175] Attaching volume 4a147af7-f082-42cf-ae1c-e5b98314a152 to /dev/vdb
Nov 28 15:54:28 user nova-compute[75176]: DEBUG os_brick.utils [None req-436926c0-b802-4fdb-8222-4c642a9d8060 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 15:54:28 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:54:28 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:54:28 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[53a8959b-9519-4f42-ad73-2fa325b359bb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:edc924a949b2\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:54:28 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:54:28 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:54:28 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2b30159-ff08-4642-9dbc-51338870d245]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:54:28 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:54:28 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:54:28 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[e733ebff-3851-4834-9e1b-673c066e3447]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:54:28 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0e9967c-961e-4add-870e-d641930e0ea1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:54:28 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-436926c0-b802-4fdb-8222-4c642a9d8060 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] Running cmd (subprocess): nvme version {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:54:28 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-436926c0-b802-4fdb-8222-4c642a9d8060 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] 'nvme version' failed. Not Retrying. {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 15:54:28 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.nvmeof [None req-436926c0-b802-4fdb-8222-4c642a9d8060 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] nvme not present on system {{(pid=75176) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 15:54:28 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:54:28 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 15:54:28 user nova-compute[75176]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 15:54:28 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[c79d081e-e55d-4bfb-b57d-46cb9fef314f]: (4, '') {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:54:28 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.lightos [None req-436926c0-b802-4fdb-8222-4c642a9d8060 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75176) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 15:54:28 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.lightos [None req-436926c0-b802-4fdb-8222-4c642a9d8060 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75176) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 15:54:28 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.lightos [None req-436926c0-b802-4fdb-8222-4c642a9d8060 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] LIGHTOS: no hostnqn found. {{(pid=75176) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 15:54:28 user nova-compute[75176]: DEBUG os_brick.utils [None req-436926c0-b802-4fdb-8222-4c642a9d8060 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] <== get_connector_properties: return (142ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:edc924a949b2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 15:54:28 user nova-compute[75176]: DEBUG nova.virt.block_device [None req-436926c0-b802-4fdb-8222-4c642a9d8060 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] [instance: 742bfe1e-6885-4aba-9f7f-c07a5d904175] Updating existing volume attachment record: 44bcce01-4b9f-4c03-974a-dbbdd143f9a6 {{(pid=75176) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 15:54:29 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:54:29 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:54:30 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:54:32 user nova-compute[75176]: DEBUG nova.compute.manager [req-2b17f497-9e67-4553-b16b-fb7e49adb783 req-91d29292-437f-41a1-aa47-7c593dffcbb4 service nova] [instance: 193235b9-8ef5-41d0-a9ab-4f1679d30266] Received event network-changed-44024d49-7b6d-415a-a9eb-fe53b53da379 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:54:32 user nova-compute[75176]: DEBUG nova.compute.manager [req-2b17f497-9e67-4553-b16b-fb7e49adb783 req-91d29292-437f-41a1-aa47-7c593dffcbb4 service nova] [instance: 193235b9-8ef5-41d0-a9ab-4f1679d30266] Refreshing instance network info cache due to event network-changed-44024d49-7b6d-415a-a9eb-fe53b53da379. {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 15:54:32 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-2b17f497-9e67-4553-b16b-fb7e49adb783 req-91d29292-437f-41a1-aa47-7c593dffcbb4 service nova] Acquiring lock "refresh_cache-193235b9-8ef5-41d0-a9ab-4f1679d30266" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:54:32 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-2b17f497-9e67-4553-b16b-fb7e49adb783 req-91d29292-437f-41a1-aa47-7c593dffcbb4 service nova] Acquired lock "refresh_cache-193235b9-8ef5-41d0-a9ab-4f1679d30266" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:54:32 user nova-compute[75176]: DEBUG nova.network.neutron [req-2b17f497-9e67-4553-b16b-fb7e49adb783 req-91d29292-437f-41a1-aa47-7c593dffcbb4 service nova] [instance: 193235b9-8ef5-41d0-a9ab-4f1679d30266] Refreshing network info cache for port 44024d49-7b6d-415a-a9eb-fe53b53da379 {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 15:54:33 user nova-compute[75176]: DEBUG nova.network.neutron [req-2b17f497-9e67-4553-b16b-fb7e49adb783 req-91d29292-437f-41a1-aa47-7c593dffcbb4 service nova] [instance: 193235b9-8ef5-41d0-a9ab-4f1679d30266] Updated VIF entry in instance network info cache for port 44024d49-7b6d-415a-a9eb-fe53b53da379. {{(pid=75176) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 15:54:33 user nova-compute[75176]: DEBUG nova.network.neutron [req-2b17f497-9e67-4553-b16b-fb7e49adb783 req-91d29292-437f-41a1-aa47-7c593dffcbb4 service nova] [instance: 193235b9-8ef5-41d0-a9ab-4f1679d30266] Updating instance_info_cache with network_info: [{"id": "44024d49-7b6d-415a-a9eb-fe53b53da379", "address": "fa:16:3e:21:d9:11", "network": {"id": "7ab60343-57be-427d-9037-6ecf0eaf5de0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1508138843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a194f81f7e104be7940d1d05f71bbad9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44024d49-7b", "ovs_interfaceid": "44024d49-7b6d-415a-a9eb-fe53b53da379", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:54:33 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-2b17f497-9e67-4553-b16b-fb7e49adb783 req-91d29292-437f-41a1-aa47-7c593dffcbb4 service nova] Releasing lock "refresh_cache-193235b9-8ef5-41d0-a9ab-4f1679d30266" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:54:34 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:54:34 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:54:38 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-436926c0-b802-4fdb-8222-4c642a9d8060 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] [instance: 742bfe1e-6885-4aba-9f7f-c07a5d904175] Calling os-brick to attach iSCSI Volume {{(pid=75176) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 15:54:38 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-436926c0-b802-4fdb-8222-4c642a9d8060 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c1b8a00>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4a147af7-f082-42cf-ae1c-e5b98314a152', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uWHmAeNg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 15:54:38 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-436926c0-b802-4fdb-8222-4c642a9d8060 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 15:54:38 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-436926c0-b802-4fdb-8222-4c642a9d8060 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 15:54:38 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-436926c0-b802-4fdb-8222-4c642a9d8060 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 15:54:38 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-436926c0-b802-4fdb-8222-4c642a9d8060 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 15:54:38 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-436926c0-b802-4fdb-8222-4c642a9d8060 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4a147af7-f082-42cf-ae1c-e5b98314a152" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 15:54:38 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-436926c0-b802-4fdb-8222-4c642a9d8060 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4a147af7-f082-42cf-ae1c-e5b98314a152" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 15:54:38 user nova-compute[75176]: INFO os_brick.initiator.connectors.iscsi [None req-436926c0-b802-4fdb-8222-4c642a9d8060 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 15:54:38 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a147af7-f082-42cf-ae1c-e5b98314a152 -p 172.16.0.220:3260 {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:54:38 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a147af7-f082-42cf-ae1c-e5b98314a152 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:54:38 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[65a01558-1da3-4b23-88f4-cb2c488afde3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:54:38 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-436926c0-b802-4fdb-8222-4c642a9d8060 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 15:54:38 user nova-compute[75176]:  {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:54:38 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a147af7-f082-42cf-ae1c-e5b98314a152 -p 172.16.0.220:3260 --interface default --op new {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:54:38 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a147af7-f082-42cf-ae1c-e5b98314a152 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:54:38 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[c34c1311-f8fd-4202-a61a-605947892999]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4a147af7-f082-42cf-ae1c-e5b98314a152] added\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:54:38 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-436926c0-b802-4fdb-8222-4c642a9d8060 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4a147af7-f082-42cf-ae1c-e5b98314a152] added
Nov 28 15:54:38 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:54:38 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a147af7-f082-42cf-ae1c-e5b98314a152 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:54:38 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a147af7-f082-42cf-ae1c-e5b98314a152 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:54:38 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[4488b0ed-9e19-4643-acdf-385fc698564c]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:54:38 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-436926c0-b802-4fdb-8222-4c642a9d8060 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:54:38 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a147af7-f082-42cf-ae1c-e5b98314a152 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:54:38 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a147af7-f082-42cf-ae1c-e5b98314a152 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:54:38 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb7a7a07-5299-465d-8fe9-93120a61be8c]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:54:38 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-436926c0-b802-4fdb-8222-4c642a9d8060 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:54:38 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a147af7-f082-42cf-ae1c-e5b98314a152 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uWHmAeNg {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:54:38 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a147af7-f082-42cf-ae1c-e5b98314a152 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uWHmAeNg" returned: 0 in 0.046s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:54:38 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[89ad0388-8058-439e-9d37-5b8549679604]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:54:38 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-436926c0-b802-4fdb-8222-4c642a9d8060 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uWHmAeNg'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:54:38 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a147af7-f082-42cf-ae1c-e5b98314a152 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:54:38 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a147af7-f082-42cf-ae1c-e5b98314a152 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:54:38 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[170d38ba-86c4-43e3-b632-32c3880019c0]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:54:38 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-436926c0-b802-4fdb-8222-4c642a9d8060 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:54:38 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:54:39 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:54:39 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[90a7acec-04e9-48cc-8705-bd2592fac9e1]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0 (non-flash)\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:54:39 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-436926c0-b802-4fdb-8222-4c642a9d8060 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 (non-flash)
Nov 28 15:54:39 user nova-compute[75176]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc (non-flash)
Nov 28 15:54:39 user nova-compute[75176]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0 (non-flash)
Nov 28 15:54:39 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:54:39 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-436926c0-b802-4fdb-8222-4c642a9d8060 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 (non-flash)
Nov 28 15:54:39 user nova-compute[75176]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc (non-flash)
Nov 28 15:54:39 user nova-compute[75176]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0 (non-flash)
Nov 28 15:54:39 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 15:54:39 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a147af7-f082-42cf-ae1c-e5b98314a152 -p 172.16.0.220:3260 --login {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:54:39 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a147af7-f082-42cf-ae1c-e5b98314a152 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:54:39 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea057eac-333e-400d-ae8a-85ce4286080b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4a147af7-f082-42cf-ae1c-e5b98314a152, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4a147af7-f082-42cf-ae1c-e5b98314a152, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:54:39 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-436926c0-b802-4fdb-8222-4c642a9d8060 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4a147af7-f082-42cf-ae1c-e5b98314a152, portal: 172.16.0.220,3260]
Nov 28 15:54:39 user nova-compute[75176]: Login to [iface: default, target: iqn.2010-10.org.openstack:4a147af7-f082-42cf-ae1c-e5b98314a152, portal: 172.16.0.220,3260] successful.
Nov 28 15:54:39 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:54:39 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a147af7-f082-42cf-ae1c-e5b98314a152 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:54:39 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a147af7-f082-42cf-ae1c-e5b98314a152 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:54:39 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[b351815a-907e-4da2-b0ee-425e6890e61d]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:54:39 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-436926c0-b802-4fdb-8222-4c642a9d8060 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:54:39 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:54:39 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:54:39 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5e1442b-1907-4364-9837-126ea146c4d0]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a147af7-f082-42cf-ae1c-e5b98314a152 (non-flash)\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:54:39 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-436926c0-b802-4fdb-8222-4c642a9d8060 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 (non-flash)
Nov 28 15:54:39 user nova-compute[75176]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc (non-flash)
Nov 28 15:54:39 user nova-compute[75176]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0 (non-flash)
Nov 28 15:54:39 user nova-compute[75176]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a147af7-f082-42cf-ae1c-e5b98314a152 (non-flash)
Nov 28 15:54:39 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:54:39 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-436926c0-b802-4fdb-8222-4c642a9d8060 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 (non-flash)
Nov 28 15:54:39 user nova-compute[75176]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc (non-flash)
Nov 28 15:54:39 user nova-compute[75176]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0 (non-flash)
Nov 28 15:54:39 user nova-compute[75176]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a147af7-f082-42cf-ae1c-e5b98314a152 (non-flash)
Nov 28 15:54:39 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 15:54:39 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-436926c0-b802-4fdb-8222-4c642a9d8060 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4a147af7-f082-42cf-ae1c-e5b98314a152" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.330s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 15:54:39 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-436926c0-b802-4fdb-8222-4c642a9d8060 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] Connected to 172.16.0.220:3260 {{(pid=75176) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 15:54:39 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-436926c0-b802-4fdb-8222-4c642a9d8060 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] HCTL ('34', '-', '-', 0) found on session 44 with lun 0 {{(pid=75176) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 15:54:39 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-436926c0-b802-4fdb-8222-4c642a9d8060 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75176) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 15:54:39 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:54:39 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:54:39 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[c97a0fc9-2d56-4679-8643-69c6ee0e44da]: (4, ('- - 0', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:54:39 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-436926c0-b802-4fdb-8222-4c642a9d8060 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] Searching for a device in session 44 and hctl ['34', '*', '*', 0] yield: None {{(pid=75176) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 15:54:39 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:54:39 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:54:39 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-bc2149aa-c233-4c8e-89d6-120ecd408c9b tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Acquiring lock "193235b9-8ef5-41d0-a9ab-4f1679d30266" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:54:39 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-bc2149aa-c233-4c8e-89d6-120ecd408c9b tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Lock "193235b9-8ef5-41d0-a9ab-4f1679d30266" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:54:39 user nova-compute[75176]: DEBUG nova.objects.instance [None req-bc2149aa-c233-4c8e-89d6-120ecd408c9b tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Lazy-loading 'flavor' on Instance uuid 193235b9-8ef5-41d0-a9ab-4f1679d30266 {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:54:39 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-bc2149aa-c233-4c8e-89d6-120ecd408c9b tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Lock "193235b9-8ef5-41d0-a9ab-4f1679d30266" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:54:39 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-bc2149aa-c233-4c8e-89d6-120ecd408c9b tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Acquiring lock "193235b9-8ef5-41d0-a9ab-4f1679d30266" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:54:39 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-bc2149aa-c233-4c8e-89d6-120ecd408c9b tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Lock "193235b9-8ef5-41d0-a9ab-4f1679d30266" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:54:39 user nova-compute[75176]: INFO nova.compute.manager [None req-bc2149aa-c233-4c8e-89d6-120ecd408c9b tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] [instance: 193235b9-8ef5-41d0-a9ab-4f1679d30266] Attaching volume 7019ee77-2086-41d6-a8a2-9a82042b4047 to /dev/vdb
Nov 28 15:54:39 user nova-compute[75176]: DEBUG os_brick.utils [None req-bc2149aa-c233-4c8e-89d6-120ecd408c9b tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 15:54:39 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:54:39 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:54:39 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[92124d6a-f420-4a06-9905-50c4a6f37161]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:edc924a949b2\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:54:39 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:54:39 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:54:39 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7f3993f-861a-4d22-8807-1ce8ac7fd0e5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:54:39 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:54:39 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:54:39 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[a669e3d9-b25f-4401-94d2-32b1cfd54fca]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:54:39 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[9beccaa8-7736-4680-98a7-7367a6d74261]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:54:39 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-bc2149aa-c233-4c8e-89d6-120ecd408c9b tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Running cmd (subprocess): nvme version {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:54:39 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-bc2149aa-c233-4c8e-89d6-120ecd408c9b tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] 'nvme version' failed. Not Retrying. {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 15:54:39 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bc2149aa-c233-4c8e-89d6-120ecd408c9b tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] nvme not present on system {{(pid=75176) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 15:54:40 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:54:40 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 15:54:40 user nova-compute[75176]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 15:54:40 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[448cd417-491d-435b-a94c-dd78089c3d14]: (4, '') {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:54:40 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.lightos [None req-bc2149aa-c233-4c8e-89d6-120ecd408c9b tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75176) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 15:54:40 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.lightos [None req-bc2149aa-c233-4c8e-89d6-120ecd408c9b tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75176) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 15:54:40 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.lightos [None req-bc2149aa-c233-4c8e-89d6-120ecd408c9b tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] LIGHTOS: no hostnqn found. {{(pid=75176) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 15:54:40 user nova-compute[75176]: DEBUG os_brick.utils [None req-bc2149aa-c233-4c8e-89d6-120ecd408c9b tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:edc924a949b2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 15:54:40 user nova-compute[75176]: DEBUG nova.virt.block_device [None req-bc2149aa-c233-4c8e-89d6-120ecd408c9b tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] [instance: 193235b9-8ef5-41d0-a9ab-4f1679d30266] Updating existing volume attachment record: 53ccc70e-9386-4524-83e5-25ea605d3da0 {{(pid=75176) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 15:54:40 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-436926c0-b802-4fdb-8222-4c642a9d8060 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] Searching for a device in session 44 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75176) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 15:54:40 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-436926c0-b802-4fdb-8222-4c642a9d8060 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:4a147af7-f082-42cf-ae1c-e5b98314a152', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uWHmAeNg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75176) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 15:54:40 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-436926c0-b802-4fdb-8222-4c642a9d8060 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.364s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 15:54:40 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-436926c0-b802-4fdb-8222-4c642a9d8060 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] <== connect_volume: return (1365ms) {'type': 'block', 'scsi_wwn': '23966626331353435', 'path': '/dev/sdc'} {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 15:54:40 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-436926c0-b802-4fdb-8222-4c642a9d8060 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] [instance: 742bfe1e-6885-4aba-9f7f-c07a5d904175] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23966626331353435', 'path': '/dev/sdc'} {{(pid=75176) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 15:54:40 user nova-compute[75176]: DEBUG nova.objects.instance [None req-436926c0-b802-4fdb-8222-4c642a9d8060 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] Lazy-loading 'flavor' on Instance uuid 742bfe1e-6885-4aba-9f7f-c07a5d904175 {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:54:40 user nova-compute[75176]: DEBUG nova.virt.libvirt.guest [None req-436926c0-b802-4fdb-8222-4c642a9d8060 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 15:54:40 user nova-compute[75176]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 15:54:40 user nova-compute[75176]:   <source dev="/dev/sdc"/>
Nov 28 15:54:40 user nova-compute[75176]:   <target dev="vdb" bus="virtio"/>
Nov 28 15:54:40 user nova-compute[75176]:   <serial>4a147af7-f082-42cf-ae1c-e5b98314a152</serial>
Nov 28 15:54:40 user nova-compute[75176]: </disk>
Nov 28 15:54:40 user nova-compute[75176]:  {{(pid=75176) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 15:54:40 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-436926c0-b802-4fdb-8222-4c642a9d8060 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] No BDM found with device name vda, not building metadata. {{(pid=75176) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 15:54:40 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-436926c0-b802-4fdb-8222-4c642a9d8060 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75176) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 15:54:40 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-436926c0-b802-4fdb-8222-4c642a9d8060 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] No VIF found with MAC fa:16:3e:c7:5d:87, not building metadata {{(pid=75176) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 15:54:40 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-436926c0-b802-4fdb-8222-4c642a9d8060 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] Lock "742bfe1e-6885-4aba-9f7f-c07a5d904175" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.849s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:54:43 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-26d85ab7-a73e-45fc-a63c-639726565248 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] Acquiring lock "742bfe1e-6885-4aba-9f7f-c07a5d904175" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:54:43 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-26d85ab7-a73e-45fc-a63c-639726565248 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] Lock "742bfe1e-6885-4aba-9f7f-c07a5d904175" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:54:43 user nova-compute[75176]: DEBUG nova.objects.instance [None req-26d85ab7-a73e-45fc-a63c-639726565248 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] Lazy-loading 'flavor' on Instance uuid 742bfe1e-6885-4aba-9f7f-c07a5d904175 {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:54:43 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-26d85ab7-a73e-45fc-a63c-639726565248 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] Lock "742bfe1e-6885-4aba-9f7f-c07a5d904175" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.066s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:54:43 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-26d85ab7-a73e-45fc-a63c-639726565248 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] Acquiring lock "742bfe1e-6885-4aba-9f7f-c07a5d904175" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:54:43 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-26d85ab7-a73e-45fc-a63c-639726565248 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] Lock "742bfe1e-6885-4aba-9f7f-c07a5d904175" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:54:43 user nova-compute[75176]: INFO nova.compute.manager [None req-26d85ab7-a73e-45fc-a63c-639726565248 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] [instance: 742bfe1e-6885-4aba-9f7f-c07a5d904175] Attaching volume b5f16a39-1439-433c-ac8b-0610d2382b46 to /dev/vdc
Nov 28 15:54:43 user nova-compute[75176]: DEBUG os_brick.utils [None req-26d85ab7-a73e-45fc-a63c-639726565248 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 15:54:43 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:54:43 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:54:43 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd24bdc8-0f31-4ab3-96d1-902bccd8b4d7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:edc924a949b2\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:54:43 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:54:43 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:54:43 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdbd4c55-ef43-4f69-9387-cab542f5d808]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:54:43 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:54:43 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:54:43 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b850fce-ce19-4d67-8e6d-8889273acfac]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:54:43 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[73c88e34-d9d3-45f8-b89e-2a97ff3526db]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:54:43 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-26d85ab7-a73e-45fc-a63c-639726565248 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] Running cmd (subprocess): nvme version {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:54:43 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-26d85ab7-a73e-45fc-a63c-639726565248 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] 'nvme version' failed. Not Retrying. {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 15:54:43 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.nvmeof [None req-26d85ab7-a73e-45fc-a63c-639726565248 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] nvme not present on system {{(pid=75176) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 15:54:43 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:54:43 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 15:54:43 user nova-compute[75176]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 15:54:43 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[acf18ea4-b538-4d36-bf2c-4237ff28d2e1]: (4, '') {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:54:43 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.lightos [None req-26d85ab7-a73e-45fc-a63c-639726565248 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75176) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 15:54:43 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.lightos [None req-26d85ab7-a73e-45fc-a63c-639726565248 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75176) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 15:54:43 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.lightos [None req-26d85ab7-a73e-45fc-a63c-639726565248 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] LIGHTOS: no hostnqn found. {{(pid=75176) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 15:54:43 user nova-compute[75176]: DEBUG os_brick.utils [None req-26d85ab7-a73e-45fc-a63c-639726565248 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:edc924a949b2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 15:54:43 user nova-compute[75176]: DEBUG nova.virt.block_device [None req-26d85ab7-a73e-45fc-a63c-639726565248 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] [instance: 742bfe1e-6885-4aba-9f7f-c07a5d904175] Updating existing volume attachment record: 32ab0e91-113f-43b1-9809-45a2be73e2ad {{(pid=75176) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 15:54:44 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:54:44 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:54:49 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:54:49 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:54:51 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc2149aa-c233-4c8e-89d6-120ecd408c9b tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] [instance: 193235b9-8ef5-41d0-a9ab-4f1679d30266] Calling os-brick to attach iSCSI Volume {{(pid=75176) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 15:54:51 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc2149aa-c233-4c8e-89d6-120ecd408c9b tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c1b8a00>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7019ee77-2086-41d6-a8a2-9a82042b4047', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QiYWSAVH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 15:54:51 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-bc2149aa-c233-4c8e-89d6-120ecd408c9b tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 15:54:51 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-bc2149aa-c233-4c8e-89d6-120ecd408c9b tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 15:54:51 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-bc2149aa-c233-4c8e-89d6-120ecd408c9b tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 15:54:51 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-bc2149aa-c233-4c8e-89d6-120ecd408c9b tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 15:54:51 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-bc2149aa-c233-4c8e-89d6-120ecd408c9b tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7019ee77-2086-41d6-a8a2-9a82042b4047" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 15:54:51 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-bc2149aa-c233-4c8e-89d6-120ecd408c9b tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7019ee77-2086-41d6-a8a2-9a82042b4047" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 15:54:51 user nova-compute[75176]: INFO os_brick.initiator.connectors.iscsi [None req-bc2149aa-c233-4c8e-89d6-120ecd408c9b tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 15:54:51 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7019ee77-2086-41d6-a8a2-9a82042b4047 -p 172.16.0.220:3260 {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:54:51 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7019ee77-2086-41d6-a8a2-9a82042b4047 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:54:51 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fc437d9-61a4-40d4-ada2-72bf34c932a3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:54:51 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc2149aa-c233-4c8e-89d6-120ecd408c9b tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 15:54:51 user nova-compute[75176]:  {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:54:51 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7019ee77-2086-41d6-a8a2-9a82042b4047 -p 172.16.0.220:3260 --interface default --op new {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:54:51 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7019ee77-2086-41d6-a8a2-9a82042b4047 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:54:51 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[19e312fa-e57b-4b8b-bd15-1b50660b6ca7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7019ee77-2086-41d6-a8a2-9a82042b4047] added\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:54:51 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc2149aa-c233-4c8e-89d6-120ecd408c9b tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7019ee77-2086-41d6-a8a2-9a82042b4047] added
Nov 28 15:54:51 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:54:51 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7019ee77-2086-41d6-a8a2-9a82042b4047 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:54:51 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7019ee77-2086-41d6-a8a2-9a82042b4047 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:54:51 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f7bfa7c-df3f-4a1d-8c8b-d6c7cd69eed1]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:54:51 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc2149aa-c233-4c8e-89d6-120ecd408c9b tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:54:51 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7019ee77-2086-41d6-a8a2-9a82042b4047 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:54:51 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7019ee77-2086-41d6-a8a2-9a82042b4047 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:54:51 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[63175772-7f88-49c4-8be8-562e0ecacc25]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:54:51 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc2149aa-c233-4c8e-89d6-120ecd408c9b tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:54:51 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7019ee77-2086-41d6-a8a2-9a82042b4047 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QiYWSAVH {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:54:51 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7019ee77-2086-41d6-a8a2-9a82042b4047 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QiYWSAVH" returned: 0 in 0.018s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:54:51 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e8741b9-0b85-4c53-80ea-2cb7f31faa75]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:54:51 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc2149aa-c233-4c8e-89d6-120ecd408c9b tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QiYWSAVH'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:54:51 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7019ee77-2086-41d6-a8a2-9a82042b4047 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:54:51 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7019ee77-2086-41d6-a8a2-9a82042b4047 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:54:51 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[59df6587-2238-493b-bcea-d8be50d3701e]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:54:51 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc2149aa-c233-4c8e-89d6-120ecd408c9b tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:54:51 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:54:51 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:54:51 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a5c5860-97d3-4d6d-8077-30f3334b9ee2]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a147af7-f082-42cf-ae1c-e5b98314a152 (non-flash)\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:54:51 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc2149aa-c233-4c8e-89d6-120ecd408c9b tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 (non-flash)
Nov 28 15:54:51 user nova-compute[75176]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc (non-flash)
Nov 28 15:54:51 user nova-compute[75176]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0 (non-flash)
Nov 28 15:54:51 user nova-compute[75176]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a147af7-f082-42cf-ae1c-e5b98314a152 (non-flash)
Nov 28 15:54:51 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:54:51 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc2149aa-c233-4c8e-89d6-120ecd408c9b tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 (non-flash)
Nov 28 15:54:51 user nova-compute[75176]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc (non-flash)
Nov 28 15:54:51 user nova-compute[75176]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0 (non-flash)
Nov 28 15:54:51 user nova-compute[75176]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a147af7-f082-42cf-ae1c-e5b98314a152 (non-flash)
Nov 28 15:54:51 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 15:54:51 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7019ee77-2086-41d6-a8a2-9a82042b4047 -p 172.16.0.220:3260 --login {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:54:51 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7019ee77-2086-41d6-a8a2-9a82042b4047 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:54:51 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e3b7455-cb67-420c-a83e-81fe4a226d32]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7019ee77-2086-41d6-a8a2-9a82042b4047, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7019ee77-2086-41d6-a8a2-9a82042b4047, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:54:51 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc2149aa-c233-4c8e-89d6-120ecd408c9b tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7019ee77-2086-41d6-a8a2-9a82042b4047, portal: 172.16.0.220,3260]
Nov 28 15:54:51 user nova-compute[75176]: Login to [iface: default, target: iqn.2010-10.org.openstack:7019ee77-2086-41d6-a8a2-9a82042b4047, portal: 172.16.0.220,3260] successful.
Nov 28 15:54:51 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:54:51 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7019ee77-2086-41d6-a8a2-9a82042b4047 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:54:51 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7019ee77-2086-41d6-a8a2-9a82042b4047 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:54:51 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[b33d6818-42a7-496c-beab-8e323587dcc8]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:54:51 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc2149aa-c233-4c8e-89d6-120ecd408c9b tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:54:51 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:54:51 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:54:51 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e048714-e510-4866-8ad9-1f8310ab9776]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a147af7-f082-42cf-ae1c-e5b98314a152 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7019ee77-2086-41d6-a8a2-9a82042b4047 (non-flash)\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:54:51 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc2149aa-c233-4c8e-89d6-120ecd408c9b tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 (non-flash)
Nov 28 15:54:51 user nova-compute[75176]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc (non-flash)
Nov 28 15:54:51 user nova-compute[75176]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0 (non-flash)
Nov 28 15:54:51 user nova-compute[75176]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a147af7-f082-42cf-ae1c-e5b98314a152 (non-flash)
Nov 28 15:54:51 user nova-compute[75176]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7019ee77-2086-41d6-a8a2-9a82042b4047 (non-flash)
Nov 28 15:54:51 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:54:51 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc2149aa-c233-4c8e-89d6-120ecd408c9b tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 (non-flash)
Nov 28 15:54:51 user nova-compute[75176]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc (non-flash)
Nov 28 15:54:51 user nova-compute[75176]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0 (non-flash)
Nov 28 15:54:51 user nova-compute[75176]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a147af7-f082-42cf-ae1c-e5b98314a152 (non-flash)
Nov 28 15:54:51 user nova-compute[75176]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7019ee77-2086-41d6-a8a2-9a82042b4047 (non-flash)
Nov 28 15:54:51 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 15:54:51 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-bc2149aa-c233-4c8e-89d6-120ecd408c9b tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7019ee77-2086-41d6-a8a2-9a82042b4047" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.286s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 15:54:51 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc2149aa-c233-4c8e-89d6-120ecd408c9b tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Connected to 172.16.0.220:3260 {{(pid=75176) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 15:54:51 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-bc2149aa-c233-4c8e-89d6-120ecd408c9b tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] HCTL ('37', '-', '-', 0) found on session 45 with lun 0 {{(pid=75176) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 15:54:51 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-bc2149aa-c233-4c8e-89d6-120ecd408c9b tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75176) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 15:54:51 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:54:51 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.016s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:54:51 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[1036c8a3-a64b-4636-b409-cbd703f42365]: (4, ('- - 0', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:54:51 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-bc2149aa-c233-4c8e-89d6-120ecd408c9b tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Searching for a device in session 45 and hctl ['37', '*', '*', 0] yield: None {{(pid=75176) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 15:54:51 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-26d85ab7-a73e-45fc-a63c-639726565248 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] [instance: 742bfe1e-6885-4aba-9f7f-c07a5d904175] Calling os-brick to attach iSCSI Volume {{(pid=75176) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 15:54:51 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-26d85ab7-a73e-45fc-a63c-639726565248 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c1b8a00>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b5f16a39-1439-433c-ac8b-0610d2382b46', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gFGRbcpj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 15:54:51 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-26d85ab7-a73e-45fc-a63c-639726565248 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 15:54:51 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-26d85ab7-a73e-45fc-a63c-639726565248 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 15:54:52 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-bc2149aa-c233-4c8e-89d6-120ecd408c9b tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Searching for a device in session 45 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75176) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 15:54:52 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc2149aa-c233-4c8e-89d6-120ecd408c9b tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:7019ee77-2086-41d6-a8a2-9a82042b4047', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QiYWSAVH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75176) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 15:54:52 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-bc2149aa-c233-4c8e-89d6-120ecd408c9b tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.315s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 15:54:52 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc2149aa-c233-4c8e-89d6-120ecd408c9b tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] <== connect_volume: return (1317ms) {'type': 'block', 'scsi_wwn': '26563633730383362', 'path': '/dev/sdf'} {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 15:54:52 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc2149aa-c233-4c8e-89d6-120ecd408c9b tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] [instance: 193235b9-8ef5-41d0-a9ab-4f1679d30266] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26563633730383362', 'path': '/dev/sdf'} {{(pid=75176) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 15:54:52 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-26d85ab7-a73e-45fc-a63c-639726565248 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.883s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 15:54:52 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-26d85ab7-a73e-45fc-a63c-639726565248 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 15:54:52 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-26d85ab7-a73e-45fc-a63c-639726565248 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b5f16a39-1439-433c-ac8b-0610d2382b46" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 15:54:52 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-26d85ab7-a73e-45fc-a63c-639726565248 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b5f16a39-1439-433c-ac8b-0610d2382b46" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 15:54:52 user nova-compute[75176]: INFO os_brick.initiator.connectors.iscsi [None req-26d85ab7-a73e-45fc-a63c-639726565248 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 15:54:52 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5f16a39-1439-433c-ac8b-0610d2382b46 -p 172.16.0.220:3260 {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:54:52 user nova-compute[75176]: DEBUG nova.objects.instance [None req-bc2149aa-c233-4c8e-89d6-120ecd408c9b tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Lazy-loading 'flavor' on Instance uuid 193235b9-8ef5-41d0-a9ab-4f1679d30266 {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:54:52 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5f16a39-1439-433c-ac8b-0610d2382b46 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:54:52 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[f68e78e1-4474-4dfc-8c83-5ea5ec89f0bf]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:54:52 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-26d85ab7-a73e-45fc-a63c-639726565248 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 15:54:52 user nova-compute[75176]:  {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:54:52 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5f16a39-1439-433c-ac8b-0610d2382b46 -p 172.16.0.220:3260 --interface default --op new {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:54:52 user nova-compute[75176]: DEBUG nova.virt.libvirt.guest [None req-bc2149aa-c233-4c8e-89d6-120ecd408c9b tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 15:54:52 user nova-compute[75176]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 15:54:52 user nova-compute[75176]:   <source dev="/dev/sdf"/>
Nov 28 15:54:52 user nova-compute[75176]:   <target dev="vdb" bus="virtio"/>
Nov 28 15:54:52 user nova-compute[75176]:   <serial>7019ee77-2086-41d6-a8a2-9a82042b4047</serial>
Nov 28 15:54:52 user nova-compute[75176]: </disk>
Nov 28 15:54:52 user nova-compute[75176]:  {{(pid=75176) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 15:54:52 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5f16a39-1439-433c-ac8b-0610d2382b46 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:54:52 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[855258a0-1d06-4e27-8a3d-aaf210bf63c9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b5f16a39-1439-433c-ac8b-0610d2382b46] added\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:54:52 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-26d85ab7-a73e-45fc-a63c-639726565248 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b5f16a39-1439-433c-ac8b-0610d2382b46] added
Nov 28 15:54:52 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:54:52 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5f16a39-1439-433c-ac8b-0610d2382b46 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:54:52 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5f16a39-1439-433c-ac8b-0610d2382b46 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:54:52 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[2564d8a7-dcea-4caa-86c7-3788fcd47334]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:54:52 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-26d85ab7-a73e-45fc-a63c-639726565248 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:54:52 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5f16a39-1439-433c-ac8b-0610d2382b46 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:54:52 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5f16a39-1439-433c-ac8b-0610d2382b46 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:54:52 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[5be70b9f-e547-495b-8a56-cb34ff1853a1]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:54:52 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-26d85ab7-a73e-45fc-a63c-639726565248 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:54:52 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5f16a39-1439-433c-ac8b-0610d2382b46 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gFGRbcpj {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:54:52 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5f16a39-1439-433c-ac8b-0610d2382b46 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gFGRbcpj" returned: 0 in 0.021s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:54:52 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[25750078-84c1-402a-a927-6887164b2f52]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:54:52 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-26d85ab7-a73e-45fc-a63c-639726565248 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gFGRbcpj'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:54:52 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5f16a39-1439-433c-ac8b-0610d2382b46 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:54:52 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5f16a39-1439-433c-ac8b-0610d2382b46 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:54:52 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[77e0afe0-1297-4003-ae0a-6be05ac4a918]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:54:52 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-26d85ab7-a73e-45fc-a63c-639726565248 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:54:52 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:54:52 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.042s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:54:52 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[73dbeddf-afce-49cb-8d89-0c6e5f972bc0]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a147af7-f082-42cf-ae1c-e5b98314a152 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7019ee77-2086-41d6-a8a2-9a82042b4047 (non-flash)\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:54:52 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-26d85ab7-a73e-45fc-a63c-639726565248 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 (non-flash)
Nov 28 15:54:52 user nova-compute[75176]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc (non-flash)
Nov 28 15:54:52 user nova-compute[75176]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0 (non-flash)
Nov 28 15:54:52 user nova-compute[75176]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a147af7-f082-42cf-ae1c-e5b98314a152 (non-flash)
Nov 28 15:54:52 user nova-compute[75176]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7019ee77-2086-41d6-a8a2-9a82042b4047 (non-flash)
Nov 28 15:54:52 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:54:52 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-26d85ab7-a73e-45fc-a63c-639726565248 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 (non-flash)
Nov 28 15:54:52 user nova-compute[75176]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc (non-flash)
Nov 28 15:54:52 user nova-compute[75176]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0 (non-flash)
Nov 28 15:54:52 user nova-compute[75176]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a147af7-f082-42cf-ae1c-e5b98314a152 (non-flash)
Nov 28 15:54:52 user nova-compute[75176]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7019ee77-2086-41d6-a8a2-9a82042b4047 (non-flash)
Nov 28 15:54:52 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 15:54:52 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5f16a39-1439-433c-ac8b-0610d2382b46 -p 172.16.0.220:3260 --login {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:54:52 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5f16a39-1439-433c-ac8b-0610d2382b46 -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:54:52 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[62fe8580-b44a-4e9c-b69e-369a7a315d14]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b5f16a39-1439-433c-ac8b-0610d2382b46, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b5f16a39-1439-433c-ac8b-0610d2382b46, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:54:52 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-26d85ab7-a73e-45fc-a63c-639726565248 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b5f16a39-1439-433c-ac8b-0610d2382b46, portal: 172.16.0.220,3260]
Nov 28 15:54:52 user nova-compute[75176]: Login to [iface: default, target: iqn.2010-10.org.openstack:b5f16a39-1439-433c-ac8b-0610d2382b46, portal: 172.16.0.220,3260] successful.
Nov 28 15:54:52 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:54:52 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5f16a39-1439-433c-ac8b-0610d2382b46 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:54:52 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5f16a39-1439-433c-ac8b-0610d2382b46 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:54:52 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[92158cac-e665-471b-953f-a1c0aedc45ed]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:54:52 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-26d85ab7-a73e-45fc-a63c-639726565248 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:54:52 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:54:52 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:54:52 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[34930130-bbc6-4c15-961c-4f3466e52932]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a147af7-f082-42cf-ae1c-e5b98314a152 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7019ee77-2086-41d6-a8a2-9a82042b4047 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5f16a39-1439-433c-ac8b-0610d2382b46 (non-flash)\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:54:52 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-26d85ab7-a73e-45fc-a63c-639726565248 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 (non-flash)
Nov 28 15:54:52 user nova-compute[75176]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc (non-flash)
Nov 28 15:54:52 user nova-compute[75176]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0 (non-flash)
Nov 28 15:54:52 user nova-compute[75176]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a147af7-f082-42cf-ae1c-e5b98314a152 (non-flash)
Nov 28 15:54:52 user nova-compute[75176]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7019ee77-2086-41d6-a8a2-9a82042b4047 (non-flash)
Nov 28 15:54:52 user nova-compute[75176]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5f16a39-1439-433c-ac8b-0610d2382b46 (non-flash)
Nov 28 15:54:52 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:54:52 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-26d85ab7-a73e-45fc-a63c-639726565248 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 (non-flash)
Nov 28 15:54:52 user nova-compute[75176]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc (non-flash)
Nov 28 15:54:52 user nova-compute[75176]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0 (non-flash)
Nov 28 15:54:52 user nova-compute[75176]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a147af7-f082-42cf-ae1c-e5b98314a152 (non-flash)
Nov 28 15:54:52 user nova-compute[75176]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7019ee77-2086-41d6-a8a2-9a82042b4047 (non-flash)
Nov 28 15:54:52 user nova-compute[75176]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5f16a39-1439-433c-ac8b-0610d2382b46 (non-flash)
Nov 28 15:54:52 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 15:54:52 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-26d85ab7-a73e-45fc-a63c-639726565248 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b5f16a39-1439-433c-ac8b-0610d2382b46" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.337s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 15:54:52 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-26d85ab7-a73e-45fc-a63c-639726565248 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] Connected to 172.16.0.220:3260 {{(pid=75176) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 15:54:52 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-26d85ab7-a73e-45fc-a63c-639726565248 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] HCTL ('38', '-', '-', 0) found on session 46 with lun 0 {{(pid=75176) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 15:54:52 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-26d85ab7-a73e-45fc-a63c-639726565248 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75176) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 15:54:52 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:54:52 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.017s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:54:52 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[64c9ab53-07cf-439b-96de-c365ea6685e4]: (4, ('- - 0', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:54:52 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-26d85ab7-a73e-45fc-a63c-639726565248 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] Searching for a device in session 46 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75176) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 15:54:52 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-26d85ab7-a73e-45fc-a63c-639726565248 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:b5f16a39-1439-433c-ac8b-0610d2382b46', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gFGRbcpj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75176) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 15:54:52 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-bc2149aa-c233-4c8e-89d6-120ecd408c9b tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] No BDM found with device name vda, not building metadata. {{(pid=75176) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 15:54:52 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-bc2149aa-c233-4c8e-89d6-120ecd408c9b tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75176) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 15:54:52 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-bc2149aa-c233-4c8e-89d6-120ecd408c9b tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] No VIF found with MAC fa:16:3e:21:d9:11, not building metadata {{(pid=75176) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 15:54:52 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-bc2149aa-c233-4c8e-89d6-120ecd408c9b tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Lock "193235b9-8ef5-41d0-a9ab-4f1679d30266" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.124s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:54:53 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-26d85ab7-a73e-45fc-a63c-639726565248 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.377s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 15:54:53 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-26d85ab7-a73e-45fc-a63c-639726565248 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] <== connect_volume: return (2260ms) {'type': 'block', 'scsi_wwn': '26664633033653566', 'path': '/dev/sdg'} {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 15:54:53 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-26d85ab7-a73e-45fc-a63c-639726565248 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] [instance: 742bfe1e-6885-4aba-9f7f-c07a5d904175] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26664633033653566', 'path': '/dev/sdg'} {{(pid=75176) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 15:54:53 user nova-compute[75176]: DEBUG nova.objects.instance [None req-26d85ab7-a73e-45fc-a63c-639726565248 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] Lazy-loading 'flavor' on Instance uuid 742bfe1e-6885-4aba-9f7f-c07a5d904175 {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:54:53 user nova-compute[75176]: DEBUG nova.virt.libvirt.guest [None req-26d85ab7-a73e-45fc-a63c-639726565248 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 15:54:53 user nova-compute[75176]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 15:54:53 user nova-compute[75176]:   <source dev="/dev/sdg"/>
Nov 28 15:54:53 user nova-compute[75176]:   <target dev="vdc" bus="virtio"/>
Nov 28 15:54:53 user nova-compute[75176]:   <serial>b5f16a39-1439-433c-ac8b-0610d2382b46</serial>
Nov 28 15:54:53 user nova-compute[75176]: </disk>
Nov 28 15:54:53 user nova-compute[75176]:  {{(pid=75176) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 15:54:54 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-26d85ab7-a73e-45fc-a63c-639726565248 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] No BDM found with device name vda, not building metadata. {{(pid=75176) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 15:54:54 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-26d85ab7-a73e-45fc-a63c-639726565248 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75176) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 15:54:54 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-26d85ab7-a73e-45fc-a63c-639726565248 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75176) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 15:54:54 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-26d85ab7-a73e-45fc-a63c-639726565248 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] No VIF found with MAC fa:16:3e:c7:5d:87, not building metadata {{(pid=75176) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 15:54:54 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-90eb7016-a92c-4b89-a9fa-506f6b2f8229 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Acquiring lock "193235b9-8ef5-41d0-a9ab-4f1679d30266" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:54:54 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-90eb7016-a92c-4b89-a9fa-506f6b2f8229 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Lock "193235b9-8ef5-41d0-a9ab-4f1679d30266" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:54:54 user nova-compute[75176]: INFO nova.compute.manager [None req-90eb7016-a92c-4b89-a9fa-506f6b2f8229 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] [instance: 193235b9-8ef5-41d0-a9ab-4f1679d30266] Detaching volume 7019ee77-2086-41d6-a8a2-9a82042b4047
Nov 28 15:54:54 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-26d85ab7-a73e-45fc-a63c-639726565248 tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] Lock "742bfe1e-6885-4aba-9f7f-c07a5d904175" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.701s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:54:54 user nova-compute[75176]: INFO nova.virt.block_device [None req-90eb7016-a92c-4b89-a9fa-506f6b2f8229 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] [instance: 193235b9-8ef5-41d0-a9ab-4f1679d30266] Attempting to driver detach volume 7019ee77-2086-41d6-a8a2-9a82042b4047 from mountpoint /dev/vdb
Nov 28 15:54:54 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-90eb7016-a92c-4b89-a9fa-506f6b2f8229 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Attempting to detach device vdb from instance 193235b9-8ef5-41d0-a9ab-4f1679d30266 from the persistent domain config. {{(pid=75176) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 15:54:54 user nova-compute[75176]: DEBUG nova.virt.libvirt.guest [None req-90eb7016-a92c-4b89-a9fa-506f6b2f8229 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 15:54:54 user nova-compute[75176]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 15:54:54 user nova-compute[75176]:   <source dev="/dev/sdf"/>
Nov 28 15:54:54 user nova-compute[75176]:   <target dev="vdb" bus="virtio"/>
Nov 28 15:54:54 user nova-compute[75176]:   <serial>7019ee77-2086-41d6-a8a2-9a82042b4047</serial>
Nov 28 15:54:54 user nova-compute[75176]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 15:54:54 user nova-compute[75176]: </disk>
Nov 28 15:54:54 user nova-compute[75176]:  {{(pid=75176) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 15:54:54 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-90eb7016-a92c-4b89-a9fa-506f6b2f8229 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Successfully detached device vdb from instance 193235b9-8ef5-41d0-a9ab-4f1679d30266 from the persistent domain config.
Nov 28 15:54:54 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-90eb7016-a92c-4b89-a9fa-506f6b2f8229 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 193235b9-8ef5-41d0-a9ab-4f1679d30266 from the live domain config. {{(pid=75176) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 15:54:54 user nova-compute[75176]: DEBUG nova.virt.libvirt.guest [None req-90eb7016-a92c-4b89-a9fa-506f6b2f8229 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 15:54:54 user nova-compute[75176]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 15:54:54 user nova-compute[75176]:   <source dev="/dev/sdf"/>
Nov 28 15:54:54 user nova-compute[75176]:   <target dev="vdb" bus="virtio"/>
Nov 28 15:54:54 user nova-compute[75176]:   <serial>7019ee77-2086-41d6-a8a2-9a82042b4047</serial>
Nov 28 15:54:54 user nova-compute[75176]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 15:54:54 user nova-compute[75176]: </disk>
Nov 28 15:54:54 user nova-compute[75176]:  {{(pid=75176) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 15:54:54 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:54:54 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-2c4c8ecb-3ca7-4ffa-88e2-e8fd5eed082f tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] Acquiring lock "742bfe1e-6885-4aba-9f7f-c07a5d904175" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:54:54 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-2c4c8ecb-3ca7-4ffa-88e2-e8fd5eed082f tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] Lock "742bfe1e-6885-4aba-9f7f-c07a5d904175" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:54:54 user nova-compute[75176]: INFO nova.compute.manager [None req-2c4c8ecb-3ca7-4ffa-88e2-e8fd5eed082f tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] [instance: 742bfe1e-6885-4aba-9f7f-c07a5d904175] Detaching volume b5f16a39-1439-433c-ac8b-0610d2382b46
Nov 28 15:54:54 user nova-compute[75176]: INFO nova.virt.block_device [None req-2c4c8ecb-3ca7-4ffa-88e2-e8fd5eed082f tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] [instance: 742bfe1e-6885-4aba-9f7f-c07a5d904175] Attempting to driver detach volume b5f16a39-1439-433c-ac8b-0610d2382b46 from mountpoint /dev/vdc
Nov 28 15:54:54 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-2c4c8ecb-3ca7-4ffa-88e2-e8fd5eed082f tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] Attempting to detach device vdc from instance 742bfe1e-6885-4aba-9f7f-c07a5d904175 from the persistent domain config. {{(pid=75176) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 15:54:54 user nova-compute[75176]: DEBUG nova.virt.libvirt.guest [None req-2c4c8ecb-3ca7-4ffa-88e2-e8fd5eed082f tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 15:54:54 user nova-compute[75176]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 15:54:54 user nova-compute[75176]:   <source dev="/dev/sdg"/>
Nov 28 15:54:54 user nova-compute[75176]:   <target dev="vdc" bus="virtio"/>
Nov 28 15:54:54 user nova-compute[75176]:   <serial>b5f16a39-1439-433c-ac8b-0610d2382b46</serial>
Nov 28 15:54:54 user nova-compute[75176]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 28 15:54:54 user nova-compute[75176]: </disk>
Nov 28 15:54:54 user nova-compute[75176]:  {{(pid=75176) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 15:54:54 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-2c4c8ecb-3ca7-4ffa-88e2-e8fd5eed082f tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] Successfully detached device vdc from instance 742bfe1e-6885-4aba-9f7f-c07a5d904175 from the persistent domain config.
Nov 28 15:54:54 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-2c4c8ecb-3ca7-4ffa-88e2-e8fd5eed082f tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 742bfe1e-6885-4aba-9f7f-c07a5d904175 from the live domain config. {{(pid=75176) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 15:54:54 user nova-compute[75176]: DEBUG nova.virt.libvirt.guest [None req-2c4c8ecb-3ca7-4ffa-88e2-e8fd5eed082f tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 15:54:54 user nova-compute[75176]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 15:54:54 user nova-compute[75176]:   <source dev="/dev/sdg"/>
Nov 28 15:54:54 user nova-compute[75176]:   <target dev="vdc" bus="virtio"/>
Nov 28 15:54:54 user nova-compute[75176]:   <serial>b5f16a39-1439-433c-ac8b-0610d2382b46</serial>
Nov 28 15:54:54 user nova-compute[75176]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 28 15:54:54 user nova-compute[75176]: </disk>
Nov 28 15:54:54 user nova-compute[75176]:  {{(pid=75176) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 15:54:54 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-90eb7016-a92c-4b89-a9fa-506f6b2f8229 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 193235b9-8ef5-41d0-a9ab-4f1679d30266 {{(pid=75176) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 15:54:55 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-2c4c8ecb-3ca7-4ffa-88e2-e8fd5eed082f tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 742bfe1e-6885-4aba-9f7f-c07a5d904175 {{(pid=75176) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 15:54:59 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:54:59 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:54:59 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=75176) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 15:54:59 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75176) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 15:54:59 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75176) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 15:54:59 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:54:59 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:55:00 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:55:00 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:55:00 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:55:00 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:55:00 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:55:00 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Cleaning up deleted instances {{(pid=75176) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 28 15:55:00 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] There are 0 instances to clean {{(pid=75176) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 28 15:55:01 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:55:01 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:55:01 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75176) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 15:55:02 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:55:04 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:55:04 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:55:04 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:55:04 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Starting heal instance info cache {{(pid=75176) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 15:55:04 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquiring lock "refresh_cache-8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:55:04 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquired lock "refresh_cache-8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:55:04 user nova-compute[75176]: DEBUG nova.network.neutron [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] [instance: 8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7] Forcefully refreshing network info cache for instance {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 15:55:05 user nova-compute[75176]: DEBUG nova.network.neutron [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] [instance: 8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7] Updating instance_info_cache with network_info: [{"id": "dcbed8eb-5414-44c1-a7d9-2358d4549f99", "address": "fa:16:3e:fd:e1:90", "network": {"id": "d47c1797-a66f-4f2d-b83e-903b5bd3251c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1416388789-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd2856ce0a2545cda0b796eb0be10a40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcbed8eb-54", "ovs_interfaceid": "dcbed8eb-5414-44c1-a7d9-2358d4549f99", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:55:05 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Releasing lock "refresh_cache-8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:55:05 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] [instance: 8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7] Updated the network info_cache for instance {{(pid=75176) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 15:55:05 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:55:05 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75176) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 28 15:55:06 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:55:06 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:55:06 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:55:06 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:55:06 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Auditing locally available compute resources for user (node: user) {{(pid=75176) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 15:55:06 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55febf04-14ea-4903-8692-c7cc6115de75/disk.rescue --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:55:07 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55febf04-14ea-4903-8692-c7cc6115de75/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:55:07 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55febf04-14ea-4903-8692-c7cc6115de75/disk.rescue --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:55:07 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55febf04-14ea-4903-8692-c7cc6115de75/disk.rescue --force-share --output=json" returned: 0 in 0.198s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:55:07 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55febf04-14ea-4903-8692-c7cc6115de75/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:55:07 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55febf04-14ea-4903-8692-c7cc6115de75/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:55:07 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55febf04-14ea-4903-8692-c7cc6115de75/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:55:07 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55febf04-14ea-4903-8692-c7cc6115de75/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:55:07 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/193235b9-8ef5-41d0-a9ab-4f1679d30266/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:55:07 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/193235b9-8ef5-41d0-a9ab-4f1679d30266/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:55:07 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/193235b9-8ef5-41d0-a9ab-4f1679d30266/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:55:08 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/193235b9-8ef5-41d0-a9ab-4f1679d30266/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:55:08 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e8507b7-fccf-4196-b589-bf2b74f165ec/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:55:08 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e8507b7-fccf-4196-b589-bf2b74f165ec/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:55:08 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e8507b7-fccf-4196-b589-bf2b74f165ec/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:55:08 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e8507b7-fccf-4196-b589-bf2b74f165ec/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:55:08 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c154591-b130-4aa4-aad4-4c85324512df/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:55:08 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c154591-b130-4aa4-aad4-4c85324512df/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:55:08 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c154591-b130-4aa4-aad4-4c85324512df/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:55:08 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c154591-b130-4aa4-aad4-4c85324512df/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:55:08 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecabea76-6c29-412d-bf77-989917b449a9/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:55:08 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecabea76-6c29-412d-bf77-989917b449a9/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:55:09 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecabea76-6c29-412d-bf77-989917b449a9/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:55:09 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecabea76-6c29-412d-bf77-989917b449a9/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:55:09 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/742bfe1e-6885-4aba-9f7f-c07a5d904175/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:55:09 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/742bfe1e-6885-4aba-9f7f-c07a5d904175/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:55:09 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/742bfe1e-6885-4aba-9f7f-c07a5d904175/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:55:09 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:55:09 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/742bfe1e-6885-4aba-9f7f-c07a5d904175/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:55:09 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75176) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 15:55:09 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75176) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 15:55:09 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75176) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 15:55:09 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc4e6d39-adfb-4d26-afef-46f316ff7846/disk.rescue --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:55:09 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc4e6d39-adfb-4d26-afef-46f316ff7846/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:55:09 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc4e6d39-adfb-4d26-afef-46f316ff7846/disk.rescue --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:55:09 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc4e6d39-adfb-4d26-afef-46f316ff7846/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:55:09 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66ead7d-98f4-4822-9dce-f2ea0206a58d/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:55:10 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66ead7d-98f4-4822-9dce-f2ea0206a58d/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:55:10 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66ead7d-98f4-4822-9dce-f2ea0206a58d/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:55:10 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66ead7d-98f4-4822-9dce-f2ea0206a58d/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:55:10 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7/disk.rescue --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:55:10 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:55:10 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7/disk.rescue --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:55:10 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:55:10 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:55:10 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:55:10 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:55:11 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:55:11 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75176) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 15:55:11 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 15:55:11 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 15:55:11 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Hypervisor/Node resource view: name=user free_ram=7165MB free_disk=25.03787612915039GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75176) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 15:55:11 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:55:11 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:55:11 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance 2e8507b7-fccf-4196-b589-bf2b74f165ec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:55:11 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance f66ead7d-98f4-4822-9dce-f2ea0206a58d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:55:11 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance 55febf04-14ea-4903-8692-c7cc6115de75 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:55:11 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance 8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:55:11 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance dc4e6d39-adfb-4d26-afef-46f316ff7846 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:55:11 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance 6161cab2-eb1f-44cb-bbd5-077e6db42f77 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:55:11 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance 742bfe1e-6885-4aba-9f7f-c07a5d904175 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:55:11 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance 193235b9-8ef5-41d0-a9ab-4f1679d30266 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:55:11 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance ecabea76-6c29-412d-bf77-989917b449a9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:55:11 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance 2c154591-b130-4aa4-aad4-4c85324512df actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:55:11 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance f1b1fc0f-1865-4020-91ee-25a5e16127cf actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:55:11 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75176) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 15:55:11 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75176) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 15:55:11 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Refreshing inventories for resource provider b37848d8-f401-4155-a029-b0ffa09ff85b {{(pid=75176) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 28 15:55:11 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Updating ProviderTree inventory for provider b37848d8-f401-4155-a029-b0ffa09ff85b from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75176) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 28 15:55:11 user nova-compute[75176]: DEBUG nova.compute.provider_tree [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Updating inventory in ProviderTree for provider b37848d8-f401-4155-a029-b0ffa09ff85b with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75176) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 28 15:55:11 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Refreshing aggregate associations for resource provider b37848d8-f401-4155-a029-b0ffa09ff85b, aggregates: None {{(pid=75176) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 28 15:55:11 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Refreshing trait associations for resource provider b37848d8-f401-4155-a029-b0ffa09ff85b, traits: COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_RESCUE_BFV,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NODE,HW_CPU_X86_SSSE3,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE42,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE2,COMPUTE_ACCELERATORS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VIRTIO {{(pid=75176) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 28 15:55:12 user nova-compute[75176]: DEBUG nova.compute.provider_tree [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Inventory has not changed in ProviderTree for provider: b37848d8-f401-4155-a029-b0ffa09ff85b {{(pid=75176) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 15:55:12 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Inventory has not changed for provider b37848d8-f401-4155-a029-b0ffa09ff85b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75176) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 15:55:12 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Compute_service record updated for user:user {{(pid=75176) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 15:55:12 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.783s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:55:14 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:55:14 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:55:14 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75176) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 15:55:14 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75176) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 15:55:14 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75176) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 15:55:14 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:55:14 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-90eb7016-a92c-4b89-a9fa-506f6b2f8229 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 193235b9-8ef5-41d0-a9ab-4f1679d30266 is timed out.
Nov 28 15:55:14 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-90eb7016-a92c-4b89-a9fa-506f6b2f8229 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Successfully detached device vdb from instance 193235b9-8ef5-41d0-a9ab-4f1679d30266 from the live domain config.
Nov 28 15:55:14 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-90eb7016-a92c-4b89-a9fa-506f6b2f8229 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] [instance: 193235b9-8ef5-41d0-a9ab-4f1679d30266] calling os-brick to detach iSCSI Volume {{(pid=75176) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 15:55:14 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-90eb7016-a92c-4b89-a9fa-506f6b2f8229 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c1b8a00>, {'target_iqn': 'iqn.2010-10.org.openstack:7019ee77-2086-41d6-a8a2-9a82042b4047', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QiYWSAVH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 15:55:14 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-90eb7016-a92c-4b89-a9fa-506f6b2f8229 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 15:55:14 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-90eb7016-a92c-4b89-a9fa-506f6b2f8229 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 15:55:14 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-90eb7016-a92c-4b89-a9fa-506f6b2f8229 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 15:55:14 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:55:14 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:55:14 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[53a8a32b-790a-4113-91a3-a47735e6ddbc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4a147af7-f082-42cf-ae1c-e5b98314a152\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7019ee77-2086-41d6-a8a2-9a82042b4047\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b5f16a39-1439-433c-ac8b-0610d2382b46\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:55:14 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-90eb7016-a92c-4b89-a9fa-506f6b2f8229 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 15:55:14 user nova-compute[75176]: No targets found.
Nov 28 15:55:14 user nova-compute[75176]: iSNS:
Nov 28 15:55:14 user nova-compute[75176]: No targets found.
Nov 28 15:55:14 user nova-compute[75176]: STATIC:
Nov 28 15:55:14 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:4a147af7-f082-42cf-ae1c-e5b98314a152
Nov 28 15:55:14 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:55:14 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:55:14 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0
Nov 28 15:55:14 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:55:14 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:55:14 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6
Nov 28 15:55:14 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:55:14 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:55:14 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc
Nov 28 15:55:14 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:55:14 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:55:14 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:7019ee77-2086-41d6-a8a2-9a82042b4047
Nov 28 15:55:14 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:55:14 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:55:14 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:b5f16a39-1439-433c-ac8b-0610d2382b46
Nov 28 15:55:14 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:55:14 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:55:14 user nova-compute[75176]: FIRMWARE:
Nov 28 15:55:14 user nova-compute[75176]: No targets found.
Nov 28 15:55:14 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:55:14 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-90eb7016-a92c-4b89-a9fa-506f6b2f8229 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 15:55:14 user nova-compute[75176]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 15:55:14 user nova-compute[75176]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75176) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 15:55:14 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-90eb7016-a92c-4b89-a9fa-506f6b2f8229 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7019ee77-2086-41d6-a8a2-9a82042b4047', 0)] {{(pid=75176) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 15:55:14 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:55:14 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:55:14 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb3a4a1a-4365-4ca8-92f6-aa1bf1b06a23]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4a147af7-f082-42cf-ae1c-e5b98314a152\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7019ee77-2086-41d6-a8a2-9a82042b4047\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b5f16a39-1439-433c-ac8b-0610d2382b46\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:55:14 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:55:14 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:55:14 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[e536a2eb-abf3-415c-aa1a-68ff42439a68]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a147af7-f082-42cf-ae1c-e5b98314a152 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7019ee77-2086-41d6-a8a2-9a82042b4047 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5f16a39-1439-433c-ac8b-0610d2382b46 (non-flash)\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:55:14 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-90eb7016-a92c-4b89-a9fa-506f6b2f8229 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 (non-flash)
Nov 28 15:55:14 user nova-compute[75176]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc (non-flash)
Nov 28 15:55:14 user nova-compute[75176]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0 (non-flash)
Nov 28 15:55:14 user nova-compute[75176]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a147af7-f082-42cf-ae1c-e5b98314a152 (non-flash)
Nov 28 15:55:14 user nova-compute[75176]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7019ee77-2086-41d6-a8a2-9a82042b4047 (non-flash)
Nov 28 15:55:14 user nova-compute[75176]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5f16a39-1439-433c-ac8b-0610d2382b46 (non-flash)
Nov 28 15:55:14 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:55:14 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-90eb7016-a92c-4b89-a9fa-506f6b2f8229 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 (non-flash)
Nov 28 15:55:14 user nova-compute[75176]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc (non-flash)
Nov 28 15:55:14 user nova-compute[75176]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0 (non-flash)
Nov 28 15:55:14 user nova-compute[75176]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a147af7-f082-42cf-ae1c-e5b98314a152 (non-flash)
Nov 28 15:55:14 user nova-compute[75176]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7019ee77-2086-41d6-a8a2-9a82042b4047 (non-flash)
Nov 28 15:55:14 user nova-compute[75176]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5f16a39-1439-433c-ac8b-0610d2382b46 (non-flash)
Nov 28 15:55:14 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 15:55:14 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-90eb7016-a92c-4b89-a9fa-506f6b2f8229 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f464c0d2440>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7019ee77-2086-41d6-a8a2-9a82042b4047'): ({'sdf'}, set())}) {{(pid=75176) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 15:55:14 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-90eb7016-a92c-4b89-a9fa-506f6b2f8229 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Removing single pathed devices sdf {{(pid=75176) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 15:55:14 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:55:15 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:55:15 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[e93d6be4-1b62-41d5-98f5-911b2ed4a3b4]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:55:15 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:55:15 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:55:15 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[91d3a5a0-fac6-4a99-acd7-ecf92a5554ff]: (4, ('ok\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:55:15 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-90eb7016-a92c-4b89-a9fa-506f6b2f8229 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Flushing IO for device /dev/sdf {{(pid=75176) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 15:55:15 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:55:15 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.012s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:55:15 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[693d5948-eb4c-4d28-b4f3-95d9b3699adc]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:55:15 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-90eb7016-a92c-4b89-a9fa-506f6b2f8229 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75176) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 15:55:15 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:55:15 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.049s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:55:15 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[49bb5918-9e41-4a7d-893a-ed7f1ddfaf14]: (4, ('1', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:55:15 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-90eb7016-a92c-4b89-a9fa-506f6b2f8229 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75176) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 15:55:15 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-90eb7016-a92c-4b89-a9fa-506f6b2f8229 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] SCSI volumes sdf have been removed. {{(pid=75176) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 15:55:15 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-90eb7016-a92c-4b89-a9fa-506f6b2f8229 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7019ee77-2086-41d6-a8a2-9a82042b4047')] {{(pid=75176) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 15:55:15 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7019ee77-2086-41d6-a8a2-9a82042b4047 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:55:15 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7019ee77-2086-41d6-a8a2-9a82042b4047 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:55:15 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[258a66b8-37ab-48b8-85a5-82a632313e38]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:55:15 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-90eb7016-a92c-4b89-a9fa-506f6b2f8229 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:55:15 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7019ee77-2086-41d6-a8a2-9a82042b4047 -p 172.16.0.220:3260 --logout {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:55:15 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7019ee77-2086-41d6-a8a2-9a82042b4047 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:55:15 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0229e5d-e2e7-4bd0-a2ba-54e3531cc40d]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:7019ee77-2086-41d6-a8a2-9a82042b4047, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:7019ee77-2086-41d6-a8a2-9a82042b4047, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:55:15 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-90eb7016-a92c-4b89-a9fa-506f6b2f8229 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:7019ee77-2086-41d6-a8a2-9a82042b4047, portal: 172.16.0.220,3260]
Nov 28 15:55:15 user nova-compute[75176]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:7019ee77-2086-41d6-a8a2-9a82042b4047, portal: 172.16.0.220,3260] successful.
Nov 28 15:55:15 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:55:15 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7019ee77-2086-41d6-a8a2-9a82042b4047 -p 172.16.0.220:3260 --op delete {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:55:15 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:55:15 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7019ee77-2086-41d6-a8a2-9a82042b4047 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:55:15 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[4341d26b-53f9-4e9a-b983-ba9e33aa7764]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:55:15 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-90eb7016-a92c-4b89-a9fa-506f6b2f8229 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:55:15 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-90eb7016-a92c-4b89-a9fa-506f6b2f8229 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.325s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 15:55:15 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-90eb7016-a92c-4b89-a9fa-506f6b2f8229 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] <== disconnect_volume: return (327ms) None {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 15:55:15 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-90eb7016-a92c-4b89-a9fa-506f6b2f8229 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] [instance: 193235b9-8ef5-41d0-a9ab-4f1679d30266] Disconnected iSCSI Volume {{(pid=75176) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 15:55:15 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-2c4c8ecb-3ca7-4ffa-88e2-e8fd5eed082f tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 742bfe1e-6885-4aba-9f7f-c07a5d904175 is timed out.
Nov 28 15:55:15 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-2c4c8ecb-3ca7-4ffa-88e2-e8fd5eed082f tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] Successfully detached device vdc from instance 742bfe1e-6885-4aba-9f7f-c07a5d904175 from the live domain config.
Nov 28 15:55:15 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c4c8ecb-3ca7-4ffa-88e2-e8fd5eed082f tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] [instance: 742bfe1e-6885-4aba-9f7f-c07a5d904175] calling os-brick to detach iSCSI Volume {{(pid=75176) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 15:55:15 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c4c8ecb-3ca7-4ffa-88e2-e8fd5eed082f tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c1b8a00>, {'target_iqn': 'iqn.2010-10.org.openstack:b5f16a39-1439-433c-ac8b-0610d2382b46', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gFGRbcpj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 15:55:15 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-2c4c8ecb-3ca7-4ffa-88e2-e8fd5eed082f tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 15:55:15 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-2c4c8ecb-3ca7-4ffa-88e2-e8fd5eed082f tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 15:55:15 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-2c4c8ecb-3ca7-4ffa-88e2-e8fd5eed082f tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 15:55:15 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:55:15 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:55:15 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c7f4ab7-a8b2-4dd8-a81b-3df338589806]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4a147af7-f082-42cf-ae1c-e5b98314a152\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b5f16a39-1439-433c-ac8b-0610d2382b46\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:55:15 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c4c8ecb-3ca7-4ffa-88e2-e8fd5eed082f tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 15:55:15 user nova-compute[75176]: No targets found.
Nov 28 15:55:15 user nova-compute[75176]: iSNS:
Nov 28 15:55:15 user nova-compute[75176]: No targets found.
Nov 28 15:55:15 user nova-compute[75176]: STATIC:
Nov 28 15:55:15 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:4a147af7-f082-42cf-ae1c-e5b98314a152
Nov 28 15:55:15 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:55:15 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:55:15 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0
Nov 28 15:55:15 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:55:15 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:55:15 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6
Nov 28 15:55:15 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:55:15 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:55:15 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc
Nov 28 15:55:15 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:55:15 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:55:15 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:b5f16a39-1439-433c-ac8b-0610d2382b46
Nov 28 15:55:15 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:55:15 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:55:15 user nova-compute[75176]: FIRMWARE:
Nov 28 15:55:15 user nova-compute[75176]: No targets found.
Nov 28 15:55:15 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:55:15 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c4c8ecb-3ca7-4ffa-88e2-e8fd5eed082f tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 15:55:15 user nova-compute[75176]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 15:55:15 user nova-compute[75176]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75176) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 15:55:15 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c4c8ecb-3ca7-4ffa-88e2-e8fd5eed082f tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b5f16a39-1439-433c-ac8b-0610d2382b46', 0)] {{(pid=75176) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 15:55:15 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:55:15 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:55:15 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[c375dc1d-ad49-42a4-9b57-ff79f1c14ede]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4a147af7-f082-42cf-ae1c-e5b98314a152\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b5f16a39-1439-433c-ac8b-0610d2382b46\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:55:15 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:55:15 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:55:15 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d6dafd3-cecc-4b48-a656-86b0fd702df7]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a147af7-f082-42cf-ae1c-e5b98314a152 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5f16a39-1439-433c-ac8b-0610d2382b46 (non-flash)\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:55:15 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c4c8ecb-3ca7-4ffa-88e2-e8fd5eed082f tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 (non-flash)
Nov 28 15:55:15 user nova-compute[75176]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc (non-flash)
Nov 28 15:55:15 user nova-compute[75176]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0 (non-flash)
Nov 28 15:55:15 user nova-compute[75176]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a147af7-f082-42cf-ae1c-e5b98314a152 (non-flash)
Nov 28 15:55:15 user nova-compute[75176]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5f16a39-1439-433c-ac8b-0610d2382b46 (non-flash)
Nov 28 15:55:15 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:55:15 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c4c8ecb-3ca7-4ffa-88e2-e8fd5eed082f tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 (non-flash)
Nov 28 15:55:15 user nova-compute[75176]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc (non-flash)
Nov 28 15:55:15 user nova-compute[75176]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0 (non-flash)
Nov 28 15:55:15 user nova-compute[75176]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a147af7-f082-42cf-ae1c-e5b98314a152 (non-flash)
Nov 28 15:55:15 user nova-compute[75176]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5f16a39-1439-433c-ac8b-0610d2382b46 (non-flash)
Nov 28 15:55:15 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 15:55:15 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c4c8ecb-3ca7-4ffa-88e2-e8fd5eed082f tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f462c55e5f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b5f16a39-1439-433c-ac8b-0610d2382b46'): ({'sdg'}, set())}) {{(pid=75176) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 15:55:15 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-2c4c8ecb-3ca7-4ffa-88e2-e8fd5eed082f tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] Removing single pathed devices sdg {{(pid=75176) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 15:55:15 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:55:15 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:55:15 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b9c2d0d-0d72-4516-becf-754d8177cdb7]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:55:15 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:55:15 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.020s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:55:15 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[a253355c-d57f-4342-ad53-075642db4ff8]: (4, ('ok\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:55:15 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-2c4c8ecb-3ca7-4ffa-88e2-e8fd5eed082f tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] Flushing IO for device /dev/sdg {{(pid=75176) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 15:55:15 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:55:15 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.015s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:55:15 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[afd586ec-6ecd-48f9-864c-9c17368bb0bd]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:55:15 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-2c4c8ecb-3ca7-4ffa-88e2-e8fd5eed082f tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75176) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 15:55:15 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:55:15 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.048s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:55:15 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[2705f26f-5d1b-423d-9bc2-c3becfe719b4]: (4, ('1', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:55:15 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-2c4c8ecb-3ca7-4ffa-88e2-e8fd5eed082f tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75176) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 15:55:15 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-2c4c8ecb-3ca7-4ffa-88e2-e8fd5eed082f tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] SCSI volumes sdg have been removed. {{(pid=75176) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 15:55:15 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c4c8ecb-3ca7-4ffa-88e2-e8fd5eed082f tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b5f16a39-1439-433c-ac8b-0610d2382b46')] {{(pid=75176) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 15:55:15 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5f16a39-1439-433c-ac8b-0610d2382b46 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:55:15 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5f16a39-1439-433c-ac8b-0610d2382b46 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:55:15 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[4641b7dc-7cfe-4b73-b801-ac9dfd881fea]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:55:15 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c4c8ecb-3ca7-4ffa-88e2-e8fd5eed082f tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:55:15 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5f16a39-1439-433c-ac8b-0610d2382b46 -p 172.16.0.220:3260 --logout {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:55:15 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5f16a39-1439-433c-ac8b-0610d2382b46 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:55:15 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecc4be7d-5028-4382-84e7-641722019c93]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:b5f16a39-1439-433c-ac8b-0610d2382b46, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:b5f16a39-1439-433c-ac8b-0610d2382b46, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:55:15 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c4c8ecb-3ca7-4ffa-88e2-e8fd5eed082f tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:b5f16a39-1439-433c-ac8b-0610d2382b46, portal: 172.16.0.220,3260]
Nov 28 15:55:15 user nova-compute[75176]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:b5f16a39-1439-433c-ac8b-0610d2382b46, portal: 172.16.0.220,3260] successful.
Nov 28 15:55:15 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:55:15 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5f16a39-1439-433c-ac8b-0610d2382b46 -p 172.16.0.220:3260 --op delete {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:55:15 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5f16a39-1439-433c-ac8b-0610d2382b46 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:55:15 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[6992dd52-7e92-49ce-b8d9-fdb071cadbe3]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:55:15 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c4c8ecb-3ca7-4ffa-88e2-e8fd5eed082f tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:55:15 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-2c4c8ecb-3ca7-4ffa-88e2-e8fd5eed082f tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.339s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 15:55:15 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c4c8ecb-3ca7-4ffa-88e2-e8fd5eed082f tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] <== disconnect_volume: return (340ms) None {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 15:55:15 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c4c8ecb-3ca7-4ffa-88e2-e8fd5eed082f tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] [instance: 742bfe1e-6885-4aba-9f7f-c07a5d904175] Disconnected iSCSI Volume {{(pid=75176) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 15:55:15 user nova-compute[75176]: DEBUG nova.objects.instance [None req-90eb7016-a92c-4b89-a9fa-506f6b2f8229 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Lazy-loading 'flavor' on Instance uuid 193235b9-8ef5-41d0-a9ab-4f1679d30266 {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:55:16 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-90eb7016-a92c-4b89-a9fa-506f6b2f8229 tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Lock "193235b9-8ef5-41d0-a9ab-4f1679d30266" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.758s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:55:16 user nova-compute[75176]: DEBUG nova.objects.instance [None req-2c4c8ecb-3ca7-4ffa-88e2-e8fd5eed082f tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] Lazy-loading 'flavor' on Instance uuid 742bfe1e-6885-4aba-9f7f-c07a5d904175 {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:55:16 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-2c4c8ecb-3ca7-4ffa-88e2-e8fd5eed082f tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] Lock "742bfe1e-6885-4aba-9f7f-c07a5d904175" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.800s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:55:18 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:55:19 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:55:19 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:55:24 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:55:24 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:55:24 user nova-compute[75176]: DEBUG nova.compute.manager [req-36851e0a-ef3f-40f1-bdba-215b29a91102 req-d5071e9c-2690-4b72-8808-7a267aa2ea8e service nova] [instance: ecabea76-6c29-412d-bf77-989917b449a9] Received event network-changed-1c8a679e-a301-43a1-81fa-6a80def1bade {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:55:24 user nova-compute[75176]: DEBUG nova.compute.manager [req-36851e0a-ef3f-40f1-bdba-215b29a91102 req-d5071e9c-2690-4b72-8808-7a267aa2ea8e service nova] [instance: ecabea76-6c29-412d-bf77-989917b449a9] Refreshing instance network info cache due to event network-changed-1c8a679e-a301-43a1-81fa-6a80def1bade. {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 15:55:24 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-36851e0a-ef3f-40f1-bdba-215b29a91102 req-d5071e9c-2690-4b72-8808-7a267aa2ea8e service nova] Acquiring lock "refresh_cache-ecabea76-6c29-412d-bf77-989917b449a9" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:55:24 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-36851e0a-ef3f-40f1-bdba-215b29a91102 req-d5071e9c-2690-4b72-8808-7a267aa2ea8e service nova] Acquired lock "refresh_cache-ecabea76-6c29-412d-bf77-989917b449a9" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:55:24 user nova-compute[75176]: DEBUG nova.network.neutron [req-36851e0a-ef3f-40f1-bdba-215b29a91102 req-d5071e9c-2690-4b72-8808-7a267aa2ea8e service nova] [instance: ecabea76-6c29-412d-bf77-989917b449a9] Refreshing network info cache for port 1c8a679e-a301-43a1-81fa-6a80def1bade {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 15:55:25 user nova-compute[75176]: DEBUG nova.network.neutron [req-36851e0a-ef3f-40f1-bdba-215b29a91102 req-d5071e9c-2690-4b72-8808-7a267aa2ea8e service nova] [instance: ecabea76-6c29-412d-bf77-989917b449a9] Updated VIF entry in instance network info cache for port 1c8a679e-a301-43a1-81fa-6a80def1bade. {{(pid=75176) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 15:55:25 user nova-compute[75176]: DEBUG nova.network.neutron [req-36851e0a-ef3f-40f1-bdba-215b29a91102 req-d5071e9c-2690-4b72-8808-7a267aa2ea8e service nova] [instance: ecabea76-6c29-412d-bf77-989917b449a9] Updating instance_info_cache with network_info: [{"id": "1c8a679e-a301-43a1-81fa-6a80def1bade", "address": "fa:16:3e:7e:b3:fc", "network": {"id": "1fd59c02-7617-4d0e-9456-84d6cc91ce3b", "bridge": "br-int", "label": "tempest-TestStampPattern-116968826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4a10ba40c844955b63cb8603dd548cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c8a679e-a3", "ovs_interfaceid": "1c8a679e-a301-43a1-81fa-6a80def1bade", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:55:25 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-36851e0a-ef3f-40f1-bdba-215b29a91102 req-d5071e9c-2690-4b72-8808-7a267aa2ea8e service nova] Releasing lock "refresh_cache-ecabea76-6c29-412d-bf77-989917b449a9" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:55:25 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-e6dd9ff1-2cb5-4d9c-886c-262066874841 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Acquiring lock "ecabea76-6c29-412d-bf77-989917b449a9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:55:25 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-e6dd9ff1-2cb5-4d9c-886c-262066874841 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Lock "ecabea76-6c29-412d-bf77-989917b449a9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:55:25 user nova-compute[75176]: DEBUG nova.objects.instance [None req-e6dd9ff1-2cb5-4d9c-886c-262066874841 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Lazy-loading 'flavor' on Instance uuid ecabea76-6c29-412d-bf77-989917b449a9 {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:55:25 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-e6dd9ff1-2cb5-4d9c-886c-262066874841 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Lock "ecabea76-6c29-412d-bf77-989917b449a9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:55:25 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-e6dd9ff1-2cb5-4d9c-886c-262066874841 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Acquiring lock "ecabea76-6c29-412d-bf77-989917b449a9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:55:25 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-e6dd9ff1-2cb5-4d9c-886c-262066874841 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Lock "ecabea76-6c29-412d-bf77-989917b449a9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:55:25 user nova-compute[75176]: INFO nova.compute.manager [None req-e6dd9ff1-2cb5-4d9c-886c-262066874841 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] [instance: ecabea76-6c29-412d-bf77-989917b449a9] Attaching volume f95c57b0-7531-4206-81ae-6f8f993da96c to /dev/vdb
Nov 28 15:55:25 user nova-compute[75176]: DEBUG os_brick.utils [None req-e6dd9ff1-2cb5-4d9c-886c-262066874841 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 15:55:25 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:55:25 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:55:25 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[952b797f-c50e-4c42-a766-453fc991d3e0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:edc924a949b2\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:55:25 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:55:25 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:55:25 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd93963b-3dd1-4ef6-a678-a8b81c1ea5b8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:55:25 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:55:25 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:55:25 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[15db2f5d-fb9a-4685-813b-30d9e4672bf6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:55:25 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[08f03904-9827-48b9-9ce2-fe1743fd1f08]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:55:25 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-e6dd9ff1-2cb5-4d9c-886c-262066874841 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Running cmd (subprocess): nvme version {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:55:25 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-e6dd9ff1-2cb5-4d9c-886c-262066874841 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] 'nvme version' failed. Not Retrying. {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 15:55:25 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e6dd9ff1-2cb5-4d9c-886c-262066874841 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] nvme not present on system {{(pid=75176) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 15:55:25 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:55:25 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 15:55:25 user nova-compute[75176]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 15:55:25 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[027dc8a8-0fa6-4dce-90d9-84794675ea12]: (4, '') {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:55:25 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.lightos [None req-e6dd9ff1-2cb5-4d9c-886c-262066874841 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75176) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 15:55:25 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.lightos [None req-e6dd9ff1-2cb5-4d9c-886c-262066874841 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75176) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 15:55:25 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.lightos [None req-e6dd9ff1-2cb5-4d9c-886c-262066874841 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] LIGHTOS: no hostnqn found. {{(pid=75176) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 15:55:25 user nova-compute[75176]: DEBUG os_brick.utils [None req-e6dd9ff1-2cb5-4d9c-886c-262066874841 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:edc924a949b2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 15:55:25 user nova-compute[75176]: DEBUG nova.virt.block_device [None req-e6dd9ff1-2cb5-4d9c-886c-262066874841 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] [instance: ecabea76-6c29-412d-bf77-989917b449a9] Updating existing volume attachment record: 37197fe4-a3f3-4efd-bd5f-f17cd17ede8d {{(pid=75176) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 15:55:26 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:55:29 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:55:29 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:55:32 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:55:33 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e6dd9ff1-2cb5-4d9c-886c-262066874841 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] [instance: ecabea76-6c29-412d-bf77-989917b449a9] Calling os-brick to attach iSCSI Volume {{(pid=75176) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 15:55:33 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6dd9ff1-2cb5-4d9c-886c-262066874841 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c1b8a00>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f95c57b0-7531-4206-81ae-6f8f993da96c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BvLxsCFZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 15:55:33 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-e6dd9ff1-2cb5-4d9c-886c-262066874841 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 15:55:33 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-e6dd9ff1-2cb5-4d9c-886c-262066874841 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 15:55:33 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-e6dd9ff1-2cb5-4d9c-886c-262066874841 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 15:55:33 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-e6dd9ff1-2cb5-4d9c-886c-262066874841 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 15:55:33 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-e6dd9ff1-2cb5-4d9c-886c-262066874841 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f95c57b0-7531-4206-81ae-6f8f993da96c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 15:55:33 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-e6dd9ff1-2cb5-4d9c-886c-262066874841 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f95c57b0-7531-4206-81ae-6f8f993da96c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 15:55:33 user nova-compute[75176]: INFO os_brick.initiator.connectors.iscsi [None req-e6dd9ff1-2cb5-4d9c-886c-262066874841 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 15:55:33 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f95c57b0-7531-4206-81ae-6f8f993da96c -p 172.16.0.220:3260 {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:55:33 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f95c57b0-7531-4206-81ae-6f8f993da96c -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:55:33 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[9701acb6-1453-4cc6-857f-d7ee40e47fe9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:55:33 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6dd9ff1-2cb5-4d9c-886c-262066874841 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 15:55:33 user nova-compute[75176]:  {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:55:33 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f95c57b0-7531-4206-81ae-6f8f993da96c -p 172.16.0.220:3260 --interface default --op new {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:55:33 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f95c57b0-7531-4206-81ae-6f8f993da96c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:55:33 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f4db56a-c6e5-40d9-b98a-8510326af0a1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f95c57b0-7531-4206-81ae-6f8f993da96c] added\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:55:33 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6dd9ff1-2cb5-4d9c-886c-262066874841 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f95c57b0-7531-4206-81ae-6f8f993da96c] added
Nov 28 15:55:33 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:55:33 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f95c57b0-7531-4206-81ae-6f8f993da96c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:55:33 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f95c57b0-7531-4206-81ae-6f8f993da96c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:55:33 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a9d69c5-3ba2-4b2f-9351-3d1ca1ea6f83]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:55:33 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6dd9ff1-2cb5-4d9c-886c-262066874841 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:55:33 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f95c57b0-7531-4206-81ae-6f8f993da96c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:55:33 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f95c57b0-7531-4206-81ae-6f8f993da96c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:55:33 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[e07eaabe-c1ec-476c-aa35-8893568b20ed]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:55:33 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6dd9ff1-2cb5-4d9c-886c-262066874841 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:55:33 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f95c57b0-7531-4206-81ae-6f8f993da96c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BvLxsCFZ {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:55:33 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f95c57b0-7531-4206-81ae-6f8f993da96c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BvLxsCFZ" returned: 0 in 0.019s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:55:33 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ae4a55b-4f1f-4e97-a91c-8c800713ffff]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:55:33 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6dd9ff1-2cb5-4d9c-886c-262066874841 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BvLxsCFZ'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:55:33 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f95c57b0-7531-4206-81ae-6f8f993da96c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:55:33 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f95c57b0-7531-4206-81ae-6f8f993da96c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:55:33 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[876f0d97-68e0-4d0e-bd84-3c8dda707ec4]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:55:33 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6dd9ff1-2cb5-4d9c-886c-262066874841 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:55:33 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:55:33 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:55:33 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f5e384f-744f-45ca-b0f2-decff5c5f67b]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a147af7-f082-42cf-ae1c-e5b98314a152 (non-flash)\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:55:33 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6dd9ff1-2cb5-4d9c-886c-262066874841 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 (non-flash)
Nov 28 15:55:33 user nova-compute[75176]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc (non-flash)
Nov 28 15:55:33 user nova-compute[75176]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0 (non-flash)
Nov 28 15:55:33 user nova-compute[75176]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a147af7-f082-42cf-ae1c-e5b98314a152 (non-flash)
Nov 28 15:55:33 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:55:33 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6dd9ff1-2cb5-4d9c-886c-262066874841 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 (non-flash)
Nov 28 15:55:33 user nova-compute[75176]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc (non-flash)
Nov 28 15:55:33 user nova-compute[75176]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0 (non-flash)
Nov 28 15:55:33 user nova-compute[75176]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a147af7-f082-42cf-ae1c-e5b98314a152 (non-flash)
Nov 28 15:55:33 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 15:55:33 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f95c57b0-7531-4206-81ae-6f8f993da96c -p 172.16.0.220:3260 --login {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:55:33 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f95c57b0-7531-4206-81ae-6f8f993da96c -p 172.16.0.220:3260 --login" returned: 0 in 0.224s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:55:33 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d7ed201-d083-49b5-ae5f-10dd11688976]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f95c57b0-7531-4206-81ae-6f8f993da96c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f95c57b0-7531-4206-81ae-6f8f993da96c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:55:33 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6dd9ff1-2cb5-4d9c-886c-262066874841 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f95c57b0-7531-4206-81ae-6f8f993da96c, portal: 172.16.0.220,3260]
Nov 28 15:55:33 user nova-compute[75176]: Login to [iface: default, target: iqn.2010-10.org.openstack:f95c57b0-7531-4206-81ae-6f8f993da96c, portal: 172.16.0.220,3260] successful.
Nov 28 15:55:33 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:55:33 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f95c57b0-7531-4206-81ae-6f8f993da96c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:55:33 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f95c57b0-7531-4206-81ae-6f8f993da96c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:55:33 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[36ea48c8-51ad-4fd3-96fa-8d544a4da156]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:55:33 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6dd9ff1-2cb5-4d9c-886c-262066874841 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:55:33 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:55:33 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:55:33 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[70000b7b-0900-49aa-a4a4-81ee4fbdbdbe]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a147af7-f082-42cf-ae1c-e5b98314a152 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f95c57b0-7531-4206-81ae-6f8f993da96c (non-flash)\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:55:33 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6dd9ff1-2cb5-4d9c-886c-262066874841 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 (non-flash)
Nov 28 15:55:33 user nova-compute[75176]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc (non-flash)
Nov 28 15:55:33 user nova-compute[75176]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0 (non-flash)
Nov 28 15:55:33 user nova-compute[75176]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a147af7-f082-42cf-ae1c-e5b98314a152 (non-flash)
Nov 28 15:55:33 user nova-compute[75176]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f95c57b0-7531-4206-81ae-6f8f993da96c (non-flash)
Nov 28 15:55:33 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:55:33 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6dd9ff1-2cb5-4d9c-886c-262066874841 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 (non-flash)
Nov 28 15:55:33 user nova-compute[75176]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc (non-flash)
Nov 28 15:55:33 user nova-compute[75176]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0 (non-flash)
Nov 28 15:55:33 user nova-compute[75176]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a147af7-f082-42cf-ae1c-e5b98314a152 (non-flash)
Nov 28 15:55:33 user nova-compute[75176]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f95c57b0-7531-4206-81ae-6f8f993da96c (non-flash)
Nov 28 15:55:33 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 15:55:33 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-e6dd9ff1-2cb5-4d9c-886c-262066874841 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f95c57b0-7531-4206-81ae-6f8f993da96c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.597s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 15:55:33 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6dd9ff1-2cb5-4d9c-886c-262066874841 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Connected to 172.16.0.220:3260 {{(pid=75176) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 15:55:33 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-e6dd9ff1-2cb5-4d9c-886c-262066874841 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] HCTL ('37', '-', '-', 0) found on session 47 with lun 0 {{(pid=75176) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 15:55:33 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-e6dd9ff1-2cb5-4d9c-886c-262066874841 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75176) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 15:55:33 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:55:33 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.018s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:55:33 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[df742541-86e7-46a5-8840-c3830de9326a]: (4, ('- - 0', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:55:33 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-e6dd9ff1-2cb5-4d9c-886c-262066874841 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Searching for a device in session 47 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75176) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 15:55:33 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6dd9ff1-2cb5-4d9c-886c-262066874841 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:f95c57b0-7531-4206-81ae-6f8f993da96c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BvLxsCFZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75176) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 15:55:34 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:55:34 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-e6dd9ff1-2cb5-4d9c-886c-262066874841 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.632s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 15:55:34 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6dd9ff1-2cb5-4d9c-886c-262066874841 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] <== connect_volume: return (1635ms) {'type': 'block', 'scsi_wwn': '23239663963663665', 'path': '/dev/sdf'} {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 15:55:34 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e6dd9ff1-2cb5-4d9c-886c-262066874841 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] [instance: ecabea76-6c29-412d-bf77-989917b449a9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23239663963663665', 'path': '/dev/sdf'} {{(pid=75176) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 15:55:34 user nova-compute[75176]: DEBUG nova.objects.instance [None req-e6dd9ff1-2cb5-4d9c-886c-262066874841 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Lazy-loading 'flavor' on Instance uuid ecabea76-6c29-412d-bf77-989917b449a9 {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:55:34 user nova-compute[75176]: DEBUG nova.virt.libvirt.guest [None req-e6dd9ff1-2cb5-4d9c-886c-262066874841 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 15:55:34 user nova-compute[75176]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 15:55:34 user nova-compute[75176]:   <source dev="/dev/sdf"/>
Nov 28 15:55:34 user nova-compute[75176]:   <target dev="vdb" bus="virtio"/>
Nov 28 15:55:34 user nova-compute[75176]:   <serial>f95c57b0-7531-4206-81ae-6f8f993da96c</serial>
Nov 28 15:55:34 user nova-compute[75176]: </disk>
Nov 28 15:55:34 user nova-compute[75176]:  {{(pid=75176) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 15:55:35 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-e6dd9ff1-2cb5-4d9c-886c-262066874841 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] No BDM found with device name vda, not building metadata. {{(pid=75176) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 15:55:35 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-e6dd9ff1-2cb5-4d9c-886c-262066874841 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75176) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 15:55:35 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-e6dd9ff1-2cb5-4d9c-886c-262066874841 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] No VIF found with MAC fa:16:3e:7e:b3:fc, not building metadata {{(pid=75176) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 15:55:35 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-e6dd9ff1-2cb5-4d9c-886c-262066874841 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Lock "ecabea76-6c29-412d-bf77-989917b449a9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.013s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:55:36 user nova-compute[75176]: INFO nova.compute.manager [None req-4b21b444-3e4a-4023-9e31-a2c2c7615159 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] [instance: 55febf04-14ea-4903-8692-c7cc6115de75] Unrescuing
Nov 28 15:55:36 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-4b21b444-3e4a-4023-9e31-a2c2c7615159 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Acquiring lock "refresh_cache-55febf04-14ea-4903-8692-c7cc6115de75" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:55:36 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-4b21b444-3e4a-4023-9e31-a2c2c7615159 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Acquired lock "refresh_cache-55febf04-14ea-4903-8692-c7cc6115de75" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:55:36 user nova-compute[75176]: DEBUG nova.network.neutron [None req-4b21b444-3e4a-4023-9e31-a2c2c7615159 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] [instance: 55febf04-14ea-4903-8692-c7cc6115de75] Building network info cache for instance {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 15:55:36 user nova-compute[75176]: DEBUG nova.network.neutron [None req-4b21b444-3e4a-4023-9e31-a2c2c7615159 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] [instance: 55febf04-14ea-4903-8692-c7cc6115de75] Updating instance_info_cache with network_info: [{"id": "e287ec1a-3726-4719-94b2-79764f7abd31", "address": "fa:16:3e:0c:d1:2f", "network": {"id": "d47c1797-a66f-4f2d-b83e-903b5bd3251c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1416388789-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd2856ce0a2545cda0b796eb0be10a40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape287ec1a-37", "ovs_interfaceid": "e287ec1a-3726-4719-94b2-79764f7abd31", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:55:36 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-4b21b444-3e4a-4023-9e31-a2c2c7615159 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Releasing lock "refresh_cache-55febf04-14ea-4903-8692-c7cc6115de75" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:55:36 user nova-compute[75176]: DEBUG nova.objects.instance [None req-4b21b444-3e4a-4023-9e31-a2c2c7615159 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Lazy-loading 'flavor' on Instance uuid 55febf04-14ea-4903-8692-c7cc6115de75 {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:55:36 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:55:36 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:55:37 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:55:37 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:55:37 user nova-compute[75176]: DEBUG nova.compute.manager [req-d096b71a-5aec-4482-aa09-63d2bae78648 req-77a2a238-e0a2-4e16-8cc1-321e75f74e3b service nova] [instance: 55febf04-14ea-4903-8692-c7cc6115de75] Received event network-vif-unplugged-e287ec1a-3726-4719-94b2-79764f7abd31 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:55:37 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-d096b71a-5aec-4482-aa09-63d2bae78648 req-77a2a238-e0a2-4e16-8cc1-321e75f74e3b service nova] Acquiring lock "55febf04-14ea-4903-8692-c7cc6115de75-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:55:37 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-d096b71a-5aec-4482-aa09-63d2bae78648 req-77a2a238-e0a2-4e16-8cc1-321e75f74e3b service nova] Lock "55febf04-14ea-4903-8692-c7cc6115de75-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:55:37 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-d096b71a-5aec-4482-aa09-63d2bae78648 req-77a2a238-e0a2-4e16-8cc1-321e75f74e3b service nova] Lock "55febf04-14ea-4903-8692-c7cc6115de75-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:55:37 user nova-compute[75176]: DEBUG nova.compute.manager [req-d096b71a-5aec-4482-aa09-63d2bae78648 req-77a2a238-e0a2-4e16-8cc1-321e75f74e3b service nova] [instance: 55febf04-14ea-4903-8692-c7cc6115de75] No waiting events found dispatching network-vif-unplugged-e287ec1a-3726-4719-94b2-79764f7abd31 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:55:37 user nova-compute[75176]: WARNING nova.compute.manager [req-d096b71a-5aec-4482-aa09-63d2bae78648 req-77a2a238-e0a2-4e16-8cc1-321e75f74e3b service nova] [instance: 55febf04-14ea-4903-8692-c7cc6115de75] Received unexpected event network-vif-unplugged-e287ec1a-3726-4719-94b2-79764f7abd31 for instance with vm_state rescued and task_state unrescuing.
Nov 28 15:55:37 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-d734dcbe-fc8f-486f-ab26-b80485cb6960 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Acquiring lock "e0b7a064-03b6-4a0d-88be-2f12c12a1ddb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:55:37 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-d734dcbe-fc8f-486f-ab26-b80485cb6960 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Lock "e0b7a064-03b6-4a0d-88be-2f12c12a1ddb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:55:37 user nova-compute[75176]: DEBUG nova.compute.manager [None req-d734dcbe-fc8f-486f-ab26-b80485cb6960 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] [instance: e0b7a064-03b6-4a0d-88be-2f12c12a1ddb] Starting instance... {{(pid=75176) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 15:55:37 user nova-compute[75176]: INFO nova.virt.libvirt.driver [-] [instance: 55febf04-14ea-4903-8692-c7cc6115de75] Instance destroyed successfully.
Nov 28 15:55:37 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-d734dcbe-fc8f-486f-ab26-b80485cb6960 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:55:37 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-d734dcbe-fc8f-486f-ab26-b80485cb6960 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:55:37 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-d734dcbe-fc8f-486f-ab26-b80485cb6960 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75176) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 15:55:37 user nova-compute[75176]: INFO nova.compute.claims [None req-d734dcbe-fc8f-486f-ab26-b80485cb6960 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] [instance: e0b7a064-03b6-4a0d-88be-2f12c12a1ddb] Claim successful on node user
Nov 28 15:55:37 user nova-compute[75176]: DEBUG nova.compute.manager [req-97e522c2-668b-41d8-8fbd-550943941263 req-630acef9-f5a5-4c2d-b212-c1b38162184b service nova] [instance: 2c154591-b130-4aa4-aad4-4c85324512df] Received event network-changed-c743768f-0b40-435a-8754-96784ae96dda {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:55:37 user nova-compute[75176]: DEBUG nova.compute.manager [req-97e522c2-668b-41d8-8fbd-550943941263 req-630acef9-f5a5-4c2d-b212-c1b38162184b service nova] [instance: 2c154591-b130-4aa4-aad4-4c85324512df] Refreshing instance network info cache due to event network-changed-c743768f-0b40-435a-8754-96784ae96dda. {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 15:55:37 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-97e522c2-668b-41d8-8fbd-550943941263 req-630acef9-f5a5-4c2d-b212-c1b38162184b service nova] Acquiring lock "refresh_cache-2c154591-b130-4aa4-aad4-4c85324512df" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:55:37 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-97e522c2-668b-41d8-8fbd-550943941263 req-630acef9-f5a5-4c2d-b212-c1b38162184b service nova] Acquired lock "refresh_cache-2c154591-b130-4aa4-aad4-4c85324512df" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:55:37 user nova-compute[75176]: DEBUG nova.network.neutron [req-97e522c2-668b-41d8-8fbd-550943941263 req-630acef9-f5a5-4c2d-b212-c1b38162184b service nova] [instance: 2c154591-b130-4aa4-aad4-4c85324512df] Refreshing network info cache for port c743768f-0b40-435a-8754-96784ae96dda {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 15:55:37 user nova-compute[75176]: INFO nova.compute.manager [None req-da164ea8-c5d9-4326-862e-e08b76b1edc8 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: dc4e6d39-adfb-4d26-afef-46f316ff7846] Unrescuing
Nov 28 15:55:37 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-da164ea8-c5d9-4326-862e-e08b76b1edc8 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Acquiring lock "refresh_cache-dc4e6d39-adfb-4d26-afef-46f316ff7846" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:55:37 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-da164ea8-c5d9-4326-862e-e08b76b1edc8 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Acquired lock "refresh_cache-dc4e6d39-adfb-4d26-afef-46f316ff7846" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:55:37 user nova-compute[75176]: DEBUG nova.network.neutron [None req-da164ea8-c5d9-4326-862e-e08b76b1edc8 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: dc4e6d39-adfb-4d26-afef-46f316ff7846] Building network info cache for instance {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 15:55:37 user nova-compute[75176]: DEBUG nova.compute.provider_tree [None req-d734dcbe-fc8f-486f-ab26-b80485cb6960 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Inventory has not changed in ProviderTree for provider: b37848d8-f401-4155-a029-b0ffa09ff85b {{(pid=75176) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 15:55:37 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-d734dcbe-fc8f-486f-ab26-b80485cb6960 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Inventory has not changed for provider b37848d8-f401-4155-a029-b0ffa09ff85b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75176) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 15:55:38 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-d734dcbe-fc8f-486f-ab26-b80485cb6960 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.546s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:55:38 user nova-compute[75176]: DEBUG nova.compute.manager [None req-d734dcbe-fc8f-486f-ab26-b80485cb6960 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] [instance: e0b7a064-03b6-4a0d-88be-2f12c12a1ddb] Start building networks asynchronously for instance. {{(pid=75176) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 15:55:38 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-ec25b820-937d-4669-abd8-c60c545787b6 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Acquiring lock "ecabea76-6c29-412d-bf77-989917b449a9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:55:38 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-ec25b820-937d-4669-abd8-c60c545787b6 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Lock "ecabea76-6c29-412d-bf77-989917b449a9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:55:38 user nova-compute[75176]: DEBUG nova.compute.manager [None req-d734dcbe-fc8f-486f-ab26-b80485cb6960 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] [instance: e0b7a064-03b6-4a0d-88be-2f12c12a1ddb] Allocating IP information in the background. {{(pid=75176) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 15:55:38 user nova-compute[75176]: DEBUG nova.network.neutron [None req-d734dcbe-fc8f-486f-ab26-b80485cb6960 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] [instance: e0b7a064-03b6-4a0d-88be-2f12c12a1ddb] allocate_for_instance() {{(pid=75176) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 15:55:38 user nova-compute[75176]: INFO nova.compute.manager [None req-ec25b820-937d-4669-abd8-c60c545787b6 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] [instance: ecabea76-6c29-412d-bf77-989917b449a9] Detaching volume f95c57b0-7531-4206-81ae-6f8f993da96c
Nov 28 15:55:38 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-d734dcbe-fc8f-486f-ab26-b80485cb6960 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] [instance: e0b7a064-03b6-4a0d-88be-2f12c12a1ddb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 15:55:38 user nova-compute[75176]: DEBUG nova.compute.manager [None req-d734dcbe-fc8f-486f-ab26-b80485cb6960 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] [instance: e0b7a064-03b6-4a0d-88be-2f12c12a1ddb] Start building block device mappings for instance. {{(pid=75176) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 15:55:38 user nova-compute[75176]: INFO nova.virt.block_device [None req-ec25b820-937d-4669-abd8-c60c545787b6 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] [instance: ecabea76-6c29-412d-bf77-989917b449a9] Attempting to driver detach volume f95c57b0-7531-4206-81ae-6f8f993da96c from mountpoint /dev/vdb
Nov 28 15:55:38 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-ec25b820-937d-4669-abd8-c60c545787b6 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Attempting to detach device vdb from instance ecabea76-6c29-412d-bf77-989917b449a9 from the persistent domain config. {{(pid=75176) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 15:55:38 user nova-compute[75176]: DEBUG nova.virt.libvirt.guest [None req-ec25b820-937d-4669-abd8-c60c545787b6 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 15:55:38 user nova-compute[75176]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 15:55:38 user nova-compute[75176]:   <source dev="/dev/sdf"/>
Nov 28 15:55:38 user nova-compute[75176]:   <target dev="vdb" bus="virtio"/>
Nov 28 15:55:38 user nova-compute[75176]:   <serial>f95c57b0-7531-4206-81ae-6f8f993da96c</serial>
Nov 28 15:55:38 user nova-compute[75176]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 15:55:38 user nova-compute[75176]: </disk>
Nov 28 15:55:38 user nova-compute[75176]:  {{(pid=75176) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 15:55:38 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-ec25b820-937d-4669-abd8-c60c545787b6 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Successfully detached device vdb from instance ecabea76-6c29-412d-bf77-989917b449a9 from the persistent domain config.
Nov 28 15:55:38 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-ec25b820-937d-4669-abd8-c60c545787b6 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ecabea76-6c29-412d-bf77-989917b449a9 from the live domain config. {{(pid=75176) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 15:55:38 user nova-compute[75176]: DEBUG nova.virt.libvirt.guest [None req-ec25b820-937d-4669-abd8-c60c545787b6 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 15:55:38 user nova-compute[75176]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 15:55:38 user nova-compute[75176]:   <source dev="/dev/sdf"/>
Nov 28 15:55:38 user nova-compute[75176]:   <target dev="vdb" bus="virtio"/>
Nov 28 15:55:38 user nova-compute[75176]:   <serial>f95c57b0-7531-4206-81ae-6f8f993da96c</serial>
Nov 28 15:55:38 user nova-compute[75176]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 15:55:38 user nova-compute[75176]: </disk>
Nov 28 15:55:38 user nova-compute[75176]:  {{(pid=75176) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 15:55:38 user nova-compute[75176]: DEBUG nova.compute.manager [None req-d734dcbe-fc8f-486f-ab26-b80485cb6960 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] [instance: e0b7a064-03b6-4a0d-88be-2f12c12a1ddb] Start spawning the instance on the hypervisor. {{(pid=75176) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 15:55:38 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-d734dcbe-fc8f-486f-ab26-b80485cb6960 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] [instance: e0b7a064-03b6-4a0d-88be-2f12c12a1ddb] Creating instance directory {{(pid=75176) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 15:55:38 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-d734dcbe-fc8f-486f-ab26-b80485cb6960 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] [instance: e0b7a064-03b6-4a0d-88be-2f12c12a1ddb] Creating image(s)
Nov 28 15:55:38 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-d734dcbe-fc8f-486f-ab26-b80485cb6960 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Acquiring lock "/opt/stack/data/nova/instances/e0b7a064-03b6-4a0d-88be-2f12c12a1ddb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:55:38 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-d734dcbe-fc8f-486f-ab26-b80485cb6960 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Lock "/opt/stack/data/nova/instances/e0b7a064-03b6-4a0d-88be-2f12c12a1ddb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:55:38 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-d734dcbe-fc8f-486f-ab26-b80485cb6960 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Lock "/opt/stack/data/nova/instances/e0b7a064-03b6-4a0d-88be-2f12c12a1ddb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:55:38 user nova-compute[75176]: DEBUG nova.policy [None req-d734dcbe-fc8f-486f-ab26-b80485cb6960 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'af0306d7f5704ccc8bf1fe056c8e779e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16cf33057bf84d25bae4a90b74bd7754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75176) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 15:55:38 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-d734dcbe-fc8f-486f-ab26-b80485cb6960 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:55:38 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-d734dcbe-fc8f-486f-ab26-b80485cb6960 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json" returned: 0 in 0.183s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:55:38 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-d734dcbe-fc8f-486f-ab26-b80485cb6960 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Acquiring lock "5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:55:38 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-d734dcbe-fc8f-486f-ab26-b80485cb6960 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Lock "5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:55:38 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-d734dcbe-fc8f-486f-ab26-b80485cb6960 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:55:38 user nova-compute[75176]: DEBUG nova.network.neutron [req-97e522c2-668b-41d8-8fbd-550943941263 req-630acef9-f5a5-4c2d-b212-c1b38162184b service nova] [instance: 2c154591-b130-4aa4-aad4-4c85324512df] Updated VIF entry in instance network info cache for port c743768f-0b40-435a-8754-96784ae96dda. {{(pid=75176) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 15:55:38 user nova-compute[75176]: DEBUG nova.network.neutron [req-97e522c2-668b-41d8-8fbd-550943941263 req-630acef9-f5a5-4c2d-b212-c1b38162184b service nova] [instance: 2c154591-b130-4aa4-aad4-4c85324512df] Updating instance_info_cache with network_info: [{"id": "c743768f-0b40-435a-8754-96784ae96dda", "address": "fa:16:3e:c1:2c:1c", "network": {"id": "5d0ae041-a67d-4a54-bd53-104c4f44209d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-938551772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "169fdaea89d4431aa6adacdbb76f3546", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc743768f-0b", "ovs_interfaceid": "c743768f-0b40-435a-8754-96784ae96dda", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:55:38 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-d734dcbe-fc8f-486f-ab26-b80485cb6960 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json" returned: 0 in 0.200s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:55:38 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-97e522c2-668b-41d8-8fbd-550943941263 req-630acef9-f5a5-4c2d-b212-c1b38162184b service nova] Releasing lock "refresh_cache-2c154591-b130-4aa4-aad4-4c85324512df" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:55:38 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-d734dcbe-fc8f-486f-ab26-b80485cb6960 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2,backing_fmt=raw /opt/stack/data/nova/instances/e0b7a064-03b6-4a0d-88be-2f12c12a1ddb/disk 1073741824 {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:55:38 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-d734dcbe-fc8f-486f-ab26-b80485cb6960 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2,backing_fmt=raw /opt/stack/data/nova/instances/e0b7a064-03b6-4a0d-88be-2f12c12a1ddb/disk 1073741824" returned: 0 in 0.060s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:55:38 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-d734dcbe-fc8f-486f-ab26-b80485cb6960 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Lock "5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.267s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:55:38 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-d734dcbe-fc8f-486f-ab26-b80485cb6960 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:55:38 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-ec25b820-937d-4669-abd8-c60c545787b6 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ecabea76-6c29-412d-bf77-989917b449a9 {{(pid=75176) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 15:55:38 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-d734dcbe-fc8f-486f-ab26-b80485cb6960 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json" returned: 0 in 0.173s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:55:38 user nova-compute[75176]: DEBUG nova.virt.disk.api [None req-d734dcbe-fc8f-486f-ab26-b80485cb6960 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e0b7a064-03b6-4a0d-88be-2f12c12a1ddb/disk. size=1073741824 {{(pid=75176) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 15:55:38 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-d734dcbe-fc8f-486f-ab26-b80485cb6960 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0b7a064-03b6-4a0d-88be-2f12c12a1ddb/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:55:39 user nova-compute[75176]: DEBUG nova.network.neutron [None req-da164ea8-c5d9-4326-862e-e08b76b1edc8 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: dc4e6d39-adfb-4d26-afef-46f316ff7846] Updating instance_info_cache with network_info: [{"id": "65eb3123-182c-40fd-b20c-48b19b833f14", "address": "fa:16:3e:59:4a:59", "network": {"id": "998766cd-2e8e-4e39-add9-286086640993", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-989265510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf05c8836b8a40de8e64c2d046ed71ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65eb3123-18", "ovs_interfaceid": "65eb3123-182c-40fd-b20c-48b19b833f14", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:55:39 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-da164ea8-c5d9-4326-862e-e08b76b1edc8 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Releasing lock "refresh_cache-dc4e6d39-adfb-4d26-afef-46f316ff7846" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:55:39 user nova-compute[75176]: DEBUG nova.objects.instance [None req-da164ea8-c5d9-4326-862e-e08b76b1edc8 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Lazy-loading 'flavor' on Instance uuid dc4e6d39-adfb-4d26-afef-46f316ff7846 {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:55:39 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:55:39 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-d734dcbe-fc8f-486f-ab26-b80485cb6960 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0b7a064-03b6-4a0d-88be-2f12c12a1ddb/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:55:39 user nova-compute[75176]: DEBUG nova.virt.disk.api [None req-d734dcbe-fc8f-486f-ab26-b80485cb6960 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Cannot resize image /opt/stack/data/nova/instances/e0b7a064-03b6-4a0d-88be-2f12c12a1ddb/disk to a smaller size. {{(pid=75176) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 15:55:39 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-d734dcbe-fc8f-486f-ab26-b80485cb6960 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] [instance: e0b7a064-03b6-4a0d-88be-2f12c12a1ddb] Created local disks {{(pid=75176) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 15:55:39 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-d734dcbe-fc8f-486f-ab26-b80485cb6960 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] [instance: e0b7a064-03b6-4a0d-88be-2f12c12a1ddb] Ensure instance console log exists: /opt/stack/data/nova/instances/e0b7a064-03b6-4a0d-88be-2f12c12a1ddb/console.log {{(pid=75176) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 15:55:39 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-d734dcbe-fc8f-486f-ab26-b80485cb6960 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:55:39 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-d734dcbe-fc8f-486f-ab26-b80485cb6960 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:55:39 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-d734dcbe-fc8f-486f-ab26-b80485cb6960 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:55:39 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:55:39 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:55:39 user nova-compute[75176]: DEBUG nova.compute.manager [req-0c49867f-0386-4dd3-becc-0b78517ce272 req-025db494-0783-48a7-8853-96d4d464d41f service nova] [instance: 55febf04-14ea-4903-8692-c7cc6115de75] Received event network-vif-plugged-e287ec1a-3726-4719-94b2-79764f7abd31 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:55:39 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-0c49867f-0386-4dd3-becc-0b78517ce272 req-025db494-0783-48a7-8853-96d4d464d41f service nova] Acquiring lock "55febf04-14ea-4903-8692-c7cc6115de75-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:55:39 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-0c49867f-0386-4dd3-becc-0b78517ce272 req-025db494-0783-48a7-8853-96d4d464d41f service nova] Lock "55febf04-14ea-4903-8692-c7cc6115de75-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:55:39 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-0c49867f-0386-4dd3-becc-0b78517ce272 req-025db494-0783-48a7-8853-96d4d464d41f service nova] Lock "55febf04-14ea-4903-8692-c7cc6115de75-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:55:39 user nova-compute[75176]: DEBUG nova.compute.manager [req-0c49867f-0386-4dd3-becc-0b78517ce272 req-025db494-0783-48a7-8853-96d4d464d41f service nova] [instance: 55febf04-14ea-4903-8692-c7cc6115de75] No waiting events found dispatching network-vif-plugged-e287ec1a-3726-4719-94b2-79764f7abd31 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:55:39 user nova-compute[75176]: WARNING nova.compute.manager [req-0c49867f-0386-4dd3-becc-0b78517ce272 req-025db494-0783-48a7-8853-96d4d464d41f service nova] [instance: 55febf04-14ea-4903-8692-c7cc6115de75] Received unexpected event network-vif-plugged-e287ec1a-3726-4719-94b2-79764f7abd31 for instance with vm_state rescued and task_state unrescuing.
Nov 28 15:55:39 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:55:39 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:55:39 user nova-compute[75176]: DEBUG nova.network.neutron [None req-d734dcbe-fc8f-486f-ab26-b80485cb6960 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] [instance: e0b7a064-03b6-4a0d-88be-2f12c12a1ddb] Successfully created port: 76c02515-a349-4b46-939a-cf520b5f3b33 {{(pid=75176) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 15:55:39 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:55:39 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:55:39 user nova-compute[75176]: DEBUG nova.compute.manager [req-2337ccf6-0a8f-43ef-b224-0eef69cb9342 req-6c3b1aee-72d1-4899-bce8-70ea2f677529 service nova] [instance: dc4e6d39-adfb-4d26-afef-46f316ff7846] Received event network-vif-unplugged-65eb3123-182c-40fd-b20c-48b19b833f14 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:55:39 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-2337ccf6-0a8f-43ef-b224-0eef69cb9342 req-6c3b1aee-72d1-4899-bce8-70ea2f677529 service nova] Acquiring lock "dc4e6d39-adfb-4d26-afef-46f316ff7846-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:55:39 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-2337ccf6-0a8f-43ef-b224-0eef69cb9342 req-6c3b1aee-72d1-4899-bce8-70ea2f677529 service nova] Lock "dc4e6d39-adfb-4d26-afef-46f316ff7846-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:55:39 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-2337ccf6-0a8f-43ef-b224-0eef69cb9342 req-6c3b1aee-72d1-4899-bce8-70ea2f677529 service nova] Lock "dc4e6d39-adfb-4d26-afef-46f316ff7846-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:55:39 user nova-compute[75176]: DEBUG nova.compute.manager [req-2337ccf6-0a8f-43ef-b224-0eef69cb9342 req-6c3b1aee-72d1-4899-bce8-70ea2f677529 service nova] [instance: dc4e6d39-adfb-4d26-afef-46f316ff7846] No waiting events found dispatching network-vif-unplugged-65eb3123-182c-40fd-b20c-48b19b833f14 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:55:39 user nova-compute[75176]: WARNING nova.compute.manager [req-2337ccf6-0a8f-43ef-b224-0eef69cb9342 req-6c3b1aee-72d1-4899-bce8-70ea2f677529 service nova] [instance: dc4e6d39-adfb-4d26-afef-46f316ff7846] Received unexpected event network-vif-unplugged-65eb3123-182c-40fd-b20c-48b19b833f14 for instance with vm_state rescued and task_state unrescuing.
Nov 28 15:55:39 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:55:39 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:55:39 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:55:39 user nova-compute[75176]: INFO nova.virt.libvirt.driver [-] [instance: dc4e6d39-adfb-4d26-afef-46f316ff7846] Instance destroyed successfully.
Nov 28 15:55:39 user nova-compute[75176]: WARNING nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] While synchronizing instance power states, found 12 instances in the database and 11 instances on the hypervisor.
Nov 28 15:55:39 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Triggering sync for uuid 2e8507b7-fccf-4196-b589-bf2b74f165ec {{(pid=75176) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 15:55:39 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Triggering sync for uuid f66ead7d-98f4-4822-9dce-f2ea0206a58d {{(pid=75176) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 15:55:39 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Triggering sync for uuid 55febf04-14ea-4903-8692-c7cc6115de75 {{(pid=75176) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 15:55:39 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Triggering sync for uuid 8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7 {{(pid=75176) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 15:55:39 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Triggering sync for uuid 6161cab2-eb1f-44cb-bbd5-077e6db42f77 {{(pid=75176) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 15:55:39 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Triggering sync for uuid dc4e6d39-adfb-4d26-afef-46f316ff7846 {{(pid=75176) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 15:55:39 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Triggering sync for uuid 742bfe1e-6885-4aba-9f7f-c07a5d904175 {{(pid=75176) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 15:55:39 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Triggering sync for uuid 193235b9-8ef5-41d0-a9ab-4f1679d30266 {{(pid=75176) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 15:55:39 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Triggering sync for uuid ecabea76-6c29-412d-bf77-989917b449a9 {{(pid=75176) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 15:55:39 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Triggering sync for uuid 2c154591-b130-4aa4-aad4-4c85324512df {{(pid=75176) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 15:55:39 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Triggering sync for uuid f1b1fc0f-1865-4020-91ee-25a5e16127cf {{(pid=75176) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 15:55:39 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Triggering sync for uuid e0b7a064-03b6-4a0d-88be-2f12c12a1ddb {{(pid=75176) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 15:55:39 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquiring lock "2e8507b7-fccf-4196-b589-bf2b74f165ec" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:55:39 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "2e8507b7-fccf-4196-b589-bf2b74f165ec" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:55:39 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquiring lock "f66ead7d-98f4-4822-9dce-f2ea0206a58d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:55:39 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "f66ead7d-98f4-4822-9dce-f2ea0206a58d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:55:39 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquiring lock "55febf04-14ea-4903-8692-c7cc6115de75" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:55:39 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "55febf04-14ea-4903-8692-c7cc6115de75" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:55:39 user nova-compute[75176]: INFO nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] [instance: 55febf04-14ea-4903-8692-c7cc6115de75] During sync_power_state the instance has a pending task (unrescuing). Skip.
Nov 28 15:55:39 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "55febf04-14ea-4903-8692-c7cc6115de75" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:55:39 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquiring lock "8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:55:39 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:55:39 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquiring lock "6161cab2-eb1f-44cb-bbd5-077e6db42f77" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:55:39 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "6161cab2-eb1f-44cb-bbd5-077e6db42f77" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:55:39 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquiring lock "dc4e6d39-adfb-4d26-afef-46f316ff7846" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:55:39 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "dc4e6d39-adfb-4d26-afef-46f316ff7846" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:55:39 user nova-compute[75176]: INFO nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] [instance: dc4e6d39-adfb-4d26-afef-46f316ff7846] During sync_power_state the instance has a pending task (unrescuing). Skip.
Nov 28 15:55:39 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "dc4e6d39-adfb-4d26-afef-46f316ff7846" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:55:39 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquiring lock "742bfe1e-6885-4aba-9f7f-c07a5d904175" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:55:39 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "742bfe1e-6885-4aba-9f7f-c07a5d904175" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:55:39 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquiring lock "193235b9-8ef5-41d0-a9ab-4f1679d30266" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:55:39 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "193235b9-8ef5-41d0-a9ab-4f1679d30266" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:55:39 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquiring lock "ecabea76-6c29-412d-bf77-989917b449a9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:55:39 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquiring lock "2c154591-b130-4aa4-aad4-4c85324512df" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:55:39 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "2c154591-b130-4aa4-aad4-4c85324512df" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:55:39 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquiring lock "f1b1fc0f-1865-4020-91ee-25a5e16127cf" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:55:39 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "f1b1fc0f-1865-4020-91ee-25a5e16127cf" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:55:39 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquiring lock "e0b7a064-03b6-4a0d-88be-2f12c12a1ddb" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:55:39 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "2e8507b7-fccf-4196-b589-bf2b74f165ec" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.054s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:55:39 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "f66ead7d-98f4-4822-9dce-f2ea0206a58d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.054s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:55:39 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.056s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:55:40 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "6161cab2-eb1f-44cb-bbd5-077e6db42f77" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.074s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:55:40 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "193235b9-8ef5-41d0-a9ab-4f1679d30266" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.084s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:55:40 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "742bfe1e-6885-4aba-9f7f-c07a5d904175" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.094s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:55:40 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "2c154591-b130-4aa4-aad4-4c85324512df" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.096s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:55:40 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "f1b1fc0f-1865-4020-91ee-25a5e16127cf" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.103s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:55:40 user nova-compute[75176]: DEBUG nova.network.neutron [None req-d734dcbe-fc8f-486f-ab26-b80485cb6960 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] [instance: e0b7a064-03b6-4a0d-88be-2f12c12a1ddb] Successfully updated port: 76c02515-a349-4b46-939a-cf520b5f3b33 {{(pid=75176) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 15:55:40 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-d734dcbe-fc8f-486f-ab26-b80485cb6960 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Acquiring lock "refresh_cache-e0b7a064-03b6-4a0d-88be-2f12c12a1ddb" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:55:40 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-d734dcbe-fc8f-486f-ab26-b80485cb6960 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Acquired lock "refresh_cache-e0b7a064-03b6-4a0d-88be-2f12c12a1ddb" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:55:40 user nova-compute[75176]: DEBUG nova.network.neutron [None req-d734dcbe-fc8f-486f-ab26-b80485cb6960 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] [instance: e0b7a064-03b6-4a0d-88be-2f12c12a1ddb] Building network info cache for instance {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 15:55:40 user nova-compute[75176]: DEBUG nova.network.neutron [None req-d734dcbe-fc8f-486f-ab26-b80485cb6960 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] [instance: e0b7a064-03b6-4a0d-88be-2f12c12a1ddb] Instance cache missing network info. {{(pid=75176) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 15:55:40 user nova-compute[75176]: DEBUG nova.network.neutron [None req-d734dcbe-fc8f-486f-ab26-b80485cb6960 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] [instance: e0b7a064-03b6-4a0d-88be-2f12c12a1ddb] Updating instance_info_cache with network_info: [{"id": "76c02515-a349-4b46-939a-cf520b5f3b33", "address": "fa:16:3e:92:22:dd", "network": {"id": "459cb688-3ab2-41c9-8b98-296b629e36b6", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1294058889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16cf33057bf84d25bae4a90b74bd7754", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76c02515-a3", "ovs_interfaceid": "76c02515-a349-4b46-939a-cf520b5f3b33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:55:40 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-d734dcbe-fc8f-486f-ab26-b80485cb6960 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Releasing lock "refresh_cache-e0b7a064-03b6-4a0d-88be-2f12c12a1ddb" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:55:40 user nova-compute[75176]: DEBUG nova.compute.manager [None req-d734dcbe-fc8f-486f-ab26-b80485cb6960 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] [instance: e0b7a064-03b6-4a0d-88be-2f12c12a1ddb] Instance network_info: |[{"id": "76c02515-a349-4b46-939a-cf520b5f3b33", "address": "fa:16:3e:92:22:dd", "network": {"id": "459cb688-3ab2-41c9-8b98-296b629e36b6", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1294058889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16cf33057bf84d25bae4a90b74bd7754", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76c02515-a3", "ovs_interfaceid": "76c02515-a349-4b46-939a-cf520b5f3b33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75176) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 15:55:40 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-d734dcbe-fc8f-486f-ab26-b80485cb6960 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] [instance: e0b7a064-03b6-4a0d-88be-2f12c12a1ddb] Start _get_guest_xml network_info=[{"id": "76c02515-a349-4b46-939a-cf520b5f3b33", "address": "fa:16:3e:92:22:dd", "network": {"id": "459cb688-3ab2-41c9-8b98-296b629e36b6", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1294058889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16cf33057bf84d25bae4a90b74bd7754", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76c02515-a3", "ovs_interfaceid": "76c02515-a349-4b46-939a-cf520b5f3b33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T15:35:12Z,direct_url=<?>,disk_format='qcow2',id=1f41819e-c93f-4dc7-b253-37a27bbbbc74,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1b91c5d0672c4224a48df2e1f92688e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T15:35:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'size': 0, 'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'image_id': '1f41819e-c93f-4dc7-b253-37a27bbbbc74'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75176) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 15:55:40 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-d734dcbe-fc8f-486f-ab26-b80485cb6960 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 15:55:40 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-d734dcbe-fc8f-486f-ab26-b80485cb6960 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 15:55:40 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-d734dcbe-fc8f-486f-ab26-b80485cb6960 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75176) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 15:55:40 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-d734dcbe-fc8f-486f-ab26-b80485cb6960 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] CPU controller missing on host. {{(pid=75176) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 15:55:40 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-d734dcbe-fc8f-486f-ab26-b80485cb6960 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75176) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 15:55:40 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-d734dcbe-fc8f-486f-ab26-b80485cb6960 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] CPU controller found on host. {{(pid=75176) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 15:55:40 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-d734dcbe-fc8f-486f-ab26-b80485cb6960 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75176) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 15:55:40 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-d734dcbe-fc8f-486f-ab26-b80485cb6960 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T15:35:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T15:35:12Z,direct_url=<?>,disk_format='qcow2',id=1f41819e-c93f-4dc7-b253-37a27bbbbc74,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1b91c5d0672c4224a48df2e1f92688e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T15:35:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 15:55:40 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-d734dcbe-fc8f-486f-ab26-b80485cb6960 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Flavor limits 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 15:55:40 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-d734dcbe-fc8f-486f-ab26-b80485cb6960 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Image limits 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 15:55:40 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-d734dcbe-fc8f-486f-ab26-b80485cb6960 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Flavor pref 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 15:55:40 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-d734dcbe-fc8f-486f-ab26-b80485cb6960 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Image pref 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 15:55:40 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-d734dcbe-fc8f-486f-ab26-b80485cb6960 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 15:55:40 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-d734dcbe-fc8f-486f-ab26-b80485cb6960 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 15:55:40 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-d734dcbe-fc8f-486f-ab26-b80485cb6960 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75176) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 15:55:40 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-d734dcbe-fc8f-486f-ab26-b80485cb6960 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Got 1 possible topologies {{(pid=75176) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 15:55:40 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-d734dcbe-fc8f-486f-ab26-b80485cb6960 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 15:55:40 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-d734dcbe-fc8f-486f-ab26-b80485cb6960 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 15:55:40 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-d734dcbe-fc8f-486f-ab26-b80485cb6960 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T15:55:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-2053745581',display_name='tempest-SnapshotDataIntegrityTests-server-2053745581',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-2053745581',id=41,image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIy6wWSRGfZyXiGXXkXqBToeU1zWHjsklWsHjMraT19dqDHgHnUBb0EJ2/rKWCrgBX/Ffh25spRK4jFsAVCoejLyMgoL/ZTbY2aZwpWbx0WqyhU7zAeG2zpcrTZFr0qPNA==',key_name='tempest-keypair-1174293917',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='16cf33057bf84d25bae4a90b74bd7754',ramdisk_id='',reservation_id='r-73vllbci',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1194433303',owner_user_name='tempest-SnapshotDataIntegrityTests-1194433303-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T15:55:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='af0306d7f5704ccc8bf1fe056c8e779e',uuid=e0b7a064-03b6-4a0d-88be-2f12c12a1ddb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "76c02515-a349-4b46-939a-cf520b5f3b33", "address": "fa:16:3e:92:22:dd", "network": {"id": "459cb688-3ab2-41c9-8b98-296b629e36b6", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1294058889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16cf33057bf84d25bae4a90b74bd7754", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76c02515-a3", "ovs_interfaceid": "76c02515-a349-4b46-939a-cf520b5f3b33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75176) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 15:55:40 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-d734dcbe-fc8f-486f-ab26-b80485cb6960 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Converting VIF {"id": "76c02515-a349-4b46-939a-cf520b5f3b33", "address": "fa:16:3e:92:22:dd", "network": {"id": "459cb688-3ab2-41c9-8b98-296b629e36b6", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1294058889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16cf33057bf84d25bae4a90b74bd7754", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76c02515-a3", "ovs_interfaceid": "76c02515-a349-4b46-939a-cf520b5f3b33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:55:40 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-d734dcbe-fc8f-486f-ab26-b80485cb6960 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:22:dd,bridge_name='br-int',has_traffic_filtering=True,id=76c02515-a349-4b46-939a-cf520b5f3b33,network=Network(459cb688-3ab2-41c9-8b98-296b629e36b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76c02515-a3') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:55:40 user nova-compute[75176]: DEBUG nova.objects.instance [None req-d734dcbe-fc8f-486f-ab26-b80485cb6960 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Lazy-loading 'pci_devices' on Instance uuid e0b7a064-03b6-4a0d-88be-2f12c12a1ddb {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:55:40 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-d734dcbe-fc8f-486f-ab26-b80485cb6960 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] [instance: e0b7a064-03b6-4a0d-88be-2f12c12a1ddb] End _get_guest_xml xml=<domain type="kvm">
Nov 28 15:55:40 user nova-compute[75176]:   <uuid>e0b7a064-03b6-4a0d-88be-2f12c12a1ddb</uuid>
Nov 28 15:55:40 user nova-compute[75176]:   <name>instance-00000029</name>
Nov 28 15:55:40 user nova-compute[75176]:   <memory>524288</memory>
Nov 28 15:55:40 user nova-compute[75176]:   <vcpu>1</vcpu>
Nov 28 15:55:40 user nova-compute[75176]:   <metadata>
Nov 28 15:55:40 user nova-compute[75176]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 15:55:40 user nova-compute[75176]:       <nova:package version="0.0.0"/>
Nov 28 15:55:40 user nova-compute[75176]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-2053745581</nova:name>
Nov 28 15:55:40 user nova-compute[75176]:       <nova:creationTime>2023-11-28 15:55:40</nova:creationTime>
Nov 28 15:55:40 user nova-compute[75176]:       <nova:flavor name="m1.tiny">
Nov 28 15:55:40 user nova-compute[75176]:         <nova:memory>512</nova:memory>
Nov 28 15:55:40 user nova-compute[75176]:         <nova:disk>1</nova:disk>
Nov 28 15:55:40 user nova-compute[75176]:         <nova:swap>0</nova:swap>
Nov 28 15:55:40 user nova-compute[75176]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 15:55:40 user nova-compute[75176]:         <nova:vcpus>1</nova:vcpus>
Nov 28 15:55:40 user nova-compute[75176]:       </nova:flavor>
Nov 28 15:55:40 user nova-compute[75176]:       <nova:owner>
Nov 28 15:55:40 user nova-compute[75176]:         <nova:user uuid="af0306d7f5704ccc8bf1fe056c8e779e">tempest-SnapshotDataIntegrityTests-1194433303-project-member</nova:user>
Nov 28 15:55:40 user nova-compute[75176]:         <nova:project uuid="16cf33057bf84d25bae4a90b74bd7754">tempest-SnapshotDataIntegrityTests-1194433303</nova:project>
Nov 28 15:55:40 user nova-compute[75176]:       </nova:owner>
Nov 28 15:55:40 user nova-compute[75176]:       <nova:root type="image" uuid="1f41819e-c93f-4dc7-b253-37a27bbbbc74"/>
Nov 28 15:55:40 user nova-compute[75176]:       <nova:ports>
Nov 28 15:55:40 user nova-compute[75176]:         <nova:port uuid="76c02515-a349-4b46-939a-cf520b5f3b33">
Nov 28 15:55:40 user nova-compute[75176]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 28 15:55:40 user nova-compute[75176]:         </nova:port>
Nov 28 15:55:40 user nova-compute[75176]:       </nova:ports>
Nov 28 15:55:40 user nova-compute[75176]:     </nova:instance>
Nov 28 15:55:40 user nova-compute[75176]:   </metadata>
Nov 28 15:55:40 user nova-compute[75176]:   <sysinfo type="smbios">
Nov 28 15:55:40 user nova-compute[75176]:     <system>
Nov 28 15:55:40 user nova-compute[75176]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 15:55:40 user nova-compute[75176]:       <entry name="product">OpenStack Nova</entry>
Nov 28 15:55:40 user nova-compute[75176]:       <entry name="version">0.0.0</entry>
Nov 28 15:55:40 user nova-compute[75176]:       <entry name="serial">e0b7a064-03b6-4a0d-88be-2f12c12a1ddb</entry>
Nov 28 15:55:40 user nova-compute[75176]:       <entry name="uuid">e0b7a064-03b6-4a0d-88be-2f12c12a1ddb</entry>
Nov 28 15:55:40 user nova-compute[75176]:       <entry name="family">Virtual Machine</entry>
Nov 28 15:55:40 user nova-compute[75176]:     </system>
Nov 28 15:55:40 user nova-compute[75176]:   </sysinfo>
Nov 28 15:55:40 user nova-compute[75176]:   <os>
Nov 28 15:55:40 user nova-compute[75176]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 15:55:40 user nova-compute[75176]:     <boot dev="hd"/>
Nov 28 15:55:40 user nova-compute[75176]:     <smbios mode="sysinfo"/>
Nov 28 15:55:40 user nova-compute[75176]:   </os>
Nov 28 15:55:40 user nova-compute[75176]:   <features>
Nov 28 15:55:40 user nova-compute[75176]:     <acpi/>
Nov 28 15:55:40 user nova-compute[75176]:     <apic/>
Nov 28 15:55:40 user nova-compute[75176]:     <vmcoreinfo/>
Nov 28 15:55:40 user nova-compute[75176]:   </features>
Nov 28 15:55:40 user nova-compute[75176]:   <clock offset="utc">
Nov 28 15:55:40 user nova-compute[75176]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 15:55:40 user nova-compute[75176]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 15:55:40 user nova-compute[75176]:     <timer name="hpet" present="no"/>
Nov 28 15:55:40 user nova-compute[75176]:   </clock>
Nov 28 15:55:40 user nova-compute[75176]:   <cpu mode="custom" match="exact">
Nov 28 15:55:40 user nova-compute[75176]:     <model>Nehalem</model>
Nov 28 15:55:40 user nova-compute[75176]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 15:55:40 user nova-compute[75176]:   </cpu>
Nov 28 15:55:40 user nova-compute[75176]:   <devices>
Nov 28 15:55:40 user nova-compute[75176]:     <disk type="file" device="disk">
Nov 28 15:55:40 user nova-compute[75176]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 15:55:40 user nova-compute[75176]:       <source file="/opt/stack/data/nova/instances/e0b7a064-03b6-4a0d-88be-2f12c12a1ddb/disk"/>
Nov 28 15:55:40 user nova-compute[75176]:       <target dev="vda" bus="virtio"/>
Nov 28 15:55:40 user nova-compute[75176]:     </disk>
Nov 28 15:55:40 user nova-compute[75176]:     <interface type="ethernet">
Nov 28 15:55:40 user nova-compute[75176]:       <mac address="fa:16:3e:92:22:dd"/>
Nov 28 15:55:40 user nova-compute[75176]:       <model type="virtio"/>
Nov 28 15:55:40 user nova-compute[75176]:       <mtu size="1442"/>
Nov 28 15:55:40 user nova-compute[75176]:       <target dev="tap76c02515-a3"/>
Nov 28 15:55:40 user nova-compute[75176]:     </interface>
Nov 28 15:55:40 user nova-compute[75176]:     <serial type="pty">
Nov 28 15:55:40 user nova-compute[75176]:       <log file="/opt/stack/data/nova/instances/e0b7a064-03b6-4a0d-88be-2f12c12a1ddb/console.log" append="off"/>
Nov 28 15:55:40 user nova-compute[75176]:     </serial>
Nov 28 15:55:40 user nova-compute[75176]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 15:55:40 user nova-compute[75176]:     <video>
Nov 28 15:55:40 user nova-compute[75176]:       <model type="virtio"/>
Nov 28 15:55:40 user nova-compute[75176]:     </video>
Nov 28 15:55:40 user nova-compute[75176]:     <rng model="virtio">
Nov 28 15:55:40 user nova-compute[75176]:       <backend model="random">/dev/urandom</backend>
Nov 28 15:55:40 user nova-compute[75176]:     </rng>
Nov 28 15:55:40 user nova-compute[75176]:     <controller type="usb" index="0" model="none"/>
Nov 28 15:55:40 user nova-compute[75176]:     <memballoon model="virtio">
Nov 28 15:55:40 user nova-compute[75176]:       <stats period="10"/>
Nov 28 15:55:40 user nova-compute[75176]:     </memballoon>
Nov 28 15:55:40 user nova-compute[75176]:   </devices>
Nov 28 15:55:40 user nova-compute[75176]: </domain>
Nov 28 15:55:40 user nova-compute[75176]:  {{(pid=75176) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 15:55:40 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-d734dcbe-fc8f-486f-ab26-b80485cb6960 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T15:55:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-2053745581',display_name='tempest-SnapshotDataIntegrityTests-server-2053745581',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-2053745581',id=41,image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIy6wWSRGfZyXiGXXkXqBToeU1zWHjsklWsHjMraT19dqDHgHnUBb0EJ2/rKWCrgBX/Ffh25spRK4jFsAVCoejLyMgoL/ZTbY2aZwpWbx0WqyhU7zAeG2zpcrTZFr0qPNA==',key_name='tempest-keypair-1174293917',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='16cf33057bf84d25bae4a90b74bd7754',ramdisk_id='',reservation_id='r-73vllbci',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1194433303',owner_user_name='tempest-SnapshotDataIntegrityTests-1194433303-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T15:55:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='af0306d7f5704ccc8bf1fe056c8e779e',uuid=e0b7a064-03b6-4a0d-88be-2f12c12a1ddb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "76c02515-a349-4b46-939a-cf520b5f3b33", "address": "fa:16:3e:92:22:dd", "network": {"id": "459cb688-3ab2-41c9-8b98-296b629e36b6", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1294058889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16cf33057bf84d25bae4a90b74bd7754", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76c02515-a3", "ovs_interfaceid": "76c02515-a349-4b46-939a-cf520b5f3b33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 15:55:40 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-d734dcbe-fc8f-486f-ab26-b80485cb6960 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Converting VIF {"id": "76c02515-a349-4b46-939a-cf520b5f3b33", "address": "fa:16:3e:92:22:dd", "network": {"id": "459cb688-3ab2-41c9-8b98-296b629e36b6", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1294058889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16cf33057bf84d25bae4a90b74bd7754", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76c02515-a3", "ovs_interfaceid": "76c02515-a349-4b46-939a-cf520b5f3b33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:55:40 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-d734dcbe-fc8f-486f-ab26-b80485cb6960 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:22:dd,bridge_name='br-int',has_traffic_filtering=True,id=76c02515-a349-4b46-939a-cf520b5f3b33,network=Network(459cb688-3ab2-41c9-8b98-296b629e36b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76c02515-a3') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:55:40 user nova-compute[75176]: DEBUG os_vif [None req-d734dcbe-fc8f-486f-ab26-b80485cb6960 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:22:dd,bridge_name='br-int',has_traffic_filtering=True,id=76c02515-a349-4b46-939a-cf520b5f3b33,network=Network(459cb688-3ab2-41c9-8b98-296b629e36b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76c02515-a3') {{(pid=75176) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 15:55:40 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:55:40 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:55:40 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 15:55:40 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:55:40 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '852dbda8-31f4-5a38-931b-a18c86b899b3', '_type': 'linux-noop'}}, row=False) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:55:40 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:55:40 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:55:40 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:55:40 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:55:40 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap76c02515-a3, may_exist=True, interface_attrs={}) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:55:40 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap76c02515-a3, col_values=(('qos', UUID('4ac5b2fb-3d75-4b35-9be7-e4b72dabad7c')),), if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:55:40 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap76c02515-a3, col_values=(('external_ids', {'iface-id': '76c02515-a349-4b46-939a-cf520b5f3b33', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:92:22:dd', 'vm-uuid': 'e0b7a064-03b6-4a0d-88be-2f12c12a1ddb'}),), if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:55:40 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:55:40 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:55:40 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:55:40 user nova-compute[75176]: INFO os_vif [None req-d734dcbe-fc8f-486f-ab26-b80485cb6960 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:22:dd,bridge_name='br-int',has_traffic_filtering=True,id=76c02515-a349-4b46-939a-cf520b5f3b33,network=Network(459cb688-3ab2-41c9-8b98-296b629e36b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76c02515-a3')
Nov 28 15:55:40 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-d734dcbe-fc8f-486f-ab26-b80485cb6960 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] No BDM found with device name vda, not building metadata. {{(pid=75176) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 15:55:40 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-d734dcbe-fc8f-486f-ab26-b80485cb6960 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] No VIF found with MAC fa:16:3e:92:22:dd, not building metadata {{(pid=75176) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 15:55:41 user nova-compute[75176]: DEBUG nova.compute.manager [req-5d181a5f-3460-4322-8447-8466893af1ee req-fa2c7fe8-2b4d-4493-ae7a-c25e3e88ef81 service nova] [instance: 55febf04-14ea-4903-8692-c7cc6115de75] Received event network-vif-plugged-e287ec1a-3726-4719-94b2-79764f7abd31 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:55:41 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-5d181a5f-3460-4322-8447-8466893af1ee req-fa2c7fe8-2b4d-4493-ae7a-c25e3e88ef81 service nova] Acquiring lock "55febf04-14ea-4903-8692-c7cc6115de75-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:55:41 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-5d181a5f-3460-4322-8447-8466893af1ee req-fa2c7fe8-2b4d-4493-ae7a-c25e3e88ef81 service nova] Lock "55febf04-14ea-4903-8692-c7cc6115de75-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:55:41 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-5d181a5f-3460-4322-8447-8466893af1ee req-fa2c7fe8-2b4d-4493-ae7a-c25e3e88ef81 service nova] Lock "55febf04-14ea-4903-8692-c7cc6115de75-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:55:41 user nova-compute[75176]: DEBUG nova.compute.manager [req-5d181a5f-3460-4322-8447-8466893af1ee req-fa2c7fe8-2b4d-4493-ae7a-c25e3e88ef81 service nova] [instance: 55febf04-14ea-4903-8692-c7cc6115de75] No waiting events found dispatching network-vif-plugged-e287ec1a-3726-4719-94b2-79764f7abd31 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:55:41 user nova-compute[75176]: WARNING nova.compute.manager [req-5d181a5f-3460-4322-8447-8466893af1ee req-fa2c7fe8-2b4d-4493-ae7a-c25e3e88ef81 service nova] [instance: 55febf04-14ea-4903-8692-c7cc6115de75] Received unexpected event network-vif-plugged-e287ec1a-3726-4719-94b2-79764f7abd31 for instance with vm_state rescued and task_state unrescuing.
Nov 28 15:55:41 user nova-compute[75176]: DEBUG nova.compute.manager [req-5d181a5f-3460-4322-8447-8466893af1ee req-fa2c7fe8-2b4d-4493-ae7a-c25e3e88ef81 service nova] [instance: 55febf04-14ea-4903-8692-c7cc6115de75] Received event network-vif-plugged-e287ec1a-3726-4719-94b2-79764f7abd31 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:55:41 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-5d181a5f-3460-4322-8447-8466893af1ee req-fa2c7fe8-2b4d-4493-ae7a-c25e3e88ef81 service nova] Acquiring lock "55febf04-14ea-4903-8692-c7cc6115de75-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:55:41 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-5d181a5f-3460-4322-8447-8466893af1ee req-fa2c7fe8-2b4d-4493-ae7a-c25e3e88ef81 service nova] Lock "55febf04-14ea-4903-8692-c7cc6115de75-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:55:41 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-5d181a5f-3460-4322-8447-8466893af1ee req-fa2c7fe8-2b4d-4493-ae7a-c25e3e88ef81 service nova] Lock "55febf04-14ea-4903-8692-c7cc6115de75-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:55:41 user nova-compute[75176]: DEBUG nova.compute.manager [req-5d181a5f-3460-4322-8447-8466893af1ee req-fa2c7fe8-2b4d-4493-ae7a-c25e3e88ef81 service nova] [instance: 55febf04-14ea-4903-8692-c7cc6115de75] No waiting events found dispatching network-vif-plugged-e287ec1a-3726-4719-94b2-79764f7abd31 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:55:41 user nova-compute[75176]: WARNING nova.compute.manager [req-5d181a5f-3460-4322-8447-8466893af1ee req-fa2c7fe8-2b4d-4493-ae7a-c25e3e88ef81 service nova] [instance: 55febf04-14ea-4903-8692-c7cc6115de75] Received unexpected event network-vif-plugged-e287ec1a-3726-4719-94b2-79764f7abd31 for instance with vm_state rescued and task_state unrescuing.
Nov 28 15:55:41 user nova-compute[75176]: DEBUG nova.compute.manager [req-9483686f-337b-4204-9a3b-8c261d02e0c0 req-17339836-9d0a-4c51-b575-9f354dbb21aa service nova] [instance: dc4e6d39-adfb-4d26-afef-46f316ff7846] Received event network-vif-plugged-65eb3123-182c-40fd-b20c-48b19b833f14 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:55:41 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-9483686f-337b-4204-9a3b-8c261d02e0c0 req-17339836-9d0a-4c51-b575-9f354dbb21aa service nova] Acquiring lock "dc4e6d39-adfb-4d26-afef-46f316ff7846-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:55:41 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-9483686f-337b-4204-9a3b-8c261d02e0c0 req-17339836-9d0a-4c51-b575-9f354dbb21aa service nova] Lock "dc4e6d39-adfb-4d26-afef-46f316ff7846-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:55:41 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-9483686f-337b-4204-9a3b-8c261d02e0c0 req-17339836-9d0a-4c51-b575-9f354dbb21aa service nova] Lock "dc4e6d39-adfb-4d26-afef-46f316ff7846-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:55:41 user nova-compute[75176]: DEBUG nova.compute.manager [req-9483686f-337b-4204-9a3b-8c261d02e0c0 req-17339836-9d0a-4c51-b575-9f354dbb21aa service nova] [instance: dc4e6d39-adfb-4d26-afef-46f316ff7846] No waiting events found dispatching network-vif-plugged-65eb3123-182c-40fd-b20c-48b19b833f14 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:55:41 user nova-compute[75176]: WARNING nova.compute.manager [req-9483686f-337b-4204-9a3b-8c261d02e0c0 req-17339836-9d0a-4c51-b575-9f354dbb21aa service nova] [instance: dc4e6d39-adfb-4d26-afef-46f316ff7846] Received unexpected event network-vif-plugged-65eb3123-182c-40fd-b20c-48b19b833f14 for instance with vm_state rescued and task_state unrescuing.
Nov 28 15:55:41 user nova-compute[75176]: DEBUG nova.compute.manager [req-9483686f-337b-4204-9a3b-8c261d02e0c0 req-17339836-9d0a-4c51-b575-9f354dbb21aa service nova] [instance: e0b7a064-03b6-4a0d-88be-2f12c12a1ddb] Received event network-changed-76c02515-a349-4b46-939a-cf520b5f3b33 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:55:41 user nova-compute[75176]: DEBUG nova.compute.manager [req-9483686f-337b-4204-9a3b-8c261d02e0c0 req-17339836-9d0a-4c51-b575-9f354dbb21aa service nova] [instance: e0b7a064-03b6-4a0d-88be-2f12c12a1ddb] Refreshing instance network info cache due to event network-changed-76c02515-a349-4b46-939a-cf520b5f3b33. {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 15:55:41 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-9483686f-337b-4204-9a3b-8c261d02e0c0 req-17339836-9d0a-4c51-b575-9f354dbb21aa service nova] Acquiring lock "refresh_cache-e0b7a064-03b6-4a0d-88be-2f12c12a1ddb" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:55:41 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-9483686f-337b-4204-9a3b-8c261d02e0c0 req-17339836-9d0a-4c51-b575-9f354dbb21aa service nova] Acquired lock "refresh_cache-e0b7a064-03b6-4a0d-88be-2f12c12a1ddb" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:55:41 user nova-compute[75176]: DEBUG nova.network.neutron [req-9483686f-337b-4204-9a3b-8c261d02e0c0 req-17339836-9d0a-4c51-b575-9f354dbb21aa service nova] [instance: e0b7a064-03b6-4a0d-88be-2f12c12a1ddb] Refreshing network info cache for port 76c02515-a349-4b46-939a-cf520b5f3b33 {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 15:55:41 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7f952b8d-49db-42c5-9ff2-857a859b1942 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Acquiring lock "2c154591-b130-4aa4-aad4-4c85324512df" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:55:41 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7f952b8d-49db-42c5-9ff2-857a859b1942 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Lock "2c154591-b130-4aa4-aad4-4c85324512df" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:55:41 user nova-compute[75176]: INFO nova.compute.manager [None req-7f952b8d-49db-42c5-9ff2-857a859b1942 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] [instance: 2c154591-b130-4aa4-aad4-4c85324512df] Shelving
Nov 28 15:55:41 user nova-compute[75176]: DEBUG nova.compute.manager [None req-4b21b444-3e4a-4023-9e31-a2c2c7615159 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] [instance: 55febf04-14ea-4903-8692-c7cc6115de75] Checking state {{(pid=75176) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 15:55:41 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:55:41 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:55:41 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:55:41 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:55:41 user nova-compute[75176]: DEBUG nova.network.neutron [req-9483686f-337b-4204-9a3b-8c261d02e0c0 req-17339836-9d0a-4c51-b575-9f354dbb21aa service nova] [instance: e0b7a064-03b6-4a0d-88be-2f12c12a1ddb] Updated VIF entry in instance network info cache for port 76c02515-a349-4b46-939a-cf520b5f3b33. {{(pid=75176) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 15:55:41 user nova-compute[75176]: DEBUG nova.network.neutron [req-9483686f-337b-4204-9a3b-8c261d02e0c0 req-17339836-9d0a-4c51-b575-9f354dbb21aa service nova] [instance: e0b7a064-03b6-4a0d-88be-2f12c12a1ddb] Updating instance_info_cache with network_info: [{"id": "76c02515-a349-4b46-939a-cf520b5f3b33", "address": "fa:16:3e:92:22:dd", "network": {"id": "459cb688-3ab2-41c9-8b98-296b629e36b6", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1294058889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16cf33057bf84d25bae4a90b74bd7754", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76c02515-a3", "ovs_interfaceid": "76c02515-a349-4b46-939a-cf520b5f3b33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:55:41 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-9483686f-337b-4204-9a3b-8c261d02e0c0 req-17339836-9d0a-4c51-b575-9f354dbb21aa service nova] Releasing lock "refresh_cache-e0b7a064-03b6-4a0d-88be-2f12c12a1ddb" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:55:42 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:55:42 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:55:42 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:55:42 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:55:42 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:55:42 user nova-compute[75176]: INFO nova.virt.libvirt.driver [-] [instance: 2c154591-b130-4aa4-aad4-4c85324512df] Instance destroyed successfully.
Nov 28 15:55:42 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-7f952b8d-49db-42c5-9ff2-857a859b1942 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] [instance: 2c154591-b130-4aa4-aad4-4c85324512df] Beginning cold snapshot process
Nov 28 15:55:42 user nova-compute[75176]: DEBUG nova.privsep.utils [None req-7f952b8d-49db-42c5-9ff2-857a859b1942 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75176) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 28 15:55:42 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7f952b8d-49db-42c5-9ff2-857a859b1942 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/2c154591-b130-4aa4-aad4-4c85324512df/disk /opt/stack/data/nova/instances/snapshots/tmp7qewmuta/3fcf12f6d77c405c8ec3df674f7bffe4 {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:55:43 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:55:43 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:55:43 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:55:43 user nova-compute[75176]: DEBUG nova.compute.manager [req-1c73f5f4-e9a5-43ba-ad69-5f0adba90471 req-68cc1405-6ee2-4b39-a51d-a72c9e44d6dc service nova] [instance: 2c154591-b130-4aa4-aad4-4c85324512df] Received event network-vif-unplugged-c743768f-0b40-435a-8754-96784ae96dda {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:55:43 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-1c73f5f4-e9a5-43ba-ad69-5f0adba90471 req-68cc1405-6ee2-4b39-a51d-a72c9e44d6dc service nova] Acquiring lock "2c154591-b130-4aa4-aad4-4c85324512df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:55:43 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-1c73f5f4-e9a5-43ba-ad69-5f0adba90471 req-68cc1405-6ee2-4b39-a51d-a72c9e44d6dc service nova] Lock "2c154591-b130-4aa4-aad4-4c85324512df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:55:43 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-1c73f5f4-e9a5-43ba-ad69-5f0adba90471 req-68cc1405-6ee2-4b39-a51d-a72c9e44d6dc service nova] Lock "2c154591-b130-4aa4-aad4-4c85324512df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:55:43 user nova-compute[75176]: DEBUG nova.compute.manager [req-1c73f5f4-e9a5-43ba-ad69-5f0adba90471 req-68cc1405-6ee2-4b39-a51d-a72c9e44d6dc service nova] [instance: 2c154591-b130-4aa4-aad4-4c85324512df] No waiting events found dispatching network-vif-unplugged-c743768f-0b40-435a-8754-96784ae96dda {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:55:43 user nova-compute[75176]: WARNING nova.compute.manager [req-1c73f5f4-e9a5-43ba-ad69-5f0adba90471 req-68cc1405-6ee2-4b39-a51d-a72c9e44d6dc service nova] [instance: 2c154591-b130-4aa4-aad4-4c85324512df] Received unexpected event network-vif-unplugged-c743768f-0b40-435a-8754-96784ae96dda for instance with vm_state active and task_state shelving_image_pending_upload.
Nov 28 15:55:43 user nova-compute[75176]: DEBUG nova.compute.manager [req-1c73f5f4-e9a5-43ba-ad69-5f0adba90471 req-68cc1405-6ee2-4b39-a51d-a72c9e44d6dc service nova] [instance: 2c154591-b130-4aa4-aad4-4c85324512df] Received event network-vif-plugged-c743768f-0b40-435a-8754-96784ae96dda {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:55:43 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-1c73f5f4-e9a5-43ba-ad69-5f0adba90471 req-68cc1405-6ee2-4b39-a51d-a72c9e44d6dc service nova] Acquiring lock "2c154591-b130-4aa4-aad4-4c85324512df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:55:43 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-1c73f5f4-e9a5-43ba-ad69-5f0adba90471 req-68cc1405-6ee2-4b39-a51d-a72c9e44d6dc service nova] Lock "2c154591-b130-4aa4-aad4-4c85324512df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:55:43 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-1c73f5f4-e9a5-43ba-ad69-5f0adba90471 req-68cc1405-6ee2-4b39-a51d-a72c9e44d6dc service nova] Lock "2c154591-b130-4aa4-aad4-4c85324512df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:55:43 user nova-compute[75176]: DEBUG nova.compute.manager [req-1c73f5f4-e9a5-43ba-ad69-5f0adba90471 req-68cc1405-6ee2-4b39-a51d-a72c9e44d6dc service nova] [instance: 2c154591-b130-4aa4-aad4-4c85324512df] No waiting events found dispatching network-vif-plugged-c743768f-0b40-435a-8754-96784ae96dda {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:55:43 user nova-compute[75176]: WARNING nova.compute.manager [req-1c73f5f4-e9a5-43ba-ad69-5f0adba90471 req-68cc1405-6ee2-4b39-a51d-a72c9e44d6dc service nova] [instance: 2c154591-b130-4aa4-aad4-4c85324512df] Received unexpected event network-vif-plugged-c743768f-0b40-435a-8754-96784ae96dda for instance with vm_state active and task_state shelving_image_pending_upload.
Nov 28 15:55:43 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7f952b8d-49db-42c5-9ff2-857a859b1942 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/2c154591-b130-4aa4-aad4-4c85324512df/disk /opt/stack/data/nova/instances/snapshots/tmp7qewmuta/3fcf12f6d77c405c8ec3df674f7bffe4" returned: 0 in 0.405s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:55:43 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-7f952b8d-49db-42c5-9ff2-857a859b1942 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] [instance: 2c154591-b130-4aa4-aad4-4c85324512df] Snapshot extracted, beginning image upload
Nov 28 15:55:43 user nova-compute[75176]: DEBUG nova.compute.manager [req-61c96ed9-4718-4fec-b3b1-ef99ed11a20e req-4180ba11-2534-45a0-b0a4-5f2d9cdc19c4 service nova] [instance: dc4e6d39-adfb-4d26-afef-46f316ff7846] Received event network-vif-plugged-65eb3123-182c-40fd-b20c-48b19b833f14 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:55:43 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-61c96ed9-4718-4fec-b3b1-ef99ed11a20e req-4180ba11-2534-45a0-b0a4-5f2d9cdc19c4 service nova] Acquiring lock "dc4e6d39-adfb-4d26-afef-46f316ff7846-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:55:43 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-61c96ed9-4718-4fec-b3b1-ef99ed11a20e req-4180ba11-2534-45a0-b0a4-5f2d9cdc19c4 service nova] Lock "dc4e6d39-adfb-4d26-afef-46f316ff7846-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:55:43 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-61c96ed9-4718-4fec-b3b1-ef99ed11a20e req-4180ba11-2534-45a0-b0a4-5f2d9cdc19c4 service nova] Lock "dc4e6d39-adfb-4d26-afef-46f316ff7846-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:55:43 user nova-compute[75176]: DEBUG nova.compute.manager [req-61c96ed9-4718-4fec-b3b1-ef99ed11a20e req-4180ba11-2534-45a0-b0a4-5f2d9cdc19c4 service nova] [instance: dc4e6d39-adfb-4d26-afef-46f316ff7846] No waiting events found dispatching network-vif-plugged-65eb3123-182c-40fd-b20c-48b19b833f14 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:55:43 user nova-compute[75176]: WARNING nova.compute.manager [req-61c96ed9-4718-4fec-b3b1-ef99ed11a20e req-4180ba11-2534-45a0-b0a4-5f2d9cdc19c4 service nova] [instance: dc4e6d39-adfb-4d26-afef-46f316ff7846] Received unexpected event network-vif-plugged-65eb3123-182c-40fd-b20c-48b19b833f14 for instance with vm_state rescued and task_state unrescuing.
Nov 28 15:55:43 user nova-compute[75176]: DEBUG nova.compute.manager [req-61c96ed9-4718-4fec-b3b1-ef99ed11a20e req-4180ba11-2534-45a0-b0a4-5f2d9cdc19c4 service nova] [instance: dc4e6d39-adfb-4d26-afef-46f316ff7846] Received event network-vif-plugged-65eb3123-182c-40fd-b20c-48b19b833f14 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:55:43 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-61c96ed9-4718-4fec-b3b1-ef99ed11a20e req-4180ba11-2534-45a0-b0a4-5f2d9cdc19c4 service nova] Acquiring lock "dc4e6d39-adfb-4d26-afef-46f316ff7846-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:55:43 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-61c96ed9-4718-4fec-b3b1-ef99ed11a20e req-4180ba11-2534-45a0-b0a4-5f2d9cdc19c4 service nova] Lock "dc4e6d39-adfb-4d26-afef-46f316ff7846-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:55:43 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-61c96ed9-4718-4fec-b3b1-ef99ed11a20e req-4180ba11-2534-45a0-b0a4-5f2d9cdc19c4 service nova] Lock "dc4e6d39-adfb-4d26-afef-46f316ff7846-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:55:43 user nova-compute[75176]: DEBUG nova.compute.manager [req-61c96ed9-4718-4fec-b3b1-ef99ed11a20e req-4180ba11-2534-45a0-b0a4-5f2d9cdc19c4 service nova] [instance: dc4e6d39-adfb-4d26-afef-46f316ff7846] No waiting events found dispatching network-vif-plugged-65eb3123-182c-40fd-b20c-48b19b833f14 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:55:43 user nova-compute[75176]: WARNING nova.compute.manager [req-61c96ed9-4718-4fec-b3b1-ef99ed11a20e req-4180ba11-2534-45a0-b0a4-5f2d9cdc19c4 service nova] [instance: dc4e6d39-adfb-4d26-afef-46f316ff7846] Received unexpected event network-vif-plugged-65eb3123-182c-40fd-b20c-48b19b833f14 for instance with vm_state rescued and task_state unrescuing.
Nov 28 15:55:43 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:55:43 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:55:43 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:55:43 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:55:43 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:55:44 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:55:44 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-96c5875d-a107-427d-9cd2-6012be3f318b tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Acquiring lock "193235b9-8ef5-41d0-a9ab-4f1679d30266" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:55:44 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-96c5875d-a107-427d-9cd2-6012be3f318b tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Lock "193235b9-8ef5-41d0-a9ab-4f1679d30266" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:55:44 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-96c5875d-a107-427d-9cd2-6012be3f318b tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Acquiring lock "193235b9-8ef5-41d0-a9ab-4f1679d30266-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:55:44 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-96c5875d-a107-427d-9cd2-6012be3f318b tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Lock "193235b9-8ef5-41d0-a9ab-4f1679d30266-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.004s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:55:44 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-96c5875d-a107-427d-9cd2-6012be3f318b tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Lock "193235b9-8ef5-41d0-a9ab-4f1679d30266-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:55:44 user nova-compute[75176]: INFO nova.compute.manager [None req-96c5875d-a107-427d-9cd2-6012be3f318b tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] [instance: 193235b9-8ef5-41d0-a9ab-4f1679d30266] Terminating instance
Nov 28 15:55:44 user nova-compute[75176]: DEBUG nova.compute.manager [None req-96c5875d-a107-427d-9cd2-6012be3f318b tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] [instance: 193235b9-8ef5-41d0-a9ab-4f1679d30266] Start destroying the instance on the hypervisor. {{(pid=75176) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 15:55:44 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:55:44 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:55:44 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:55:44 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:55:44 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:55:45 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-670c7c6a-91d3-43d9-a68f-dbc49ed634be tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] Acquiring lock "742bfe1e-6885-4aba-9f7f-c07a5d904175" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:55:45 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-670c7c6a-91d3-43d9-a68f-dbc49ed634be tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] Lock "742bfe1e-6885-4aba-9f7f-c07a5d904175" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:55:45 user nova-compute[75176]: INFO nova.compute.manager [None req-670c7c6a-91d3-43d9-a68f-dbc49ed634be tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] [instance: 742bfe1e-6885-4aba-9f7f-c07a5d904175] Detaching volume 4a147af7-f082-42cf-ae1c-e5b98314a152
Nov 28 15:55:45 user nova-compute[75176]: INFO nova.virt.block_device [None req-670c7c6a-91d3-43d9-a68f-dbc49ed634be tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] [instance: 742bfe1e-6885-4aba-9f7f-c07a5d904175] Attempting to driver detach volume 4a147af7-f082-42cf-ae1c-e5b98314a152 from mountpoint /dev/vdb
Nov 28 15:55:45 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-670c7c6a-91d3-43d9-a68f-dbc49ed634be tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] Attempting to detach device vdb from instance 742bfe1e-6885-4aba-9f7f-c07a5d904175 from the persistent domain config. {{(pid=75176) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 15:55:45 user nova-compute[75176]: DEBUG nova.virt.libvirt.guest [None req-670c7c6a-91d3-43d9-a68f-dbc49ed634be tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 15:55:45 user nova-compute[75176]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 15:55:45 user nova-compute[75176]:   <source dev="/dev/sdc"/>
Nov 28 15:55:45 user nova-compute[75176]:   <target dev="vdb" bus="virtio"/>
Nov 28 15:55:45 user nova-compute[75176]:   <serial>4a147af7-f082-42cf-ae1c-e5b98314a152</serial>
Nov 28 15:55:45 user nova-compute[75176]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 15:55:45 user nova-compute[75176]: </disk>
Nov 28 15:55:45 user nova-compute[75176]:  {{(pid=75176) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 15:55:45 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-670c7c6a-91d3-43d9-a68f-dbc49ed634be tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] Successfully detached device vdb from instance 742bfe1e-6885-4aba-9f7f-c07a5d904175 from the persistent domain config.
Nov 28 15:55:45 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-670c7c6a-91d3-43d9-a68f-dbc49ed634be tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 742bfe1e-6885-4aba-9f7f-c07a5d904175 from the live domain config. {{(pid=75176) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 15:55:45 user nova-compute[75176]: DEBUG nova.virt.libvirt.guest [None req-670c7c6a-91d3-43d9-a68f-dbc49ed634be tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 15:55:45 user nova-compute[75176]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 15:55:45 user nova-compute[75176]:   <source dev="/dev/sdc"/>
Nov 28 15:55:45 user nova-compute[75176]:   <target dev="vdb" bus="virtio"/>
Nov 28 15:55:45 user nova-compute[75176]:   <serial>4a147af7-f082-42cf-ae1c-e5b98314a152</serial>
Nov 28 15:55:45 user nova-compute[75176]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 15:55:45 user nova-compute[75176]: </disk>
Nov 28 15:55:45 user nova-compute[75176]:  {{(pid=75176) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 15:55:45 user nova-compute[75176]: DEBUG nova.compute.manager [req-18328392-dee5-4f9e-bf2c-2051e2fa54cc req-ba4620ee-14e4-40ba-af10-b17c5bb21f53 service nova] [instance: e0b7a064-03b6-4a0d-88be-2f12c12a1ddb] Received event network-vif-plugged-76c02515-a349-4b46-939a-cf520b5f3b33 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:55:45 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-18328392-dee5-4f9e-bf2c-2051e2fa54cc req-ba4620ee-14e4-40ba-af10-b17c5bb21f53 service nova] Acquiring lock "e0b7a064-03b6-4a0d-88be-2f12c12a1ddb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:55:45 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-18328392-dee5-4f9e-bf2c-2051e2fa54cc req-ba4620ee-14e4-40ba-af10-b17c5bb21f53 service nova] Lock "e0b7a064-03b6-4a0d-88be-2f12c12a1ddb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.009s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:55:45 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-18328392-dee5-4f9e-bf2c-2051e2fa54cc req-ba4620ee-14e4-40ba-af10-b17c5bb21f53 service nova] Lock "e0b7a064-03b6-4a0d-88be-2f12c12a1ddb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:55:45 user nova-compute[75176]: DEBUG nova.compute.manager [req-18328392-dee5-4f9e-bf2c-2051e2fa54cc req-ba4620ee-14e4-40ba-af10-b17c5bb21f53 service nova] [instance: e0b7a064-03b6-4a0d-88be-2f12c12a1ddb] No waiting events found dispatching network-vif-plugged-76c02515-a349-4b46-939a-cf520b5f3b33 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:55:45 user nova-compute[75176]: WARNING nova.compute.manager [req-18328392-dee5-4f9e-bf2c-2051e2fa54cc req-ba4620ee-14e4-40ba-af10-b17c5bb21f53 service nova] [instance: e0b7a064-03b6-4a0d-88be-2f12c12a1ddb] Received unexpected event network-vif-plugged-76c02515-a349-4b46-939a-cf520b5f3b33 for instance with vm_state building and task_state spawning.
Nov 28 15:55:45 user nova-compute[75176]: DEBUG nova.compute.manager [req-18328392-dee5-4f9e-bf2c-2051e2fa54cc req-ba4620ee-14e4-40ba-af10-b17c5bb21f53 service nova] [instance: e0b7a064-03b6-4a0d-88be-2f12c12a1ddb] Received event network-vif-plugged-76c02515-a349-4b46-939a-cf520b5f3b33 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:55:45 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-18328392-dee5-4f9e-bf2c-2051e2fa54cc req-ba4620ee-14e4-40ba-af10-b17c5bb21f53 service nova] Acquiring lock "e0b7a064-03b6-4a0d-88be-2f12c12a1ddb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:55:45 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-18328392-dee5-4f9e-bf2c-2051e2fa54cc req-ba4620ee-14e4-40ba-af10-b17c5bb21f53 service nova] Lock "e0b7a064-03b6-4a0d-88be-2f12c12a1ddb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:55:45 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-18328392-dee5-4f9e-bf2c-2051e2fa54cc req-ba4620ee-14e4-40ba-af10-b17c5bb21f53 service nova] Lock "e0b7a064-03b6-4a0d-88be-2f12c12a1ddb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:55:45 user nova-compute[75176]: DEBUG nova.compute.manager [req-18328392-dee5-4f9e-bf2c-2051e2fa54cc req-ba4620ee-14e4-40ba-af10-b17c5bb21f53 service nova] [instance: e0b7a064-03b6-4a0d-88be-2f12c12a1ddb] No waiting events found dispatching network-vif-plugged-76c02515-a349-4b46-939a-cf520b5f3b33 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:55:45 user nova-compute[75176]: WARNING nova.compute.manager [req-18328392-dee5-4f9e-bf2c-2051e2fa54cc req-ba4620ee-14e4-40ba-af10-b17c5bb21f53 service nova] [instance: e0b7a064-03b6-4a0d-88be-2f12c12a1ddb] Received unexpected event network-vif-plugged-76c02515-a349-4b46-939a-cf520b5f3b33 for instance with vm_state building and task_state spawning.
Nov 28 15:55:45 user nova-compute[75176]: INFO nova.virt.libvirt.driver [-] [instance: 193235b9-8ef5-41d0-a9ab-4f1679d30266] Instance destroyed successfully.
Nov 28 15:55:45 user nova-compute[75176]: DEBUG nova.objects.instance [None req-96c5875d-a107-427d-9cd2-6012be3f318b tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Lazy-loading 'resources' on Instance uuid 193235b9-8ef5-41d0-a9ab-4f1679d30266 {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:55:45 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-96c5875d-a107-427d-9cd2-6012be3f318b tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T15:52:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1794209844',display_name='tempest-AttachVolumeNegativeTest-server-1794209844',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1794209844',id=37,image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGTxOfm1fi485fQCGM3mKeM4YdfflWo/HXai7jroVO5LkpL83smiyElCp44L7mLApfObOe8GGAjuxze4bn039XfAA4CeC5yfefDRI08N7t9fss1PS6g7R3hmYI3Xbtp5tQ==',key_name='tempest-keypair-2084612264',keypairs=<?>,launch_index=0,launched_at=2023-11-28T15:52:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a194f81f7e104be7940d1d05f71bbad9',ramdisk_id='',reservation_id='r-3kktfock',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1403590572',owner_user_name='tempest-AttachVolumeNegativeTest-1403590572-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T15:52:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f9a745552d974e05a9e0befc68eb7f6e',uuid=193235b9-8ef5-41d0-a9ab-4f1679d30266,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "44024d49-7b6d-415a-a9eb-fe53b53da379", "address": "fa:16:3e:21:d9:11", "network": {"id": "7ab60343-57be-427d-9037-6ecf0eaf5de0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1508138843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a194f81f7e104be7940d1d05f71bbad9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44024d49-7b", "ovs_interfaceid": "44024d49-7b6d-415a-a9eb-fe53b53da379", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 15:55:45 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-96c5875d-a107-427d-9cd2-6012be3f318b tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Converting VIF {"id": "44024d49-7b6d-415a-a9eb-fe53b53da379", "address": "fa:16:3e:21:d9:11", "network": {"id": "7ab60343-57be-427d-9037-6ecf0eaf5de0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1508138843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a194f81f7e104be7940d1d05f71bbad9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44024d49-7b", "ovs_interfaceid": "44024d49-7b6d-415a-a9eb-fe53b53da379", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:55:45 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-96c5875d-a107-427d-9cd2-6012be3f318b tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:21:d9:11,bridge_name='br-int',has_traffic_filtering=True,id=44024d49-7b6d-415a-a9eb-fe53b53da379,network=Network(7ab60343-57be-427d-9037-6ecf0eaf5de0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap44024d49-7b') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:55:45 user nova-compute[75176]: DEBUG os_vif [None req-96c5875d-a107-427d-9cd2-6012be3f318b tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:21:d9:11,bridge_name='br-int',has_traffic_filtering=True,id=44024d49-7b6d-415a-a9eb-fe53b53da379,network=Network(7ab60343-57be-427d-9037-6ecf0eaf5de0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap44024d49-7b') {{(pid=75176) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 15:55:45 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:55:45 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap44024d49-7b, bridge=br-int, if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:55:45 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:55:45 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:55:45 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:55:45 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:55:45 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=13084b03-3a8f-45c8-9765-f6e8f0e8c07f) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:55:45 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:55:45 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:55:45 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:55:45 user nova-compute[75176]: INFO os_vif [None req-96c5875d-a107-427d-9cd2-6012be3f318b tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:21:d9:11,bridge_name='br-int',has_traffic_filtering=True,id=44024d49-7b6d-415a-a9eb-fe53b53da379,network=Network(7ab60343-57be-427d-9037-6ecf0eaf5de0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap44024d49-7b')
Nov 28 15:55:45 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-96c5875d-a107-427d-9cd2-6012be3f318b tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] [instance: 193235b9-8ef5-41d0-a9ab-4f1679d30266] Deleting instance files /opt/stack/data/nova/instances/193235b9-8ef5-41d0-a9ab-4f1679d30266_del
Nov 28 15:55:45 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-96c5875d-a107-427d-9cd2-6012be3f318b tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] [instance: 193235b9-8ef5-41d0-a9ab-4f1679d30266] Deletion of /opt/stack/data/nova/instances/193235b9-8ef5-41d0-a9ab-4f1679d30266_del complete
Nov 28 15:55:45 user nova-compute[75176]: DEBUG nova.compute.manager [None req-da164ea8-c5d9-4326-862e-e08b76b1edc8 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: dc4e6d39-adfb-4d26-afef-46f316ff7846] Checking state {{(pid=75176) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 15:55:45 user nova-compute[75176]: INFO nova.compute.manager [None req-96c5875d-a107-427d-9cd2-6012be3f318b tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] [instance: 193235b9-8ef5-41d0-a9ab-4f1679d30266] Took 0.98 seconds to destroy the instance on the hypervisor.
Nov 28 15:55:45 user nova-compute[75176]: DEBUG oslo.service.loopingcall [None req-96c5875d-a107-427d-9cd2-6012be3f318b tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75176) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 15:55:45 user nova-compute[75176]: DEBUG nova.compute.manager [-] [instance: 193235b9-8ef5-41d0-a9ab-4f1679d30266] Deallocating network for instance {{(pid=75176) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 15:55:45 user nova-compute[75176]: DEBUG nova.network.neutron [-] [instance: 193235b9-8ef5-41d0-a9ab-4f1679d30266] deallocate_for_instance() {{(pid=75176) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 15:55:45 user nova-compute[75176]: DEBUG nova.compute.manager [None req-d734dcbe-fc8f-486f-ab26-b80485cb6960 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] [instance: e0b7a064-03b6-4a0d-88be-2f12c12a1ddb] Instance event wait completed in 0 seconds for  {{(pid=75176) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 15:55:45 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-d734dcbe-fc8f-486f-ab26-b80485cb6960 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] [instance: e0b7a064-03b6-4a0d-88be-2f12c12a1ddb] Guest created on hypervisor {{(pid=75176) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 15:55:45 user nova-compute[75176]: INFO nova.virt.libvirt.driver [-] [instance: e0b7a064-03b6-4a0d-88be-2f12c12a1ddb] Instance spawned successfully.
Nov 28 15:55:45 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-d734dcbe-fc8f-486f-ab26-b80485cb6960 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] [instance: e0b7a064-03b6-4a0d-88be-2f12c12a1ddb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 15:55:45 user nova-compute[75176]: DEBUG nova.compute.manager [req-5e53f9e1-43cc-47b6-9b37-7c141d829945 req-63456df1-8b1a-438c-8f5b-cc9cd64ed58e service nova] [instance: 193235b9-8ef5-41d0-a9ab-4f1679d30266] Received event network-vif-unplugged-44024d49-7b6d-415a-a9eb-fe53b53da379 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:55:45 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-5e53f9e1-43cc-47b6-9b37-7c141d829945 req-63456df1-8b1a-438c-8f5b-cc9cd64ed58e service nova] Acquiring lock "193235b9-8ef5-41d0-a9ab-4f1679d30266-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:55:45 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-5e53f9e1-43cc-47b6-9b37-7c141d829945 req-63456df1-8b1a-438c-8f5b-cc9cd64ed58e service nova] Lock "193235b9-8ef5-41d0-a9ab-4f1679d30266-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:55:45 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-5e53f9e1-43cc-47b6-9b37-7c141d829945 req-63456df1-8b1a-438c-8f5b-cc9cd64ed58e service nova] Lock "193235b9-8ef5-41d0-a9ab-4f1679d30266-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:55:45 user nova-compute[75176]: DEBUG nova.compute.manager [req-5e53f9e1-43cc-47b6-9b37-7c141d829945 req-63456df1-8b1a-438c-8f5b-cc9cd64ed58e service nova] [instance: 193235b9-8ef5-41d0-a9ab-4f1679d30266] No waiting events found dispatching network-vif-unplugged-44024d49-7b6d-415a-a9eb-fe53b53da379 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:55:45 user nova-compute[75176]: DEBUG nova.compute.manager [req-5e53f9e1-43cc-47b6-9b37-7c141d829945 req-63456df1-8b1a-438c-8f5b-cc9cd64ed58e service nova] [instance: 193235b9-8ef5-41d0-a9ab-4f1679d30266] Received event network-vif-unplugged-44024d49-7b6d-415a-a9eb-fe53b53da379 for instance with task_state deleting. {{(pid=75176) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 15:55:45 user nova-compute[75176]: DEBUG nova.compute.manager [req-5e53f9e1-43cc-47b6-9b37-7c141d829945 req-63456df1-8b1a-438c-8f5b-cc9cd64ed58e service nova] [instance: 193235b9-8ef5-41d0-a9ab-4f1679d30266] Received event network-vif-plugged-44024d49-7b6d-415a-a9eb-fe53b53da379 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:55:45 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-5e53f9e1-43cc-47b6-9b37-7c141d829945 req-63456df1-8b1a-438c-8f5b-cc9cd64ed58e service nova] Acquiring lock "193235b9-8ef5-41d0-a9ab-4f1679d30266-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:55:45 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-5e53f9e1-43cc-47b6-9b37-7c141d829945 req-63456df1-8b1a-438c-8f5b-cc9cd64ed58e service nova] Lock "193235b9-8ef5-41d0-a9ab-4f1679d30266-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:55:45 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-5e53f9e1-43cc-47b6-9b37-7c141d829945 req-63456df1-8b1a-438c-8f5b-cc9cd64ed58e service nova] Lock "193235b9-8ef5-41d0-a9ab-4f1679d30266-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:55:45 user nova-compute[75176]: DEBUG nova.compute.manager [req-5e53f9e1-43cc-47b6-9b37-7c141d829945 req-63456df1-8b1a-438c-8f5b-cc9cd64ed58e service nova] [instance: 193235b9-8ef5-41d0-a9ab-4f1679d30266] No waiting events found dispatching network-vif-plugged-44024d49-7b6d-415a-a9eb-fe53b53da379 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:55:45 user nova-compute[75176]: WARNING nova.compute.manager [req-5e53f9e1-43cc-47b6-9b37-7c141d829945 req-63456df1-8b1a-438c-8f5b-cc9cd64ed58e service nova] [instance: 193235b9-8ef5-41d0-a9ab-4f1679d30266] Received unexpected event network-vif-plugged-44024d49-7b6d-415a-a9eb-fe53b53da379 for instance with vm_state active and task_state deleting.
Nov 28 15:55:45 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-d734dcbe-fc8f-486f-ab26-b80485cb6960 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] [instance: e0b7a064-03b6-4a0d-88be-2f12c12a1ddb] Found default for hw_cdrom_bus of ide {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:55:45 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-d734dcbe-fc8f-486f-ab26-b80485cb6960 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] [instance: e0b7a064-03b6-4a0d-88be-2f12c12a1ddb] Found default for hw_disk_bus of virtio {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:55:45 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-d734dcbe-fc8f-486f-ab26-b80485cb6960 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] [instance: e0b7a064-03b6-4a0d-88be-2f12c12a1ddb] Found default for hw_input_bus of None {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:55:45 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-d734dcbe-fc8f-486f-ab26-b80485cb6960 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] [instance: e0b7a064-03b6-4a0d-88be-2f12c12a1ddb] Found default for hw_pointer_model of None {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:55:45 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-d734dcbe-fc8f-486f-ab26-b80485cb6960 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] [instance: e0b7a064-03b6-4a0d-88be-2f12c12a1ddb] Found default for hw_video_model of virtio {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:55:45 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-d734dcbe-fc8f-486f-ab26-b80485cb6960 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] [instance: e0b7a064-03b6-4a0d-88be-2f12c12a1ddb] Found default for hw_vif_model of virtio {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:55:45 user nova-compute[75176]: INFO nova.compute.manager [None req-d734dcbe-fc8f-486f-ab26-b80485cb6960 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] [instance: e0b7a064-03b6-4a0d-88be-2f12c12a1ddb] Took 7.52 seconds to spawn the instance on the hypervisor.
Nov 28 15:55:45 user nova-compute[75176]: DEBUG nova.compute.manager [None req-d734dcbe-fc8f-486f-ab26-b80485cb6960 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] [instance: e0b7a064-03b6-4a0d-88be-2f12c12a1ddb] Checking state {{(pid=75176) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 15:55:45 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-670c7c6a-91d3-43d9-a68f-dbc49ed634be tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 742bfe1e-6885-4aba-9f7f-c07a5d904175 {{(pid=75176) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 15:55:45 user nova-compute[75176]: INFO nova.compute.manager [None req-d734dcbe-fc8f-486f-ab26-b80485cb6960 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] [instance: e0b7a064-03b6-4a0d-88be-2f12c12a1ddb] Took 8.50 seconds to build instance.
Nov 28 15:55:45 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-d734dcbe-fc8f-486f-ab26-b80485cb6960 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Lock "e0b7a064-03b6-4a0d-88be-2f12c12a1ddb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.627s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:55:45 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "e0b7a064-03b6-4a0d-88be-2f12c12a1ddb" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 6.042s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:55:45 user nova-compute[75176]: INFO nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] [instance: e0b7a064-03b6-4a0d-88be-2f12c12a1ddb] During sync_power_state the instance has a pending task (spawning). Skip.
Nov 28 15:55:45 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "e0b7a064-03b6-4a0d-88be-2f12c12a1ddb" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:55:46 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-7f952b8d-49db-42c5-9ff2-857a859b1942 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] [instance: 2c154591-b130-4aa4-aad4-4c85324512df] Snapshot image upload complete
Nov 28 15:55:46 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7f952b8d-49db-42c5-9ff2-857a859b1942 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] [instance: 2c154591-b130-4aa4-aad4-4c85324512df] Checking state {{(pid=75176) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 15:55:46 user nova-compute[75176]: INFO nova.compute.manager [None req-7f952b8d-49db-42c5-9ff2-857a859b1942 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] [instance: 2c154591-b130-4aa4-aad4-4c85324512df] Shelve offloading
Nov 28 15:55:46 user nova-compute[75176]: INFO nova.virt.libvirt.driver [-] [instance: 2c154591-b130-4aa4-aad4-4c85324512df] Instance destroyed successfully.
Nov 28 15:55:46 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7f952b8d-49db-42c5-9ff2-857a859b1942 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] [instance: 2c154591-b130-4aa4-aad4-4c85324512df] Checking state {{(pid=75176) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 15:55:46 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7f952b8d-49db-42c5-9ff2-857a859b1942 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Acquiring lock "refresh_cache-2c154591-b130-4aa4-aad4-4c85324512df" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:55:46 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7f952b8d-49db-42c5-9ff2-857a859b1942 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Acquired lock "refresh_cache-2c154591-b130-4aa4-aad4-4c85324512df" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:55:46 user nova-compute[75176]: DEBUG nova.network.neutron [None req-7f952b8d-49db-42c5-9ff2-857a859b1942 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] [instance: 2c154591-b130-4aa4-aad4-4c85324512df] Building network info cache for instance {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 15:55:46 user nova-compute[75176]: DEBUG nova.network.neutron [-] [instance: 193235b9-8ef5-41d0-a9ab-4f1679d30266] Updating instance_info_cache with network_info: [] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:55:46 user nova-compute[75176]: INFO nova.compute.manager [-] [instance: 193235b9-8ef5-41d0-a9ab-4f1679d30266] Took 0.97 seconds to deallocate network for instance.
Nov 28 15:55:46 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-96c5875d-a107-427d-9cd2-6012be3f318b tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:55:46 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-96c5875d-a107-427d-9cd2-6012be3f318b tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:55:47 user nova-compute[75176]: DEBUG nova.network.neutron [None req-7f952b8d-49db-42c5-9ff2-857a859b1942 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] [instance: 2c154591-b130-4aa4-aad4-4c85324512df] Updating instance_info_cache with network_info: [{"id": "c743768f-0b40-435a-8754-96784ae96dda", "address": "fa:16:3e:c1:2c:1c", "network": {"id": "5d0ae041-a67d-4a54-bd53-104c4f44209d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-938551772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "169fdaea89d4431aa6adacdbb76f3546", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc743768f-0b", "ovs_interfaceid": "c743768f-0b40-435a-8754-96784ae96dda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:55:47 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7f952b8d-49db-42c5-9ff2-857a859b1942 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Releasing lock "refresh_cache-2c154591-b130-4aa4-aad4-4c85324512df" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:55:47 user nova-compute[75176]: DEBUG nova.compute.provider_tree [None req-96c5875d-a107-427d-9cd2-6012be3f318b tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Inventory has not changed in ProviderTree for provider: b37848d8-f401-4155-a029-b0ffa09ff85b {{(pid=75176) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 15:55:47 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-96c5875d-a107-427d-9cd2-6012be3f318b tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Inventory has not changed for provider b37848d8-f401-4155-a029-b0ffa09ff85b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75176) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 15:55:47 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-96c5875d-a107-427d-9cd2-6012be3f318b tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.466s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:55:47 user nova-compute[75176]: INFO nova.scheduler.client.report [None req-96c5875d-a107-427d-9cd2-6012be3f318b tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Deleted allocations for instance 193235b9-8ef5-41d0-a9ab-4f1679d30266
Nov 28 15:55:47 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-96c5875d-a107-427d-9cd2-6012be3f318b tempest-AttachVolumeNegativeTest-1403590572 tempest-AttachVolumeNegativeTest-1403590572-project-member] Lock "193235b9-8ef5-41d0-a9ab-4f1679d30266" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.633s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:55:47 user nova-compute[75176]: INFO nova.virt.libvirt.driver [-] [instance: 2c154591-b130-4aa4-aad4-4c85324512df] Instance destroyed successfully.
Nov 28 15:55:47 user nova-compute[75176]: DEBUG nova.objects.instance [None req-7f952b8d-49db-42c5-9ff2-857a859b1942 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Lazy-loading 'resources' on Instance uuid 2c154591-b130-4aa4-aad4-4c85324512df {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:55:47 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-7f952b8d-49db-42c5-9ff2-857a859b1942 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T15:53:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-130212440',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-130212440',id=39,image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGX7gmaaJWlutz/TKDo+wkCFFen5sReDn+1HuisCX/yqohTszCj8BZs1uuq8QFCZ3S7ilSOTHvQUXrHX6M5+9jiqleMWZztv4BQdNTI6ilr9cn1OCtm55/Gf1FtOLQUPeg==',key_name='tempest-keypair-780187379',keypairs=<?>,launch_index=0,launched_at=2023-11-28T15:53:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='169fdaea89d4431aa6adacdbb76f3546',ramdisk_id='',reservation_id='r-cpedp58n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1264107218',owner_user_name='tempest-AttachVolumeShelveTestJSON-1264107218-project-member',shelved_at='2023-11-28T15:55:46.363341',shelved_host='user',shelved_image_id='8d77ced3-9ecf-4009-ba49-2589530341cc'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T15:55:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3146d6b1e7324ebaa62ade09f1d1c68f',uuid=2c154591-b130-4aa4-aad4-4c85324512df,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "c743768f-0b40-435a-8754-96784ae96dda", "address": "fa:16:3e:c1:2c:1c", "network": {"id": "5d0ae041-a67d-4a54-bd53-104c4f44209d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-938551772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "169fdaea89d4431aa6adacdbb76f3546", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc743768f-0b", "ovs_interfaceid": "c743768f-0b40-435a-8754-96784ae96dda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 15:55:47 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-7f952b8d-49db-42c5-9ff2-857a859b1942 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Converting VIF {"id": "c743768f-0b40-435a-8754-96784ae96dda", "address": "fa:16:3e:c1:2c:1c", "network": {"id": "5d0ae041-a67d-4a54-bd53-104c4f44209d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-938551772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "169fdaea89d4431aa6adacdbb76f3546", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc743768f-0b", "ovs_interfaceid": "c743768f-0b40-435a-8754-96784ae96dda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:55:47 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-7f952b8d-49db-42c5-9ff2-857a859b1942 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:2c:1c,bridge_name='br-int',has_traffic_filtering=True,id=c743768f-0b40-435a-8754-96784ae96dda,network=Network(5d0ae041-a67d-4a54-bd53-104c4f44209d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc743768f-0b') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:55:47 user nova-compute[75176]: DEBUG os_vif [None req-7f952b8d-49db-42c5-9ff2-857a859b1942 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:2c:1c,bridge_name='br-int',has_traffic_filtering=True,id=c743768f-0b40-435a-8754-96784ae96dda,network=Network(5d0ae041-a67d-4a54-bd53-104c4f44209d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc743768f-0b') {{(pid=75176) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 15:55:47 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:55:47 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc743768f-0b, bridge=br-int, if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:55:47 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:55:47 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:55:47 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:55:47 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=dd65c93c-9bd2-4fbb-a051-dbbb3f4a9f17) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:55:47 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:55:47 user nova-compute[75176]: DEBUG nova.compute.manager [req-a4b270b7-b78c-4643-9cec-e48b549ac6e7 req-5c6d75df-264f-4dd0-b46f-a247ce15fc5d service nova] [instance: 2c154591-b130-4aa4-aad4-4c85324512df] Received event network-changed-c743768f-0b40-435a-8754-96784ae96dda {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:55:47 user nova-compute[75176]: DEBUG nova.compute.manager [req-a4b270b7-b78c-4643-9cec-e48b549ac6e7 req-5c6d75df-264f-4dd0-b46f-a247ce15fc5d service nova] [instance: 2c154591-b130-4aa4-aad4-4c85324512df] Refreshing instance network info cache due to event network-changed-c743768f-0b40-435a-8754-96784ae96dda. {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 15:55:47 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-a4b270b7-b78c-4643-9cec-e48b549ac6e7 req-5c6d75df-264f-4dd0-b46f-a247ce15fc5d service nova] Acquiring lock "refresh_cache-2c154591-b130-4aa4-aad4-4c85324512df" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:55:47 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-a4b270b7-b78c-4643-9cec-e48b549ac6e7 req-5c6d75df-264f-4dd0-b46f-a247ce15fc5d service nova] Acquired lock "refresh_cache-2c154591-b130-4aa4-aad4-4c85324512df" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:55:47 user nova-compute[75176]: DEBUG nova.network.neutron [req-a4b270b7-b78c-4643-9cec-e48b549ac6e7 req-5c6d75df-264f-4dd0-b46f-a247ce15fc5d service nova] [instance: 2c154591-b130-4aa4-aad4-4c85324512df] Refreshing network info cache for port c743768f-0b40-435a-8754-96784ae96dda {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 15:55:47 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:55:47 user nova-compute[75176]: INFO os_vif [None req-7f952b8d-49db-42c5-9ff2-857a859b1942 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:2c:1c,bridge_name='br-int',has_traffic_filtering=True,id=c743768f-0b40-435a-8754-96784ae96dda,network=Network(5d0ae041-a67d-4a54-bd53-104c4f44209d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc743768f-0b')
Nov 28 15:55:47 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-7f952b8d-49db-42c5-9ff2-857a859b1942 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] [instance: 2c154591-b130-4aa4-aad4-4c85324512df] Deleting instance files /opt/stack/data/nova/instances/2c154591-b130-4aa4-aad4-4c85324512df_del
Nov 28 15:55:47 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-7f952b8d-49db-42c5-9ff2-857a859b1942 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] [instance: 2c154591-b130-4aa4-aad4-4c85324512df] Deletion of /opt/stack/data/nova/instances/2c154591-b130-4aa4-aad4-4c85324512df_del complete
Nov 28 15:55:47 user nova-compute[75176]: DEBUG nova.compute.manager [req-03959fc0-d04b-4f9c-9087-a434afedde13 req-897b2bb2-1088-453e-94c1-7583229797be service nova] [instance: 193235b9-8ef5-41d0-a9ab-4f1679d30266] Received event network-vif-deleted-44024d49-7b6d-415a-a9eb-fe53b53da379 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:55:47 user nova-compute[75176]: INFO nova.scheduler.client.report [None req-7f952b8d-49db-42c5-9ff2-857a859b1942 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Deleted allocations for instance 2c154591-b130-4aa4-aad4-4c85324512df
Nov 28 15:55:47 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7f952b8d-49db-42c5-9ff2-857a859b1942 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:55:47 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7f952b8d-49db-42c5-9ff2-857a859b1942 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:55:47 user nova-compute[75176]: DEBUG nova.objects.instance [None req-7f952b8d-49db-42c5-9ff2-857a859b1942 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Lazy-loading 'numa_topology' on Instance uuid 2c154591-b130-4aa4-aad4-4c85324512df {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:55:47 user nova-compute[75176]: DEBUG nova.objects.base [None req-7f952b8d-49db-42c5-9ff2-857a859b1942 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Object Instance<2c154591-b130-4aa4-aad4-4c85324512df> lazy-loaded attributes: resources,numa_topology {{(pid=75176) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 15:55:48 user nova-compute[75176]: DEBUG nova.network.neutron [req-a4b270b7-b78c-4643-9cec-e48b549ac6e7 req-5c6d75df-264f-4dd0-b46f-a247ce15fc5d service nova] [instance: 2c154591-b130-4aa4-aad4-4c85324512df] Updated VIF entry in instance network info cache for port c743768f-0b40-435a-8754-96784ae96dda. {{(pid=75176) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 15:55:48 user nova-compute[75176]: DEBUG nova.network.neutron [req-a4b270b7-b78c-4643-9cec-e48b549ac6e7 req-5c6d75df-264f-4dd0-b46f-a247ce15fc5d service nova] [instance: 2c154591-b130-4aa4-aad4-4c85324512df] Updating instance_info_cache with network_info: [{"id": "c743768f-0b40-435a-8754-96784ae96dda", "address": "fa:16:3e:c1:2c:1c", "network": {"id": "5d0ae041-a67d-4a54-bd53-104c4f44209d", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-938551772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "169fdaea89d4431aa6adacdbb76f3546", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapc743768f-0b", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:55:48 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-a4b270b7-b78c-4643-9cec-e48b549ac6e7 req-5c6d75df-264f-4dd0-b46f-a247ce15fc5d service nova] Releasing lock "refresh_cache-2c154591-b130-4aa4-aad4-4c85324512df" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:55:48 user nova-compute[75176]: DEBUG nova.compute.provider_tree [None req-7f952b8d-49db-42c5-9ff2-857a859b1942 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Inventory has not changed in ProviderTree for provider: b37848d8-f401-4155-a029-b0ffa09ff85b {{(pid=75176) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 15:55:48 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-7f952b8d-49db-42c5-9ff2-857a859b1942 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Inventory has not changed for provider b37848d8-f401-4155-a029-b0ffa09ff85b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75176) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 15:55:48 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7f952b8d-49db-42c5-9ff2-857a859b1942 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.449s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:55:48 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7f952b8d-49db-42c5-9ff2-857a859b1942 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Lock "2c154591-b130-4aa4-aad4-4c85324512df" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.793s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:55:49 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:55:52 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:55:53 user nova-compute[75176]: DEBUG nova.compute.manager [req-7a68b750-78d2-4971-a408-5a6a48a093c0 req-1f1c3ecc-32b1-4617-a35f-41d21e256264 service nova] [instance: f1b1fc0f-1865-4020-91ee-25a5e16127cf] Received event network-changed-be523c77-4157-491b-be90-3b45d62b5523 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:55:53 user nova-compute[75176]: DEBUG nova.compute.manager [req-7a68b750-78d2-4971-a408-5a6a48a093c0 req-1f1c3ecc-32b1-4617-a35f-41d21e256264 service nova] [instance: f1b1fc0f-1865-4020-91ee-25a5e16127cf] Refreshing instance network info cache due to event network-changed-be523c77-4157-491b-be90-3b45d62b5523. {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 15:55:53 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-7a68b750-78d2-4971-a408-5a6a48a093c0 req-1f1c3ecc-32b1-4617-a35f-41d21e256264 service nova] Acquiring lock "refresh_cache-f1b1fc0f-1865-4020-91ee-25a5e16127cf" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:55:53 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-7a68b750-78d2-4971-a408-5a6a48a093c0 req-1f1c3ecc-32b1-4617-a35f-41d21e256264 service nova] Acquired lock "refresh_cache-f1b1fc0f-1865-4020-91ee-25a5e16127cf" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:55:53 user nova-compute[75176]: DEBUG nova.network.neutron [req-7a68b750-78d2-4971-a408-5a6a48a093c0 req-1f1c3ecc-32b1-4617-a35f-41d21e256264 service nova] [instance: f1b1fc0f-1865-4020-91ee-25a5e16127cf] Refreshing network info cache for port be523c77-4157-491b-be90-3b45d62b5523 {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 15:55:54 user nova-compute[75176]: DEBUG nova.network.neutron [req-7a68b750-78d2-4971-a408-5a6a48a093c0 req-1f1c3ecc-32b1-4617-a35f-41d21e256264 service nova] [instance: f1b1fc0f-1865-4020-91ee-25a5e16127cf] Updated VIF entry in instance network info cache for port be523c77-4157-491b-be90-3b45d62b5523. {{(pid=75176) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 15:55:54 user nova-compute[75176]: DEBUG nova.network.neutron [req-7a68b750-78d2-4971-a408-5a6a48a093c0 req-1f1c3ecc-32b1-4617-a35f-41d21e256264 service nova] [instance: f1b1fc0f-1865-4020-91ee-25a5e16127cf] Updating instance_info_cache with network_info: [{"id": "be523c77-4157-491b-be90-3b45d62b5523", "address": "fa:16:3e:4e:dd:53", "network": {"id": "5ec264ad-3459-468c-bdbf-c6a4ef016951", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1574289626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07c7783cc16049208421204910982c79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe523c77-41", "ovs_interfaceid": "be523c77-4157-491b-be90-3b45d62b5523", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:55:54 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-7a68b750-78d2-4971-a408-5a6a48a093c0 req-1f1c3ecc-32b1-4617-a35f-41d21e256264 service nova] Releasing lock "refresh_cache-f1b1fc0f-1865-4020-91ee-25a5e16127cf" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:55:54 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-1a2a49fd-e24e-481f-9380-e40b6668c159 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Acquiring lock "f1b1fc0f-1865-4020-91ee-25a5e16127cf" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:55:54 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-1a2a49fd-e24e-481f-9380-e40b6668c159 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Lock "f1b1fc0f-1865-4020-91ee-25a5e16127cf" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:55:54 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-1a2a49fd-e24e-481f-9380-e40b6668c159 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Acquiring lock "f1b1fc0f-1865-4020-91ee-25a5e16127cf-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:55:54 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-1a2a49fd-e24e-481f-9380-e40b6668c159 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Lock "f1b1fc0f-1865-4020-91ee-25a5e16127cf-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:55:54 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-1a2a49fd-e24e-481f-9380-e40b6668c159 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Lock "f1b1fc0f-1865-4020-91ee-25a5e16127cf-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:55:54 user nova-compute[75176]: INFO nova.compute.manager [None req-1a2a49fd-e24e-481f-9380-e40b6668c159 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: f1b1fc0f-1865-4020-91ee-25a5e16127cf] Terminating instance
Nov 28 15:55:54 user nova-compute[75176]: DEBUG nova.compute.manager [None req-1a2a49fd-e24e-481f-9380-e40b6668c159 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: f1b1fc0f-1865-4020-91ee-25a5e16127cf] Start destroying the instance on the hypervisor. {{(pid=75176) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 15:55:54 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:55:54 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:55:54 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:55:54 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:55:54 user nova-compute[75176]: DEBUG nova.compute.manager [req-1869e1b9-1d8d-4638-a8b0-8e7344ba2d7d req-41a3473d-bb08-4f61-abe5-a5e9d8b80b2f service nova] [instance: f1b1fc0f-1865-4020-91ee-25a5e16127cf] Received event network-vif-unplugged-be523c77-4157-491b-be90-3b45d62b5523 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:55:54 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-1869e1b9-1d8d-4638-a8b0-8e7344ba2d7d req-41a3473d-bb08-4f61-abe5-a5e9d8b80b2f service nova] Acquiring lock "f1b1fc0f-1865-4020-91ee-25a5e16127cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:55:54 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-1869e1b9-1d8d-4638-a8b0-8e7344ba2d7d req-41a3473d-bb08-4f61-abe5-a5e9d8b80b2f service nova] Lock "f1b1fc0f-1865-4020-91ee-25a5e16127cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:55:54 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-1869e1b9-1d8d-4638-a8b0-8e7344ba2d7d req-41a3473d-bb08-4f61-abe5-a5e9d8b80b2f service nova] Lock "f1b1fc0f-1865-4020-91ee-25a5e16127cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:55:54 user nova-compute[75176]: DEBUG nova.compute.manager [req-1869e1b9-1d8d-4638-a8b0-8e7344ba2d7d req-41a3473d-bb08-4f61-abe5-a5e9d8b80b2f service nova] [instance: f1b1fc0f-1865-4020-91ee-25a5e16127cf] No waiting events found dispatching network-vif-unplugged-be523c77-4157-491b-be90-3b45d62b5523 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:55:54 user nova-compute[75176]: DEBUG nova.compute.manager [req-1869e1b9-1d8d-4638-a8b0-8e7344ba2d7d req-41a3473d-bb08-4f61-abe5-a5e9d8b80b2f service nova] [instance: f1b1fc0f-1865-4020-91ee-25a5e16127cf] Received event network-vif-unplugged-be523c77-4157-491b-be90-3b45d62b5523 for instance with task_state deleting. {{(pid=75176) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 15:55:54 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:55:55 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:55:55 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:55:55 user nova-compute[75176]: INFO nova.virt.libvirt.driver [-] [instance: f1b1fc0f-1865-4020-91ee-25a5e16127cf] Instance destroyed successfully.
Nov 28 15:55:55 user nova-compute[75176]: DEBUG nova.objects.instance [None req-1a2a49fd-e24e-481f-9380-e40b6668c159 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Lazy-loading 'resources' on Instance uuid f1b1fc0f-1865-4020-91ee-25a5e16127cf {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:55:55 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-1a2a49fd-e24e-481f-9380-e40b6668c159 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T15:54:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1219018675',display_name='tempest-TestVolumeBootPattern-server-1219018675',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1219018675',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAT4j4MwMCXcgxPv2ypvh6Le18WUkR/7PQX0ERUSwv8uiHb35AkMlGdcRbKgULWyfAemfpuoTAyzTZycSyQIMMK+kqb2pUHOOT/5otX0G6BKfJMaYPfRy2E0NOlU0WUh/Q==',key_name='tempest-TestVolumeBootPattern-94664483',keypairs=<?>,launch_index=0,launched_at=2023-11-28T15:54:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='07c7783cc16049208421204910982c79',ramdisk_id='',reservation_id='r-57eqnllg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1695196118',owner_user_name='tempest-TestVolumeBootPattern-1695196118-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T15:54:18Z,user_data=None,user_id='081bf84d24194b81be4e0a6638db9b66',uuid=f1b1fc0f-1865-4020-91ee-25a5e16127cf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "be523c77-4157-491b-be90-3b45d62b5523", "address": "fa:16:3e:4e:dd:53", "network": {"id": "5ec264ad-3459-468c-bdbf-c6a4ef016951", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1574289626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07c7783cc16049208421204910982c79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe523c77-41", "ovs_interfaceid": "be523c77-4157-491b-be90-3b45d62b5523", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 15:55:55 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-1a2a49fd-e24e-481f-9380-e40b6668c159 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Converting VIF {"id": "be523c77-4157-491b-be90-3b45d62b5523", "address": "fa:16:3e:4e:dd:53", "network": {"id": "5ec264ad-3459-468c-bdbf-c6a4ef016951", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1574289626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07c7783cc16049208421204910982c79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe523c77-41", "ovs_interfaceid": "be523c77-4157-491b-be90-3b45d62b5523", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:55:55 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-1a2a49fd-e24e-481f-9380-e40b6668c159 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:dd:53,bridge_name='br-int',has_traffic_filtering=True,id=be523c77-4157-491b-be90-3b45d62b5523,network=Network(5ec264ad-3459-468c-bdbf-c6a4ef016951),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe523c77-41') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:55:55 user nova-compute[75176]: DEBUG os_vif [None req-1a2a49fd-e24e-481f-9380-e40b6668c159 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:dd:53,bridge_name='br-int',has_traffic_filtering=True,id=be523c77-4157-491b-be90-3b45d62b5523,network=Network(5ec264ad-3459-468c-bdbf-c6a4ef016951),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe523c77-41') {{(pid=75176) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 15:55:55 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:55:55 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbe523c77-41, bridge=br-int, if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:55:55 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:55:55 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:55:55 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:55:55 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=738473f3-7aed-4f69-8008-b6a42add6d7e) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:55:55 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:55:55 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:55:55 user nova-compute[75176]: INFO os_vif [None req-1a2a49fd-e24e-481f-9380-e40b6668c159 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:dd:53,bridge_name='br-int',has_traffic_filtering=True,id=be523c77-4157-491b-be90-3b45d62b5523,network=Network(5ec264ad-3459-468c-bdbf-c6a4ef016951),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe523c77-41')
Nov 28 15:55:55 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1a2a49fd-e24e-481f-9380-e40b6668c159 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: f1b1fc0f-1865-4020-91ee-25a5e16127cf] calling os-brick to detach iSCSI Volume {{(pid=75176) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 15:55:55 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a2a49fd-e24e-481f-9380-e40b6668c159 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c1b8a00>, {'target_iqn': 'iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tspqduOv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 15:55:55 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-1a2a49fd-e24e-481f-9380-e40b6668c159 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 15:55:55 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-1a2a49fd-e24e-481f-9380-e40b6668c159 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 15:55:55 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-1a2a49fd-e24e-481f-9380-e40b6668c159 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 15:55:55 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:55:55 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:55:55 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:55:55 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eaa52fd-1770-4d6f-a2dd-efc2d963c9ff]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4a147af7-f082-42cf-ae1c-e5b98314a152\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f95c57b0-7531-4206-81ae-6f8f993da96c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:55:55 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a2a49fd-e24e-481f-9380-e40b6668c159 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 15:55:55 user nova-compute[75176]: No targets found.
Nov 28 15:55:55 user nova-compute[75176]: iSNS:
Nov 28 15:55:55 user nova-compute[75176]: No targets found.
Nov 28 15:55:55 user nova-compute[75176]: STATIC:
Nov 28 15:55:55 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:4a147af7-f082-42cf-ae1c-e5b98314a152
Nov 28 15:55:55 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:55:55 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:55:55 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0
Nov 28 15:55:55 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:55:55 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:55:55 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6
Nov 28 15:55:55 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:55:55 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:55:55 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc
Nov 28 15:55:55 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:55:55 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:55:55 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:f95c57b0-7531-4206-81ae-6f8f993da96c
Nov 28 15:55:55 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:55:55 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:55:55 user nova-compute[75176]: FIRMWARE:
Nov 28 15:55:55 user nova-compute[75176]: No targets found.
Nov 28 15:55:55 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:55:55 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a2a49fd-e24e-481f-9380-e40b6668c159 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 15:55:55 user nova-compute[75176]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 15:55:55 user nova-compute[75176]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75176) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 15:55:55 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a2a49fd-e24e-481f-9380-e40b6668c159 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0', 0)] {{(pid=75176) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 15:55:55 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:55:55 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.029s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:55:55 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d6e9154-3845-46c4-96e5-b601274296e1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4a147af7-f082-42cf-ae1c-e5b98314a152\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f95c57b0-7531-4206-81ae-6f8f993da96c\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:55:55 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:55:55 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:55:55 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[f70b7229-30d2-43fe-93d1-323c780c9c37]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a147af7-f082-42cf-ae1c-e5b98314a152 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f95c57b0-7531-4206-81ae-6f8f993da96c (non-flash)\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:55:55 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a2a49fd-e24e-481f-9380-e40b6668c159 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 (non-flash)
Nov 28 15:55:55 user nova-compute[75176]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc (non-flash)
Nov 28 15:55:55 user nova-compute[75176]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0 (non-flash)
Nov 28 15:55:55 user nova-compute[75176]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a147af7-f082-42cf-ae1c-e5b98314a152 (non-flash)
Nov 28 15:55:55 user nova-compute[75176]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f95c57b0-7531-4206-81ae-6f8f993da96c (non-flash)
Nov 28 15:55:55 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:55:55 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a2a49fd-e24e-481f-9380-e40b6668c159 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 (non-flash)
Nov 28 15:55:55 user nova-compute[75176]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc (non-flash)
Nov 28 15:55:55 user nova-compute[75176]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0 (non-flash)
Nov 28 15:55:55 user nova-compute[75176]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a147af7-f082-42cf-ae1c-e5b98314a152 (non-flash)
Nov 28 15:55:55 user nova-compute[75176]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f95c57b0-7531-4206-81ae-6f8f993da96c (non-flash)
Nov 28 15:55:55 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 15:55:55 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a2a49fd-e24e-481f-9380-e40b6668c159 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f464c1fcdc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0'): ({'sdb'}, set())}) {{(pid=75176) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 15:55:55 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-1a2a49fd-e24e-481f-9380-e40b6668c159 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Removing single pathed devices sdb {{(pid=75176) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 15:55:55 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:55:55 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.033s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:55:55 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac7c25cf-2b02-4fca-b504-63ba23508c53]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:55:55 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:55:55 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.028s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:55:55 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[a815fd47-9d9b-40b9-bcfc-5ed675004ab8]: (4, ('ok\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:55:55 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-1a2a49fd-e24e-481f-9380-e40b6668c159 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Flushing IO for device /dev/sdb {{(pid=75176) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 15:55:55 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:55:55 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:55:55 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b8eb4b4-0778-4a03-a44b-eec5aefe7007]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:55:55 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-1a2a49fd-e24e-481f-9380-e40b6668c159 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75176) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 15:55:55 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:55:55 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.052s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:55:55 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[f36f3944-f900-47a6-bb92-682601c64c07]: (4, ('1', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:55:55 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-1a2a49fd-e24e-481f-9380-e40b6668c159 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75176) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 15:55:55 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-1a2a49fd-e24e-481f-9380-e40b6668c159 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] SCSI volumes sdb have been removed. {{(pid=75176) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 15:55:55 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a2a49fd-e24e-481f-9380-e40b6668c159 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0')] {{(pid=75176) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 15:55:55 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:55:55 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:55:55 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:55:55 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f51ea69-f791-4358-a531-96939f2ab509]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:55:55 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a2a49fd-e24e-481f-9380-e40b6668c159 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:55:55 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0 -p 172.16.0.220:3260 --logout {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:55:55 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:55:55 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7ceab2e-b548-466c-8de1-3972d362b33c]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:55:55 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a2a49fd-e24e-481f-9380-e40b6668c159 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0, portal: 172.16.0.220,3260]
Nov 28 15:55:55 user nova-compute[75176]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0, portal: 172.16.0.220,3260] successful.
Nov 28 15:55:55 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:55:55 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0 -p 172.16.0.220:3260 --op delete {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:55:55 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:55:55 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2d2dc5d-3377-4a35-ac17-3506246746da]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:55:55 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a2a49fd-e24e-481f-9380-e40b6668c159 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:55:55 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-1a2a49fd-e24e-481f-9380-e40b6668c159 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.427s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 15:55:55 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a2a49fd-e24e-481f-9380-e40b6668c159 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] <== disconnect_volume: return (429ms) None {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 15:55:55 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1a2a49fd-e24e-481f-9380-e40b6668c159 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: f1b1fc0f-1865-4020-91ee-25a5e16127cf] Disconnected iSCSI Volume {{(pid=75176) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 15:55:55 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-1a2a49fd-e24e-481f-9380-e40b6668c159 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: f1b1fc0f-1865-4020-91ee-25a5e16127cf] Deleting instance files /opt/stack/data/nova/instances/f1b1fc0f-1865-4020-91ee-25a5e16127cf_del
Nov 28 15:55:55 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-1a2a49fd-e24e-481f-9380-e40b6668c159 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: f1b1fc0f-1865-4020-91ee-25a5e16127cf] Deletion of /opt/stack/data/nova/instances/f1b1fc0f-1865-4020-91ee-25a5e16127cf_del complete
Nov 28 15:55:55 user nova-compute[75176]: INFO nova.compute.manager [None req-1a2a49fd-e24e-481f-9380-e40b6668c159 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: f1b1fc0f-1865-4020-91ee-25a5e16127cf] Took 1.39 seconds to destroy the instance on the hypervisor.
Nov 28 15:55:55 user nova-compute[75176]: DEBUG oslo.service.loopingcall [None req-1a2a49fd-e24e-481f-9380-e40b6668c159 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75176) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 15:55:55 user nova-compute[75176]: DEBUG nova.compute.manager [-] [instance: f1b1fc0f-1865-4020-91ee-25a5e16127cf] Deallocating network for instance {{(pid=75176) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 15:55:55 user nova-compute[75176]: DEBUG nova.network.neutron [-] [instance: f1b1fc0f-1865-4020-91ee-25a5e16127cf] deallocate_for_instance() {{(pid=75176) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 15:55:55 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:55:55 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:55:55 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:55:55 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:55:56 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:55:56 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:55:56 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:55:56 user nova-compute[75176]: DEBUG nova.network.neutron [-] [instance: f1b1fc0f-1865-4020-91ee-25a5e16127cf] Updating instance_info_cache with network_info: [] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:55:56 user nova-compute[75176]: INFO nova.compute.manager [-] [instance: f1b1fc0f-1865-4020-91ee-25a5e16127cf] Took 0.95 seconds to deallocate network for instance.
Nov 28 15:55:56 user nova-compute[75176]: DEBUG nova.compute.manager [req-b36dbec4-dfb9-4bf0-977a-12fff5dfd3ed req-e089acff-4a9a-4787-8da9-65ea031291f9 service nova] [instance: f1b1fc0f-1865-4020-91ee-25a5e16127cf] Received event network-vif-plugged-be523c77-4157-491b-be90-3b45d62b5523 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:55:56 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-b36dbec4-dfb9-4bf0-977a-12fff5dfd3ed req-e089acff-4a9a-4787-8da9-65ea031291f9 service nova] Acquiring lock "f1b1fc0f-1865-4020-91ee-25a5e16127cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:55:56 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-b36dbec4-dfb9-4bf0-977a-12fff5dfd3ed req-e089acff-4a9a-4787-8da9-65ea031291f9 service nova] Lock "f1b1fc0f-1865-4020-91ee-25a5e16127cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:55:56 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-b36dbec4-dfb9-4bf0-977a-12fff5dfd3ed req-e089acff-4a9a-4787-8da9-65ea031291f9 service nova] Lock "f1b1fc0f-1865-4020-91ee-25a5e16127cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:55:56 user nova-compute[75176]: DEBUG nova.compute.manager [req-b36dbec4-dfb9-4bf0-977a-12fff5dfd3ed req-e089acff-4a9a-4787-8da9-65ea031291f9 service nova] [instance: f1b1fc0f-1865-4020-91ee-25a5e16127cf] No waiting events found dispatching network-vif-plugged-be523c77-4157-491b-be90-3b45d62b5523 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:55:56 user nova-compute[75176]: WARNING nova.compute.manager [req-b36dbec4-dfb9-4bf0-977a-12fff5dfd3ed req-e089acff-4a9a-4787-8da9-65ea031291f9 service nova] [instance: f1b1fc0f-1865-4020-91ee-25a5e16127cf] Received unexpected event network-vif-plugged-be523c77-4157-491b-be90-3b45d62b5523 for instance with vm_state active and task_state deleting.
Nov 28 15:55:56 user nova-compute[75176]: DEBUG nova.compute.manager [req-b36dbec4-dfb9-4bf0-977a-12fff5dfd3ed req-e089acff-4a9a-4787-8da9-65ea031291f9 service nova] [instance: f1b1fc0f-1865-4020-91ee-25a5e16127cf] Received event network-vif-plugged-be523c77-4157-491b-be90-3b45d62b5523 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:55:56 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-b36dbec4-dfb9-4bf0-977a-12fff5dfd3ed req-e089acff-4a9a-4787-8da9-65ea031291f9 service nova] Acquiring lock "f1b1fc0f-1865-4020-91ee-25a5e16127cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:55:56 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-b36dbec4-dfb9-4bf0-977a-12fff5dfd3ed req-e089acff-4a9a-4787-8da9-65ea031291f9 service nova] Lock "f1b1fc0f-1865-4020-91ee-25a5e16127cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:55:56 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-b36dbec4-dfb9-4bf0-977a-12fff5dfd3ed req-e089acff-4a9a-4787-8da9-65ea031291f9 service nova] Lock "f1b1fc0f-1865-4020-91ee-25a5e16127cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:55:56 user nova-compute[75176]: DEBUG nova.compute.manager [req-b36dbec4-dfb9-4bf0-977a-12fff5dfd3ed req-e089acff-4a9a-4787-8da9-65ea031291f9 service nova] [instance: f1b1fc0f-1865-4020-91ee-25a5e16127cf] No waiting events found dispatching network-vif-plugged-be523c77-4157-491b-be90-3b45d62b5523 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:55:56 user nova-compute[75176]: WARNING nova.compute.manager [req-b36dbec4-dfb9-4bf0-977a-12fff5dfd3ed req-e089acff-4a9a-4787-8da9-65ea031291f9 service nova] [instance: f1b1fc0f-1865-4020-91ee-25a5e16127cf] Received unexpected event network-vif-plugged-be523c77-4157-491b-be90-3b45d62b5523 for instance with vm_state active and task_state deleting.
Nov 28 15:55:56 user nova-compute[75176]: DEBUG nova.compute.manager [req-b36dbec4-dfb9-4bf0-977a-12fff5dfd3ed req-e089acff-4a9a-4787-8da9-65ea031291f9 service nova] [instance: f1b1fc0f-1865-4020-91ee-25a5e16127cf] Received event network-vif-plugged-be523c77-4157-491b-be90-3b45d62b5523 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:55:56 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-b36dbec4-dfb9-4bf0-977a-12fff5dfd3ed req-e089acff-4a9a-4787-8da9-65ea031291f9 service nova] Acquiring lock "f1b1fc0f-1865-4020-91ee-25a5e16127cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:55:56 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-b36dbec4-dfb9-4bf0-977a-12fff5dfd3ed req-e089acff-4a9a-4787-8da9-65ea031291f9 service nova] Lock "f1b1fc0f-1865-4020-91ee-25a5e16127cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:55:56 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-b36dbec4-dfb9-4bf0-977a-12fff5dfd3ed req-e089acff-4a9a-4787-8da9-65ea031291f9 service nova] Lock "f1b1fc0f-1865-4020-91ee-25a5e16127cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:55:56 user nova-compute[75176]: DEBUG nova.compute.manager [req-b36dbec4-dfb9-4bf0-977a-12fff5dfd3ed req-e089acff-4a9a-4787-8da9-65ea031291f9 service nova] [instance: f1b1fc0f-1865-4020-91ee-25a5e16127cf] No waiting events found dispatching network-vif-plugged-be523c77-4157-491b-be90-3b45d62b5523 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:55:56 user nova-compute[75176]: WARNING nova.compute.manager [req-b36dbec4-dfb9-4bf0-977a-12fff5dfd3ed req-e089acff-4a9a-4787-8da9-65ea031291f9 service nova] [instance: f1b1fc0f-1865-4020-91ee-25a5e16127cf] Received unexpected event network-vif-plugged-be523c77-4157-491b-be90-3b45d62b5523 for instance with vm_state active and task_state deleting.
Nov 28 15:55:56 user nova-compute[75176]: DEBUG nova.compute.manager [req-b36dbec4-dfb9-4bf0-977a-12fff5dfd3ed req-e089acff-4a9a-4787-8da9-65ea031291f9 service nova] [instance: f1b1fc0f-1865-4020-91ee-25a5e16127cf] Received event network-vif-unplugged-be523c77-4157-491b-be90-3b45d62b5523 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:55:56 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-b36dbec4-dfb9-4bf0-977a-12fff5dfd3ed req-e089acff-4a9a-4787-8da9-65ea031291f9 service nova] Acquiring lock "f1b1fc0f-1865-4020-91ee-25a5e16127cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:55:56 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-b36dbec4-dfb9-4bf0-977a-12fff5dfd3ed req-e089acff-4a9a-4787-8da9-65ea031291f9 service nova] Lock "f1b1fc0f-1865-4020-91ee-25a5e16127cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:55:56 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-b36dbec4-dfb9-4bf0-977a-12fff5dfd3ed req-e089acff-4a9a-4787-8da9-65ea031291f9 service nova] Lock "f1b1fc0f-1865-4020-91ee-25a5e16127cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:55:56 user nova-compute[75176]: DEBUG nova.compute.manager [req-b36dbec4-dfb9-4bf0-977a-12fff5dfd3ed req-e089acff-4a9a-4787-8da9-65ea031291f9 service nova] [instance: f1b1fc0f-1865-4020-91ee-25a5e16127cf] No waiting events found dispatching network-vif-unplugged-be523c77-4157-491b-be90-3b45d62b5523 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:55:56 user nova-compute[75176]: DEBUG nova.compute.manager [req-b36dbec4-dfb9-4bf0-977a-12fff5dfd3ed req-e089acff-4a9a-4787-8da9-65ea031291f9 service nova] [instance: f1b1fc0f-1865-4020-91ee-25a5e16127cf] Received event network-vif-unplugged-be523c77-4157-491b-be90-3b45d62b5523 for instance with task_state deleting. {{(pid=75176) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 15:55:56 user nova-compute[75176]: DEBUG nova.compute.manager [req-b36dbec4-dfb9-4bf0-977a-12fff5dfd3ed req-e089acff-4a9a-4787-8da9-65ea031291f9 service nova] [instance: f1b1fc0f-1865-4020-91ee-25a5e16127cf] Received event network-vif-plugged-be523c77-4157-491b-be90-3b45d62b5523 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:55:56 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-b36dbec4-dfb9-4bf0-977a-12fff5dfd3ed req-e089acff-4a9a-4787-8da9-65ea031291f9 service nova] Acquiring lock "f1b1fc0f-1865-4020-91ee-25a5e16127cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:55:56 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-b36dbec4-dfb9-4bf0-977a-12fff5dfd3ed req-e089acff-4a9a-4787-8da9-65ea031291f9 service nova] Lock "f1b1fc0f-1865-4020-91ee-25a5e16127cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:55:56 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-b36dbec4-dfb9-4bf0-977a-12fff5dfd3ed req-e089acff-4a9a-4787-8da9-65ea031291f9 service nova] Lock "f1b1fc0f-1865-4020-91ee-25a5e16127cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:55:56 user nova-compute[75176]: DEBUG nova.compute.manager [req-b36dbec4-dfb9-4bf0-977a-12fff5dfd3ed req-e089acff-4a9a-4787-8da9-65ea031291f9 service nova] [instance: f1b1fc0f-1865-4020-91ee-25a5e16127cf] No waiting events found dispatching network-vif-plugged-be523c77-4157-491b-be90-3b45d62b5523 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:55:56 user nova-compute[75176]: WARNING nova.compute.manager [req-b36dbec4-dfb9-4bf0-977a-12fff5dfd3ed req-e089acff-4a9a-4787-8da9-65ea031291f9 service nova] [instance: f1b1fc0f-1865-4020-91ee-25a5e16127cf] Received unexpected event network-vif-plugged-be523c77-4157-491b-be90-3b45d62b5523 for instance with vm_state active and task_state deleting.
Nov 28 15:55:56 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:55:57 user nova-compute[75176]: INFO nova.compute.manager [None req-1a2a49fd-e24e-481f-9380-e40b6668c159 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: f1b1fc0f-1865-4020-91ee-25a5e16127cf] Took 0.84 seconds to detach 1 volumes for instance.
Nov 28 15:55:57 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-1a2a49fd-e24e-481f-9380-e40b6668c159 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:55:57 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-1a2a49fd-e24e-481f-9380-e40b6668c159 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:55:57 user nova-compute[75176]: DEBUG nova.compute.provider_tree [None req-1a2a49fd-e24e-481f-9380-e40b6668c159 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Inventory has not changed in ProviderTree for provider: b37848d8-f401-4155-a029-b0ffa09ff85b {{(pid=75176) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 15:55:57 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-1a2a49fd-e24e-481f-9380-e40b6668c159 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Inventory has not changed for provider b37848d8-f401-4155-a029-b0ffa09ff85b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75176) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 15:55:57 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-1a2a49fd-e24e-481f-9380-e40b6668c159 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.288s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:55:57 user nova-compute[75176]: INFO nova.scheduler.client.report [None req-1a2a49fd-e24e-481f-9380-e40b6668c159 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Deleted allocations for instance f1b1fc0f-1865-4020-91ee-25a5e16127cf
Nov 28 15:55:57 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-1a2a49fd-e24e-481f-9380-e40b6668c159 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Lock "f1b1fc0f-1865-4020-91ee-25a5e16127cf" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.655s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:55:58 user nova-compute[75176]: DEBUG nova.compute.manager [req-73dbc812-5495-4bcb-ae9d-01b072c12a84 req-9f5441da-2b70-412f-8d86-f32098d73eb3 service nova] [instance: f1b1fc0f-1865-4020-91ee-25a5e16127cf] Received event network-vif-deleted-be523c77-4157-491b-be90-3b45d62b5523 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:55:58 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:55:58 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-ec25b820-937d-4669-abd8-c60c545787b6 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance ecabea76-6c29-412d-bf77-989917b449a9 is timed out.
Nov 28 15:55:58 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-ec25b820-937d-4669-abd8-c60c545787b6 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Successfully detached device vdb from instance ecabea76-6c29-412d-bf77-989917b449a9 from the live domain config.
Nov 28 15:55:58 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ec25b820-937d-4669-abd8-c60c545787b6 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] [instance: ecabea76-6c29-412d-bf77-989917b449a9] calling os-brick to detach iSCSI Volume {{(pid=75176) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 15:55:58 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec25b820-937d-4669-abd8-c60c545787b6 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c1b8a00>, {'target_iqn': 'iqn.2010-10.org.openstack:f95c57b0-7531-4206-81ae-6f8f993da96c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BvLxsCFZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 15:55:58 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-ec25b820-937d-4669-abd8-c60c545787b6 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 15:55:58 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-ec25b820-937d-4669-abd8-c60c545787b6 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 15:55:58 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-ec25b820-937d-4669-abd8-c60c545787b6 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 15:55:58 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:55:58 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:55:58 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[c06bf1bd-8271-471d-90e2-5272a4281e76]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4a147af7-f082-42cf-ae1c-e5b98314a152\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f95c57b0-7531-4206-81ae-6f8f993da96c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:55:58 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec25b820-937d-4669-abd8-c60c545787b6 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 15:55:58 user nova-compute[75176]: No targets found.
Nov 28 15:55:58 user nova-compute[75176]: iSNS:
Nov 28 15:55:58 user nova-compute[75176]: No targets found.
Nov 28 15:55:58 user nova-compute[75176]: STATIC:
Nov 28 15:55:58 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:4a147af7-f082-42cf-ae1c-e5b98314a152
Nov 28 15:55:58 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:55:58 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:55:58 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6
Nov 28 15:55:58 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:55:58 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:55:58 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc
Nov 28 15:55:58 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:55:58 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:55:58 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:f95c57b0-7531-4206-81ae-6f8f993da96c
Nov 28 15:55:58 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:55:58 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:55:58 user nova-compute[75176]: FIRMWARE:
Nov 28 15:55:58 user nova-compute[75176]: No targets found.
Nov 28 15:55:58 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:55:58 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec25b820-937d-4669-abd8-c60c545787b6 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 15:55:58 user nova-compute[75176]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 15:55:58 user nova-compute[75176]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75176) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 15:55:58 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec25b820-937d-4669-abd8-c60c545787b6 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f95c57b0-7531-4206-81ae-6f8f993da96c', 0)] {{(pid=75176) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 15:55:58 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:55:58 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:55:58 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d3872ef-bd5b-4e58-8651-b07168a618f4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4a147af7-f082-42cf-ae1c-e5b98314a152\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f95c57b0-7531-4206-81ae-6f8f993da96c\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:55:58 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:55:58 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:55:58 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[77706b6e-f1ff-4078-afd2-f6f1d23762df]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a147af7-f082-42cf-ae1c-e5b98314a152 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f95c57b0-7531-4206-81ae-6f8f993da96c (non-flash)\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:55:58 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec25b820-937d-4669-abd8-c60c545787b6 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 (non-flash)
Nov 28 15:55:58 user nova-compute[75176]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc (non-flash)
Nov 28 15:55:58 user nova-compute[75176]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a147af7-f082-42cf-ae1c-e5b98314a152 (non-flash)
Nov 28 15:55:58 user nova-compute[75176]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f95c57b0-7531-4206-81ae-6f8f993da96c (non-flash)
Nov 28 15:55:58 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:55:58 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec25b820-937d-4669-abd8-c60c545787b6 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 (non-flash)
Nov 28 15:55:58 user nova-compute[75176]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc (non-flash)
Nov 28 15:55:58 user nova-compute[75176]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a147af7-f082-42cf-ae1c-e5b98314a152 (non-flash)
Nov 28 15:55:58 user nova-compute[75176]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f95c57b0-7531-4206-81ae-6f8f993da96c (non-flash)
Nov 28 15:55:58 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 15:55:58 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec25b820-937d-4669-abd8-c60c545787b6 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f464c1fd240>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f95c57b0-7531-4206-81ae-6f8f993da96c'): ({'sdf'}, set())}) {{(pid=75176) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 15:55:58 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-ec25b820-937d-4669-abd8-c60c545787b6 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Removing single pathed devices sdf {{(pid=75176) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 15:55:58 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:55:58 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.046s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:55:58 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[644d3c00-103b-41ea-a6c6-5c2a5888ae47]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:55:58 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:55:59 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.021s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:55:59 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[10d04424-b75f-4acc-8119-6acf64ee6c99]: (4, ('ok\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:55:59 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-ec25b820-937d-4669-abd8-c60c545787b6 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Flushing IO for device /dev/sdf {{(pid=75176) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 15:55:59 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:55:59 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:55:59 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[31b6d352-a06b-46b3-9917-56474e6b137f]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:55:59 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-ec25b820-937d-4669-abd8-c60c545787b6 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75176) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 15:55:59 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:55:59 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.095s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:55:59 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[3de9934a-d737-4b8f-a8ee-f6916c10090d]: (4, ('1', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:55:59 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-ec25b820-937d-4669-abd8-c60c545787b6 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75176) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 15:55:59 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-ec25b820-937d-4669-abd8-c60c545787b6 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] SCSI volumes sdf have been removed. {{(pid=75176) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 15:55:59 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec25b820-937d-4669-abd8-c60c545787b6 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f95c57b0-7531-4206-81ae-6f8f993da96c')] {{(pid=75176) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 15:55:59 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f95c57b0-7531-4206-81ae-6f8f993da96c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:55:59 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f95c57b0-7531-4206-81ae-6f8f993da96c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.040s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:55:59 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc3c006d-72ad-4474-85af-a68919bed91f]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:55:59 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec25b820-937d-4669-abd8-c60c545787b6 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:55:59 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f95c57b0-7531-4206-81ae-6f8f993da96c -p 172.16.0.220:3260 --logout {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:55:59 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f95c57b0-7531-4206-81ae-6f8f993da96c -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:55:59 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d9a1a93-eca9-4e43-b531-6378db1afd37]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:f95c57b0-7531-4206-81ae-6f8f993da96c, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:f95c57b0-7531-4206-81ae-6f8f993da96c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:55:59 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec25b820-937d-4669-abd8-c60c545787b6 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:f95c57b0-7531-4206-81ae-6f8f993da96c, portal: 172.16.0.220,3260]
Nov 28 15:55:59 user nova-compute[75176]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:f95c57b0-7531-4206-81ae-6f8f993da96c, portal: 172.16.0.220,3260] successful.
Nov 28 15:55:59 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:55:59 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f95c57b0-7531-4206-81ae-6f8f993da96c -p 172.16.0.220:3260 --op delete {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:55:59 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f95c57b0-7531-4206-81ae-6f8f993da96c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:55:59 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1c89ef2-07a0-405f-9c60-963c07b3bc67]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:55:59 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec25b820-937d-4669-abd8-c60c545787b6 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:55:59 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-ec25b820-937d-4669-abd8-c60c545787b6 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.411s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 15:55:59 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec25b820-937d-4669-abd8-c60c545787b6 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] <== disconnect_volume: return (412ms) None {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 15:55:59 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ec25b820-937d-4669-abd8-c60c545787b6 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] [instance: ecabea76-6c29-412d-bf77-989917b449a9] Disconnected iSCSI Volume {{(pid=75176) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 15:55:59 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:55:59 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:56:00 user nova-compute[75176]: DEBUG nova.objects.instance [None req-ec25b820-937d-4669-abd8-c60c545787b6 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Lazy-loading 'flavor' on Instance uuid ecabea76-6c29-412d-bf77-989917b449a9 {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:56:00 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-ec25b820-937d-4669-abd8-c60c545787b6 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Lock "ecabea76-6c29-412d-bf77-989917b449a9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.944s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:56:00 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "ecabea76-6c29-412d-bf77-989917b449a9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 20.151s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:56:00 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "ecabea76-6c29-412d-bf77-989917b449a9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.023s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:56:00 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:56:01 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:56:01 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75176) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 15:56:02 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:56:03 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:56:04 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:56:04 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:56:04 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Starting heal instance info cache {{(pid=75176) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 15:56:04 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquiring lock "refresh_cache-6161cab2-eb1f-44cb-bbd5-077e6db42f77" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:56:04 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquired lock "refresh_cache-6161cab2-eb1f-44cb-bbd5-077e6db42f77" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:56:04 user nova-compute[75176]: DEBUG nova.network.neutron [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] [instance: 6161cab2-eb1f-44cb-bbd5-077e6db42f77] Forcefully refreshing network info cache for instance {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 15:56:05 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:56:05 user nova-compute[75176]: DEBUG nova.network.neutron [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] [instance: 6161cab2-eb1f-44cb-bbd5-077e6db42f77] Updating instance_info_cache with network_info: [{"id": "f2811544-4cf2-4302-b012-8bf1881b9b6c", "address": "fa:16:3e:2a:df:42", "network": {"id": "8b63f2d3-0683-4832-abc5-e4c796cf12ab", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-877608435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3704b38a2bd44cb78c28d3f6d86d9e60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2811544-4c", "ovs_interfaceid": "f2811544-4cf2-4302-b012-8bf1881b9b6c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:56:05 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Releasing lock "refresh_cache-6161cab2-eb1f-44cb-bbd5-077e6db42f77" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:56:05 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] [instance: 6161cab2-eb1f-44cb-bbd5-077e6db42f77] Updated the network info_cache for instance {{(pid=75176) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 15:56:05 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-670c7c6a-91d3-43d9-a68f-dbc49ed634be tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 742bfe1e-6885-4aba-9f7f-c07a5d904175 is timed out.
Nov 28 15:56:05 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-670c7c6a-91d3-43d9-a68f-dbc49ed634be tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] Successfully detached device vdb from instance 742bfe1e-6885-4aba-9f7f-c07a5d904175 from the live domain config.
Nov 28 15:56:05 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-670c7c6a-91d3-43d9-a68f-dbc49ed634be tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] [instance: 742bfe1e-6885-4aba-9f7f-c07a5d904175] calling os-brick to detach iSCSI Volume {{(pid=75176) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 15:56:05 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-670c7c6a-91d3-43d9-a68f-dbc49ed634be tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c1b8a00>, {'target_iqn': 'iqn.2010-10.org.openstack:4a147af7-f082-42cf-ae1c-e5b98314a152', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uWHmAeNg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 15:56:05 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-670c7c6a-91d3-43d9-a68f-dbc49ed634be tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 15:56:05 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-670c7c6a-91d3-43d9-a68f-dbc49ed634be tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 15:56:05 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-670c7c6a-91d3-43d9-a68f-dbc49ed634be tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 15:56:05 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:56:05 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:56:05 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[51113470-ed88-4320-9a7b-a54ffcce856e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4a147af7-f082-42cf-ae1c-e5b98314a152\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:56:05 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-670c7c6a-91d3-43d9-a68f-dbc49ed634be tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 15:56:05 user nova-compute[75176]: No targets found.
Nov 28 15:56:05 user nova-compute[75176]: iSNS:
Nov 28 15:56:05 user nova-compute[75176]: No targets found.
Nov 28 15:56:05 user nova-compute[75176]: STATIC:
Nov 28 15:56:05 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:4a147af7-f082-42cf-ae1c-e5b98314a152
Nov 28 15:56:05 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:56:05 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:56:05 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6
Nov 28 15:56:05 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:56:05 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:56:05 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc
Nov 28 15:56:05 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:56:05 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:56:05 user nova-compute[75176]: FIRMWARE:
Nov 28 15:56:05 user nova-compute[75176]: No targets found.
Nov 28 15:56:05 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:56:05 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-670c7c6a-91d3-43d9-a68f-dbc49ed634be tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 15:56:05 user nova-compute[75176]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 15:56:05 user nova-compute[75176]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75176) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 15:56:05 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-670c7c6a-91d3-43d9-a68f-dbc49ed634be tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4a147af7-f082-42cf-ae1c-e5b98314a152', 0)] {{(pid=75176) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 15:56:05 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:56:06 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:56:06 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c065ebe-d400-426c-b532-d332e63990a9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4a147af7-f082-42cf-ae1c-e5b98314a152\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:56:06 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:56:06 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:56:06 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ad7b9b5-326e-4f31-bd9c-b9625131a0d4]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a147af7-f082-42cf-ae1c-e5b98314a152 (non-flash)\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:56:06 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-670c7c6a-91d3-43d9-a68f-dbc49ed634be tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 (non-flash)
Nov 28 15:56:06 user nova-compute[75176]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc (non-flash)
Nov 28 15:56:06 user nova-compute[75176]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a147af7-f082-42cf-ae1c-e5b98314a152 (non-flash)
Nov 28 15:56:06 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:56:06 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-670c7c6a-91d3-43d9-a68f-dbc49ed634be tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 (non-flash)
Nov 28 15:56:06 user nova-compute[75176]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc (non-flash)
Nov 28 15:56:06 user nova-compute[75176]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a147af7-f082-42cf-ae1c-e5b98314a152 (non-flash)
Nov 28 15:56:06 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 15:56:06 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-670c7c6a-91d3-43d9-a68f-dbc49ed634be tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f464c6e8b80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4a147af7-f082-42cf-ae1c-e5b98314a152'): ({'sdc'}, set())}) {{(pid=75176) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 15:56:06 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-670c7c6a-91d3-43d9-a68f-dbc49ed634be tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] Removing single pathed devices sdc {{(pid=75176) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 15:56:06 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:56:06 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:56:06 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6d2e8ec-9ab9-49cf-b471-60e72e2d0521]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:56:06 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:56:06 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:56:06 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[62658866-97fc-40fc-9241-800a138d14da]: (4, ('ok\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:56:06 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-670c7c6a-91d3-43d9-a68f-dbc49ed634be tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] Flushing IO for device /dev/sdc {{(pid=75176) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 15:56:06 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:56:06 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:56:06 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f236c96-7363-4c02-8053-b358ccf78092]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:56:06 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-670c7c6a-91d3-43d9-a68f-dbc49ed634be tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75176) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 15:56:06 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:56:06 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.048s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:56:06 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f19470d-5139-4861-a02a-e70d02c64d21]: (4, ('1', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:56:06 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-670c7c6a-91d3-43d9-a68f-dbc49ed634be tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75176) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 15:56:06 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-670c7c6a-91d3-43d9-a68f-dbc49ed634be tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] SCSI volumes sdc have been removed. {{(pid=75176) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 15:56:06 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-670c7c6a-91d3-43d9-a68f-dbc49ed634be tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4a147af7-f082-42cf-ae1c-e5b98314a152')] {{(pid=75176) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 15:56:06 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a147af7-f082-42cf-ae1c-e5b98314a152 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:56:06 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a147af7-f082-42cf-ae1c-e5b98314a152 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:56:06 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[79ceb50d-7064-463c-82a3-29d007d3bb61]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:56:06 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-670c7c6a-91d3-43d9-a68f-dbc49ed634be tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:56:06 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a147af7-f082-42cf-ae1c-e5b98314a152 -p 172.16.0.220:3260 --logout {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:56:06 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a147af7-f082-42cf-ae1c-e5b98314a152 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:56:06 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[03a2adba-8fcb-4189-a0c3-a6393aff2189]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:4a147af7-f082-42cf-ae1c-e5b98314a152, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:4a147af7-f082-42cf-ae1c-e5b98314a152, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:56:06 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-670c7c6a-91d3-43d9-a68f-dbc49ed634be tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:4a147af7-f082-42cf-ae1c-e5b98314a152, portal: 172.16.0.220,3260]
Nov 28 15:56:06 user nova-compute[75176]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:4a147af7-f082-42cf-ae1c-e5b98314a152, portal: 172.16.0.220,3260] successful.
Nov 28 15:56:06 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:56:06 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a147af7-f082-42cf-ae1c-e5b98314a152 -p 172.16.0.220:3260 --op delete {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:56:06 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a147af7-f082-42cf-ae1c-e5b98314a152 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:56:06 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[72e38baf-181a-4ad2-adb3-55e780fb8fc4]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:56:06 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-670c7c6a-91d3-43d9-a68f-dbc49ed634be tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:56:06 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-670c7c6a-91d3-43d9-a68f-dbc49ed634be tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.328s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 15:56:06 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-670c7c6a-91d3-43d9-a68f-dbc49ed634be tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] <== disconnect_volume: return (329ms) None {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 15:56:06 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-670c7c6a-91d3-43d9-a68f-dbc49ed634be tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] [instance: 742bfe1e-6885-4aba-9f7f-c07a5d904175] Disconnected iSCSI Volume {{(pid=75176) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 15:56:06 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:56:06 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:56:06 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:56:06 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:56:06 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Auditing locally available compute resources for user (node: user) {{(pid=75176) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 15:56:07 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55febf04-14ea-4903-8692-c7cc6115de75/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:56:07 user nova-compute[75176]: DEBUG nova.objects.instance [None req-670c7c6a-91d3-43d9-a68f-dbc49ed634be tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] Lazy-loading 'flavor' on Instance uuid 742bfe1e-6885-4aba-9f7f-c07a5d904175 {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:56:07 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-670c7c6a-91d3-43d9-a68f-dbc49ed634be tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] Lock "742bfe1e-6885-4aba-9f7f-c07a5d904175" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.849s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:56:07 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55febf04-14ea-4903-8692-c7cc6115de75/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:56:07 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55febf04-14ea-4903-8692-c7cc6115de75/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:56:07 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55febf04-14ea-4903-8692-c7cc6115de75/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:56:07 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e8507b7-fccf-4196-b589-bf2b74f165ec/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:56:07 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e8507b7-fccf-4196-b589-bf2b74f165ec/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:56:07 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e8507b7-fccf-4196-b589-bf2b74f165ec/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:56:07 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e8507b7-fccf-4196-b589-bf2b74f165ec/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:56:07 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecabea76-6c29-412d-bf77-989917b449a9/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:56:07 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecabea76-6c29-412d-bf77-989917b449a9/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:56:07 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecabea76-6c29-412d-bf77-989917b449a9/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:56:08 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecabea76-6c29-412d-bf77-989917b449a9/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:56:08 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0b7a064-03b6-4a0d-88be-2f12c12a1ddb/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:56:08 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0b7a064-03b6-4a0d-88be-2f12c12a1ddb/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:56:08 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0b7a064-03b6-4a0d-88be-2f12c12a1ddb/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:56:08 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0b7a064-03b6-4a0d-88be-2f12c12a1ddb/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:56:08 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/742bfe1e-6885-4aba-9f7f-c07a5d904175/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:56:08 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/742bfe1e-6885-4aba-9f7f-c07a5d904175/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:56:08 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/742bfe1e-6885-4aba-9f7f-c07a5d904175/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:56:08 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/742bfe1e-6885-4aba-9f7f-c07a5d904175/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:56:08 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75176) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 15:56:08 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75176) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 15:56:08 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66ead7d-98f4-4822-9dce-f2ea0206a58d/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:56:09 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66ead7d-98f4-4822-9dce-f2ea0206a58d/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:56:09 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66ead7d-98f4-4822-9dce-f2ea0206a58d/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:56:09 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66ead7d-98f4-4822-9dce-f2ea0206a58d/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:56:09 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7/disk.rescue --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:56:09 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:56:09 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7/disk.rescue --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:56:09 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:56:09 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7/disk.rescue --force-share --output=json" returned: 0 in 0.190s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:56:09 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:56:09 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:56:09 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:56:09 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:56:10 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:56:10 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 15:56:10 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 15:56:10 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Hypervisor/Node resource view: name=user free_ram=7678MB free_disk=25.006282806396484GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75176) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 15:56:10 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:56:10 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:56:10 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance 2e8507b7-fccf-4196-b589-bf2b74f165ec actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:56:10 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance f66ead7d-98f4-4822-9dce-f2ea0206a58d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:56:10 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance 55febf04-14ea-4903-8692-c7cc6115de75 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:56:10 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance 8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:56:10 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance dc4e6d39-adfb-4d26-afef-46f316ff7846 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:56:10 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance 6161cab2-eb1f-44cb-bbd5-077e6db42f77 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:56:10 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance 742bfe1e-6885-4aba-9f7f-c07a5d904175 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:56:10 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance ecabea76-6c29-412d-bf77-989917b449a9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:56:10 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance e0b7a064-03b6-4a0d-88be-2f12c12a1ddb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:56:10 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75176) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 15:56:10 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75176) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 15:56:10 user nova-compute[75176]: DEBUG nova.compute.provider_tree [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Inventory has not changed in ProviderTree for provider: b37848d8-f401-4155-a029-b0ffa09ff85b {{(pid=75176) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 15:56:10 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Inventory has not changed for provider b37848d8-f401-4155-a029-b0ffa09ff85b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75176) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 15:56:10 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Compute_service record updated for user:user {{(pid=75176) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 15:56:10 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.443s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:56:14 user nova-compute[75176]: INFO nova.compute.manager [None req-4db58ecf-86ba-4e71-ae95-d2b1eaa4a017 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] [instance: 6161cab2-eb1f-44cb-bbd5-077e6db42f77] Get console output
Nov 28 15:56:14 user nova-compute[75176]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Nov 28 15:56:14 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:56:15 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:56:19 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:56:20 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:56:25 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:56:30 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:56:32 user nova-compute[75176]: DEBUG nova.compute.manager [None req-ea2b9c0f-1fc7-4c5e-b0ad-b412db0fab08 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] [instance: ecabea76-6c29-412d-bf77-989917b449a9] Checking state {{(pid=75176) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 15:56:32 user nova-compute[75176]: INFO nova.compute.manager [None req-ea2b9c0f-1fc7-4c5e-b0ad-b412db0fab08 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] [instance: ecabea76-6c29-412d-bf77-989917b449a9] instance snapshotting
Nov 28 15:56:32 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-ea2b9c0f-1fc7-4c5e-b0ad-b412db0fab08 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] [instance: ecabea76-6c29-412d-bf77-989917b449a9] Beginning live snapshot process
Nov 28 15:56:32 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-ea2b9c0f-1fc7-4c5e-b0ad-b412db0fab08 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecabea76-6c29-412d-bf77-989917b449a9/disk --force-share --output=json -f qcow2 {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:56:32 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-ea2b9c0f-1fc7-4c5e-b0ad-b412db0fab08 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecabea76-6c29-412d-bf77-989917b449a9/disk --force-share --output=json -f qcow2" returned: 0 in 0.180s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:56:32 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-ea2b9c0f-1fc7-4c5e-b0ad-b412db0fab08 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecabea76-6c29-412d-bf77-989917b449a9/disk --force-share --output=json -f qcow2 {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:56:33 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-ea2b9c0f-1fc7-4c5e-b0ad-b412db0fab08 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecabea76-6c29-412d-bf77-989917b449a9/disk --force-share --output=json -f qcow2" returned: 0 in 0.175s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:56:33 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-ea2b9c0f-1fc7-4c5e-b0ad-b412db0fab08 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:56:33 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-ea2b9c0f-1fc7-4c5e-b0ad-b412db0fab08 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json" returned: 0 in 0.172s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:56:33 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-ea2b9c0f-1fc7-4c5e-b0ad-b412db0fab08 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp8u0wveai/de17601f98eb4783802b8dd76860cc40.delta 1073741824 {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:56:33 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-ea2b9c0f-1fc7-4c5e-b0ad-b412db0fab08 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp8u0wveai/de17601f98eb4783802b8dd76860cc40.delta 1073741824" returned: 0 in 0.044s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:56:33 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-ea2b9c0f-1fc7-4c5e-b0ad-b412db0fab08 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] [instance: ecabea76-6c29-412d-bf77-989917b449a9] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 28 15:56:34 user nova-compute[75176]: DEBUG nova.virt.libvirt.guest [None req-ea2b9c0f-1fc7-4c5e-b0ad-b412db0fab08 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=75176) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 15:56:34 user nova-compute[75176]: DEBUG nova.virt.libvirt.guest [None req-ea2b9c0f-1fc7-4c5e-b0ad-b412db0fab08 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] COPY block job progress, current cursor: 26411008 final cursor: 75563008 {{(pid=75176) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 15:56:35 user nova-compute[75176]: DEBUG nova.virt.libvirt.guest [None req-ea2b9c0f-1fc7-4c5e-b0ad-b412db0fab08 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=75176) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 15:56:35 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-ea2b9c0f-1fc7-4c5e-b0ad-b412db0fab08 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] [instance: ecabea76-6c29-412d-bf77-989917b449a9] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 28 15:56:35 user nova-compute[75176]: DEBUG nova.privsep.utils [None req-ea2b9c0f-1fc7-4c5e-b0ad-b412db0fab08 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75176) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 28 15:56:35 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-ea2b9c0f-1fc7-4c5e-b0ad-b412db0fab08 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp8u0wveai/de17601f98eb4783802b8dd76860cc40.delta /opt/stack/data/nova/instances/snapshots/tmp8u0wveai/de17601f98eb4783802b8dd76860cc40 {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:56:35 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:56:35 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-ea2b9c0f-1fc7-4c5e-b0ad-b412db0fab08 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp8u0wveai/de17601f98eb4783802b8dd76860cc40.delta /opt/stack/data/nova/instances/snapshots/tmp8u0wveai/de17601f98eb4783802b8dd76860cc40" returned: 0 in 0.420s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:56:35 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-ea2b9c0f-1fc7-4c5e-b0ad-b412db0fab08 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] [instance: ecabea76-6c29-412d-bf77-989917b449a9] Snapshot extracted, beginning image upload
Nov 28 15:56:35 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-ceff432d-3e77-4e62-a781-53e1377cd2fc tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] Acquiring lock "742bfe1e-6885-4aba-9f7f-c07a5d904175" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:56:35 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-ceff432d-3e77-4e62-a781-53e1377cd2fc tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] Lock "742bfe1e-6885-4aba-9f7f-c07a5d904175" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:56:35 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-ceff432d-3e77-4e62-a781-53e1377cd2fc tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] Acquiring lock "742bfe1e-6885-4aba-9f7f-c07a5d904175-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:56:35 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-ceff432d-3e77-4e62-a781-53e1377cd2fc tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] Lock "742bfe1e-6885-4aba-9f7f-c07a5d904175-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:56:35 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-ceff432d-3e77-4e62-a781-53e1377cd2fc tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] Lock "742bfe1e-6885-4aba-9f7f-c07a5d904175-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:56:35 user nova-compute[75176]: INFO nova.compute.manager [None req-ceff432d-3e77-4e62-a781-53e1377cd2fc tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] [instance: 742bfe1e-6885-4aba-9f7f-c07a5d904175] Terminating instance
Nov 28 15:56:35 user nova-compute[75176]: DEBUG nova.compute.manager [None req-ceff432d-3e77-4e62-a781-53e1377cd2fc tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] [instance: 742bfe1e-6885-4aba-9f7f-c07a5d904175] Start destroying the instance on the hypervisor. {{(pid=75176) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 15:56:35 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:56:35 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:56:35 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:56:35 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:56:36 user nova-compute[75176]: DEBUG nova.compute.manager [req-a0bda2e6-02c0-4fc2-9e97-abf8d7cdee1d req-23cb85dc-b85f-4e57-a6c9-4a2599920ab2 service nova] [instance: 742bfe1e-6885-4aba-9f7f-c07a5d904175] Received event network-vif-unplugged-0b7a1072-6ad0-4907-a951-67975f1497b5 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:56:36 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-a0bda2e6-02c0-4fc2-9e97-abf8d7cdee1d req-23cb85dc-b85f-4e57-a6c9-4a2599920ab2 service nova] Acquiring lock "742bfe1e-6885-4aba-9f7f-c07a5d904175-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:56:36 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-a0bda2e6-02c0-4fc2-9e97-abf8d7cdee1d req-23cb85dc-b85f-4e57-a6c9-4a2599920ab2 service nova] Lock "742bfe1e-6885-4aba-9f7f-c07a5d904175-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:56:36 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-a0bda2e6-02c0-4fc2-9e97-abf8d7cdee1d req-23cb85dc-b85f-4e57-a6c9-4a2599920ab2 service nova] Lock "742bfe1e-6885-4aba-9f7f-c07a5d904175-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:56:36 user nova-compute[75176]: DEBUG nova.compute.manager [req-a0bda2e6-02c0-4fc2-9e97-abf8d7cdee1d req-23cb85dc-b85f-4e57-a6c9-4a2599920ab2 service nova] [instance: 742bfe1e-6885-4aba-9f7f-c07a5d904175] No waiting events found dispatching network-vif-unplugged-0b7a1072-6ad0-4907-a951-67975f1497b5 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:56:36 user nova-compute[75176]: DEBUG nova.compute.manager [req-a0bda2e6-02c0-4fc2-9e97-abf8d7cdee1d req-23cb85dc-b85f-4e57-a6c9-4a2599920ab2 service nova] [instance: 742bfe1e-6885-4aba-9f7f-c07a5d904175] Received event network-vif-unplugged-0b7a1072-6ad0-4907-a951-67975f1497b5 for instance with task_state deleting. {{(pid=75176) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 15:56:36 user nova-compute[75176]: INFO nova.virt.libvirt.driver [-] [instance: 742bfe1e-6885-4aba-9f7f-c07a5d904175] Instance destroyed successfully.
Nov 28 15:56:36 user nova-compute[75176]: DEBUG nova.objects.instance [None req-ceff432d-3e77-4e62-a781-53e1377cd2fc tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] Lazy-loading 'resources' on Instance uuid 742bfe1e-6885-4aba-9f7f-c07a5d904175 {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:56:36 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-ceff432d-3e77-4e62-a781-53e1377cd2fc tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T15:52:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1282306666',display_name='tempest-TestServerVolumeAttachmentScenario-server-1282306666',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1282306666',id=36,image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCUqclveht6BjAO09SxfLKX5af4yrHLLMMkUAd6M2Oexq680bHnAwVqg80BFu6CFjfE0NOZAACtenEwpm0AYqV/VfHtc+CSA83+PUdNSZzB3R1lp7Mcfb+TXITKkKAyX2A==',key_name='tempest-keypair-608680231',keypairs=<?>,launch_index=0,launched_at=2023-11-28T15:52:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e8967023e58840afa09d5959d29a0285',ramdisk_id='',reservation_id='r-5tqc630u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1079141498',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1079141498-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T15:52:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0ba38ecd6e8f440cbad7d11e95de1e62',uuid=742bfe1e-6885-4aba-9f7f-c07a5d904175,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0b7a1072-6ad0-4907-a951-67975f1497b5", "address": "fa:16:3e:c7:5d:87", "network": {"id": "d512a3da-3880-40f2-9c54-9130a3dc1f6c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1594970670-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e8967023e58840afa09d5959d29a0285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b7a1072-6a", "ovs_interfaceid": "0b7a1072-6ad0-4907-a951-67975f1497b5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 15:56:36 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-ceff432d-3e77-4e62-a781-53e1377cd2fc tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] Converting VIF {"id": "0b7a1072-6ad0-4907-a951-67975f1497b5", "address": "fa:16:3e:c7:5d:87", "network": {"id": "d512a3da-3880-40f2-9c54-9130a3dc1f6c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1594970670-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e8967023e58840afa09d5959d29a0285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b7a1072-6a", "ovs_interfaceid": "0b7a1072-6ad0-4907-a951-67975f1497b5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:56:36 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-ceff432d-3e77-4e62-a781-53e1377cd2fc tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c7:5d:87,bridge_name='br-int',has_traffic_filtering=True,id=0b7a1072-6ad0-4907-a951-67975f1497b5,network=Network(d512a3da-3880-40f2-9c54-9130a3dc1f6c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b7a1072-6a') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:56:36 user nova-compute[75176]: DEBUG os_vif [None req-ceff432d-3e77-4e62-a781-53e1377cd2fc tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c7:5d:87,bridge_name='br-int',has_traffic_filtering=True,id=0b7a1072-6ad0-4907-a951-67975f1497b5,network=Network(d512a3da-3880-40f2-9c54-9130a3dc1f6c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b7a1072-6a') {{(pid=75176) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 15:56:36 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:56:36 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0b7a1072-6a, bridge=br-int, if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:56:36 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:56:36 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:56:36 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:56:36 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=430934ea-239a-40a8-8796-d1acba311d8f) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:56:36 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:56:36 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:56:36 user nova-compute[75176]: INFO os_vif [None req-ceff432d-3e77-4e62-a781-53e1377cd2fc tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c7:5d:87,bridge_name='br-int',has_traffic_filtering=True,id=0b7a1072-6ad0-4907-a951-67975f1497b5,network=Network(d512a3da-3880-40f2-9c54-9130a3dc1f6c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b7a1072-6a')
Nov 28 15:56:36 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-ceff432d-3e77-4e62-a781-53e1377cd2fc tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] [instance: 742bfe1e-6885-4aba-9f7f-c07a5d904175] Deleting instance files /opt/stack/data/nova/instances/742bfe1e-6885-4aba-9f7f-c07a5d904175_del
Nov 28 15:56:36 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-ceff432d-3e77-4e62-a781-53e1377cd2fc tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] [instance: 742bfe1e-6885-4aba-9f7f-c07a5d904175] Deletion of /opt/stack/data/nova/instances/742bfe1e-6885-4aba-9f7f-c07a5d904175_del complete
Nov 28 15:56:36 user nova-compute[75176]: INFO nova.compute.manager [None req-ceff432d-3e77-4e62-a781-53e1377cd2fc tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] [instance: 742bfe1e-6885-4aba-9f7f-c07a5d904175] Took 1.01 seconds to destroy the instance on the hypervisor.
Nov 28 15:56:36 user nova-compute[75176]: DEBUG oslo.service.loopingcall [None req-ceff432d-3e77-4e62-a781-53e1377cd2fc tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75176) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 15:56:36 user nova-compute[75176]: DEBUG nova.compute.manager [-] [instance: 742bfe1e-6885-4aba-9f7f-c07a5d904175] Deallocating network for instance {{(pid=75176) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 15:56:36 user nova-compute[75176]: DEBUG nova.network.neutron [-] [instance: 742bfe1e-6885-4aba-9f7f-c07a5d904175] deallocate_for_instance() {{(pid=75176) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 15:56:37 user nova-compute[75176]: DEBUG nova.network.neutron [-] [instance: 742bfe1e-6885-4aba-9f7f-c07a5d904175] Updating instance_info_cache with network_info: [] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:56:37 user nova-compute[75176]: INFO nova.compute.manager [-] [instance: 742bfe1e-6885-4aba-9f7f-c07a5d904175] Took 0.81 seconds to deallocate network for instance.
Nov 28 15:56:37 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-ceff432d-3e77-4e62-a781-53e1377cd2fc tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:56:37 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-ceff432d-3e77-4e62-a781-53e1377cd2fc tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:56:37 user nova-compute[75176]: DEBUG nova.compute.provider_tree [None req-ceff432d-3e77-4e62-a781-53e1377cd2fc tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] Inventory has not changed in ProviderTree for provider: b37848d8-f401-4155-a029-b0ffa09ff85b {{(pid=75176) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 15:56:37 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-ceff432d-3e77-4e62-a781-53e1377cd2fc tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] Inventory has not changed for provider b37848d8-f401-4155-a029-b0ffa09ff85b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75176) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 15:56:37 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-ceff432d-3e77-4e62-a781-53e1377cd2fc tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.315s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:56:38 user nova-compute[75176]: INFO nova.scheduler.client.report [None req-ceff432d-3e77-4e62-a781-53e1377cd2fc tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] Deleted allocations for instance 742bfe1e-6885-4aba-9f7f-c07a5d904175
Nov 28 15:56:38 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-ceff432d-3e77-4e62-a781-53e1377cd2fc tempest-TestServerVolumeAttachmentScenario-1079141498 tempest-TestServerVolumeAttachmentScenario-1079141498-project-member] Lock "742bfe1e-6885-4aba-9f7f-c07a5d904175" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.334s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:56:38 user nova-compute[75176]: DEBUG nova.compute.manager [req-015cc209-4dab-47ab-96b8-75125259215b req-dde0e7af-b90c-42ec-b6ca-0080c0a33aba service nova] [instance: 742bfe1e-6885-4aba-9f7f-c07a5d904175] Received event network-vif-plugged-0b7a1072-6ad0-4907-a951-67975f1497b5 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:56:38 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-015cc209-4dab-47ab-96b8-75125259215b req-dde0e7af-b90c-42ec-b6ca-0080c0a33aba service nova] Acquiring lock "742bfe1e-6885-4aba-9f7f-c07a5d904175-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:56:38 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-015cc209-4dab-47ab-96b8-75125259215b req-dde0e7af-b90c-42ec-b6ca-0080c0a33aba service nova] Lock "742bfe1e-6885-4aba-9f7f-c07a5d904175-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:56:38 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-015cc209-4dab-47ab-96b8-75125259215b req-dde0e7af-b90c-42ec-b6ca-0080c0a33aba service nova] Lock "742bfe1e-6885-4aba-9f7f-c07a5d904175-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:56:38 user nova-compute[75176]: DEBUG nova.compute.manager [req-015cc209-4dab-47ab-96b8-75125259215b req-dde0e7af-b90c-42ec-b6ca-0080c0a33aba service nova] [instance: 742bfe1e-6885-4aba-9f7f-c07a5d904175] No waiting events found dispatching network-vif-plugged-0b7a1072-6ad0-4907-a951-67975f1497b5 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:56:38 user nova-compute[75176]: WARNING nova.compute.manager [req-015cc209-4dab-47ab-96b8-75125259215b req-dde0e7af-b90c-42ec-b6ca-0080c0a33aba service nova] [instance: 742bfe1e-6885-4aba-9f7f-c07a5d904175] Received unexpected event network-vif-plugged-0b7a1072-6ad0-4907-a951-67975f1497b5 for instance with vm_state deleted and task_state None.
Nov 28 15:56:38 user nova-compute[75176]: DEBUG nova.compute.manager [req-015cc209-4dab-47ab-96b8-75125259215b req-dde0e7af-b90c-42ec-b6ca-0080c0a33aba service nova] [instance: 742bfe1e-6885-4aba-9f7f-c07a5d904175] Received event network-vif-deleted-0b7a1072-6ad0-4907-a951-67975f1497b5 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:56:38 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-ea2b9c0f-1fc7-4c5e-b0ad-b412db0fab08 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] [instance: ecabea76-6c29-412d-bf77-989917b449a9] Snapshot image upload complete
Nov 28 15:56:38 user nova-compute[75176]: INFO nova.compute.manager [None req-ea2b9c0f-1fc7-4c5e-b0ad-b412db0fab08 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] [instance: ecabea76-6c29-412d-bf77-989917b449a9] Took 5.66 seconds to snapshot the instance on the hypervisor.
Nov 28 15:56:40 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-4694d4e4-178d-4fd8-a84e-271bbaf0c18c tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Acquiring lock "3ae602c1-2aed-41ea-9f4c-4f3ec4aab254" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:56:40 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-4694d4e4-178d-4fd8-a84e-271bbaf0c18c tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Lock "3ae602c1-2aed-41ea-9f4c-4f3ec4aab254" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:56:40 user nova-compute[75176]: DEBUG nova.compute.manager [None req-4694d4e4-178d-4fd8-a84e-271bbaf0c18c tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] [instance: 3ae602c1-2aed-41ea-9f4c-4f3ec4aab254] Starting instance... {{(pid=75176) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 15:56:40 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-4694d4e4-178d-4fd8-a84e-271bbaf0c18c tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:56:40 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-4694d4e4-178d-4fd8-a84e-271bbaf0c18c tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:56:40 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-4694d4e4-178d-4fd8-a84e-271bbaf0c18c tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75176) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 15:56:40 user nova-compute[75176]: INFO nova.compute.claims [None req-4694d4e4-178d-4fd8-a84e-271bbaf0c18c tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] [instance: 3ae602c1-2aed-41ea-9f4c-4f3ec4aab254] Claim successful on node user
Nov 28 15:56:40 user nova-compute[75176]: DEBUG nova.compute.provider_tree [None req-4694d4e4-178d-4fd8-a84e-271bbaf0c18c tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Inventory has not changed in ProviderTree for provider: b37848d8-f401-4155-a029-b0ffa09ff85b {{(pid=75176) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 15:56:40 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-4694d4e4-178d-4fd8-a84e-271bbaf0c18c tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Inventory has not changed for provider b37848d8-f401-4155-a029-b0ffa09ff85b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75176) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 15:56:40 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-4694d4e4-178d-4fd8-a84e-271bbaf0c18c tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.368s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:56:40 user nova-compute[75176]: DEBUG nova.compute.manager [None req-4694d4e4-178d-4fd8-a84e-271bbaf0c18c tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] [instance: 3ae602c1-2aed-41ea-9f4c-4f3ec4aab254] Start building networks asynchronously for instance. {{(pid=75176) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 15:56:40 user nova-compute[75176]: DEBUG nova.compute.manager [None req-4694d4e4-178d-4fd8-a84e-271bbaf0c18c tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] [instance: 3ae602c1-2aed-41ea-9f4c-4f3ec4aab254] Allocating IP information in the background. {{(pid=75176) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 15:56:40 user nova-compute[75176]: DEBUG nova.network.neutron [None req-4694d4e4-178d-4fd8-a84e-271bbaf0c18c tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] [instance: 3ae602c1-2aed-41ea-9f4c-4f3ec4aab254] allocate_for_instance() {{(pid=75176) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 15:56:40 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-4694d4e4-178d-4fd8-a84e-271bbaf0c18c tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] [instance: 3ae602c1-2aed-41ea-9f4c-4f3ec4aab254] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 15:56:40 user nova-compute[75176]: DEBUG nova.compute.manager [None req-4694d4e4-178d-4fd8-a84e-271bbaf0c18c tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] [instance: 3ae602c1-2aed-41ea-9f4c-4f3ec4aab254] Start building block device mappings for instance. {{(pid=75176) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 15:56:40 user nova-compute[75176]: DEBUG nova.policy [None req-4694d4e4-178d-4fd8-a84e-271bbaf0c18c tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0dcee22ed63f40fab2ee0e42f5f38e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a10ba40c844955b63cb8603dd548cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75176) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 15:56:41 user nova-compute[75176]: DEBUG nova.compute.manager [None req-4694d4e4-178d-4fd8-a84e-271bbaf0c18c tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] [instance: 3ae602c1-2aed-41ea-9f4c-4f3ec4aab254] Start spawning the instance on the hypervisor. {{(pid=75176) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 15:56:41 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-4694d4e4-178d-4fd8-a84e-271bbaf0c18c tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] [instance: 3ae602c1-2aed-41ea-9f4c-4f3ec4aab254] Creating instance directory {{(pid=75176) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 15:56:41 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-4694d4e4-178d-4fd8-a84e-271bbaf0c18c tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] [instance: 3ae602c1-2aed-41ea-9f4c-4f3ec4aab254] Creating image(s)
Nov 28 15:56:41 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-4694d4e4-178d-4fd8-a84e-271bbaf0c18c tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Acquiring lock "/opt/stack/data/nova/instances/3ae602c1-2aed-41ea-9f4c-4f3ec4aab254/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:56:41 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-4694d4e4-178d-4fd8-a84e-271bbaf0c18c tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Lock "/opt/stack/data/nova/instances/3ae602c1-2aed-41ea-9f4c-4f3ec4aab254/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:56:41 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-4694d4e4-178d-4fd8-a84e-271bbaf0c18c tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Lock "/opt/stack/data/nova/instances/3ae602c1-2aed-41ea-9f4c-4f3ec4aab254/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:56:41 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-4694d4e4-178d-4fd8-a84e-271bbaf0c18c tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Acquiring lock "74aecd291fbec52d157938a688173a923d0d3efd" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:56:41 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-4694d4e4-178d-4fd8-a84e-271bbaf0c18c tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Lock "74aecd291fbec52d157938a688173a923d0d3efd" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:56:41 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-4694d4e4-178d-4fd8-a84e-271bbaf0c18c tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74aecd291fbec52d157938a688173a923d0d3efd.part --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:56:41 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:56:41 user nova-compute[75176]: DEBUG nova.network.neutron [None req-4694d4e4-178d-4fd8-a84e-271bbaf0c18c tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] [instance: 3ae602c1-2aed-41ea-9f4c-4f3ec4aab254] Successfully created port: dee8b036-92ce-421f-bb73-dbf92200da92 {{(pid=75176) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 15:56:42 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-4694d4e4-178d-4fd8-a84e-271bbaf0c18c tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74aecd291fbec52d157938a688173a923d0d3efd.part --force-share --output=json" returned: 0 in 0.282s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:56:42 user nova-compute[75176]: DEBUG nova.virt.images [None req-4694d4e4-178d-4fd8-a84e-271bbaf0c18c tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] bfdcb73d-4912-40b6-bdaf-299321d8dfaa was qcow2, converting to raw {{(pid=75176) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 28 15:56:42 user nova-compute[75176]: DEBUG nova.privsep.utils [None req-4694d4e4-178d-4fd8-a84e-271bbaf0c18c tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75176) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 28 15:56:42 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-4694d4e4-178d-4fd8-a84e-271bbaf0c18c tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/74aecd291fbec52d157938a688173a923d0d3efd.part /opt/stack/data/nova/instances/_base/74aecd291fbec52d157938a688173a923d0d3efd.converted {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:56:42 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-4694d4e4-178d-4fd8-a84e-271bbaf0c18c tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/74aecd291fbec52d157938a688173a923d0d3efd.part /opt/stack/data/nova/instances/_base/74aecd291fbec52d157938a688173a923d0d3efd.converted" returned: 0 in 0.440s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:56:42 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-4694d4e4-178d-4fd8-a84e-271bbaf0c18c tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74aecd291fbec52d157938a688173a923d0d3efd.converted --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:56:42 user nova-compute[75176]: DEBUG nova.network.neutron [None req-4694d4e4-178d-4fd8-a84e-271bbaf0c18c tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] [instance: 3ae602c1-2aed-41ea-9f4c-4f3ec4aab254] Successfully updated port: dee8b036-92ce-421f-bb73-dbf92200da92 {{(pid=75176) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 15:56:42 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-4694d4e4-178d-4fd8-a84e-271bbaf0c18c tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74aecd291fbec52d157938a688173a923d0d3efd.converted --force-share --output=json" returned: 0 in 0.200s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:56:42 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-4694d4e4-178d-4fd8-a84e-271bbaf0c18c tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Lock "74aecd291fbec52d157938a688173a923d0d3efd" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.823s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:56:42 user nova-compute[75176]: DEBUG nova.compute.manager [req-595a8225-1ea8-4fd3-8d0b-cd1ab2755d8b req-d254db51-d610-4a3f-8b1b-ca5f175e1eb1 service nova] [instance: 3ae602c1-2aed-41ea-9f4c-4f3ec4aab254] Received event network-changed-dee8b036-92ce-421f-bb73-dbf92200da92 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:56:42 user nova-compute[75176]: DEBUG nova.compute.manager [req-595a8225-1ea8-4fd3-8d0b-cd1ab2755d8b req-d254db51-d610-4a3f-8b1b-ca5f175e1eb1 service nova] [instance: 3ae602c1-2aed-41ea-9f4c-4f3ec4aab254] Refreshing instance network info cache due to event network-changed-dee8b036-92ce-421f-bb73-dbf92200da92. {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 15:56:42 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-595a8225-1ea8-4fd3-8d0b-cd1ab2755d8b req-d254db51-d610-4a3f-8b1b-ca5f175e1eb1 service nova] Acquiring lock "refresh_cache-3ae602c1-2aed-41ea-9f4c-4f3ec4aab254" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:56:42 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-595a8225-1ea8-4fd3-8d0b-cd1ab2755d8b req-d254db51-d610-4a3f-8b1b-ca5f175e1eb1 service nova] Acquired lock "refresh_cache-3ae602c1-2aed-41ea-9f4c-4f3ec4aab254" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:56:42 user nova-compute[75176]: DEBUG nova.network.neutron [req-595a8225-1ea8-4fd3-8d0b-cd1ab2755d8b req-d254db51-d610-4a3f-8b1b-ca5f175e1eb1 service nova] [instance: 3ae602c1-2aed-41ea-9f4c-4f3ec4aab254] Refreshing network info cache for port dee8b036-92ce-421f-bb73-dbf92200da92 {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 15:56:42 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-4694d4e4-178d-4fd8-a84e-271bbaf0c18c tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74aecd291fbec52d157938a688173a923d0d3efd --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:56:42 user nova-compute[75176]: DEBUG nova.network.neutron [req-595a8225-1ea8-4fd3-8d0b-cd1ab2755d8b req-d254db51-d610-4a3f-8b1b-ca5f175e1eb1 service nova] [instance: 3ae602c1-2aed-41ea-9f4c-4f3ec4aab254] Instance cache missing network info. {{(pid=75176) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 15:56:43 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-4694d4e4-178d-4fd8-a84e-271bbaf0c18c tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Acquiring lock "refresh_cache-3ae602c1-2aed-41ea-9f4c-4f3ec4aab254" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:56:43 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-4694d4e4-178d-4fd8-a84e-271bbaf0c18c tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74aecd291fbec52d157938a688173a923d0d3efd --force-share --output=json" returned: 0 in 0.201s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:56:43 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-4694d4e4-178d-4fd8-a84e-271bbaf0c18c tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Acquiring lock "74aecd291fbec52d157938a688173a923d0d3efd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:56:43 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-4694d4e4-178d-4fd8-a84e-271bbaf0c18c tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Lock "74aecd291fbec52d157938a688173a923d0d3efd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:56:43 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-4694d4e4-178d-4fd8-a84e-271bbaf0c18c tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74aecd291fbec52d157938a688173a923d0d3efd --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:56:43 user nova-compute[75176]: DEBUG nova.network.neutron [req-595a8225-1ea8-4fd3-8d0b-cd1ab2755d8b req-d254db51-d610-4a3f-8b1b-ca5f175e1eb1 service nova] [instance: 3ae602c1-2aed-41ea-9f4c-4f3ec4aab254] Updating instance_info_cache with network_info: [] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:56:43 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-595a8225-1ea8-4fd3-8d0b-cd1ab2755d8b req-d254db51-d610-4a3f-8b1b-ca5f175e1eb1 service nova] Releasing lock "refresh_cache-3ae602c1-2aed-41ea-9f4c-4f3ec4aab254" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:56:43 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-4694d4e4-178d-4fd8-a84e-271bbaf0c18c tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Acquired lock "refresh_cache-3ae602c1-2aed-41ea-9f4c-4f3ec4aab254" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:56:43 user nova-compute[75176]: DEBUG nova.network.neutron [None req-4694d4e4-178d-4fd8-a84e-271bbaf0c18c tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] [instance: 3ae602c1-2aed-41ea-9f4c-4f3ec4aab254] Building network info cache for instance {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 15:56:43 user nova-compute[75176]: DEBUG nova.network.neutron [None req-4694d4e4-178d-4fd8-a84e-271bbaf0c18c tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] [instance: 3ae602c1-2aed-41ea-9f4c-4f3ec4aab254] Instance cache missing network info. {{(pid=75176) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 15:56:43 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-4694d4e4-178d-4fd8-a84e-271bbaf0c18c tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74aecd291fbec52d157938a688173a923d0d3efd --force-share --output=json" returned: 0 in 0.181s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:56:43 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-4694d4e4-178d-4fd8-a84e-271bbaf0c18c tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74aecd291fbec52d157938a688173a923d0d3efd,backing_fmt=raw /opt/stack/data/nova/instances/3ae602c1-2aed-41ea-9f4c-4f3ec4aab254/disk 1073741824 {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:56:43 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-4694d4e4-178d-4fd8-a84e-271bbaf0c18c tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74aecd291fbec52d157938a688173a923d0d3efd,backing_fmt=raw /opt/stack/data/nova/instances/3ae602c1-2aed-41ea-9f4c-4f3ec4aab254/disk 1073741824" returned: 0 in 0.050s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:56:43 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-4694d4e4-178d-4fd8-a84e-271bbaf0c18c tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Lock "74aecd291fbec52d157938a688173a923d0d3efd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.235s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:56:43 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-4694d4e4-178d-4fd8-a84e-271bbaf0c18c tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74aecd291fbec52d157938a688173a923d0d3efd --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:56:43 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-4694d4e4-178d-4fd8-a84e-271bbaf0c18c tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74aecd291fbec52d157938a688173a923d0d3efd --force-share --output=json" returned: 0 in 0.176s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:56:43 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-4694d4e4-178d-4fd8-a84e-271bbaf0c18c tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] [instance: 3ae602c1-2aed-41ea-9f4c-4f3ec4aab254] Created local disks {{(pid=75176) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 15:56:43 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-4694d4e4-178d-4fd8-a84e-271bbaf0c18c tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] [instance: 3ae602c1-2aed-41ea-9f4c-4f3ec4aab254] Ensure instance console log exists: /opt/stack/data/nova/instances/3ae602c1-2aed-41ea-9f4c-4f3ec4aab254/console.log {{(pid=75176) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 15:56:43 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-4694d4e4-178d-4fd8-a84e-271bbaf0c18c tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:56:43 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-4694d4e4-178d-4fd8-a84e-271bbaf0c18c tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:56:43 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-4694d4e4-178d-4fd8-a84e-271bbaf0c18c tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:56:43 user nova-compute[75176]: DEBUG nova.network.neutron [None req-4694d4e4-178d-4fd8-a84e-271bbaf0c18c tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] [instance: 3ae602c1-2aed-41ea-9f4c-4f3ec4aab254] Updating instance_info_cache with network_info: [{"id": "dee8b036-92ce-421f-bb73-dbf92200da92", "address": "fa:16:3e:51:3e:28", "network": {"id": "1fd59c02-7617-4d0e-9456-84d6cc91ce3b", "bridge": "br-int", "label": "tempest-TestStampPattern-116968826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4a10ba40c844955b63cb8603dd548cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdee8b036-92", "ovs_interfaceid": "dee8b036-92ce-421f-bb73-dbf92200da92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:56:43 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-4694d4e4-178d-4fd8-a84e-271bbaf0c18c tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Releasing lock "refresh_cache-3ae602c1-2aed-41ea-9f4c-4f3ec4aab254" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:56:43 user nova-compute[75176]: DEBUG nova.compute.manager [None req-4694d4e4-178d-4fd8-a84e-271bbaf0c18c tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] [instance: 3ae602c1-2aed-41ea-9f4c-4f3ec4aab254] Instance network_info: |[{"id": "dee8b036-92ce-421f-bb73-dbf92200da92", "address": "fa:16:3e:51:3e:28", "network": {"id": "1fd59c02-7617-4d0e-9456-84d6cc91ce3b", "bridge": "br-int", "label": "tempest-TestStampPattern-116968826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4a10ba40c844955b63cb8603dd548cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdee8b036-92", "ovs_interfaceid": "dee8b036-92ce-421f-bb73-dbf92200da92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75176) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 15:56:43 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-4694d4e4-178d-4fd8-a84e-271bbaf0c18c tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] [instance: 3ae602c1-2aed-41ea-9f4c-4f3ec4aab254] Start _get_guest_xml network_info=[{"id": "dee8b036-92ce-421f-bb73-dbf92200da92", "address": "fa:16:3e:51:3e:28", "network": {"id": "1fd59c02-7617-4d0e-9456-84d6cc91ce3b", "bridge": "br-int", "label": "tempest-TestStampPattern-116968826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4a10ba40c844955b63cb8603dd548cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdee8b036-92", "ovs_interfaceid": "dee8b036-92ce-421f-bb73-dbf92200da92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b6606a73b5be8db6a739ec2f32cc9d2c',container_format='bare',created_at=2023-11-28T15:56:32Z,direct_url=<?>,disk_format='qcow2',id=bfdcb73d-4912-40b6-bdaf-299321d8dfaa,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1112779929',owner='c4a10ba40c844955b63cb8603dd548cf',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-28T15:56:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'size': 0, 'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'image_id': 'bfdcb73d-4912-40b6-bdaf-299321d8dfaa'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75176) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 15:56:43 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-4694d4e4-178d-4fd8-a84e-271bbaf0c18c tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 15:56:43 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-4694d4e4-178d-4fd8-a84e-271bbaf0c18c tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 15:56:43 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-4694d4e4-178d-4fd8-a84e-271bbaf0c18c tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75176) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 15:56:43 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-4694d4e4-178d-4fd8-a84e-271bbaf0c18c tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] CPU controller missing on host. {{(pid=75176) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 15:56:43 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-4694d4e4-178d-4fd8-a84e-271bbaf0c18c tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75176) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 15:56:43 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-4694d4e4-178d-4fd8-a84e-271bbaf0c18c tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] CPU controller found on host. {{(pid=75176) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 15:56:43 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-4694d4e4-178d-4fd8-a84e-271bbaf0c18c tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75176) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 15:56:43 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-4694d4e4-178d-4fd8-a84e-271bbaf0c18c tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T15:35:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b6606a73b5be8db6a739ec2f32cc9d2c',container_format='bare',created_at=2023-11-28T15:56:32Z,direct_url=<?>,disk_format='qcow2',id=bfdcb73d-4912-40b6-bdaf-299321d8dfaa,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1112779929',owner='c4a10ba40c844955b63cb8603dd548cf',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-28T15:56:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 15:56:43 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-4694d4e4-178d-4fd8-a84e-271bbaf0c18c tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Flavor limits 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 15:56:43 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-4694d4e4-178d-4fd8-a84e-271bbaf0c18c tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Image limits 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 15:56:43 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-4694d4e4-178d-4fd8-a84e-271bbaf0c18c tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Flavor pref 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 15:56:43 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-4694d4e4-178d-4fd8-a84e-271bbaf0c18c tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Image pref 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 15:56:43 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-4694d4e4-178d-4fd8-a84e-271bbaf0c18c tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 15:56:43 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-4694d4e4-178d-4fd8-a84e-271bbaf0c18c tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 15:56:43 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-4694d4e4-178d-4fd8-a84e-271bbaf0c18c tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75176) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 15:56:43 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-4694d4e4-178d-4fd8-a84e-271bbaf0c18c tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Got 1 possible topologies {{(pid=75176) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 15:56:43 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-4694d4e4-178d-4fd8-a84e-271bbaf0c18c tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 15:56:43 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-4694d4e4-178d-4fd8-a84e-271bbaf0c18c tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 15:56:43 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-4694d4e4-178d-4fd8-a84e-271bbaf0c18c tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T15:56:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-847942438',display_name='tempest-TestStampPattern-server-847942438',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-847942438',id=42,image_ref='bfdcb73d-4912-40b6-bdaf-299321d8dfaa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJDBFhGQGpvl0PzqrMCTu0nZeD/U57w9NaBED1EztO7Blxs28QRqXvlfz9rV68t1LblFY2IOCQcQRNQ31eEMoYQx8drae7GcY4KAfy8XhLJfS2RIdXJ5ySbX/yQzldJoeQ==',key_name='tempest-TestStampPattern-557159962',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c4a10ba40c844955b63cb8603dd548cf',ramdisk_id='',reservation_id='r-5kkb6qmj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='ecabea76-6c29-412d-bf77-989917b449a9',image_min_disk='1',image_min_ram='0',image_owner_id='c4a10ba40c844955b63cb8603dd548cf',image_owner_project_name='tempest-TestStampPattern-286689652',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-286689652-project-member',image_user_id='0dcee22ed63f40fab2ee0e42f5f38e13',network_allocated='True',owner_project_name='tempest-TestStampPattern-286689652',owner_user_name='tempest-TestStampPattern-286689652-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T15:56:41Z,user_data=None,user_id='0dcee22ed63f40fab2ee0e42f5f38e13',uuid=3ae602c1-2aed-41ea-9f4c-4f3ec4aab254,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dee8b036-92ce-421f-bb73-dbf92200da92", "address": "fa:16:3e:51:3e:28", "network": {"id": "1fd59c02-7617-4d0e-9456-84d6cc91ce3b", "bridge": "br-int", "label": "tempest-TestStampPattern-116968826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4a10ba40c844955b63cb8603dd548cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdee8b036-92", "ovs_interfaceid": "dee8b036-92ce-421f-bb73-dbf92200da92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75176) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 15:56:43 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-4694d4e4-178d-4fd8-a84e-271bbaf0c18c tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Converting VIF {"id": "dee8b036-92ce-421f-bb73-dbf92200da92", "address": "fa:16:3e:51:3e:28", "network": {"id": "1fd59c02-7617-4d0e-9456-84d6cc91ce3b", "bridge": "br-int", "label": "tempest-TestStampPattern-116968826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4a10ba40c844955b63cb8603dd548cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdee8b036-92", "ovs_interfaceid": "dee8b036-92ce-421f-bb73-dbf92200da92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:56:43 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-4694d4e4-178d-4fd8-a84e-271bbaf0c18c tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:3e:28,bridge_name='br-int',has_traffic_filtering=True,id=dee8b036-92ce-421f-bb73-dbf92200da92,network=Network(1fd59c02-7617-4d0e-9456-84d6cc91ce3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdee8b036-92') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:56:43 user nova-compute[75176]: DEBUG nova.objects.instance [None req-4694d4e4-178d-4fd8-a84e-271bbaf0c18c tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Lazy-loading 'pci_devices' on Instance uuid 3ae602c1-2aed-41ea-9f4c-4f3ec4aab254 {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:56:43 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-4694d4e4-178d-4fd8-a84e-271bbaf0c18c tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] [instance: 3ae602c1-2aed-41ea-9f4c-4f3ec4aab254] End _get_guest_xml xml=<domain type="kvm">
Nov 28 15:56:43 user nova-compute[75176]:   <uuid>3ae602c1-2aed-41ea-9f4c-4f3ec4aab254</uuid>
Nov 28 15:56:43 user nova-compute[75176]:   <name>instance-0000002a</name>
Nov 28 15:56:43 user nova-compute[75176]:   <memory>524288</memory>
Nov 28 15:56:43 user nova-compute[75176]:   <vcpu>1</vcpu>
Nov 28 15:56:43 user nova-compute[75176]:   <metadata>
Nov 28 15:56:43 user nova-compute[75176]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 15:56:43 user nova-compute[75176]:       <nova:package version="0.0.0"/>
Nov 28 15:56:43 user nova-compute[75176]:       <nova:name>tempest-TestStampPattern-server-847942438</nova:name>
Nov 28 15:56:43 user nova-compute[75176]:       <nova:creationTime>2023-11-28 15:56:43</nova:creationTime>
Nov 28 15:56:43 user nova-compute[75176]:       <nova:flavor name="m1.tiny">
Nov 28 15:56:43 user nova-compute[75176]:         <nova:memory>512</nova:memory>
Nov 28 15:56:43 user nova-compute[75176]:         <nova:disk>1</nova:disk>
Nov 28 15:56:43 user nova-compute[75176]:         <nova:swap>0</nova:swap>
Nov 28 15:56:43 user nova-compute[75176]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 15:56:43 user nova-compute[75176]:         <nova:vcpus>1</nova:vcpus>
Nov 28 15:56:43 user nova-compute[75176]:       </nova:flavor>
Nov 28 15:56:43 user nova-compute[75176]:       <nova:owner>
Nov 28 15:56:43 user nova-compute[75176]:         <nova:user uuid="0dcee22ed63f40fab2ee0e42f5f38e13">tempest-TestStampPattern-286689652-project-member</nova:user>
Nov 28 15:56:43 user nova-compute[75176]:         <nova:project uuid="c4a10ba40c844955b63cb8603dd548cf">tempest-TestStampPattern-286689652</nova:project>
Nov 28 15:56:43 user nova-compute[75176]:       </nova:owner>
Nov 28 15:56:43 user nova-compute[75176]:       <nova:root type="image" uuid="bfdcb73d-4912-40b6-bdaf-299321d8dfaa"/>
Nov 28 15:56:43 user nova-compute[75176]:       <nova:ports>
Nov 28 15:56:43 user nova-compute[75176]:         <nova:port uuid="dee8b036-92ce-421f-bb73-dbf92200da92">
Nov 28 15:56:43 user nova-compute[75176]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 28 15:56:43 user nova-compute[75176]:         </nova:port>
Nov 28 15:56:43 user nova-compute[75176]:       </nova:ports>
Nov 28 15:56:43 user nova-compute[75176]:     </nova:instance>
Nov 28 15:56:43 user nova-compute[75176]:   </metadata>
Nov 28 15:56:43 user nova-compute[75176]:   <sysinfo type="smbios">
Nov 28 15:56:43 user nova-compute[75176]:     <system>
Nov 28 15:56:43 user nova-compute[75176]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 15:56:43 user nova-compute[75176]:       <entry name="product">OpenStack Nova</entry>
Nov 28 15:56:43 user nova-compute[75176]:       <entry name="version">0.0.0</entry>
Nov 28 15:56:43 user nova-compute[75176]:       <entry name="serial">3ae602c1-2aed-41ea-9f4c-4f3ec4aab254</entry>
Nov 28 15:56:43 user nova-compute[75176]:       <entry name="uuid">3ae602c1-2aed-41ea-9f4c-4f3ec4aab254</entry>
Nov 28 15:56:43 user nova-compute[75176]:       <entry name="family">Virtual Machine</entry>
Nov 28 15:56:43 user nova-compute[75176]:     </system>
Nov 28 15:56:43 user nova-compute[75176]:   </sysinfo>
Nov 28 15:56:43 user nova-compute[75176]:   <os>
Nov 28 15:56:43 user nova-compute[75176]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 15:56:43 user nova-compute[75176]:     <boot dev="hd"/>
Nov 28 15:56:43 user nova-compute[75176]:     <smbios mode="sysinfo"/>
Nov 28 15:56:43 user nova-compute[75176]:   </os>
Nov 28 15:56:43 user nova-compute[75176]:   <features>
Nov 28 15:56:43 user nova-compute[75176]:     <acpi/>
Nov 28 15:56:43 user nova-compute[75176]:     <apic/>
Nov 28 15:56:43 user nova-compute[75176]:     <vmcoreinfo/>
Nov 28 15:56:43 user nova-compute[75176]:   </features>
Nov 28 15:56:43 user nova-compute[75176]:   <clock offset="utc">
Nov 28 15:56:43 user nova-compute[75176]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 15:56:43 user nova-compute[75176]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 15:56:43 user nova-compute[75176]:     <timer name="hpet" present="no"/>
Nov 28 15:56:43 user nova-compute[75176]:   </clock>
Nov 28 15:56:43 user nova-compute[75176]:   <cpu mode="custom" match="exact">
Nov 28 15:56:43 user nova-compute[75176]:     <model>Nehalem</model>
Nov 28 15:56:43 user nova-compute[75176]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 15:56:43 user nova-compute[75176]:   </cpu>
Nov 28 15:56:43 user nova-compute[75176]:   <devices>
Nov 28 15:56:43 user nova-compute[75176]:     <disk type="file" device="disk">
Nov 28 15:56:43 user nova-compute[75176]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 15:56:43 user nova-compute[75176]:       <source file="/opt/stack/data/nova/instances/3ae602c1-2aed-41ea-9f4c-4f3ec4aab254/disk"/>
Nov 28 15:56:43 user nova-compute[75176]:       <target dev="vda" bus="virtio"/>
Nov 28 15:56:43 user nova-compute[75176]:     </disk>
Nov 28 15:56:43 user nova-compute[75176]:     <interface type="ethernet">
Nov 28 15:56:43 user nova-compute[75176]:       <mac address="fa:16:3e:51:3e:28"/>
Nov 28 15:56:43 user nova-compute[75176]:       <model type="virtio"/>
Nov 28 15:56:43 user nova-compute[75176]:       <mtu size="1442"/>
Nov 28 15:56:43 user nova-compute[75176]:       <target dev="tapdee8b036-92"/>
Nov 28 15:56:43 user nova-compute[75176]:     </interface>
Nov 28 15:56:43 user nova-compute[75176]:     <serial type="pty">
Nov 28 15:56:43 user nova-compute[75176]:       <log file="/opt/stack/data/nova/instances/3ae602c1-2aed-41ea-9f4c-4f3ec4aab254/console.log" append="off"/>
Nov 28 15:56:43 user nova-compute[75176]:     </serial>
Nov 28 15:56:43 user nova-compute[75176]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 15:56:43 user nova-compute[75176]:     <video>
Nov 28 15:56:43 user nova-compute[75176]:       <model type="virtio"/>
Nov 28 15:56:43 user nova-compute[75176]:     </video>
Nov 28 15:56:43 user nova-compute[75176]:     <rng model="virtio">
Nov 28 15:56:43 user nova-compute[75176]:       <backend model="random">/dev/urandom</backend>
Nov 28 15:56:43 user nova-compute[75176]:     </rng>
Nov 28 15:56:43 user nova-compute[75176]:     <controller type="usb" index="0" model="none"/>
Nov 28 15:56:43 user nova-compute[75176]:     <memballoon model="virtio">
Nov 28 15:56:43 user nova-compute[75176]:       <stats period="10"/>
Nov 28 15:56:43 user nova-compute[75176]:     </memballoon>
Nov 28 15:56:43 user nova-compute[75176]:   </devices>
Nov 28 15:56:43 user nova-compute[75176]: </domain>
Nov 28 15:56:43 user nova-compute[75176]:  {{(pid=75176) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 15:56:43 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-4694d4e4-178d-4fd8-a84e-271bbaf0c18c tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T15:56:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-847942438',display_name='tempest-TestStampPattern-server-847942438',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-847942438',id=42,image_ref='bfdcb73d-4912-40b6-bdaf-299321d8dfaa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJDBFhGQGpvl0PzqrMCTu0nZeD/U57w9NaBED1EztO7Blxs28QRqXvlfz9rV68t1LblFY2IOCQcQRNQ31eEMoYQx8drae7GcY4KAfy8XhLJfS2RIdXJ5ySbX/yQzldJoeQ==',key_name='tempest-TestStampPattern-557159962',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c4a10ba40c844955b63cb8603dd548cf',ramdisk_id='',reservation_id='r-5kkb6qmj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='ecabea76-6c29-412d-bf77-989917b449a9',image_min_disk='1',image_min_ram='0',image_owner_id='c4a10ba40c844955b63cb8603dd548cf',image_owner_project_name='tempest-TestStampPattern-286689652',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-286689652-project-member',image_user_id='0dcee22ed63f40fab2ee0e42f5f38e13',network_allocated='True',owner_project_name='tempest-TestStampPattern-286689652',owner_user_name='tempest-TestStampPattern-286689652-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T15:56:41Z,user_data=None,user_id='0dcee22ed63f40fab2ee0e42f5f38e13',uuid=3ae602c1-2aed-41ea-9f4c-4f3ec4aab254,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dee8b036-92ce-421f-bb73-dbf92200da92", "address": "fa:16:3e:51:3e:28", "network": {"id": "1fd59c02-7617-4d0e-9456-84d6cc91ce3b", "bridge": "br-int", "label": "tempest-TestStampPattern-116968826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4a10ba40c844955b63cb8603dd548cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdee8b036-92", "ovs_interfaceid": "dee8b036-92ce-421f-bb73-dbf92200da92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 15:56:43 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-4694d4e4-178d-4fd8-a84e-271bbaf0c18c tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Converting VIF {"id": "dee8b036-92ce-421f-bb73-dbf92200da92", "address": "fa:16:3e:51:3e:28", "network": {"id": "1fd59c02-7617-4d0e-9456-84d6cc91ce3b", "bridge": "br-int", "label": "tempest-TestStampPattern-116968826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4a10ba40c844955b63cb8603dd548cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdee8b036-92", "ovs_interfaceid": "dee8b036-92ce-421f-bb73-dbf92200da92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:56:43 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-4694d4e4-178d-4fd8-a84e-271bbaf0c18c tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:3e:28,bridge_name='br-int',has_traffic_filtering=True,id=dee8b036-92ce-421f-bb73-dbf92200da92,network=Network(1fd59c02-7617-4d0e-9456-84d6cc91ce3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdee8b036-92') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:56:43 user nova-compute[75176]: DEBUG os_vif [None req-4694d4e4-178d-4fd8-a84e-271bbaf0c18c tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:3e:28,bridge_name='br-int',has_traffic_filtering=True,id=dee8b036-92ce-421f-bb73-dbf92200da92,network=Network(1fd59c02-7617-4d0e-9456-84d6cc91ce3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdee8b036-92') {{(pid=75176) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 15:56:43 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:56:43 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:56:43 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 15:56:43 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:56:43 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'aea7fc09-f5d9-5f3c-8a07-bfb8c571ebcb', '_type': 'linux-noop'}}, row=False) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:56:43 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:56:43 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:56:43 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:56:43 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdee8b036-92, may_exist=True, interface_attrs={}) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:56:43 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdee8b036-92, col_values=(('qos', UUID('4831a25e-8e2e-4d92-a321-36dd0f290326')),), if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:56:43 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdee8b036-92, col_values=(('external_ids', {'iface-id': 'dee8b036-92ce-421f-bb73-dbf92200da92', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:51:3e:28', 'vm-uuid': '3ae602c1-2aed-41ea-9f4c-4f3ec4aab254'}),), if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:56:43 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:56:43 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:56:43 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:56:43 user nova-compute[75176]: INFO os_vif [None req-4694d4e4-178d-4fd8-a84e-271bbaf0c18c tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:3e:28,bridge_name='br-int',has_traffic_filtering=True,id=dee8b036-92ce-421f-bb73-dbf92200da92,network=Network(1fd59c02-7617-4d0e-9456-84d6cc91ce3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdee8b036-92')
Nov 28 15:56:43 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-4694d4e4-178d-4fd8-a84e-271bbaf0c18c tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] No BDM found with device name vda, not building metadata. {{(pid=75176) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 15:56:43 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-4694d4e4-178d-4fd8-a84e-271bbaf0c18c tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] No VIF found with MAC fa:16:3e:51:3e:28, not building metadata {{(pid=75176) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 15:56:45 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:56:45 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:56:45 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:56:45 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:56:45 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:56:45 user nova-compute[75176]: DEBUG nova.compute.manager [req-e7cbcdd3-86c1-417f-8146-3b8ebee0c4c5 req-bea40e9c-f9d1-4b47-95c2-bfd2c6aa50bc service nova] [instance: 3ae602c1-2aed-41ea-9f4c-4f3ec4aab254] Received event network-vif-plugged-dee8b036-92ce-421f-bb73-dbf92200da92 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:56:45 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-e7cbcdd3-86c1-417f-8146-3b8ebee0c4c5 req-bea40e9c-f9d1-4b47-95c2-bfd2c6aa50bc service nova] Acquiring lock "3ae602c1-2aed-41ea-9f4c-4f3ec4aab254-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:56:45 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-e7cbcdd3-86c1-417f-8146-3b8ebee0c4c5 req-bea40e9c-f9d1-4b47-95c2-bfd2c6aa50bc service nova] Lock "3ae602c1-2aed-41ea-9f4c-4f3ec4aab254-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:56:45 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-e7cbcdd3-86c1-417f-8146-3b8ebee0c4c5 req-bea40e9c-f9d1-4b47-95c2-bfd2c6aa50bc service nova] Lock "3ae602c1-2aed-41ea-9f4c-4f3ec4aab254-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:56:45 user nova-compute[75176]: DEBUG nova.compute.manager [req-e7cbcdd3-86c1-417f-8146-3b8ebee0c4c5 req-bea40e9c-f9d1-4b47-95c2-bfd2c6aa50bc service nova] [instance: 3ae602c1-2aed-41ea-9f4c-4f3ec4aab254] No waiting events found dispatching network-vif-plugged-dee8b036-92ce-421f-bb73-dbf92200da92 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:56:45 user nova-compute[75176]: WARNING nova.compute.manager [req-e7cbcdd3-86c1-417f-8146-3b8ebee0c4c5 req-bea40e9c-f9d1-4b47-95c2-bfd2c6aa50bc service nova] [instance: 3ae602c1-2aed-41ea-9f4c-4f3ec4aab254] Received unexpected event network-vif-plugged-dee8b036-92ce-421f-bb73-dbf92200da92 for instance with vm_state building and task_state spawning.
Nov 28 15:56:46 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-c01f769f-6ac8-48ad-8f06-3ae915ad885c tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Acquiring lock "525c3cc4-9cc4-470b-bf72-5e53d80cea6f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:56:46 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-c01f769f-6ac8-48ad-8f06-3ae915ad885c tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Lock "525c3cc4-9cc4-470b-bf72-5e53d80cea6f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:56:46 user nova-compute[75176]: DEBUG nova.compute.manager [None req-c01f769f-6ac8-48ad-8f06-3ae915ad885c tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: 525c3cc4-9cc4-470b-bf72-5e53d80cea6f] Starting instance... {{(pid=75176) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 15:56:46 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-c01f769f-6ac8-48ad-8f06-3ae915ad885c tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:56:46 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-c01f769f-6ac8-48ad-8f06-3ae915ad885c tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:56:46 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-c01f769f-6ac8-48ad-8f06-3ae915ad885c tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75176) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 15:56:46 user nova-compute[75176]: INFO nova.compute.claims [None req-c01f769f-6ac8-48ad-8f06-3ae915ad885c tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: 525c3cc4-9cc4-470b-bf72-5e53d80cea6f] Claim successful on node user
Nov 28 15:56:46 user nova-compute[75176]: DEBUG nova.compute.provider_tree [None req-c01f769f-6ac8-48ad-8f06-3ae915ad885c tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Inventory has not changed in ProviderTree for provider: b37848d8-f401-4155-a029-b0ffa09ff85b {{(pid=75176) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 15:56:46 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-c01f769f-6ac8-48ad-8f06-3ae915ad885c tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Inventory has not changed for provider b37848d8-f401-4155-a029-b0ffa09ff85b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75176) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 15:56:46 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-c01f769f-6ac8-48ad-8f06-3ae915ad885c tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.415s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:56:46 user nova-compute[75176]: DEBUG nova.compute.manager [None req-c01f769f-6ac8-48ad-8f06-3ae915ad885c tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: 525c3cc4-9cc4-470b-bf72-5e53d80cea6f] Start building networks asynchronously for instance. {{(pid=75176) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 15:56:46 user nova-compute[75176]: DEBUG nova.compute.manager [None req-c01f769f-6ac8-48ad-8f06-3ae915ad885c tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: 525c3cc4-9cc4-470b-bf72-5e53d80cea6f] Allocating IP information in the background. {{(pid=75176) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 15:56:46 user nova-compute[75176]: DEBUG nova.network.neutron [None req-c01f769f-6ac8-48ad-8f06-3ae915ad885c tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: 525c3cc4-9cc4-470b-bf72-5e53d80cea6f] allocate_for_instance() {{(pid=75176) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 15:56:46 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-c01f769f-6ac8-48ad-8f06-3ae915ad885c tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: 525c3cc4-9cc4-470b-bf72-5e53d80cea6f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 15:56:46 user nova-compute[75176]: DEBUG nova.compute.manager [None req-c01f769f-6ac8-48ad-8f06-3ae915ad885c tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: 525c3cc4-9cc4-470b-bf72-5e53d80cea6f] Start building block device mappings for instance. {{(pid=75176) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 15:56:46 user nova-compute[75176]: INFO nova.virt.block_device [None req-c01f769f-6ac8-48ad-8f06-3ae915ad885c tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: 525c3cc4-9cc4-470b-bf72-5e53d80cea6f] Booting with volume 2389818d-1c3f-46d9-a70a-1330da1b94e0 at /dev/vda
Nov 28 15:56:46 user nova-compute[75176]: DEBUG nova.policy [None req-c01f769f-6ac8-48ad-8f06-3ae915ad885c tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '081bf84d24194b81be4e0a6638db9b66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c7783cc16049208421204910982c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75176) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 15:56:46 user nova-compute[75176]: DEBUG os_brick.utils [None req-c01f769f-6ac8-48ad-8f06-3ae915ad885c tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 15:56:46 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:56:46 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:56:46 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4688e4b-b811-426c-911d-9626f5640adb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:edc924a949b2\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:56:46 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:56:46 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.023s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:56:46 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeea1b01-2446-4c59-bf3e-d8a1a20f3a36]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:56:46 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:56:46 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:56:46 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6e15210-c9b8-4c8f-b8d6-34a722764ebb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:56:46 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0f56636-0b17-43a9-bfe4-55840705a1b4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:56:46 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-c01f769f-6ac8-48ad-8f06-3ae915ad885c tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Running cmd (subprocess): nvme version {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:56:47 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-c01f769f-6ac8-48ad-8f06-3ae915ad885c tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] 'nvme version' failed. Not Retrying. {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 15:56:47 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c01f769f-6ac8-48ad-8f06-3ae915ad885c tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] nvme not present on system {{(pid=75176) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 15:56:47 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:56:47 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 15:56:47 user nova-compute[75176]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 15:56:47 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c217069-ac1b-4279-b03d-d00e05c82e85]: (4, '') {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:56:47 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.lightos [None req-c01f769f-6ac8-48ad-8f06-3ae915ad885c tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75176) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 15:56:47 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.lightos [None req-c01f769f-6ac8-48ad-8f06-3ae915ad885c tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75176) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 15:56:47 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.lightos [None req-c01f769f-6ac8-48ad-8f06-3ae915ad885c tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] LIGHTOS: no hostnqn found. {{(pid=75176) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 15:56:47 user nova-compute[75176]: DEBUG os_brick.utils [None req-c01f769f-6ac8-48ad-8f06-3ae915ad885c tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:edc924a949b2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 15:56:47 user nova-compute[75176]: DEBUG nova.virt.block_device [None req-c01f769f-6ac8-48ad-8f06-3ae915ad885c tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: 525c3cc4-9cc4-470b-bf72-5e53d80cea6f] Updating existing volume attachment record: 7ecff0d0-8218-49cf-83cd-0ea474dafcbf {{(pid=75176) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 15:56:47 user nova-compute[75176]: DEBUG nova.compute.manager [req-a085a553-330f-4345-97eb-652ae3854019 req-e9dfff25-0231-4df9-87c9-49dd69af341f service nova] [instance: 3ae602c1-2aed-41ea-9f4c-4f3ec4aab254] Received event network-vif-plugged-dee8b036-92ce-421f-bb73-dbf92200da92 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:56:47 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-a085a553-330f-4345-97eb-652ae3854019 req-e9dfff25-0231-4df9-87c9-49dd69af341f service nova] Acquiring lock "3ae602c1-2aed-41ea-9f4c-4f3ec4aab254-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:56:47 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-a085a553-330f-4345-97eb-652ae3854019 req-e9dfff25-0231-4df9-87c9-49dd69af341f service nova] Lock "3ae602c1-2aed-41ea-9f4c-4f3ec4aab254-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:56:47 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-a085a553-330f-4345-97eb-652ae3854019 req-e9dfff25-0231-4df9-87c9-49dd69af341f service nova] Lock "3ae602c1-2aed-41ea-9f4c-4f3ec4aab254-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:56:47 user nova-compute[75176]: DEBUG nova.compute.manager [req-a085a553-330f-4345-97eb-652ae3854019 req-e9dfff25-0231-4df9-87c9-49dd69af341f service nova] [instance: 3ae602c1-2aed-41ea-9f4c-4f3ec4aab254] No waiting events found dispatching network-vif-plugged-dee8b036-92ce-421f-bb73-dbf92200da92 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:56:47 user nova-compute[75176]: WARNING nova.compute.manager [req-a085a553-330f-4345-97eb-652ae3854019 req-e9dfff25-0231-4df9-87c9-49dd69af341f service nova] [instance: 3ae602c1-2aed-41ea-9f4c-4f3ec4aab254] Received unexpected event network-vif-plugged-dee8b036-92ce-421f-bb73-dbf92200da92 for instance with vm_state building and task_state spawning.
Nov 28 15:56:47 user nova-compute[75176]: DEBUG nova.compute.manager [None req-4694d4e4-178d-4fd8-a84e-271bbaf0c18c tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] [instance: 3ae602c1-2aed-41ea-9f4c-4f3ec4aab254] Instance event wait completed in 0 seconds for  {{(pid=75176) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 15:56:47 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-4694d4e4-178d-4fd8-a84e-271bbaf0c18c tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] [instance: 3ae602c1-2aed-41ea-9f4c-4f3ec4aab254] Guest created on hypervisor {{(pid=75176) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 15:56:47 user nova-compute[75176]: INFO nova.virt.libvirt.driver [-] [instance: 3ae602c1-2aed-41ea-9f4c-4f3ec4aab254] Instance spawned successfully.
Nov 28 15:56:47 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-4694d4e4-178d-4fd8-a84e-271bbaf0c18c tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] [instance: 3ae602c1-2aed-41ea-9f4c-4f3ec4aab254] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 15:56:47 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-4694d4e4-178d-4fd8-a84e-271bbaf0c18c tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] [instance: 3ae602c1-2aed-41ea-9f4c-4f3ec4aab254] Found default for hw_input_bus of None {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:56:47 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-4694d4e4-178d-4fd8-a84e-271bbaf0c18c tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] [instance: 3ae602c1-2aed-41ea-9f4c-4f3ec4aab254] Found default for hw_pointer_model of None {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:56:47 user nova-compute[75176]: DEBUG nova.network.neutron [None req-c01f769f-6ac8-48ad-8f06-3ae915ad885c tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: 525c3cc4-9cc4-470b-bf72-5e53d80cea6f] Successfully created port: 6c64d8cb-6ee1-4d8f-8898-3e70b5e17b9e {{(pid=75176) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 15:56:47 user nova-compute[75176]: INFO nova.compute.manager [None req-4694d4e4-178d-4fd8-a84e-271bbaf0c18c tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] [instance: 3ae602c1-2aed-41ea-9f4c-4f3ec4aab254] Took 6.61 seconds to spawn the instance on the hypervisor.
Nov 28 15:56:47 user nova-compute[75176]: DEBUG nova.compute.manager [None req-4694d4e4-178d-4fd8-a84e-271bbaf0c18c tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] [instance: 3ae602c1-2aed-41ea-9f4c-4f3ec4aab254] Checking state {{(pid=75176) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 15:56:47 user nova-compute[75176]: INFO nova.compute.manager [None req-4694d4e4-178d-4fd8-a84e-271bbaf0c18c tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] [instance: 3ae602c1-2aed-41ea-9f4c-4f3ec4aab254] Took 7.35 seconds to build instance.
Nov 28 15:56:47 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-4694d4e4-178d-4fd8-a84e-271bbaf0c18c tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Lock "3ae602c1-2aed-41ea-9f4c-4f3ec4aab254" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.450s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:56:48 user nova-compute[75176]: DEBUG nova.network.neutron [None req-c01f769f-6ac8-48ad-8f06-3ae915ad885c tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: 525c3cc4-9cc4-470b-bf72-5e53d80cea6f] Successfully updated port: 6c64d8cb-6ee1-4d8f-8898-3e70b5e17b9e {{(pid=75176) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 15:56:48 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-c01f769f-6ac8-48ad-8f06-3ae915ad885c tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Acquiring lock "refresh_cache-525c3cc4-9cc4-470b-bf72-5e53d80cea6f" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:56:48 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-c01f769f-6ac8-48ad-8f06-3ae915ad885c tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Acquired lock "refresh_cache-525c3cc4-9cc4-470b-bf72-5e53d80cea6f" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:56:48 user nova-compute[75176]: DEBUG nova.network.neutron [None req-c01f769f-6ac8-48ad-8f06-3ae915ad885c tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: 525c3cc4-9cc4-470b-bf72-5e53d80cea6f] Building network info cache for instance {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 15:56:48 user nova-compute[75176]: DEBUG nova.network.neutron [None req-c01f769f-6ac8-48ad-8f06-3ae915ad885c tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: 525c3cc4-9cc4-470b-bf72-5e53d80cea6f] Instance cache missing network info. {{(pid=75176) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 15:56:48 user nova-compute[75176]: DEBUG nova.network.neutron [None req-c01f769f-6ac8-48ad-8f06-3ae915ad885c tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: 525c3cc4-9cc4-470b-bf72-5e53d80cea6f] Updating instance_info_cache with network_info: [{"id": "6c64d8cb-6ee1-4d8f-8898-3e70b5e17b9e", "address": "fa:16:3e:93:0e:39", "network": {"id": "5ec264ad-3459-468c-bdbf-c6a4ef016951", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1574289626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07c7783cc16049208421204910982c79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c64d8cb-6e", "ovs_interfaceid": "6c64d8cb-6ee1-4d8f-8898-3e70b5e17b9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:56:48 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-c01f769f-6ac8-48ad-8f06-3ae915ad885c tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Releasing lock "refresh_cache-525c3cc4-9cc4-470b-bf72-5e53d80cea6f" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:56:48 user nova-compute[75176]: DEBUG nova.compute.manager [None req-c01f769f-6ac8-48ad-8f06-3ae915ad885c tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: 525c3cc4-9cc4-470b-bf72-5e53d80cea6f] Instance network_info: |[{"id": "6c64d8cb-6ee1-4d8f-8898-3e70b5e17b9e", "address": "fa:16:3e:93:0e:39", "network": {"id": "5ec264ad-3459-468c-bdbf-c6a4ef016951", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1574289626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07c7783cc16049208421204910982c79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c64d8cb-6e", "ovs_interfaceid": "6c64d8cb-6ee1-4d8f-8898-3e70b5e17b9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75176) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 15:56:48 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:56:49 user nova-compute[75176]: DEBUG nova.compute.manager [req-8bad7062-e4e9-46c3-9e4a-ab8a39874c4a req-b5e8f4b5-987d-46f6-ac8a-6f14444fb5a9 service nova] [instance: 525c3cc4-9cc4-470b-bf72-5e53d80cea6f] Received event network-changed-6c64d8cb-6ee1-4d8f-8898-3e70b5e17b9e {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:56:49 user nova-compute[75176]: DEBUG nova.compute.manager [req-8bad7062-e4e9-46c3-9e4a-ab8a39874c4a req-b5e8f4b5-987d-46f6-ac8a-6f14444fb5a9 service nova] [instance: 525c3cc4-9cc4-470b-bf72-5e53d80cea6f] Refreshing instance network info cache due to event network-changed-6c64d8cb-6ee1-4d8f-8898-3e70b5e17b9e. {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 15:56:49 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-8bad7062-e4e9-46c3-9e4a-ab8a39874c4a req-b5e8f4b5-987d-46f6-ac8a-6f14444fb5a9 service nova] Acquiring lock "refresh_cache-525c3cc4-9cc4-470b-bf72-5e53d80cea6f" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:56:49 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-8bad7062-e4e9-46c3-9e4a-ab8a39874c4a req-b5e8f4b5-987d-46f6-ac8a-6f14444fb5a9 service nova] Acquired lock "refresh_cache-525c3cc4-9cc4-470b-bf72-5e53d80cea6f" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:56:49 user nova-compute[75176]: DEBUG nova.network.neutron [req-8bad7062-e4e9-46c3-9e4a-ab8a39874c4a req-b5e8f4b5-987d-46f6-ac8a-6f14444fb5a9 service nova] [instance: 525c3cc4-9cc4-470b-bf72-5e53d80cea6f] Refreshing network info cache for port 6c64d8cb-6ee1-4d8f-8898-3e70b5e17b9e {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 15:56:49 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:56:49 user nova-compute[75176]: DEBUG nova.network.neutron [req-8bad7062-e4e9-46c3-9e4a-ab8a39874c4a req-b5e8f4b5-987d-46f6-ac8a-6f14444fb5a9 service nova] [instance: 525c3cc4-9cc4-470b-bf72-5e53d80cea6f] Updated VIF entry in instance network info cache for port 6c64d8cb-6ee1-4d8f-8898-3e70b5e17b9e. {{(pid=75176) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 15:56:49 user nova-compute[75176]: DEBUG nova.network.neutron [req-8bad7062-e4e9-46c3-9e4a-ab8a39874c4a req-b5e8f4b5-987d-46f6-ac8a-6f14444fb5a9 service nova] [instance: 525c3cc4-9cc4-470b-bf72-5e53d80cea6f] Updating instance_info_cache with network_info: [{"id": "6c64d8cb-6ee1-4d8f-8898-3e70b5e17b9e", "address": "fa:16:3e:93:0e:39", "network": {"id": "5ec264ad-3459-468c-bdbf-c6a4ef016951", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1574289626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07c7783cc16049208421204910982c79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c64d8cb-6e", "ovs_interfaceid": "6c64d8cb-6ee1-4d8f-8898-3e70b5e17b9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:56:49 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-8bad7062-e4e9-46c3-9e4a-ab8a39874c4a req-b5e8f4b5-987d-46f6-ac8a-6f14444fb5a9 service nova] Releasing lock "refresh_cache-525c3cc4-9cc4-470b-bf72-5e53d80cea6f" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:56:53 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:56:54 user nova-compute[75176]: DEBUG nova.compute.manager [None req-c01f769f-6ac8-48ad-8f06-3ae915ad885c tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: 525c3cc4-9cc4-470b-bf72-5e53d80cea6f] Start spawning the instance on the hypervisor. {{(pid=75176) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 15:56:54 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-c01f769f-6ac8-48ad-8f06-3ae915ad885c tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: 525c3cc4-9cc4-470b-bf72-5e53d80cea6f] Creating instance directory {{(pid=75176) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 15:56:54 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-c01f769f-6ac8-48ad-8f06-3ae915ad885c tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: 525c3cc4-9cc4-470b-bf72-5e53d80cea6f] Creating image(s)
Nov 28 15:56:54 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-c01f769f-6ac8-48ad-8f06-3ae915ad885c tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: 525c3cc4-9cc4-470b-bf72-5e53d80cea6f] Did not create local disks {{(pid=75176) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 28 15:56:54 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-c01f769f-6ac8-48ad-8f06-3ae915ad885c tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: 525c3cc4-9cc4-470b-bf72-5e53d80cea6f] Ensure instance console log exists: /opt/stack/data/nova/instances/525c3cc4-9cc4-470b-bf72-5e53d80cea6f/console.log {{(pid=75176) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 15:56:54 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-c01f769f-6ac8-48ad-8f06-3ae915ad885c tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:56:54 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-c01f769f-6ac8-48ad-8f06-3ae915ad885c tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:56:54 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-c01f769f-6ac8-48ad-8f06-3ae915ad885c tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:56:54 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-c01f769f-6ac8-48ad-8f06-3ae915ad885c tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: 525c3cc4-9cc4-470b-bf72-5e53d80cea6f] Start _get_guest_xml network_info=[{"id": "6c64d8cb-6ee1-4d8f-8898-3e70b5e17b9e", "address": "fa:16:3e:93:0e:39", "network": {"id": "5ec264ad-3459-468c-bdbf-c6a4ef016951", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1574289626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07c7783cc16049208421204910982c79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c64d8cb-6e", "ovs_interfaceid": "6c64d8cb-6ee1-4d8f-8898-3e70b5e17b9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tspqduOv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '525c3cc4-9cc4-470b-bf72-5e53d80cea6f', 'attached_at': '', 'detached_at': '', 'volume_id': '2389818d-1c3f-46d9-a70a-1330da1b94e0', 'serial': '2389818d-1c3f-46d9-a70a-1330da1b94e0'}, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'delete_on_termination': False, 'mount_device': '/dev/vda', 'attachment_id': '7ecff0d0-8218-49cf-83cd-0ea474dafcbf', 'volume_type': None} {{(pid=75176) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 15:56:54 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-c01f769f-6ac8-48ad-8f06-3ae915ad885c tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 15:56:54 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-c01f769f-6ac8-48ad-8f06-3ae915ad885c tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 15:56:54 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-c01f769f-6ac8-48ad-8f06-3ae915ad885c tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75176) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 15:56:54 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-c01f769f-6ac8-48ad-8f06-3ae915ad885c tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] CPU controller missing on host. {{(pid=75176) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 15:56:54 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-c01f769f-6ac8-48ad-8f06-3ae915ad885c tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75176) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 15:56:54 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-c01f769f-6ac8-48ad-8f06-3ae915ad885c tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] CPU controller found on host. {{(pid=75176) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 15:56:54 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-c01f769f-6ac8-48ad-8f06-3ae915ad885c tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75176) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 15:56:54 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-c01f769f-6ac8-48ad-8f06-3ae915ad885c tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T15:35:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 15:56:54 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-c01f769f-6ac8-48ad-8f06-3ae915ad885c tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Flavor limits 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 15:56:54 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-c01f769f-6ac8-48ad-8f06-3ae915ad885c tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Image limits 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 15:56:54 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-c01f769f-6ac8-48ad-8f06-3ae915ad885c tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Flavor pref 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 15:56:54 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-c01f769f-6ac8-48ad-8f06-3ae915ad885c tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Image pref 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 15:56:54 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-c01f769f-6ac8-48ad-8f06-3ae915ad885c tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 15:56:54 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-c01f769f-6ac8-48ad-8f06-3ae915ad885c tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 15:56:54 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-c01f769f-6ac8-48ad-8f06-3ae915ad885c tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75176) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 15:56:54 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-c01f769f-6ac8-48ad-8f06-3ae915ad885c tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Got 1 possible topologies {{(pid=75176) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 15:56:54 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-c01f769f-6ac8-48ad-8f06-3ae915ad885c tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 15:56:54 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-c01f769f-6ac8-48ad-8f06-3ae915ad885c tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 15:56:54 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c01f769f-6ac8-48ad-8f06-3ae915ad885c tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: 525c3cc4-9cc4-470b-bf72-5e53d80cea6f] Calling os-brick to attach iSCSI Volume {{(pid=75176) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 15:56:54 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-c01f769f-6ac8-48ad-8f06-3ae915ad885c tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c1b8a00>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tspqduOv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 15:56:54 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-c01f769f-6ac8-48ad-8f06-3ae915ad885c tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 15:56:54 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-c01f769f-6ac8-48ad-8f06-3ae915ad885c tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 15:56:54 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-c01f769f-6ac8-48ad-8f06-3ae915ad885c tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 15:56:54 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-c01f769f-6ac8-48ad-8f06-3ae915ad885c tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 15:56:54 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-c01f769f-6ac8-48ad-8f06-3ae915ad885c tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 15:56:54 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-c01f769f-6ac8-48ad-8f06-3ae915ad885c tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 15:56:54 user nova-compute[75176]: INFO os_brick.initiator.connectors.iscsi [None req-c01f769f-6ac8-48ad-8f06-3ae915ad885c tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 15:56:54 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0 -p 172.16.0.220:3260 {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:56:54 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:56:54 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f0c4def-b20d-4b52-87d6-66d436462cf4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:56:54 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-c01f769f-6ac8-48ad-8f06-3ae915ad885c tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 15:56:54 user nova-compute[75176]:  {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:56:54 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0 -p 172.16.0.220:3260 --interface default --op new {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:56:54 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:56:54 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcc97344-508f-4834-9806-b6293c2cfbfa]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0] added\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:56:54 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-c01f769f-6ac8-48ad-8f06-3ae915ad885c tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0] added
Nov 28 15:56:54 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:56:54 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:56:54 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:56:54 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[7422ae7d-36de-4b76-be84-fcd3e5c07ea8]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:56:54 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-c01f769f-6ac8-48ad-8f06-3ae915ad885c tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:56:54 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:56:55 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.035s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:56:55 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1cdf44f-649a-4b61-9327-a39878a907db]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:56:55 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-c01f769f-6ac8-48ad-8f06-3ae915ad885c tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:56:55 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tspqduOv {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:56:55 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tspqduOv" returned: 0 in 0.027s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:56:55 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc952f55-a762-46e6-8d2f-590de66df47a]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:56:55 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-c01f769f-6ac8-48ad-8f06-3ae915ad885c tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tspqduOv'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:56:55 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:56:55 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:56:55 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[fba4818f-9c9b-4bbd-9aa5-5400feed9282]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:56:55 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-c01f769f-6ac8-48ad-8f06-3ae915ad885c tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:56:55 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:56:55 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:56:55 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[bda40228-b1a2-4912-b19d-758fe366104a]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc (non-flash)\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:56:55 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-c01f769f-6ac8-48ad-8f06-3ae915ad885c tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 (non-flash)
Nov 28 15:56:55 user nova-compute[75176]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc (non-flash)
Nov 28 15:56:55 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:56:55 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-c01f769f-6ac8-48ad-8f06-3ae915ad885c tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 (non-flash)
Nov 28 15:56:55 user nova-compute[75176]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc (non-flash)
Nov 28 15:56:55 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 15:56:55 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0 -p 172.16.0.220:3260 --login {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:56:55 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:56:55 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[098f9b83-b37b-437a-9a6a-121ce63fff55]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:56:55 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-c01f769f-6ac8-48ad-8f06-3ae915ad885c tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0, portal: 172.16.0.220,3260]
Nov 28 15:56:55 user nova-compute[75176]: Login to [iface: default, target: iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0, portal: 172.16.0.220,3260] successful.
Nov 28 15:56:55 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:56:55 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:56:55 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:56:55 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[8835f634-69e3-4949-9f5a-5ea768764f03]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:56:55 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-c01f769f-6ac8-48ad-8f06-3ae915ad885c tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:56:55 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:56:55 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:56:55 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5e7e81c-a968-454e-a460-584e060f025f]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0 (non-flash)\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:56:55 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-c01f769f-6ac8-48ad-8f06-3ae915ad885c tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 (non-flash)
Nov 28 15:56:55 user nova-compute[75176]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc (non-flash)
Nov 28 15:56:55 user nova-compute[75176]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0 (non-flash)
Nov 28 15:56:55 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:56:55 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-c01f769f-6ac8-48ad-8f06-3ae915ad885c tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 (non-flash)
Nov 28 15:56:55 user nova-compute[75176]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc (non-flash)
Nov 28 15:56:55 user nova-compute[75176]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0 (non-flash)
Nov 28 15:56:55 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 15:56:55 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-c01f769f-6ac8-48ad-8f06-3ae915ad885c tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.309s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 15:56:55 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-c01f769f-6ac8-48ad-8f06-3ae915ad885c tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Connected to 172.16.0.220:3260 {{(pid=75176) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 15:56:55 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-c01f769f-6ac8-48ad-8f06-3ae915ad885c tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] HCTL ('33', '-', '-', 0) found on session 48 with lun 0 {{(pid=75176) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 15:56:55 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-c01f769f-6ac8-48ad-8f06-3ae915ad885c tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75176) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 15:56:55 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:56:55 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:56:55 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa4fc60f-85c2-43e3-ab52-a862dd0d1fef]: (4, ('- - 0', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:56:55 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-c01f769f-6ac8-48ad-8f06-3ae915ad885c tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Searching for a device in session 48 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75176) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 15:56:55 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-c01f769f-6ac8-48ad-8f06-3ae915ad885c tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tspqduOv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75176) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 15:56:56 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-c01f769f-6ac8-48ad-8f06-3ae915ad885c tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.341s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 15:56:56 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-c01f769f-6ac8-48ad-8f06-3ae915ad885c tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] <== connect_volume: return (1342ms) {'type': 'block', 'scsi_wwn': '23439633632613235', 'path': '/dev/sdb'} {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 15:56:56 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c01f769f-6ac8-48ad-8f06-3ae915ad885c tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: 525c3cc4-9cc4-470b-bf72-5e53d80cea6f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23439633632613235', 'path': '/dev/sdb'} {{(pid=75176) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 15:56:56 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-c01f769f-6ac8-48ad-8f06-3ae915ad885c tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T15:56:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-367386830',display_name='tempest-TestVolumeBootPattern-server-367386830',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-367386830',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAT4j4MwMCXcgxPv2ypvh6Le18WUkR/7PQX0ERUSwv8uiHb35AkMlGdcRbKgULWyfAemfpuoTAyzTZycSyQIMMK+kqb2pUHOOT/5otX0G6BKfJMaYPfRy2E0NOlU0WUh/Q==',key_name='tempest-TestVolumeBootPattern-94664483',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='07c7783cc16049208421204910982c79',ramdisk_id='',reservation_id='r-mqqbey4c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1695196118',owner_user_name='tempest-TestVolumeBootPattern-1695196118-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T15:56:47Z,user_data=None,user_id='081bf84d24194b81be4e0a6638db9b66',uuid=525c3cc4-9cc4-470b-bf72-5e53d80cea6f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6c64d8cb-6ee1-4d8f-8898-3e70b5e17b9e", "address": "fa:16:3e:93:0e:39", "network": {"id": "5ec264ad-3459-468c-bdbf-c6a4ef016951", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1574289626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07c7783cc16049208421204910982c79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c64d8cb-6e", "ovs_interfaceid": "6c64d8cb-6ee1-4d8f-8898-3e70b5e17b9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75176) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 15:56:56 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-c01f769f-6ac8-48ad-8f06-3ae915ad885c tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Converting VIF {"id": "6c64d8cb-6ee1-4d8f-8898-3e70b5e17b9e", "address": "fa:16:3e:93:0e:39", "network": {"id": "5ec264ad-3459-468c-bdbf-c6a4ef016951", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1574289626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07c7783cc16049208421204910982c79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c64d8cb-6e", "ovs_interfaceid": "6c64d8cb-6ee1-4d8f-8898-3e70b5e17b9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:56:56 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-c01f769f-6ac8-48ad-8f06-3ae915ad885c tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:93:0e:39,bridge_name='br-int',has_traffic_filtering=True,id=6c64d8cb-6ee1-4d8f-8898-3e70b5e17b9e,network=Network(5ec264ad-3459-468c-bdbf-c6a4ef016951),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c64d8cb-6e') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:56:56 user nova-compute[75176]: DEBUG nova.objects.instance [None req-c01f769f-6ac8-48ad-8f06-3ae915ad885c tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Lazy-loading 'pci_devices' on Instance uuid 525c3cc4-9cc4-470b-bf72-5e53d80cea6f {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:56:56 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-c01f769f-6ac8-48ad-8f06-3ae915ad885c tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: 525c3cc4-9cc4-470b-bf72-5e53d80cea6f] End _get_guest_xml xml=<domain type="kvm">
Nov 28 15:56:56 user nova-compute[75176]:   <uuid>525c3cc4-9cc4-470b-bf72-5e53d80cea6f</uuid>
Nov 28 15:56:56 user nova-compute[75176]:   <name>instance-0000002b</name>
Nov 28 15:56:56 user nova-compute[75176]:   <memory>524288</memory>
Nov 28 15:56:56 user nova-compute[75176]:   <vcpu>1</vcpu>
Nov 28 15:56:56 user nova-compute[75176]:   <metadata>
Nov 28 15:56:56 user nova-compute[75176]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 15:56:56 user nova-compute[75176]:       <nova:package version="0.0.0"/>
Nov 28 15:56:56 user nova-compute[75176]:       <nova:name>tempest-TestVolumeBootPattern-server-367386830</nova:name>
Nov 28 15:56:56 user nova-compute[75176]:       <nova:creationTime>2023-11-28 15:56:54</nova:creationTime>
Nov 28 15:56:56 user nova-compute[75176]:       <nova:flavor name="m1.tiny">
Nov 28 15:56:56 user nova-compute[75176]:         <nova:memory>512</nova:memory>
Nov 28 15:56:56 user nova-compute[75176]:         <nova:disk>1</nova:disk>
Nov 28 15:56:56 user nova-compute[75176]:         <nova:swap>0</nova:swap>
Nov 28 15:56:56 user nova-compute[75176]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 15:56:56 user nova-compute[75176]:         <nova:vcpus>1</nova:vcpus>
Nov 28 15:56:56 user nova-compute[75176]:       </nova:flavor>
Nov 28 15:56:56 user nova-compute[75176]:       <nova:owner>
Nov 28 15:56:56 user nova-compute[75176]:         <nova:user uuid="081bf84d24194b81be4e0a6638db9b66">tempest-TestVolumeBootPattern-1695196118-project-member</nova:user>
Nov 28 15:56:56 user nova-compute[75176]:         <nova:project uuid="07c7783cc16049208421204910982c79">tempest-TestVolumeBootPattern-1695196118</nova:project>
Nov 28 15:56:56 user nova-compute[75176]:       </nova:owner>
Nov 28 15:56:56 user nova-compute[75176]:       <nova:ports>
Nov 28 15:56:56 user nova-compute[75176]:         <nova:port uuid="6c64d8cb-6ee1-4d8f-8898-3e70b5e17b9e">
Nov 28 15:56:56 user nova-compute[75176]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 28 15:56:56 user nova-compute[75176]:         </nova:port>
Nov 28 15:56:56 user nova-compute[75176]:       </nova:ports>
Nov 28 15:56:56 user nova-compute[75176]:     </nova:instance>
Nov 28 15:56:56 user nova-compute[75176]:   </metadata>
Nov 28 15:56:56 user nova-compute[75176]:   <sysinfo type="smbios">
Nov 28 15:56:56 user nova-compute[75176]:     <system>
Nov 28 15:56:56 user nova-compute[75176]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 15:56:56 user nova-compute[75176]:       <entry name="product">OpenStack Nova</entry>
Nov 28 15:56:56 user nova-compute[75176]:       <entry name="version">0.0.0</entry>
Nov 28 15:56:56 user nova-compute[75176]:       <entry name="serial">525c3cc4-9cc4-470b-bf72-5e53d80cea6f</entry>
Nov 28 15:56:56 user nova-compute[75176]:       <entry name="uuid">525c3cc4-9cc4-470b-bf72-5e53d80cea6f</entry>
Nov 28 15:56:56 user nova-compute[75176]:       <entry name="family">Virtual Machine</entry>
Nov 28 15:56:56 user nova-compute[75176]:     </system>
Nov 28 15:56:56 user nova-compute[75176]:   </sysinfo>
Nov 28 15:56:56 user nova-compute[75176]:   <os>
Nov 28 15:56:56 user nova-compute[75176]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 15:56:56 user nova-compute[75176]:     <boot dev="hd"/>
Nov 28 15:56:56 user nova-compute[75176]:     <smbios mode="sysinfo"/>
Nov 28 15:56:56 user nova-compute[75176]:   </os>
Nov 28 15:56:56 user nova-compute[75176]:   <features>
Nov 28 15:56:56 user nova-compute[75176]:     <acpi/>
Nov 28 15:56:56 user nova-compute[75176]:     <apic/>
Nov 28 15:56:56 user nova-compute[75176]:     <vmcoreinfo/>
Nov 28 15:56:56 user nova-compute[75176]:   </features>
Nov 28 15:56:56 user nova-compute[75176]:   <clock offset="utc">
Nov 28 15:56:56 user nova-compute[75176]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 15:56:56 user nova-compute[75176]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 15:56:56 user nova-compute[75176]:     <timer name="hpet" present="no"/>
Nov 28 15:56:56 user nova-compute[75176]:   </clock>
Nov 28 15:56:56 user nova-compute[75176]:   <cpu mode="custom" match="exact">
Nov 28 15:56:56 user nova-compute[75176]:     <model>Nehalem</model>
Nov 28 15:56:56 user nova-compute[75176]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 15:56:56 user nova-compute[75176]:   </cpu>
Nov 28 15:56:56 user nova-compute[75176]:   <devices>
Nov 28 15:56:56 user nova-compute[75176]:     <disk type="block" device="disk">
Nov 28 15:56:56 user nova-compute[75176]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 15:56:56 user nova-compute[75176]:       <source dev="/dev/sdb"/>
Nov 28 15:56:56 user nova-compute[75176]:       <target dev="vda" bus="virtio"/>
Nov 28 15:56:56 user nova-compute[75176]:       <serial>2389818d-1c3f-46d9-a70a-1330da1b94e0</serial>
Nov 28 15:56:56 user nova-compute[75176]:     </disk>
Nov 28 15:56:56 user nova-compute[75176]:     <interface type="ethernet">
Nov 28 15:56:56 user nova-compute[75176]:       <mac address="fa:16:3e:93:0e:39"/>
Nov 28 15:56:56 user nova-compute[75176]:       <model type="virtio"/>
Nov 28 15:56:56 user nova-compute[75176]:       <mtu size="1442"/>
Nov 28 15:56:56 user nova-compute[75176]:       <target dev="tap6c64d8cb-6e"/>
Nov 28 15:56:56 user nova-compute[75176]:     </interface>
Nov 28 15:56:56 user nova-compute[75176]:     <serial type="pty">
Nov 28 15:56:56 user nova-compute[75176]:       <log file="/opt/stack/data/nova/instances/525c3cc4-9cc4-470b-bf72-5e53d80cea6f/console.log" append="off"/>
Nov 28 15:56:56 user nova-compute[75176]:     </serial>
Nov 28 15:56:56 user nova-compute[75176]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 15:56:56 user nova-compute[75176]:     <video>
Nov 28 15:56:56 user nova-compute[75176]:       <model type="virtio"/>
Nov 28 15:56:56 user nova-compute[75176]:     </video>
Nov 28 15:56:56 user nova-compute[75176]:     <rng model="virtio">
Nov 28 15:56:56 user nova-compute[75176]:       <backend model="random">/dev/urandom</backend>
Nov 28 15:56:56 user nova-compute[75176]:     </rng>
Nov 28 15:56:56 user nova-compute[75176]:     <controller type="usb" index="0" model="none"/>
Nov 28 15:56:56 user nova-compute[75176]:     <memballoon model="virtio">
Nov 28 15:56:56 user nova-compute[75176]:       <stats period="10"/>
Nov 28 15:56:56 user nova-compute[75176]:     </memballoon>
Nov 28 15:56:56 user nova-compute[75176]:   </devices>
Nov 28 15:56:56 user nova-compute[75176]: </domain>
Nov 28 15:56:56 user nova-compute[75176]:  {{(pid=75176) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 15:56:56 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-c01f769f-6ac8-48ad-8f06-3ae915ad885c tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T15:56:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-367386830',display_name='tempest-TestVolumeBootPattern-server-367386830',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-367386830',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAT4j4MwMCXcgxPv2ypvh6Le18WUkR/7PQX0ERUSwv8uiHb35AkMlGdcRbKgULWyfAemfpuoTAyzTZycSyQIMMK+kqb2pUHOOT/5otX0G6BKfJMaYPfRy2E0NOlU0WUh/Q==',key_name='tempest-TestVolumeBootPattern-94664483',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='07c7783cc16049208421204910982c79',ramdisk_id='',reservation_id='r-mqqbey4c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1695196118',owner_user_name='tempest-TestVolumeBootPattern-1695196118-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T15:56:47Z,user_data=None,user_id='081bf84d24194b81be4e0a6638db9b66',uuid=525c3cc4-9cc4-470b-bf72-5e53d80cea6f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6c64d8cb-6ee1-4d8f-8898-3e70b5e17b9e", "address": "fa:16:3e:93:0e:39", "network": {"id": "5ec264ad-3459-468c-bdbf-c6a4ef016951", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1574289626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07c7783cc16049208421204910982c79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c64d8cb-6e", "ovs_interfaceid": "6c64d8cb-6ee1-4d8f-8898-3e70b5e17b9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 15:56:56 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-c01f769f-6ac8-48ad-8f06-3ae915ad885c tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Converting VIF {"id": "6c64d8cb-6ee1-4d8f-8898-3e70b5e17b9e", "address": "fa:16:3e:93:0e:39", "network": {"id": "5ec264ad-3459-468c-bdbf-c6a4ef016951", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1574289626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07c7783cc16049208421204910982c79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c64d8cb-6e", "ovs_interfaceid": "6c64d8cb-6ee1-4d8f-8898-3e70b5e17b9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:56:56 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-c01f769f-6ac8-48ad-8f06-3ae915ad885c tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:93:0e:39,bridge_name='br-int',has_traffic_filtering=True,id=6c64d8cb-6ee1-4d8f-8898-3e70b5e17b9e,network=Network(5ec264ad-3459-468c-bdbf-c6a4ef016951),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c64d8cb-6e') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:56:56 user nova-compute[75176]: DEBUG os_vif [None req-c01f769f-6ac8-48ad-8f06-3ae915ad885c tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:0e:39,bridge_name='br-int',has_traffic_filtering=True,id=6c64d8cb-6ee1-4d8f-8898-3e70b5e17b9e,network=Network(5ec264ad-3459-468c-bdbf-c6a4ef016951),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c64d8cb-6e') {{(pid=75176) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 15:56:56 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:56:56 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:56:56 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 15:56:56 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:56:56 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '85bd28da-6a27-5d68-8ad7-1e4801ae8934', '_type': 'linux-noop'}}, row=False) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:56:56 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:56:56 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:56:56 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:56:56 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6c64d8cb-6e, may_exist=True, interface_attrs={}) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:56:56 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6c64d8cb-6e, col_values=(('qos', UUID('6a7da5fe-7356-4b4a-86c9-67eee8450d26')),), if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:56:56 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6c64d8cb-6e, col_values=(('external_ids', {'iface-id': '6c64d8cb-6ee1-4d8f-8898-3e70b5e17b9e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:93:0e:39', 'vm-uuid': '525c3cc4-9cc4-470b-bf72-5e53d80cea6f'}),), if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:56:56 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:56:56 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:56:56 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:56:56 user nova-compute[75176]: INFO os_vif [None req-c01f769f-6ac8-48ad-8f06-3ae915ad885c tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:0e:39,bridge_name='br-int',has_traffic_filtering=True,id=6c64d8cb-6ee1-4d8f-8898-3e70b5e17b9e,network=Network(5ec264ad-3459-468c-bdbf-c6a4ef016951),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c64d8cb-6e')
Nov 28 15:56:56 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-c01f769f-6ac8-48ad-8f06-3ae915ad885c tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] No BDM found with device name vda, not building metadata. {{(pid=75176) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 15:56:56 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-c01f769f-6ac8-48ad-8f06-3ae915ad885c tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] No VIF found with MAC fa:16:3e:93:0e:39, not building metadata {{(pid=75176) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 15:56:57 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:56:57 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:56:57 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:56:57 user nova-compute[75176]: DEBUG nova.compute.manager [req-ab4968ee-a58b-4b46-bf00-af5fd6476096 req-42c4d152-ee24-46ce-803c-62f89c52dfeb service nova] [instance: 525c3cc4-9cc4-470b-bf72-5e53d80cea6f] Received event network-vif-plugged-6c64d8cb-6ee1-4d8f-8898-3e70b5e17b9e {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:56:57 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-ab4968ee-a58b-4b46-bf00-af5fd6476096 req-42c4d152-ee24-46ce-803c-62f89c52dfeb service nova] Acquiring lock "525c3cc4-9cc4-470b-bf72-5e53d80cea6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:56:57 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-ab4968ee-a58b-4b46-bf00-af5fd6476096 req-42c4d152-ee24-46ce-803c-62f89c52dfeb service nova] Lock "525c3cc4-9cc4-470b-bf72-5e53d80cea6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:56:57 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-ab4968ee-a58b-4b46-bf00-af5fd6476096 req-42c4d152-ee24-46ce-803c-62f89c52dfeb service nova] Lock "525c3cc4-9cc4-470b-bf72-5e53d80cea6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:56:57 user nova-compute[75176]: DEBUG nova.compute.manager [req-ab4968ee-a58b-4b46-bf00-af5fd6476096 req-42c4d152-ee24-46ce-803c-62f89c52dfeb service nova] [instance: 525c3cc4-9cc4-470b-bf72-5e53d80cea6f] No waiting events found dispatching network-vif-plugged-6c64d8cb-6ee1-4d8f-8898-3e70b5e17b9e {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:56:57 user nova-compute[75176]: WARNING nova.compute.manager [req-ab4968ee-a58b-4b46-bf00-af5fd6476096 req-42c4d152-ee24-46ce-803c-62f89c52dfeb service nova] [instance: 525c3cc4-9cc4-470b-bf72-5e53d80cea6f] Received unexpected event network-vif-plugged-6c64d8cb-6ee1-4d8f-8898-3e70b5e17b9e for instance with vm_state building and task_state spawning.
Nov 28 15:56:58 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:56:58 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:56:58 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:56:58 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:56:58 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:56:59 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:56:59 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:56:59 user nova-compute[75176]: DEBUG nova.compute.manager [None req-c01f769f-6ac8-48ad-8f06-3ae915ad885c tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: 525c3cc4-9cc4-470b-bf72-5e53d80cea6f] Instance event wait completed in 0 seconds for  {{(pid=75176) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 15:56:59 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-c01f769f-6ac8-48ad-8f06-3ae915ad885c tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: 525c3cc4-9cc4-470b-bf72-5e53d80cea6f] Guest created on hypervisor {{(pid=75176) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 15:56:59 user nova-compute[75176]: INFO nova.virt.libvirt.driver [-] [instance: 525c3cc4-9cc4-470b-bf72-5e53d80cea6f] Instance spawned successfully.
Nov 28 15:56:59 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-c01f769f-6ac8-48ad-8f06-3ae915ad885c tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: 525c3cc4-9cc4-470b-bf72-5e53d80cea6f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 15:56:59 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-c01f769f-6ac8-48ad-8f06-3ae915ad885c tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: 525c3cc4-9cc4-470b-bf72-5e53d80cea6f] Found default for hw_cdrom_bus of ide {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:56:59 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-c01f769f-6ac8-48ad-8f06-3ae915ad885c tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: 525c3cc4-9cc4-470b-bf72-5e53d80cea6f] Found default for hw_disk_bus of virtio {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:56:59 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-c01f769f-6ac8-48ad-8f06-3ae915ad885c tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: 525c3cc4-9cc4-470b-bf72-5e53d80cea6f] Found default for hw_input_bus of None {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:56:59 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-c01f769f-6ac8-48ad-8f06-3ae915ad885c tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: 525c3cc4-9cc4-470b-bf72-5e53d80cea6f] Found default for hw_pointer_model of None {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:56:59 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-c01f769f-6ac8-48ad-8f06-3ae915ad885c tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: 525c3cc4-9cc4-470b-bf72-5e53d80cea6f] Found default for hw_video_model of virtio {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:56:59 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-c01f769f-6ac8-48ad-8f06-3ae915ad885c tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: 525c3cc4-9cc4-470b-bf72-5e53d80cea6f] Found default for hw_vif_model of virtio {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:56:59 user nova-compute[75176]: INFO nova.compute.manager [None req-c01f769f-6ac8-48ad-8f06-3ae915ad885c tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: 525c3cc4-9cc4-470b-bf72-5e53d80cea6f] Took 5.13 seconds to spawn the instance on the hypervisor.
Nov 28 15:56:59 user nova-compute[75176]: DEBUG nova.compute.manager [None req-c01f769f-6ac8-48ad-8f06-3ae915ad885c tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: 525c3cc4-9cc4-470b-bf72-5e53d80cea6f] Checking state {{(pid=75176) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 15:56:59 user nova-compute[75176]: DEBUG nova.compute.manager [req-23eb0609-e645-4ff0-ba23-f887d1222cf3 req-49180f49-881c-49bd-8d8f-790b96a96564 service nova] [instance: 525c3cc4-9cc4-470b-bf72-5e53d80cea6f] Received event network-vif-plugged-6c64d8cb-6ee1-4d8f-8898-3e70b5e17b9e {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:56:59 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-23eb0609-e645-4ff0-ba23-f887d1222cf3 req-49180f49-881c-49bd-8d8f-790b96a96564 service nova] Acquiring lock "525c3cc4-9cc4-470b-bf72-5e53d80cea6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:56:59 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-23eb0609-e645-4ff0-ba23-f887d1222cf3 req-49180f49-881c-49bd-8d8f-790b96a96564 service nova] Lock "525c3cc4-9cc4-470b-bf72-5e53d80cea6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:56:59 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-23eb0609-e645-4ff0-ba23-f887d1222cf3 req-49180f49-881c-49bd-8d8f-790b96a96564 service nova] Lock "525c3cc4-9cc4-470b-bf72-5e53d80cea6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:56:59 user nova-compute[75176]: DEBUG nova.compute.manager [req-23eb0609-e645-4ff0-ba23-f887d1222cf3 req-49180f49-881c-49bd-8d8f-790b96a96564 service nova] [instance: 525c3cc4-9cc4-470b-bf72-5e53d80cea6f] No waiting events found dispatching network-vif-plugged-6c64d8cb-6ee1-4d8f-8898-3e70b5e17b9e {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:56:59 user nova-compute[75176]: WARNING nova.compute.manager [req-23eb0609-e645-4ff0-ba23-f887d1222cf3 req-49180f49-881c-49bd-8d8f-790b96a96564 service nova] [instance: 525c3cc4-9cc4-470b-bf72-5e53d80cea6f] Received unexpected event network-vif-plugged-6c64d8cb-6ee1-4d8f-8898-3e70b5e17b9e for instance with vm_state building and task_state spawning.
Nov 28 15:57:00 user nova-compute[75176]: INFO nova.compute.manager [None req-c01f769f-6ac8-48ad-8f06-3ae915ad885c tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: 525c3cc4-9cc4-470b-bf72-5e53d80cea6f] Took 13.92 seconds to build instance.
Nov 28 15:57:00 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-c01f769f-6ac8-48ad-8f06-3ae915ad885c tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Lock "525c3cc4-9cc4-470b-bf72-5e53d80cea6f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.011s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:57:00 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:57:01 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:57:03 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:57:03 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:57:03 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75176) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 15:57:04 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:57:05 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:57:05 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Starting heal instance info cache {{(pid=75176) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 15:57:05 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Didn't find any instances for network info cache update. {{(pid=75176) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 28 15:57:05 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:57:06 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:57:08 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:57:08 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:57:08 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:57:08 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:57:08 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Auditing locally available compute resources for user (node: user) {{(pid=75176) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 15:57:08 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55febf04-14ea-4903-8692-c7cc6115de75/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:57:09 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55febf04-14ea-4903-8692-c7cc6115de75/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:57:09 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55febf04-14ea-4903-8692-c7cc6115de75/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:57:09 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55febf04-14ea-4903-8692-c7cc6115de75/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:57:09 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ae602c1-2aed-41ea-9f4c-4f3ec4aab254/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:57:09 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ae602c1-2aed-41ea-9f4c-4f3ec4aab254/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:57:09 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ae602c1-2aed-41ea-9f4c-4f3ec4aab254/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:57:09 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:57:09 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ae602c1-2aed-41ea-9f4c-4f3ec4aab254/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:57:09 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e8507b7-fccf-4196-b589-bf2b74f165ec/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:57:09 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e8507b7-fccf-4196-b589-bf2b74f165ec/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:57:09 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e8507b7-fccf-4196-b589-bf2b74f165ec/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:57:10 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e8507b7-fccf-4196-b589-bf2b74f165ec/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:57:10 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecabea76-6c29-412d-bf77-989917b449a9/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:57:10 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecabea76-6c29-412d-bf77-989917b449a9/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:57:10 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecabea76-6c29-412d-bf77-989917b449a9/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:57:10 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecabea76-6c29-412d-bf77-989917b449a9/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:57:10 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0b7a064-03b6-4a0d-88be-2f12c12a1ddb/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:57:10 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0b7a064-03b6-4a0d-88be-2f12c12a1ddb/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:57:10 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0b7a064-03b6-4a0d-88be-2f12c12a1ddb/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:57:10 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0b7a064-03b6-4a0d-88be-2f12c12a1ddb/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:57:10 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75176) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 15:57:10 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75176) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 15:57:10 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66ead7d-98f4-4822-9dce-f2ea0206a58d/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:57:11 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66ead7d-98f4-4822-9dce-f2ea0206a58d/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:57:11 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66ead7d-98f4-4822-9dce-f2ea0206a58d/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:57:11 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66ead7d-98f4-4822-9dce-f2ea0206a58d/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:57:11 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7/disk.rescue --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:57:11 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:57:11 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7/disk.rescue --force-share --output=json" returned: 0 in 0.233s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:57:11 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7/disk.rescue --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:57:11 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:57:11 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:57:11 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:57:11 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:57:12 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:57:12 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75176) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 15:57:12 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 15:57:12 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 15:57:12 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Hypervisor/Node resource view: name=user free_ram=7623MB free_disk=24.876060485839844GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75176) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 15:57:12 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:57:12 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:57:12 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance 2e8507b7-fccf-4196-b589-bf2b74f165ec actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:57:12 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance f66ead7d-98f4-4822-9dce-f2ea0206a58d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:57:12 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance 55febf04-14ea-4903-8692-c7cc6115de75 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:57:12 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance 8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:57:12 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance dc4e6d39-adfb-4d26-afef-46f316ff7846 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:57:12 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance 6161cab2-eb1f-44cb-bbd5-077e6db42f77 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:57:12 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance ecabea76-6c29-412d-bf77-989917b449a9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:57:12 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance e0b7a064-03b6-4a0d-88be-2f12c12a1ddb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:57:12 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance 3ae602c1-2aed-41ea-9f4c-4f3ec4aab254 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:57:12 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance 525c3cc4-9cc4-470b-bf72-5e53d80cea6f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:57:12 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75176) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 15:57:12 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75176) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 15:57:12 user nova-compute[75176]: DEBUG nova.compute.provider_tree [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Inventory has not changed in ProviderTree for provider: b37848d8-f401-4155-a029-b0ffa09ff85b {{(pid=75176) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 15:57:12 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Inventory has not changed for provider b37848d8-f401-4155-a029-b0ffa09ff85b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75176) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 15:57:13 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Compute_service record updated for user:user {{(pid=75176) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 15:57:13 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.549s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:57:14 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:57:14 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-2bb06eaf-b3ce-4704-a1b8-0d6be011b1f9 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Acquiring lock "6161cab2-eb1f-44cb-bbd5-077e6db42f77" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:57:14 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-2bb06eaf-b3ce-4704-a1b8-0d6be011b1f9 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Lock "6161cab2-eb1f-44cb-bbd5-077e6db42f77" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:57:14 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-2bb06eaf-b3ce-4704-a1b8-0d6be011b1f9 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Acquiring lock "6161cab2-eb1f-44cb-bbd5-077e6db42f77-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:57:14 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-2bb06eaf-b3ce-4704-a1b8-0d6be011b1f9 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Lock "6161cab2-eb1f-44cb-bbd5-077e6db42f77-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:57:14 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-2bb06eaf-b3ce-4704-a1b8-0d6be011b1f9 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Lock "6161cab2-eb1f-44cb-bbd5-077e6db42f77-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:57:14 user nova-compute[75176]: INFO nova.compute.manager [None req-2bb06eaf-b3ce-4704-a1b8-0d6be011b1f9 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] [instance: 6161cab2-eb1f-44cb-bbd5-077e6db42f77] Terminating instance
Nov 28 15:57:14 user nova-compute[75176]: DEBUG nova.compute.manager [None req-2bb06eaf-b3ce-4704-a1b8-0d6be011b1f9 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] [instance: 6161cab2-eb1f-44cb-bbd5-077e6db42f77] Start destroying the instance on the hypervisor. {{(pid=75176) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 15:57:15 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:57:15 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:57:15 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:57:15 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:57:15 user nova-compute[75176]: DEBUG nova.compute.manager [req-914fcc54-4353-4f73-b310-827655139145 req-c6e2629a-a73d-452c-9949-955fe5ec1131 service nova] [instance: 6161cab2-eb1f-44cb-bbd5-077e6db42f77] Received event network-vif-unplugged-f2811544-4cf2-4302-b012-8bf1881b9b6c {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:57:15 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-914fcc54-4353-4f73-b310-827655139145 req-c6e2629a-a73d-452c-9949-955fe5ec1131 service nova] Acquiring lock "6161cab2-eb1f-44cb-bbd5-077e6db42f77-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:57:15 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-914fcc54-4353-4f73-b310-827655139145 req-c6e2629a-a73d-452c-9949-955fe5ec1131 service nova] Lock "6161cab2-eb1f-44cb-bbd5-077e6db42f77-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:57:15 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-914fcc54-4353-4f73-b310-827655139145 req-c6e2629a-a73d-452c-9949-955fe5ec1131 service nova] Lock "6161cab2-eb1f-44cb-bbd5-077e6db42f77-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:57:15 user nova-compute[75176]: DEBUG nova.compute.manager [req-914fcc54-4353-4f73-b310-827655139145 req-c6e2629a-a73d-452c-9949-955fe5ec1131 service nova] [instance: 6161cab2-eb1f-44cb-bbd5-077e6db42f77] No waiting events found dispatching network-vif-unplugged-f2811544-4cf2-4302-b012-8bf1881b9b6c {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:57:15 user nova-compute[75176]: DEBUG nova.compute.manager [req-914fcc54-4353-4f73-b310-827655139145 req-c6e2629a-a73d-452c-9949-955fe5ec1131 service nova] [instance: 6161cab2-eb1f-44cb-bbd5-077e6db42f77] Received event network-vif-unplugged-f2811544-4cf2-4302-b012-8bf1881b9b6c for instance with task_state deleting. {{(pid=75176) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 15:57:15 user nova-compute[75176]: INFO nova.virt.libvirt.driver [-] [instance: 6161cab2-eb1f-44cb-bbd5-077e6db42f77] Instance destroyed successfully.
Nov 28 15:57:15 user nova-compute[75176]: DEBUG nova.objects.instance [None req-2bb06eaf-b3ce-4704-a1b8-0d6be011b1f9 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Lazy-loading 'resources' on Instance uuid 6161cab2-eb1f-44cb-bbd5-077e6db42f77 {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:57:15 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-2bb06eaf-b3ce-4704-a1b8-0d6be011b1f9 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T15:50:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-572538979',display_name='tempest-ServerActionsTestOtherA-server-572538979',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-572538979',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOMWl0O1/eKbWND/zyjGraAKxeAyZ2R2+QgHiQ80zmzsi5uDkOgtIp8e2HjbFwlKUWmHgZppW6LnrIueD7TS7l/EkNAyCl7Y/pD0TSC3H7ZDLxYbZaFDAxH/uT7EnME+ig==',key_name='tempest-keypair-740685341',keypairs=<?>,launch_index=0,launched_at=2023-11-28T15:52:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3704b38a2bd44cb78c28d3f6d86d9e60',ramdisk_id='',reservation_id='r-s3c8yj7d',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-680502445',owner_user_name='tempest-ServerActionsTestOtherA-680502445-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T15:54:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d028b79a105b485dbb0178c9da162640',uuid=6161cab2-eb1f-44cb-bbd5-077e6db42f77,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f2811544-4cf2-4302-b012-8bf1881b9b6c", "address": "fa:16:3e:2a:df:42", "network": {"id": "8b63f2d3-0683-4832-abc5-e4c796cf12ab", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-877608435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3704b38a2bd44cb78c28d3f6d86d9e60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2811544-4c", "ovs_interfaceid": "f2811544-4cf2-4302-b012-8bf1881b9b6c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 15:57:15 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-2bb06eaf-b3ce-4704-a1b8-0d6be011b1f9 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Converting VIF {"id": "f2811544-4cf2-4302-b012-8bf1881b9b6c", "address": "fa:16:3e:2a:df:42", "network": {"id": "8b63f2d3-0683-4832-abc5-e4c796cf12ab", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-877608435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3704b38a2bd44cb78c28d3f6d86d9e60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2811544-4c", "ovs_interfaceid": "f2811544-4cf2-4302-b012-8bf1881b9b6c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:57:15 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-2bb06eaf-b3ce-4704-a1b8-0d6be011b1f9 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2a:df:42,bridge_name='br-int',has_traffic_filtering=True,id=f2811544-4cf2-4302-b012-8bf1881b9b6c,network=Network(8b63f2d3-0683-4832-abc5-e4c796cf12ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2811544-4c') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:57:15 user nova-compute[75176]: DEBUG os_vif [None req-2bb06eaf-b3ce-4704-a1b8-0d6be011b1f9 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2a:df:42,bridge_name='br-int',has_traffic_filtering=True,id=f2811544-4cf2-4302-b012-8bf1881b9b6c,network=Network(8b63f2d3-0683-4832-abc5-e4c796cf12ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2811544-4c') {{(pid=75176) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 15:57:15 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:57:15 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf2811544-4c, bridge=br-int, if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:57:15 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:57:15 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:57:15 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:57:15 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=70202cbb-ad90-469b-9b6a-97de42634b0d) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:57:15 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:57:15 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:57:15 user nova-compute[75176]: INFO os_vif [None req-2bb06eaf-b3ce-4704-a1b8-0d6be011b1f9 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2a:df:42,bridge_name='br-int',has_traffic_filtering=True,id=f2811544-4cf2-4302-b012-8bf1881b9b6c,network=Network(8b63f2d3-0683-4832-abc5-e4c796cf12ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2811544-4c')
Nov 28 15:57:15 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2bb06eaf-b3ce-4704-a1b8-0d6be011b1f9 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] [instance: 6161cab2-eb1f-44cb-bbd5-077e6db42f77] calling os-brick to detach iSCSI Volume {{(pid=75176) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 15:57:15 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bb06eaf-b3ce-4704-a1b8-0d6be011b1f9 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c1b8a00>, {'target_iqn': 'iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zMZSixul', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 15:57:15 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-2bb06eaf-b3ce-4704-a1b8-0d6be011b1f9 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 15:57:15 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-2bb06eaf-b3ce-4704-a1b8-0d6be011b1f9 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 15:57:15 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-2bb06eaf-b3ce-4704-a1b8-0d6be011b1f9 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 15:57:15 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:57:15 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:57:15 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e0520fa-2313-41d9-86d0-dff5e3198d8a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:57:15 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bb06eaf-b3ce-4704-a1b8-0d6be011b1f9 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 15:57:15 user nova-compute[75176]: No targets found.
Nov 28 15:57:15 user nova-compute[75176]: iSNS:
Nov 28 15:57:15 user nova-compute[75176]: No targets found.
Nov 28 15:57:15 user nova-compute[75176]: STATIC:
Nov 28 15:57:15 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0
Nov 28 15:57:15 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:57:15 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:57:15 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6
Nov 28 15:57:15 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:57:15 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:57:15 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc
Nov 28 15:57:15 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:57:15 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:57:15 user nova-compute[75176]: FIRMWARE:
Nov 28 15:57:15 user nova-compute[75176]: No targets found.
Nov 28 15:57:15 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:57:15 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bb06eaf-b3ce-4704-a1b8-0d6be011b1f9 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 15:57:15 user nova-compute[75176]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 15:57:15 user nova-compute[75176]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75176) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 15:57:15 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bb06eaf-b3ce-4704-a1b8-0d6be011b1f9 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc', 0)] {{(pid=75176) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 15:57:15 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:57:15 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:57:15 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[a018ca5c-71d9-4b3b-b0d4-1422dcf0a14b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:57:15 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:57:15 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:57:15 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eb94fcd-79df-4468-9fe5-5d5418f3e917]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0 (non-flash)\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:57:15 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bb06eaf-b3ce-4704-a1b8-0d6be011b1f9 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 (non-flash)
Nov 28 15:57:15 user nova-compute[75176]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc (non-flash)
Nov 28 15:57:15 user nova-compute[75176]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0 (non-flash)
Nov 28 15:57:15 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:57:15 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bb06eaf-b3ce-4704-a1b8-0d6be011b1f9 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 (non-flash)
Nov 28 15:57:15 user nova-compute[75176]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc (non-flash)
Nov 28 15:57:15 user nova-compute[75176]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0 (non-flash)
Nov 28 15:57:15 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 15:57:15 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bb06eaf-b3ce-4704-a1b8-0d6be011b1f9 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f462c5979a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc'): ({'sde'}, set())}) {{(pid=75176) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 15:57:15 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-2bb06eaf-b3ce-4704-a1b8-0d6be011b1f9 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Removing single pathed devices sde {{(pid=75176) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 15:57:15 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:57:15 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:57:15 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff24196e-07a9-4af1-b36a-ba73328589da]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:57:15 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:57:15 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:57:15 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e795232-6f15-4f96-8009-33a6da7e8fb8]: (4, ('ok\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:57:15 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-2bb06eaf-b3ce-4704-a1b8-0d6be011b1f9 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Flushing IO for device /dev/sde {{(pid=75176) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 15:57:15 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:57:15 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.017s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:57:15 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3388ea3-ccc2-4930-a8ff-d3849dc8445f]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:57:15 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-2bb06eaf-b3ce-4704-a1b8-0d6be011b1f9 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75176) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 15:57:15 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:57:15 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.050s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:57:15 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[bad4e5d1-83d8-40c4-90d4-c2d388ea6fba]: (4, ('1', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:57:15 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-2bb06eaf-b3ce-4704-a1b8-0d6be011b1f9 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75176) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 15:57:15 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-2bb06eaf-b3ce-4704-a1b8-0d6be011b1f9 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] SCSI volumes sde have been removed. {{(pid=75176) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 15:57:15 user nova-compute[75176]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO8903fc9b-28fbbc77aac0ae57', '/dev/disk/by-id/scsi-23238666262633737', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_8903fc9b') {{(pid=85736) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 28 15:57:15 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[c59b5781-eee5-4471-8199-0cd64e821cec]: (4, None) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:57:15 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bb06eaf-b3ce-4704-a1b8-0d6be011b1f9 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc')] {{(pid=75176) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 15:57:15 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:57:15 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:57:15 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[acb94945-7db2-4569-8bbe-226243a85587]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:57:15 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bb06eaf-b3ce-4704-a1b8-0d6be011b1f9 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:57:15 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc -p 172.16.0.220:3260 --logout {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:57:16 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:57:16 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[473bd2e4-4db9-4b13-a6ce-2f3cca98243f]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:57:16 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bb06eaf-b3ce-4704-a1b8-0d6be011b1f9 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc, portal: 172.16.0.220,3260]
Nov 28 15:57:16 user nova-compute[75176]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc, portal: 172.16.0.220,3260] successful.
Nov 28 15:57:16 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:57:16 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc -p 172.16.0.220:3260 --op delete {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:57:16 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3e5eacd-1738-4959-be40-6d99da8776fc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:57:16 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d04a7d7-2c70-456c-9190-5dca4e6bd8b2]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:57:16 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bb06eaf-b3ce-4704-a1b8-0d6be011b1f9 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:57:16 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-2bb06eaf-b3ce-4704-a1b8-0d6be011b1f9 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.330s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 15:57:16 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bb06eaf-b3ce-4704-a1b8-0d6be011b1f9 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] <== disconnect_volume: return (331ms) None {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 15:57:16 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2bb06eaf-b3ce-4704-a1b8-0d6be011b1f9 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] [instance: 6161cab2-eb1f-44cb-bbd5-077e6db42f77] Disconnected iSCSI Volume {{(pid=75176) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 15:57:16 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-2bb06eaf-b3ce-4704-a1b8-0d6be011b1f9 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] [instance: 6161cab2-eb1f-44cb-bbd5-077e6db42f77] Deleting instance files /opt/stack/data/nova/instances/6161cab2-eb1f-44cb-bbd5-077e6db42f77_del
Nov 28 15:57:16 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-2bb06eaf-b3ce-4704-a1b8-0d6be011b1f9 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] [instance: 6161cab2-eb1f-44cb-bbd5-077e6db42f77] Deletion of /opt/stack/data/nova/instances/6161cab2-eb1f-44cb-bbd5-077e6db42f77_del complete
Nov 28 15:57:16 user nova-compute[75176]: INFO nova.compute.manager [None req-2bb06eaf-b3ce-4704-a1b8-0d6be011b1f9 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] [instance: 6161cab2-eb1f-44cb-bbd5-077e6db42f77] Took 1.21 seconds to destroy the instance on the hypervisor.
Nov 28 15:57:16 user nova-compute[75176]: DEBUG oslo.service.loopingcall [None req-2bb06eaf-b3ce-4704-a1b8-0d6be011b1f9 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75176) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 15:57:16 user nova-compute[75176]: DEBUG nova.compute.manager [-] [instance: 6161cab2-eb1f-44cb-bbd5-077e6db42f77] Deallocating network for instance {{(pid=75176) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 15:57:16 user nova-compute[75176]: DEBUG nova.network.neutron [-] [instance: 6161cab2-eb1f-44cb-bbd5-077e6db42f77] deallocate_for_instance() {{(pid=75176) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 15:57:16 user nova-compute[75176]: DEBUG nova.network.neutron [-] [instance: 6161cab2-eb1f-44cb-bbd5-077e6db42f77] Updating instance_info_cache with network_info: [] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:57:16 user nova-compute[75176]: INFO nova.compute.manager [-] [instance: 6161cab2-eb1f-44cb-bbd5-077e6db42f77] Took 0.82 seconds to deallocate network for instance.
Nov 28 15:57:16 user nova-compute[75176]: DEBUG nova.compute.manager [req-9b658344-bafc-4817-9890-51fde2bb6c3c req-fd4922aa-b475-4874-a0b3-386f672e3475 service nova] [instance: 6161cab2-eb1f-44cb-bbd5-077e6db42f77] Received event network-vif-deleted-f2811544-4cf2-4302-b012-8bf1881b9b6c {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:57:17 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:57:17 user nova-compute[75176]: DEBUG nova.compute.manager [req-5526a648-22fb-474e-9355-90e646df2aca req-83b832de-230e-42a6-acdb-50f0f657068b service nova] [instance: 6161cab2-eb1f-44cb-bbd5-077e6db42f77] Received event network-vif-plugged-f2811544-4cf2-4302-b012-8bf1881b9b6c {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:57:17 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-5526a648-22fb-474e-9355-90e646df2aca req-83b832de-230e-42a6-acdb-50f0f657068b service nova] Acquiring lock "6161cab2-eb1f-44cb-bbd5-077e6db42f77-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:57:17 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-5526a648-22fb-474e-9355-90e646df2aca req-83b832de-230e-42a6-acdb-50f0f657068b service nova] Lock "6161cab2-eb1f-44cb-bbd5-077e6db42f77-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:57:17 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-5526a648-22fb-474e-9355-90e646df2aca req-83b832de-230e-42a6-acdb-50f0f657068b service nova] Lock "6161cab2-eb1f-44cb-bbd5-077e6db42f77-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:57:17 user nova-compute[75176]: DEBUG nova.compute.manager [req-5526a648-22fb-474e-9355-90e646df2aca req-83b832de-230e-42a6-acdb-50f0f657068b service nova] [instance: 6161cab2-eb1f-44cb-bbd5-077e6db42f77] No waiting events found dispatching network-vif-plugged-f2811544-4cf2-4302-b012-8bf1881b9b6c {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:57:17 user nova-compute[75176]: WARNING nova.compute.manager [req-5526a648-22fb-474e-9355-90e646df2aca req-83b832de-230e-42a6-acdb-50f0f657068b service nova] [instance: 6161cab2-eb1f-44cb-bbd5-077e6db42f77] Received unexpected event network-vif-plugged-f2811544-4cf2-4302-b012-8bf1881b9b6c for instance with vm_state active and task_state deleting.
Nov 28 15:57:17 user nova-compute[75176]: INFO nova.compute.manager [None req-2bb06eaf-b3ce-4704-a1b8-0d6be011b1f9 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] [instance: 6161cab2-eb1f-44cb-bbd5-077e6db42f77] Took 0.82 seconds to detach 1 volumes for instance.
Nov 28 15:57:17 user nova-compute[75176]: DEBUG nova.compute.manager [None req-2bb06eaf-b3ce-4704-a1b8-0d6be011b1f9 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] [instance: 6161cab2-eb1f-44cb-bbd5-077e6db42f77] Deleting volume: d3e5eacd-1738-4959-be40-6d99da8776fc {{(pid=75176) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 28 15:57:17 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-2bb06eaf-b3ce-4704-a1b8-0d6be011b1f9 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:57:17 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-2bb06eaf-b3ce-4704-a1b8-0d6be011b1f9 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:57:18 user nova-compute[75176]: DEBUG nova.compute.provider_tree [None req-2bb06eaf-b3ce-4704-a1b8-0d6be011b1f9 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Inventory has not changed in ProviderTree for provider: b37848d8-f401-4155-a029-b0ffa09ff85b {{(pid=75176) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 15:57:18 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-2bb06eaf-b3ce-4704-a1b8-0d6be011b1f9 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Inventory has not changed for provider b37848d8-f401-4155-a029-b0ffa09ff85b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75176) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 15:57:18 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-2bb06eaf-b3ce-4704-a1b8-0d6be011b1f9 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.394s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:57:18 user nova-compute[75176]: INFO nova.scheduler.client.report [None req-2bb06eaf-b3ce-4704-a1b8-0d6be011b1f9 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Deleted allocations for instance 6161cab2-eb1f-44cb-bbd5-077e6db42f77
Nov 28 15:57:18 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-2bb06eaf-b3ce-4704-a1b8-0d6be011b1f9 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Lock "6161cab2-eb1f-44cb-bbd5-077e6db42f77" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.516s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:57:19 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:57:20 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:57:24 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:57:25 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:57:28 user nova-compute[75176]: DEBUG nova.compute.manager [req-500ece6b-edb8-474a-929f-d62e888ce498 req-a1b8c3dd-6c7a-4576-927c-c158ae360420 service nova] [instance: e0b7a064-03b6-4a0d-88be-2f12c12a1ddb] Received event network-changed-76c02515-a349-4b46-939a-cf520b5f3b33 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:57:28 user nova-compute[75176]: DEBUG nova.compute.manager [req-500ece6b-edb8-474a-929f-d62e888ce498 req-a1b8c3dd-6c7a-4576-927c-c158ae360420 service nova] [instance: e0b7a064-03b6-4a0d-88be-2f12c12a1ddb] Refreshing instance network info cache due to event network-changed-76c02515-a349-4b46-939a-cf520b5f3b33. {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 15:57:28 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-500ece6b-edb8-474a-929f-d62e888ce498 req-a1b8c3dd-6c7a-4576-927c-c158ae360420 service nova] Acquiring lock "refresh_cache-e0b7a064-03b6-4a0d-88be-2f12c12a1ddb" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:57:28 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-500ece6b-edb8-474a-929f-d62e888ce498 req-a1b8c3dd-6c7a-4576-927c-c158ae360420 service nova] Acquired lock "refresh_cache-e0b7a064-03b6-4a0d-88be-2f12c12a1ddb" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:57:28 user nova-compute[75176]: DEBUG nova.network.neutron [req-500ece6b-edb8-474a-929f-d62e888ce498 req-a1b8c3dd-6c7a-4576-927c-c158ae360420 service nova] [instance: e0b7a064-03b6-4a0d-88be-2f12c12a1ddb] Refreshing network info cache for port 76c02515-a349-4b46-939a-cf520b5f3b33 {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 15:57:28 user nova-compute[75176]: DEBUG nova.network.neutron [req-500ece6b-edb8-474a-929f-d62e888ce498 req-a1b8c3dd-6c7a-4576-927c-c158ae360420 service nova] [instance: e0b7a064-03b6-4a0d-88be-2f12c12a1ddb] Updated VIF entry in instance network info cache for port 76c02515-a349-4b46-939a-cf520b5f3b33. {{(pid=75176) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 15:57:28 user nova-compute[75176]: DEBUG nova.network.neutron [req-500ece6b-edb8-474a-929f-d62e888ce498 req-a1b8c3dd-6c7a-4576-927c-c158ae360420 service nova] [instance: e0b7a064-03b6-4a0d-88be-2f12c12a1ddb] Updating instance_info_cache with network_info: [{"id": "76c02515-a349-4b46-939a-cf520b5f3b33", "address": "fa:16:3e:92:22:dd", "network": {"id": "459cb688-3ab2-41c9-8b98-296b629e36b6", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1294058889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16cf33057bf84d25bae4a90b74bd7754", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76c02515-a3", "ovs_interfaceid": "76c02515-a349-4b46-939a-cf520b5f3b33", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:57:28 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-500ece6b-edb8-474a-929f-d62e888ce498 req-a1b8c3dd-6c7a-4576-927c-c158ae360420 service nova] Releasing lock "refresh_cache-e0b7a064-03b6-4a0d-88be-2f12c12a1ddb" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:57:29 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:57:30 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-3a4af14c-080e-433b-b608-c23b08e18b52 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Acquiring lock "ecf38787-0a69-4f35-b121-3dc6e70023a1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:57:30 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-3a4af14c-080e-433b-b608-c23b08e18b52 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Lock "ecf38787-0a69-4f35-b121-3dc6e70023a1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:57:30 user nova-compute[75176]: DEBUG nova.compute.manager [None req-3a4af14c-080e-433b-b608-c23b08e18b52 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: ecf38787-0a69-4f35-b121-3dc6e70023a1] Starting instance... {{(pid=75176) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 15:57:30 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-3a4af14c-080e-433b-b608-c23b08e18b52 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:57:30 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-3a4af14c-080e-433b-b608-c23b08e18b52 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:57:30 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-3a4af14c-080e-433b-b608-c23b08e18b52 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75176) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 15:57:30 user nova-compute[75176]: INFO nova.compute.claims [None req-3a4af14c-080e-433b-b608-c23b08e18b52 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: ecf38787-0a69-4f35-b121-3dc6e70023a1] Claim successful on node user
Nov 28 15:57:30 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:57:30 user nova-compute[75176]: DEBUG nova.compute.provider_tree [None req-3a4af14c-080e-433b-b608-c23b08e18b52 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Inventory has not changed in ProviderTree for provider: b37848d8-f401-4155-a029-b0ffa09ff85b {{(pid=75176) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 15:57:30 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-3a4af14c-080e-433b-b608-c23b08e18b52 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Inventory has not changed for provider b37848d8-f401-4155-a029-b0ffa09ff85b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75176) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 15:57:31 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-3a4af14c-080e-433b-b608-c23b08e18b52 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.621s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:57:31 user nova-compute[75176]: DEBUG nova.compute.manager [None req-3a4af14c-080e-433b-b608-c23b08e18b52 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: ecf38787-0a69-4f35-b121-3dc6e70023a1] Start building networks asynchronously for instance. {{(pid=75176) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 15:57:31 user nova-compute[75176]: DEBUG nova.compute.manager [None req-3a4af14c-080e-433b-b608-c23b08e18b52 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: ecf38787-0a69-4f35-b121-3dc6e70023a1] Allocating IP information in the background. {{(pid=75176) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 15:57:31 user nova-compute[75176]: DEBUG nova.network.neutron [None req-3a4af14c-080e-433b-b608-c23b08e18b52 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: ecf38787-0a69-4f35-b121-3dc6e70023a1] allocate_for_instance() {{(pid=75176) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 15:57:31 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-3a4af14c-080e-433b-b608-c23b08e18b52 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: ecf38787-0a69-4f35-b121-3dc6e70023a1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 15:57:31 user nova-compute[75176]: DEBUG nova.compute.manager [None req-3a4af14c-080e-433b-b608-c23b08e18b52 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: ecf38787-0a69-4f35-b121-3dc6e70023a1] Start building block device mappings for instance. {{(pid=75176) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 15:57:31 user nova-compute[75176]: DEBUG nova.policy [None req-3a4af14c-080e-433b-b608-c23b08e18b52 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f24cedac95a44bb5a9ee54cc4713945c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf05c8836b8a40de8e64c2d046ed71ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75176) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 15:57:31 user nova-compute[75176]: DEBUG nova.compute.manager [None req-3a4af14c-080e-433b-b608-c23b08e18b52 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: ecf38787-0a69-4f35-b121-3dc6e70023a1] Start spawning the instance on the hypervisor. {{(pid=75176) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 15:57:31 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-3a4af14c-080e-433b-b608-c23b08e18b52 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: ecf38787-0a69-4f35-b121-3dc6e70023a1] Creating instance directory {{(pid=75176) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 15:57:31 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-3a4af14c-080e-433b-b608-c23b08e18b52 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: ecf38787-0a69-4f35-b121-3dc6e70023a1] Creating image(s)
Nov 28 15:57:31 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-3a4af14c-080e-433b-b608-c23b08e18b52 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Acquiring lock "/opt/stack/data/nova/instances/ecf38787-0a69-4f35-b121-3dc6e70023a1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:57:31 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-3a4af14c-080e-433b-b608-c23b08e18b52 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Lock "/opt/stack/data/nova/instances/ecf38787-0a69-4f35-b121-3dc6e70023a1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:57:31 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-3a4af14c-080e-433b-b608-c23b08e18b52 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Lock "/opt/stack/data/nova/instances/ecf38787-0a69-4f35-b121-3dc6e70023a1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:57:31 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-3a4af14c-080e-433b-b608-c23b08e18b52 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:57:31 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-3a4af14c-080e-433b-b608-c23b08e18b52 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json" returned: 0 in 0.246s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:57:31 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-3a4af14c-080e-433b-b608-c23b08e18b52 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Acquiring lock "5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:57:31 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-3a4af14c-080e-433b-b608-c23b08e18b52 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Lock "5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:57:31 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-3a4af14c-080e-433b-b608-c23b08e18b52 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:57:31 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-3a4af14c-080e-433b-b608-c23b08e18b52 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json" returned: 0 in 0.213s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:57:31 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-3a4af14c-080e-433b-b608-c23b08e18b52 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2,backing_fmt=raw /opt/stack/data/nova/instances/ecf38787-0a69-4f35-b121-3dc6e70023a1/disk 1073741824 {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:57:32 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-3a4af14c-080e-433b-b608-c23b08e18b52 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2,backing_fmt=raw /opt/stack/data/nova/instances/ecf38787-0a69-4f35-b121-3dc6e70023a1/disk 1073741824" returned: 0 in 0.087s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:57:32 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-3a4af14c-080e-433b-b608-c23b08e18b52 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Lock "5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.309s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:57:32 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-3a4af14c-080e-433b-b608-c23b08e18b52 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:57:32 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-3a4af14c-080e-433b-b608-c23b08e18b52 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json" returned: 0 in 0.225s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:57:32 user nova-compute[75176]: DEBUG nova.virt.disk.api [None req-3a4af14c-080e-433b-b608-c23b08e18b52 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ecf38787-0a69-4f35-b121-3dc6e70023a1/disk. size=1073741824 {{(pid=75176) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 15:57:32 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-3a4af14c-080e-433b-b608-c23b08e18b52 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecf38787-0a69-4f35-b121-3dc6e70023a1/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:57:32 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-3a4af14c-080e-433b-b608-c23b08e18b52 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecf38787-0a69-4f35-b121-3dc6e70023a1/disk --force-share --output=json" returned: 0 in 0.274s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:57:32 user nova-compute[75176]: DEBUG nova.virt.disk.api [None req-3a4af14c-080e-433b-b608-c23b08e18b52 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Cannot resize image /opt/stack/data/nova/instances/ecf38787-0a69-4f35-b121-3dc6e70023a1/disk to a smaller size. {{(pid=75176) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 15:57:32 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-3a4af14c-080e-433b-b608-c23b08e18b52 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: ecf38787-0a69-4f35-b121-3dc6e70023a1] Created local disks {{(pid=75176) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 15:57:32 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-3a4af14c-080e-433b-b608-c23b08e18b52 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: ecf38787-0a69-4f35-b121-3dc6e70023a1] Ensure instance console log exists: /opt/stack/data/nova/instances/ecf38787-0a69-4f35-b121-3dc6e70023a1/console.log {{(pid=75176) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 15:57:32 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-3a4af14c-080e-433b-b608-c23b08e18b52 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:57:32 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-3a4af14c-080e-433b-b608-c23b08e18b52 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.003s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:57:32 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-3a4af14c-080e-433b-b608-c23b08e18b52 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:57:32 user nova-compute[75176]: DEBUG nova.network.neutron [None req-3a4af14c-080e-433b-b608-c23b08e18b52 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: ecf38787-0a69-4f35-b121-3dc6e70023a1] Successfully created port: 29444d70-7dc7-4e88-9856-cab5ebd77464 {{(pid=75176) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 15:57:33 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-e00de3ee-776e-4720-abf7-85b4585913ec tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Acquiring lock "726344c0-a0dc-48d5-a18f-8a258ebde87d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:57:33 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-e00de3ee-776e-4720-abf7-85b4585913ec tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Lock "726344c0-a0dc-48d5-a18f-8a258ebde87d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:57:33 user nova-compute[75176]: DEBUG nova.compute.manager [None req-e00de3ee-776e-4720-abf7-85b4585913ec tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] [instance: 726344c0-a0dc-48d5-a18f-8a258ebde87d] Starting instance... {{(pid=75176) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 15:57:33 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-4a2cf0c2-d8d0-4bc1-9b70-ccb3c2345aeb tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Acquiring lock "e0b7a064-03b6-4a0d-88be-2f12c12a1ddb" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:57:33 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-4a2cf0c2-d8d0-4bc1-9b70-ccb3c2345aeb tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Lock "e0b7a064-03b6-4a0d-88be-2f12c12a1ddb" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:57:33 user nova-compute[75176]: DEBUG nova.objects.instance [None req-4a2cf0c2-d8d0-4bc1-9b70-ccb3c2345aeb tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Lazy-loading 'flavor' on Instance uuid e0b7a064-03b6-4a0d-88be-2f12c12a1ddb {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:57:33 user nova-compute[75176]: DEBUG nova.network.neutron [None req-3a4af14c-080e-433b-b608-c23b08e18b52 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: ecf38787-0a69-4f35-b121-3dc6e70023a1] Successfully updated port: 29444d70-7dc7-4e88-9856-cab5ebd77464 {{(pid=75176) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 15:57:33 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-3a4af14c-080e-433b-b608-c23b08e18b52 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Acquiring lock "refresh_cache-ecf38787-0a69-4f35-b121-3dc6e70023a1" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:57:33 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-3a4af14c-080e-433b-b608-c23b08e18b52 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Acquired lock "refresh_cache-ecf38787-0a69-4f35-b121-3dc6e70023a1" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:57:33 user nova-compute[75176]: DEBUG nova.network.neutron [None req-3a4af14c-080e-433b-b608-c23b08e18b52 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: ecf38787-0a69-4f35-b121-3dc6e70023a1] Building network info cache for instance {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 15:57:33 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-4a2cf0c2-d8d0-4bc1-9b70-ccb3c2345aeb tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Lock "e0b7a064-03b6-4a0d-88be-2f12c12a1ddb" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.094s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:57:33 user nova-compute[75176]: DEBUG nova.compute.manager [req-e201e372-c7b4-4062-a436-fe33ccad369d req-4b75311e-5eec-485a-9589-9126e143a92c service nova] [instance: ecf38787-0a69-4f35-b121-3dc6e70023a1] Received event network-changed-29444d70-7dc7-4e88-9856-cab5ebd77464 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:57:33 user nova-compute[75176]: DEBUG nova.compute.manager [req-e201e372-c7b4-4062-a436-fe33ccad369d req-4b75311e-5eec-485a-9589-9126e143a92c service nova] [instance: ecf38787-0a69-4f35-b121-3dc6e70023a1] Refreshing instance network info cache due to event network-changed-29444d70-7dc7-4e88-9856-cab5ebd77464. {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 15:57:33 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-e201e372-c7b4-4062-a436-fe33ccad369d req-4b75311e-5eec-485a-9589-9126e143a92c service nova] Acquiring lock "refresh_cache-ecf38787-0a69-4f35-b121-3dc6e70023a1" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:57:33 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-e00de3ee-776e-4720-abf7-85b4585913ec tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:57:33 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-e00de3ee-776e-4720-abf7-85b4585913ec tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:57:33 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-e00de3ee-776e-4720-abf7-85b4585913ec tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75176) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 15:57:33 user nova-compute[75176]: INFO nova.compute.claims [None req-e00de3ee-776e-4720-abf7-85b4585913ec tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] [instance: 726344c0-a0dc-48d5-a18f-8a258ebde87d] Claim successful on node user
Nov 28 15:57:33 user nova-compute[75176]: DEBUG nova.network.neutron [None req-3a4af14c-080e-433b-b608-c23b08e18b52 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: ecf38787-0a69-4f35-b121-3dc6e70023a1] Instance cache missing network info. {{(pid=75176) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 15:57:33 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-4a2cf0c2-d8d0-4bc1-9b70-ccb3c2345aeb tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Acquiring lock "e0b7a064-03b6-4a0d-88be-2f12c12a1ddb" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:57:33 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-4a2cf0c2-d8d0-4bc1-9b70-ccb3c2345aeb tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Lock "e0b7a064-03b6-4a0d-88be-2f12c12a1ddb" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:57:33 user nova-compute[75176]: INFO nova.compute.manager [None req-4a2cf0c2-d8d0-4bc1-9b70-ccb3c2345aeb tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] [instance: e0b7a064-03b6-4a0d-88be-2f12c12a1ddb] Attaching volume 0e035375-c026-46d7-ab68-37b8b17529e5 to /dev/vdb
Nov 28 15:57:33 user nova-compute[75176]: DEBUG os_brick.utils [None req-4a2cf0c2-d8d0-4bc1-9b70-ccb3c2345aeb tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 15:57:33 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:57:33 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:57:33 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[204ba9a3-47cc-4138-9b7b-81b187d77c89]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:edc924a949b2\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:57:33 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:57:33 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:57:33 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[490aba0a-843e-45ee-a1df-d4ddf7dbfd22]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:57:33 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:57:33 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:57:33 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2a145ee-522f-4183-94b0-9f35d382f9b4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:57:33 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[793852db-1641-4e77-8920-4af700bcd681]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:57:33 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-4a2cf0c2-d8d0-4bc1-9b70-ccb3c2345aeb tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Running cmd (subprocess): nvme version {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:57:33 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-4a2cf0c2-d8d0-4bc1-9b70-ccb3c2345aeb tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] 'nvme version' failed. Not Retrying. {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 15:57:33 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4a2cf0c2-d8d0-4bc1-9b70-ccb3c2345aeb tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] nvme not present on system {{(pid=75176) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 15:57:33 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:57:33 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 15:57:33 user nova-compute[75176]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 15:57:33 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d03a8c4-ee34-4472-be79-022cad3fa5fc]: (4, '') {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:57:33 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.lightos [None req-4a2cf0c2-d8d0-4bc1-9b70-ccb3c2345aeb tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75176) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 15:57:33 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.lightos [None req-4a2cf0c2-d8d0-4bc1-9b70-ccb3c2345aeb tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75176) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 15:57:33 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.lightos [None req-4a2cf0c2-d8d0-4bc1-9b70-ccb3c2345aeb tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] LIGHTOS: no hostnqn found. {{(pid=75176) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 15:57:33 user nova-compute[75176]: DEBUG os_brick.utils [None req-4a2cf0c2-d8d0-4bc1-9b70-ccb3c2345aeb tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] <== get_connector_properties: return (164ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:edc924a949b2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 15:57:33 user nova-compute[75176]: DEBUG nova.virt.block_device [None req-4a2cf0c2-d8d0-4bc1-9b70-ccb3c2345aeb tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] [instance: e0b7a064-03b6-4a0d-88be-2f12c12a1ddb] Updating existing volume attachment record: d1c16317-2f4d-4e7b-9001-cb1d606f4755 {{(pid=75176) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 15:57:33 user nova-compute[75176]: DEBUG nova.network.neutron [None req-3a4af14c-080e-433b-b608-c23b08e18b52 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: ecf38787-0a69-4f35-b121-3dc6e70023a1] Updating instance_info_cache with network_info: [{"id": "29444d70-7dc7-4e88-9856-cab5ebd77464", "address": "fa:16:3e:37:aa:5a", "network": {"id": "998766cd-2e8e-4e39-add9-286086640993", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-989265510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf05c8836b8a40de8e64c2d046ed71ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29444d70-7d", "ovs_interfaceid": "29444d70-7dc7-4e88-9856-cab5ebd77464", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:57:33 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-3a4af14c-080e-433b-b608-c23b08e18b52 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Releasing lock "refresh_cache-ecf38787-0a69-4f35-b121-3dc6e70023a1" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:57:33 user nova-compute[75176]: DEBUG nova.compute.manager [None req-3a4af14c-080e-433b-b608-c23b08e18b52 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: ecf38787-0a69-4f35-b121-3dc6e70023a1] Instance network_info: |[{"id": "29444d70-7dc7-4e88-9856-cab5ebd77464", "address": "fa:16:3e:37:aa:5a", "network": {"id": "998766cd-2e8e-4e39-add9-286086640993", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-989265510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf05c8836b8a40de8e64c2d046ed71ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29444d70-7d", "ovs_interfaceid": "29444d70-7dc7-4e88-9856-cab5ebd77464", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75176) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 15:57:33 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-e201e372-c7b4-4062-a436-fe33ccad369d req-4b75311e-5eec-485a-9589-9126e143a92c service nova] Acquired lock "refresh_cache-ecf38787-0a69-4f35-b121-3dc6e70023a1" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:57:33 user nova-compute[75176]: DEBUG nova.network.neutron [req-e201e372-c7b4-4062-a436-fe33ccad369d req-4b75311e-5eec-485a-9589-9126e143a92c service nova] [instance: ecf38787-0a69-4f35-b121-3dc6e70023a1] Refreshing network info cache for port 29444d70-7dc7-4e88-9856-cab5ebd77464 {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 15:57:33 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-3a4af14c-080e-433b-b608-c23b08e18b52 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: ecf38787-0a69-4f35-b121-3dc6e70023a1] Start _get_guest_xml network_info=[{"id": "29444d70-7dc7-4e88-9856-cab5ebd77464", "address": "fa:16:3e:37:aa:5a", "network": {"id": "998766cd-2e8e-4e39-add9-286086640993", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-989265510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf05c8836b8a40de8e64c2d046ed71ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29444d70-7d", "ovs_interfaceid": "29444d70-7dc7-4e88-9856-cab5ebd77464", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T15:35:12Z,direct_url=<?>,disk_format='qcow2',id=1f41819e-c93f-4dc7-b253-37a27bbbbc74,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1b91c5d0672c4224a48df2e1f92688e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T15:35:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'size': 0, 'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'image_id': '1f41819e-c93f-4dc7-b253-37a27bbbbc74'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75176) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 15:57:33 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-3a4af14c-080e-433b-b608-c23b08e18b52 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 15:57:33 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-3a4af14c-080e-433b-b608-c23b08e18b52 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 15:57:33 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-3a4af14c-080e-433b-b608-c23b08e18b52 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75176) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 15:57:33 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-3a4af14c-080e-433b-b608-c23b08e18b52 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] CPU controller missing on host. {{(pid=75176) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 15:57:33 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-3a4af14c-080e-433b-b608-c23b08e18b52 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75176) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 15:57:33 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-3a4af14c-080e-433b-b608-c23b08e18b52 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] CPU controller found on host. {{(pid=75176) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 15:57:33 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-3a4af14c-080e-433b-b608-c23b08e18b52 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75176) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 15:57:33 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-3a4af14c-080e-433b-b608-c23b08e18b52 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T15:35:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T15:35:12Z,direct_url=<?>,disk_format='qcow2',id=1f41819e-c93f-4dc7-b253-37a27bbbbc74,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1b91c5d0672c4224a48df2e1f92688e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T15:35:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 15:57:33 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-3a4af14c-080e-433b-b608-c23b08e18b52 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Flavor limits 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 15:57:33 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-3a4af14c-080e-433b-b608-c23b08e18b52 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Image limits 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 15:57:33 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-3a4af14c-080e-433b-b608-c23b08e18b52 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Flavor pref 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 15:57:33 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-3a4af14c-080e-433b-b608-c23b08e18b52 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Image pref 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 15:57:33 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-3a4af14c-080e-433b-b608-c23b08e18b52 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 15:57:33 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-3a4af14c-080e-433b-b608-c23b08e18b52 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 15:57:33 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-3a4af14c-080e-433b-b608-c23b08e18b52 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75176) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 15:57:33 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-3a4af14c-080e-433b-b608-c23b08e18b52 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Got 1 possible topologies {{(pid=75176) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 15:57:33 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-3a4af14c-080e-433b-b608-c23b08e18b52 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 15:57:33 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-3a4af14c-080e-433b-b608-c23b08e18b52 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 15:57:33 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-3a4af14c-080e-433b-b608-c23b08e18b52 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T15:57:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-829781152',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-829781152',id=44,image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bf05c8836b8a40de8e64c2d046ed71ff',ramdisk_id='',reservation_id='r-kk1vp13q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1648409789',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T15:57:31Z,user_data=None,user_id='f24cedac95a44bb5a9ee54cc4713945c',uuid=ecf38787-0a69-4f35-b121-3dc6e70023a1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "29444d70-7dc7-4e88-9856-cab5ebd77464", "address": "fa:16:3e:37:aa:5a", "network": {"id": "998766cd-2e8e-4e39-add9-286086640993", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-989265510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf05c8836b8a40de8e64c2d046ed71ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29444d70-7d", "ovs_interfaceid": "29444d70-7dc7-4e88-9856-cab5ebd77464", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75176) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 15:57:33 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-3a4af14c-080e-433b-b608-c23b08e18b52 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Converting VIF {"id": "29444d70-7dc7-4e88-9856-cab5ebd77464", "address": "fa:16:3e:37:aa:5a", "network": {"id": "998766cd-2e8e-4e39-add9-286086640993", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-989265510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf05c8836b8a40de8e64c2d046ed71ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29444d70-7d", "ovs_interfaceid": "29444d70-7dc7-4e88-9856-cab5ebd77464", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:57:33 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-3a4af14c-080e-433b-b608-c23b08e18b52 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:37:aa:5a,bridge_name='br-int',has_traffic_filtering=True,id=29444d70-7dc7-4e88-9856-cab5ebd77464,network=Network(998766cd-2e8e-4e39-add9-286086640993),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29444d70-7d') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:57:33 user nova-compute[75176]: DEBUG nova.objects.instance [None req-3a4af14c-080e-433b-b608-c23b08e18b52 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Lazy-loading 'pci_devices' on Instance uuid ecf38787-0a69-4f35-b121-3dc6e70023a1 {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:57:34 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-3a4af14c-080e-433b-b608-c23b08e18b52 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: ecf38787-0a69-4f35-b121-3dc6e70023a1] End _get_guest_xml xml=<domain type="kvm">
Nov 28 15:57:34 user nova-compute[75176]:   <uuid>ecf38787-0a69-4f35-b121-3dc6e70023a1</uuid>
Nov 28 15:57:34 user nova-compute[75176]:   <name>instance-0000002c</name>
Nov 28 15:57:34 user nova-compute[75176]:   <memory>524288</memory>
Nov 28 15:57:34 user nova-compute[75176]:   <vcpu>1</vcpu>
Nov 28 15:57:34 user nova-compute[75176]:   <metadata>
Nov 28 15:57:34 user nova-compute[75176]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 15:57:34 user nova-compute[75176]:       <nova:package version="0.0.0"/>
Nov 28 15:57:34 user nova-compute[75176]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-829781152</nova:name>
Nov 28 15:57:34 user nova-compute[75176]:       <nova:creationTime>2023-11-28 15:57:33</nova:creationTime>
Nov 28 15:57:34 user nova-compute[75176]:       <nova:flavor name="m1.tiny">
Nov 28 15:57:34 user nova-compute[75176]:         <nova:memory>512</nova:memory>
Nov 28 15:57:34 user nova-compute[75176]:         <nova:disk>1</nova:disk>
Nov 28 15:57:34 user nova-compute[75176]:         <nova:swap>0</nova:swap>
Nov 28 15:57:34 user nova-compute[75176]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 15:57:34 user nova-compute[75176]:         <nova:vcpus>1</nova:vcpus>
Nov 28 15:57:34 user nova-compute[75176]:       </nova:flavor>
Nov 28 15:57:34 user nova-compute[75176]:       <nova:owner>
Nov 28 15:57:34 user nova-compute[75176]:         <nova:user uuid="f24cedac95a44bb5a9ee54cc4713945c">tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member</nova:user>
Nov 28 15:57:34 user nova-compute[75176]:         <nova:project uuid="bf05c8836b8a40de8e64c2d046ed71ff">tempest-ServerBootFromVolumeStableRescueTest-1648409789</nova:project>
Nov 28 15:57:34 user nova-compute[75176]:       </nova:owner>
Nov 28 15:57:34 user nova-compute[75176]:       <nova:root type="image" uuid="1f41819e-c93f-4dc7-b253-37a27bbbbc74"/>
Nov 28 15:57:34 user nova-compute[75176]:       <nova:ports>
Nov 28 15:57:34 user nova-compute[75176]:         <nova:port uuid="29444d70-7dc7-4e88-9856-cab5ebd77464">
Nov 28 15:57:34 user nova-compute[75176]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 28 15:57:34 user nova-compute[75176]:         </nova:port>
Nov 28 15:57:34 user nova-compute[75176]:       </nova:ports>
Nov 28 15:57:34 user nova-compute[75176]:     </nova:instance>
Nov 28 15:57:34 user nova-compute[75176]:   </metadata>
Nov 28 15:57:34 user nova-compute[75176]:   <sysinfo type="smbios">
Nov 28 15:57:34 user nova-compute[75176]:     <system>
Nov 28 15:57:34 user nova-compute[75176]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 15:57:34 user nova-compute[75176]:       <entry name="product">OpenStack Nova</entry>
Nov 28 15:57:34 user nova-compute[75176]:       <entry name="version">0.0.0</entry>
Nov 28 15:57:34 user nova-compute[75176]:       <entry name="serial">ecf38787-0a69-4f35-b121-3dc6e70023a1</entry>
Nov 28 15:57:34 user nova-compute[75176]:       <entry name="uuid">ecf38787-0a69-4f35-b121-3dc6e70023a1</entry>
Nov 28 15:57:34 user nova-compute[75176]:       <entry name="family">Virtual Machine</entry>
Nov 28 15:57:34 user nova-compute[75176]:     </system>
Nov 28 15:57:34 user nova-compute[75176]:   </sysinfo>
Nov 28 15:57:34 user nova-compute[75176]:   <os>
Nov 28 15:57:34 user nova-compute[75176]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 15:57:34 user nova-compute[75176]:     <boot dev="hd"/>
Nov 28 15:57:34 user nova-compute[75176]:     <smbios mode="sysinfo"/>
Nov 28 15:57:34 user nova-compute[75176]:   </os>
Nov 28 15:57:34 user nova-compute[75176]:   <features>
Nov 28 15:57:34 user nova-compute[75176]:     <acpi/>
Nov 28 15:57:34 user nova-compute[75176]:     <apic/>
Nov 28 15:57:34 user nova-compute[75176]:     <vmcoreinfo/>
Nov 28 15:57:34 user nova-compute[75176]:   </features>
Nov 28 15:57:34 user nova-compute[75176]:   <clock offset="utc">
Nov 28 15:57:34 user nova-compute[75176]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 15:57:34 user nova-compute[75176]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 15:57:34 user nova-compute[75176]:     <timer name="hpet" present="no"/>
Nov 28 15:57:34 user nova-compute[75176]:   </clock>
Nov 28 15:57:34 user nova-compute[75176]:   <cpu mode="custom" match="exact">
Nov 28 15:57:34 user nova-compute[75176]:     <model>Nehalem</model>
Nov 28 15:57:34 user nova-compute[75176]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 15:57:34 user nova-compute[75176]:   </cpu>
Nov 28 15:57:34 user nova-compute[75176]:   <devices>
Nov 28 15:57:34 user nova-compute[75176]:     <disk type="file" device="disk">
Nov 28 15:57:34 user nova-compute[75176]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 15:57:34 user nova-compute[75176]:       <source file="/opt/stack/data/nova/instances/ecf38787-0a69-4f35-b121-3dc6e70023a1/disk"/>
Nov 28 15:57:34 user nova-compute[75176]:       <target dev="vda" bus="virtio"/>
Nov 28 15:57:34 user nova-compute[75176]:     </disk>
Nov 28 15:57:34 user nova-compute[75176]:     <interface type="ethernet">
Nov 28 15:57:34 user nova-compute[75176]:       <mac address="fa:16:3e:37:aa:5a"/>
Nov 28 15:57:34 user nova-compute[75176]:       <model type="virtio"/>
Nov 28 15:57:34 user nova-compute[75176]:       <mtu size="1442"/>
Nov 28 15:57:34 user nova-compute[75176]:       <target dev="tap29444d70-7d"/>
Nov 28 15:57:34 user nova-compute[75176]:     </interface>
Nov 28 15:57:34 user nova-compute[75176]:     <serial type="pty">
Nov 28 15:57:34 user nova-compute[75176]:       <log file="/opt/stack/data/nova/instances/ecf38787-0a69-4f35-b121-3dc6e70023a1/console.log" append="off"/>
Nov 28 15:57:34 user nova-compute[75176]:     </serial>
Nov 28 15:57:34 user nova-compute[75176]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 15:57:34 user nova-compute[75176]:     <video>
Nov 28 15:57:34 user nova-compute[75176]:       <model type="virtio"/>
Nov 28 15:57:34 user nova-compute[75176]:     </video>
Nov 28 15:57:34 user nova-compute[75176]:     <rng model="virtio">
Nov 28 15:57:34 user nova-compute[75176]:       <backend model="random">/dev/urandom</backend>
Nov 28 15:57:34 user nova-compute[75176]:     </rng>
Nov 28 15:57:34 user nova-compute[75176]:     <controller type="usb" index="0" model="none"/>
Nov 28 15:57:34 user nova-compute[75176]:     <memballoon model="virtio">
Nov 28 15:57:34 user nova-compute[75176]:       <stats period="10"/>
Nov 28 15:57:34 user nova-compute[75176]:     </memballoon>
Nov 28 15:57:34 user nova-compute[75176]:   </devices>
Nov 28 15:57:34 user nova-compute[75176]: </domain>
Nov 28 15:57:34 user nova-compute[75176]:  {{(pid=75176) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 15:57:34 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-3a4af14c-080e-433b-b608-c23b08e18b52 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T15:57:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-829781152',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-829781152',id=44,image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bf05c8836b8a40de8e64c2d046ed71ff',ramdisk_id='',reservation_id='r-kk1vp13q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1648409789',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T15:57:31Z,user_data=None,user_id='f24cedac95a44bb5a9ee54cc4713945c',uuid=ecf38787-0a69-4f35-b121-3dc6e70023a1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "29444d70-7dc7-4e88-9856-cab5ebd77464", "address": "fa:16:3e:37:aa:5a", "network": {"id": "998766cd-2e8e-4e39-add9-286086640993", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-989265510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf05c8836b8a40de8e64c2d046ed71ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29444d70-7d", "ovs_interfaceid": "29444d70-7dc7-4e88-9856-cab5ebd77464", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 15:57:34 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-3a4af14c-080e-433b-b608-c23b08e18b52 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Converting VIF {"id": "29444d70-7dc7-4e88-9856-cab5ebd77464", "address": "fa:16:3e:37:aa:5a", "network": {"id": "998766cd-2e8e-4e39-add9-286086640993", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-989265510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf05c8836b8a40de8e64c2d046ed71ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29444d70-7d", "ovs_interfaceid": "29444d70-7dc7-4e88-9856-cab5ebd77464", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:57:34 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-3a4af14c-080e-433b-b608-c23b08e18b52 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:37:aa:5a,bridge_name='br-int',has_traffic_filtering=True,id=29444d70-7dc7-4e88-9856-cab5ebd77464,network=Network(998766cd-2e8e-4e39-add9-286086640993),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29444d70-7d') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:57:34 user nova-compute[75176]: DEBUG os_vif [None req-3a4af14c-080e-433b-b608-c23b08e18b52 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:aa:5a,bridge_name='br-int',has_traffic_filtering=True,id=29444d70-7dc7-4e88-9856-cab5ebd77464,network=Network(998766cd-2e8e-4e39-add9-286086640993),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29444d70-7d') {{(pid=75176) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 15:57:34 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:57:34 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:57:34 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 15:57:34 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:57:34 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '45bc6f03-3e19-575d-a1e3-84431ef76d21', '_type': 'linux-noop'}}, row=False) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:57:34 user nova-compute[75176]: DEBUG nova.compute.provider_tree [None req-e00de3ee-776e-4720-abf7-85b4585913ec tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Inventory has not changed in ProviderTree for provider: b37848d8-f401-4155-a029-b0ffa09ff85b {{(pid=75176) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 15:57:34 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:57:34 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:57:34 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:57:34 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap29444d70-7d, may_exist=True, interface_attrs={}) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:57:34 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap29444d70-7d, col_values=(('qos', UUID('ee65e93e-183d-4f38-964c-f3a0679410c2')),), if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:57:34 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap29444d70-7d, col_values=(('external_ids', {'iface-id': '29444d70-7dc7-4e88-9856-cab5ebd77464', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:37:aa:5a', 'vm-uuid': 'ecf38787-0a69-4f35-b121-3dc6e70023a1'}),), if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:57:34 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:57:34 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:57:34 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-e00de3ee-776e-4720-abf7-85b4585913ec tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Inventory has not changed for provider b37848d8-f401-4155-a029-b0ffa09ff85b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75176) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 15:57:34 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:57:34 user nova-compute[75176]: INFO os_vif [None req-3a4af14c-080e-433b-b608-c23b08e18b52 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:aa:5a,bridge_name='br-int',has_traffic_filtering=True,id=29444d70-7dc7-4e88-9856-cab5ebd77464,network=Network(998766cd-2e8e-4e39-add9-286086640993),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29444d70-7d')
Nov 28 15:57:34 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-e00de3ee-776e-4720-abf7-85b4585913ec tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.687s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:57:34 user nova-compute[75176]: DEBUG nova.compute.manager [None req-e00de3ee-776e-4720-abf7-85b4585913ec tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] [instance: 726344c0-a0dc-48d5-a18f-8a258ebde87d] Start building networks asynchronously for instance. {{(pid=75176) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 15:57:34 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-3a4af14c-080e-433b-b608-c23b08e18b52 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] No BDM found with device name vda, not building metadata. {{(pid=75176) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 15:57:34 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-3a4af14c-080e-433b-b608-c23b08e18b52 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] No VIF found with MAC fa:16:3e:37:aa:5a, not building metadata {{(pid=75176) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 15:57:34 user nova-compute[75176]: DEBUG nova.compute.manager [None req-e00de3ee-776e-4720-abf7-85b4585913ec tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] [instance: 726344c0-a0dc-48d5-a18f-8a258ebde87d] Allocating IP information in the background. {{(pid=75176) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 15:57:34 user nova-compute[75176]: DEBUG nova.network.neutron [None req-e00de3ee-776e-4720-abf7-85b4585913ec tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] [instance: 726344c0-a0dc-48d5-a18f-8a258ebde87d] allocate_for_instance() {{(pid=75176) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 15:57:34 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-e00de3ee-776e-4720-abf7-85b4585913ec tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] [instance: 726344c0-a0dc-48d5-a18f-8a258ebde87d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 15:57:34 user nova-compute[75176]: DEBUG nova.compute.manager [None req-e00de3ee-776e-4720-abf7-85b4585913ec tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] [instance: 726344c0-a0dc-48d5-a18f-8a258ebde87d] Start building block device mappings for instance. {{(pid=75176) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 15:57:34 user nova-compute[75176]: DEBUG nova.policy [None req-e00de3ee-776e-4720-abf7-85b4585913ec tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b7bd0e1b307f4d339ca2e540e063f028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2856ce0a2545cda0b796eb0be10a40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75176) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 15:57:34 user nova-compute[75176]: DEBUG nova.compute.manager [None req-e00de3ee-776e-4720-abf7-85b4585913ec tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] [instance: 726344c0-a0dc-48d5-a18f-8a258ebde87d] Start spawning the instance on the hypervisor. {{(pid=75176) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 15:57:34 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-e00de3ee-776e-4720-abf7-85b4585913ec tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] [instance: 726344c0-a0dc-48d5-a18f-8a258ebde87d] Creating instance directory {{(pid=75176) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 15:57:34 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-e00de3ee-776e-4720-abf7-85b4585913ec tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] [instance: 726344c0-a0dc-48d5-a18f-8a258ebde87d] Creating image(s)
Nov 28 15:57:34 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-e00de3ee-776e-4720-abf7-85b4585913ec tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Acquiring lock "/opt/stack/data/nova/instances/726344c0-a0dc-48d5-a18f-8a258ebde87d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:57:34 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-e00de3ee-776e-4720-abf7-85b4585913ec tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Lock "/opt/stack/data/nova/instances/726344c0-a0dc-48d5-a18f-8a258ebde87d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:57:34 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-e00de3ee-776e-4720-abf7-85b4585913ec tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Lock "/opt/stack/data/nova/instances/726344c0-a0dc-48d5-a18f-8a258ebde87d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:57:34 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-e00de3ee-776e-4720-abf7-85b4585913ec tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:57:34 user nova-compute[75176]: DEBUG nova.network.neutron [req-e201e372-c7b4-4062-a436-fe33ccad369d req-4b75311e-5eec-485a-9589-9126e143a92c service nova] [instance: ecf38787-0a69-4f35-b121-3dc6e70023a1] Updated VIF entry in instance network info cache for port 29444d70-7dc7-4e88-9856-cab5ebd77464. {{(pid=75176) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 15:57:34 user nova-compute[75176]: DEBUG nova.network.neutron [req-e201e372-c7b4-4062-a436-fe33ccad369d req-4b75311e-5eec-485a-9589-9126e143a92c service nova] [instance: ecf38787-0a69-4f35-b121-3dc6e70023a1] Updating instance_info_cache with network_info: [{"id": "29444d70-7dc7-4e88-9856-cab5ebd77464", "address": "fa:16:3e:37:aa:5a", "network": {"id": "998766cd-2e8e-4e39-add9-286086640993", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-989265510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf05c8836b8a40de8e64c2d046ed71ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29444d70-7d", "ovs_interfaceid": "29444d70-7dc7-4e88-9856-cab5ebd77464", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:57:34 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-e201e372-c7b4-4062-a436-fe33ccad369d req-4b75311e-5eec-485a-9589-9126e143a92c service nova] Releasing lock "refresh_cache-ecf38787-0a69-4f35-b121-3dc6e70023a1" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:57:34 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-e00de3ee-776e-4720-abf7-85b4585913ec tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json" returned: 0 in 0.224s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:57:34 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-e00de3ee-776e-4720-abf7-85b4585913ec tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Acquiring lock "5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:57:34 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-e00de3ee-776e-4720-abf7-85b4585913ec tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Lock "5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:57:34 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-e00de3ee-776e-4720-abf7-85b4585913ec tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:57:34 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:57:34 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-11ce2b4c-fb1d-441a-8a4c-e13fe7575468 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Acquiring lock "2c154591-b130-4aa4-aad4-4c85324512df" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:57:34 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-11ce2b4c-fb1d-441a-8a4c-e13fe7575468 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Lock "2c154591-b130-4aa4-aad4-4c85324512df" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:57:34 user nova-compute[75176]: INFO nova.compute.manager [None req-11ce2b4c-fb1d-441a-8a4c-e13fe7575468 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] [instance: 2c154591-b130-4aa4-aad4-4c85324512df] Unshelving
Nov 28 15:57:34 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-e00de3ee-776e-4720-abf7-85b4585913ec tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json" returned: 0 in 0.255s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:57:34 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-e00de3ee-776e-4720-abf7-85b4585913ec tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2,backing_fmt=raw /opt/stack/data/nova/instances/726344c0-a0dc-48d5-a18f-8a258ebde87d/disk 1073741824 {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:57:34 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-11ce2b4c-fb1d-441a-8a4c-e13fe7575468 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:57:34 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-11ce2b4c-fb1d-441a-8a4c-e13fe7575468 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:57:34 user nova-compute[75176]: DEBUG nova.objects.instance [None req-11ce2b4c-fb1d-441a-8a4c-e13fe7575468 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Lazy-loading 'pci_requests' on Instance uuid 2c154591-b130-4aa4-aad4-4c85324512df {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:57:34 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-e00de3ee-776e-4720-abf7-85b4585913ec tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2,backing_fmt=raw /opt/stack/data/nova/instances/726344c0-a0dc-48d5-a18f-8a258ebde87d/disk 1073741824" returned: 0 in 0.062s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:57:34 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-e00de3ee-776e-4720-abf7-85b4585913ec tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Lock "5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.320s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:57:34 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-e00de3ee-776e-4720-abf7-85b4585913ec tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:57:34 user nova-compute[75176]: DEBUG nova.objects.instance [None req-11ce2b4c-fb1d-441a-8a4c-e13fe7575468 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Lazy-loading 'numa_topology' on Instance uuid 2c154591-b130-4aa4-aad4-4c85324512df {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:57:35 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-11ce2b4c-fb1d-441a-8a4c-e13fe7575468 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75176) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 15:57:35 user nova-compute[75176]: INFO nova.compute.claims [None req-11ce2b4c-fb1d-441a-8a4c-e13fe7575468 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] [instance: 2c154591-b130-4aa4-aad4-4c85324512df] Claim successful on node user
Nov 28 15:57:35 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-e00de3ee-776e-4720-abf7-85b4585913ec tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json" returned: 0 in 0.258s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:57:35 user nova-compute[75176]: DEBUG nova.virt.disk.api [None req-e00de3ee-776e-4720-abf7-85b4585913ec tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Checking if we can resize image /opt/stack/data/nova/instances/726344c0-a0dc-48d5-a18f-8a258ebde87d/disk. size=1073741824 {{(pid=75176) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 15:57:35 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-e00de3ee-776e-4720-abf7-85b4585913ec tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/726344c0-a0dc-48d5-a18f-8a258ebde87d/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:57:35 user nova-compute[75176]: DEBUG nova.network.neutron [None req-e00de3ee-776e-4720-abf7-85b4585913ec tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] [instance: 726344c0-a0dc-48d5-a18f-8a258ebde87d] Successfully created port: 966907f1-2c5f-4c34-b155-b1b3b4176f5f {{(pid=75176) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 15:57:35 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-e00de3ee-776e-4720-abf7-85b4585913ec tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/726344c0-a0dc-48d5-a18f-8a258ebde87d/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:57:35 user nova-compute[75176]: DEBUG nova.virt.disk.api [None req-e00de3ee-776e-4720-abf7-85b4585913ec tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Cannot resize image /opt/stack/data/nova/instances/726344c0-a0dc-48d5-a18f-8a258ebde87d/disk to a smaller size. {{(pid=75176) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 15:57:35 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-e00de3ee-776e-4720-abf7-85b4585913ec tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] [instance: 726344c0-a0dc-48d5-a18f-8a258ebde87d] Created local disks {{(pid=75176) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 15:57:35 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-e00de3ee-776e-4720-abf7-85b4585913ec tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] [instance: 726344c0-a0dc-48d5-a18f-8a258ebde87d] Ensure instance console log exists: /opt/stack/data/nova/instances/726344c0-a0dc-48d5-a18f-8a258ebde87d/console.log {{(pid=75176) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 15:57:35 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-e00de3ee-776e-4720-abf7-85b4585913ec tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:57:35 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-e00de3ee-776e-4720-abf7-85b4585913ec tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:57:35 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-e00de3ee-776e-4720-abf7-85b4585913ec tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:57:35 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:57:35 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:57:35 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:57:35 user nova-compute[75176]: DEBUG nova.compute.provider_tree [None req-11ce2b4c-fb1d-441a-8a4c-e13fe7575468 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Inventory has not changed in ProviderTree for provider: b37848d8-f401-4155-a029-b0ffa09ff85b {{(pid=75176) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 15:57:35 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-11ce2b4c-fb1d-441a-8a4c-e13fe7575468 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Inventory has not changed for provider b37848d8-f401-4155-a029-b0ffa09ff85b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75176) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 15:57:35 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-11ce2b4c-fb1d-441a-8a4c-e13fe7575468 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.754s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:57:35 user nova-compute[75176]: INFO nova.network.neutron [None req-11ce2b4c-fb1d-441a-8a4c-e13fe7575468 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] [instance: 2c154591-b130-4aa4-aad4-4c85324512df] Updating port c743768f-0b40-435a-8754-96784ae96dda with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 28 15:57:35 user nova-compute[75176]: DEBUG nova.compute.manager [req-476e65a5-a48f-4146-8236-483619c94fc2 req-b76aaa7e-631a-45ea-b969-59922c2dd646 service nova] [instance: ecf38787-0a69-4f35-b121-3dc6e70023a1] Received event network-vif-plugged-29444d70-7dc7-4e88-9856-cab5ebd77464 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:57:35 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-476e65a5-a48f-4146-8236-483619c94fc2 req-b76aaa7e-631a-45ea-b969-59922c2dd646 service nova] Acquiring lock "ecf38787-0a69-4f35-b121-3dc6e70023a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:57:35 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-476e65a5-a48f-4146-8236-483619c94fc2 req-b76aaa7e-631a-45ea-b969-59922c2dd646 service nova] Lock "ecf38787-0a69-4f35-b121-3dc6e70023a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:57:35 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-476e65a5-a48f-4146-8236-483619c94fc2 req-b76aaa7e-631a-45ea-b969-59922c2dd646 service nova] Lock "ecf38787-0a69-4f35-b121-3dc6e70023a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:57:35 user nova-compute[75176]: DEBUG nova.compute.manager [req-476e65a5-a48f-4146-8236-483619c94fc2 req-b76aaa7e-631a-45ea-b969-59922c2dd646 service nova] [instance: ecf38787-0a69-4f35-b121-3dc6e70023a1] No waiting events found dispatching network-vif-plugged-29444d70-7dc7-4e88-9856-cab5ebd77464 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:57:35 user nova-compute[75176]: WARNING nova.compute.manager [req-476e65a5-a48f-4146-8236-483619c94fc2 req-b76aaa7e-631a-45ea-b969-59922c2dd646 service nova] [instance: ecf38787-0a69-4f35-b121-3dc6e70023a1] Received unexpected event network-vif-plugged-29444d70-7dc7-4e88-9856-cab5ebd77464 for instance with vm_state building and task_state spawning.
Nov 28 15:57:35 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:57:35 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:57:36 user nova-compute[75176]: DEBUG nova.network.neutron [None req-e00de3ee-776e-4720-abf7-85b4585913ec tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] [instance: 726344c0-a0dc-48d5-a18f-8a258ebde87d] Successfully updated port: 966907f1-2c5f-4c34-b155-b1b3b4176f5f {{(pid=75176) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 15:57:36 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-e00de3ee-776e-4720-abf7-85b4585913ec tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Acquiring lock "refresh_cache-726344c0-a0dc-48d5-a18f-8a258ebde87d" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:57:36 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-e00de3ee-776e-4720-abf7-85b4585913ec tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Acquired lock "refresh_cache-726344c0-a0dc-48d5-a18f-8a258ebde87d" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:57:36 user nova-compute[75176]: DEBUG nova.network.neutron [None req-e00de3ee-776e-4720-abf7-85b4585913ec tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] [instance: 726344c0-a0dc-48d5-a18f-8a258ebde87d] Building network info cache for instance {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 15:57:36 user nova-compute[75176]: DEBUG nova.compute.manager [req-400a5cac-7ae9-436f-a9aa-0b22794c357f req-fa1cfb28-7662-49d7-b4c8-1a1d74fba2fb service nova] [instance: 726344c0-a0dc-48d5-a18f-8a258ebde87d] Received event network-changed-966907f1-2c5f-4c34-b155-b1b3b4176f5f {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:57:36 user nova-compute[75176]: DEBUG nova.compute.manager [req-400a5cac-7ae9-436f-a9aa-0b22794c357f req-fa1cfb28-7662-49d7-b4c8-1a1d74fba2fb service nova] [instance: 726344c0-a0dc-48d5-a18f-8a258ebde87d] Refreshing instance network info cache due to event network-changed-966907f1-2c5f-4c34-b155-b1b3b4176f5f. {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 15:57:36 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-400a5cac-7ae9-436f-a9aa-0b22794c357f req-fa1cfb28-7662-49d7-b4c8-1a1d74fba2fb service nova] Acquiring lock "refresh_cache-726344c0-a0dc-48d5-a18f-8a258ebde87d" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:57:36 user nova-compute[75176]: DEBUG nova.network.neutron [None req-e00de3ee-776e-4720-abf7-85b4585913ec tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] [instance: 726344c0-a0dc-48d5-a18f-8a258ebde87d] Instance cache missing network info. {{(pid=75176) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 15:57:36 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:57:36 user nova-compute[75176]: DEBUG nova.network.neutron [None req-e00de3ee-776e-4720-abf7-85b4585913ec tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] [instance: 726344c0-a0dc-48d5-a18f-8a258ebde87d] Updating instance_info_cache with network_info: [{"id": "966907f1-2c5f-4c34-b155-b1b3b4176f5f", "address": "fa:16:3e:0d:da:42", "network": {"id": "d47c1797-a66f-4f2d-b83e-903b5bd3251c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1416388789-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd2856ce0a2545cda0b796eb0be10a40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap966907f1-2c", "ovs_interfaceid": "966907f1-2c5f-4c34-b155-b1b3b4176f5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:57:36 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-e00de3ee-776e-4720-abf7-85b4585913ec tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Releasing lock "refresh_cache-726344c0-a0dc-48d5-a18f-8a258ebde87d" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:57:36 user nova-compute[75176]: DEBUG nova.compute.manager [None req-e00de3ee-776e-4720-abf7-85b4585913ec tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] [instance: 726344c0-a0dc-48d5-a18f-8a258ebde87d] Instance network_info: |[{"id": "966907f1-2c5f-4c34-b155-b1b3b4176f5f", "address": "fa:16:3e:0d:da:42", "network": {"id": "d47c1797-a66f-4f2d-b83e-903b5bd3251c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1416388789-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd2856ce0a2545cda0b796eb0be10a40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap966907f1-2c", "ovs_interfaceid": "966907f1-2c5f-4c34-b155-b1b3b4176f5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75176) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 15:57:36 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-400a5cac-7ae9-436f-a9aa-0b22794c357f req-fa1cfb28-7662-49d7-b4c8-1a1d74fba2fb service nova] Acquired lock "refresh_cache-726344c0-a0dc-48d5-a18f-8a258ebde87d" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:57:36 user nova-compute[75176]: DEBUG nova.network.neutron [req-400a5cac-7ae9-436f-a9aa-0b22794c357f req-fa1cfb28-7662-49d7-b4c8-1a1d74fba2fb service nova] [instance: 726344c0-a0dc-48d5-a18f-8a258ebde87d] Refreshing network info cache for port 966907f1-2c5f-4c34-b155-b1b3b4176f5f {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 15:57:36 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-e00de3ee-776e-4720-abf7-85b4585913ec tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] [instance: 726344c0-a0dc-48d5-a18f-8a258ebde87d] Start _get_guest_xml network_info=[{"id": "966907f1-2c5f-4c34-b155-b1b3b4176f5f", "address": "fa:16:3e:0d:da:42", "network": {"id": "d47c1797-a66f-4f2d-b83e-903b5bd3251c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1416388789-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd2856ce0a2545cda0b796eb0be10a40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap966907f1-2c", "ovs_interfaceid": "966907f1-2c5f-4c34-b155-b1b3b4176f5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T15:35:12Z,direct_url=<?>,disk_format='qcow2',id=1f41819e-c93f-4dc7-b253-37a27bbbbc74,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1b91c5d0672c4224a48df2e1f92688e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T15:35:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'size': 0, 'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'image_id': '1f41819e-c93f-4dc7-b253-37a27bbbbc74'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75176) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 15:57:36 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-e00de3ee-776e-4720-abf7-85b4585913ec tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 15:57:36 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-e00de3ee-776e-4720-abf7-85b4585913ec tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 15:57:36 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-e00de3ee-776e-4720-abf7-85b4585913ec tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75176) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 15:57:36 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-e00de3ee-776e-4720-abf7-85b4585913ec tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] CPU controller missing on host. {{(pid=75176) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 15:57:36 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-e00de3ee-776e-4720-abf7-85b4585913ec tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75176) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 15:57:36 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-e00de3ee-776e-4720-abf7-85b4585913ec tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] CPU controller found on host. {{(pid=75176) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 15:57:36 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-e00de3ee-776e-4720-abf7-85b4585913ec tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75176) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 15:57:36 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-e00de3ee-776e-4720-abf7-85b4585913ec tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T15:35:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T15:35:12Z,direct_url=<?>,disk_format='qcow2',id=1f41819e-c93f-4dc7-b253-37a27bbbbc74,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1b91c5d0672c4224a48df2e1f92688e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T15:35:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 15:57:36 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-e00de3ee-776e-4720-abf7-85b4585913ec tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Flavor limits 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 15:57:36 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-e00de3ee-776e-4720-abf7-85b4585913ec tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Image limits 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 15:57:36 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-e00de3ee-776e-4720-abf7-85b4585913ec tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Flavor pref 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 15:57:36 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-e00de3ee-776e-4720-abf7-85b4585913ec tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Image pref 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 15:57:36 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-e00de3ee-776e-4720-abf7-85b4585913ec tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 15:57:36 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-e00de3ee-776e-4720-abf7-85b4585913ec tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 15:57:36 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-e00de3ee-776e-4720-abf7-85b4585913ec tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75176) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 15:57:36 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-e00de3ee-776e-4720-abf7-85b4585913ec tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Got 1 possible topologies {{(pid=75176) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 15:57:36 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-e00de3ee-776e-4720-abf7-85b4585913ec tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 15:57:36 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-e00de3ee-776e-4720-abf7-85b4585913ec tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 15:57:36 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-e00de3ee-776e-4720-abf7-85b4585913ec tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T15:57:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1122679672',display_name='tempest-ServerRescueNegativeTestJSON-server-1122679672',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1122679672',id=45,image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEZuNmXMFz6sBu04nshrF/BB/Cnv2fAQGDkY1pjVwPYLhAmT6GMTzKRLMsJCXLjGi+jXRTKDx4ZWnzYKB3Ckq5OigiPkcaffbdzn12nwNwhUqhkxX7xDpQqJpdgTCr30aA==',key_name='tempest-keypair-210592767',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fd2856ce0a2545cda0b796eb0be10a40',ramdisk_id='',reservation_id='r-wq0wf5rj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1263291627',owner_user_name='tempest-ServerRescueNegativeTestJSON-1263291627-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T15:57:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b7bd0e1b307f4d339ca2e540e063f028',uuid=726344c0-a0dc-48d5-a18f-8a258ebde87d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "966907f1-2c5f-4c34-b155-b1b3b4176f5f", "address": "fa:16:3e:0d:da:42", "network": {"id": "d47c1797-a66f-4f2d-b83e-903b5bd3251c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1416388789-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd2856ce0a2545cda0b796eb0be10a40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap966907f1-2c", "ovs_interfaceid": "966907f1-2c5f-4c34-b155-b1b3b4176f5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75176) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 15:57:36 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-e00de3ee-776e-4720-abf7-85b4585913ec tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Converting VIF {"id": "966907f1-2c5f-4c34-b155-b1b3b4176f5f", "address": "fa:16:3e:0d:da:42", "network": {"id": "d47c1797-a66f-4f2d-b83e-903b5bd3251c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1416388789-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd2856ce0a2545cda0b796eb0be10a40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap966907f1-2c", "ovs_interfaceid": "966907f1-2c5f-4c34-b155-b1b3b4176f5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:57:36 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-e00de3ee-776e-4720-abf7-85b4585913ec tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:da:42,bridge_name='br-int',has_traffic_filtering=True,id=966907f1-2c5f-4c34-b155-b1b3b4176f5f,network=Network(d47c1797-a66f-4f2d-b83e-903b5bd3251c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap966907f1-2c') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:57:36 user nova-compute[75176]: DEBUG nova.objects.instance [None req-e00de3ee-776e-4720-abf7-85b4585913ec tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Lazy-loading 'pci_devices' on Instance uuid 726344c0-a0dc-48d5-a18f-8a258ebde87d {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:57:36 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-e00de3ee-776e-4720-abf7-85b4585913ec tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] [instance: 726344c0-a0dc-48d5-a18f-8a258ebde87d] End _get_guest_xml xml=<domain type="kvm">
Nov 28 15:57:36 user nova-compute[75176]:   <uuid>726344c0-a0dc-48d5-a18f-8a258ebde87d</uuid>
Nov 28 15:57:36 user nova-compute[75176]:   <name>instance-0000002d</name>
Nov 28 15:57:36 user nova-compute[75176]:   <memory>524288</memory>
Nov 28 15:57:36 user nova-compute[75176]:   <vcpu>1</vcpu>
Nov 28 15:57:36 user nova-compute[75176]:   <metadata>
Nov 28 15:57:36 user nova-compute[75176]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 15:57:36 user nova-compute[75176]:       <nova:package version="0.0.0"/>
Nov 28 15:57:36 user nova-compute[75176]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1122679672</nova:name>
Nov 28 15:57:36 user nova-compute[75176]:       <nova:creationTime>2023-11-28 15:57:36</nova:creationTime>
Nov 28 15:57:36 user nova-compute[75176]:       <nova:flavor name="m1.tiny">
Nov 28 15:57:36 user nova-compute[75176]:         <nova:memory>512</nova:memory>
Nov 28 15:57:36 user nova-compute[75176]:         <nova:disk>1</nova:disk>
Nov 28 15:57:36 user nova-compute[75176]:         <nova:swap>0</nova:swap>
Nov 28 15:57:36 user nova-compute[75176]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 15:57:36 user nova-compute[75176]:         <nova:vcpus>1</nova:vcpus>
Nov 28 15:57:36 user nova-compute[75176]:       </nova:flavor>
Nov 28 15:57:36 user nova-compute[75176]:       <nova:owner>
Nov 28 15:57:36 user nova-compute[75176]:         <nova:user uuid="b7bd0e1b307f4d339ca2e540e063f028">tempest-ServerRescueNegativeTestJSON-1263291627-project-member</nova:user>
Nov 28 15:57:36 user nova-compute[75176]:         <nova:project uuid="fd2856ce0a2545cda0b796eb0be10a40">tempest-ServerRescueNegativeTestJSON-1263291627</nova:project>
Nov 28 15:57:36 user nova-compute[75176]:       </nova:owner>
Nov 28 15:57:36 user nova-compute[75176]:       <nova:root type="image" uuid="1f41819e-c93f-4dc7-b253-37a27bbbbc74"/>
Nov 28 15:57:36 user nova-compute[75176]:       <nova:ports>
Nov 28 15:57:36 user nova-compute[75176]:         <nova:port uuid="966907f1-2c5f-4c34-b155-b1b3b4176f5f">
Nov 28 15:57:36 user nova-compute[75176]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 28 15:57:36 user nova-compute[75176]:         </nova:port>
Nov 28 15:57:36 user nova-compute[75176]:       </nova:ports>
Nov 28 15:57:36 user nova-compute[75176]:     </nova:instance>
Nov 28 15:57:36 user nova-compute[75176]:   </metadata>
Nov 28 15:57:36 user nova-compute[75176]:   <sysinfo type="smbios">
Nov 28 15:57:36 user nova-compute[75176]:     <system>
Nov 28 15:57:36 user nova-compute[75176]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 15:57:36 user nova-compute[75176]:       <entry name="product">OpenStack Nova</entry>
Nov 28 15:57:36 user nova-compute[75176]:       <entry name="version">0.0.0</entry>
Nov 28 15:57:36 user nova-compute[75176]:       <entry name="serial">726344c0-a0dc-48d5-a18f-8a258ebde87d</entry>
Nov 28 15:57:36 user nova-compute[75176]:       <entry name="uuid">726344c0-a0dc-48d5-a18f-8a258ebde87d</entry>
Nov 28 15:57:36 user nova-compute[75176]:       <entry name="family">Virtual Machine</entry>
Nov 28 15:57:36 user nova-compute[75176]:     </system>
Nov 28 15:57:36 user nova-compute[75176]:   </sysinfo>
Nov 28 15:57:36 user nova-compute[75176]:   <os>
Nov 28 15:57:36 user nova-compute[75176]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 15:57:36 user nova-compute[75176]:     <boot dev="hd"/>
Nov 28 15:57:36 user nova-compute[75176]:     <smbios mode="sysinfo"/>
Nov 28 15:57:36 user nova-compute[75176]:   </os>
Nov 28 15:57:36 user nova-compute[75176]:   <features>
Nov 28 15:57:36 user nova-compute[75176]:     <acpi/>
Nov 28 15:57:36 user nova-compute[75176]:     <apic/>
Nov 28 15:57:36 user nova-compute[75176]:     <vmcoreinfo/>
Nov 28 15:57:36 user nova-compute[75176]:   </features>
Nov 28 15:57:36 user nova-compute[75176]:   <clock offset="utc">
Nov 28 15:57:36 user nova-compute[75176]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 15:57:36 user nova-compute[75176]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 15:57:36 user nova-compute[75176]:     <timer name="hpet" present="no"/>
Nov 28 15:57:36 user nova-compute[75176]:   </clock>
Nov 28 15:57:36 user nova-compute[75176]:   <cpu mode="custom" match="exact">
Nov 28 15:57:36 user nova-compute[75176]:     <model>Nehalem</model>
Nov 28 15:57:36 user nova-compute[75176]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 15:57:36 user nova-compute[75176]:   </cpu>
Nov 28 15:57:36 user nova-compute[75176]:   <devices>
Nov 28 15:57:36 user nova-compute[75176]:     <disk type="file" device="disk">
Nov 28 15:57:36 user nova-compute[75176]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 15:57:36 user nova-compute[75176]:       <source file="/opt/stack/data/nova/instances/726344c0-a0dc-48d5-a18f-8a258ebde87d/disk"/>
Nov 28 15:57:36 user nova-compute[75176]:       <target dev="vda" bus="virtio"/>
Nov 28 15:57:36 user nova-compute[75176]:     </disk>
Nov 28 15:57:36 user nova-compute[75176]:     <interface type="ethernet">
Nov 28 15:57:36 user nova-compute[75176]:       <mac address="fa:16:3e:0d:da:42"/>
Nov 28 15:57:36 user nova-compute[75176]:       <model type="virtio"/>
Nov 28 15:57:36 user nova-compute[75176]:       <mtu size="1442"/>
Nov 28 15:57:36 user nova-compute[75176]:       <target dev="tap966907f1-2c"/>
Nov 28 15:57:36 user nova-compute[75176]:     </interface>
Nov 28 15:57:36 user nova-compute[75176]:     <serial type="pty">
Nov 28 15:57:36 user nova-compute[75176]:       <log file="/opt/stack/data/nova/instances/726344c0-a0dc-48d5-a18f-8a258ebde87d/console.log" append="off"/>
Nov 28 15:57:36 user nova-compute[75176]:     </serial>
Nov 28 15:57:36 user nova-compute[75176]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 15:57:36 user nova-compute[75176]:     <video>
Nov 28 15:57:36 user nova-compute[75176]:       <model type="virtio"/>
Nov 28 15:57:36 user nova-compute[75176]:     </video>
Nov 28 15:57:36 user nova-compute[75176]:     <rng model="virtio">
Nov 28 15:57:36 user nova-compute[75176]:       <backend model="random">/dev/urandom</backend>
Nov 28 15:57:36 user nova-compute[75176]:     </rng>
Nov 28 15:57:36 user nova-compute[75176]:     <controller type="usb" index="0" model="none"/>
Nov 28 15:57:36 user nova-compute[75176]:     <memballoon model="virtio">
Nov 28 15:57:36 user nova-compute[75176]:       <stats period="10"/>
Nov 28 15:57:36 user nova-compute[75176]:     </memballoon>
Nov 28 15:57:36 user nova-compute[75176]:   </devices>
Nov 28 15:57:36 user nova-compute[75176]: </domain>
Nov 28 15:57:36 user nova-compute[75176]:  {{(pid=75176) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 15:57:36 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-e00de3ee-776e-4720-abf7-85b4585913ec tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T15:57:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1122679672',display_name='tempest-ServerRescueNegativeTestJSON-server-1122679672',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1122679672',id=45,image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEZuNmXMFz6sBu04nshrF/BB/Cnv2fAQGDkY1pjVwPYLhAmT6GMTzKRLMsJCXLjGi+jXRTKDx4ZWnzYKB3Ckq5OigiPkcaffbdzn12nwNwhUqhkxX7xDpQqJpdgTCr30aA==',key_name='tempest-keypair-210592767',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fd2856ce0a2545cda0b796eb0be10a40',ramdisk_id='',reservation_id='r-wq0wf5rj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1263291627',owner_user_name='tempest-ServerRescueNegativeTestJSON-1263291627-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T15:57:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b7bd0e1b307f4d339ca2e540e063f028',uuid=726344c0-a0dc-48d5-a18f-8a258ebde87d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "966907f1-2c5f-4c34-b155-b1b3b4176f5f", "address": "fa:16:3e:0d:da:42", "network": {"id": "d47c1797-a66f-4f2d-b83e-903b5bd3251c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1416388789-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd2856ce0a2545cda0b796eb0be10a40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap966907f1-2c", "ovs_interfaceid": "966907f1-2c5f-4c34-b155-b1b3b4176f5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 15:57:36 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-e00de3ee-776e-4720-abf7-85b4585913ec tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Converting VIF {"id": "966907f1-2c5f-4c34-b155-b1b3b4176f5f", "address": "fa:16:3e:0d:da:42", "network": {"id": "d47c1797-a66f-4f2d-b83e-903b5bd3251c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1416388789-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd2856ce0a2545cda0b796eb0be10a40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap966907f1-2c", "ovs_interfaceid": "966907f1-2c5f-4c34-b155-b1b3b4176f5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:57:36 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-e00de3ee-776e-4720-abf7-85b4585913ec tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:da:42,bridge_name='br-int',has_traffic_filtering=True,id=966907f1-2c5f-4c34-b155-b1b3b4176f5f,network=Network(d47c1797-a66f-4f2d-b83e-903b5bd3251c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap966907f1-2c') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:57:36 user nova-compute[75176]: DEBUG os_vif [None req-e00de3ee-776e-4720-abf7-85b4585913ec tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:da:42,bridge_name='br-int',has_traffic_filtering=True,id=966907f1-2c5f-4c34-b155-b1b3b4176f5f,network=Network(d47c1797-a66f-4f2d-b83e-903b5bd3251c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap966907f1-2c') {{(pid=75176) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 15:57:36 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:57:36 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:57:36 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 15:57:36 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:57:36 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cb271ad5-a4c8-574f-84b3-aef12b763629', '_type': 'linux-noop'}}, row=False) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:57:36 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:57:36 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:57:36 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:57:36 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap966907f1-2c, may_exist=True, interface_attrs={}) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:57:36 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap966907f1-2c, col_values=(('qos', UUID('9d00bdb3-4e05-486f-a42c-160b210bd7e5')),), if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:57:36 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap966907f1-2c, col_values=(('external_ids', {'iface-id': '966907f1-2c5f-4c34-b155-b1b3b4176f5f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0d:da:42', 'vm-uuid': '726344c0-a0dc-48d5-a18f-8a258ebde87d'}),), if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:57:36 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:57:36 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:57:36 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:57:36 user nova-compute[75176]: INFO os_vif [None req-e00de3ee-776e-4720-abf7-85b4585913ec tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:da:42,bridge_name='br-int',has_traffic_filtering=True,id=966907f1-2c5f-4c34-b155-b1b3b4176f5f,network=Network(d47c1797-a66f-4f2d-b83e-903b5bd3251c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap966907f1-2c')
Nov 28 15:57:36 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-e00de3ee-776e-4720-abf7-85b4585913ec tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] No BDM found with device name vda, not building metadata. {{(pid=75176) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 15:57:36 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-e00de3ee-776e-4720-abf7-85b4585913ec tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] No VIF found with MAC fa:16:3e:0d:da:42, not building metadata {{(pid=75176) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 15:57:37 user nova-compute[75176]: DEBUG nova.network.neutron [req-400a5cac-7ae9-436f-a9aa-0b22794c357f req-fa1cfb28-7662-49d7-b4c8-1a1d74fba2fb service nova] [instance: 726344c0-a0dc-48d5-a18f-8a258ebde87d] Updated VIF entry in instance network info cache for port 966907f1-2c5f-4c34-b155-b1b3b4176f5f. {{(pid=75176) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 15:57:37 user nova-compute[75176]: DEBUG nova.network.neutron [req-400a5cac-7ae9-436f-a9aa-0b22794c357f req-fa1cfb28-7662-49d7-b4c8-1a1d74fba2fb service nova] [instance: 726344c0-a0dc-48d5-a18f-8a258ebde87d] Updating instance_info_cache with network_info: [{"id": "966907f1-2c5f-4c34-b155-b1b3b4176f5f", "address": "fa:16:3e:0d:da:42", "network": {"id": "d47c1797-a66f-4f2d-b83e-903b5bd3251c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1416388789-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd2856ce0a2545cda0b796eb0be10a40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap966907f1-2c", "ovs_interfaceid": "966907f1-2c5f-4c34-b155-b1b3b4176f5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:57:37 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-400a5cac-7ae9-436f-a9aa-0b22794c357f req-fa1cfb28-7662-49d7-b4c8-1a1d74fba2fb service nova] Releasing lock "refresh_cache-726344c0-a0dc-48d5-a18f-8a258ebde87d" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:57:37 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-11ce2b4c-fb1d-441a-8a4c-e13fe7575468 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Acquiring lock "refresh_cache-2c154591-b130-4aa4-aad4-4c85324512df" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:57:37 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-11ce2b4c-fb1d-441a-8a4c-e13fe7575468 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Acquired lock "refresh_cache-2c154591-b130-4aa4-aad4-4c85324512df" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:57:37 user nova-compute[75176]: DEBUG nova.network.neutron [None req-11ce2b4c-fb1d-441a-8a4c-e13fe7575468 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] [instance: 2c154591-b130-4aa4-aad4-4c85324512df] Building network info cache for instance {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 15:57:37 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:57:37 user nova-compute[75176]: DEBUG nova.network.neutron [None req-11ce2b4c-fb1d-441a-8a4c-e13fe7575468 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] [instance: 2c154591-b130-4aa4-aad4-4c85324512df] Updating instance_info_cache with network_info: [{"id": "c743768f-0b40-435a-8754-96784ae96dda", "address": "fa:16:3e:c1:2c:1c", "network": {"id": "5d0ae041-a67d-4a54-bd53-104c4f44209d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-938551772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "169fdaea89d4431aa6adacdbb76f3546", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc743768f-0b", "ovs_interfaceid": "c743768f-0b40-435a-8754-96784ae96dda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:57:37 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-11ce2b4c-fb1d-441a-8a4c-e13fe7575468 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Releasing lock "refresh_cache-2c154591-b130-4aa4-aad4-4c85324512df" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:57:37 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-11ce2b4c-fb1d-441a-8a4c-e13fe7575468 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] [instance: 2c154591-b130-4aa4-aad4-4c85324512df] Creating instance directory {{(pid=75176) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 15:57:37 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-11ce2b4c-fb1d-441a-8a4c-e13fe7575468 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] [instance: 2c154591-b130-4aa4-aad4-4c85324512df] Creating image(s)
Nov 28 15:57:37 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-11ce2b4c-fb1d-441a-8a4c-e13fe7575468 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Acquiring lock "/opt/stack/data/nova/instances/2c154591-b130-4aa4-aad4-4c85324512df/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:57:37 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-11ce2b4c-fb1d-441a-8a4c-e13fe7575468 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Lock "/opt/stack/data/nova/instances/2c154591-b130-4aa4-aad4-4c85324512df/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:57:37 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-11ce2b4c-fb1d-441a-8a4c-e13fe7575468 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Lock "/opt/stack/data/nova/instances/2c154591-b130-4aa4-aad4-4c85324512df/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:57:37 user nova-compute[75176]: DEBUG nova.objects.instance [None req-11ce2b4c-fb1d-441a-8a4c-e13fe7575468 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Lazy-loading 'trusted_certs' on Instance uuid 2c154591-b130-4aa4-aad4-4c85324512df {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:57:37 user nova-compute[75176]: DEBUG nova.objects.base [None req-11ce2b4c-fb1d-441a-8a4c-e13fe7575468 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Object Instance<2c154591-b130-4aa4-aad4-4c85324512df> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=75176) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 15:57:37 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-11ce2b4c-fb1d-441a-8a4c-e13fe7575468 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Acquiring lock "cbc26ed1db0759708530d18d919dd1a5a6c242dd" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:57:37 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-11ce2b4c-fb1d-441a-8a4c-e13fe7575468 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Lock "cbc26ed1db0759708530d18d919dd1a5a6c242dd" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:57:38 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-11ce2b4c-fb1d-441a-8a4c-e13fe7575468 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbc26ed1db0759708530d18d919dd1a5a6c242dd.part --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:57:38 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:57:38 user nova-compute[75176]: DEBUG nova.compute.manager [req-93fdab3c-fc04-421c-881b-caba0a7007d9 req-66fe33c9-f0c3-45f9-8f87-0e3fd7f56432 service nova] [instance: ecf38787-0a69-4f35-b121-3dc6e70023a1] Received event network-vif-plugged-29444d70-7dc7-4e88-9856-cab5ebd77464 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:57:38 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-93fdab3c-fc04-421c-881b-caba0a7007d9 req-66fe33c9-f0c3-45f9-8f87-0e3fd7f56432 service nova] Acquiring lock "ecf38787-0a69-4f35-b121-3dc6e70023a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:57:38 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-93fdab3c-fc04-421c-881b-caba0a7007d9 req-66fe33c9-f0c3-45f9-8f87-0e3fd7f56432 service nova] Lock "ecf38787-0a69-4f35-b121-3dc6e70023a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:57:38 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-93fdab3c-fc04-421c-881b-caba0a7007d9 req-66fe33c9-f0c3-45f9-8f87-0e3fd7f56432 service nova] Lock "ecf38787-0a69-4f35-b121-3dc6e70023a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:57:38 user nova-compute[75176]: DEBUG nova.compute.manager [req-93fdab3c-fc04-421c-881b-caba0a7007d9 req-66fe33c9-f0c3-45f9-8f87-0e3fd7f56432 service nova] [instance: ecf38787-0a69-4f35-b121-3dc6e70023a1] No waiting events found dispatching network-vif-plugged-29444d70-7dc7-4e88-9856-cab5ebd77464 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:57:38 user nova-compute[75176]: WARNING nova.compute.manager [req-93fdab3c-fc04-421c-881b-caba0a7007d9 req-66fe33c9-f0c3-45f9-8f87-0e3fd7f56432 service nova] [instance: ecf38787-0a69-4f35-b121-3dc6e70023a1] Received unexpected event network-vif-plugged-29444d70-7dc7-4e88-9856-cab5ebd77464 for instance with vm_state building and task_state spawning.
Nov 28 15:57:38 user nova-compute[75176]: DEBUG nova.compute.manager [req-93fdab3c-fc04-421c-881b-caba0a7007d9 req-66fe33c9-f0c3-45f9-8f87-0e3fd7f56432 service nova] [instance: 2c154591-b130-4aa4-aad4-4c85324512df] Received event network-changed-c743768f-0b40-435a-8754-96784ae96dda {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:57:38 user nova-compute[75176]: DEBUG nova.compute.manager [req-93fdab3c-fc04-421c-881b-caba0a7007d9 req-66fe33c9-f0c3-45f9-8f87-0e3fd7f56432 service nova] [instance: 2c154591-b130-4aa4-aad4-4c85324512df] Refreshing instance network info cache due to event network-changed-c743768f-0b40-435a-8754-96784ae96dda. {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 15:57:38 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-93fdab3c-fc04-421c-881b-caba0a7007d9 req-66fe33c9-f0c3-45f9-8f87-0e3fd7f56432 service nova] Acquiring lock "refresh_cache-2c154591-b130-4aa4-aad4-4c85324512df" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:57:38 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-93fdab3c-fc04-421c-881b-caba0a7007d9 req-66fe33c9-f0c3-45f9-8f87-0e3fd7f56432 service nova] Acquired lock "refresh_cache-2c154591-b130-4aa4-aad4-4c85324512df" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:57:38 user nova-compute[75176]: DEBUG nova.network.neutron [req-93fdab3c-fc04-421c-881b-caba0a7007d9 req-66fe33c9-f0c3-45f9-8f87-0e3fd7f56432 service nova] [instance: 2c154591-b130-4aa4-aad4-4c85324512df] Refreshing network info cache for port c743768f-0b40-435a-8754-96784ae96dda {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 15:57:38 user nova-compute[75176]: DEBUG nova.compute.manager [None req-3a4af14c-080e-433b-b608-c23b08e18b52 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: ecf38787-0a69-4f35-b121-3dc6e70023a1] Instance event wait completed in 0 seconds for  {{(pid=75176) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 15:57:38 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-3a4af14c-080e-433b-b608-c23b08e18b52 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: ecf38787-0a69-4f35-b121-3dc6e70023a1] Guest created on hypervisor {{(pid=75176) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 15:57:38 user nova-compute[75176]: INFO nova.virt.libvirt.driver [-] [instance: ecf38787-0a69-4f35-b121-3dc6e70023a1] Instance spawned successfully.
Nov 28 15:57:38 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-3a4af14c-080e-433b-b608-c23b08e18b52 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: ecf38787-0a69-4f35-b121-3dc6e70023a1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 15:57:39 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-3a4af14c-080e-433b-b608-c23b08e18b52 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: ecf38787-0a69-4f35-b121-3dc6e70023a1] Found default for hw_cdrom_bus of ide {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:57:39 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-3a4af14c-080e-433b-b608-c23b08e18b52 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: ecf38787-0a69-4f35-b121-3dc6e70023a1] Found default for hw_disk_bus of virtio {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:57:39 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-3a4af14c-080e-433b-b608-c23b08e18b52 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: ecf38787-0a69-4f35-b121-3dc6e70023a1] Found default for hw_input_bus of None {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:57:39 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-3a4af14c-080e-433b-b608-c23b08e18b52 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: ecf38787-0a69-4f35-b121-3dc6e70023a1] Found default for hw_pointer_model of None {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:57:39 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-3a4af14c-080e-433b-b608-c23b08e18b52 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: ecf38787-0a69-4f35-b121-3dc6e70023a1] Found default for hw_video_model of virtio {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:57:39 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-3a4af14c-080e-433b-b608-c23b08e18b52 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: ecf38787-0a69-4f35-b121-3dc6e70023a1] Found default for hw_vif_model of virtio {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:57:39 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-11ce2b4c-fb1d-441a-8a4c-e13fe7575468 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbc26ed1db0759708530d18d919dd1a5a6c242dd.part --force-share --output=json" returned: 0 in 0.225s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:57:39 user nova-compute[75176]: DEBUG nova.virt.images [None req-11ce2b4c-fb1d-441a-8a4c-e13fe7575468 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] 8d77ced3-9ecf-4009-ba49-2589530341cc was qcow2, converting to raw {{(pid=75176) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 28 15:57:39 user nova-compute[75176]: DEBUG nova.privsep.utils [None req-11ce2b4c-fb1d-441a-8a4c-e13fe7575468 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75176) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 28 15:57:39 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-11ce2b4c-fb1d-441a-8a4c-e13fe7575468 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/cbc26ed1db0759708530d18d919dd1a5a6c242dd.part /opt/stack/data/nova/instances/_base/cbc26ed1db0759708530d18d919dd1a5a6c242dd.converted {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:57:39 user nova-compute[75176]: INFO nova.compute.manager [None req-3a4af14c-080e-433b-b608-c23b08e18b52 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: ecf38787-0a69-4f35-b121-3dc6e70023a1] Took 7.93 seconds to spawn the instance on the hypervisor.
Nov 28 15:57:39 user nova-compute[75176]: DEBUG nova.compute.manager [None req-3a4af14c-080e-433b-b608-c23b08e18b52 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: ecf38787-0a69-4f35-b121-3dc6e70023a1] Checking state {{(pid=75176) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 15:57:39 user nova-compute[75176]: INFO nova.compute.manager [None req-3a4af14c-080e-433b-b608-c23b08e18b52 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: ecf38787-0a69-4f35-b121-3dc6e70023a1] Took 9.04 seconds to build instance.
Nov 28 15:57:39 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-3a4af14c-080e-433b-b608-c23b08e18b52 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Lock "ecf38787-0a69-4f35-b121-3dc6e70023a1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.199s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:57:39 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-11ce2b4c-fb1d-441a-8a4c-e13fe7575468 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/cbc26ed1db0759708530d18d919dd1a5a6c242dd.part /opt/stack/data/nova/instances/_base/cbc26ed1db0759708530d18d919dd1a5a6c242dd.converted" returned: 0 in 0.529s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:57:39 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-11ce2b4c-fb1d-441a-8a4c-e13fe7575468 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbc26ed1db0759708530d18d919dd1a5a6c242dd.converted --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:57:39 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:57:39 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-11ce2b4c-fb1d-441a-8a4c-e13fe7575468 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbc26ed1db0759708530d18d919dd1a5a6c242dd.converted --force-share --output=json" returned: 0 in 0.199s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:57:39 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-11ce2b4c-fb1d-441a-8a4c-e13fe7575468 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Lock "cbc26ed1db0759708530d18d919dd1a5a6c242dd" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.087s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:57:39 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-11ce2b4c-fb1d-441a-8a4c-e13fe7575468 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbc26ed1db0759708530d18d919dd1a5a6c242dd --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:57:39 user nova-compute[75176]: DEBUG nova.network.neutron [req-93fdab3c-fc04-421c-881b-caba0a7007d9 req-66fe33c9-f0c3-45f9-8f87-0e3fd7f56432 service nova] [instance: 2c154591-b130-4aa4-aad4-4c85324512df] Updated VIF entry in instance network info cache for port c743768f-0b40-435a-8754-96784ae96dda. {{(pid=75176) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 15:57:39 user nova-compute[75176]: DEBUG nova.network.neutron [req-93fdab3c-fc04-421c-881b-caba0a7007d9 req-66fe33c9-f0c3-45f9-8f87-0e3fd7f56432 service nova] [instance: 2c154591-b130-4aa4-aad4-4c85324512df] Updating instance_info_cache with network_info: [{"id": "c743768f-0b40-435a-8754-96784ae96dda", "address": "fa:16:3e:c1:2c:1c", "network": {"id": "5d0ae041-a67d-4a54-bd53-104c4f44209d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-938551772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "169fdaea89d4431aa6adacdbb76f3546", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc743768f-0b", "ovs_interfaceid": "c743768f-0b40-435a-8754-96784ae96dda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:57:39 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-93fdab3c-fc04-421c-881b-caba0a7007d9 req-66fe33c9-f0c3-45f9-8f87-0e3fd7f56432 service nova] Releasing lock "refresh_cache-2c154591-b130-4aa4-aad4-4c85324512df" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:57:39 user nova-compute[75176]: DEBUG nova.compute.manager [req-8c784fe3-9bee-40d1-9ff1-638191b1e765 req-5c7ed97e-10dd-40aa-9059-8dfd64856867 service nova] [instance: 726344c0-a0dc-48d5-a18f-8a258ebde87d] Received event network-vif-plugged-966907f1-2c5f-4c34-b155-b1b3b4176f5f {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:57:39 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-8c784fe3-9bee-40d1-9ff1-638191b1e765 req-5c7ed97e-10dd-40aa-9059-8dfd64856867 service nova] Acquiring lock "726344c0-a0dc-48d5-a18f-8a258ebde87d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:57:39 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-8c784fe3-9bee-40d1-9ff1-638191b1e765 req-5c7ed97e-10dd-40aa-9059-8dfd64856867 service nova] Lock "726344c0-a0dc-48d5-a18f-8a258ebde87d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:57:39 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-8c784fe3-9bee-40d1-9ff1-638191b1e765 req-5c7ed97e-10dd-40aa-9059-8dfd64856867 service nova] Lock "726344c0-a0dc-48d5-a18f-8a258ebde87d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:57:39 user nova-compute[75176]: DEBUG nova.compute.manager [req-8c784fe3-9bee-40d1-9ff1-638191b1e765 req-5c7ed97e-10dd-40aa-9059-8dfd64856867 service nova] [instance: 726344c0-a0dc-48d5-a18f-8a258ebde87d] No waiting events found dispatching network-vif-plugged-966907f1-2c5f-4c34-b155-b1b3b4176f5f {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:57:39 user nova-compute[75176]: WARNING nova.compute.manager [req-8c784fe3-9bee-40d1-9ff1-638191b1e765 req-5c7ed97e-10dd-40aa-9059-8dfd64856867 service nova] [instance: 726344c0-a0dc-48d5-a18f-8a258ebde87d] Received unexpected event network-vif-plugged-966907f1-2c5f-4c34-b155-b1b3b4176f5f for instance with vm_state building and task_state spawning.
Nov 28 15:57:39 user nova-compute[75176]: DEBUG nova.compute.manager [req-8c784fe3-9bee-40d1-9ff1-638191b1e765 req-5c7ed97e-10dd-40aa-9059-8dfd64856867 service nova] [instance: 726344c0-a0dc-48d5-a18f-8a258ebde87d] Received event network-vif-plugged-966907f1-2c5f-4c34-b155-b1b3b4176f5f {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:57:39 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-8c784fe3-9bee-40d1-9ff1-638191b1e765 req-5c7ed97e-10dd-40aa-9059-8dfd64856867 service nova] Acquiring lock "726344c0-a0dc-48d5-a18f-8a258ebde87d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:57:39 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-8c784fe3-9bee-40d1-9ff1-638191b1e765 req-5c7ed97e-10dd-40aa-9059-8dfd64856867 service nova] Lock "726344c0-a0dc-48d5-a18f-8a258ebde87d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:57:39 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-8c784fe3-9bee-40d1-9ff1-638191b1e765 req-5c7ed97e-10dd-40aa-9059-8dfd64856867 service nova] Lock "726344c0-a0dc-48d5-a18f-8a258ebde87d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:57:39 user nova-compute[75176]: DEBUG nova.compute.manager [req-8c784fe3-9bee-40d1-9ff1-638191b1e765 req-5c7ed97e-10dd-40aa-9059-8dfd64856867 service nova] [instance: 726344c0-a0dc-48d5-a18f-8a258ebde87d] No waiting events found dispatching network-vif-plugged-966907f1-2c5f-4c34-b155-b1b3b4176f5f {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:57:39 user nova-compute[75176]: WARNING nova.compute.manager [req-8c784fe3-9bee-40d1-9ff1-638191b1e765 req-5c7ed97e-10dd-40aa-9059-8dfd64856867 service nova] [instance: 726344c0-a0dc-48d5-a18f-8a258ebde87d] Received unexpected event network-vif-plugged-966907f1-2c5f-4c34-b155-b1b3b4176f5f for instance with vm_state building and task_state spawning.
Nov 28 15:57:39 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-11ce2b4c-fb1d-441a-8a4c-e13fe7575468 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbc26ed1db0759708530d18d919dd1a5a6c242dd --force-share --output=json" returned: 0 in 0.182s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:57:39 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-11ce2b4c-fb1d-441a-8a4c-e13fe7575468 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Acquiring lock "cbc26ed1db0759708530d18d919dd1a5a6c242dd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:57:40 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-11ce2b4c-fb1d-441a-8a4c-e13fe7575468 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Lock "cbc26ed1db0759708530d18d919dd1a5a6c242dd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:57:40 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-11ce2b4c-fb1d-441a-8a4c-e13fe7575468 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbc26ed1db0759708530d18d919dd1a5a6c242dd --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:57:40 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-11ce2b4c-fb1d-441a-8a4c-e13fe7575468 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbc26ed1db0759708530d18d919dd1a5a6c242dd --force-share --output=json" returned: 0 in 0.218s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:57:40 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-11ce2b4c-fb1d-441a-8a4c-e13fe7575468 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cbc26ed1db0759708530d18d919dd1a5a6c242dd,backing_fmt=raw /opt/stack/data/nova/instances/2c154591-b130-4aa4-aad4-4c85324512df/disk 1073741824 {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:57:40 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-11ce2b4c-fb1d-441a-8a4c-e13fe7575468 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cbc26ed1db0759708530d18d919dd1a5a6c242dd,backing_fmt=raw /opt/stack/data/nova/instances/2c154591-b130-4aa4-aad4-4c85324512df/disk 1073741824" returned: 0 in 0.051s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:57:40 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-11ce2b4c-fb1d-441a-8a4c-e13fe7575468 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Lock "cbc26ed1db0759708530d18d919dd1a5a6c242dd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.282s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:57:40 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-11ce2b4c-fb1d-441a-8a4c-e13fe7575468 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbc26ed1db0759708530d18d919dd1a5a6c242dd --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:57:40 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-11ce2b4c-fb1d-441a-8a4c-e13fe7575468 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbc26ed1db0759708530d18d919dd1a5a6c242dd --force-share --output=json" returned: 0 in 0.221s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:57:40 user nova-compute[75176]: DEBUG nova.objects.instance [None req-11ce2b4c-fb1d-441a-8a4c-e13fe7575468 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Lazy-loading 'migration_context' on Instance uuid 2c154591-b130-4aa4-aad4-4c85324512df {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:57:40 user nova-compute[75176]: DEBUG nova.objects.base [None req-11ce2b4c-fb1d-441a-8a4c-e13fe7575468 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Object Instance<2c154591-b130-4aa4-aad4-4c85324512df> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=75176) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 15:57:40 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-11ce2b4c-fb1d-441a-8a4c-e13fe7575468 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] [instance: 2c154591-b130-4aa4-aad4-4c85324512df] Rebasing disk image.
Nov 28 15:57:40 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-11ce2b4c-fb1d-441a-8a4c-e13fe7575468 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:57:40 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-11ce2b4c-fb1d-441a-8a4c-e13fe7575468 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json" returned: 0 in 0.182s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:57:40 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-11ce2b4c-fb1d-441a-8a4c-e13fe7575468 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 -F raw /opt/stack/data/nova/instances/2c154591-b130-4aa4-aad4-4c85324512df/disk {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:57:41 user nova-compute[75176]: DEBUG nova.compute.manager [None req-e00de3ee-776e-4720-abf7-85b4585913ec tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] [instance: 726344c0-a0dc-48d5-a18f-8a258ebde87d] Instance event wait completed in 0 seconds for  {{(pid=75176) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 15:57:41 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-e00de3ee-776e-4720-abf7-85b4585913ec tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] [instance: 726344c0-a0dc-48d5-a18f-8a258ebde87d] Guest created on hypervisor {{(pid=75176) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 15:57:41 user nova-compute[75176]: INFO nova.virt.libvirt.driver [-] [instance: 726344c0-a0dc-48d5-a18f-8a258ebde87d] Instance spawned successfully.
Nov 28 15:57:41 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-e00de3ee-776e-4720-abf7-85b4585913ec tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] [instance: 726344c0-a0dc-48d5-a18f-8a258ebde87d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 15:57:41 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-e00de3ee-776e-4720-abf7-85b4585913ec tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] [instance: 726344c0-a0dc-48d5-a18f-8a258ebde87d] Found default for hw_cdrom_bus of ide {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:57:41 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-e00de3ee-776e-4720-abf7-85b4585913ec tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] [instance: 726344c0-a0dc-48d5-a18f-8a258ebde87d] Found default for hw_disk_bus of virtio {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:57:41 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-e00de3ee-776e-4720-abf7-85b4585913ec tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] [instance: 726344c0-a0dc-48d5-a18f-8a258ebde87d] Found default for hw_input_bus of None {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:57:41 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-e00de3ee-776e-4720-abf7-85b4585913ec tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] [instance: 726344c0-a0dc-48d5-a18f-8a258ebde87d] Found default for hw_pointer_model of None {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:57:41 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-e00de3ee-776e-4720-abf7-85b4585913ec tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] [instance: 726344c0-a0dc-48d5-a18f-8a258ebde87d] Found default for hw_video_model of virtio {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:57:41 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-e00de3ee-776e-4720-abf7-85b4585913ec tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] [instance: 726344c0-a0dc-48d5-a18f-8a258ebde87d] Found default for hw_vif_model of virtio {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:57:41 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:57:41 user nova-compute[75176]: INFO nova.compute.manager [None req-e00de3ee-776e-4720-abf7-85b4585913ec tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] [instance: 726344c0-a0dc-48d5-a18f-8a258ebde87d] Took 6.95 seconds to spawn the instance on the hypervisor.
Nov 28 15:57:41 user nova-compute[75176]: DEBUG nova.compute.manager [None req-e00de3ee-776e-4720-abf7-85b4585913ec tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] [instance: 726344c0-a0dc-48d5-a18f-8a258ebde87d] Checking state {{(pid=75176) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 15:57:41 user nova-compute[75176]: INFO nova.compute.manager [None req-e00de3ee-776e-4720-abf7-85b4585913ec tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] [instance: 726344c0-a0dc-48d5-a18f-8a258ebde87d] Took 8.03 seconds to build instance.
Nov 28 15:57:41 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-e00de3ee-776e-4720-abf7-85b4585913ec tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Lock "726344c0-a0dc-48d5-a18f-8a258ebde87d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.195s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:57:41 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:57:42 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4a2cf0c2-d8d0-4bc1-9b70-ccb3c2345aeb tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] [instance: e0b7a064-03b6-4a0d-88be-2f12c12a1ddb] Calling os-brick to attach iSCSI Volume {{(pid=75176) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 15:57:42 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a2cf0c2-d8d0-4bc1-9b70-ccb3c2345aeb tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c1b8a00>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0e035375-c026-46d7-ab68-37b8b17529e5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pxWOIKvl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 15:57:42 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-4a2cf0c2-d8d0-4bc1-9b70-ccb3c2345aeb tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 15:57:42 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-4a2cf0c2-d8d0-4bc1-9b70-ccb3c2345aeb tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 15:57:42 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-4a2cf0c2-d8d0-4bc1-9b70-ccb3c2345aeb tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 15:57:42 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-4a2cf0c2-d8d0-4bc1-9b70-ccb3c2345aeb tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 15:57:42 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-4a2cf0c2-d8d0-4bc1-9b70-ccb3c2345aeb tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0e035375-c026-46d7-ab68-37b8b17529e5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 15:57:42 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-4a2cf0c2-d8d0-4bc1-9b70-ccb3c2345aeb tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0e035375-c026-46d7-ab68-37b8b17529e5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 15:57:42 user nova-compute[75176]: INFO os_brick.initiator.connectors.iscsi [None req-4a2cf0c2-d8d0-4bc1-9b70-ccb3c2345aeb tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 15:57:42 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e035375-c026-46d7-ab68-37b8b17529e5 -p 172.16.0.220:3260 {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:57:42 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e035375-c026-46d7-ab68-37b8b17529e5 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:57:42 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[105084dc-b567-4de4-aeb8-76b8b92f2f1e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:57:42 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a2cf0c2-d8d0-4bc1-9b70-ccb3c2345aeb tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 15:57:42 user nova-compute[75176]:  {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:57:42 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e035375-c026-46d7-ab68-37b8b17529e5 -p 172.16.0.220:3260 --interface default --op new {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:57:42 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e035375-c026-46d7-ab68-37b8b17529e5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:57:42 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c8fdfc4-c8dd-45e7-8d46-eedfc2b48a58]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0e035375-c026-46d7-ab68-37b8b17529e5] added\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:57:42 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a2cf0c2-d8d0-4bc1-9b70-ccb3c2345aeb tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0e035375-c026-46d7-ab68-37b8b17529e5] added
Nov 28 15:57:42 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:57:42 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e035375-c026-46d7-ab68-37b8b17529e5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:57:42 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e035375-c026-46d7-ab68-37b8b17529e5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:57:42 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[b145c928-6f45-42ff-a3d9-7e156bcd70ea]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:57:42 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a2cf0c2-d8d0-4bc1-9b70-ccb3c2345aeb tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:57:42 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e035375-c026-46d7-ab68-37b8b17529e5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:57:42 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e035375-c026-46d7-ab68-37b8b17529e5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.053s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:57:42 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[d724ec31-f410-4279-9a60-ea73e3894be8]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:57:42 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a2cf0c2-d8d0-4bc1-9b70-ccb3c2345aeb tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:57:42 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e035375-c026-46d7-ab68-37b8b17529e5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pxWOIKvl {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:57:42 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e035375-c026-46d7-ab68-37b8b17529e5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pxWOIKvl" returned: 0 in 0.032s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:57:42 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[63c8ed0d-9887-4ba9-b6ed-111eefdc1625]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:57:42 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a2cf0c2-d8d0-4bc1-9b70-ccb3c2345aeb tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pxWOIKvl'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:57:42 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e035375-c026-46d7-ab68-37b8b17529e5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:57:42 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e035375-c026-46d7-ab68-37b8b17529e5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.032s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:57:42 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[522f251a-6ec0-40ba-b863-9aded49f5dcb]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:57:42 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a2cf0c2-d8d0-4bc1-9b70-ccb3c2345aeb tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:57:42 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:57:42 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:57:42 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd9ed921-83fb-4058-9720-491eeeaa2ee1]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0 (non-flash)\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:57:42 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a2cf0c2-d8d0-4bc1-9b70-ccb3c2345aeb tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 (non-flash)
Nov 28 15:57:42 user nova-compute[75176]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0 (non-flash)
Nov 28 15:57:42 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:57:42 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a2cf0c2-d8d0-4bc1-9b70-ccb3c2345aeb tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 (non-flash)
Nov 28 15:57:42 user nova-compute[75176]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0 (non-flash)
Nov 28 15:57:42 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 15:57:42 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e035375-c026-46d7-ab68-37b8b17529e5 -p 172.16.0.220:3260 --login {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:57:42 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e035375-c026-46d7-ab68-37b8b17529e5 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:57:42 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[905bea67-330c-41d4-bad5-dd6852a9b927]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0e035375-c026-46d7-ab68-37b8b17529e5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0e035375-c026-46d7-ab68-37b8b17529e5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:57:42 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a2cf0c2-d8d0-4bc1-9b70-ccb3c2345aeb tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0e035375-c026-46d7-ab68-37b8b17529e5, portal: 172.16.0.220,3260]
Nov 28 15:57:42 user nova-compute[75176]: Login to [iface: default, target: iqn.2010-10.org.openstack:0e035375-c026-46d7-ab68-37b8b17529e5, portal: 172.16.0.220,3260] successful.
Nov 28 15:57:42 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:57:42 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e035375-c026-46d7-ab68-37b8b17529e5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:57:42 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e035375-c026-46d7-ab68-37b8b17529e5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:57:42 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca749576-ce43-461f-9993-b02d3b0fd007]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:57:42 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a2cf0c2-d8d0-4bc1-9b70-ccb3c2345aeb tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:57:42 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:57:42 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.042s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:57:42 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[81a9f674-2de7-4d6f-b388-7616a5475f71]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e035375-c026-46d7-ab68-37b8b17529e5 (non-flash)\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:57:42 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a2cf0c2-d8d0-4bc1-9b70-ccb3c2345aeb tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 (non-flash)
Nov 28 15:57:42 user nova-compute[75176]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0 (non-flash)
Nov 28 15:57:42 user nova-compute[75176]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e035375-c026-46d7-ab68-37b8b17529e5 (non-flash)
Nov 28 15:57:42 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:57:42 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a2cf0c2-d8d0-4bc1-9b70-ccb3c2345aeb tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 (non-flash)
Nov 28 15:57:42 user nova-compute[75176]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0 (non-flash)
Nov 28 15:57:42 user nova-compute[75176]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e035375-c026-46d7-ab68-37b8b17529e5 (non-flash)
Nov 28 15:57:42 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 15:57:42 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-4a2cf0c2-d8d0-4bc1-9b70-ccb3c2345aeb tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0e035375-c026-46d7-ab68-37b8b17529e5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.396s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 15:57:42 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a2cf0c2-d8d0-4bc1-9b70-ccb3c2345aeb tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Connected to 172.16.0.220:3260 {{(pid=75176) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 15:57:42 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-4a2cf0c2-d8d0-4bc1-9b70-ccb3c2345aeb tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] HCTL ('34', '-', '-', 0) found on session 49 with lun 0 {{(pid=75176) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 15:57:42 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-4a2cf0c2-d8d0-4bc1-9b70-ccb3c2345aeb tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75176) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 15:57:42 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:57:42 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:57:42 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ee221bd-de70-4981-ab83-37336d18ac63]: (4, ('- - 0', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:57:42 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-4a2cf0c2-d8d0-4bc1-9b70-ccb3c2345aeb tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Searching for a device in session 49 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75176) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 15:57:42 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a2cf0c2-d8d0-4bc1-9b70-ccb3c2345aeb tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:0e035375-c026-46d7-ab68-37b8b17529e5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pxWOIKvl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75176) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 15:57:43 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-11ce2b4c-fb1d-441a-8a4c-e13fe7575468 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 -F raw /opt/stack/data/nova/instances/2c154591-b130-4aa4-aad4-4c85324512df/disk" returned: 0 in 2.476s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:57:43 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-11ce2b4c-fb1d-441a-8a4c-e13fe7575468 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] [instance: 2c154591-b130-4aa4-aad4-4c85324512df] Created local disks {{(pid=75176) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 15:57:43 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-11ce2b4c-fb1d-441a-8a4c-e13fe7575468 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] [instance: 2c154591-b130-4aa4-aad4-4c85324512df] Ensure instance console log exists: /opt/stack/data/nova/instances/2c154591-b130-4aa4-aad4-4c85324512df/console.log {{(pid=75176) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 15:57:43 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-11ce2b4c-fb1d-441a-8a4c-e13fe7575468 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:57:43 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-11ce2b4c-fb1d-441a-8a4c-e13fe7575468 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:57:43 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-11ce2b4c-fb1d-441a-8a4c-e13fe7575468 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:57:43 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-11ce2b4c-fb1d-441a-8a4c-e13fe7575468 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] [instance: 2c154591-b130-4aa4-aad4-4c85324512df] Start _get_guest_xml network_info=[{"id": "c743768f-0b40-435a-8754-96784ae96dda", "address": "fa:16:3e:c1:2c:1c", "network": {"id": "5d0ae041-a67d-4a54-bd53-104c4f44209d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-938551772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "169fdaea89d4431aa6adacdbb76f3546", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc743768f-0b", "ovs_interfaceid": "c743768f-0b40-435a-8754-96784ae96dda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='56d42b7690362b03d2cb0afbbad30e41',container_format='bare',created_at=2023-11-28T15:55:42Z,direct_url=<?>,disk_format='qcow2',id=8d77ced3-9ecf-4009-ba49-2589530341cc,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-130212440-shelved',owner='169fdaea89d4431aa6adacdbb76f3546',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-28T15:55:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'size': 0, 'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'image_id': '1f41819e-c93f-4dc7-b253-37a27bbbbc74'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75176) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 15:57:43 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-11ce2b4c-fb1d-441a-8a4c-e13fe7575468 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 15:57:43 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-11ce2b4c-fb1d-441a-8a4c-e13fe7575468 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 15:57:43 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-11ce2b4c-fb1d-441a-8a4c-e13fe7575468 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75176) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 15:57:43 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-11ce2b4c-fb1d-441a-8a4c-e13fe7575468 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] CPU controller missing on host. {{(pid=75176) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 15:57:43 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-11ce2b4c-fb1d-441a-8a4c-e13fe7575468 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75176) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 15:57:43 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-11ce2b4c-fb1d-441a-8a4c-e13fe7575468 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] CPU controller found on host. {{(pid=75176) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 15:57:43 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-11ce2b4c-fb1d-441a-8a4c-e13fe7575468 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75176) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 15:57:43 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-11ce2b4c-fb1d-441a-8a4c-e13fe7575468 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T15:35:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='56d42b7690362b03d2cb0afbbad30e41',container_format='bare',created_at=2023-11-28T15:55:42Z,direct_url=<?>,disk_format='qcow2',id=8d77ced3-9ecf-4009-ba49-2589530341cc,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-130212440-shelved',owner='169fdaea89d4431aa6adacdbb76f3546',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-28T15:55:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 15:57:43 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-11ce2b4c-fb1d-441a-8a4c-e13fe7575468 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Flavor limits 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 15:57:43 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-11ce2b4c-fb1d-441a-8a4c-e13fe7575468 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Image limits 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 15:57:43 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-11ce2b4c-fb1d-441a-8a4c-e13fe7575468 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Flavor pref 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 15:57:43 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-11ce2b4c-fb1d-441a-8a4c-e13fe7575468 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Image pref 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 15:57:43 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-11ce2b4c-fb1d-441a-8a4c-e13fe7575468 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 15:57:43 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-11ce2b4c-fb1d-441a-8a4c-e13fe7575468 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 15:57:43 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-11ce2b4c-fb1d-441a-8a4c-e13fe7575468 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75176) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 15:57:43 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-11ce2b4c-fb1d-441a-8a4c-e13fe7575468 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Got 1 possible topologies {{(pid=75176) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 15:57:43 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-11ce2b4c-fb1d-441a-8a4c-e13fe7575468 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 15:57:43 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-11ce2b4c-fb1d-441a-8a4c-e13fe7575468 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 15:57:43 user nova-compute[75176]: DEBUG nova.objects.instance [None req-11ce2b4c-fb1d-441a-8a4c-e13fe7575468 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Lazy-loading 'vcpu_model' on Instance uuid 2c154591-b130-4aa4-aad4-4c85324512df {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:57:43 user nova-compute[75176]: DEBUG nova.objects.base [None req-11ce2b4c-fb1d-441a-8a4c-e13fe7575468 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Object Instance<2c154591-b130-4aa4-aad4-4c85324512df> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=75176) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 15:57:43 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-11ce2b4c-fb1d-441a-8a4c-e13fe7575468 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-28T15:53:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-130212440',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-130212440',id=39,image_ref='8d77ced3-9ecf-4009-ba49-2589530341cc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-780187379',keypairs=<?>,launch_index=0,launched_at=2023-11-28T15:53:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='169fdaea89d4431aa6adacdbb76f3546',ramdisk_id='',reservation_id='r-cpedp58n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1264107218',owner_user_name='tempest-AttachVolumeShelveTestJSON-1264107218-project-member',shelved_at='2023-11-28T15:55:46.363341',shelved_host='user',shelved_image_id='8d77ced3-9ecf-4009-ba49-2589530341cc'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T15:57:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3146d6b1e7324ebaa62ade09f1d1c68f',uuid=2c154591-b130-4aa4-aad4-4c85324512df,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "c743768f-0b40-435a-8754-96784ae96dda", "address": "fa:16:3e:c1:2c:1c", "network": {"id": "5d0ae041-a67d-4a54-bd53-104c4f44209d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-938551772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "169fdaea89d4431aa6adacdbb76f3546", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc743768f-0b", "ovs_interfaceid": "c743768f-0b40-435a-8754-96784ae96dda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75176) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 15:57:43 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-11ce2b4c-fb1d-441a-8a4c-e13fe7575468 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Converting VIF {"id": "c743768f-0b40-435a-8754-96784ae96dda", "address": "fa:16:3e:c1:2c:1c", "network": {"id": "5d0ae041-a67d-4a54-bd53-104c4f44209d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-938551772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "169fdaea89d4431aa6adacdbb76f3546", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc743768f-0b", "ovs_interfaceid": "c743768f-0b40-435a-8754-96784ae96dda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:57:43 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-11ce2b4c-fb1d-441a-8a4c-e13fe7575468 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:2c:1c,bridge_name='br-int',has_traffic_filtering=True,id=c743768f-0b40-435a-8754-96784ae96dda,network=Network(5d0ae041-a67d-4a54-bd53-104c4f44209d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc743768f-0b') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:57:43 user nova-compute[75176]: DEBUG nova.objects.instance [None req-11ce2b4c-fb1d-441a-8a4c-e13fe7575468 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Lazy-loading 'pci_devices' on Instance uuid 2c154591-b130-4aa4-aad4-4c85324512df {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:57:43 user nova-compute[75176]: DEBUG nova.objects.base [None req-11ce2b4c-fb1d-441a-8a4c-e13fe7575468 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Object Instance<2c154591-b130-4aa4-aad4-4c85324512df> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=75176) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 15:57:43 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-11ce2b4c-fb1d-441a-8a4c-e13fe7575468 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] [instance: 2c154591-b130-4aa4-aad4-4c85324512df] End _get_guest_xml xml=<domain type="kvm">
Nov 28 15:57:43 user nova-compute[75176]:   <uuid>2c154591-b130-4aa4-aad4-4c85324512df</uuid>
Nov 28 15:57:43 user nova-compute[75176]:   <name>instance-00000027</name>
Nov 28 15:57:43 user nova-compute[75176]:   <memory>524288</memory>
Nov 28 15:57:43 user nova-compute[75176]:   <vcpu>1</vcpu>
Nov 28 15:57:43 user nova-compute[75176]:   <metadata>
Nov 28 15:57:43 user nova-compute[75176]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 15:57:43 user nova-compute[75176]:       <nova:package version="0.0.0"/>
Nov 28 15:57:43 user nova-compute[75176]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-130212440</nova:name>
Nov 28 15:57:43 user nova-compute[75176]:       <nova:creationTime>2023-11-28 15:57:43</nova:creationTime>
Nov 28 15:57:43 user nova-compute[75176]:       <nova:flavor name="m1.tiny">
Nov 28 15:57:43 user nova-compute[75176]:         <nova:memory>512</nova:memory>
Nov 28 15:57:43 user nova-compute[75176]:         <nova:disk>1</nova:disk>
Nov 28 15:57:43 user nova-compute[75176]:         <nova:swap>0</nova:swap>
Nov 28 15:57:43 user nova-compute[75176]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 15:57:43 user nova-compute[75176]:         <nova:vcpus>1</nova:vcpus>
Nov 28 15:57:43 user nova-compute[75176]:       </nova:flavor>
Nov 28 15:57:43 user nova-compute[75176]:       <nova:owner>
Nov 28 15:57:43 user nova-compute[75176]:         <nova:user uuid="3146d6b1e7324ebaa62ade09f1d1c68f">tempest-AttachVolumeShelveTestJSON-1264107218-project-member</nova:user>
Nov 28 15:57:43 user nova-compute[75176]:         <nova:project uuid="169fdaea89d4431aa6adacdbb76f3546">tempest-AttachVolumeShelveTestJSON-1264107218</nova:project>
Nov 28 15:57:43 user nova-compute[75176]:       </nova:owner>
Nov 28 15:57:43 user nova-compute[75176]:       <nova:root type="image" uuid="8d77ced3-9ecf-4009-ba49-2589530341cc"/>
Nov 28 15:57:43 user nova-compute[75176]:       <nova:ports>
Nov 28 15:57:43 user nova-compute[75176]:         <nova:port uuid="c743768f-0b40-435a-8754-96784ae96dda">
Nov 28 15:57:43 user nova-compute[75176]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 28 15:57:43 user nova-compute[75176]:         </nova:port>
Nov 28 15:57:43 user nova-compute[75176]:       </nova:ports>
Nov 28 15:57:43 user nova-compute[75176]:     </nova:instance>
Nov 28 15:57:43 user nova-compute[75176]:   </metadata>
Nov 28 15:57:43 user nova-compute[75176]:   <sysinfo type="smbios">
Nov 28 15:57:43 user nova-compute[75176]:     <system>
Nov 28 15:57:43 user nova-compute[75176]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 15:57:43 user nova-compute[75176]:       <entry name="product">OpenStack Nova</entry>
Nov 28 15:57:43 user nova-compute[75176]:       <entry name="version">0.0.0</entry>
Nov 28 15:57:43 user nova-compute[75176]:       <entry name="serial">2c154591-b130-4aa4-aad4-4c85324512df</entry>
Nov 28 15:57:43 user nova-compute[75176]:       <entry name="uuid">2c154591-b130-4aa4-aad4-4c85324512df</entry>
Nov 28 15:57:43 user nova-compute[75176]:       <entry name="family">Virtual Machine</entry>
Nov 28 15:57:43 user nova-compute[75176]:     </system>
Nov 28 15:57:43 user nova-compute[75176]:   </sysinfo>
Nov 28 15:57:43 user nova-compute[75176]:   <os>
Nov 28 15:57:43 user nova-compute[75176]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 15:57:43 user nova-compute[75176]:     <boot dev="hd"/>
Nov 28 15:57:43 user nova-compute[75176]:     <smbios mode="sysinfo"/>
Nov 28 15:57:43 user nova-compute[75176]:   </os>
Nov 28 15:57:43 user nova-compute[75176]:   <features>
Nov 28 15:57:43 user nova-compute[75176]:     <acpi/>
Nov 28 15:57:43 user nova-compute[75176]:     <apic/>
Nov 28 15:57:43 user nova-compute[75176]:     <vmcoreinfo/>
Nov 28 15:57:43 user nova-compute[75176]:   </features>
Nov 28 15:57:43 user nova-compute[75176]:   <clock offset="utc">
Nov 28 15:57:43 user nova-compute[75176]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 15:57:43 user nova-compute[75176]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 15:57:43 user nova-compute[75176]:     <timer name="hpet" present="no"/>
Nov 28 15:57:43 user nova-compute[75176]:   </clock>
Nov 28 15:57:43 user nova-compute[75176]:   <cpu mode="custom" match="exact">
Nov 28 15:57:43 user nova-compute[75176]:     <model>Nehalem</model>
Nov 28 15:57:43 user nova-compute[75176]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 15:57:43 user nova-compute[75176]:   </cpu>
Nov 28 15:57:43 user nova-compute[75176]:   <devices>
Nov 28 15:57:43 user nova-compute[75176]:     <disk type="file" device="disk">
Nov 28 15:57:43 user nova-compute[75176]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 15:57:43 user nova-compute[75176]:       <source file="/opt/stack/data/nova/instances/2c154591-b130-4aa4-aad4-4c85324512df/disk"/>
Nov 28 15:57:43 user nova-compute[75176]:       <target dev="vda" bus="virtio"/>
Nov 28 15:57:43 user nova-compute[75176]:     </disk>
Nov 28 15:57:43 user nova-compute[75176]:     <interface type="ethernet">
Nov 28 15:57:43 user nova-compute[75176]:       <mac address="fa:16:3e:c1:2c:1c"/>
Nov 28 15:57:43 user nova-compute[75176]:       <model type="virtio"/>
Nov 28 15:57:43 user nova-compute[75176]:       <mtu size="1442"/>
Nov 28 15:57:43 user nova-compute[75176]:       <target dev="tapc743768f-0b"/>
Nov 28 15:57:43 user nova-compute[75176]:     </interface>
Nov 28 15:57:43 user nova-compute[75176]:     <serial type="pty">
Nov 28 15:57:43 user nova-compute[75176]:       <log file="/opt/stack/data/nova/instances/2c154591-b130-4aa4-aad4-4c85324512df/console.log" append="off"/>
Nov 28 15:57:43 user nova-compute[75176]:     </serial>
Nov 28 15:57:43 user nova-compute[75176]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 15:57:43 user nova-compute[75176]:     <video>
Nov 28 15:57:43 user nova-compute[75176]:       <model type="virtio"/>
Nov 28 15:57:43 user nova-compute[75176]:     </video>
Nov 28 15:57:43 user nova-compute[75176]:     <rng model="virtio">
Nov 28 15:57:43 user nova-compute[75176]:       <backend model="random">/dev/urandom</backend>
Nov 28 15:57:43 user nova-compute[75176]:     </rng>
Nov 28 15:57:43 user nova-compute[75176]:     <controller type="usb" index="0" model="none"/>
Nov 28 15:57:43 user nova-compute[75176]:     <memballoon model="virtio">
Nov 28 15:57:43 user nova-compute[75176]:       <stats period="10"/>
Nov 28 15:57:43 user nova-compute[75176]:     </memballoon>
Nov 28 15:57:43 user nova-compute[75176]:   </devices>
Nov 28 15:57:43 user nova-compute[75176]: </domain>
Nov 28 15:57:43 user nova-compute[75176]:  {{(pid=75176) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 15:57:43 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-11ce2b4c-fb1d-441a-8a4c-e13fe7575468 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-28T15:53:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-130212440',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-130212440',id=39,image_ref='8d77ced3-9ecf-4009-ba49-2589530341cc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-780187379',keypairs=<?>,launch_index=0,launched_at=2023-11-28T15:53:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='169fdaea89d4431aa6adacdbb76f3546',ramdisk_id='',reservation_id='r-cpedp58n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1264107218',owner_user_name='tempest-AttachVolumeShelveTestJSON-1264107218-project-member',shelved_at='2023-11-28T15:55:46.363341',shelved_host='user',shelved_image_id='8d77ced3-9ecf-4009-ba49-2589530341cc'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T15:57:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3146d6b1e7324ebaa62ade09f1d1c68f',uuid=2c154591-b130-4aa4-aad4-4c85324512df,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "c743768f-0b40-435a-8754-96784ae96dda", "address": "fa:16:3e:c1:2c:1c", "network": {"id": "5d0ae041-a67d-4a54-bd53-104c4f44209d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-938551772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "169fdaea89d4431aa6adacdbb76f3546", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc743768f-0b", "ovs_interfaceid": "c743768f-0b40-435a-8754-96784ae96dda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 15:57:43 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-11ce2b4c-fb1d-441a-8a4c-e13fe7575468 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Converting VIF {"id": "c743768f-0b40-435a-8754-96784ae96dda", "address": "fa:16:3e:c1:2c:1c", "network": {"id": "5d0ae041-a67d-4a54-bd53-104c4f44209d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-938551772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "169fdaea89d4431aa6adacdbb76f3546", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc743768f-0b", "ovs_interfaceid": "c743768f-0b40-435a-8754-96784ae96dda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:57:43 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-11ce2b4c-fb1d-441a-8a4c-e13fe7575468 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:2c:1c,bridge_name='br-int',has_traffic_filtering=True,id=c743768f-0b40-435a-8754-96784ae96dda,network=Network(5d0ae041-a67d-4a54-bd53-104c4f44209d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc743768f-0b') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:57:43 user nova-compute[75176]: DEBUG os_vif [None req-11ce2b4c-fb1d-441a-8a4c-e13fe7575468 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:2c:1c,bridge_name='br-int',has_traffic_filtering=True,id=c743768f-0b40-435a-8754-96784ae96dda,network=Network(5d0ae041-a67d-4a54-bd53-104c4f44209d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc743768f-0b') {{(pid=75176) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 15:57:43 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:57:43 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:57:43 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 15:57:43 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:57:43 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2cbf83f5-63ba-5c1e-b1b9-40369d84d2bc', '_type': 'linux-noop'}}, row=False) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:57:43 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:57:43 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:57:43 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:57:43 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc743768f-0b, may_exist=True, interface_attrs={}) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:57:43 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc743768f-0b, col_values=(('qos', UUID('e0cb6678-27a0-402f-a954-2453d5ef8fbc')),), if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:57:43 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc743768f-0b, col_values=(('external_ids', {'iface-id': 'c743768f-0b40-435a-8754-96784ae96dda', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c1:2c:1c', 'vm-uuid': '2c154591-b130-4aa4-aad4-4c85324512df'}),), if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:57:43 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:57:43 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:57:43 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:57:43 user nova-compute[75176]: INFO os_vif [None req-11ce2b4c-fb1d-441a-8a4c-e13fe7575468 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:2c:1c,bridge_name='br-int',has_traffic_filtering=True,id=c743768f-0b40-435a-8754-96784ae96dda,network=Network(5d0ae041-a67d-4a54-bd53-104c4f44209d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc743768f-0b')
Nov 28 15:57:43 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-11ce2b4c-fb1d-441a-8a4c-e13fe7575468 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] No BDM found with device name vda, not building metadata. {{(pid=75176) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 15:57:43 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-11ce2b4c-fb1d-441a-8a4c-e13fe7575468 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] No VIF found with MAC fa:16:3e:c1:2c:1c, not building metadata {{(pid=75176) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 15:57:43 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-4a2cf0c2-d8d0-4bc1-9b70-ccb3c2345aeb tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.439s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 15:57:43 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a2cf0c2-d8d0-4bc1-9b70-ccb3c2345aeb tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] <== connect_volume: return (1441ms) {'type': 'block', 'scsi_wwn': '23166346532393565', 'path': '/dev/sdc'} {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 15:57:43 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4a2cf0c2-d8d0-4bc1-9b70-ccb3c2345aeb tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] [instance: e0b7a064-03b6-4a0d-88be-2f12c12a1ddb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23166346532393565', 'path': '/dev/sdc'} {{(pid=75176) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 15:57:43 user nova-compute[75176]: DEBUG nova.objects.instance [None req-4a2cf0c2-d8d0-4bc1-9b70-ccb3c2345aeb tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Lazy-loading 'flavor' on Instance uuid e0b7a064-03b6-4a0d-88be-2f12c12a1ddb {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:57:43 user nova-compute[75176]: DEBUG nova.virt.libvirt.guest [None req-4a2cf0c2-d8d0-4bc1-9b70-ccb3c2345aeb tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 15:57:43 user nova-compute[75176]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 15:57:43 user nova-compute[75176]:   <source dev="/dev/sdc"/>
Nov 28 15:57:43 user nova-compute[75176]:   <target dev="vdb" bus="virtio"/>
Nov 28 15:57:43 user nova-compute[75176]:   <serial>0e035375-c026-46d7-ab68-37b8b17529e5</serial>
Nov 28 15:57:43 user nova-compute[75176]: </disk>
Nov 28 15:57:43 user nova-compute[75176]:  {{(pid=75176) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 15:57:44 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-4a2cf0c2-d8d0-4bc1-9b70-ccb3c2345aeb tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] No BDM found with device name vda, not building metadata. {{(pid=75176) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 15:57:44 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-4a2cf0c2-d8d0-4bc1-9b70-ccb3c2345aeb tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75176) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 15:57:44 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-4a2cf0c2-d8d0-4bc1-9b70-ccb3c2345aeb tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] No VIF found with MAC fa:16:3e:92:22:dd, not building metadata {{(pid=75176) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 15:57:44 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-4a2cf0c2-d8d0-4bc1-9b70-ccb3c2345aeb tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Lock "e0b7a064-03b6-4a0d-88be-2f12c12a1ddb" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.083s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:57:44 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:57:45 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:57:45 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:57:45 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:57:45 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:57:45 user nova-compute[75176]: DEBUG nova.compute.manager [req-a14c1103-cabc-4f03-bc04-39bc4bdfd349 req-15cc8dbd-c46f-43eb-9300-f229591f01f4 service nova] [instance: 2c154591-b130-4aa4-aad4-4c85324512df] Received event network-vif-plugged-c743768f-0b40-435a-8754-96784ae96dda {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:57:45 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-a14c1103-cabc-4f03-bc04-39bc4bdfd349 req-15cc8dbd-c46f-43eb-9300-f229591f01f4 service nova] Acquiring lock "2c154591-b130-4aa4-aad4-4c85324512df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:57:45 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-a14c1103-cabc-4f03-bc04-39bc4bdfd349 req-15cc8dbd-c46f-43eb-9300-f229591f01f4 service nova] Lock "2c154591-b130-4aa4-aad4-4c85324512df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:57:45 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-a14c1103-cabc-4f03-bc04-39bc4bdfd349 req-15cc8dbd-c46f-43eb-9300-f229591f01f4 service nova] Lock "2c154591-b130-4aa4-aad4-4c85324512df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:57:45 user nova-compute[75176]: DEBUG nova.compute.manager [req-a14c1103-cabc-4f03-bc04-39bc4bdfd349 req-15cc8dbd-c46f-43eb-9300-f229591f01f4 service nova] [instance: 2c154591-b130-4aa4-aad4-4c85324512df] No waiting events found dispatching network-vif-plugged-c743768f-0b40-435a-8754-96784ae96dda {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:57:45 user nova-compute[75176]: WARNING nova.compute.manager [req-a14c1103-cabc-4f03-bc04-39bc4bdfd349 req-15cc8dbd-c46f-43eb-9300-f229591f01f4 service nova] [instance: 2c154591-b130-4aa4-aad4-4c85324512df] Received unexpected event network-vif-plugged-c743768f-0b40-435a-8754-96784ae96dda for instance with vm_state shelved_offloaded and task_state spawning.
Nov 28 15:57:45 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:57:45 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:57:45 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:57:45 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:57:47 user nova-compute[75176]: DEBUG nova.compute.manager [req-53af2dcc-41ed-432d-b88d-206c4c870a51 req-cab0107a-e3eb-4714-91a7-bbb19c1a2a8d service nova] [instance: 2c154591-b130-4aa4-aad4-4c85324512df] Received event network-vif-plugged-c743768f-0b40-435a-8754-96784ae96dda {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:57:47 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-53af2dcc-41ed-432d-b88d-206c4c870a51 req-cab0107a-e3eb-4714-91a7-bbb19c1a2a8d service nova] Acquiring lock "2c154591-b130-4aa4-aad4-4c85324512df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:57:47 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-53af2dcc-41ed-432d-b88d-206c4c870a51 req-cab0107a-e3eb-4714-91a7-bbb19c1a2a8d service nova] Lock "2c154591-b130-4aa4-aad4-4c85324512df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:57:47 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-53af2dcc-41ed-432d-b88d-206c4c870a51 req-cab0107a-e3eb-4714-91a7-bbb19c1a2a8d service nova] Lock "2c154591-b130-4aa4-aad4-4c85324512df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:57:47 user nova-compute[75176]: DEBUG nova.compute.manager [req-53af2dcc-41ed-432d-b88d-206c4c870a51 req-cab0107a-e3eb-4714-91a7-bbb19c1a2a8d service nova] [instance: 2c154591-b130-4aa4-aad4-4c85324512df] No waiting events found dispatching network-vif-plugged-c743768f-0b40-435a-8754-96784ae96dda {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:57:47 user nova-compute[75176]: WARNING nova.compute.manager [req-53af2dcc-41ed-432d-b88d-206c4c870a51 req-cab0107a-e3eb-4714-91a7-bbb19c1a2a8d service nova] [instance: 2c154591-b130-4aa4-aad4-4c85324512df] Received unexpected event network-vif-plugged-c743768f-0b40-435a-8754-96784ae96dda for instance with vm_state shelved_offloaded and task_state spawning.
Nov 28 15:57:47 user nova-compute[75176]: DEBUG nova.compute.manager [None req-11ce2b4c-fb1d-441a-8a4c-e13fe7575468 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] [instance: 2c154591-b130-4aa4-aad4-4c85324512df] Instance event wait completed in 0 seconds for  {{(pid=75176) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 15:57:47 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-11ce2b4c-fb1d-441a-8a4c-e13fe7575468 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] [instance: 2c154591-b130-4aa4-aad4-4c85324512df] Guest created on hypervisor {{(pid=75176) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 15:57:47 user nova-compute[75176]: INFO nova.virt.libvirt.driver [-] [instance: 2c154591-b130-4aa4-aad4-4c85324512df] Instance spawned successfully.
Nov 28 15:57:48 user nova-compute[75176]: DEBUG nova.compute.manager [None req-11ce2b4c-fb1d-441a-8a4c-e13fe7575468 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] [instance: 2c154591-b130-4aa4-aad4-4c85324512df] Checking state {{(pid=75176) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 15:57:48 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-11ce2b4c-fb1d-441a-8a4c-e13fe7575468 tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Lock "2c154591-b130-4aa4-aad4-4c85324512df" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 13.528s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:57:48 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:57:49 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:57:53 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:57:54 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:57:56 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:57:56 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:57:58 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:57:58 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-0cb39600-b06c-49b6-a58a-2190c785de55 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Acquiring lock "e0b7a064-03b6-4a0d-88be-2f12c12a1ddb" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:57:58 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-0cb39600-b06c-49b6-a58a-2190c785de55 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Lock "e0b7a064-03b6-4a0d-88be-2f12c12a1ddb" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:57:58 user nova-compute[75176]: INFO nova.compute.manager [None req-0cb39600-b06c-49b6-a58a-2190c785de55 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] [instance: e0b7a064-03b6-4a0d-88be-2f12c12a1ddb] Detaching volume 0e035375-c026-46d7-ab68-37b8b17529e5
Nov 28 15:57:58 user nova-compute[75176]: INFO nova.virt.block_device [None req-0cb39600-b06c-49b6-a58a-2190c785de55 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] [instance: e0b7a064-03b6-4a0d-88be-2f12c12a1ddb] Attempting to driver detach volume 0e035375-c026-46d7-ab68-37b8b17529e5 from mountpoint /dev/vdb
Nov 28 15:57:58 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-0cb39600-b06c-49b6-a58a-2190c785de55 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Attempting to detach device vdb from instance e0b7a064-03b6-4a0d-88be-2f12c12a1ddb from the persistent domain config. {{(pid=75176) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 15:57:58 user nova-compute[75176]: DEBUG nova.virt.libvirt.guest [None req-0cb39600-b06c-49b6-a58a-2190c785de55 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 15:57:58 user nova-compute[75176]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 15:57:58 user nova-compute[75176]:   <source dev="/dev/sdc"/>
Nov 28 15:57:58 user nova-compute[75176]:   <target dev="vdb" bus="virtio"/>
Nov 28 15:57:58 user nova-compute[75176]:   <serial>0e035375-c026-46d7-ab68-37b8b17529e5</serial>
Nov 28 15:57:58 user nova-compute[75176]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 15:57:58 user nova-compute[75176]: </disk>
Nov 28 15:57:58 user nova-compute[75176]:  {{(pid=75176) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 15:57:58 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-0cb39600-b06c-49b6-a58a-2190c785de55 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Successfully detached device vdb from instance e0b7a064-03b6-4a0d-88be-2f12c12a1ddb from the persistent domain config.
Nov 28 15:57:58 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-0cb39600-b06c-49b6-a58a-2190c785de55 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e0b7a064-03b6-4a0d-88be-2f12c12a1ddb from the live domain config. {{(pid=75176) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 15:57:58 user nova-compute[75176]: DEBUG nova.virt.libvirt.guest [None req-0cb39600-b06c-49b6-a58a-2190c785de55 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 15:57:58 user nova-compute[75176]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 15:57:58 user nova-compute[75176]:   <source dev="/dev/sdc"/>
Nov 28 15:57:58 user nova-compute[75176]:   <target dev="vdb" bus="virtio"/>
Nov 28 15:57:58 user nova-compute[75176]:   <serial>0e035375-c026-46d7-ab68-37b8b17529e5</serial>
Nov 28 15:57:58 user nova-compute[75176]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 15:57:58 user nova-compute[75176]: </disk>
Nov 28 15:57:58 user nova-compute[75176]:  {{(pid=75176) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 15:57:59 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-0cb39600-b06c-49b6-a58a-2190c785de55 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e0b7a064-03b6-4a0d-88be-2f12c12a1ddb {{(pid=75176) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 15:57:59 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:57:59 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:58:01 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:58:03 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:58:04 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:58:04 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75176) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 15:58:04 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:58:05 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:58:05 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:58:07 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:58:07 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Starting heal instance info cache {{(pid=75176) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 15:58:07 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Rebuilding the list of instances to heal {{(pid=75176) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 15:58:07 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquiring lock "refresh_cache-2e8507b7-fccf-4196-b589-bf2b74f165ec" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:58:07 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquired lock "refresh_cache-2e8507b7-fccf-4196-b589-bf2b74f165ec" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:58:07 user nova-compute[75176]: DEBUG nova.network.neutron [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] [instance: 2e8507b7-fccf-4196-b589-bf2b74f165ec] Forcefully refreshing network info cache for instance {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 15:58:07 user nova-compute[75176]: DEBUG nova.objects.instance [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lazy-loading 'info_cache' on Instance uuid 2e8507b7-fccf-4196-b589-bf2b74f165ec {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:58:08 user nova-compute[75176]: DEBUG nova.network.neutron [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] [instance: 2e8507b7-fccf-4196-b589-bf2b74f165ec] Updating instance_info_cache with network_info: [{"id": "3dc67fc3-7fcf-4655-8dbd-22febf2be39e", "address": "fa:16:3e:04:68:53", "network": {"id": "8b63f2d3-0683-4832-abc5-e4c796cf12ab", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-877608435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3704b38a2bd44cb78c28d3f6d86d9e60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dc67fc3-7f", "ovs_interfaceid": "3dc67fc3-7fcf-4655-8dbd-22febf2be39e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:58:08 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Releasing lock "refresh_cache-2e8507b7-fccf-4196-b589-bf2b74f165ec" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:58:08 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] [instance: 2e8507b7-fccf-4196-b589-bf2b74f165ec] Updated the network info_cache for instance {{(pid=75176) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 15:58:08 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:58:08 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:58:08 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:58:08 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:58:08 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:58:08 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Auditing locally available compute resources for user (node: user) {{(pid=75176) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 15:58:08 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-f64f0dba-1a30-43a8-a89f-544a63e06949 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Acquiring lock "2e8507b7-fccf-4196-b589-bf2b74f165ec" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:58:08 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-f64f0dba-1a30-43a8-a89f-544a63e06949 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Lock "2e8507b7-fccf-4196-b589-bf2b74f165ec" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:58:08 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-f64f0dba-1a30-43a8-a89f-544a63e06949 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Acquiring lock "2e8507b7-fccf-4196-b589-bf2b74f165ec-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:58:08 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-f64f0dba-1a30-43a8-a89f-544a63e06949 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Lock "2e8507b7-fccf-4196-b589-bf2b74f165ec-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:58:08 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-f64f0dba-1a30-43a8-a89f-544a63e06949 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Lock "2e8507b7-fccf-4196-b589-bf2b74f165ec-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:58:08 user nova-compute[75176]: INFO nova.compute.manager [None req-f64f0dba-1a30-43a8-a89f-544a63e06949 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] [instance: 2e8507b7-fccf-4196-b589-bf2b74f165ec] Terminating instance
Nov 28 15:58:08 user nova-compute[75176]: DEBUG nova.compute.manager [None req-f64f0dba-1a30-43a8-a89f-544a63e06949 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] [instance: 2e8507b7-fccf-4196-b589-bf2b74f165ec] Start destroying the instance on the hypervisor. {{(pid=75176) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 15:58:08 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:58:08 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55febf04-14ea-4903-8692-c7cc6115de75/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:58:08 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:58:08 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:58:09 user nova-compute[75176]: DEBUG nova.compute.manager [req-3172bee7-9b47-45a0-a67a-fde99ad7d384 req-5a8d4a30-d6aa-4a94-80d0-93bdbba52f3a service nova] [instance: 2e8507b7-fccf-4196-b589-bf2b74f165ec] Received event network-vif-unplugged-3dc67fc3-7fcf-4655-8dbd-22febf2be39e {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:58:09 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-3172bee7-9b47-45a0-a67a-fde99ad7d384 req-5a8d4a30-d6aa-4a94-80d0-93bdbba52f3a service nova] Acquiring lock "2e8507b7-fccf-4196-b589-bf2b74f165ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:58:09 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-3172bee7-9b47-45a0-a67a-fde99ad7d384 req-5a8d4a30-d6aa-4a94-80d0-93bdbba52f3a service nova] Lock "2e8507b7-fccf-4196-b589-bf2b74f165ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:58:09 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-3172bee7-9b47-45a0-a67a-fde99ad7d384 req-5a8d4a30-d6aa-4a94-80d0-93bdbba52f3a service nova] Lock "2e8507b7-fccf-4196-b589-bf2b74f165ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:58:09 user nova-compute[75176]: DEBUG nova.compute.manager [req-3172bee7-9b47-45a0-a67a-fde99ad7d384 req-5a8d4a30-d6aa-4a94-80d0-93bdbba52f3a service nova] [instance: 2e8507b7-fccf-4196-b589-bf2b74f165ec] No waiting events found dispatching network-vif-unplugged-3dc67fc3-7fcf-4655-8dbd-22febf2be39e {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:58:09 user nova-compute[75176]: DEBUG nova.compute.manager [req-3172bee7-9b47-45a0-a67a-fde99ad7d384 req-5a8d4a30-d6aa-4a94-80d0-93bdbba52f3a service nova] [instance: 2e8507b7-fccf-4196-b589-bf2b74f165ec] Received event network-vif-unplugged-3dc67fc3-7fcf-4655-8dbd-22febf2be39e for instance with task_state deleting. {{(pid=75176) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 15:58:09 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55febf04-14ea-4903-8692-c7cc6115de75/disk --force-share --output=json" returned: 0 in 0.308s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:58:09 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55febf04-14ea-4903-8692-c7cc6115de75/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:58:09 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55febf04-14ea-4903-8692-c7cc6115de75/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:58:09 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ae602c1-2aed-41ea-9f4c-4f3ec4aab254/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:58:09 user nova-compute[75176]: INFO nova.virt.libvirt.driver [-] [instance: 2e8507b7-fccf-4196-b589-bf2b74f165ec] Instance destroyed successfully.
Nov 28 15:58:09 user nova-compute[75176]: DEBUG nova.objects.instance [None req-f64f0dba-1a30-43a8-a89f-544a63e06949 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Lazy-loading 'resources' on Instance uuid 2e8507b7-fccf-4196-b589-bf2b74f165ec {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:58:09 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-f64f0dba-1a30-43a8-a89f-544a63e06949 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T15:39:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-486965920',display_name='tempest-ServerActionsTestOtherA-server-486965920',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-486965920',id=4,image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOMWl0O1/eKbWND/zyjGraAKxeAyZ2R2+QgHiQ80zmzsi5uDkOgtIp8e2HjbFwlKUWmHgZppW6LnrIueD7TS7l/EkNAyCl7Y/pD0TSC3H7ZDLxYbZaFDAxH/uT7EnME+ig==',key_name='tempest-keypair-740685341',keypairs=<?>,launch_index=0,launched_at=2023-11-28T15:39:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3704b38a2bd44cb78c28d3f6d86d9e60',ramdisk_id='',reservation_id='r-adka2uzv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-680502445',owner_user_name='tempest-ServerActionsTestOtherA-680502445-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T15:39:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d028b79a105b485dbb0178c9da162640',uuid=2e8507b7-fccf-4196-b589-bf2b74f165ec,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3dc67fc3-7fcf-4655-8dbd-22febf2be39e", "address": "fa:16:3e:04:68:53", "network": {"id": "8b63f2d3-0683-4832-abc5-e4c796cf12ab", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-877608435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3704b38a2bd44cb78c28d3f6d86d9e60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dc67fc3-7f", "ovs_interfaceid": "3dc67fc3-7fcf-4655-8dbd-22febf2be39e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 15:58:09 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-f64f0dba-1a30-43a8-a89f-544a63e06949 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Converting VIF {"id": "3dc67fc3-7fcf-4655-8dbd-22febf2be39e", "address": "fa:16:3e:04:68:53", "network": {"id": "8b63f2d3-0683-4832-abc5-e4c796cf12ab", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-877608435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3704b38a2bd44cb78c28d3f6d86d9e60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dc67fc3-7f", "ovs_interfaceid": "3dc67fc3-7fcf-4655-8dbd-22febf2be39e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:58:09 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-f64f0dba-1a30-43a8-a89f-544a63e06949 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:04:68:53,bridge_name='br-int',has_traffic_filtering=True,id=3dc67fc3-7fcf-4655-8dbd-22febf2be39e,network=Network(8b63f2d3-0683-4832-abc5-e4c796cf12ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3dc67fc3-7f') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:58:09 user nova-compute[75176]: DEBUG os_vif [None req-f64f0dba-1a30-43a8-a89f-544a63e06949 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:04:68:53,bridge_name='br-int',has_traffic_filtering=True,id=3dc67fc3-7fcf-4655-8dbd-22febf2be39e,network=Network(8b63f2d3-0683-4832-abc5-e4c796cf12ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3dc67fc3-7f') {{(pid=75176) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 15:58:09 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ae602c1-2aed-41ea-9f4c-4f3ec4aab254/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:58:09 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:58:09 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3dc67fc3-7f, bridge=br-int, if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:58:09 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ae602c1-2aed-41ea-9f4c-4f3ec4aab254/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:58:09 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:58:09 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:58:09 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:58:09 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6d208a54-923d-449e-b0dd-4c2c84fdfcd6) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:58:09 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:58:09 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:58:09 user nova-compute[75176]: INFO os_vif [None req-f64f0dba-1a30-43a8-a89f-544a63e06949 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:04:68:53,bridge_name='br-int',has_traffic_filtering=True,id=3dc67fc3-7fcf-4655-8dbd-22febf2be39e,network=Network(8b63f2d3-0683-4832-abc5-e4c796cf12ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3dc67fc3-7f')
Nov 28 15:58:09 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-f64f0dba-1a30-43a8-a89f-544a63e06949 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] [instance: 2e8507b7-fccf-4196-b589-bf2b74f165ec] Deleting instance files /opt/stack/data/nova/instances/2e8507b7-fccf-4196-b589-bf2b74f165ec_del
Nov 28 15:58:09 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-f64f0dba-1a30-43a8-a89f-544a63e06949 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] [instance: 2e8507b7-fccf-4196-b589-bf2b74f165ec] Deletion of /opt/stack/data/nova/instances/2e8507b7-fccf-4196-b589-bf2b74f165ec_del complete
Nov 28 15:58:09 user nova-compute[75176]: INFO nova.compute.manager [None req-f64f0dba-1a30-43a8-a89f-544a63e06949 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] [instance: 2e8507b7-fccf-4196-b589-bf2b74f165ec] Took 1.02 seconds to destroy the instance on the hypervisor.
Nov 28 15:58:09 user nova-compute[75176]: DEBUG oslo.service.loopingcall [None req-f64f0dba-1a30-43a8-a89f-544a63e06949 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75176) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 15:58:09 user nova-compute[75176]: DEBUG nova.compute.manager [-] [instance: 2e8507b7-fccf-4196-b589-bf2b74f165ec] Deallocating network for instance {{(pid=75176) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 15:58:09 user nova-compute[75176]: DEBUG nova.network.neutron [-] [instance: 2e8507b7-fccf-4196-b589-bf2b74f165ec] deallocate_for_instance() {{(pid=75176) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 15:58:09 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ae602c1-2aed-41ea-9f4c-4f3ec4aab254/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:58:09 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Error from libvirt while getting description of instance-00000004: [Error Code 42] Domain not found: no domain with matching uuid '2e8507b7-fccf-4196-b589-bf2b74f165ec' (instance-00000004): libvirt.libvirtError: Domain not found: no domain with matching uuid '2e8507b7-fccf-4196-b589-bf2b74f165ec' (instance-00000004)
Nov 28 15:58:09 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecf38787-0a69-4f35-b121-3dc6e70023a1/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:58:10 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecf38787-0a69-4f35-b121-3dc6e70023a1/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:58:10 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecf38787-0a69-4f35-b121-3dc6e70023a1/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:58:10 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecf38787-0a69-4f35-b121-3dc6e70023a1/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:58:10 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecabea76-6c29-412d-bf77-989917b449a9/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:58:10 user nova-compute[75176]: DEBUG nova.network.neutron [-] [instance: 2e8507b7-fccf-4196-b589-bf2b74f165ec] Updating instance_info_cache with network_info: [] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:58:10 user nova-compute[75176]: INFO nova.compute.manager [-] [instance: 2e8507b7-fccf-4196-b589-bf2b74f165ec] Took 0.55 seconds to deallocate network for instance.
Nov 28 15:58:10 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-f64f0dba-1a30-43a8-a89f-544a63e06949 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:58:10 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-f64f0dba-1a30-43a8-a89f-544a63e06949 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:58:10 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecabea76-6c29-412d-bf77-989917b449a9/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:58:10 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecabea76-6c29-412d-bf77-989917b449a9/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:58:10 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecabea76-6c29-412d-bf77-989917b449a9/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:58:10 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0b7a064-03b6-4a0d-88be-2f12c12a1ddb/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:58:10 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0b7a064-03b6-4a0d-88be-2f12c12a1ddb/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:58:10 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0b7a064-03b6-4a0d-88be-2f12c12a1ddb/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:58:10 user nova-compute[75176]: DEBUG nova.compute.provider_tree [None req-f64f0dba-1a30-43a8-a89f-544a63e06949 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Inventory has not changed in ProviderTree for provider: b37848d8-f401-4155-a029-b0ffa09ff85b {{(pid=75176) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 15:58:10 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-f64f0dba-1a30-43a8-a89f-544a63e06949 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Inventory has not changed for provider b37848d8-f401-4155-a029-b0ffa09ff85b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75176) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 15:58:11 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-f64f0dba-1a30-43a8-a89f-544a63e06949 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.585s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:58:11 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0b7a064-03b6-4a0d-88be-2f12c12a1ddb/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:58:11 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c154591-b130-4aa4-aad4-4c85324512df/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:58:11 user nova-compute[75176]: INFO nova.scheduler.client.report [None req-f64f0dba-1a30-43a8-a89f-544a63e06949 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Deleted allocations for instance 2e8507b7-fccf-4196-b589-bf2b74f165ec
Nov 28 15:58:11 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-f64f0dba-1a30-43a8-a89f-544a63e06949 tempest-ServerActionsTestOtherA-680502445 tempest-ServerActionsTestOtherA-680502445-project-member] Lock "2e8507b7-fccf-4196-b589-bf2b74f165ec" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.391s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:58:11 user nova-compute[75176]: DEBUG nova.compute.manager [req-2350838b-a34b-4463-a060-a3dc3b32f935 req-cd6a0415-2d6e-4e65-8f3e-25f3b228eb01 service nova] [instance: 2e8507b7-fccf-4196-b589-bf2b74f165ec] Received event network-vif-plugged-3dc67fc3-7fcf-4655-8dbd-22febf2be39e {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:58:11 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-2350838b-a34b-4463-a060-a3dc3b32f935 req-cd6a0415-2d6e-4e65-8f3e-25f3b228eb01 service nova] Acquiring lock "2e8507b7-fccf-4196-b589-bf2b74f165ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:58:11 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-2350838b-a34b-4463-a060-a3dc3b32f935 req-cd6a0415-2d6e-4e65-8f3e-25f3b228eb01 service nova] Lock "2e8507b7-fccf-4196-b589-bf2b74f165ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:58:11 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-2350838b-a34b-4463-a060-a3dc3b32f935 req-cd6a0415-2d6e-4e65-8f3e-25f3b228eb01 service nova] Lock "2e8507b7-fccf-4196-b589-bf2b74f165ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:58:11 user nova-compute[75176]: DEBUG nova.compute.manager [req-2350838b-a34b-4463-a060-a3dc3b32f935 req-cd6a0415-2d6e-4e65-8f3e-25f3b228eb01 service nova] [instance: 2e8507b7-fccf-4196-b589-bf2b74f165ec] No waiting events found dispatching network-vif-plugged-3dc67fc3-7fcf-4655-8dbd-22febf2be39e {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:58:11 user nova-compute[75176]: WARNING nova.compute.manager [req-2350838b-a34b-4463-a060-a3dc3b32f935 req-cd6a0415-2d6e-4e65-8f3e-25f3b228eb01 service nova] [instance: 2e8507b7-fccf-4196-b589-bf2b74f165ec] Received unexpected event network-vif-plugged-3dc67fc3-7fcf-4655-8dbd-22febf2be39e for instance with vm_state deleted and task_state None.
Nov 28 15:58:11 user nova-compute[75176]: DEBUG nova.compute.manager [req-2350838b-a34b-4463-a060-a3dc3b32f935 req-cd6a0415-2d6e-4e65-8f3e-25f3b228eb01 service nova] [instance: 2e8507b7-fccf-4196-b589-bf2b74f165ec] Received event network-vif-deleted-3dc67fc3-7fcf-4655-8dbd-22febf2be39e {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:58:11 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c154591-b130-4aa4-aad4-4c85324512df/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:58:11 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c154591-b130-4aa4-aad4-4c85324512df/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:58:11 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c154591-b130-4aa4-aad4-4c85324512df/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:58:11 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75176) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 15:58:11 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66ead7d-98f4-4822-9dce-f2ea0206a58d/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:58:11 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66ead7d-98f4-4822-9dce-f2ea0206a58d/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:58:11 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66ead7d-98f4-4822-9dce-f2ea0206a58d/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:58:11 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66ead7d-98f4-4822-9dce-f2ea0206a58d/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:58:11 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7/disk.rescue --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:58:11 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:58:11 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7/disk.rescue --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:58:12 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:58:12 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:58:12 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:58:12 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:58:12 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:58:12 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75176) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 15:58:12 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/726344c0-a0dc-48d5-a18f-8a258ebde87d/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:58:12 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/726344c0-a0dc-48d5-a18f-8a258ebde87d/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:58:12 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/726344c0-a0dc-48d5-a18f-8a258ebde87d/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:58:12 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/726344c0-a0dc-48d5-a18f-8a258ebde87d/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:58:13 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 15:58:13 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 15:58:13 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Hypervisor/Node resource view: name=user free_ram=7375MB free_disk=24.78909683227539GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75176) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 15:58:13 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:58:13 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:58:13 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance f66ead7d-98f4-4822-9dce-f2ea0206a58d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:58:13 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance 55febf04-14ea-4903-8692-c7cc6115de75 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:58:13 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance 8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:58:13 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance dc4e6d39-adfb-4d26-afef-46f316ff7846 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:58:13 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance ecabea76-6c29-412d-bf77-989917b449a9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:58:13 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance e0b7a064-03b6-4a0d-88be-2f12c12a1ddb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:58:13 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance 3ae602c1-2aed-41ea-9f4c-4f3ec4aab254 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:58:13 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance 525c3cc4-9cc4-470b-bf72-5e53d80cea6f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:58:13 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance ecf38787-0a69-4f35-b121-3dc6e70023a1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:58:13 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance 726344c0-a0dc-48d5-a18f-8a258ebde87d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:58:13 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance 2c154591-b130-4aa4-aad4-4c85324512df actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:58:13 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75176) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 15:58:13 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75176) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 15:58:13 user nova-compute[75176]: DEBUG nova.compute.provider_tree [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Inventory has not changed in ProviderTree for provider: b37848d8-f401-4155-a029-b0ffa09ff85b {{(pid=75176) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 15:58:13 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Inventory has not changed for provider b37848d8-f401-4155-a029-b0ffa09ff85b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75176) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 15:58:13 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Compute_service record updated for user:user {{(pid=75176) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 15:58:13 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.491s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:58:14 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:58:14 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:58:19 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-0cb39600-b06c-49b6-a58a-2190c785de55 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance e0b7a064-03b6-4a0d-88be-2f12c12a1ddb is timed out.
Nov 28 15:58:19 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-0cb39600-b06c-49b6-a58a-2190c785de55 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Successfully detached device vdb from instance e0b7a064-03b6-4a0d-88be-2f12c12a1ddb from the live domain config.
Nov 28 15:58:19 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0cb39600-b06c-49b6-a58a-2190c785de55 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] [instance: e0b7a064-03b6-4a0d-88be-2f12c12a1ddb] calling os-brick to detach iSCSI Volume {{(pid=75176) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 15:58:19 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cb39600-b06c-49b6-a58a-2190c785de55 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c1b8a00>, {'target_iqn': 'iqn.2010-10.org.openstack:0e035375-c026-46d7-ab68-37b8b17529e5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pxWOIKvl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 15:58:19 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-0cb39600-b06c-49b6-a58a-2190c785de55 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 15:58:19 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-0cb39600-b06c-49b6-a58a-2190c785de55 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 15:58:19 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-0cb39600-b06c-49b6-a58a-2190c785de55 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 15:58:19 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:58:19 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:58:19 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8d766ee-4a39-446f-9cc2-5dd3894a9b26]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:da2a8398-08c5-41a0-ac27-ecc54947d31b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f6b64883-4ad0-4425-8293-71abe45cc1dc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0e035375-c026-46d7-ab68-37b8b17529e5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:58:19 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cb39600-b06c-49b6-a58a-2190c785de55 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 15:58:19 user nova-compute[75176]: No targets found.
Nov 28 15:58:19 user nova-compute[75176]: iSNS:
Nov 28 15:58:19 user nova-compute[75176]: No targets found.
Nov 28 15:58:19 user nova-compute[75176]: STATIC:
Nov 28 15:58:19 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:da2a8398-08c5-41a0-ac27-ecc54947d31b
Nov 28 15:58:19 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:58:19 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:58:19 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0
Nov 28 15:58:19 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:58:19 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:58:19 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6
Nov 28 15:58:19 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:58:19 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:58:19 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:f6b64883-4ad0-4425-8293-71abe45cc1dc
Nov 28 15:58:19 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:58:19 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:58:19 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:0e035375-c026-46d7-ab68-37b8b17529e5
Nov 28 15:58:19 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:58:19 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:58:19 user nova-compute[75176]: FIRMWARE:
Nov 28 15:58:19 user nova-compute[75176]: No targets found.
Nov 28 15:58:19 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:58:19 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cb39600-b06c-49b6-a58a-2190c785de55 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 15:58:19 user nova-compute[75176]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 15:58:19 user nova-compute[75176]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75176) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 15:58:19 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cb39600-b06c-49b6-a58a-2190c785de55 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0e035375-c026-46d7-ab68-37b8b17529e5', 0)] {{(pid=75176) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 15:58:19 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:58:19 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:58:19 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e5942d4-d77d-4ade-8b11-d1be5a1bad67]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0e035375-c026-46d7-ab68-37b8b17529e5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:da2a8398-08c5-41a0-ac27-ecc54947d31b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f6b64883-4ad0-4425-8293-71abe45cc1dc\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:58:19 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:58:19 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:58:19 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[d38fc066-2636-4b95-a089-08a359448673]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e035375-c026-46d7-ab68-37b8b17529e5 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6b64883-4ad0-4425-8293-71abe45cc1dc (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da2a8398-08c5-41a0-ac27-ecc54947d31b (non-flash)\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:58:19 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cb39600-b06c-49b6-a58a-2190c785de55 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 (non-flash)
Nov 28 15:58:19 user nova-compute[75176]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0 (non-flash)
Nov 28 15:58:19 user nova-compute[75176]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e035375-c026-46d7-ab68-37b8b17529e5 (non-flash)
Nov 28 15:58:19 user nova-compute[75176]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6b64883-4ad0-4425-8293-71abe45cc1dc (non-flash)
Nov 28 15:58:19 user nova-compute[75176]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da2a8398-08c5-41a0-ac27-ecc54947d31b (non-flash)
Nov 28 15:58:19 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:58:19 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cb39600-b06c-49b6-a58a-2190c785de55 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 (non-flash)
Nov 28 15:58:19 user nova-compute[75176]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0 (non-flash)
Nov 28 15:58:19 user nova-compute[75176]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e035375-c026-46d7-ab68-37b8b17529e5 (non-flash)
Nov 28 15:58:19 user nova-compute[75176]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6b64883-4ad0-4425-8293-71abe45cc1dc (non-flash)
Nov 28 15:58:19 user nova-compute[75176]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da2a8398-08c5-41a0-ac27-ecc54947d31b (non-flash)
Nov 28 15:58:19 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 15:58:19 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cb39600-b06c-49b6-a58a-2190c785de55 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f464c1fc9d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0e035375-c026-46d7-ab68-37b8b17529e5'): ({'sdc'}, set())}) {{(pid=75176) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 15:58:19 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-0cb39600-b06c-49b6-a58a-2190c785de55 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Removing single pathed devices sdc {{(pid=75176) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 15:58:19 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:58:19 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:58:19 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[facfd4a8-a590-47a0-81e7-b3729b44d854]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:58:19 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:58:19 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:58:19 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6065184-b6d4-4079-a6d4-85f2e44170ae]: (4, ('ok\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:58:19 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-0cb39600-b06c-49b6-a58a-2190c785de55 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Flushing IO for device /dev/sdc {{(pid=75176) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 15:58:19 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:58:19 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:58:19 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[28156b6a-7546-4efa-953a-fa5d7c22b528]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:58:19 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-0cb39600-b06c-49b6-a58a-2190c785de55 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75176) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 15:58:19 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:58:19 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.039s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:58:19 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[06e6c72c-1cf5-46e2-8580-c9f17fab7ee2]: (4, ('1', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:58:19 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-0cb39600-b06c-49b6-a58a-2190c785de55 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75176) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 15:58:19 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-0cb39600-b06c-49b6-a58a-2190c785de55 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] SCSI volumes sdc have been removed. {{(pid=75176) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 15:58:19 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cb39600-b06c-49b6-a58a-2190c785de55 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0e035375-c026-46d7-ab68-37b8b17529e5')] {{(pid=75176) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 15:58:19 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e035375-c026-46d7-ab68-37b8b17529e5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:58:19 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e035375-c026-46d7-ab68-37b8b17529e5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:58:19 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[a324a669-314b-41bf-9fb5-373729953ab7]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:58:19 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cb39600-b06c-49b6-a58a-2190c785de55 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:58:19 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e035375-c026-46d7-ab68-37b8b17529e5 -p 172.16.0.220:3260 --logout {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:58:19 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e035375-c026-46d7-ab68-37b8b17529e5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:58:19 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[2914195a-ab1c-4289-9a82-23cfca6bd3bb]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:0e035375-c026-46d7-ab68-37b8b17529e5, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:0e035375-c026-46d7-ab68-37b8b17529e5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:58:19 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cb39600-b06c-49b6-a58a-2190c785de55 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:0e035375-c026-46d7-ab68-37b8b17529e5, portal: 172.16.0.220,3260]
Nov 28 15:58:19 user nova-compute[75176]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:0e035375-c026-46d7-ab68-37b8b17529e5, portal: 172.16.0.220,3260] successful.
Nov 28 15:58:19 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:58:19 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e035375-c026-46d7-ab68-37b8b17529e5 -p 172.16.0.220:3260 --op delete {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:58:19 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e035375-c026-46d7-ab68-37b8b17529e5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:58:19 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[57073000-805f-4225-a6b1-f96a5a0fb0b1]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:58:19 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cb39600-b06c-49b6-a58a-2190c785de55 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:58:19 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-0cb39600-b06c-49b6-a58a-2190c785de55 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.331s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 15:58:19 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cb39600-b06c-49b6-a58a-2190c785de55 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] <== disconnect_volume: return (333ms) None {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 15:58:19 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0cb39600-b06c-49b6-a58a-2190c785de55 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] [instance: e0b7a064-03b6-4a0d-88be-2f12c12a1ddb] Disconnected iSCSI Volume {{(pid=75176) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 15:58:19 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:58:19 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:58:20 user nova-compute[75176]: DEBUG nova.objects.instance [None req-0cb39600-b06c-49b6-a58a-2190c785de55 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Lazy-loading 'flavor' on Instance uuid e0b7a064-03b6-4a0d-88be-2f12c12a1ddb {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:58:20 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-0cb39600-b06c-49b6-a58a-2190c785de55 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Lock "e0b7a064-03b6-4a0d-88be-2f12c12a1ddb" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.896s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:58:24 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:58:29 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:58:32 user nova-compute[75176]: DEBUG nova.compute.manager [req-8c718727-3991-40cc-9fae-dd47ce3383d7 req-ed1898f2-6bce-42c1-a310-0ac8f1cd536b service nova] [instance: 3ae602c1-2aed-41ea-9f4c-4f3ec4aab254] Received event network-changed-dee8b036-92ce-421f-bb73-dbf92200da92 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:58:32 user nova-compute[75176]: DEBUG nova.compute.manager [req-8c718727-3991-40cc-9fae-dd47ce3383d7 req-ed1898f2-6bce-42c1-a310-0ac8f1cd536b service nova] [instance: 3ae602c1-2aed-41ea-9f4c-4f3ec4aab254] Refreshing instance network info cache due to event network-changed-dee8b036-92ce-421f-bb73-dbf92200da92. {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 15:58:32 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-8c718727-3991-40cc-9fae-dd47ce3383d7 req-ed1898f2-6bce-42c1-a310-0ac8f1cd536b service nova] Acquiring lock "refresh_cache-3ae602c1-2aed-41ea-9f4c-4f3ec4aab254" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:58:32 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-8c718727-3991-40cc-9fae-dd47ce3383d7 req-ed1898f2-6bce-42c1-a310-0ac8f1cd536b service nova] Acquired lock "refresh_cache-3ae602c1-2aed-41ea-9f4c-4f3ec4aab254" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:58:32 user nova-compute[75176]: DEBUG nova.network.neutron [req-8c718727-3991-40cc-9fae-dd47ce3383d7 req-ed1898f2-6bce-42c1-a310-0ac8f1cd536b service nova] [instance: 3ae602c1-2aed-41ea-9f4c-4f3ec4aab254] Refreshing network info cache for port dee8b036-92ce-421f-bb73-dbf92200da92 {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 15:58:33 user nova-compute[75176]: DEBUG nova.network.neutron [req-8c718727-3991-40cc-9fae-dd47ce3383d7 req-ed1898f2-6bce-42c1-a310-0ac8f1cd536b service nova] [instance: 3ae602c1-2aed-41ea-9f4c-4f3ec4aab254] Updated VIF entry in instance network info cache for port dee8b036-92ce-421f-bb73-dbf92200da92. {{(pid=75176) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 15:58:33 user nova-compute[75176]: DEBUG nova.network.neutron [req-8c718727-3991-40cc-9fae-dd47ce3383d7 req-ed1898f2-6bce-42c1-a310-0ac8f1cd536b service nova] [instance: 3ae602c1-2aed-41ea-9f4c-4f3ec4aab254] Updating instance_info_cache with network_info: [{"id": "dee8b036-92ce-421f-bb73-dbf92200da92", "address": "fa:16:3e:51:3e:28", "network": {"id": "1fd59c02-7617-4d0e-9456-84d6cc91ce3b", "bridge": "br-int", "label": "tempest-TestStampPattern-116968826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4a10ba40c844955b63cb8603dd548cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdee8b036-92", "ovs_interfaceid": "dee8b036-92ce-421f-bb73-dbf92200da92", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:58:33 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-8c718727-3991-40cc-9fae-dd47ce3383d7 req-ed1898f2-6bce-42c1-a310-0ac8f1cd536b service nova] Releasing lock "refresh_cache-3ae602c1-2aed-41ea-9f4c-4f3ec4aab254" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:58:33 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-38a61144-d3b9-473b-ad23-53ff58d49ac2 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Acquiring lock "3ae602c1-2aed-41ea-9f4c-4f3ec4aab254" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:58:33 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-38a61144-d3b9-473b-ad23-53ff58d49ac2 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Lock "3ae602c1-2aed-41ea-9f4c-4f3ec4aab254" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:58:33 user nova-compute[75176]: DEBUG nova.objects.instance [None req-38a61144-d3b9-473b-ad23-53ff58d49ac2 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Lazy-loading 'flavor' on Instance uuid 3ae602c1-2aed-41ea-9f4c-4f3ec4aab254 {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:58:34 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-38a61144-d3b9-473b-ad23-53ff58d49ac2 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Lock "3ae602c1-2aed-41ea-9f4c-4f3ec4aab254" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.049s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:58:34 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-38a61144-d3b9-473b-ad23-53ff58d49ac2 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Acquiring lock "3ae602c1-2aed-41ea-9f4c-4f3ec4aab254" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:58:34 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-38a61144-d3b9-473b-ad23-53ff58d49ac2 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Lock "3ae602c1-2aed-41ea-9f4c-4f3ec4aab254" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:58:34 user nova-compute[75176]: INFO nova.compute.manager [None req-38a61144-d3b9-473b-ad23-53ff58d49ac2 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] [instance: 3ae602c1-2aed-41ea-9f4c-4f3ec4aab254] Attaching volume d0f9d557-1dc1-4892-b808-35606162f6a5 to /dev/vdb
Nov 28 15:58:34 user nova-compute[75176]: DEBUG os_brick.utils [None req-38a61144-d3b9-473b-ad23-53ff58d49ac2 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 15:58:34 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:58:34 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:58:34 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[fadcdf03-bca8-4c61-ac46-21275d8df333]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:edc924a949b2\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:58:34 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:58:34 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:58:34 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[95f22a69-2658-41fe-b083-27b1cdcc3056]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:58:34 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:58:34 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:58:34 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8635976-b97c-4714-91dd-f9b95c0d4273]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:58:34 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebf93a80-9459-4f8d-bcde-9791f2c9e65e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:58:34 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-38a61144-d3b9-473b-ad23-53ff58d49ac2 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Running cmd (subprocess): nvme version {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:58:34 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-38a61144-d3b9-473b-ad23-53ff58d49ac2 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] 'nvme version' failed. Not Retrying. {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 15:58:34 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.nvmeof [None req-38a61144-d3b9-473b-ad23-53ff58d49ac2 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] nvme not present on system {{(pid=75176) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 15:58:34 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:58:34 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 15:58:34 user nova-compute[75176]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 15:58:34 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[d556b1a0-8b6b-4067-a2e8-8f67f0c547e5]: (4, '') {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:58:34 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.lightos [None req-38a61144-d3b9-473b-ad23-53ff58d49ac2 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75176) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 15:58:34 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.lightos [None req-38a61144-d3b9-473b-ad23-53ff58d49ac2 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75176) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 15:58:34 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.lightos [None req-38a61144-d3b9-473b-ad23-53ff58d49ac2 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] LIGHTOS: no hostnqn found. {{(pid=75176) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 15:58:34 user nova-compute[75176]: DEBUG os_brick.utils [None req-38a61144-d3b9-473b-ad23-53ff58d49ac2 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:edc924a949b2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 15:58:34 user nova-compute[75176]: DEBUG nova.virt.block_device [None req-38a61144-d3b9-473b-ad23-53ff58d49ac2 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] [instance: 3ae602c1-2aed-41ea-9f4c-4f3ec4aab254] Updating existing volume attachment record: 2afbe337-d460-4f9e-9362-ee19d04d0b8b {{(pid=75176) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 15:58:34 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:58:34 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:58:37 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:58:38 user nova-compute[75176]: DEBUG nova.compute.manager [req-36550af7-3b5f-4825-a9d5-6192920dee07 req-3d03675e-4ac4-4ca2-808b-0ebd373b818e service nova] [instance: 525c3cc4-9cc4-470b-bf72-5e53d80cea6f] Received event network-changed-6c64d8cb-6ee1-4d8f-8898-3e70b5e17b9e {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:58:38 user nova-compute[75176]: DEBUG nova.compute.manager [req-36550af7-3b5f-4825-a9d5-6192920dee07 req-3d03675e-4ac4-4ca2-808b-0ebd373b818e service nova] [instance: 525c3cc4-9cc4-470b-bf72-5e53d80cea6f] Refreshing instance network info cache due to event network-changed-6c64d8cb-6ee1-4d8f-8898-3e70b5e17b9e. {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 15:58:38 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-36550af7-3b5f-4825-a9d5-6192920dee07 req-3d03675e-4ac4-4ca2-808b-0ebd373b818e service nova] Acquiring lock "refresh_cache-525c3cc4-9cc4-470b-bf72-5e53d80cea6f" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:58:38 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-36550af7-3b5f-4825-a9d5-6192920dee07 req-3d03675e-4ac4-4ca2-808b-0ebd373b818e service nova] Acquired lock "refresh_cache-525c3cc4-9cc4-470b-bf72-5e53d80cea6f" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:58:38 user nova-compute[75176]: DEBUG nova.network.neutron [req-36550af7-3b5f-4825-a9d5-6192920dee07 req-3d03675e-4ac4-4ca2-808b-0ebd373b818e service nova] [instance: 525c3cc4-9cc4-470b-bf72-5e53d80cea6f] Refreshing network info cache for port 6c64d8cb-6ee1-4d8f-8898-3e70b5e17b9e {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 15:58:38 user nova-compute[75176]: DEBUG nova.network.neutron [req-36550af7-3b5f-4825-a9d5-6192920dee07 req-3d03675e-4ac4-4ca2-808b-0ebd373b818e service nova] [instance: 525c3cc4-9cc4-470b-bf72-5e53d80cea6f] Updated VIF entry in instance network info cache for port 6c64d8cb-6ee1-4d8f-8898-3e70b5e17b9e. {{(pid=75176) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 15:58:38 user nova-compute[75176]: DEBUG nova.network.neutron [req-36550af7-3b5f-4825-a9d5-6192920dee07 req-3d03675e-4ac4-4ca2-808b-0ebd373b818e service nova] [instance: 525c3cc4-9cc4-470b-bf72-5e53d80cea6f] Updating instance_info_cache with network_info: [{"id": "6c64d8cb-6ee1-4d8f-8898-3e70b5e17b9e", "address": "fa:16:3e:93:0e:39", "network": {"id": "5ec264ad-3459-468c-bdbf-c6a4ef016951", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1574289626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07c7783cc16049208421204910982c79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c64d8cb-6e", "ovs_interfaceid": "6c64d8cb-6ee1-4d8f-8898-3e70b5e17b9e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:58:38 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-36550af7-3b5f-4825-a9d5-6192920dee07 req-3d03675e-4ac4-4ca2-808b-0ebd373b818e service nova] Releasing lock "refresh_cache-525c3cc4-9cc4-470b-bf72-5e53d80cea6f" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:58:39 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:58:39 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:58:41 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-38a61144-d3b9-473b-ad23-53ff58d49ac2 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] [instance: 3ae602c1-2aed-41ea-9f4c-4f3ec4aab254] Calling os-brick to attach iSCSI Volume {{(pid=75176) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 15:58:41 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-38a61144-d3b9-473b-ad23-53ff58d49ac2 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c1b8a00>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d0f9d557-1dc1-4892-b808-35606162f6a5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZrvDikFo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 15:58:41 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-38a61144-d3b9-473b-ad23-53ff58d49ac2 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 15:58:41 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-38a61144-d3b9-473b-ad23-53ff58d49ac2 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 15:58:41 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-38a61144-d3b9-473b-ad23-53ff58d49ac2 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 15:58:41 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-38a61144-d3b9-473b-ad23-53ff58d49ac2 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 15:58:41 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-38a61144-d3b9-473b-ad23-53ff58d49ac2 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d0f9d557-1dc1-4892-b808-35606162f6a5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 15:58:41 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-38a61144-d3b9-473b-ad23-53ff58d49ac2 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d0f9d557-1dc1-4892-b808-35606162f6a5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 15:58:41 user nova-compute[75176]: INFO os_brick.initiator.connectors.iscsi [None req-38a61144-d3b9-473b-ad23-53ff58d49ac2 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 15:58:41 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0f9d557-1dc1-4892-b808-35606162f6a5 -p 172.16.0.220:3260 {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:58:41 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0f9d557-1dc1-4892-b808-35606162f6a5 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:58:41 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2985131-36b5-4b90-9ee4-131f1959a630]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:58:41 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-38a61144-d3b9-473b-ad23-53ff58d49ac2 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 15:58:41 user nova-compute[75176]:  {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:58:41 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0f9d557-1dc1-4892-b808-35606162f6a5 -p 172.16.0.220:3260 --interface default --op new {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:58:41 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0f9d557-1dc1-4892-b808-35606162f6a5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:58:41 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[36678c29-d6e4-4993-9e6a-1f1a6f194c16]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d0f9d557-1dc1-4892-b808-35606162f6a5] added\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:58:41 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-38a61144-d3b9-473b-ad23-53ff58d49ac2 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d0f9d557-1dc1-4892-b808-35606162f6a5] added
Nov 28 15:58:41 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:58:41 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0f9d557-1dc1-4892-b808-35606162f6a5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:58:41 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0f9d557-1dc1-4892-b808-35606162f6a5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:58:41 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[18dfaedc-7676-44ea-a5fb-adff5411ee63]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:58:41 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-38a61144-d3b9-473b-ad23-53ff58d49ac2 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:58:41 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0f9d557-1dc1-4892-b808-35606162f6a5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:58:41 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0f9d557-1dc1-4892-b808-35606162f6a5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:58:41 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bf75921-1599-4a40-a215-7242be2e20a3]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:58:41 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-38a61144-d3b9-473b-ad23-53ff58d49ac2 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:58:41 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0f9d557-1dc1-4892-b808-35606162f6a5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZrvDikFo {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:58:41 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0f9d557-1dc1-4892-b808-35606162f6a5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZrvDikFo" returned: 0 in 0.018s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:58:41 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[11c6b4e5-6ee3-454d-a0e1-289d16dc5d3d]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:58:41 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-38a61144-d3b9-473b-ad23-53ff58d49ac2 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZrvDikFo'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:58:41 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0f9d557-1dc1-4892-b808-35606162f6a5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:58:41 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0f9d557-1dc1-4892-b808-35606162f6a5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:58:41 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[15f35e9b-c831-44a6-900d-a739935f7738]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:58:41 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-38a61144-d3b9-473b-ad23-53ff58d49ac2 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:58:41 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:58:41 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:58:41 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a9a86e6-f079-48cf-a05d-984035db2ea5]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0 (non-flash)\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:58:41 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-38a61144-d3b9-473b-ad23-53ff58d49ac2 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 (non-flash)
Nov 28 15:58:41 user nova-compute[75176]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0 (non-flash)
Nov 28 15:58:41 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:58:41 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-38a61144-d3b9-473b-ad23-53ff58d49ac2 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 (non-flash)
Nov 28 15:58:41 user nova-compute[75176]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0 (non-flash)
Nov 28 15:58:41 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 15:58:41 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0f9d557-1dc1-4892-b808-35606162f6a5 -p 172.16.0.220:3260 --login {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:58:41 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0f9d557-1dc1-4892-b808-35606162f6a5 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:58:41 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d35d6c1-9f64-4715-88e4-4bcd9211003e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d0f9d557-1dc1-4892-b808-35606162f6a5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d0f9d557-1dc1-4892-b808-35606162f6a5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:58:41 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-38a61144-d3b9-473b-ad23-53ff58d49ac2 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d0f9d557-1dc1-4892-b808-35606162f6a5, portal: 172.16.0.220,3260]
Nov 28 15:58:41 user nova-compute[75176]: Login to [iface: default, target: iqn.2010-10.org.openstack:d0f9d557-1dc1-4892-b808-35606162f6a5, portal: 172.16.0.220,3260] successful.
Nov 28 15:58:41 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:58:41 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0f9d557-1dc1-4892-b808-35606162f6a5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:58:41 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0f9d557-1dc1-4892-b808-35606162f6a5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:58:41 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0602921-9066-4ab1-b2d4-e412f7598fb9]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:58:41 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-38a61144-d3b9-473b-ad23-53ff58d49ac2 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:58:41 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:58:41 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:58:41 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[77ff3a1b-dc64-41fa-9eec-837b852a14b9]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0f9d557-1dc1-4892-b808-35606162f6a5 (non-flash)\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:58:41 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-38a61144-d3b9-473b-ad23-53ff58d49ac2 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 (non-flash)
Nov 28 15:58:41 user nova-compute[75176]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0 (non-flash)
Nov 28 15:58:41 user nova-compute[75176]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0f9d557-1dc1-4892-b808-35606162f6a5 (non-flash)
Nov 28 15:58:41 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:58:41 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-38a61144-d3b9-473b-ad23-53ff58d49ac2 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 (non-flash)
Nov 28 15:58:41 user nova-compute[75176]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0 (non-flash)
Nov 28 15:58:41 user nova-compute[75176]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0f9d557-1dc1-4892-b808-35606162f6a5 (non-flash)
Nov 28 15:58:41 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 15:58:41 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-38a61144-d3b9-473b-ad23-53ff58d49ac2 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d0f9d557-1dc1-4892-b808-35606162f6a5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.281s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 15:58:41 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-38a61144-d3b9-473b-ad23-53ff58d49ac2 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Connected to 172.16.0.220:3260 {{(pid=75176) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 15:58:41 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-38a61144-d3b9-473b-ad23-53ff58d49ac2 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] HCTL ('34', '-', '-', 0) found on session 52 with lun 0 {{(pid=75176) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 15:58:41 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-38a61144-d3b9-473b-ad23-53ff58d49ac2 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75176) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 15:58:41 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:58:41 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:58:41 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a1c7782-2051-45e7-b622-4d8b6f42ef61]: (4, ('- - 0', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:58:41 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-38a61144-d3b9-473b-ad23-53ff58d49ac2 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Searching for a device in session 52 and hctl ['34', '*', '*', 0] yield: None {{(pid=75176) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 15:58:42 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-38a61144-d3b9-473b-ad23-53ff58d49ac2 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Searching for a device in session 52 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75176) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 15:58:42 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-38a61144-d3b9-473b-ad23-53ff58d49ac2 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:d0f9d557-1dc1-4892-b808-35606162f6a5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZrvDikFo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75176) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 15:58:42 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-38a61144-d3b9-473b-ad23-53ff58d49ac2 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.314s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 15:58:42 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-38a61144-d3b9-473b-ad23-53ff58d49ac2 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] <== connect_volume: return (1316ms) {'type': 'block', 'scsi_wwn': '23766653034643464', 'path': '/dev/sdc'} {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 15:58:42 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-38a61144-d3b9-473b-ad23-53ff58d49ac2 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] [instance: 3ae602c1-2aed-41ea-9f4c-4f3ec4aab254] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23766653034643464', 'path': '/dev/sdc'} {{(pid=75176) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 15:58:42 user nova-compute[75176]: DEBUG nova.objects.instance [None req-38a61144-d3b9-473b-ad23-53ff58d49ac2 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Lazy-loading 'flavor' on Instance uuid 3ae602c1-2aed-41ea-9f4c-4f3ec4aab254 {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:58:42 user nova-compute[75176]: DEBUG nova.virt.libvirt.guest [None req-38a61144-d3b9-473b-ad23-53ff58d49ac2 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 15:58:42 user nova-compute[75176]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 15:58:42 user nova-compute[75176]:   <source dev="/dev/sdc"/>
Nov 28 15:58:42 user nova-compute[75176]:   <target dev="vdb" bus="virtio"/>
Nov 28 15:58:42 user nova-compute[75176]:   <serial>d0f9d557-1dc1-4892-b808-35606162f6a5</serial>
Nov 28 15:58:42 user nova-compute[75176]: </disk>
Nov 28 15:58:42 user nova-compute[75176]:  {{(pid=75176) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 15:58:43 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-38a61144-d3b9-473b-ad23-53ff58d49ac2 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] No BDM found with device name vda, not building metadata. {{(pid=75176) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 15:58:43 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-38a61144-d3b9-473b-ad23-53ff58d49ac2 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75176) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 15:58:43 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-38a61144-d3b9-473b-ad23-53ff58d49ac2 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] No VIF found with MAC fa:16:3e:51:3e:28, not building metadata {{(pid=75176) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 15:58:43 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-38a61144-d3b9-473b-ad23-53ff58d49ac2 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Lock "3ae602c1-2aed-41ea-9f4c-4f3ec4aab254" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.294s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:58:44 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:58:44 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:58:45 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7bae7348-1f30-430a-a8c8-d22cc9d4da42 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Acquiring lock "3ae602c1-2aed-41ea-9f4c-4f3ec4aab254" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:58:45 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7bae7348-1f30-430a-a8c8-d22cc9d4da42 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Lock "3ae602c1-2aed-41ea-9f4c-4f3ec4aab254" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:58:45 user nova-compute[75176]: INFO nova.compute.manager [None req-7bae7348-1f30-430a-a8c8-d22cc9d4da42 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] [instance: 3ae602c1-2aed-41ea-9f4c-4f3ec4aab254] Detaching volume d0f9d557-1dc1-4892-b808-35606162f6a5
Nov 28 15:58:45 user nova-compute[75176]: INFO nova.virt.block_device [None req-7bae7348-1f30-430a-a8c8-d22cc9d4da42 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] [instance: 3ae602c1-2aed-41ea-9f4c-4f3ec4aab254] Attempting to driver detach volume d0f9d557-1dc1-4892-b808-35606162f6a5 from mountpoint /dev/vdb
Nov 28 15:58:45 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-7bae7348-1f30-430a-a8c8-d22cc9d4da42 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Attempting to detach device vdb from instance 3ae602c1-2aed-41ea-9f4c-4f3ec4aab254 from the persistent domain config. {{(pid=75176) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 15:58:45 user nova-compute[75176]: DEBUG nova.virt.libvirt.guest [None req-7bae7348-1f30-430a-a8c8-d22cc9d4da42 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 15:58:45 user nova-compute[75176]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 15:58:45 user nova-compute[75176]:   <source dev="/dev/sdc"/>
Nov 28 15:58:45 user nova-compute[75176]:   <target dev="vdb" bus="virtio"/>
Nov 28 15:58:45 user nova-compute[75176]:   <serial>d0f9d557-1dc1-4892-b808-35606162f6a5</serial>
Nov 28 15:58:45 user nova-compute[75176]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 15:58:45 user nova-compute[75176]: </disk>
Nov 28 15:58:45 user nova-compute[75176]:  {{(pid=75176) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 15:58:45 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-7bae7348-1f30-430a-a8c8-d22cc9d4da42 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Successfully detached device vdb from instance 3ae602c1-2aed-41ea-9f4c-4f3ec4aab254 from the persistent domain config.
Nov 28 15:58:45 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-7bae7348-1f30-430a-a8c8-d22cc9d4da42 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3ae602c1-2aed-41ea-9f4c-4f3ec4aab254 from the live domain config. {{(pid=75176) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 15:58:45 user nova-compute[75176]: DEBUG nova.virt.libvirt.guest [None req-7bae7348-1f30-430a-a8c8-d22cc9d4da42 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 15:58:45 user nova-compute[75176]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 15:58:45 user nova-compute[75176]:   <source dev="/dev/sdc"/>
Nov 28 15:58:45 user nova-compute[75176]:   <target dev="vdb" bus="virtio"/>
Nov 28 15:58:45 user nova-compute[75176]:   <serial>d0f9d557-1dc1-4892-b808-35606162f6a5</serial>
Nov 28 15:58:45 user nova-compute[75176]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 15:58:45 user nova-compute[75176]: </disk>
Nov 28 15:58:45 user nova-compute[75176]:  {{(pid=75176) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 15:58:45 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-f33a29d3-2c93-4108-8b5f-cf13da769e69 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Acquiring lock "216e9ce3-28d7-4282-ae91-3aa6282626e1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:58:45 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-f33a29d3-2c93-4108-8b5f-cf13da769e69 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Lock "216e9ce3-28d7-4282-ae91-3aa6282626e1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:58:45 user nova-compute[75176]: DEBUG nova.compute.manager [None req-f33a29d3-2c93-4108-8b5f-cf13da769e69 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: 216e9ce3-28d7-4282-ae91-3aa6282626e1] Starting instance... {{(pid=75176) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 15:58:45 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-f33a29d3-2c93-4108-8b5f-cf13da769e69 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:58:45 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-f33a29d3-2c93-4108-8b5f-cf13da769e69 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:58:45 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-f33a29d3-2c93-4108-8b5f-cf13da769e69 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75176) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 15:58:45 user nova-compute[75176]: INFO nova.compute.claims [None req-f33a29d3-2c93-4108-8b5f-cf13da769e69 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: 216e9ce3-28d7-4282-ae91-3aa6282626e1] Claim successful on node user
Nov 28 15:58:45 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-7bae7348-1f30-430a-a8c8-d22cc9d4da42 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3ae602c1-2aed-41ea-9f4c-4f3ec4aab254 {{(pid=75176) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 15:58:45 user nova-compute[75176]: DEBUG nova.compute.provider_tree [None req-f33a29d3-2c93-4108-8b5f-cf13da769e69 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Inventory has not changed in ProviderTree for provider: b37848d8-f401-4155-a029-b0ffa09ff85b {{(pid=75176) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 15:58:45 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-f33a29d3-2c93-4108-8b5f-cf13da769e69 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Inventory has not changed for provider b37848d8-f401-4155-a029-b0ffa09ff85b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75176) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 15:58:45 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-f33a29d3-2c93-4108-8b5f-cf13da769e69 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.450s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:58:45 user nova-compute[75176]: DEBUG nova.compute.manager [None req-f33a29d3-2c93-4108-8b5f-cf13da769e69 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: 216e9ce3-28d7-4282-ae91-3aa6282626e1] Start building networks asynchronously for instance. {{(pid=75176) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 15:58:46 user nova-compute[75176]: DEBUG nova.compute.manager [None req-f33a29d3-2c93-4108-8b5f-cf13da769e69 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: 216e9ce3-28d7-4282-ae91-3aa6282626e1] Allocating IP information in the background. {{(pid=75176) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 15:58:46 user nova-compute[75176]: DEBUG nova.network.neutron [None req-f33a29d3-2c93-4108-8b5f-cf13da769e69 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: 216e9ce3-28d7-4282-ae91-3aa6282626e1] allocate_for_instance() {{(pid=75176) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 15:58:46 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-f33a29d3-2c93-4108-8b5f-cf13da769e69 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: 216e9ce3-28d7-4282-ae91-3aa6282626e1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 15:58:46 user nova-compute[75176]: DEBUG nova.compute.manager [None req-f33a29d3-2c93-4108-8b5f-cf13da769e69 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: 216e9ce3-28d7-4282-ae91-3aa6282626e1] Start building block device mappings for instance. {{(pid=75176) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 15:58:46 user nova-compute[75176]: DEBUG nova.policy [None req-f33a29d3-2c93-4108-8b5f-cf13da769e69 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '081bf84d24194b81be4e0a6638db9b66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c7783cc16049208421204910982c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75176) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 15:58:46 user nova-compute[75176]: INFO nova.virt.block_device [None req-f33a29d3-2c93-4108-8b5f-cf13da769e69 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: 216e9ce3-28d7-4282-ae91-3aa6282626e1] Booting with volume 6a0ac2c4-a491-487c-b957-f46813dd109d at /dev/vda
Nov 28 15:58:46 user nova-compute[75176]: DEBUG os_brick.utils [None req-f33a29d3-2c93-4108-8b5f-cf13da769e69 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 15:58:46 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:58:46 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:58:46 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[542b8a24-3d67-498e-97b3-d83caec0b340]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:edc924a949b2\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:58:46 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:58:46 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:58:46 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[88cecb8d-1e03-41e2-bba1-50e2a6a5f14c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:58:46 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:58:46 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:58:46 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[11cffee7-0a6d-4ec2-b9f2-9c6b659f06c1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:58:46 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f2283aa-799a-4d54-8d0e-5cb2f307566d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:58:46 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-f33a29d3-2c93-4108-8b5f-cf13da769e69 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Running cmd (subprocess): nvme version {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:58:46 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-f33a29d3-2c93-4108-8b5f-cf13da769e69 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] 'nvme version' failed. Not Retrying. {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 15:58:46 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f33a29d3-2c93-4108-8b5f-cf13da769e69 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] nvme not present on system {{(pid=75176) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 15:58:46 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:58:46 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 15:58:46 user nova-compute[75176]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 15:58:46 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[804842b1-21bf-4703-bc0e-e51251c4d5b7]: (4, '') {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:58:46 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.lightos [None req-f33a29d3-2c93-4108-8b5f-cf13da769e69 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75176) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 15:58:46 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.lightos [None req-f33a29d3-2c93-4108-8b5f-cf13da769e69 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75176) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 15:58:46 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.lightos [None req-f33a29d3-2c93-4108-8b5f-cf13da769e69 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] LIGHTOS: no hostnqn found. {{(pid=75176) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 15:58:46 user nova-compute[75176]: DEBUG os_brick.utils [None req-f33a29d3-2c93-4108-8b5f-cf13da769e69 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:edc924a949b2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 15:58:46 user nova-compute[75176]: DEBUG nova.virt.block_device [None req-f33a29d3-2c93-4108-8b5f-cf13da769e69 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: 216e9ce3-28d7-4282-ae91-3aa6282626e1] Updating existing volume attachment record: 7659096c-4fda-43fa-aa42-2056a9de9638 {{(pid=75176) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 15:58:46 user nova-compute[75176]: DEBUG nova.network.neutron [None req-f33a29d3-2c93-4108-8b5f-cf13da769e69 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: 216e9ce3-28d7-4282-ae91-3aa6282626e1] Successfully created port: f099a41b-937c-4a91-bcc8-d194cd644485 {{(pid=75176) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 15:58:47 user nova-compute[75176]: DEBUG nova.network.neutron [None req-f33a29d3-2c93-4108-8b5f-cf13da769e69 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: 216e9ce3-28d7-4282-ae91-3aa6282626e1] Successfully updated port: f099a41b-937c-4a91-bcc8-d194cd644485 {{(pid=75176) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 15:58:47 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-f33a29d3-2c93-4108-8b5f-cf13da769e69 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Acquiring lock "refresh_cache-216e9ce3-28d7-4282-ae91-3aa6282626e1" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:58:47 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-f33a29d3-2c93-4108-8b5f-cf13da769e69 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Acquired lock "refresh_cache-216e9ce3-28d7-4282-ae91-3aa6282626e1" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:58:47 user nova-compute[75176]: DEBUG nova.network.neutron [None req-f33a29d3-2c93-4108-8b5f-cf13da769e69 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: 216e9ce3-28d7-4282-ae91-3aa6282626e1] Building network info cache for instance {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 15:58:47 user nova-compute[75176]: DEBUG nova.compute.manager [req-52774ec9-5844-4ad0-b9e4-45e163ccfe12 req-1dd651ad-b260-41c0-a100-36689791e144 service nova] [instance: 216e9ce3-28d7-4282-ae91-3aa6282626e1] Received event network-changed-f099a41b-937c-4a91-bcc8-d194cd644485 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:58:47 user nova-compute[75176]: DEBUG nova.compute.manager [req-52774ec9-5844-4ad0-b9e4-45e163ccfe12 req-1dd651ad-b260-41c0-a100-36689791e144 service nova] [instance: 216e9ce3-28d7-4282-ae91-3aa6282626e1] Refreshing instance network info cache due to event network-changed-f099a41b-937c-4a91-bcc8-d194cd644485. {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 15:58:47 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-52774ec9-5844-4ad0-b9e4-45e163ccfe12 req-1dd651ad-b260-41c0-a100-36689791e144 service nova] Acquiring lock "refresh_cache-216e9ce3-28d7-4282-ae91-3aa6282626e1" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:58:47 user nova-compute[75176]: DEBUG nova.network.neutron [None req-f33a29d3-2c93-4108-8b5f-cf13da769e69 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: 216e9ce3-28d7-4282-ae91-3aa6282626e1] Instance cache missing network info. {{(pid=75176) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 15:58:47 user nova-compute[75176]: DEBUG nova.network.neutron [None req-f33a29d3-2c93-4108-8b5f-cf13da769e69 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: 216e9ce3-28d7-4282-ae91-3aa6282626e1] Updating instance_info_cache with network_info: [{"id": "f099a41b-937c-4a91-bcc8-d194cd644485", "address": "fa:16:3e:e9:1a:8d", "network": {"id": "5ec264ad-3459-468c-bdbf-c6a4ef016951", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1574289626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07c7783cc16049208421204910982c79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf099a41b-93", "ovs_interfaceid": "f099a41b-937c-4a91-bcc8-d194cd644485", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:58:47 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-f33a29d3-2c93-4108-8b5f-cf13da769e69 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Releasing lock "refresh_cache-216e9ce3-28d7-4282-ae91-3aa6282626e1" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:58:47 user nova-compute[75176]: DEBUG nova.compute.manager [None req-f33a29d3-2c93-4108-8b5f-cf13da769e69 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: 216e9ce3-28d7-4282-ae91-3aa6282626e1] Instance network_info: |[{"id": "f099a41b-937c-4a91-bcc8-d194cd644485", "address": "fa:16:3e:e9:1a:8d", "network": {"id": "5ec264ad-3459-468c-bdbf-c6a4ef016951", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1574289626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07c7783cc16049208421204910982c79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf099a41b-93", "ovs_interfaceid": "f099a41b-937c-4a91-bcc8-d194cd644485", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75176) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 15:58:47 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-52774ec9-5844-4ad0-b9e4-45e163ccfe12 req-1dd651ad-b260-41c0-a100-36689791e144 service nova] Acquired lock "refresh_cache-216e9ce3-28d7-4282-ae91-3aa6282626e1" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:58:47 user nova-compute[75176]: DEBUG nova.network.neutron [req-52774ec9-5844-4ad0-b9e4-45e163ccfe12 req-1dd651ad-b260-41c0-a100-36689791e144 service nova] [instance: 216e9ce3-28d7-4282-ae91-3aa6282626e1] Refreshing network info cache for port f099a41b-937c-4a91-bcc8-d194cd644485 {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 15:58:48 user nova-compute[75176]: DEBUG nova.network.neutron [req-52774ec9-5844-4ad0-b9e4-45e163ccfe12 req-1dd651ad-b260-41c0-a100-36689791e144 service nova] [instance: 216e9ce3-28d7-4282-ae91-3aa6282626e1] Updated VIF entry in instance network info cache for port f099a41b-937c-4a91-bcc8-d194cd644485. {{(pid=75176) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 15:58:48 user nova-compute[75176]: DEBUG nova.network.neutron [req-52774ec9-5844-4ad0-b9e4-45e163ccfe12 req-1dd651ad-b260-41c0-a100-36689791e144 service nova] [instance: 216e9ce3-28d7-4282-ae91-3aa6282626e1] Updating instance_info_cache with network_info: [{"id": "f099a41b-937c-4a91-bcc8-d194cd644485", "address": "fa:16:3e:e9:1a:8d", "network": {"id": "5ec264ad-3459-468c-bdbf-c6a4ef016951", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1574289626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07c7783cc16049208421204910982c79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf099a41b-93", "ovs_interfaceid": "f099a41b-937c-4a91-bcc8-d194cd644485", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:58:48 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-52774ec9-5844-4ad0-b9e4-45e163ccfe12 req-1dd651ad-b260-41c0-a100-36689791e144 service nova] Releasing lock "refresh_cache-216e9ce3-28d7-4282-ae91-3aa6282626e1" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:58:49 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:58:49 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:58:51 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-01db41a0-581d-477c-ab45-692b5e26e7da tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Acquiring lock "e0b7a064-03b6-4a0d-88be-2f12c12a1ddb" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:58:51 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-01db41a0-581d-477c-ab45-692b5e26e7da tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Lock "e0b7a064-03b6-4a0d-88be-2f12c12a1ddb" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:58:51 user nova-compute[75176]: DEBUG nova.objects.instance [None req-01db41a0-581d-477c-ab45-692b5e26e7da tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Lazy-loading 'flavor' on Instance uuid e0b7a064-03b6-4a0d-88be-2f12c12a1ddb {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:58:51 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-01db41a0-581d-477c-ab45-692b5e26e7da tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Lock "e0b7a064-03b6-4a0d-88be-2f12c12a1ddb" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:58:51 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-01db41a0-581d-477c-ab45-692b5e26e7da tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Acquiring lock "e0b7a064-03b6-4a0d-88be-2f12c12a1ddb" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:58:51 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-01db41a0-581d-477c-ab45-692b5e26e7da tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Lock "e0b7a064-03b6-4a0d-88be-2f12c12a1ddb" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:58:51 user nova-compute[75176]: INFO nova.compute.manager [None req-01db41a0-581d-477c-ab45-692b5e26e7da tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] [instance: e0b7a064-03b6-4a0d-88be-2f12c12a1ddb] Attaching volume b0becf87-3043-4b86-bca1-221d3f06a233 to /dev/vdb
Nov 28 15:58:51 user nova-compute[75176]: DEBUG os_brick.utils [None req-01db41a0-581d-477c-ab45-692b5e26e7da tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 15:58:51 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:58:51 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:58:51 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[de47d00f-445e-40e4-8df8-b31a6f3ca505]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:edc924a949b2\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:58:51 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:58:52 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:58:52 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0ded574-6fda-45ef-9a00-c17420a95305]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:58:52 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:58:52 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:58:52 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[a58bd489-4ddc-47e2-a800-f48590c6ab3a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:58:52 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[34e83de1-3178-4061-a511-d13380c79fb7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:58:52 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-01db41a0-581d-477c-ab45-692b5e26e7da tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Running cmd (subprocess): nvme version {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:58:52 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-01db41a0-581d-477c-ab45-692b5e26e7da tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] 'nvme version' failed. Not Retrying. {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 15:58:52 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.nvmeof [None req-01db41a0-581d-477c-ab45-692b5e26e7da tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] nvme not present on system {{(pid=75176) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 15:58:52 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:58:52 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 15:58:52 user nova-compute[75176]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 15:58:52 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef58a1bb-f943-4a56-9d77-db6779cb9222]: (4, '') {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:58:52 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.lightos [None req-01db41a0-581d-477c-ab45-692b5e26e7da tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75176) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 15:58:52 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.lightos [None req-01db41a0-581d-477c-ab45-692b5e26e7da tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75176) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 15:58:52 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.lightos [None req-01db41a0-581d-477c-ab45-692b5e26e7da tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] LIGHTOS: no hostnqn found. {{(pid=75176) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 15:58:52 user nova-compute[75176]: DEBUG os_brick.utils [None req-01db41a0-581d-477c-ab45-692b5e26e7da tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:edc924a949b2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 15:58:52 user nova-compute[75176]: DEBUG nova.virt.block_device [None req-01db41a0-581d-477c-ab45-692b5e26e7da tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] [instance: e0b7a064-03b6-4a0d-88be-2f12c12a1ddb] Updating existing volume attachment record: baba5e7c-87b0-4d8e-b29f-304937fa51d2 {{(pid=75176) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 15:58:53 user nova-compute[75176]: DEBUG nova.compute.manager [None req-f33a29d3-2c93-4108-8b5f-cf13da769e69 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: 216e9ce3-28d7-4282-ae91-3aa6282626e1] Start spawning the instance on the hypervisor. {{(pid=75176) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 15:58:53 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-f33a29d3-2c93-4108-8b5f-cf13da769e69 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: 216e9ce3-28d7-4282-ae91-3aa6282626e1] Creating instance directory {{(pid=75176) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 15:58:53 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-f33a29d3-2c93-4108-8b5f-cf13da769e69 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: 216e9ce3-28d7-4282-ae91-3aa6282626e1] Creating image(s)
Nov 28 15:58:53 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-f33a29d3-2c93-4108-8b5f-cf13da769e69 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: 216e9ce3-28d7-4282-ae91-3aa6282626e1] Did not create local disks {{(pid=75176) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 28 15:58:53 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-f33a29d3-2c93-4108-8b5f-cf13da769e69 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: 216e9ce3-28d7-4282-ae91-3aa6282626e1] Ensure instance console log exists: /opt/stack/data/nova/instances/216e9ce3-28d7-4282-ae91-3aa6282626e1/console.log {{(pid=75176) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 15:58:53 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-f33a29d3-2c93-4108-8b5f-cf13da769e69 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:58:53 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-f33a29d3-2c93-4108-8b5f-cf13da769e69 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:58:53 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-f33a29d3-2c93-4108-8b5f-cf13da769e69 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:58:53 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-f33a29d3-2c93-4108-8b5f-cf13da769e69 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: 216e9ce3-28d7-4282-ae91-3aa6282626e1] Start _get_guest_xml network_info=[{"id": "f099a41b-937c-4a91-bcc8-d194cd644485", "address": "fa:16:3e:e9:1a:8d", "network": {"id": "5ec264ad-3459-468c-bdbf-c6a4ef016951", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1574289626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07c7783cc16049208421204910982c79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf099a41b-93", "ovs_interfaceid": "f099a41b-937c-4a91-bcc8-d194cd644485", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6a0ac2c4-a491-487c-b957-f46813dd109d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jVGCWnxp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '216e9ce3-28d7-4282-ae91-3aa6282626e1', 'attached_at': '', 'detached_at': '', 'volume_id': '6a0ac2c4-a491-487c-b957-f46813dd109d', 'serial': '6a0ac2c4-a491-487c-b957-f46813dd109d'}, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'delete_on_termination': False, 'mount_device': '/dev/vda', 'attachment_id': '7659096c-4fda-43fa-aa42-2056a9de9638', 'volume_type': None} {{(pid=75176) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 15:58:53 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-f33a29d3-2c93-4108-8b5f-cf13da769e69 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 15:58:53 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-f33a29d3-2c93-4108-8b5f-cf13da769e69 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 15:58:53 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-f33a29d3-2c93-4108-8b5f-cf13da769e69 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75176) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 15:58:53 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-f33a29d3-2c93-4108-8b5f-cf13da769e69 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] CPU controller missing on host. {{(pid=75176) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 15:58:53 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-f33a29d3-2c93-4108-8b5f-cf13da769e69 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75176) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 15:58:53 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-f33a29d3-2c93-4108-8b5f-cf13da769e69 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] CPU controller found on host. {{(pid=75176) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 15:58:53 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-f33a29d3-2c93-4108-8b5f-cf13da769e69 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75176) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 15:58:53 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-f33a29d3-2c93-4108-8b5f-cf13da769e69 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T15:35:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 15:58:53 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-f33a29d3-2c93-4108-8b5f-cf13da769e69 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Flavor limits 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 15:58:53 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-f33a29d3-2c93-4108-8b5f-cf13da769e69 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Image limits 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 15:58:53 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-f33a29d3-2c93-4108-8b5f-cf13da769e69 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Flavor pref 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 15:58:53 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-f33a29d3-2c93-4108-8b5f-cf13da769e69 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Image pref 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 15:58:53 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-f33a29d3-2c93-4108-8b5f-cf13da769e69 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 15:58:53 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-f33a29d3-2c93-4108-8b5f-cf13da769e69 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 15:58:53 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-f33a29d3-2c93-4108-8b5f-cf13da769e69 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75176) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 15:58:53 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-f33a29d3-2c93-4108-8b5f-cf13da769e69 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Got 1 possible topologies {{(pid=75176) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 15:58:53 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-f33a29d3-2c93-4108-8b5f-cf13da769e69 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 15:58:53 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-f33a29d3-2c93-4108-8b5f-cf13da769e69 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 15:58:53 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f33a29d3-2c93-4108-8b5f-cf13da769e69 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: 216e9ce3-28d7-4282-ae91-3aa6282626e1] Calling os-brick to attach iSCSI Volume {{(pid=75176) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 15:58:53 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-f33a29d3-2c93-4108-8b5f-cf13da769e69 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c1b8a00>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6a0ac2c4-a491-487c-b957-f46813dd109d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jVGCWnxp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 15:58:53 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-f33a29d3-2c93-4108-8b5f-cf13da769e69 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 15:58:53 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-f33a29d3-2c93-4108-8b5f-cf13da769e69 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 15:58:53 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-f33a29d3-2c93-4108-8b5f-cf13da769e69 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 15:58:53 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-f33a29d3-2c93-4108-8b5f-cf13da769e69 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 15:58:53 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-f33a29d3-2c93-4108-8b5f-cf13da769e69 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6a0ac2c4-a491-487c-b957-f46813dd109d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 15:58:53 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-f33a29d3-2c93-4108-8b5f-cf13da769e69 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6a0ac2c4-a491-487c-b957-f46813dd109d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 15:58:53 user nova-compute[75176]: INFO os_brick.initiator.connectors.iscsi [None req-f33a29d3-2c93-4108-8b5f-cf13da769e69 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 15:58:53 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a0ac2c4-a491-487c-b957-f46813dd109d -p 172.16.0.220:3260 {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:58:53 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a0ac2c4-a491-487c-b957-f46813dd109d -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:58:53 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[97551783-ece5-46c2-bd70-37f52689a832]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:58:53 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-f33a29d3-2c93-4108-8b5f-cf13da769e69 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 15:58:53 user nova-compute[75176]:  {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:58:53 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a0ac2c4-a491-487c-b957-f46813dd109d -p 172.16.0.220:3260 --interface default --op new {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:58:53 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a0ac2c4-a491-487c-b957-f46813dd109d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:58:53 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e9b87a6-8cd2-4770-97df-e505c3de2a3a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6a0ac2c4-a491-487c-b957-f46813dd109d] added\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:58:53 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-f33a29d3-2c93-4108-8b5f-cf13da769e69 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6a0ac2c4-a491-487c-b957-f46813dd109d] added
Nov 28 15:58:53 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:58:53 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a0ac2c4-a491-487c-b957-f46813dd109d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:58:53 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a0ac2c4-a491-487c-b957-f46813dd109d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:58:53 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[160f7443-9314-4ea5-8b32-bfcad004121d]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:58:53 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-f33a29d3-2c93-4108-8b5f-cf13da769e69 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:58:53 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a0ac2c4-a491-487c-b957-f46813dd109d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:58:53 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a0ac2c4-a491-487c-b957-f46813dd109d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:58:53 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[d584164b-bb74-4b97-a53f-fbc2c6766fd8]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:58:53 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-f33a29d3-2c93-4108-8b5f-cf13da769e69 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:58:53 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a0ac2c4-a491-487c-b957-f46813dd109d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jVGCWnxp {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:58:53 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a0ac2c4-a491-487c-b957-f46813dd109d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jVGCWnxp" returned: 0 in 0.022s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:58:53 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[18dc64b8-ec0e-4444-968f-20e4401d8597]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:58:53 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-f33a29d3-2c93-4108-8b5f-cf13da769e69 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jVGCWnxp'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:58:53 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a0ac2c4-a491-487c-b957-f46813dd109d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:58:54 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a0ac2c4-a491-487c-b957-f46813dd109d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:58:54 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[932131cf-3083-420c-8754-27c6188bd11b]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:58:54 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-f33a29d3-2c93-4108-8b5f-cf13da769e69 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:58:54 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:58:54 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:58:54 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[819f1844-099d-434d-ac02-6c8f093952be]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0f9d557-1dc1-4892-b808-35606162f6a5 (non-flash)\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:58:54 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-f33a29d3-2c93-4108-8b5f-cf13da769e69 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 (non-flash)
Nov 28 15:58:54 user nova-compute[75176]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0 (non-flash)
Nov 28 15:58:54 user nova-compute[75176]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0f9d557-1dc1-4892-b808-35606162f6a5 (non-flash)
Nov 28 15:58:54 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:58:54 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-f33a29d3-2c93-4108-8b5f-cf13da769e69 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 (non-flash)
Nov 28 15:58:54 user nova-compute[75176]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0 (non-flash)
Nov 28 15:58:54 user nova-compute[75176]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0f9d557-1dc1-4892-b808-35606162f6a5 (non-flash)
Nov 28 15:58:54 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 15:58:54 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a0ac2c4-a491-487c-b957-f46813dd109d -p 172.16.0.220:3260 --login {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:58:54 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a0ac2c4-a491-487c-b957-f46813dd109d -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:58:54 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[e57dd3f0-5101-4b9d-9cbc-250651c00b30]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6a0ac2c4-a491-487c-b957-f46813dd109d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6a0ac2c4-a491-487c-b957-f46813dd109d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:58:54 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-f33a29d3-2c93-4108-8b5f-cf13da769e69 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6a0ac2c4-a491-487c-b957-f46813dd109d, portal: 172.16.0.220,3260]
Nov 28 15:58:54 user nova-compute[75176]: Login to [iface: default, target: iqn.2010-10.org.openstack:6a0ac2c4-a491-487c-b957-f46813dd109d, portal: 172.16.0.220,3260] successful.
Nov 28 15:58:54 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:58:54 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a0ac2c4-a491-487c-b957-f46813dd109d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:58:54 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a0ac2c4-a491-487c-b957-f46813dd109d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:58:54 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[2230aab6-510e-4ab5-927b-17341b344dcb]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:58:54 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-f33a29d3-2c93-4108-8b5f-cf13da769e69 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:58:54 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:58:54 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:58:54 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[6586205d-c4e7-4349-a6f1-f0e25efbf618]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0f9d557-1dc1-4892-b808-35606162f6a5 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a0ac2c4-a491-487c-b957-f46813dd109d (non-flash)\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:58:54 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-f33a29d3-2c93-4108-8b5f-cf13da769e69 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 (non-flash)
Nov 28 15:58:54 user nova-compute[75176]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0 (non-flash)
Nov 28 15:58:54 user nova-compute[75176]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0f9d557-1dc1-4892-b808-35606162f6a5 (non-flash)
Nov 28 15:58:54 user nova-compute[75176]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a0ac2c4-a491-487c-b957-f46813dd109d (non-flash)
Nov 28 15:58:54 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:58:54 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-f33a29d3-2c93-4108-8b5f-cf13da769e69 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 (non-flash)
Nov 28 15:58:54 user nova-compute[75176]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0 (non-flash)
Nov 28 15:58:54 user nova-compute[75176]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0f9d557-1dc1-4892-b808-35606162f6a5 (non-flash)
Nov 28 15:58:54 user nova-compute[75176]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a0ac2c4-a491-487c-b957-f46813dd109d (non-flash)
Nov 28 15:58:54 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 15:58:54 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-f33a29d3-2c93-4108-8b5f-cf13da769e69 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6a0ac2c4-a491-487c-b957-f46813dd109d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.300s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 15:58:54 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-f33a29d3-2c93-4108-8b5f-cf13da769e69 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Connected to 172.16.0.220:3260 {{(pid=75176) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 15:58:54 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-f33a29d3-2c93-4108-8b5f-cf13da769e69 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] HCTL ('36', '-', '-', 0) found on session 53 with lun 0 {{(pid=75176) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 15:58:54 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-f33a29d3-2c93-4108-8b5f-cf13da769e69 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75176) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 15:58:54 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:58:54 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:58:54 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e132779-6beb-458f-821a-763be9e56ccd]: (4, ('- - 0', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:58:54 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-f33a29d3-2c93-4108-8b5f-cf13da769e69 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Searching for a device in session 53 and hctl ['36', '*', '*', 0] yield: None {{(pid=75176) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 15:58:54 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:58:54 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:58:55 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-f33a29d3-2c93-4108-8b5f-cf13da769e69 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Searching for a device in session 53 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75176) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 15:58:55 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-f33a29d3-2c93-4108-8b5f-cf13da769e69 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:6a0ac2c4-a491-487c-b957-f46813dd109d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jVGCWnxp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75176) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 15:58:55 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-f33a29d3-2c93-4108-8b5f-cf13da769e69 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.387s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 15:58:55 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-f33a29d3-2c93-4108-8b5f-cf13da769e69 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] <== connect_volume: return (1389ms) {'type': 'block', 'scsi_wwn': '23839643434366439', 'path': '/dev/sde'} {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 15:58:55 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f33a29d3-2c93-4108-8b5f-cf13da769e69 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: 216e9ce3-28d7-4282-ae91-3aa6282626e1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23839643434366439', 'path': '/dev/sde'} {{(pid=75176) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 15:58:55 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-f33a29d3-2c93-4108-8b5f-cf13da769e69 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T15:58:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-685970400',display_name='tempest-TestVolumeBootPattern-server-685970400',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-685970400',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAT4j4MwMCXcgxPv2ypvh6Le18WUkR/7PQX0ERUSwv8uiHb35AkMlGdcRbKgULWyfAemfpuoTAyzTZycSyQIMMK+kqb2pUHOOT/5otX0G6BKfJMaYPfRy2E0NOlU0WUh/Q==',key_name='tempest-TestVolumeBootPattern-94664483',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='07c7783cc16049208421204910982c79',ramdisk_id='',reservation_id='r-b3jl9i5m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1695196118',owner_user_name='tempest-TestVolumeBootPattern-1695196118-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T15:58:46Z,user_data=None,user_id='081bf84d24194b81be4e0a6638db9b66',uuid=216e9ce3-28d7-4282-ae91-3aa6282626e1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f099a41b-937c-4a91-bcc8-d194cd644485", "address": "fa:16:3e:e9:1a:8d", "network": {"id": "5ec264ad-3459-468c-bdbf-c6a4ef016951", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1574289626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07c7783cc16049208421204910982c79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf099a41b-93", "ovs_interfaceid": "f099a41b-937c-4a91-bcc8-d194cd644485", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75176) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 15:58:55 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-f33a29d3-2c93-4108-8b5f-cf13da769e69 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Converting VIF {"id": "f099a41b-937c-4a91-bcc8-d194cd644485", "address": "fa:16:3e:e9:1a:8d", "network": {"id": "5ec264ad-3459-468c-bdbf-c6a4ef016951", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1574289626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07c7783cc16049208421204910982c79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf099a41b-93", "ovs_interfaceid": "f099a41b-937c-4a91-bcc8-d194cd644485", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:58:55 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-f33a29d3-2c93-4108-8b5f-cf13da769e69 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e9:1a:8d,bridge_name='br-int',has_traffic_filtering=True,id=f099a41b-937c-4a91-bcc8-d194cd644485,network=Network(5ec264ad-3459-468c-bdbf-c6a4ef016951),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf099a41b-93') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:58:55 user nova-compute[75176]: DEBUG nova.objects.instance [None req-f33a29d3-2c93-4108-8b5f-cf13da769e69 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Lazy-loading 'pci_devices' on Instance uuid 216e9ce3-28d7-4282-ae91-3aa6282626e1 {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:58:55 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-f33a29d3-2c93-4108-8b5f-cf13da769e69 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: 216e9ce3-28d7-4282-ae91-3aa6282626e1] End _get_guest_xml xml=<domain type="kvm">
Nov 28 15:58:55 user nova-compute[75176]:   <uuid>216e9ce3-28d7-4282-ae91-3aa6282626e1</uuid>
Nov 28 15:58:55 user nova-compute[75176]:   <name>instance-0000002e</name>
Nov 28 15:58:55 user nova-compute[75176]:   <memory>524288</memory>
Nov 28 15:58:55 user nova-compute[75176]:   <vcpu>1</vcpu>
Nov 28 15:58:55 user nova-compute[75176]:   <metadata>
Nov 28 15:58:55 user nova-compute[75176]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 15:58:55 user nova-compute[75176]:       <nova:package version="0.0.0"/>
Nov 28 15:58:55 user nova-compute[75176]:       <nova:name>tempest-TestVolumeBootPattern-server-685970400</nova:name>
Nov 28 15:58:55 user nova-compute[75176]:       <nova:creationTime>2023-11-28 15:58:53</nova:creationTime>
Nov 28 15:58:55 user nova-compute[75176]:       <nova:flavor name="m1.tiny">
Nov 28 15:58:55 user nova-compute[75176]:         <nova:memory>512</nova:memory>
Nov 28 15:58:55 user nova-compute[75176]:         <nova:disk>1</nova:disk>
Nov 28 15:58:55 user nova-compute[75176]:         <nova:swap>0</nova:swap>
Nov 28 15:58:55 user nova-compute[75176]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 15:58:55 user nova-compute[75176]:         <nova:vcpus>1</nova:vcpus>
Nov 28 15:58:55 user nova-compute[75176]:       </nova:flavor>
Nov 28 15:58:55 user nova-compute[75176]:       <nova:owner>
Nov 28 15:58:55 user nova-compute[75176]:         <nova:user uuid="081bf84d24194b81be4e0a6638db9b66">tempest-TestVolumeBootPattern-1695196118-project-member</nova:user>
Nov 28 15:58:55 user nova-compute[75176]:         <nova:project uuid="07c7783cc16049208421204910982c79">tempest-TestVolumeBootPattern-1695196118</nova:project>
Nov 28 15:58:55 user nova-compute[75176]:       </nova:owner>
Nov 28 15:58:55 user nova-compute[75176]:       <nova:ports>
Nov 28 15:58:55 user nova-compute[75176]:         <nova:port uuid="f099a41b-937c-4a91-bcc8-d194cd644485">
Nov 28 15:58:55 user nova-compute[75176]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 28 15:58:55 user nova-compute[75176]:         </nova:port>
Nov 28 15:58:55 user nova-compute[75176]:       </nova:ports>
Nov 28 15:58:55 user nova-compute[75176]:     </nova:instance>
Nov 28 15:58:55 user nova-compute[75176]:   </metadata>
Nov 28 15:58:55 user nova-compute[75176]:   <sysinfo type="smbios">
Nov 28 15:58:55 user nova-compute[75176]:     <system>
Nov 28 15:58:55 user nova-compute[75176]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 15:58:55 user nova-compute[75176]:       <entry name="product">OpenStack Nova</entry>
Nov 28 15:58:55 user nova-compute[75176]:       <entry name="version">0.0.0</entry>
Nov 28 15:58:55 user nova-compute[75176]:       <entry name="serial">216e9ce3-28d7-4282-ae91-3aa6282626e1</entry>
Nov 28 15:58:55 user nova-compute[75176]:       <entry name="uuid">216e9ce3-28d7-4282-ae91-3aa6282626e1</entry>
Nov 28 15:58:55 user nova-compute[75176]:       <entry name="family">Virtual Machine</entry>
Nov 28 15:58:55 user nova-compute[75176]:     </system>
Nov 28 15:58:55 user nova-compute[75176]:   </sysinfo>
Nov 28 15:58:55 user nova-compute[75176]:   <os>
Nov 28 15:58:55 user nova-compute[75176]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 15:58:55 user nova-compute[75176]:     <boot dev="hd"/>
Nov 28 15:58:55 user nova-compute[75176]:     <smbios mode="sysinfo"/>
Nov 28 15:58:55 user nova-compute[75176]:   </os>
Nov 28 15:58:55 user nova-compute[75176]:   <features>
Nov 28 15:58:55 user nova-compute[75176]:     <acpi/>
Nov 28 15:58:55 user nova-compute[75176]:     <apic/>
Nov 28 15:58:55 user nova-compute[75176]:     <vmcoreinfo/>
Nov 28 15:58:55 user nova-compute[75176]:   </features>
Nov 28 15:58:55 user nova-compute[75176]:   <clock offset="utc">
Nov 28 15:58:55 user nova-compute[75176]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 15:58:55 user nova-compute[75176]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 15:58:55 user nova-compute[75176]:     <timer name="hpet" present="no"/>
Nov 28 15:58:55 user nova-compute[75176]:   </clock>
Nov 28 15:58:55 user nova-compute[75176]:   <cpu mode="custom" match="exact">
Nov 28 15:58:55 user nova-compute[75176]:     <model>Nehalem</model>
Nov 28 15:58:55 user nova-compute[75176]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 15:58:55 user nova-compute[75176]:   </cpu>
Nov 28 15:58:55 user nova-compute[75176]:   <devices>
Nov 28 15:58:55 user nova-compute[75176]:     <disk type="block" device="disk">
Nov 28 15:58:55 user nova-compute[75176]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 15:58:55 user nova-compute[75176]:       <source dev="/dev/sde"/>
Nov 28 15:58:55 user nova-compute[75176]:       <target dev="vda" bus="virtio"/>
Nov 28 15:58:55 user nova-compute[75176]:       <serial>6a0ac2c4-a491-487c-b957-f46813dd109d</serial>
Nov 28 15:58:55 user nova-compute[75176]:     </disk>
Nov 28 15:58:55 user nova-compute[75176]:     <interface type="ethernet">
Nov 28 15:58:55 user nova-compute[75176]:       <mac address="fa:16:3e:e9:1a:8d"/>
Nov 28 15:58:55 user nova-compute[75176]:       <model type="virtio"/>
Nov 28 15:58:55 user nova-compute[75176]:       <mtu size="1442"/>
Nov 28 15:58:55 user nova-compute[75176]:       <target dev="tapf099a41b-93"/>
Nov 28 15:58:55 user nova-compute[75176]:     </interface>
Nov 28 15:58:55 user nova-compute[75176]:     <serial type="pty">
Nov 28 15:58:55 user nova-compute[75176]:       <log file="/opt/stack/data/nova/instances/216e9ce3-28d7-4282-ae91-3aa6282626e1/console.log" append="off"/>
Nov 28 15:58:55 user nova-compute[75176]:     </serial>
Nov 28 15:58:55 user nova-compute[75176]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 15:58:55 user nova-compute[75176]:     <video>
Nov 28 15:58:55 user nova-compute[75176]:       <model type="virtio"/>
Nov 28 15:58:55 user nova-compute[75176]:     </video>
Nov 28 15:58:55 user nova-compute[75176]:     <rng model="virtio">
Nov 28 15:58:55 user nova-compute[75176]:       <backend model="random">/dev/urandom</backend>
Nov 28 15:58:55 user nova-compute[75176]:     </rng>
Nov 28 15:58:55 user nova-compute[75176]:     <controller type="usb" index="0" model="none"/>
Nov 28 15:58:55 user nova-compute[75176]:     <memballoon model="virtio">
Nov 28 15:58:55 user nova-compute[75176]:       <stats period="10"/>
Nov 28 15:58:55 user nova-compute[75176]:     </memballoon>
Nov 28 15:58:55 user nova-compute[75176]:   </devices>
Nov 28 15:58:55 user nova-compute[75176]: </domain>
Nov 28 15:58:55 user nova-compute[75176]:  {{(pid=75176) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 15:58:55 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-f33a29d3-2c93-4108-8b5f-cf13da769e69 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T15:58:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-685970400',display_name='tempest-TestVolumeBootPattern-server-685970400',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-685970400',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAT4j4MwMCXcgxPv2ypvh6Le18WUkR/7PQX0ERUSwv8uiHb35AkMlGdcRbKgULWyfAemfpuoTAyzTZycSyQIMMK+kqb2pUHOOT/5otX0G6BKfJMaYPfRy2E0NOlU0WUh/Q==',key_name='tempest-TestVolumeBootPattern-94664483',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='07c7783cc16049208421204910982c79',ramdisk_id='',reservation_id='r-b3jl9i5m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1695196118',owner_user_name='tempest-TestVolumeBootPattern-1695196118-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T15:58:46Z,user_data=None,user_id='081bf84d24194b81be4e0a6638db9b66',uuid=216e9ce3-28d7-4282-ae91-3aa6282626e1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f099a41b-937c-4a91-bcc8-d194cd644485", "address": "fa:16:3e:e9:1a:8d", "network": {"id": "5ec264ad-3459-468c-bdbf-c6a4ef016951", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1574289626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07c7783cc16049208421204910982c79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf099a41b-93", "ovs_interfaceid": "f099a41b-937c-4a91-bcc8-d194cd644485", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 15:58:55 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-f33a29d3-2c93-4108-8b5f-cf13da769e69 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Converting VIF {"id": "f099a41b-937c-4a91-bcc8-d194cd644485", "address": "fa:16:3e:e9:1a:8d", "network": {"id": "5ec264ad-3459-468c-bdbf-c6a4ef016951", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1574289626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07c7783cc16049208421204910982c79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf099a41b-93", "ovs_interfaceid": "f099a41b-937c-4a91-bcc8-d194cd644485", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:58:55 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-f33a29d3-2c93-4108-8b5f-cf13da769e69 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e9:1a:8d,bridge_name='br-int',has_traffic_filtering=True,id=f099a41b-937c-4a91-bcc8-d194cd644485,network=Network(5ec264ad-3459-468c-bdbf-c6a4ef016951),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf099a41b-93') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:58:55 user nova-compute[75176]: DEBUG os_vif [None req-f33a29d3-2c93-4108-8b5f-cf13da769e69 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e9:1a:8d,bridge_name='br-int',has_traffic_filtering=True,id=f099a41b-937c-4a91-bcc8-d194cd644485,network=Network(5ec264ad-3459-468c-bdbf-c6a4ef016951),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf099a41b-93') {{(pid=75176) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 15:58:55 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:58:55 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:58:55 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 15:58:55 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:58:55 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '945c233d-2528-5ede-84fd-17a12aad7e08', '_type': 'linux-noop'}}, row=False) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:58:55 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:58:55 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:58:55 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:58:55 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf099a41b-93, may_exist=True, interface_attrs={}) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:58:55 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf099a41b-93, col_values=(('qos', UUID('691641c7-002c-405f-bf6f-cf125c1d5cf9')),), if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:58:55 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf099a41b-93, col_values=(('external_ids', {'iface-id': 'f099a41b-937c-4a91-bcc8-d194cd644485', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e9:1a:8d', 'vm-uuid': '216e9ce3-28d7-4282-ae91-3aa6282626e1'}),), if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:58:55 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:58:55 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:58:55 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:58:55 user nova-compute[75176]: INFO os_vif [None req-f33a29d3-2c93-4108-8b5f-cf13da769e69 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e9:1a:8d,bridge_name='br-int',has_traffic_filtering=True,id=f099a41b-937c-4a91-bcc8-d194cd644485,network=Network(5ec264ad-3459-468c-bdbf-c6a4ef016951),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf099a41b-93')
Nov 28 15:58:55 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-f33a29d3-2c93-4108-8b5f-cf13da769e69 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] No BDM found with device name vda, not building metadata. {{(pid=75176) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 15:58:55 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-f33a29d3-2c93-4108-8b5f-cf13da769e69 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] No VIF found with MAC fa:16:3e:e9:1a:8d, not building metadata {{(pid=75176) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 15:58:56 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:58:56 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:58:56 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:58:56 user nova-compute[75176]: DEBUG nova.compute.manager [req-c4345d82-97d0-4a38-b3b9-5d01c85383c7 req-6b519597-bf10-4846-a176-df35efb615a0 service nova] [instance: 216e9ce3-28d7-4282-ae91-3aa6282626e1] Received event network-vif-plugged-f099a41b-937c-4a91-bcc8-d194cd644485 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:58:56 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-c4345d82-97d0-4a38-b3b9-5d01c85383c7 req-6b519597-bf10-4846-a176-df35efb615a0 service nova] Acquiring lock "216e9ce3-28d7-4282-ae91-3aa6282626e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:58:56 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-c4345d82-97d0-4a38-b3b9-5d01c85383c7 req-6b519597-bf10-4846-a176-df35efb615a0 service nova] Lock "216e9ce3-28d7-4282-ae91-3aa6282626e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:58:56 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-c4345d82-97d0-4a38-b3b9-5d01c85383c7 req-6b519597-bf10-4846-a176-df35efb615a0 service nova] Lock "216e9ce3-28d7-4282-ae91-3aa6282626e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:58:56 user nova-compute[75176]: DEBUG nova.compute.manager [req-c4345d82-97d0-4a38-b3b9-5d01c85383c7 req-6b519597-bf10-4846-a176-df35efb615a0 service nova] [instance: 216e9ce3-28d7-4282-ae91-3aa6282626e1] No waiting events found dispatching network-vif-plugged-f099a41b-937c-4a91-bcc8-d194cd644485 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:58:56 user nova-compute[75176]: WARNING nova.compute.manager [req-c4345d82-97d0-4a38-b3b9-5d01c85383c7 req-6b519597-bf10-4846-a176-df35efb615a0 service nova] [instance: 216e9ce3-28d7-4282-ae91-3aa6282626e1] Received unexpected event network-vif-plugged-f099a41b-937c-4a91-bcc8-d194cd644485 for instance with vm_state building and task_state spawning.
Nov 28 15:58:56 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:58:56 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:58:58 user nova-compute[75176]: DEBUG nova.compute.manager [req-73f5574a-a25a-4a77-8b23-7d9fac2aff12 req-42dea631-0348-4c4e-beb9-c323f2ff4fbc service nova] [instance: 216e9ce3-28d7-4282-ae91-3aa6282626e1] Received event network-vif-plugged-f099a41b-937c-4a91-bcc8-d194cd644485 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:58:58 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-73f5574a-a25a-4a77-8b23-7d9fac2aff12 req-42dea631-0348-4c4e-beb9-c323f2ff4fbc service nova] Acquiring lock "216e9ce3-28d7-4282-ae91-3aa6282626e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:58:58 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-73f5574a-a25a-4a77-8b23-7d9fac2aff12 req-42dea631-0348-4c4e-beb9-c323f2ff4fbc service nova] Lock "216e9ce3-28d7-4282-ae91-3aa6282626e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:58:58 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-73f5574a-a25a-4a77-8b23-7d9fac2aff12 req-42dea631-0348-4c4e-beb9-c323f2ff4fbc service nova] Lock "216e9ce3-28d7-4282-ae91-3aa6282626e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:58:58 user nova-compute[75176]: DEBUG nova.compute.manager [req-73f5574a-a25a-4a77-8b23-7d9fac2aff12 req-42dea631-0348-4c4e-beb9-c323f2ff4fbc service nova] [instance: 216e9ce3-28d7-4282-ae91-3aa6282626e1] No waiting events found dispatching network-vif-plugged-f099a41b-937c-4a91-bcc8-d194cd644485 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:58:58 user nova-compute[75176]: WARNING nova.compute.manager [req-73f5574a-a25a-4a77-8b23-7d9fac2aff12 req-42dea631-0348-4c4e-beb9-c323f2ff4fbc service nova] [instance: 216e9ce3-28d7-4282-ae91-3aa6282626e1] Received unexpected event network-vif-plugged-f099a41b-937c-4a91-bcc8-d194cd644485 for instance with vm_state building and task_state spawning.
Nov 28 15:58:59 user nova-compute[75176]: DEBUG nova.compute.manager [None req-f33a29d3-2c93-4108-8b5f-cf13da769e69 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: 216e9ce3-28d7-4282-ae91-3aa6282626e1] Instance event wait completed in 0 seconds for  {{(pid=75176) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 15:58:59 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-f33a29d3-2c93-4108-8b5f-cf13da769e69 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: 216e9ce3-28d7-4282-ae91-3aa6282626e1] Guest created on hypervisor {{(pid=75176) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 15:58:59 user nova-compute[75176]: INFO nova.virt.libvirt.driver [-] [instance: 216e9ce3-28d7-4282-ae91-3aa6282626e1] Instance spawned successfully.
Nov 28 15:58:59 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-f33a29d3-2c93-4108-8b5f-cf13da769e69 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: 216e9ce3-28d7-4282-ae91-3aa6282626e1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 15:58:59 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-f33a29d3-2c93-4108-8b5f-cf13da769e69 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: 216e9ce3-28d7-4282-ae91-3aa6282626e1] Found default for hw_cdrom_bus of ide {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:58:59 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-f33a29d3-2c93-4108-8b5f-cf13da769e69 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: 216e9ce3-28d7-4282-ae91-3aa6282626e1] Found default for hw_disk_bus of virtio {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:58:59 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-f33a29d3-2c93-4108-8b5f-cf13da769e69 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: 216e9ce3-28d7-4282-ae91-3aa6282626e1] Found default for hw_input_bus of None {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:58:59 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-f33a29d3-2c93-4108-8b5f-cf13da769e69 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: 216e9ce3-28d7-4282-ae91-3aa6282626e1] Found default for hw_pointer_model of None {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:58:59 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-f33a29d3-2c93-4108-8b5f-cf13da769e69 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: 216e9ce3-28d7-4282-ae91-3aa6282626e1] Found default for hw_video_model of virtio {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:58:59 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-f33a29d3-2c93-4108-8b5f-cf13da769e69 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: 216e9ce3-28d7-4282-ae91-3aa6282626e1] Found default for hw_vif_model of virtio {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 15:58:59 user nova-compute[75176]: INFO nova.compute.manager [None req-f33a29d3-2c93-4108-8b5f-cf13da769e69 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: 216e9ce3-28d7-4282-ae91-3aa6282626e1] Took 5.37 seconds to spawn the instance on the hypervisor.
Nov 28 15:58:59 user nova-compute[75176]: DEBUG nova.compute.manager [None req-f33a29d3-2c93-4108-8b5f-cf13da769e69 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: 216e9ce3-28d7-4282-ae91-3aa6282626e1] Checking state {{(pid=75176) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 15:58:59 user nova-compute[75176]: INFO nova.compute.manager [None req-f33a29d3-2c93-4108-8b5f-cf13da769e69 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: 216e9ce3-28d7-4282-ae91-3aa6282626e1] Took 13.71 seconds to build instance.
Nov 28 15:58:59 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-f33a29d3-2c93-4108-8b5f-cf13da769e69 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Lock "216e9ce3-28d7-4282-ae91-3aa6282626e1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.809s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:58:59 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:58:59 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-01db41a0-581d-477c-ab45-692b5e26e7da tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] [instance: e0b7a064-03b6-4a0d-88be-2f12c12a1ddb] Calling os-brick to attach iSCSI Volume {{(pid=75176) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 15:58:59 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-01db41a0-581d-477c-ab45-692b5e26e7da tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c1b8a00>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b0becf87-3043-4b86-bca1-221d3f06a233', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TCgkjqAl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 15:58:59 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-01db41a0-581d-477c-ab45-692b5e26e7da tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 15:58:59 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-01db41a0-581d-477c-ab45-692b5e26e7da tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 15:58:59 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-01db41a0-581d-477c-ab45-692b5e26e7da tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 15:58:59 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-01db41a0-581d-477c-ab45-692b5e26e7da tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 15:58:59 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-01db41a0-581d-477c-ab45-692b5e26e7da tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b0becf87-3043-4b86-bca1-221d3f06a233" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 15:58:59 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-01db41a0-581d-477c-ab45-692b5e26e7da tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b0becf87-3043-4b86-bca1-221d3f06a233" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 15:58:59 user nova-compute[75176]: INFO os_brick.initiator.connectors.iscsi [None req-01db41a0-581d-477c-ab45-692b5e26e7da tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 15:58:59 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0becf87-3043-4b86-bca1-221d3f06a233 -p 172.16.0.220:3260 {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:58:59 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0becf87-3043-4b86-bca1-221d3f06a233 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:58:59 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[16d2aa2f-c3f2-44bc-8878-27e2578b6a71]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:58:59 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-01db41a0-581d-477c-ab45-692b5e26e7da tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 15:58:59 user nova-compute[75176]:  {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:58:59 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0becf87-3043-4b86-bca1-221d3f06a233 -p 172.16.0.220:3260 --interface default --op new {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:58:59 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0becf87-3043-4b86-bca1-221d3f06a233 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:58:59 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[578089ed-e776-488d-a931-ec74150b5269]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b0becf87-3043-4b86-bca1-221d3f06a233] added\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:58:59 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-01db41a0-581d-477c-ab45-692b5e26e7da tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b0becf87-3043-4b86-bca1-221d3f06a233] added
Nov 28 15:58:59 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:58:59 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0becf87-3043-4b86-bca1-221d3f06a233 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:58:59 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0becf87-3043-4b86-bca1-221d3f06a233 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.129s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:58:59 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1ee71ea-c6af-4b79-aa38-ad5765087b86]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:58:59 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-01db41a0-581d-477c-ab45-692b5e26e7da tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:58:59 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0becf87-3043-4b86-bca1-221d3f06a233 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:59:00 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0becf87-3043-4b86-bca1-221d3f06a233 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:59:00 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[43051d27-6ef9-4d18-9873-09dd853f69ea]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:59:00 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-01db41a0-581d-477c-ab45-692b5e26e7da tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:59:00 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0becf87-3043-4b86-bca1-221d3f06a233 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TCgkjqAl {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:59:00 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0becf87-3043-4b86-bca1-221d3f06a233 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TCgkjqAl" returned: 0 in 0.025s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:59:00 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[6de34e66-a928-4a48-a684-eee399de4b1f]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:59:00 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-01db41a0-581d-477c-ab45-692b5e26e7da tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TCgkjqAl'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:59:00 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0becf87-3043-4b86-bca1-221d3f06a233 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:59:00 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0becf87-3043-4b86-bca1-221d3f06a233 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:59:00 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[613d4665-ed9e-483e-815b-68168f786694]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:59:00 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-01db41a0-581d-477c-ab45-692b5e26e7da tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:59:00 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:59:00 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:59:00 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[608b76ef-3a60-496c-9d3e-eb3e84891b48]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0f9d557-1dc1-4892-b808-35606162f6a5 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a0ac2c4-a491-487c-b957-f46813dd109d (non-flash)\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:59:00 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-01db41a0-581d-477c-ab45-692b5e26e7da tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 (non-flash)
Nov 28 15:59:00 user nova-compute[75176]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0 (non-flash)
Nov 28 15:59:00 user nova-compute[75176]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0f9d557-1dc1-4892-b808-35606162f6a5 (non-flash)
Nov 28 15:59:00 user nova-compute[75176]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a0ac2c4-a491-487c-b957-f46813dd109d (non-flash)
Nov 28 15:59:00 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:59:00 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-01db41a0-581d-477c-ab45-692b5e26e7da tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 (non-flash)
Nov 28 15:59:00 user nova-compute[75176]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0 (non-flash)
Nov 28 15:59:00 user nova-compute[75176]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0f9d557-1dc1-4892-b808-35606162f6a5 (non-flash)
Nov 28 15:59:00 user nova-compute[75176]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a0ac2c4-a491-487c-b957-f46813dd109d (non-flash)
Nov 28 15:59:00 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 15:59:00 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0becf87-3043-4b86-bca1-221d3f06a233 -p 172.16.0.220:3260 --login {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:59:00 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0becf87-3043-4b86-bca1-221d3f06a233 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:59:00 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[d34bfc27-f533-4e49-b5f9-d15637883303]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b0becf87-3043-4b86-bca1-221d3f06a233, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b0becf87-3043-4b86-bca1-221d3f06a233, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:59:00 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-01db41a0-581d-477c-ab45-692b5e26e7da tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b0becf87-3043-4b86-bca1-221d3f06a233, portal: 172.16.0.220,3260]
Nov 28 15:59:00 user nova-compute[75176]: Login to [iface: default, target: iqn.2010-10.org.openstack:b0becf87-3043-4b86-bca1-221d3f06a233, portal: 172.16.0.220,3260] successful.
Nov 28 15:59:00 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:59:00 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0becf87-3043-4b86-bca1-221d3f06a233 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:59:00 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0becf87-3043-4b86-bca1-221d3f06a233 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:59:00 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[774d0d64-7db0-4045-a1b7-f906f78c3345]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:59:00 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-01db41a0-581d-477c-ab45-692b5e26e7da tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:59:00 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:59:00 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:59:00 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf71da76-b08b-4e9c-8941-ecb2122cc5cd]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0f9d557-1dc1-4892-b808-35606162f6a5 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a0ac2c4-a491-487c-b957-f46813dd109d (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0becf87-3043-4b86-bca1-221d3f06a233 (non-flash)\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:59:00 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-01db41a0-581d-477c-ab45-692b5e26e7da tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 (non-flash)
Nov 28 15:59:00 user nova-compute[75176]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0 (non-flash)
Nov 28 15:59:00 user nova-compute[75176]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0f9d557-1dc1-4892-b808-35606162f6a5 (non-flash)
Nov 28 15:59:00 user nova-compute[75176]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a0ac2c4-a491-487c-b957-f46813dd109d (non-flash)
Nov 28 15:59:00 user nova-compute[75176]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0becf87-3043-4b86-bca1-221d3f06a233 (non-flash)
Nov 28 15:59:00 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:59:00 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-01db41a0-581d-477c-ab45-692b5e26e7da tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 (non-flash)
Nov 28 15:59:00 user nova-compute[75176]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0 (non-flash)
Nov 28 15:59:00 user nova-compute[75176]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0f9d557-1dc1-4892-b808-35606162f6a5 (non-flash)
Nov 28 15:59:00 user nova-compute[75176]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a0ac2c4-a491-487c-b957-f46813dd109d (non-flash)
Nov 28 15:59:00 user nova-compute[75176]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0becf87-3043-4b86-bca1-221d3f06a233 (non-flash)
Nov 28 15:59:00 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 15:59:00 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-01db41a0-581d-477c-ab45-692b5e26e7da tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b0becf87-3043-4b86-bca1-221d3f06a233" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.422s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 15:59:00 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-01db41a0-581d-477c-ab45-692b5e26e7da tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Connected to 172.16.0.220:3260 {{(pid=75176) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 15:59:00 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-01db41a0-581d-477c-ab45-692b5e26e7da tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] HCTL ('37', '-', '-', 0) found on session 54 with lun 0 {{(pid=75176) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 15:59:00 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-01db41a0-581d-477c-ab45-692b5e26e7da tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75176) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 15:59:00 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:59:00 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.019s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:59:00 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[496f1241-faf2-42fa-b7c9-059718860ff4]: (4, ('- - 0', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:59:00 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-01db41a0-581d-477c-ab45-692b5e26e7da tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Searching for a device in session 54 and hctl ['37', '*', '*', 0] yield: None {{(pid=75176) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 15:59:00 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:59:01 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-01db41a0-581d-477c-ab45-692b5e26e7da tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Searching for a device in session 54 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75176) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 15:59:01 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-01db41a0-581d-477c-ab45-692b5e26e7da tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:b0becf87-3043-4b86-bca1-221d3f06a233', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TCgkjqAl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75176) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 15:59:01 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-01db41a0-581d-477c-ab45-692b5e26e7da tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.457s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 15:59:01 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-01db41a0-581d-477c-ab45-692b5e26e7da tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] <== connect_volume: return (1458ms) {'type': 'block', 'scsi_wwn': '23135656132363161', 'path': '/dev/sdf'} {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 15:59:01 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-01db41a0-581d-477c-ab45-692b5e26e7da tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] [instance: e0b7a064-03b6-4a0d-88be-2f12c12a1ddb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23135656132363161', 'path': '/dev/sdf'} {{(pid=75176) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 15:59:01 user nova-compute[75176]: DEBUG nova.objects.instance [None req-01db41a0-581d-477c-ab45-692b5e26e7da tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Lazy-loading 'flavor' on Instance uuid e0b7a064-03b6-4a0d-88be-2f12c12a1ddb {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:59:01 user nova-compute[75176]: DEBUG nova.virt.libvirt.guest [None req-01db41a0-581d-477c-ab45-692b5e26e7da tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 15:59:01 user nova-compute[75176]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 15:59:01 user nova-compute[75176]:   <source dev="/dev/sdf"/>
Nov 28 15:59:01 user nova-compute[75176]:   <target dev="vdb" bus="virtio"/>
Nov 28 15:59:01 user nova-compute[75176]:   <serial>b0becf87-3043-4b86-bca1-221d3f06a233</serial>
Nov 28 15:59:01 user nova-compute[75176]: </disk>
Nov 28 15:59:01 user nova-compute[75176]:  {{(pid=75176) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 15:59:01 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-01db41a0-581d-477c-ab45-692b5e26e7da tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] No BDM found with device name vda, not building metadata. {{(pid=75176) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 15:59:01 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-01db41a0-581d-477c-ab45-692b5e26e7da tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75176) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 15:59:01 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-01db41a0-581d-477c-ab45-692b5e26e7da tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] No VIF found with MAC fa:16:3e:92:22:dd, not building metadata {{(pid=75176) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 15:59:02 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-01db41a0-581d-477c-ab45-692b5e26e7da tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Lock "e0b7a064-03b6-4a0d-88be-2f12c12a1ddb" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.162s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:59:02 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:59:02 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:59:02 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:59:02 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:59:03 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:59:04 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-fb4b4a2f-9f6d-447f-badc-e4dbdbe9af40 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Acquiring lock "e0b7a064-03b6-4a0d-88be-2f12c12a1ddb" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:59:04 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-fb4b4a2f-9f6d-447f-badc-e4dbdbe9af40 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Lock "e0b7a064-03b6-4a0d-88be-2f12c12a1ddb" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:59:04 user nova-compute[75176]: INFO nova.compute.manager [None req-fb4b4a2f-9f6d-447f-badc-e4dbdbe9af40 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] [instance: e0b7a064-03b6-4a0d-88be-2f12c12a1ddb] Detaching volume b0becf87-3043-4b86-bca1-221d3f06a233
Nov 28 15:59:04 user nova-compute[75176]: INFO nova.virt.block_device [None req-fb4b4a2f-9f6d-447f-badc-e4dbdbe9af40 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] [instance: e0b7a064-03b6-4a0d-88be-2f12c12a1ddb] Attempting to driver detach volume b0becf87-3043-4b86-bca1-221d3f06a233 from mountpoint /dev/vdb
Nov 28 15:59:04 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-fb4b4a2f-9f6d-447f-badc-e4dbdbe9af40 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Attempting to detach device vdb from instance e0b7a064-03b6-4a0d-88be-2f12c12a1ddb from the persistent domain config. {{(pid=75176) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 15:59:04 user nova-compute[75176]: DEBUG nova.virt.libvirt.guest [None req-fb4b4a2f-9f6d-447f-badc-e4dbdbe9af40 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 15:59:04 user nova-compute[75176]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 15:59:04 user nova-compute[75176]:   <source dev="/dev/sdf"/>
Nov 28 15:59:04 user nova-compute[75176]:   <target dev="vdb" bus="virtio"/>
Nov 28 15:59:04 user nova-compute[75176]:   <serial>b0becf87-3043-4b86-bca1-221d3f06a233</serial>
Nov 28 15:59:04 user nova-compute[75176]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 15:59:04 user nova-compute[75176]: </disk>
Nov 28 15:59:04 user nova-compute[75176]:  {{(pid=75176) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 15:59:04 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-fb4b4a2f-9f6d-447f-badc-e4dbdbe9af40 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Successfully detached device vdb from instance e0b7a064-03b6-4a0d-88be-2f12c12a1ddb from the persistent domain config.
Nov 28 15:59:04 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-fb4b4a2f-9f6d-447f-badc-e4dbdbe9af40 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e0b7a064-03b6-4a0d-88be-2f12c12a1ddb from the live domain config. {{(pid=75176) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 15:59:04 user nova-compute[75176]: DEBUG nova.virt.libvirt.guest [None req-fb4b4a2f-9f6d-447f-badc-e4dbdbe9af40 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 15:59:04 user nova-compute[75176]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 15:59:04 user nova-compute[75176]:   <source dev="/dev/sdf"/>
Nov 28 15:59:04 user nova-compute[75176]:   <target dev="vdb" bus="virtio"/>
Nov 28 15:59:04 user nova-compute[75176]:   <serial>b0becf87-3043-4b86-bca1-221d3f06a233</serial>
Nov 28 15:59:04 user nova-compute[75176]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 15:59:04 user nova-compute[75176]: </disk>
Nov 28 15:59:04 user nova-compute[75176]:  {{(pid=75176) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 15:59:04 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:59:04 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-fb4b4a2f-9f6d-447f-badc-e4dbdbe9af40 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e0b7a064-03b6-4a0d-88be-2f12c12a1ddb {{(pid=75176) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 15:59:05 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:59:05 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:59:05 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-7bae7348-1f30-430a-a8c8-d22cc9d4da42 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 3ae602c1-2aed-41ea-9f4c-4f3ec4aab254 is timed out.
Nov 28 15:59:05 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:59:05 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75176) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 15:59:05 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-7bae7348-1f30-430a-a8c8-d22cc9d4da42 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Successfully detached device vdb from instance 3ae602c1-2aed-41ea-9f4c-4f3ec4aab254 from the live domain config.
Nov 28 15:59:05 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7bae7348-1f30-430a-a8c8-d22cc9d4da42 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] [instance: 3ae602c1-2aed-41ea-9f4c-4f3ec4aab254] calling os-brick to detach iSCSI Volume {{(pid=75176) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 15:59:05 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bae7348-1f30-430a-a8c8-d22cc9d4da42 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c1b8a00>, {'target_iqn': 'iqn.2010-10.org.openstack:d0f9d557-1dc1-4892-b808-35606162f6a5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZrvDikFo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 15:59:05 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-7bae7348-1f30-430a-a8c8-d22cc9d4da42 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 15:59:05 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-7bae7348-1f30-430a-a8c8-d22cc9d4da42 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 15:59:05 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-7bae7348-1f30-430a-a8c8-d22cc9d4da42 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 15:59:05 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:59:05 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:59:05 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4018981-b2b1-4da0-b5d7-294d56a8bca0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6a0ac2c4-a491-487c-b957-f46813dd109d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d0f9d557-1dc1-4892-b808-35606162f6a5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b0becf87-3043-4b86-bca1-221d3f06a233\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:59:05 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bae7348-1f30-430a-a8c8-d22cc9d4da42 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 15:59:05 user nova-compute[75176]: No targets found.
Nov 28 15:59:05 user nova-compute[75176]: iSNS:
Nov 28 15:59:05 user nova-compute[75176]: No targets found.
Nov 28 15:59:05 user nova-compute[75176]: STATIC:
Nov 28 15:59:05 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:6a0ac2c4-a491-487c-b957-f46813dd109d
Nov 28 15:59:05 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:59:05 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:59:05 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0
Nov 28 15:59:05 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:59:05 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:59:05 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6
Nov 28 15:59:05 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:59:05 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:59:05 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:d0f9d557-1dc1-4892-b808-35606162f6a5
Nov 28 15:59:05 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:59:05 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:59:05 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:b0becf87-3043-4b86-bca1-221d3f06a233
Nov 28 15:59:05 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:59:05 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:59:05 user nova-compute[75176]: FIRMWARE:
Nov 28 15:59:05 user nova-compute[75176]: No targets found.
Nov 28 15:59:05 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:59:05 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bae7348-1f30-430a-a8c8-d22cc9d4da42 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 15:59:05 user nova-compute[75176]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 15:59:05 user nova-compute[75176]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75176) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 15:59:05 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bae7348-1f30-430a-a8c8-d22cc9d4da42 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d0f9d557-1dc1-4892-b808-35606162f6a5', 0)] {{(pid=75176) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 15:59:05 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:59:05 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:59:05 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[116f36e3-0dac-43d9-8d94-c85a3996f5ff]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6a0ac2c4-a491-487c-b957-f46813dd109d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b0becf87-3043-4b86-bca1-221d3f06a233\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d0f9d557-1dc1-4892-b808-35606162f6a5\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:59:05 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:59:05 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:59:05 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[63dc278d-1eba-4926-81ae-41dbba4a0cc3]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0f9d557-1dc1-4892-b808-35606162f6a5 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a0ac2c4-a491-487c-b957-f46813dd109d (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0becf87-3043-4b86-bca1-221d3f06a233 (non-flash)\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:59:05 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bae7348-1f30-430a-a8c8-d22cc9d4da42 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 (non-flash)
Nov 28 15:59:05 user nova-compute[75176]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0 (non-flash)
Nov 28 15:59:05 user nova-compute[75176]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0f9d557-1dc1-4892-b808-35606162f6a5 (non-flash)
Nov 28 15:59:05 user nova-compute[75176]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a0ac2c4-a491-487c-b957-f46813dd109d (non-flash)
Nov 28 15:59:05 user nova-compute[75176]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0becf87-3043-4b86-bca1-221d3f06a233 (non-flash)
Nov 28 15:59:05 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:59:05 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bae7348-1f30-430a-a8c8-d22cc9d4da42 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 (non-flash)
Nov 28 15:59:05 user nova-compute[75176]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0 (non-flash)
Nov 28 15:59:05 user nova-compute[75176]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0f9d557-1dc1-4892-b808-35606162f6a5 (non-flash)
Nov 28 15:59:05 user nova-compute[75176]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a0ac2c4-a491-487c-b957-f46813dd109d (non-flash)
Nov 28 15:59:05 user nova-compute[75176]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0becf87-3043-4b86-bca1-221d3f06a233 (non-flash)
Nov 28 15:59:05 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 15:59:05 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bae7348-1f30-430a-a8c8-d22cc9d4da42 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f462c429360>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d0f9d557-1dc1-4892-b808-35606162f6a5'): ({'sdc'}, set())}) {{(pid=75176) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 15:59:05 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-7bae7348-1f30-430a-a8c8-d22cc9d4da42 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Removing single pathed devices sdc {{(pid=75176) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 15:59:05 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:59:05 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:59:05 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1823daf-1661-4028-b7be-994e79b81384]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:59:05 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:59:05 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.024s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:59:05 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae429acb-b861-48f8-b506-579b82a2a9c8]: (4, ('ok\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:59:05 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-7bae7348-1f30-430a-a8c8-d22cc9d4da42 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Flushing IO for device /dev/sdc {{(pid=75176) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 15:59:05 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:59:05 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:59:05 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[76b7fad2-b617-4a41-86f2-904b11b8d6f4]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:59:05 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-7bae7348-1f30-430a-a8c8-d22cc9d4da42 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75176) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 15:59:05 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:59:05 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.049s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:59:05 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[c28c15d7-3f30-42a1-bbb3-9a52f3bf2291]: (4, ('1', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:59:05 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-7bae7348-1f30-430a-a8c8-d22cc9d4da42 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75176) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 15:59:05 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-7bae7348-1f30-430a-a8c8-d22cc9d4da42 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] SCSI volumes sdc have been removed. {{(pid=75176) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 15:59:05 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bae7348-1f30-430a-a8c8-d22cc9d4da42 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d0f9d557-1dc1-4892-b808-35606162f6a5')] {{(pid=75176) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 15:59:05 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0f9d557-1dc1-4892-b808-35606162f6a5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:59:05 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0f9d557-1dc1-4892-b808-35606162f6a5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:59:05 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a02f7fd-7a3c-4e4c-bbdf-17d4cf13e521]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:59:05 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bae7348-1f30-430a-a8c8-d22cc9d4da42 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:59:05 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0f9d557-1dc1-4892-b808-35606162f6a5 -p 172.16.0.220:3260 --logout {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:59:06 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0f9d557-1dc1-4892-b808-35606162f6a5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:59:06 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eede952-8ec8-4e55-9d72-11166a5d1fbe]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:d0f9d557-1dc1-4892-b808-35606162f6a5, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:d0f9d557-1dc1-4892-b808-35606162f6a5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:59:06 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bae7348-1f30-430a-a8c8-d22cc9d4da42 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:d0f9d557-1dc1-4892-b808-35606162f6a5, portal: 172.16.0.220,3260]
Nov 28 15:59:06 user nova-compute[75176]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:d0f9d557-1dc1-4892-b808-35606162f6a5, portal: 172.16.0.220,3260] successful.
Nov 28 15:59:06 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:59:06 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0f9d557-1dc1-4892-b808-35606162f6a5 -p 172.16.0.220:3260 --op delete {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:59:06 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0f9d557-1dc1-4892-b808-35606162f6a5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:59:06 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[4850df09-33b3-4b48-b2e8-305b1c3a0818]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:59:06 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bae7348-1f30-430a-a8c8-d22cc9d4da42 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:59:06 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-7bae7348-1f30-430a-a8c8-d22cc9d4da42 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.366s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 15:59:06 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bae7348-1f30-430a-a8c8-d22cc9d4da42 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] <== disconnect_volume: return (368ms) None {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 15:59:06 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7bae7348-1f30-430a-a8c8-d22cc9d4da42 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] [instance: 3ae602c1-2aed-41ea-9f4c-4f3ec4aab254] Disconnected iSCSI Volume {{(pid=75176) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 15:59:06 user nova-compute[75176]: DEBUG nova.objects.instance [None req-7bae7348-1f30-430a-a8c8-d22cc9d4da42 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Lazy-loading 'flavor' on Instance uuid 3ae602c1-2aed-41ea-9f4c-4f3ec4aab254 {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:59:06 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7bae7348-1f30-430a-a8c8-d22cc9d4da42 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Lock "3ae602c1-2aed-41ea-9f4c-4f3ec4aab254" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.817s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:59:07 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:59:07 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Starting heal instance info cache {{(pid=75176) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 15:59:07 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquiring lock "refresh_cache-f66ead7d-98f4-4822-9dce-f2ea0206a58d" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:59:07 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquired lock "refresh_cache-f66ead7d-98f4-4822-9dce-f2ea0206a58d" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:59:07 user nova-compute[75176]: DEBUG nova.network.neutron [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] [instance: f66ead7d-98f4-4822-9dce-f2ea0206a58d] Forcefully refreshing network info cache for instance {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 15:59:08 user nova-compute[75176]: DEBUG nova.network.neutron [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] [instance: f66ead7d-98f4-4822-9dce-f2ea0206a58d] Updating instance_info_cache with network_info: [{"id": "30bb2de8-1609-4cd8-8bb1-e32f2c4bfa81", "address": "fa:16:3e:22:f2:8e", "network": {"id": "998766cd-2e8e-4e39-add9-286086640993", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-989265510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf05c8836b8a40de8e64c2d046ed71ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30bb2de8-16", "ovs_interfaceid": "30bb2de8-1609-4cd8-8bb1-e32f2c4bfa81", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:59:08 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Releasing lock "refresh_cache-f66ead7d-98f4-4822-9dce-f2ea0206a58d" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:59:08 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] [instance: f66ead7d-98f4-4822-9dce-f2ea0206a58d] Updated the network info_cache for instance {{(pid=75176) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 15:59:08 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:59:09 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:59:10 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:59:10 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:59:10 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:59:10 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:59:10 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:59:10 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Auditing locally available compute resources for user (node: user) {{(pid=75176) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 15:59:10 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55febf04-14ea-4903-8692-c7cc6115de75/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:59:11 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55febf04-14ea-4903-8692-c7cc6115de75/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:59:11 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55febf04-14ea-4903-8692-c7cc6115de75/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:59:11 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55febf04-14ea-4903-8692-c7cc6115de75/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:59:11 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ae602c1-2aed-41ea-9f4c-4f3ec4aab254/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:59:11 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ae602c1-2aed-41ea-9f4c-4f3ec4aab254/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:59:11 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ae602c1-2aed-41ea-9f4c-4f3ec4aab254/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:59:11 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ae602c1-2aed-41ea-9f4c-4f3ec4aab254/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:59:11 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecf38787-0a69-4f35-b121-3dc6e70023a1/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:59:11 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecf38787-0a69-4f35-b121-3dc6e70023a1/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:59:11 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecf38787-0a69-4f35-b121-3dc6e70023a1/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:59:11 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecf38787-0a69-4f35-b121-3dc6e70023a1/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:59:12 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecabea76-6c29-412d-bf77-989917b449a9/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:59:12 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecabea76-6c29-412d-bf77-989917b449a9/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:59:12 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecabea76-6c29-412d-bf77-989917b449a9/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:59:12 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecabea76-6c29-412d-bf77-989917b449a9/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:59:12 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0b7a064-03b6-4a0d-88be-2f12c12a1ddb/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:59:12 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0b7a064-03b6-4a0d-88be-2f12c12a1ddb/disk --force-share --output=json" returned: 0 in 0.335s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:59:12 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0b7a064-03b6-4a0d-88be-2f12c12a1ddb/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:59:12 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0b7a064-03b6-4a0d-88be-2f12c12a1ddb/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:59:12 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75176) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 15:59:12 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c154591-b130-4aa4-aad4-4c85324512df/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:59:13 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c154591-b130-4aa4-aad4-4c85324512df/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:59:13 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c154591-b130-4aa4-aad4-4c85324512df/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:59:13 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c154591-b130-4aa4-aad4-4c85324512df/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:59:13 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75176) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 15:59:13 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66ead7d-98f4-4822-9dce-f2ea0206a58d/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:59:13 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66ead7d-98f4-4822-9dce-f2ea0206a58d/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:59:13 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66ead7d-98f4-4822-9dce-f2ea0206a58d/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:59:13 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66ead7d-98f4-4822-9dce-f2ea0206a58d/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:59:13 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7/disk.rescue --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:59:13 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:59:13 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7/disk.rescue --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:59:14 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:59:14 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:59:14 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:59:14 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:59:14 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:59:14 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75176) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 15:59:14 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/726344c0-a0dc-48d5-a18f-8a258ebde87d/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:59:14 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/726344c0-a0dc-48d5-a18f-8a258ebde87d/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:59:14 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/726344c0-a0dc-48d5-a18f-8a258ebde87d/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:59:14 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:59:14 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/726344c0-a0dc-48d5-a18f-8a258ebde87d/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:59:15 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 15:59:15 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 15:59:15 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Hypervisor/Node resource view: name=user free_ram=7570MB free_disk=24.803951263427734GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75176) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 15:59:15 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:59:15 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:59:15 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:59:15 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance f66ead7d-98f4-4822-9dce-f2ea0206a58d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:59:15 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance 55febf04-14ea-4903-8692-c7cc6115de75 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:59:15 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance 8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:59:15 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance dc4e6d39-adfb-4d26-afef-46f316ff7846 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:59:15 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance ecabea76-6c29-412d-bf77-989917b449a9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:59:15 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance e0b7a064-03b6-4a0d-88be-2f12c12a1ddb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:59:15 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance 3ae602c1-2aed-41ea-9f4c-4f3ec4aab254 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:59:15 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance 525c3cc4-9cc4-470b-bf72-5e53d80cea6f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:59:15 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance ecf38787-0a69-4f35-b121-3dc6e70023a1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:59:15 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance 726344c0-a0dc-48d5-a18f-8a258ebde87d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:59:15 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance 2c154591-b130-4aa4-aad4-4c85324512df actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:59:15 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance 216e9ce3-28d7-4282-ae91-3aa6282626e1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 15:59:15 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75176) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 15:59:15 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75176) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 15:59:15 user nova-compute[75176]: DEBUG nova.compute.provider_tree [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Inventory has not changed in ProviderTree for provider: b37848d8-f401-4155-a029-b0ffa09ff85b {{(pid=75176) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 15:59:15 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Inventory has not changed for provider b37848d8-f401-4155-a029-b0ffa09ff85b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75176) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 15:59:15 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Compute_service record updated for user:user {{(pid=75176) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 15:59:15 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.486s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:59:19 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:59:20 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:59:20 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:59:21 user nova-compute[75176]: DEBUG nova.compute.manager [None req-4ac59d61-f344-495c-bee5-89bd51b32c3d tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: ecf38787-0a69-4f35-b121-3dc6e70023a1] Checking state {{(pid=75176) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 15:59:21 user nova-compute[75176]: INFO nova.compute.manager [None req-4ac59d61-f344-495c-bee5-89bd51b32c3d tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: ecf38787-0a69-4f35-b121-3dc6e70023a1] instance snapshotting
Nov 28 15:59:21 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-4ac59d61-f344-495c-bee5-89bd51b32c3d tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: ecf38787-0a69-4f35-b121-3dc6e70023a1] Beginning live snapshot process
Nov 28 15:59:21 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-4ac59d61-f344-495c-bee5-89bd51b32c3d tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecf38787-0a69-4f35-b121-3dc6e70023a1/disk --force-share --output=json -f qcow2 {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:59:22 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-4ac59d61-f344-495c-bee5-89bd51b32c3d tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecf38787-0a69-4f35-b121-3dc6e70023a1/disk --force-share --output=json -f qcow2" returned: 0 in 0.184s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:59:22 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-4ac59d61-f344-495c-bee5-89bd51b32c3d tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecf38787-0a69-4f35-b121-3dc6e70023a1/disk --force-share --output=json -f qcow2 {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:59:22 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-4ac59d61-f344-495c-bee5-89bd51b32c3d tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecf38787-0a69-4f35-b121-3dc6e70023a1/disk --force-share --output=json -f qcow2" returned: 0 in 0.186s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:59:22 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-4ac59d61-f344-495c-bee5-89bd51b32c3d tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:59:22 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-4ac59d61-f344-495c-bee5-89bd51b32c3d tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json" returned: 0 in 0.171s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:59:22 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-4ac59d61-f344-495c-bee5-89bd51b32c3d tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp8xjq7gl2/6d565e4364ca40eea933a35fe1e9c8e9.delta 1073741824 {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:59:22 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-4ac59d61-f344-495c-bee5-89bd51b32c3d tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp8xjq7gl2/6d565e4364ca40eea933a35fe1e9c8e9.delta 1073741824" returned: 0 in 0.050s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:59:22 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-4ac59d61-f344-495c-bee5-89bd51b32c3d tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: ecf38787-0a69-4f35-b121-3dc6e70023a1] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 28 15:59:23 user nova-compute[75176]: DEBUG nova.virt.libvirt.guest [None req-4ac59d61-f344-495c-bee5-89bd51b32c3d tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75176) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 15:59:23 user nova-compute[75176]: DEBUG nova.virt.libvirt.guest [None req-4ac59d61-f344-495c-bee5-89bd51b32c3d tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75176) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 15:59:23 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-4ac59d61-f344-495c-bee5-89bd51b32c3d tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: ecf38787-0a69-4f35-b121-3dc6e70023a1] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 28 15:59:23 user nova-compute[75176]: DEBUG nova.privsep.utils [None req-4ac59d61-f344-495c-bee5-89bd51b32c3d tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75176) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 28 15:59:23 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-4ac59d61-f344-495c-bee5-89bd51b32c3d tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp8xjq7gl2/6d565e4364ca40eea933a35fe1e9c8e9.delta /opt/stack/data/nova/instances/snapshots/tmp8xjq7gl2/6d565e4364ca40eea933a35fe1e9c8e9 {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:59:24 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-4ac59d61-f344-495c-bee5-89bd51b32c3d tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp8xjq7gl2/6d565e4364ca40eea933a35fe1e9c8e9.delta /opt/stack/data/nova/instances/snapshots/tmp8xjq7gl2/6d565e4364ca40eea933a35fe1e9c8e9" returned: 0 in 0.452s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:59:24 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-4ac59d61-f344-495c-bee5-89bd51b32c3d tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: ecf38787-0a69-4f35-b121-3dc6e70023a1] Snapshot extracted, beginning image upload
Nov 28 15:59:24 user nova-compute[75176]: DEBUG nova.compute.manager [req-550db4d1-2534-42f0-837e-79f1e42c618b req-a2741c92-bb05-4c70-bde5-d7d92dbe2e96 service nova] [instance: 726344c0-a0dc-48d5-a18f-8a258ebde87d] Received event network-changed-966907f1-2c5f-4c34-b155-b1b3b4176f5f {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:59:24 user nova-compute[75176]: DEBUG nova.compute.manager [req-550db4d1-2534-42f0-837e-79f1e42c618b req-a2741c92-bb05-4c70-bde5-d7d92dbe2e96 service nova] [instance: 726344c0-a0dc-48d5-a18f-8a258ebde87d] Refreshing instance network info cache due to event network-changed-966907f1-2c5f-4c34-b155-b1b3b4176f5f. {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 15:59:24 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-550db4d1-2534-42f0-837e-79f1e42c618b req-a2741c92-bb05-4c70-bde5-d7d92dbe2e96 service nova] Acquiring lock "refresh_cache-726344c0-a0dc-48d5-a18f-8a258ebde87d" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:59:24 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-550db4d1-2534-42f0-837e-79f1e42c618b req-a2741c92-bb05-4c70-bde5-d7d92dbe2e96 service nova] Acquired lock "refresh_cache-726344c0-a0dc-48d5-a18f-8a258ebde87d" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:59:24 user nova-compute[75176]: DEBUG nova.network.neutron [req-550db4d1-2534-42f0-837e-79f1e42c618b req-a2741c92-bb05-4c70-bde5-d7d92dbe2e96 service nova] [instance: 726344c0-a0dc-48d5-a18f-8a258ebde87d] Refreshing network info cache for port 966907f1-2c5f-4c34-b155-b1b3b4176f5f {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 15:59:24 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:59:24 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-ffa3ccbd-6e2d-4573-94a4-625ddb10d120 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Acquiring lock "726344c0-a0dc-48d5-a18f-8a258ebde87d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:59:24 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-ffa3ccbd-6e2d-4573-94a4-625ddb10d120 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Lock "726344c0-a0dc-48d5-a18f-8a258ebde87d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:59:24 user nova-compute[75176]: DEBUG nova.objects.instance [None req-ffa3ccbd-6e2d-4573-94a4-625ddb10d120 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Lazy-loading 'flavor' on Instance uuid 726344c0-a0dc-48d5-a18f-8a258ebde87d {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:59:24 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-ffa3ccbd-6e2d-4573-94a4-625ddb10d120 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Lock "726344c0-a0dc-48d5-a18f-8a258ebde87d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:59:24 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-64e20296-c7ef-470c-b3fe-9d81a56e609f tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Acquiring lock "2c154591-b130-4aa4-aad4-4c85324512df" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:59:24 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-64e20296-c7ef-470c-b3fe-9d81a56e609f tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Lock "2c154591-b130-4aa4-aad4-4c85324512df" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:59:24 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-64e20296-c7ef-470c-b3fe-9d81a56e609f tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Acquiring lock "2c154591-b130-4aa4-aad4-4c85324512df-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:59:24 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-64e20296-c7ef-470c-b3fe-9d81a56e609f tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Lock "2c154591-b130-4aa4-aad4-4c85324512df-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:59:24 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-64e20296-c7ef-470c-b3fe-9d81a56e609f tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Lock "2c154591-b130-4aa4-aad4-4c85324512df-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:59:24 user nova-compute[75176]: INFO nova.compute.manager [None req-64e20296-c7ef-470c-b3fe-9d81a56e609f tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] [instance: 2c154591-b130-4aa4-aad4-4c85324512df] Terminating instance
Nov 28 15:59:24 user nova-compute[75176]: DEBUG nova.compute.manager [None req-64e20296-c7ef-470c-b3fe-9d81a56e609f tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] [instance: 2c154591-b130-4aa4-aad4-4c85324512df] Start destroying the instance on the hypervisor. {{(pid=75176) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 15:59:24 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-fb4b4a2f-9f6d-447f-badc-e4dbdbe9af40 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance e0b7a064-03b6-4a0d-88be-2f12c12a1ddb is timed out.
Nov 28 15:59:24 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-fb4b4a2f-9f6d-447f-badc-e4dbdbe9af40 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Successfully detached device vdb from instance e0b7a064-03b6-4a0d-88be-2f12c12a1ddb from the live domain config.
Nov 28 15:59:24 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fb4b4a2f-9f6d-447f-badc-e4dbdbe9af40 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] [instance: e0b7a064-03b6-4a0d-88be-2f12c12a1ddb] calling os-brick to detach iSCSI Volume {{(pid=75176) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 15:59:24 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb4b4a2f-9f6d-447f-badc-e4dbdbe9af40 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c1b8a00>, {'target_iqn': 'iqn.2010-10.org.openstack:b0becf87-3043-4b86-bca1-221d3f06a233', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TCgkjqAl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 15:59:24 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-fb4b4a2f-9f6d-447f-badc-e4dbdbe9af40 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 15:59:24 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-fb4b4a2f-9f6d-447f-badc-e4dbdbe9af40 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 15:59:24 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-fb4b4a2f-9f6d-447f-badc-e4dbdbe9af40 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 15:59:24 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:59:24 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-ffa3ccbd-6e2d-4573-94a4-625ddb10d120 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Acquiring lock "726344c0-a0dc-48d5-a18f-8a258ebde87d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:59:24 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-ffa3ccbd-6e2d-4573-94a4-625ddb10d120 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Lock "726344c0-a0dc-48d5-a18f-8a258ebde87d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:59:24 user nova-compute[75176]: INFO nova.compute.manager [None req-ffa3ccbd-6e2d-4573-94a4-625ddb10d120 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] [instance: 726344c0-a0dc-48d5-a18f-8a258ebde87d] Attaching volume 4b1a81f9-4a84-4f9e-9b1a-86b0c17ed81c to /dev/vdb
Nov 28 15:59:24 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:59:24 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[6510a07b-5b4a-41bb-8050-7457d7e06ea6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6a0ac2c4-a491-487c-b957-f46813dd109d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b0becf87-3043-4b86-bca1-221d3f06a233\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:59:24 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb4b4a2f-9f6d-447f-badc-e4dbdbe9af40 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 15:59:24 user nova-compute[75176]: No targets found.
Nov 28 15:59:24 user nova-compute[75176]: iSNS:
Nov 28 15:59:24 user nova-compute[75176]: No targets found.
Nov 28 15:59:24 user nova-compute[75176]: STATIC:
Nov 28 15:59:24 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:6a0ac2c4-a491-487c-b957-f46813dd109d
Nov 28 15:59:24 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:59:24 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:59:24 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0
Nov 28 15:59:24 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:59:24 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:59:24 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6
Nov 28 15:59:24 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:59:24 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:59:24 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:b0becf87-3043-4b86-bca1-221d3f06a233
Nov 28 15:59:24 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 15:59:24 user nova-compute[75176]:                 Iface Name: default
Nov 28 15:59:24 user nova-compute[75176]: FIRMWARE:
Nov 28 15:59:24 user nova-compute[75176]: No targets found.
Nov 28 15:59:24 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:59:24 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb4b4a2f-9f6d-447f-badc-e4dbdbe9af40 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 15:59:24 user nova-compute[75176]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 15:59:24 user nova-compute[75176]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75176) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 15:59:24 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb4b4a2f-9f6d-447f-badc-e4dbdbe9af40 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b0becf87-3043-4b86-bca1-221d3f06a233', 0)] {{(pid=75176) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 15:59:25 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:59:25 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:59:25 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ff28c4e-8b4e-40ae-b8b4-90922bb02093]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6a0ac2c4-a491-487c-b957-f46813dd109d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b0becf87-3043-4b86-bca1-221d3f06a233\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:59:25 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:59:25 user nova-compute[75176]: DEBUG nova.network.neutron [req-550db4d1-2534-42f0-837e-79f1e42c618b req-a2741c92-bb05-4c70-bde5-d7d92dbe2e96 service nova] [instance: 726344c0-a0dc-48d5-a18f-8a258ebde87d] Updated VIF entry in instance network info cache for port 966907f1-2c5f-4c34-b155-b1b3b4176f5f. {{(pid=75176) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 15:59:25 user nova-compute[75176]: DEBUG nova.network.neutron [req-550db4d1-2534-42f0-837e-79f1e42c618b req-a2741c92-bb05-4c70-bde5-d7d92dbe2e96 service nova] [instance: 726344c0-a0dc-48d5-a18f-8a258ebde87d] Updating instance_info_cache with network_info: [{"id": "966907f1-2c5f-4c34-b155-b1b3b4176f5f", "address": "fa:16:3e:0d:da:42", "network": {"id": "d47c1797-a66f-4f2d-b83e-903b5bd3251c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1416388789-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd2856ce0a2545cda0b796eb0be10a40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap966907f1-2c", "ovs_interfaceid": "966907f1-2c5f-4c34-b155-b1b3b4176f5f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:59:25 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:59:25 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:59:25 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[400fbd08-0ea0-4a55-b454-5b7460f45452]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a0ac2c4-a491-487c-b957-f46813dd109d (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0becf87-3043-4b86-bca1-221d3f06a233 (non-flash)\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:59:25 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb4b4a2f-9f6d-447f-badc-e4dbdbe9af40 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 (non-flash)
Nov 28 15:59:25 user nova-compute[75176]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0 (non-flash)
Nov 28 15:59:25 user nova-compute[75176]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a0ac2c4-a491-487c-b957-f46813dd109d (non-flash)
Nov 28 15:59:25 user nova-compute[75176]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0becf87-3043-4b86-bca1-221d3f06a233 (non-flash)
Nov 28 15:59:25 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:59:25 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb4b4a2f-9f6d-447f-badc-e4dbdbe9af40 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 (non-flash)
Nov 28 15:59:25 user nova-compute[75176]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0 (non-flash)
Nov 28 15:59:25 user nova-compute[75176]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a0ac2c4-a491-487c-b957-f46813dd109d (non-flash)
Nov 28 15:59:25 user nova-compute[75176]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0becf87-3043-4b86-bca1-221d3f06a233 (non-flash)
Nov 28 15:59:25 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 15:59:25 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb4b4a2f-9f6d-447f-badc-e4dbdbe9af40 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f464c314ee0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b0becf87-3043-4b86-bca1-221d3f06a233'): ({'sdf'}, set())}) {{(pid=75176) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 15:59:25 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-fb4b4a2f-9f6d-447f-badc-e4dbdbe9af40 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Removing single pathed devices sdf {{(pid=75176) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 15:59:25 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-550db4d1-2534-42f0-837e-79f1e42c618b req-a2741c92-bb05-4c70-bde5-d7d92dbe2e96 service nova] Releasing lock "refresh_cache-726344c0-a0dc-48d5-a18f-8a258ebde87d" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:59:25 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:59:25 user nova-compute[75176]: DEBUG os_brick.utils [None req-ffa3ccbd-6e2d-4573-94a4-625ddb10d120 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 15:59:25 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:59:25 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:59:25 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:59:25 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[f75f0a69-9411-4531-845c-77b6d7b0a540]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:edc924a949b2\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:59:25 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.032s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:59:25 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[43f79d75-6e6d-4894-baa0-55383a6f771b]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:59:25 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:59:25 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:59:25 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:59:25 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:59:25 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[6720c13e-909a-4856-9353-797e9366acf8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:59:25 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:59:25 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.027s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:59:25 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[45db4310-1a15-44ed-a6c8-67e91bff6baa]: (4, ('ok\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:59:25 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-fb4b4a2f-9f6d-447f-badc-e4dbdbe9af40 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Flushing IO for device /dev/sdf {{(pid=75176) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 15:59:25 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:59:25 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:59:25 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.026s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:59:25 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[edf920f1-7dcf-4686-8e21-21df44b60fb1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:59:25 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.018s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:59:25 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef092b96-8d28-4db7-be0d-f610b6afbd64]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:59:25 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-fb4b4a2f-9f6d-447f-badc-e4dbdbe9af40 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75176) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 15:59:25 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[51ac96f8-d483-428f-9332-bc9e62f7f60e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:59:25 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:59:25 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-ffa3ccbd-6e2d-4573-94a4-625ddb10d120 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Running cmd (subprocess): nvme version {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:59:25 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-ffa3ccbd-6e2d-4573-94a4-625ddb10d120 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] 'nvme version' failed. Not Retrying. {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 15:59:25 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ffa3ccbd-6e2d-4573-94a4-625ddb10d120 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] nvme not present on system {{(pid=75176) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 15:59:25 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:59:25 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.059s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:59:25 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[72bf2392-8370-430d-980e-c6a02c8d101a]: (4, ('1', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:59:25 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-fb4b4a2f-9f6d-447f-badc-e4dbdbe9af40 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75176) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 15:59:25 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-fb4b4a2f-9f6d-447f-badc-e4dbdbe9af40 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] SCSI volumes sdf have been removed. {{(pid=75176) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 15:59:25 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb4b4a2f-9f6d-447f-badc-e4dbdbe9af40 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b0becf87-3043-4b86-bca1-221d3f06a233')] {{(pid=75176) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 15:59:25 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 15:59:25 user nova-compute[75176]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 15:59:25 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[c800a87d-de1f-455c-b8ec-ff094a248452]: (4, '') {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:59:25 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.lightos [None req-ffa3ccbd-6e2d-4573-94a4-625ddb10d120 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75176) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 15:59:25 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.lightos [None req-ffa3ccbd-6e2d-4573-94a4-625ddb10d120 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75176) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 15:59:25 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.lightos [None req-ffa3ccbd-6e2d-4573-94a4-625ddb10d120 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] LIGHTOS: no hostnqn found. {{(pid=75176) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 15:59:25 user nova-compute[75176]: DEBUG os_brick.utils [None req-ffa3ccbd-6e2d-4573-94a4-625ddb10d120 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] <== get_connector_properties: return (183ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:edc924a949b2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 15:59:25 user nova-compute[75176]: DEBUG nova.virt.block_device [None req-ffa3ccbd-6e2d-4573-94a4-625ddb10d120 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] [instance: 726344c0-a0dc-48d5-a18f-8a258ebde87d] Updating existing volume attachment record: c20f7536-d0f1-49bb-8127-da5c11b0dbab {{(pid=75176) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 15:59:25 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0becf87-3043-4b86-bca1-221d3f06a233 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:59:25 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0becf87-3043-4b86-bca1-221d3f06a233 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:59:25 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[21694364-c3f6-4142-a32c-b644187dad35]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:59:25 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb4b4a2f-9f6d-447f-badc-e4dbdbe9af40 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:59:25 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0becf87-3043-4b86-bca1-221d3f06a233 -p 172.16.0.220:3260 --logout {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:59:25 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:59:25 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0becf87-3043-4b86-bca1-221d3f06a233 -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:59:25 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[fac30e72-ba4b-4f4a-bae4-47dac6a20e10]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:b0becf87-3043-4b86-bca1-221d3f06a233, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:b0becf87-3043-4b86-bca1-221d3f06a233, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:59:25 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb4b4a2f-9f6d-447f-badc-e4dbdbe9af40 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:b0becf87-3043-4b86-bca1-221d3f06a233, portal: 172.16.0.220,3260]
Nov 28 15:59:25 user nova-compute[75176]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:b0becf87-3043-4b86-bca1-221d3f06a233, portal: 172.16.0.220,3260] successful.
Nov 28 15:59:25 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:59:25 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0becf87-3043-4b86-bca1-221d3f06a233 -p 172.16.0.220:3260 --op delete {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:59:25 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0becf87-3043-4b86-bca1-221d3f06a233 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:59:25 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[957de2bf-d1e1-4b34-8b3a-112272a80476]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:59:25 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb4b4a2f-9f6d-447f-badc-e4dbdbe9af40 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:59:25 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-fb4b4a2f-9f6d-447f-badc-e4dbdbe9af40 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.427s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 15:59:25 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb4b4a2f-9f6d-447f-badc-e4dbdbe9af40 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] <== disconnect_volume: return (428ms) None {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 15:59:25 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fb4b4a2f-9f6d-447f-badc-e4dbdbe9af40 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] [instance: e0b7a064-03b6-4a0d-88be-2f12c12a1ddb] Disconnected iSCSI Volume {{(pid=75176) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 15:59:25 user nova-compute[75176]: INFO nova.virt.libvirt.driver [-] [instance: 2c154591-b130-4aa4-aad4-4c85324512df] Instance destroyed successfully.
Nov 28 15:59:25 user nova-compute[75176]: DEBUG nova.objects.instance [None req-64e20296-c7ef-470c-b3fe-9d81a56e609f tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Lazy-loading 'resources' on Instance uuid 2c154591-b130-4aa4-aad4-4c85324512df {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:59:25 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-64e20296-c7ef-470c-b3fe-9d81a56e609f tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-28T15:53:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-130212440',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-130212440',id=39,image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGX7gmaaJWlutz/TKDo+wkCFFen5sReDn+1HuisCX/yqohTszCj8BZs1uuq8QFCZ3S7ilSOTHvQUXrHX6M5+9jiqleMWZztv4BQdNTI6ilr9cn1OCtm55/Gf1FtOLQUPeg==',key_name='tempest-keypair-780187379',keypairs=<?>,launch_index=0,launched_at=2023-11-28T15:57:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='169fdaea89d4431aa6adacdbb76f3546',ramdisk_id='',reservation_id='r-cpedp58n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1264107218',owner_user_name='tempest-AttachVolumeShelveTestJSON-1264107218-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T15:57:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3146d6b1e7324ebaa62ade09f1d1c68f',uuid=2c154591-b130-4aa4-aad4-4c85324512df,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c743768f-0b40-435a-8754-96784ae96dda", "address": "fa:16:3e:c1:2c:1c", "network": {"id": "5d0ae041-a67d-4a54-bd53-104c4f44209d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-938551772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "169fdaea89d4431aa6adacdbb76f3546", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc743768f-0b", "ovs_interfaceid": "c743768f-0b40-435a-8754-96784ae96dda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 15:59:25 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-64e20296-c7ef-470c-b3fe-9d81a56e609f tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Converting VIF {"id": "c743768f-0b40-435a-8754-96784ae96dda", "address": "fa:16:3e:c1:2c:1c", "network": {"id": "5d0ae041-a67d-4a54-bd53-104c4f44209d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-938551772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "169fdaea89d4431aa6adacdbb76f3546", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc743768f-0b", "ovs_interfaceid": "c743768f-0b40-435a-8754-96784ae96dda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:59:25 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-64e20296-c7ef-470c-b3fe-9d81a56e609f tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:2c:1c,bridge_name='br-int',has_traffic_filtering=True,id=c743768f-0b40-435a-8754-96784ae96dda,network=Network(5d0ae041-a67d-4a54-bd53-104c4f44209d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc743768f-0b') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:59:25 user nova-compute[75176]: DEBUG os_vif [None req-64e20296-c7ef-470c-b3fe-9d81a56e609f tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:2c:1c,bridge_name='br-int',has_traffic_filtering=True,id=c743768f-0b40-435a-8754-96784ae96dda,network=Network(5d0ae041-a67d-4a54-bd53-104c4f44209d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc743768f-0b') {{(pid=75176) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 15:59:25 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:59:25 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc743768f-0b, bridge=br-int, if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:59:25 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:59:25 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:59:25 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:59:25 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e0cb6678-27a0-402f-a954-2453d5ef8fbc) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:59:25 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:59:25 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:59:25 user nova-compute[75176]: INFO os_vif [None req-64e20296-c7ef-470c-b3fe-9d81a56e609f tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:2c:1c,bridge_name='br-int',has_traffic_filtering=True,id=c743768f-0b40-435a-8754-96784ae96dda,network=Network(5d0ae041-a67d-4a54-bd53-104c4f44209d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc743768f-0b')
Nov 28 15:59:25 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-64e20296-c7ef-470c-b3fe-9d81a56e609f tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] [instance: 2c154591-b130-4aa4-aad4-4c85324512df] Deleting instance files /opt/stack/data/nova/instances/2c154591-b130-4aa4-aad4-4c85324512df_del
Nov 28 15:59:25 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-64e20296-c7ef-470c-b3fe-9d81a56e609f tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] [instance: 2c154591-b130-4aa4-aad4-4c85324512df] Deletion of /opt/stack/data/nova/instances/2c154591-b130-4aa4-aad4-4c85324512df_del complete
Nov 28 15:59:25 user nova-compute[75176]: INFO nova.compute.manager [None req-64e20296-c7ef-470c-b3fe-9d81a56e609f tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] [instance: 2c154591-b130-4aa4-aad4-4c85324512df] Took 0.96 seconds to destroy the instance on the hypervisor.
Nov 28 15:59:25 user nova-compute[75176]: DEBUG oslo.service.loopingcall [None req-64e20296-c7ef-470c-b3fe-9d81a56e609f tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75176) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 15:59:25 user nova-compute[75176]: DEBUG nova.compute.manager [-] [instance: 2c154591-b130-4aa4-aad4-4c85324512df] Deallocating network for instance {{(pid=75176) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 15:59:25 user nova-compute[75176]: DEBUG nova.network.neutron [-] [instance: 2c154591-b130-4aa4-aad4-4c85324512df] deallocate_for_instance() {{(pid=75176) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 15:59:26 user nova-compute[75176]: DEBUG nova.compute.manager [req-6564ffbf-daa5-4cb0-b6ce-79a86bee6d62 req-5437c471-8b92-4259-b8c6-81d5a68b955e service nova] [instance: 2c154591-b130-4aa4-aad4-4c85324512df] Received event network-vif-unplugged-c743768f-0b40-435a-8754-96784ae96dda {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:59:26 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-6564ffbf-daa5-4cb0-b6ce-79a86bee6d62 req-5437c471-8b92-4259-b8c6-81d5a68b955e service nova] Acquiring lock "2c154591-b130-4aa4-aad4-4c85324512df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:59:26 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-6564ffbf-daa5-4cb0-b6ce-79a86bee6d62 req-5437c471-8b92-4259-b8c6-81d5a68b955e service nova] Lock "2c154591-b130-4aa4-aad4-4c85324512df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:59:26 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-6564ffbf-daa5-4cb0-b6ce-79a86bee6d62 req-5437c471-8b92-4259-b8c6-81d5a68b955e service nova] Lock "2c154591-b130-4aa4-aad4-4c85324512df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:59:26 user nova-compute[75176]: DEBUG nova.compute.manager [req-6564ffbf-daa5-4cb0-b6ce-79a86bee6d62 req-5437c471-8b92-4259-b8c6-81d5a68b955e service nova] [instance: 2c154591-b130-4aa4-aad4-4c85324512df] No waiting events found dispatching network-vif-unplugged-c743768f-0b40-435a-8754-96784ae96dda {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:59:26 user nova-compute[75176]: DEBUG nova.compute.manager [req-6564ffbf-daa5-4cb0-b6ce-79a86bee6d62 req-5437c471-8b92-4259-b8c6-81d5a68b955e service nova] [instance: 2c154591-b130-4aa4-aad4-4c85324512df] Received event network-vif-unplugged-c743768f-0b40-435a-8754-96784ae96dda for instance with task_state deleting. {{(pid=75176) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 15:59:26 user nova-compute[75176]: DEBUG nova.compute.manager [req-6564ffbf-daa5-4cb0-b6ce-79a86bee6d62 req-5437c471-8b92-4259-b8c6-81d5a68b955e service nova] [instance: 2c154591-b130-4aa4-aad4-4c85324512df] Received event network-vif-plugged-c743768f-0b40-435a-8754-96784ae96dda {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:59:26 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-6564ffbf-daa5-4cb0-b6ce-79a86bee6d62 req-5437c471-8b92-4259-b8c6-81d5a68b955e service nova] Acquiring lock "2c154591-b130-4aa4-aad4-4c85324512df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:59:26 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-6564ffbf-daa5-4cb0-b6ce-79a86bee6d62 req-5437c471-8b92-4259-b8c6-81d5a68b955e service nova] Lock "2c154591-b130-4aa4-aad4-4c85324512df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:59:26 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-6564ffbf-daa5-4cb0-b6ce-79a86bee6d62 req-5437c471-8b92-4259-b8c6-81d5a68b955e service nova] Lock "2c154591-b130-4aa4-aad4-4c85324512df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:59:26 user nova-compute[75176]: DEBUG nova.compute.manager [req-6564ffbf-daa5-4cb0-b6ce-79a86bee6d62 req-5437c471-8b92-4259-b8c6-81d5a68b955e service nova] [instance: 2c154591-b130-4aa4-aad4-4c85324512df] No waiting events found dispatching network-vif-plugged-c743768f-0b40-435a-8754-96784ae96dda {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:59:26 user nova-compute[75176]: WARNING nova.compute.manager [req-6564ffbf-daa5-4cb0-b6ce-79a86bee6d62 req-5437c471-8b92-4259-b8c6-81d5a68b955e service nova] [instance: 2c154591-b130-4aa4-aad4-4c85324512df] Received unexpected event network-vif-plugged-c743768f-0b40-435a-8754-96784ae96dda for instance with vm_state active and task_state deleting.
Nov 28 15:59:26 user nova-compute[75176]: DEBUG nova.network.neutron [-] [instance: 2c154591-b130-4aa4-aad4-4c85324512df] Updating instance_info_cache with network_info: [] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:59:26 user nova-compute[75176]: INFO nova.compute.manager [-] [instance: 2c154591-b130-4aa4-aad4-4c85324512df] Took 1.00 seconds to deallocate network for instance.
Nov 28 15:59:26 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-64e20296-c7ef-470c-b3fe-9d81a56e609f tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:59:26 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-64e20296-c7ef-470c-b3fe-9d81a56e609f tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:59:26 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-4ac59d61-f344-495c-bee5-89bd51b32c3d tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: ecf38787-0a69-4f35-b121-3dc6e70023a1] Snapshot image upload complete
Nov 28 15:59:26 user nova-compute[75176]: INFO nova.compute.manager [None req-4ac59d61-f344-495c-bee5-89bd51b32c3d tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: ecf38787-0a69-4f35-b121-3dc6e70023a1] Took 5.31 seconds to snapshot the instance on the hypervisor.
Nov 28 15:59:27 user nova-compute[75176]: DEBUG nova.compute.provider_tree [None req-64e20296-c7ef-470c-b3fe-9d81a56e609f tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Inventory has not changed in ProviderTree for provider: b37848d8-f401-4155-a029-b0ffa09ff85b {{(pid=75176) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 15:59:27 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-64e20296-c7ef-470c-b3fe-9d81a56e609f tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Inventory has not changed for provider b37848d8-f401-4155-a029-b0ffa09ff85b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75176) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 15:59:27 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-64e20296-c7ef-470c-b3fe-9d81a56e609f tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.417s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:59:27 user nova-compute[75176]: INFO nova.scheduler.client.report [None req-64e20296-c7ef-470c-b3fe-9d81a56e609f tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Deleted allocations for instance 2c154591-b130-4aa4-aad4-4c85324512df
Nov 28 15:59:27 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-64e20296-c7ef-470c-b3fe-9d81a56e609f tempest-AttachVolumeShelveTestJSON-1264107218 tempest-AttachVolumeShelveTestJSON-1264107218-project-member] Lock "2c154591-b130-4aa4-aad4-4c85324512df" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.581s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:59:28 user nova-compute[75176]: DEBUG nova.compute.manager [req-ff27e5da-3644-40cf-98a5-fc06127a3c53 req-aede22de-5d51-44d7-96e6-225047dfa92f service nova] [instance: 2c154591-b130-4aa4-aad4-4c85324512df] Received event network-vif-deleted-c743768f-0b40-435a-8754-96784ae96dda {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:59:28 user nova-compute[75176]: DEBUG nova.objects.instance [None req-fb4b4a2f-9f6d-447f-badc-e4dbdbe9af40 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Lazy-loading 'flavor' on Instance uuid e0b7a064-03b6-4a0d-88be-2f12c12a1ddb {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:59:29 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-fb4b4a2f-9f6d-447f-badc-e4dbdbe9af40 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Lock "e0b7a064-03b6-4a0d-88be-2f12c12a1ddb" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 24.675s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:59:29 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:59:30 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:59:33 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ffa3ccbd-6e2d-4573-94a4-625ddb10d120 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] [instance: 726344c0-a0dc-48d5-a18f-8a258ebde87d] Calling os-brick to attach iSCSI Volume {{(pid=75176) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 15:59:33 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffa3ccbd-6e2d-4573-94a4-625ddb10d120 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c1b8a00>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4b1a81f9-4a84-4f9e-9b1a-86b0c17ed81c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mEwKVNHQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 15:59:33 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-ffa3ccbd-6e2d-4573-94a4-625ddb10d120 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 15:59:33 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-ffa3ccbd-6e2d-4573-94a4-625ddb10d120 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 15:59:33 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-ffa3ccbd-6e2d-4573-94a4-625ddb10d120 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 15:59:33 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-ffa3ccbd-6e2d-4573-94a4-625ddb10d120 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 15:59:33 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-ffa3ccbd-6e2d-4573-94a4-625ddb10d120 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4b1a81f9-4a84-4f9e-9b1a-86b0c17ed81c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 15:59:33 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-ffa3ccbd-6e2d-4573-94a4-625ddb10d120 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4b1a81f9-4a84-4f9e-9b1a-86b0c17ed81c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 15:59:33 user nova-compute[75176]: INFO os_brick.initiator.connectors.iscsi [None req-ffa3ccbd-6e2d-4573-94a4-625ddb10d120 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 15:59:33 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b1a81f9-4a84-4f9e-9b1a-86b0c17ed81c -p 172.16.0.220:3260 {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:59:33 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b1a81f9-4a84-4f9e-9b1a-86b0c17ed81c -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:59:33 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fb7c58d-7449-46de-8829-4453167fa6f4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:59:33 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffa3ccbd-6e2d-4573-94a4-625ddb10d120 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 15:59:33 user nova-compute[75176]:  {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:59:33 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b1a81f9-4a84-4f9e-9b1a-86b0c17ed81c -p 172.16.0.220:3260 --interface default --op new {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:59:33 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b1a81f9-4a84-4f9e-9b1a-86b0c17ed81c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:59:33 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[601f6ba7-23ab-4c5b-8e0e-e4a7fef5d8c0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4b1a81f9-4a84-4f9e-9b1a-86b0c17ed81c] added\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:59:33 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffa3ccbd-6e2d-4573-94a4-625ddb10d120 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4b1a81f9-4a84-4f9e-9b1a-86b0c17ed81c] added
Nov 28 15:59:33 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:59:33 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b1a81f9-4a84-4f9e-9b1a-86b0c17ed81c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:59:33 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b1a81f9-4a84-4f9e-9b1a-86b0c17ed81c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:59:33 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[65403679-c2e1-48e0-a411-859daf8eecaf]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:59:33 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffa3ccbd-6e2d-4573-94a4-625ddb10d120 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:59:33 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b1a81f9-4a84-4f9e-9b1a-86b0c17ed81c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:59:33 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b1a81f9-4a84-4f9e-9b1a-86b0c17ed81c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:59:33 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[abe5e838-7b78-4da5-a33e-714ab7a89f4c]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:59:33 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffa3ccbd-6e2d-4573-94a4-625ddb10d120 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:59:33 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b1a81f9-4a84-4f9e-9b1a-86b0c17ed81c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mEwKVNHQ {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:59:33 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b1a81f9-4a84-4f9e-9b1a-86b0c17ed81c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mEwKVNHQ" returned: 0 in 0.019s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:59:33 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[19f6a1d4-0d09-4b6c-a21b-7923fd3ea8ef]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:59:33 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffa3ccbd-6e2d-4573-94a4-625ddb10d120 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mEwKVNHQ'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:59:33 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b1a81f9-4a84-4f9e-9b1a-86b0c17ed81c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:59:33 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b1a81f9-4a84-4f9e-9b1a-86b0c17ed81c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:59:33 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[31b0fc7a-cf06-4348-8740-7f558197df67]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:59:33 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffa3ccbd-6e2d-4573-94a4-625ddb10d120 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:59:33 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:59:33 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:59:33 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[89263c34-e3d5-45c4-8da8-bc6ae52c3a0d]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a0ac2c4-a491-487c-b957-f46813dd109d (non-flash)\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:59:33 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffa3ccbd-6e2d-4573-94a4-625ddb10d120 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 (non-flash)
Nov 28 15:59:33 user nova-compute[75176]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0 (non-flash)
Nov 28 15:59:33 user nova-compute[75176]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a0ac2c4-a491-487c-b957-f46813dd109d (non-flash)
Nov 28 15:59:33 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:59:33 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffa3ccbd-6e2d-4573-94a4-625ddb10d120 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 (non-flash)
Nov 28 15:59:33 user nova-compute[75176]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0 (non-flash)
Nov 28 15:59:33 user nova-compute[75176]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a0ac2c4-a491-487c-b957-f46813dd109d (non-flash)
Nov 28 15:59:33 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 15:59:33 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b1a81f9-4a84-4f9e-9b1a-86b0c17ed81c -p 172.16.0.220:3260 --login {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:59:33 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b1a81f9-4a84-4f9e-9b1a-86b0c17ed81c -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:59:33 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cb9e356-b8d9-43d1-8fb1-4df8748087bd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4b1a81f9-4a84-4f9e-9b1a-86b0c17ed81c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4b1a81f9-4a84-4f9e-9b1a-86b0c17ed81c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:59:33 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffa3ccbd-6e2d-4573-94a4-625ddb10d120 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4b1a81f9-4a84-4f9e-9b1a-86b0c17ed81c, portal: 172.16.0.220,3260]
Nov 28 15:59:33 user nova-compute[75176]: Login to [iface: default, target: iqn.2010-10.org.openstack:4b1a81f9-4a84-4f9e-9b1a-86b0c17ed81c, portal: 172.16.0.220,3260] successful.
Nov 28 15:59:33 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:59:33 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b1a81f9-4a84-4f9e-9b1a-86b0c17ed81c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:59:33 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b1a81f9-4a84-4f9e-9b1a-86b0c17ed81c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:59:33 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[84d04e8c-8316-45ed-9b7f-40d342c00f8b]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:59:33 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffa3ccbd-6e2d-4573-94a4-625ddb10d120 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 15:59:33 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:59:33 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:59:33 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[6619d743-eb2f-4f6f-85aa-299ec73bcaf1]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a0ac2c4-a491-487c-b957-f46813dd109d (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b1a81f9-4a84-4f9e-9b1a-86b0c17ed81c (non-flash)\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:59:33 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffa3ccbd-6e2d-4573-94a4-625ddb10d120 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 (non-flash)
Nov 28 15:59:33 user nova-compute[75176]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0 (non-flash)
Nov 28 15:59:33 user nova-compute[75176]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a0ac2c4-a491-487c-b957-f46813dd109d (non-flash)
Nov 28 15:59:33 user nova-compute[75176]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b1a81f9-4a84-4f9e-9b1a-86b0c17ed81c (non-flash)
Nov 28 15:59:33 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 15:59:33 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffa3ccbd-6e2d-4573-94a4-625ddb10d120 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 (non-flash)
Nov 28 15:59:33 user nova-compute[75176]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0 (non-flash)
Nov 28 15:59:33 user nova-compute[75176]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a0ac2c4-a491-487c-b957-f46813dd109d (non-flash)
Nov 28 15:59:33 user nova-compute[75176]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b1a81f9-4a84-4f9e-9b1a-86b0c17ed81c (non-flash)
Nov 28 15:59:33 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 15:59:33 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-ffa3ccbd-6e2d-4573-94a4-625ddb10d120 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4b1a81f9-4a84-4f9e-9b1a-86b0c17ed81c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.286s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 15:59:33 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffa3ccbd-6e2d-4573-94a4-625ddb10d120 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Connected to 172.16.0.220:3260 {{(pid=75176) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 15:59:33 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-ffa3ccbd-6e2d-4573-94a4-625ddb10d120 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] HCTL ('34', '-', '-', 0) found on session 55 with lun 0 {{(pid=75176) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 15:59:33 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-ffa3ccbd-6e2d-4573-94a4-625ddb10d120 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75176) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 15:59:33 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:59:33 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:59:33 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[82e328b7-2979-4c98-9a21-985ff51a84f8]: (4, ('- - 0', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:59:33 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-ffa3ccbd-6e2d-4573-94a4-625ddb10d120 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Searching for a device in session 55 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75176) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 15:59:33 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffa3ccbd-6e2d-4573-94a4-625ddb10d120 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:4b1a81f9-4a84-4f9e-9b1a-86b0c17ed81c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mEwKVNHQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75176) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 15:59:34 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-ffa3ccbd-6e2d-4573-94a4-625ddb10d120 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.321s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 15:59:34 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffa3ccbd-6e2d-4573-94a4-625ddb10d120 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] <== connect_volume: return (1323ms) {'type': 'block', 'scsi_wwn': '23437333362613039', 'path': '/dev/sdc'} {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 15:59:34 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ffa3ccbd-6e2d-4573-94a4-625ddb10d120 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] [instance: 726344c0-a0dc-48d5-a18f-8a258ebde87d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23437333362613039', 'path': '/dev/sdc'} {{(pid=75176) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 15:59:34 user nova-compute[75176]: DEBUG nova.objects.instance [None req-ffa3ccbd-6e2d-4573-94a4-625ddb10d120 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Lazy-loading 'flavor' on Instance uuid 726344c0-a0dc-48d5-a18f-8a258ebde87d {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:59:34 user nova-compute[75176]: DEBUG nova.virt.libvirt.guest [None req-ffa3ccbd-6e2d-4573-94a4-625ddb10d120 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 15:59:34 user nova-compute[75176]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 15:59:34 user nova-compute[75176]:   <source dev="/dev/sdc"/>
Nov 28 15:59:34 user nova-compute[75176]:   <target dev="vdb" bus="virtio"/>
Nov 28 15:59:34 user nova-compute[75176]:   <serial>4b1a81f9-4a84-4f9e-9b1a-86b0c17ed81c</serial>
Nov 28 15:59:34 user nova-compute[75176]: </disk>
Nov 28 15:59:34 user nova-compute[75176]:  {{(pid=75176) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 15:59:34 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:59:34 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-ffa3ccbd-6e2d-4573-94a4-625ddb10d120 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] No BDM found with device name vda, not building metadata. {{(pid=75176) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 15:59:34 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-ffa3ccbd-6e2d-4573-94a4-625ddb10d120 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75176) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 15:59:34 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-ffa3ccbd-6e2d-4573-94a4-625ddb10d120 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] No VIF found with MAC fa:16:3e:0d:da:42, not building metadata {{(pid=75176) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 15:59:34 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-ffa3ccbd-6e2d-4573-94a4-625ddb10d120 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Lock "726344c0-a0dc-48d5-a18f-8a258ebde87d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.913s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:59:35 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:59:35 user nova-compute[75176]: DEBUG nova.compute.manager [req-cf7a6a75-ecbc-4466-b414-9c89fab28214 req-9781fbdc-4867-46e6-a465-660b5943ef51 service nova] [instance: 3ae602c1-2aed-41ea-9f4c-4f3ec4aab254] Received event network-changed-dee8b036-92ce-421f-bb73-dbf92200da92 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:59:35 user nova-compute[75176]: DEBUG nova.compute.manager [req-cf7a6a75-ecbc-4466-b414-9c89fab28214 req-9781fbdc-4867-46e6-a465-660b5943ef51 service nova] [instance: 3ae602c1-2aed-41ea-9f4c-4f3ec4aab254] Refreshing instance network info cache due to event network-changed-dee8b036-92ce-421f-bb73-dbf92200da92. {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 15:59:35 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-cf7a6a75-ecbc-4466-b414-9c89fab28214 req-9781fbdc-4867-46e6-a465-660b5943ef51 service nova] Acquiring lock "refresh_cache-3ae602c1-2aed-41ea-9f4c-4f3ec4aab254" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:59:35 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-cf7a6a75-ecbc-4466-b414-9c89fab28214 req-9781fbdc-4867-46e6-a465-660b5943ef51 service nova] Acquired lock "refresh_cache-3ae602c1-2aed-41ea-9f4c-4f3ec4aab254" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:59:35 user nova-compute[75176]: DEBUG nova.network.neutron [req-cf7a6a75-ecbc-4466-b414-9c89fab28214 req-9781fbdc-4867-46e6-a465-660b5943ef51 service nova] [instance: 3ae602c1-2aed-41ea-9f4c-4f3ec4aab254] Refreshing network info cache for port dee8b036-92ce-421f-bb73-dbf92200da92 {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 15:59:35 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-f8d39ca9-7e2d-4c76-8505-1fb74974609d tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Acquiring lock "3ae602c1-2aed-41ea-9f4c-4f3ec4aab254" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:59:35 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-f8d39ca9-7e2d-4c76-8505-1fb74974609d tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Lock "3ae602c1-2aed-41ea-9f4c-4f3ec4aab254" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:59:35 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-f8d39ca9-7e2d-4c76-8505-1fb74974609d tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Acquiring lock "3ae602c1-2aed-41ea-9f4c-4f3ec4aab254-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:59:35 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-f8d39ca9-7e2d-4c76-8505-1fb74974609d tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Lock "3ae602c1-2aed-41ea-9f4c-4f3ec4aab254-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:59:35 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-f8d39ca9-7e2d-4c76-8505-1fb74974609d tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Lock "3ae602c1-2aed-41ea-9f4c-4f3ec4aab254-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:59:35 user nova-compute[75176]: INFO nova.compute.manager [None req-f8d39ca9-7e2d-4c76-8505-1fb74974609d tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] [instance: 3ae602c1-2aed-41ea-9f4c-4f3ec4aab254] Terminating instance
Nov 28 15:59:35 user nova-compute[75176]: DEBUG nova.compute.manager [None req-f8d39ca9-7e2d-4c76-8505-1fb74974609d tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] [instance: 3ae602c1-2aed-41ea-9f4c-4f3ec4aab254] Start destroying the instance on the hypervisor. {{(pid=75176) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 15:59:36 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:59:36 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:59:36 user nova-compute[75176]: INFO nova.compute.manager [None req-bac2f8b9-ea65-48a6-9b5b-4e2411fcdce7 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] [instance: 726344c0-a0dc-48d5-a18f-8a258ebde87d] Rescuing
Nov 28 15:59:36 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-bac2f8b9-ea65-48a6-9b5b-4e2411fcdce7 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Acquiring lock "refresh_cache-726344c0-a0dc-48d5-a18f-8a258ebde87d" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 15:59:36 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-bac2f8b9-ea65-48a6-9b5b-4e2411fcdce7 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Acquired lock "refresh_cache-726344c0-a0dc-48d5-a18f-8a258ebde87d" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 15:59:36 user nova-compute[75176]: DEBUG nova.network.neutron [None req-bac2f8b9-ea65-48a6-9b5b-4e2411fcdce7 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] [instance: 726344c0-a0dc-48d5-a18f-8a258ebde87d] Building network info cache for instance {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 15:59:36 user nova-compute[75176]: DEBUG nova.network.neutron [req-cf7a6a75-ecbc-4466-b414-9c89fab28214 req-9781fbdc-4867-46e6-a465-660b5943ef51 service nova] [instance: 3ae602c1-2aed-41ea-9f4c-4f3ec4aab254] Updated VIF entry in instance network info cache for port dee8b036-92ce-421f-bb73-dbf92200da92. {{(pid=75176) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 15:59:36 user nova-compute[75176]: DEBUG nova.network.neutron [req-cf7a6a75-ecbc-4466-b414-9c89fab28214 req-9781fbdc-4867-46e6-a465-660b5943ef51 service nova] [instance: 3ae602c1-2aed-41ea-9f4c-4f3ec4aab254] Updating instance_info_cache with network_info: [{"id": "dee8b036-92ce-421f-bb73-dbf92200da92", "address": "fa:16:3e:51:3e:28", "network": {"id": "1fd59c02-7617-4d0e-9456-84d6cc91ce3b", "bridge": "br-int", "label": "tempest-TestStampPattern-116968826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4a10ba40c844955b63cb8603dd548cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdee8b036-92", "ovs_interfaceid": "dee8b036-92ce-421f-bb73-dbf92200da92", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:59:36 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:59:36 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-cf7a6a75-ecbc-4466-b414-9c89fab28214 req-9781fbdc-4867-46e6-a465-660b5943ef51 service nova] Releasing lock "refresh_cache-3ae602c1-2aed-41ea-9f4c-4f3ec4aab254" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:59:36 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:59:36 user nova-compute[75176]: DEBUG nova.compute.manager [req-0fd7e5d8-a83c-4ed6-a4c9-5aa9ef25a4ea req-254644df-50ef-4381-a925-f2d80482845a service nova] [instance: 3ae602c1-2aed-41ea-9f4c-4f3ec4aab254] Received event network-vif-unplugged-dee8b036-92ce-421f-bb73-dbf92200da92 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:59:36 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-0fd7e5d8-a83c-4ed6-a4c9-5aa9ef25a4ea req-254644df-50ef-4381-a925-f2d80482845a service nova] Acquiring lock "3ae602c1-2aed-41ea-9f4c-4f3ec4aab254-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:59:36 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-0fd7e5d8-a83c-4ed6-a4c9-5aa9ef25a4ea req-254644df-50ef-4381-a925-f2d80482845a service nova] Lock "3ae602c1-2aed-41ea-9f4c-4f3ec4aab254-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:59:36 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-0fd7e5d8-a83c-4ed6-a4c9-5aa9ef25a4ea req-254644df-50ef-4381-a925-f2d80482845a service nova] Lock "3ae602c1-2aed-41ea-9f4c-4f3ec4aab254-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:59:36 user nova-compute[75176]: DEBUG nova.compute.manager [req-0fd7e5d8-a83c-4ed6-a4c9-5aa9ef25a4ea req-254644df-50ef-4381-a925-f2d80482845a service nova] [instance: 3ae602c1-2aed-41ea-9f4c-4f3ec4aab254] No waiting events found dispatching network-vif-unplugged-dee8b036-92ce-421f-bb73-dbf92200da92 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:59:36 user nova-compute[75176]: DEBUG nova.compute.manager [req-0fd7e5d8-a83c-4ed6-a4c9-5aa9ef25a4ea req-254644df-50ef-4381-a925-f2d80482845a service nova] [instance: 3ae602c1-2aed-41ea-9f4c-4f3ec4aab254] Received event network-vif-unplugged-dee8b036-92ce-421f-bb73-dbf92200da92 for instance with task_state deleting. {{(pid=75176) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 15:59:36 user nova-compute[75176]: INFO nova.virt.libvirt.driver [-] [instance: 3ae602c1-2aed-41ea-9f4c-4f3ec4aab254] Instance destroyed successfully.
Nov 28 15:59:36 user nova-compute[75176]: DEBUG nova.objects.instance [None req-f8d39ca9-7e2d-4c76-8505-1fb74974609d tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Lazy-loading 'resources' on Instance uuid 3ae602c1-2aed-41ea-9f4c-4f3ec4aab254 {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:59:36 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-f8d39ca9-7e2d-4c76-8505-1fb74974609d tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T15:56:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-847942438',display_name='tempest-TestStampPattern-server-847942438',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-847942438',id=42,image_ref='bfdcb73d-4912-40b6-bdaf-299321d8dfaa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJDBFhGQGpvl0PzqrMCTu0nZeD/U57w9NaBED1EztO7Blxs28QRqXvlfz9rV68t1LblFY2IOCQcQRNQ31eEMoYQx8drae7GcY4KAfy8XhLJfS2RIdXJ5ySbX/yQzldJoeQ==',key_name='tempest-TestStampPattern-557159962',keypairs=<?>,launch_index=0,launched_at=2023-11-28T15:56:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c4a10ba40c844955b63cb8603dd548cf',ramdisk_id='',reservation_id='r-5kkb6qmj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='ecabea76-6c29-412d-bf77-989917b449a9',image_min_disk='1',image_min_ram='0',image_owner_id='c4a10ba40c844955b63cb8603dd548cf',image_owner_project_name='tempest-TestStampPattern-286689652',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-286689652-project-member',image_user_id='0dcee22ed63f40fab2ee0e42f5f38e13',owner_project_name='tempest-TestStampPattern-286689652',owner_user_name='tempest-TestStampPattern-286689652-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T15:56:48Z,user_data=None,user_id='0dcee22ed63f40fab2ee0e42f5f38e13',uuid=3ae602c1-2aed-41ea-9f4c-4f3ec4aab254,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dee8b036-92ce-421f-bb73-dbf92200da92", "address": "fa:16:3e:51:3e:28", "network": {"id": "1fd59c02-7617-4d0e-9456-84d6cc91ce3b", "bridge": "br-int", "label": "tempest-TestStampPattern-116968826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4a10ba40c844955b63cb8603dd548cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdee8b036-92", "ovs_interfaceid": "dee8b036-92ce-421f-bb73-dbf92200da92", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 15:59:36 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-f8d39ca9-7e2d-4c76-8505-1fb74974609d tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Converting VIF {"id": "dee8b036-92ce-421f-bb73-dbf92200da92", "address": "fa:16:3e:51:3e:28", "network": {"id": "1fd59c02-7617-4d0e-9456-84d6cc91ce3b", "bridge": "br-int", "label": "tempest-TestStampPattern-116968826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4a10ba40c844955b63cb8603dd548cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdee8b036-92", "ovs_interfaceid": "dee8b036-92ce-421f-bb73-dbf92200da92", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:59:36 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-f8d39ca9-7e2d-4c76-8505-1fb74974609d tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:51:3e:28,bridge_name='br-int',has_traffic_filtering=True,id=dee8b036-92ce-421f-bb73-dbf92200da92,network=Network(1fd59c02-7617-4d0e-9456-84d6cc91ce3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdee8b036-92') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:59:36 user nova-compute[75176]: DEBUG os_vif [None req-f8d39ca9-7e2d-4c76-8505-1fb74974609d tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:51:3e:28,bridge_name='br-int',has_traffic_filtering=True,id=dee8b036-92ce-421f-bb73-dbf92200da92,network=Network(1fd59c02-7617-4d0e-9456-84d6cc91ce3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdee8b036-92') {{(pid=75176) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 15:59:36 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:59:36 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdee8b036-92, bridge=br-int, if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:59:36 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:59:36 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:59:36 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:59:36 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4831a25e-8e2e-4d92-a321-36dd0f290326) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 15:59:36 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:59:36 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:59:36 user nova-compute[75176]: INFO os_vif [None req-f8d39ca9-7e2d-4c76-8505-1fb74974609d tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:51:3e:28,bridge_name='br-int',has_traffic_filtering=True,id=dee8b036-92ce-421f-bb73-dbf92200da92,network=Network(1fd59c02-7617-4d0e-9456-84d6cc91ce3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdee8b036-92')
Nov 28 15:59:36 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-f8d39ca9-7e2d-4c76-8505-1fb74974609d tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] [instance: 3ae602c1-2aed-41ea-9f4c-4f3ec4aab254] Deleting instance files /opt/stack/data/nova/instances/3ae602c1-2aed-41ea-9f4c-4f3ec4aab254_del
Nov 28 15:59:36 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-f8d39ca9-7e2d-4c76-8505-1fb74974609d tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] [instance: 3ae602c1-2aed-41ea-9f4c-4f3ec4aab254] Deletion of /opt/stack/data/nova/instances/3ae602c1-2aed-41ea-9f4c-4f3ec4aab254_del complete
Nov 28 15:59:37 user nova-compute[75176]: DEBUG nova.network.neutron [None req-bac2f8b9-ea65-48a6-9b5b-4e2411fcdce7 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] [instance: 726344c0-a0dc-48d5-a18f-8a258ebde87d] Updating instance_info_cache with network_info: [{"id": "966907f1-2c5f-4c34-b155-b1b3b4176f5f", "address": "fa:16:3e:0d:da:42", "network": {"id": "d47c1797-a66f-4f2d-b83e-903b5bd3251c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1416388789-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd2856ce0a2545cda0b796eb0be10a40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap966907f1-2c", "ovs_interfaceid": "966907f1-2c5f-4c34-b155-b1b3b4176f5f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:59:37 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-bac2f8b9-ea65-48a6-9b5b-4e2411fcdce7 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Releasing lock "refresh_cache-726344c0-a0dc-48d5-a18f-8a258ebde87d" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 15:59:37 user nova-compute[75176]: INFO nova.compute.manager [None req-f8d39ca9-7e2d-4c76-8505-1fb74974609d tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] [instance: 3ae602c1-2aed-41ea-9f4c-4f3ec4aab254] Took 1.11 seconds to destroy the instance on the hypervisor.
Nov 28 15:59:37 user nova-compute[75176]: DEBUG oslo.service.loopingcall [None req-f8d39ca9-7e2d-4c76-8505-1fb74974609d tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75176) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 15:59:37 user nova-compute[75176]: DEBUG nova.compute.manager [-] [instance: 3ae602c1-2aed-41ea-9f4c-4f3ec4aab254] Deallocating network for instance {{(pid=75176) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 15:59:37 user nova-compute[75176]: DEBUG nova.network.neutron [-] [instance: 3ae602c1-2aed-41ea-9f4c-4f3ec4aab254] deallocate_for_instance() {{(pid=75176) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 15:59:37 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:59:37 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:59:37 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:59:37 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:59:37 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:59:37 user nova-compute[75176]: DEBUG nova.network.neutron [-] [instance: 3ae602c1-2aed-41ea-9f4c-4f3ec4aab254] Updating instance_info_cache with network_info: [] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 15:59:37 user nova-compute[75176]: INFO nova.compute.manager [-] [instance: 3ae602c1-2aed-41ea-9f4c-4f3ec4aab254] Took 0.69 seconds to deallocate network for instance.
Nov 28 15:59:37 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-f8d39ca9-7e2d-4c76-8505-1fb74974609d tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:59:37 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-f8d39ca9-7e2d-4c76-8505-1fb74974609d tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:59:37 user nova-compute[75176]: INFO nova.virt.libvirt.driver [-] [instance: 726344c0-a0dc-48d5-a18f-8a258ebde87d] Instance destroyed successfully.
Nov 28 15:59:37 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-bac2f8b9-ea65-48a6-9b5b-4e2411fcdce7 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] [instance: 726344c0-a0dc-48d5-a18f-8a258ebde87d] Attempting rescue
Nov 28 15:59:37 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-bac2f8b9-ea65-48a6-9b5b-4e2411fcdce7 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75176) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 28 15:59:37 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-bac2f8b9-ea65-48a6-9b5b-4e2411fcdce7 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] [instance: 726344c0-a0dc-48d5-a18f-8a258ebde87d] Instance directory exists: not creating {{(pid=75176) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 28 15:59:37 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-bac2f8b9-ea65-48a6-9b5b-4e2411fcdce7 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] [instance: 726344c0-a0dc-48d5-a18f-8a258ebde87d] Creating image(s)
Nov 28 15:59:37 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-bac2f8b9-ea65-48a6-9b5b-4e2411fcdce7 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Acquiring lock "/opt/stack/data/nova/instances/726344c0-a0dc-48d5-a18f-8a258ebde87d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:59:37 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-bac2f8b9-ea65-48a6-9b5b-4e2411fcdce7 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Lock "/opt/stack/data/nova/instances/726344c0-a0dc-48d5-a18f-8a258ebde87d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:59:37 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-bac2f8b9-ea65-48a6-9b5b-4e2411fcdce7 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Lock "/opt/stack/data/nova/instances/726344c0-a0dc-48d5-a18f-8a258ebde87d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:59:37 user nova-compute[75176]: DEBUG nova.objects.instance [None req-bac2f8b9-ea65-48a6-9b5b-4e2411fcdce7 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Lazy-loading 'trusted_certs' on Instance uuid 726344c0-a0dc-48d5-a18f-8a258ebde87d {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:59:37 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-bac2f8b9-ea65-48a6-9b5b-4e2411fcdce7 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Acquiring lock "5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:59:37 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-bac2f8b9-ea65-48a6-9b5b-4e2411fcdce7 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Lock "5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:59:37 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-bac2f8b9-ea65-48a6-9b5b-4e2411fcdce7 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:59:37 user nova-compute[75176]: DEBUG nova.compute.manager [req-705f8b29-b7c0-4601-915c-b6c8873c9c90 req-f075fe57-e572-47be-82e1-f7beeee177d1 service nova] [instance: 3ae602c1-2aed-41ea-9f4c-4f3ec4aab254] Received event network-vif-deleted-dee8b036-92ce-421f-bb73-dbf92200da92 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:59:38 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-bac2f8b9-ea65-48a6-9b5b-4e2411fcdce7 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json" returned: 0 in 0.186s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:59:38 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-bac2f8b9-ea65-48a6-9b5b-4e2411fcdce7 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2,backing_fmt=raw /opt/stack/data/nova/instances/726344c0-a0dc-48d5-a18f-8a258ebde87d/disk.rescue {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:59:38 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-bac2f8b9-ea65-48a6-9b5b-4e2411fcdce7 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2,backing_fmt=raw /opt/stack/data/nova/instances/726344c0-a0dc-48d5-a18f-8a258ebde87d/disk.rescue" returned: 0 in 0.072s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:59:38 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-bac2f8b9-ea65-48a6-9b5b-4e2411fcdce7 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Lock "5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.264s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:59:38 user nova-compute[75176]: DEBUG nova.objects.instance [None req-bac2f8b9-ea65-48a6-9b5b-4e2411fcdce7 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Lazy-loading 'migration_context' on Instance uuid 726344c0-a0dc-48d5-a18f-8a258ebde87d {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:59:38 user nova-compute[75176]: DEBUG nova.objects.base [None req-bac2f8b9-ea65-48a6-9b5b-4e2411fcdce7 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Object Instance<726344c0-a0dc-48d5-a18f-8a258ebde87d> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75176) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 15:59:38 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-bac2f8b9-ea65-48a6-9b5b-4e2411fcdce7 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] [instance: 726344c0-a0dc-48d5-a18f-8a258ebde87d] Created local disks {{(pid=75176) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 15:59:38 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-bac2f8b9-ea65-48a6-9b5b-4e2411fcdce7 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] [instance: 726344c0-a0dc-48d5-a18f-8a258ebde87d] Start _get_guest_xml network_info=[{"id": "966907f1-2c5f-4c34-b155-b1b3b4176f5f", "address": "fa:16:3e:0d:da:42", "network": {"id": "d47c1797-a66f-4f2d-b83e-903b5bd3251c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1416388789-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1416388789-network", "vif_mac": "fa:16:3e:0d:da:42"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd2856ce0a2545cda0b796eb0be10a40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap966907f1-2c", "ovs_interfaceid": "966907f1-2c5f-4c34-b155-b1b3b4176f5f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T15:35:12Z,direct_url=<?>,disk_format='qcow2',id=1f41819e-c93f-4dc7-b253-37a27bbbbc74,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1b91c5d0672c4224a48df2e1f92688e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T15:35:13Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '1f41819e-c93f-4dc7-b253-37a27bbbbc74', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75176) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 15:59:38 user nova-compute[75176]: DEBUG nova.objects.instance [None req-bac2f8b9-ea65-48a6-9b5b-4e2411fcdce7 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Lazy-loading 'resources' on Instance uuid 726344c0-a0dc-48d5-a18f-8a258ebde87d {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:59:38 user nova-compute[75176]: DEBUG nova.objects.base [None req-bac2f8b9-ea65-48a6-9b5b-4e2411fcdce7 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Object Instance<726344c0-a0dc-48d5-a18f-8a258ebde87d> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75176) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 15:59:38 user nova-compute[75176]: DEBUG nova.objects.instance [None req-bac2f8b9-ea65-48a6-9b5b-4e2411fcdce7 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Lazy-loading 'numa_topology' on Instance uuid 726344c0-a0dc-48d5-a18f-8a258ebde87d {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:59:38 user nova-compute[75176]: DEBUG nova.objects.base [None req-bac2f8b9-ea65-48a6-9b5b-4e2411fcdce7 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Object Instance<726344c0-a0dc-48d5-a18f-8a258ebde87d> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75176) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 15:59:38 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-bac2f8b9-ea65-48a6-9b5b-4e2411fcdce7 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 15:59:38 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-bac2f8b9-ea65-48a6-9b5b-4e2411fcdce7 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 15:59:38 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-bac2f8b9-ea65-48a6-9b5b-4e2411fcdce7 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75176) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 15:59:38 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-bac2f8b9-ea65-48a6-9b5b-4e2411fcdce7 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] CPU controller missing on host. {{(pid=75176) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 15:59:38 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-bac2f8b9-ea65-48a6-9b5b-4e2411fcdce7 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75176) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 15:59:38 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-bac2f8b9-ea65-48a6-9b5b-4e2411fcdce7 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] CPU controller found on host. {{(pid=75176) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 15:59:38 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-bac2f8b9-ea65-48a6-9b5b-4e2411fcdce7 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75176) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 15:59:38 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-bac2f8b9-ea65-48a6-9b5b-4e2411fcdce7 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T15:35:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T15:35:12Z,direct_url=<?>,disk_format='qcow2',id=1f41819e-c93f-4dc7-b253-37a27bbbbc74,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1b91c5d0672c4224a48df2e1f92688e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T15:35:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 15:59:38 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-bac2f8b9-ea65-48a6-9b5b-4e2411fcdce7 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Flavor limits 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 15:59:38 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-bac2f8b9-ea65-48a6-9b5b-4e2411fcdce7 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Image limits 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 15:59:38 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-bac2f8b9-ea65-48a6-9b5b-4e2411fcdce7 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Flavor pref 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 15:59:38 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-bac2f8b9-ea65-48a6-9b5b-4e2411fcdce7 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Image pref 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 15:59:38 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-bac2f8b9-ea65-48a6-9b5b-4e2411fcdce7 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 15:59:38 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-bac2f8b9-ea65-48a6-9b5b-4e2411fcdce7 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 15:59:38 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-bac2f8b9-ea65-48a6-9b5b-4e2411fcdce7 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75176) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 15:59:38 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-bac2f8b9-ea65-48a6-9b5b-4e2411fcdce7 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Got 1 possible topologies {{(pid=75176) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 15:59:38 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-bac2f8b9-ea65-48a6-9b5b-4e2411fcdce7 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 15:59:38 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-bac2f8b9-ea65-48a6-9b5b-4e2411fcdce7 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 15:59:38 user nova-compute[75176]: DEBUG nova.objects.instance [None req-bac2f8b9-ea65-48a6-9b5b-4e2411fcdce7 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Lazy-loading 'vcpu_model' on Instance uuid 726344c0-a0dc-48d5-a18f-8a258ebde87d {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:59:38 user nova-compute[75176]: DEBUG nova.objects.base [None req-bac2f8b9-ea65-48a6-9b5b-4e2411fcdce7 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Object Instance<726344c0-a0dc-48d5-a18f-8a258ebde87d> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75176) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 15:59:38 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-bac2f8b9-ea65-48a6-9b5b-4e2411fcdce7 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T15:57:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1122679672',display_name='tempest-ServerRescueNegativeTestJSON-server-1122679672',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1122679672',id=45,image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEZuNmXMFz6sBu04nshrF/BB/Cnv2fAQGDkY1pjVwPYLhAmT6GMTzKRLMsJCXLjGi+jXRTKDx4ZWnzYKB3Ckq5OigiPkcaffbdzn12nwNwhUqhkxX7xDpQqJpdgTCr30aA==',key_name='tempest-keypair-210592767',keypairs=<?>,launch_index=0,launched_at=2023-11-28T15:57:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fd2856ce0a2545cda0b796eb0be10a40',ramdisk_id='',reservation_id='r-wq0wf5rj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1263291627',owner_user_name='tempest-ServerRescueNegativeTestJSON-1263291627-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T15:57:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b7bd0e1b307f4d339ca2e540e063f028',uuid=726344c0-a0dc-48d5-a18f-8a258ebde87d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "966907f1-2c5f-4c34-b155-b1b3b4176f5f", "address": "fa:16:3e:0d:da:42", "network": {"id": "d47c1797-a66f-4f2d-b83e-903b5bd3251c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1416388789-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1416388789-network", "vif_mac": "fa:16:3e:0d:da:42"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd2856ce0a2545cda0b796eb0be10a40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap966907f1-2c", "ovs_interfaceid": "966907f1-2c5f-4c34-b155-b1b3b4176f5f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75176) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 15:59:38 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-bac2f8b9-ea65-48a6-9b5b-4e2411fcdce7 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Converting VIF {"id": "966907f1-2c5f-4c34-b155-b1b3b4176f5f", "address": "fa:16:3e:0d:da:42", "network": {"id": "d47c1797-a66f-4f2d-b83e-903b5bd3251c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1416388789-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1416388789-network", "vif_mac": "fa:16:3e:0d:da:42"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd2856ce0a2545cda0b796eb0be10a40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap966907f1-2c", "ovs_interfaceid": "966907f1-2c5f-4c34-b155-b1b3b4176f5f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 15:59:38 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-bac2f8b9-ea65-48a6-9b5b-4e2411fcdce7 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0d:da:42,bridge_name='br-int',has_traffic_filtering=True,id=966907f1-2c5f-4c34-b155-b1b3b4176f5f,network=Network(d47c1797-a66f-4f2d-b83e-903b5bd3251c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap966907f1-2c') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 15:59:38 user nova-compute[75176]: DEBUG nova.objects.instance [None req-bac2f8b9-ea65-48a6-9b5b-4e2411fcdce7 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Lazy-loading 'pci_devices' on Instance uuid 726344c0-a0dc-48d5-a18f-8a258ebde87d {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:59:38 user nova-compute[75176]: DEBUG nova.objects.base [None req-bac2f8b9-ea65-48a6-9b5b-4e2411fcdce7 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Object Instance<726344c0-a0dc-48d5-a18f-8a258ebde87d> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75176) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 15:59:38 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-bac2f8b9-ea65-48a6-9b5b-4e2411fcdce7 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] [instance: 726344c0-a0dc-48d5-a18f-8a258ebde87d] End _get_guest_xml xml=<domain type="kvm">
Nov 28 15:59:38 user nova-compute[75176]:   <uuid>726344c0-a0dc-48d5-a18f-8a258ebde87d</uuid>
Nov 28 15:59:38 user nova-compute[75176]:   <name>instance-0000002d</name>
Nov 28 15:59:38 user nova-compute[75176]:   <memory>524288</memory>
Nov 28 15:59:38 user nova-compute[75176]:   <vcpu>1</vcpu>
Nov 28 15:59:38 user nova-compute[75176]:   <metadata>
Nov 28 15:59:38 user nova-compute[75176]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 15:59:38 user nova-compute[75176]:       <nova:package version="0.0.0"/>
Nov 28 15:59:38 user nova-compute[75176]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1122679672</nova:name>
Nov 28 15:59:38 user nova-compute[75176]:       <nova:creationTime>2023-11-28 15:59:38</nova:creationTime>
Nov 28 15:59:38 user nova-compute[75176]:       <nova:flavor name="m1.tiny">
Nov 28 15:59:38 user nova-compute[75176]:         <nova:memory>512</nova:memory>
Nov 28 15:59:38 user nova-compute[75176]:         <nova:disk>1</nova:disk>
Nov 28 15:59:38 user nova-compute[75176]:         <nova:swap>0</nova:swap>
Nov 28 15:59:38 user nova-compute[75176]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 15:59:38 user nova-compute[75176]:         <nova:vcpus>1</nova:vcpus>
Nov 28 15:59:38 user nova-compute[75176]:       </nova:flavor>
Nov 28 15:59:38 user nova-compute[75176]:       <nova:owner>
Nov 28 15:59:38 user nova-compute[75176]:         <nova:user uuid="b7bd0e1b307f4d339ca2e540e063f028">tempest-ServerRescueNegativeTestJSON-1263291627-project-member</nova:user>
Nov 28 15:59:38 user nova-compute[75176]:         <nova:project uuid="fd2856ce0a2545cda0b796eb0be10a40">tempest-ServerRescueNegativeTestJSON-1263291627</nova:project>
Nov 28 15:59:38 user nova-compute[75176]:       </nova:owner>
Nov 28 15:59:38 user nova-compute[75176]:       <nova:root type="image" uuid="1f41819e-c93f-4dc7-b253-37a27bbbbc74"/>
Nov 28 15:59:38 user nova-compute[75176]:       <nova:ports>
Nov 28 15:59:38 user nova-compute[75176]:         <nova:port uuid="966907f1-2c5f-4c34-b155-b1b3b4176f5f">
Nov 28 15:59:38 user nova-compute[75176]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 28 15:59:38 user nova-compute[75176]:         </nova:port>
Nov 28 15:59:38 user nova-compute[75176]:       </nova:ports>
Nov 28 15:59:38 user nova-compute[75176]:     </nova:instance>
Nov 28 15:59:38 user nova-compute[75176]:   </metadata>
Nov 28 15:59:38 user nova-compute[75176]:   <sysinfo type="smbios">
Nov 28 15:59:38 user nova-compute[75176]:     <system>
Nov 28 15:59:38 user nova-compute[75176]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 15:59:38 user nova-compute[75176]:       <entry name="product">OpenStack Nova</entry>
Nov 28 15:59:38 user nova-compute[75176]:       <entry name="version">0.0.0</entry>
Nov 28 15:59:38 user nova-compute[75176]:       <entry name="serial">726344c0-a0dc-48d5-a18f-8a258ebde87d</entry>
Nov 28 15:59:38 user nova-compute[75176]:       <entry name="uuid">726344c0-a0dc-48d5-a18f-8a258ebde87d</entry>
Nov 28 15:59:38 user nova-compute[75176]:       <entry name="family">Virtual Machine</entry>
Nov 28 15:59:38 user nova-compute[75176]:     </system>
Nov 28 15:59:38 user nova-compute[75176]:   </sysinfo>
Nov 28 15:59:38 user nova-compute[75176]:   <os>
Nov 28 15:59:38 user nova-compute[75176]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 15:59:38 user nova-compute[75176]:     <smbios mode="sysinfo"/>
Nov 28 15:59:38 user nova-compute[75176]:   </os>
Nov 28 15:59:38 user nova-compute[75176]:   <features>
Nov 28 15:59:38 user nova-compute[75176]:     <acpi/>
Nov 28 15:59:38 user nova-compute[75176]:     <apic/>
Nov 28 15:59:38 user nova-compute[75176]:     <vmcoreinfo/>
Nov 28 15:59:38 user nova-compute[75176]:   </features>
Nov 28 15:59:38 user nova-compute[75176]:   <clock offset="utc">
Nov 28 15:59:38 user nova-compute[75176]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 15:59:38 user nova-compute[75176]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 15:59:38 user nova-compute[75176]:     <timer name="hpet" present="no"/>
Nov 28 15:59:38 user nova-compute[75176]:   </clock>
Nov 28 15:59:38 user nova-compute[75176]:   <cpu mode="custom" match="exact">
Nov 28 15:59:38 user nova-compute[75176]:     <model>Nehalem</model>
Nov 28 15:59:38 user nova-compute[75176]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 15:59:38 user nova-compute[75176]:   </cpu>
Nov 28 15:59:38 user nova-compute[75176]:   <devices>
Nov 28 15:59:38 user nova-compute[75176]:     <disk type="file" device="disk">
Nov 28 15:59:38 user nova-compute[75176]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 15:59:38 user nova-compute[75176]:       <source file="/opt/stack/data/nova/instances/726344c0-a0dc-48d5-a18f-8a258ebde87d/disk.rescue"/>
Nov 28 15:59:38 user nova-compute[75176]:       <target dev="vda" bus="virtio"/>
Nov 28 15:59:38 user nova-compute[75176]:     </disk>
Nov 28 15:59:38 user nova-compute[75176]:     <disk type="file" device="disk">
Nov 28 15:59:38 user nova-compute[75176]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 15:59:38 user nova-compute[75176]:       <source file="/opt/stack/data/nova/instances/726344c0-a0dc-48d5-a18f-8a258ebde87d/disk"/>
Nov 28 15:59:38 user nova-compute[75176]:       <target dev="vdb" bus="virtio"/>
Nov 28 15:59:38 user nova-compute[75176]:     </disk>
Nov 28 15:59:38 user nova-compute[75176]:     <interface type="ethernet">
Nov 28 15:59:38 user nova-compute[75176]:       <mac address="fa:16:3e:0d:da:42"/>
Nov 28 15:59:38 user nova-compute[75176]:       <model type="virtio"/>
Nov 28 15:59:38 user nova-compute[75176]:       <mtu size="1442"/>
Nov 28 15:59:38 user nova-compute[75176]:       <target dev="tap966907f1-2c"/>
Nov 28 15:59:38 user nova-compute[75176]:     </interface>
Nov 28 15:59:38 user nova-compute[75176]:     <serial type="pty">
Nov 28 15:59:38 user nova-compute[75176]:       <log file="/opt/stack/data/nova/instances/726344c0-a0dc-48d5-a18f-8a258ebde87d/console.log" append="off"/>
Nov 28 15:59:38 user nova-compute[75176]:     </serial>
Nov 28 15:59:38 user nova-compute[75176]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 15:59:38 user nova-compute[75176]:     <video>
Nov 28 15:59:38 user nova-compute[75176]:       <model type="virtio"/>
Nov 28 15:59:38 user nova-compute[75176]:     </video>
Nov 28 15:59:38 user nova-compute[75176]:     <rng model="virtio">
Nov 28 15:59:38 user nova-compute[75176]:       <backend model="random">/dev/urandom</backend>
Nov 28 15:59:38 user nova-compute[75176]:     </rng>
Nov 28 15:59:38 user nova-compute[75176]:     <controller type="usb" index="0" model="none"/>
Nov 28 15:59:38 user nova-compute[75176]:     <memballoon model="virtio">
Nov 28 15:59:38 user nova-compute[75176]:       <stats period="10"/>
Nov 28 15:59:38 user nova-compute[75176]:     </memballoon>
Nov 28 15:59:38 user nova-compute[75176]:   </devices>
Nov 28 15:59:38 user nova-compute[75176]: </domain>
Nov 28 15:59:38 user nova-compute[75176]:  {{(pid=75176) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 15:59:38 user nova-compute[75176]: INFO nova.virt.libvirt.driver [-] [instance: 726344c0-a0dc-48d5-a18f-8a258ebde87d] Instance destroyed successfully.
Nov 28 15:59:38 user nova-compute[75176]: DEBUG nova.compute.provider_tree [None req-f8d39ca9-7e2d-4c76-8505-1fb74974609d tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Inventory has not changed in ProviderTree for provider: b37848d8-f401-4155-a029-b0ffa09ff85b {{(pid=75176) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 15:59:38 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-f8d39ca9-7e2d-4c76-8505-1fb74974609d tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Inventory has not changed for provider b37848d8-f401-4155-a029-b0ffa09ff85b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75176) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 15:59:38 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-f8d39ca9-7e2d-4c76-8505-1fb74974609d tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.633s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:59:38 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-bac2f8b9-ea65-48a6-9b5b-4e2411fcdce7 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] No BDM found with device name vda, not building metadata. {{(pid=75176) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 15:59:38 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-bac2f8b9-ea65-48a6-9b5b-4e2411fcdce7 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75176) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 15:59:38 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-bac2f8b9-ea65-48a6-9b5b-4e2411fcdce7 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] No VIF found with MAC fa:16:3e:0d:da:42, not building metadata {{(pid=75176) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 15:59:38 user nova-compute[75176]: INFO nova.scheduler.client.report [None req-f8d39ca9-7e2d-4c76-8505-1fb74974609d tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Deleted allocations for instance 3ae602c1-2aed-41ea-9f4c-4f3ec4aab254
Nov 28 15:59:38 user nova-compute[75176]: DEBUG nova.compute.manager [req-d8e64985-3b13-4d25-bc25-5015a31a701e req-5a757e48-7e54-4852-b00b-f318d442780c service nova] [instance: 3ae602c1-2aed-41ea-9f4c-4f3ec4aab254] Received event network-vif-plugged-dee8b036-92ce-421f-bb73-dbf92200da92 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:59:38 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-d8e64985-3b13-4d25-bc25-5015a31a701e req-5a757e48-7e54-4852-b00b-f318d442780c service nova] Acquiring lock "3ae602c1-2aed-41ea-9f4c-4f3ec4aab254-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:59:38 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-d8e64985-3b13-4d25-bc25-5015a31a701e req-5a757e48-7e54-4852-b00b-f318d442780c service nova] Lock "3ae602c1-2aed-41ea-9f4c-4f3ec4aab254-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:59:38 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-d8e64985-3b13-4d25-bc25-5015a31a701e req-5a757e48-7e54-4852-b00b-f318d442780c service nova] Lock "3ae602c1-2aed-41ea-9f4c-4f3ec4aab254-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:59:38 user nova-compute[75176]: DEBUG nova.compute.manager [req-d8e64985-3b13-4d25-bc25-5015a31a701e req-5a757e48-7e54-4852-b00b-f318d442780c service nova] [instance: 3ae602c1-2aed-41ea-9f4c-4f3ec4aab254] No waiting events found dispatching network-vif-plugged-dee8b036-92ce-421f-bb73-dbf92200da92 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:59:38 user nova-compute[75176]: WARNING nova.compute.manager [req-d8e64985-3b13-4d25-bc25-5015a31a701e req-5a757e48-7e54-4852-b00b-f318d442780c service nova] [instance: 3ae602c1-2aed-41ea-9f4c-4f3ec4aab254] Received unexpected event network-vif-plugged-dee8b036-92ce-421f-bb73-dbf92200da92 for instance with vm_state deleted and task_state None.
Nov 28 15:59:38 user nova-compute[75176]: DEBUG nova.compute.manager [req-d8e64985-3b13-4d25-bc25-5015a31a701e req-5a757e48-7e54-4852-b00b-f318d442780c service nova] [instance: 726344c0-a0dc-48d5-a18f-8a258ebde87d] Received event network-vif-unplugged-966907f1-2c5f-4c34-b155-b1b3b4176f5f {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:59:38 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-d8e64985-3b13-4d25-bc25-5015a31a701e req-5a757e48-7e54-4852-b00b-f318d442780c service nova] Acquiring lock "726344c0-a0dc-48d5-a18f-8a258ebde87d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:59:38 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-d8e64985-3b13-4d25-bc25-5015a31a701e req-5a757e48-7e54-4852-b00b-f318d442780c service nova] Lock "726344c0-a0dc-48d5-a18f-8a258ebde87d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:59:38 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-d8e64985-3b13-4d25-bc25-5015a31a701e req-5a757e48-7e54-4852-b00b-f318d442780c service nova] Lock "726344c0-a0dc-48d5-a18f-8a258ebde87d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:59:38 user nova-compute[75176]: DEBUG nova.compute.manager [req-d8e64985-3b13-4d25-bc25-5015a31a701e req-5a757e48-7e54-4852-b00b-f318d442780c service nova] [instance: 726344c0-a0dc-48d5-a18f-8a258ebde87d] No waiting events found dispatching network-vif-unplugged-966907f1-2c5f-4c34-b155-b1b3b4176f5f {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:59:38 user nova-compute[75176]: WARNING nova.compute.manager [req-d8e64985-3b13-4d25-bc25-5015a31a701e req-5a757e48-7e54-4852-b00b-f318d442780c service nova] [instance: 726344c0-a0dc-48d5-a18f-8a258ebde87d] Received unexpected event network-vif-unplugged-966907f1-2c5f-4c34-b155-b1b3b4176f5f for instance with vm_state active and task_state rescuing.
Nov 28 15:59:38 user nova-compute[75176]: DEBUG nova.compute.manager [req-d8e64985-3b13-4d25-bc25-5015a31a701e req-5a757e48-7e54-4852-b00b-f318d442780c service nova] [instance: 726344c0-a0dc-48d5-a18f-8a258ebde87d] Received event network-vif-plugged-966907f1-2c5f-4c34-b155-b1b3b4176f5f {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:59:38 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-d8e64985-3b13-4d25-bc25-5015a31a701e req-5a757e48-7e54-4852-b00b-f318d442780c service nova] Acquiring lock "726344c0-a0dc-48d5-a18f-8a258ebde87d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:59:38 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-d8e64985-3b13-4d25-bc25-5015a31a701e req-5a757e48-7e54-4852-b00b-f318d442780c service nova] Lock "726344c0-a0dc-48d5-a18f-8a258ebde87d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:59:38 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-d8e64985-3b13-4d25-bc25-5015a31a701e req-5a757e48-7e54-4852-b00b-f318d442780c service nova] Lock "726344c0-a0dc-48d5-a18f-8a258ebde87d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:59:38 user nova-compute[75176]: DEBUG nova.compute.manager [req-d8e64985-3b13-4d25-bc25-5015a31a701e req-5a757e48-7e54-4852-b00b-f318d442780c service nova] [instance: 726344c0-a0dc-48d5-a18f-8a258ebde87d] No waiting events found dispatching network-vif-plugged-966907f1-2c5f-4c34-b155-b1b3b4176f5f {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:59:38 user nova-compute[75176]: WARNING nova.compute.manager [req-d8e64985-3b13-4d25-bc25-5015a31a701e req-5a757e48-7e54-4852-b00b-f318d442780c service nova] [instance: 726344c0-a0dc-48d5-a18f-8a258ebde87d] Received unexpected event network-vif-plugged-966907f1-2c5f-4c34-b155-b1b3b4176f5f for instance with vm_state active and task_state rescuing.
Nov 28 15:59:38 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-f8d39ca9-7e2d-4c76-8505-1fb74974609d tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Lock "3ae602c1-2aed-41ea-9f4c-4f3ec4aab254" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.654s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:59:39 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:59:39 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:59:39 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:59:39 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:59:39 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:59:40 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:59:40 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:59:40 user nova-compute[75176]: DEBUG nova.compute.manager [req-39644014-b251-4697-957a-3eec058aa9df req-68e4f796-4fde-4ed4-8b91-88a3c6961d2a service nova] [instance: 726344c0-a0dc-48d5-a18f-8a258ebde87d] Received event network-vif-plugged-966907f1-2c5f-4c34-b155-b1b3b4176f5f {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:59:40 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-39644014-b251-4697-957a-3eec058aa9df req-68e4f796-4fde-4ed4-8b91-88a3c6961d2a service nova] Acquiring lock "726344c0-a0dc-48d5-a18f-8a258ebde87d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:59:40 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-39644014-b251-4697-957a-3eec058aa9df req-68e4f796-4fde-4ed4-8b91-88a3c6961d2a service nova] Lock "726344c0-a0dc-48d5-a18f-8a258ebde87d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:59:40 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-39644014-b251-4697-957a-3eec058aa9df req-68e4f796-4fde-4ed4-8b91-88a3c6961d2a service nova] Lock "726344c0-a0dc-48d5-a18f-8a258ebde87d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:59:40 user nova-compute[75176]: DEBUG nova.compute.manager [req-39644014-b251-4697-957a-3eec058aa9df req-68e4f796-4fde-4ed4-8b91-88a3c6961d2a service nova] [instance: 726344c0-a0dc-48d5-a18f-8a258ebde87d] No waiting events found dispatching network-vif-plugged-966907f1-2c5f-4c34-b155-b1b3b4176f5f {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:59:40 user nova-compute[75176]: WARNING nova.compute.manager [req-39644014-b251-4697-957a-3eec058aa9df req-68e4f796-4fde-4ed4-8b91-88a3c6961d2a service nova] [instance: 726344c0-a0dc-48d5-a18f-8a258ebde87d] Received unexpected event network-vif-plugged-966907f1-2c5f-4c34-b155-b1b3b4176f5f for instance with vm_state active and task_state rescuing.
Nov 28 15:59:40 user nova-compute[75176]: DEBUG nova.compute.manager [req-39644014-b251-4697-957a-3eec058aa9df req-68e4f796-4fde-4ed4-8b91-88a3c6961d2a service nova] [instance: 726344c0-a0dc-48d5-a18f-8a258ebde87d] Received event network-vif-plugged-966907f1-2c5f-4c34-b155-b1b3b4176f5f {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 15:59:40 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-39644014-b251-4697-957a-3eec058aa9df req-68e4f796-4fde-4ed4-8b91-88a3c6961d2a service nova] Acquiring lock "726344c0-a0dc-48d5-a18f-8a258ebde87d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:59:40 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-39644014-b251-4697-957a-3eec058aa9df req-68e4f796-4fde-4ed4-8b91-88a3c6961d2a service nova] Lock "726344c0-a0dc-48d5-a18f-8a258ebde87d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:59:40 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-39644014-b251-4697-957a-3eec058aa9df req-68e4f796-4fde-4ed4-8b91-88a3c6961d2a service nova] Lock "726344c0-a0dc-48d5-a18f-8a258ebde87d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:59:40 user nova-compute[75176]: DEBUG nova.compute.manager [req-39644014-b251-4697-957a-3eec058aa9df req-68e4f796-4fde-4ed4-8b91-88a3c6961d2a service nova] [instance: 726344c0-a0dc-48d5-a18f-8a258ebde87d] No waiting events found dispatching network-vif-plugged-966907f1-2c5f-4c34-b155-b1b3b4176f5f {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 15:59:40 user nova-compute[75176]: WARNING nova.compute.manager [req-39644014-b251-4697-957a-3eec058aa9df req-68e4f796-4fde-4ed4-8b91-88a3c6961d2a service nova] [instance: 726344c0-a0dc-48d5-a18f-8a258ebde87d] Received unexpected event network-vif-plugged-966907f1-2c5f-4c34-b155-b1b3b4176f5f for instance with vm_state active and task_state rescuing.
Nov 28 15:59:41 user nova-compute[75176]: DEBUG nova.compute.manager [None req-bac2f8b9-ea65-48a6-9b5b-4e2411fcdce7 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] [instance: 726344c0-a0dc-48d5-a18f-8a258ebde87d] Checking state {{(pid=75176) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 15:59:41 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:59:44 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:59:46 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:59:51 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:59:51 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:59:51 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75176) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 15:59:51 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75176) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 15:59:51 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75176) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 15:59:51 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:59:56 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 15:59:57 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:59:57 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75176) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 15:59:57 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75176) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 15:59:57 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75176) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 15:59:57 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:59:57 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:59:58 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 15:59:59 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-fdfc86d7-c35d-4cb8-b894-06b471ba9fd6 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Acquiring lock "e0b7a064-03b6-4a0d-88be-2f12c12a1ddb" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:59:59 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-fdfc86d7-c35d-4cb8-b894-06b471ba9fd6 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Lock "e0b7a064-03b6-4a0d-88be-2f12c12a1ddb" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:59:59 user nova-compute[75176]: DEBUG nova.objects.instance [None req-fdfc86d7-c35d-4cb8-b894-06b471ba9fd6 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Lazy-loading 'flavor' on Instance uuid e0b7a064-03b6-4a0d-88be-2f12c12a1ddb {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 15:59:59 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-fdfc86d7-c35d-4cb8-b894-06b471ba9fd6 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Lock "e0b7a064-03b6-4a0d-88be-2f12c12a1ddb" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 15:59:59 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 15:59:59 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-fdfc86d7-c35d-4cb8-b894-06b471ba9fd6 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Acquiring lock "e0b7a064-03b6-4a0d-88be-2f12c12a1ddb" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 15:59:59 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-fdfc86d7-c35d-4cb8-b894-06b471ba9fd6 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Lock "e0b7a064-03b6-4a0d-88be-2f12c12a1ddb" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 15:59:59 user nova-compute[75176]: INFO nova.compute.manager [None req-fdfc86d7-c35d-4cb8-b894-06b471ba9fd6 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] [instance: e0b7a064-03b6-4a0d-88be-2f12c12a1ddb] Attaching volume 99552fd5-8d2b-4678-b859-a29382696bf5 to /dev/vdb
Nov 28 15:59:59 user nova-compute[75176]: DEBUG os_brick.utils [None req-fdfc86d7-c35d-4cb8-b894-06b471ba9fd6 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 15:59:59 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 15:59:59 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 15:59:59 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[c52f1328-c9e5-4aff-b40c-e104e06617d8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:edc924a949b2\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 15:59:59 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:00:00 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:00:00 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[5384d40c-2685-4b49-b0b7-edd28783d78a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:00:00 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:00:00 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:00:00 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[a92b5c60-1444-4c75-a989-44e06b16d95e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:00:00 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[406f195a-c242-452d-8f99-0f61de63da25]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:00:00 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-fdfc86d7-c35d-4cb8-b894-06b471ba9fd6 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Running cmd (subprocess): nvme version {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:00:00 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-fdfc86d7-c35d-4cb8-b894-06b471ba9fd6 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] 'nvme version' failed. Not Retrying. {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 16:00:00 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fdfc86d7-c35d-4cb8-b894-06b471ba9fd6 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] nvme not present on system {{(pid=75176) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 16:00:00 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:00:00 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 16:00:00 user nova-compute[75176]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 16:00:00 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[c91d3cb7-2b80-4ac0-ba23-d2e280c8c8b7]: (4, '') {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:00:00 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.lightos [None req-fdfc86d7-c35d-4cb8-b894-06b471ba9fd6 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75176) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 16:00:00 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.lightos [None req-fdfc86d7-c35d-4cb8-b894-06b471ba9fd6 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75176) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 16:00:00 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.lightos [None req-fdfc86d7-c35d-4cb8-b894-06b471ba9fd6 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] LIGHTOS: no hostnqn found. {{(pid=75176) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 16:00:00 user nova-compute[75176]: DEBUG os_brick.utils [None req-fdfc86d7-c35d-4cb8-b894-06b471ba9fd6 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:edc924a949b2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 16:00:00 user nova-compute[75176]: DEBUG nova.virt.block_device [None req-fdfc86d7-c35d-4cb8-b894-06b471ba9fd6 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] [instance: e0b7a064-03b6-4a0d-88be-2f12c12a1ddb] Updating existing volume attachment record: 15db39e6-23d3-4388-ab5b-c911f4a1d019 {{(pid=75176) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 16:00:01 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:00:02 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:00:02 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:00:02 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Cleaning up deleted instances {{(pid=75176) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 28 16:00:02 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] There are 0 instances to clean {{(pid=75176) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 28 16:00:04 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:00:04 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:00:05 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:00:06 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:00:06 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75176) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 16:00:06 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:00:06 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75176) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 28 16:00:07 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:00:07 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:00:07 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Starting heal instance info cache {{(pid=75176) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 16:00:07 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquiring lock "refresh_cache-55febf04-14ea-4903-8692-c7cc6115de75" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 16:00:07 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquired lock "refresh_cache-55febf04-14ea-4903-8692-c7cc6115de75" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 16:00:07 user nova-compute[75176]: DEBUG nova.network.neutron [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] [instance: 55febf04-14ea-4903-8692-c7cc6115de75] Forcefully refreshing network info cache for instance {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 16:00:08 user nova-compute[75176]: DEBUG nova.network.neutron [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] [instance: 55febf04-14ea-4903-8692-c7cc6115de75] Updating instance_info_cache with network_info: [{"id": "e287ec1a-3726-4719-94b2-79764f7abd31", "address": "fa:16:3e:0c:d1:2f", "network": {"id": "d47c1797-a66f-4f2d-b83e-903b5bd3251c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1416388789-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd2856ce0a2545cda0b796eb0be10a40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape287ec1a-37", "ovs_interfaceid": "e287ec1a-3726-4719-94b2-79764f7abd31", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 16:00:08 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Releasing lock "refresh_cache-55febf04-14ea-4903-8692-c7cc6115de75" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 16:00:08 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] [instance: 55febf04-14ea-4903-8692-c7cc6115de75] Updated the network info_cache for instance {{(pid=75176) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 16:00:08 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:00:09 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:00:10 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fdfc86d7-c35d-4cb8-b894-06b471ba9fd6 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] [instance: e0b7a064-03b6-4a0d-88be-2f12c12a1ddb] Calling os-brick to attach iSCSI Volume {{(pid=75176) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 16:00:10 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdfc86d7-c35d-4cb8-b894-06b471ba9fd6 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c1b8a00>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:99552fd5-8d2b-4678-b859-a29382696bf5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jRoFxlMc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 16:00:10 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-fdfc86d7-c35d-4cb8-b894-06b471ba9fd6 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 16:00:10 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-fdfc86d7-c35d-4cb8-b894-06b471ba9fd6 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 16:00:10 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-fdfc86d7-c35d-4cb8-b894-06b471ba9fd6 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 16:00:10 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-fdfc86d7-c35d-4cb8-b894-06b471ba9fd6 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 16:00:10 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-fdfc86d7-c35d-4cb8-b894-06b471ba9fd6 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:99552fd5-8d2b-4678-b859-a29382696bf5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 16:00:10 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-fdfc86d7-c35d-4cb8-b894-06b471ba9fd6 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:99552fd5-8d2b-4678-b859-a29382696bf5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 16:00:10 user nova-compute[75176]: INFO os_brick.initiator.connectors.iscsi [None req-fdfc86d7-c35d-4cb8-b894-06b471ba9fd6 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 16:00:10 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99552fd5-8d2b-4678-b859-a29382696bf5 -p 172.16.0.220:3260 {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:00:10 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99552fd5-8d2b-4678-b859-a29382696bf5 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:00:10 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[40335c3b-dddd-4863-b13f-3aebb5fc6c35]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:00:10 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdfc86d7-c35d-4cb8-b894-06b471ba9fd6 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 16:00:10 user nova-compute[75176]:  {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 16:00:10 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99552fd5-8d2b-4678-b859-a29382696bf5 -p 172.16.0.220:3260 --interface default --op new {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:00:10 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99552fd5-8d2b-4678-b859-a29382696bf5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:00:10 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5234991-9d4b-42e2-bbe9-7471775d0d39]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:99552fd5-8d2b-4678-b859-a29382696bf5] added\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:00:10 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdfc86d7-c35d-4cb8-b894-06b471ba9fd6 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:99552fd5-8d2b-4678-b859-a29382696bf5] added
Nov 28 16:00:10 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 16:00:10 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99552fd5-8d2b-4678-b859-a29382696bf5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:00:10 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99552fd5-8d2b-4678-b859-a29382696bf5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:00:10 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c624f26-65a2-40e1-8047-a71298504bc8]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:00:10 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdfc86d7-c35d-4cb8-b894-06b471ba9fd6 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 16:00:10 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99552fd5-8d2b-4678-b859-a29382696bf5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:00:10 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99552fd5-8d2b-4678-b859-a29382696bf5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:00:10 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[01f0d56f-489b-42cf-ad13-dff75aa95612]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:00:10 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdfc86d7-c35d-4cb8-b894-06b471ba9fd6 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 16:00:10 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99552fd5-8d2b-4678-b859-a29382696bf5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jRoFxlMc {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:00:10 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99552fd5-8d2b-4678-b859-a29382696bf5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jRoFxlMc" returned: 0 in 0.020s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:00:10 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[b74841cb-48ef-48d0-8de9-b425f0e5c6fd]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:00:10 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdfc86d7-c35d-4cb8-b894-06b471ba9fd6 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jRoFxlMc'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 16:00:10 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99552fd5-8d2b-4678-b859-a29382696bf5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:00:10 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99552fd5-8d2b-4678-b859-a29382696bf5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:00:10 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[00ab4067-e597-42c9-adf2-d199700b812a]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:00:10 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdfc86d7-c35d-4cb8-b894-06b471ba9fd6 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 16:00:10 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:00:10 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:00:10 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2905fdd-2fab-4285-b54a-1710d15c511e]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a0ac2c4-a491-487c-b957-f46813dd109d (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b1a81f9-4a84-4f9e-9b1a-86b0c17ed81c (non-flash)\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:00:10 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdfc86d7-c35d-4cb8-b894-06b471ba9fd6 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 (non-flash)
Nov 28 16:00:10 user nova-compute[75176]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0 (non-flash)
Nov 28 16:00:10 user nova-compute[75176]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a0ac2c4-a491-487c-b957-f46813dd109d (non-flash)
Nov 28 16:00:10 user nova-compute[75176]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b1a81f9-4a84-4f9e-9b1a-86b0c17ed81c (non-flash)
Nov 28 16:00:10 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 16:00:10 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdfc86d7-c35d-4cb8-b894-06b471ba9fd6 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 (non-flash)
Nov 28 16:00:10 user nova-compute[75176]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0 (non-flash)
Nov 28 16:00:10 user nova-compute[75176]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a0ac2c4-a491-487c-b957-f46813dd109d (non-flash)
Nov 28 16:00:10 user nova-compute[75176]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b1a81f9-4a84-4f9e-9b1a-86b0c17ed81c (non-flash)
Nov 28 16:00:10 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 16:00:10 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99552fd5-8d2b-4678-b859-a29382696bf5 -p 172.16.0.220:3260 --login {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:00:10 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99552fd5-8d2b-4678-b859-a29382696bf5 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:00:10 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[baa2847f-cf58-4593-8124-7748ee27f0a4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:99552fd5-8d2b-4678-b859-a29382696bf5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:99552fd5-8d2b-4678-b859-a29382696bf5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:00:10 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdfc86d7-c35d-4cb8-b894-06b471ba9fd6 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:99552fd5-8d2b-4678-b859-a29382696bf5, portal: 172.16.0.220,3260]
Nov 28 16:00:10 user nova-compute[75176]: Login to [iface: default, target: iqn.2010-10.org.openstack:99552fd5-8d2b-4678-b859-a29382696bf5, portal: 172.16.0.220,3260] successful.
Nov 28 16:00:10 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 16:00:10 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99552fd5-8d2b-4678-b859-a29382696bf5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:00:10 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99552fd5-8d2b-4678-b859-a29382696bf5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:00:10 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[35a584a8-240d-48b2-becc-9448f5f110d6]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:00:10 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdfc86d7-c35d-4cb8-b894-06b471ba9fd6 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 16:00:10 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:00:10 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:00:10 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[9337fff3-1af0-41b9-aadd-0eb5c3cf45d3]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a0ac2c4-a491-487c-b957-f46813dd109d (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b1a81f9-4a84-4f9e-9b1a-86b0c17ed81c (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99552fd5-8d2b-4678-b859-a29382696bf5 (non-flash)\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:00:10 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdfc86d7-c35d-4cb8-b894-06b471ba9fd6 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 (non-flash)
Nov 28 16:00:10 user nova-compute[75176]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0 (non-flash)
Nov 28 16:00:10 user nova-compute[75176]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a0ac2c4-a491-487c-b957-f46813dd109d (non-flash)
Nov 28 16:00:10 user nova-compute[75176]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b1a81f9-4a84-4f9e-9b1a-86b0c17ed81c (non-flash)
Nov 28 16:00:10 user nova-compute[75176]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99552fd5-8d2b-4678-b859-a29382696bf5 (non-flash)
Nov 28 16:00:10 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 16:00:10 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdfc86d7-c35d-4cb8-b894-06b471ba9fd6 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 (non-flash)
Nov 28 16:00:10 user nova-compute[75176]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0 (non-flash)
Nov 28 16:00:10 user nova-compute[75176]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a0ac2c4-a491-487c-b957-f46813dd109d (non-flash)
Nov 28 16:00:10 user nova-compute[75176]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b1a81f9-4a84-4f9e-9b1a-86b0c17ed81c (non-flash)
Nov 28 16:00:10 user nova-compute[75176]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99552fd5-8d2b-4678-b859-a29382696bf5 (non-flash)
Nov 28 16:00:10 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 16:00:10 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-fdfc86d7-c35d-4cb8-b894-06b471ba9fd6 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:99552fd5-8d2b-4678-b859-a29382696bf5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.295s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 16:00:10 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdfc86d7-c35d-4cb8-b894-06b471ba9fd6 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Connected to 172.16.0.220:3260 {{(pid=75176) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 16:00:10 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-fdfc86d7-c35d-4cb8-b894-06b471ba9fd6 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] HCTL ('37', '-', '-', 0) found on session 56 with lun 0 {{(pid=75176) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 16:00:10 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-fdfc86d7-c35d-4cb8-b894-06b471ba9fd6 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75176) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 16:00:10 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:00:10 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.016s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:00:10 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[be6828cf-7878-49a1-be86-1e6fc9393b49]: (4, ('- - 0', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:00:10 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-fdfc86d7-c35d-4cb8-b894-06b471ba9fd6 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Searching for a device in session 56 and hctl ['37', '*', '*', 0] yield: None {{(pid=75176) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 16:00:11 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-fdfc86d7-c35d-4cb8-b894-06b471ba9fd6 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Searching for a device in session 56 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75176) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 16:00:11 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdfc86d7-c35d-4cb8-b894-06b471ba9fd6 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:99552fd5-8d2b-4678-b859-a29382696bf5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jRoFxlMc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75176) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 16:00:11 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-fdfc86d7-c35d-4cb8-b894-06b471ba9fd6 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.325s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 16:00:11 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdfc86d7-c35d-4cb8-b894-06b471ba9fd6 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] <== connect_volume: return (1326ms) {'type': 'block', 'scsi_wwn': '23362343161396435', 'path': '/dev/sdf'} {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 16:00:11 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fdfc86d7-c35d-4cb8-b894-06b471ba9fd6 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] [instance: e0b7a064-03b6-4a0d-88be-2f12c12a1ddb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23362343161396435', 'path': '/dev/sdf'} {{(pid=75176) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 16:00:11 user nova-compute[75176]: DEBUG nova.objects.instance [None req-fdfc86d7-c35d-4cb8-b894-06b471ba9fd6 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Lazy-loading 'flavor' on Instance uuid e0b7a064-03b6-4a0d-88be-2f12c12a1ddb {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 16:00:11 user nova-compute[75176]: DEBUG nova.virt.libvirt.guest [None req-fdfc86d7-c35d-4cb8-b894-06b471ba9fd6 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 16:00:11 user nova-compute[75176]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 16:00:11 user nova-compute[75176]:   <source dev="/dev/sdf"/>
Nov 28 16:00:11 user nova-compute[75176]:   <target dev="vdb" bus="virtio"/>
Nov 28 16:00:11 user nova-compute[75176]:   <serial>99552fd5-8d2b-4678-b859-a29382696bf5</serial>
Nov 28 16:00:11 user nova-compute[75176]: </disk>
Nov 28 16:00:11 user nova-compute[75176]:  {{(pid=75176) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 16:00:11 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-fdfc86d7-c35d-4cb8-b894-06b471ba9fd6 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] No BDM found with device name vda, not building metadata. {{(pid=75176) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 16:00:11 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-fdfc86d7-c35d-4cb8-b894-06b471ba9fd6 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75176) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 16:00:11 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-fdfc86d7-c35d-4cb8-b894-06b471ba9fd6 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] No VIF found with MAC fa:16:3e:92:22:dd, not building metadata {{(pid=75176) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 16:00:12 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:00:12 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-fdfc86d7-c35d-4cb8-b894-06b471ba9fd6 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Lock "e0b7a064-03b6-4a0d-88be-2f12c12a1ddb" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.199s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:00:12 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:00:12 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:00:12 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:00:12 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:00:12 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Auditing locally available compute resources for user (node: user) {{(pid=75176) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 16:00:12 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55febf04-14ea-4903-8692-c7cc6115de75/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:00:13 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55febf04-14ea-4903-8692-c7cc6115de75/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:00:13 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55febf04-14ea-4903-8692-c7cc6115de75/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:00:13 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55febf04-14ea-4903-8692-c7cc6115de75/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:00:13 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecf38787-0a69-4f35-b121-3dc6e70023a1/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:00:13 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecf38787-0a69-4f35-b121-3dc6e70023a1/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:00:13 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecf38787-0a69-4f35-b121-3dc6e70023a1/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:00:13 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecf38787-0a69-4f35-b121-3dc6e70023a1/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:00:13 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecabea76-6c29-412d-bf77-989917b449a9/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:00:13 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecabea76-6c29-412d-bf77-989917b449a9/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:00:13 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecabea76-6c29-412d-bf77-989917b449a9/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:00:13 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecabea76-6c29-412d-bf77-989917b449a9/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:00:13 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0b7a064-03b6-4a0d-88be-2f12c12a1ddb/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:00:14 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0b7a064-03b6-4a0d-88be-2f12c12a1ddb/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:00:14 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0b7a064-03b6-4a0d-88be-2f12c12a1ddb/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:00:14 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0b7a064-03b6-4a0d-88be-2f12c12a1ddb/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:00:14 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75176) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 16:00:14 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75176) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 16:00:14 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-145c6dcd-056f-43f2-9534-6629b0759b06 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Acquiring lock "e0b7a064-03b6-4a0d-88be-2f12c12a1ddb" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:00:14 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-145c6dcd-056f-43f2-9534-6629b0759b06 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Lock "e0b7a064-03b6-4a0d-88be-2f12c12a1ddb" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:00:14 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75176) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 16:00:14 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66ead7d-98f4-4822-9dce-f2ea0206a58d/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:00:14 user nova-compute[75176]: INFO nova.compute.manager [None req-145c6dcd-056f-43f2-9534-6629b0759b06 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] [instance: e0b7a064-03b6-4a0d-88be-2f12c12a1ddb] Detaching volume 99552fd5-8d2b-4678-b859-a29382696bf5
Nov 28 16:00:14 user nova-compute[75176]: INFO nova.virt.block_device [None req-145c6dcd-056f-43f2-9534-6629b0759b06 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] [instance: e0b7a064-03b6-4a0d-88be-2f12c12a1ddb] Attempting to driver detach volume 99552fd5-8d2b-4678-b859-a29382696bf5 from mountpoint /dev/vdb
Nov 28 16:00:14 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-145c6dcd-056f-43f2-9534-6629b0759b06 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Attempting to detach device vdb from instance e0b7a064-03b6-4a0d-88be-2f12c12a1ddb from the persistent domain config. {{(pid=75176) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 16:00:14 user nova-compute[75176]: DEBUG nova.virt.libvirt.guest [None req-145c6dcd-056f-43f2-9534-6629b0759b06 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 16:00:14 user nova-compute[75176]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 16:00:14 user nova-compute[75176]:   <source dev="/dev/sdf"/>
Nov 28 16:00:14 user nova-compute[75176]:   <target dev="vdb" bus="virtio"/>
Nov 28 16:00:14 user nova-compute[75176]:   <serial>99552fd5-8d2b-4678-b859-a29382696bf5</serial>
Nov 28 16:00:14 user nova-compute[75176]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 16:00:14 user nova-compute[75176]: </disk>
Nov 28 16:00:14 user nova-compute[75176]:  {{(pid=75176) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 16:00:14 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-145c6dcd-056f-43f2-9534-6629b0759b06 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Successfully detached device vdb from instance e0b7a064-03b6-4a0d-88be-2f12c12a1ddb from the persistent domain config.
Nov 28 16:00:14 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-145c6dcd-056f-43f2-9534-6629b0759b06 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e0b7a064-03b6-4a0d-88be-2f12c12a1ddb from the live domain config. {{(pid=75176) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 16:00:14 user nova-compute[75176]: DEBUG nova.virt.libvirt.guest [None req-145c6dcd-056f-43f2-9534-6629b0759b06 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 16:00:14 user nova-compute[75176]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 16:00:14 user nova-compute[75176]:   <source dev="/dev/sdf"/>
Nov 28 16:00:14 user nova-compute[75176]:   <target dev="vdb" bus="virtio"/>
Nov 28 16:00:14 user nova-compute[75176]:   <serial>99552fd5-8d2b-4678-b859-a29382696bf5</serial>
Nov 28 16:00:14 user nova-compute[75176]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 16:00:14 user nova-compute[75176]: </disk>
Nov 28 16:00:14 user nova-compute[75176]:  {{(pid=75176) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 16:00:14 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66ead7d-98f4-4822-9dce-f2ea0206a58d/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:00:14 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66ead7d-98f4-4822-9dce-f2ea0206a58d/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:00:14 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:00:14 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66ead7d-98f4-4822-9dce-f2ea0206a58d/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:00:14 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7/disk.rescue --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:00:14 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:00:14 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7/disk.rescue --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:00:15 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-145c6dcd-056f-43f2-9534-6629b0759b06 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e0b7a064-03b6-4a0d-88be-2f12c12a1ddb {{(pid=75176) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 16:00:15 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:00:15 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:00:15 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:00:15 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:00:15 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:00:15 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75176) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 16:00:15 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/726344c0-a0dc-48d5-a18f-8a258ebde87d/disk.rescue --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:00:15 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:00:15 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/726344c0-a0dc-48d5-a18f-8a258ebde87d/disk.rescue --force-share --output=json" returned: 0 in 0.196s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:00:15 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/726344c0-a0dc-48d5-a18f-8a258ebde87d/disk.rescue --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:00:15 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/726344c0-a0dc-48d5-a18f-8a258ebde87d/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:00:15 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] skipping disk /opt/stack/data/nova/instances/726344c0-a0dc-48d5-a18f-8a258ebde87d/disk (vdb) as it is a volume {{(pid=75176) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 16:00:16 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 16:00:16 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 16:00:16 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Hypervisor/Node resource view: name=user free_ram=7768MB free_disk=24.779911041259766GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75176) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 16:00:16 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:00:16 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:00:16 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance f66ead7d-98f4-4822-9dce-f2ea0206a58d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 16:00:16 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance 55febf04-14ea-4903-8692-c7cc6115de75 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 16:00:16 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance 8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 16:00:16 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance dc4e6d39-adfb-4d26-afef-46f316ff7846 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 16:00:16 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance ecabea76-6c29-412d-bf77-989917b449a9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 16:00:16 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance e0b7a064-03b6-4a0d-88be-2f12c12a1ddb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 16:00:16 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance 525c3cc4-9cc4-470b-bf72-5e53d80cea6f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 16:00:16 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance ecf38787-0a69-4f35-b121-3dc6e70023a1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 16:00:16 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance 726344c0-a0dc-48d5-a18f-8a258ebde87d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 16:00:16 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance 216e9ce3-28d7-4282-ae91-3aa6282626e1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 16:00:16 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75176) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 16:00:16 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75176) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 16:00:16 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Refreshing inventories for resource provider b37848d8-f401-4155-a029-b0ffa09ff85b {{(pid=75176) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 28 16:00:16 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Updating ProviderTree inventory for provider b37848d8-f401-4155-a029-b0ffa09ff85b from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75176) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 28 16:00:16 user nova-compute[75176]: DEBUG nova.compute.provider_tree [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Updating inventory in ProviderTree for provider b37848d8-f401-4155-a029-b0ffa09ff85b with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75176) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 28 16:00:16 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Refreshing aggregate associations for resource provider b37848d8-f401-4155-a029-b0ffa09ff85b, aggregates: None {{(pid=75176) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 28 16:00:16 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Refreshing trait associations for resource provider b37848d8-f401-4155-a029-b0ffa09ff85b, traits: COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_RESCUE_BFV,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NODE,HW_CPU_X86_SSSE3,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE42,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE2,COMPUTE_ACCELERATORS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VIRTIO {{(pid=75176) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 28 16:00:17 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:00:17 user nova-compute[75176]: DEBUG nova.compute.provider_tree [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Inventory has not changed in ProviderTree for provider: b37848d8-f401-4155-a029-b0ffa09ff85b {{(pid=75176) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 16:00:17 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Inventory has not changed for provider b37848d8-f401-4155-a029-b0ffa09ff85b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75176) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 16:00:17 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Compute_service record updated for user:user {{(pid=75176) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 16:00:17 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.782s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:00:19 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:00:22 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 16:00:22 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 16:00:22 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75176) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 16:00:22 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75176) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 16:00:22 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75176) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 16:00:22 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:00:26 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:00:27 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:00:29 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-fbc17638-4ec2-4a5d-9f50-c32cf02d057e tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Acquiring lock "1062234d-4890-46df-bb52-49c55b4af32b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:00:29 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-fbc17638-4ec2-4a5d-9f50-c32cf02d057e tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Lock "1062234d-4890-46df-bb52-49c55b4af32b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:00:29 user nova-compute[75176]: DEBUG nova.compute.manager [None req-fbc17638-4ec2-4a5d-9f50-c32cf02d057e tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: 1062234d-4890-46df-bb52-49c55b4af32b] Starting instance... {{(pid=75176) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 16:00:29 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-fbc17638-4ec2-4a5d-9f50-c32cf02d057e tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:00:29 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-fbc17638-4ec2-4a5d-9f50-c32cf02d057e tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:00:29 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-fbc17638-4ec2-4a5d-9f50-c32cf02d057e tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75176) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 16:00:29 user nova-compute[75176]: INFO nova.compute.claims [None req-fbc17638-4ec2-4a5d-9f50-c32cf02d057e tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: 1062234d-4890-46df-bb52-49c55b4af32b] Claim successful on node user
Nov 28 16:00:30 user nova-compute[75176]: DEBUG nova.compute.provider_tree [None req-fbc17638-4ec2-4a5d-9f50-c32cf02d057e tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Inventory has not changed in ProviderTree for provider: b37848d8-f401-4155-a029-b0ffa09ff85b {{(pid=75176) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 16:00:30 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-fbc17638-4ec2-4a5d-9f50-c32cf02d057e tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Inventory has not changed for provider b37848d8-f401-4155-a029-b0ffa09ff85b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75176) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 16:00:30 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-fbc17638-4ec2-4a5d-9f50-c32cf02d057e tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.553s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:00:30 user nova-compute[75176]: DEBUG nova.compute.manager [None req-fbc17638-4ec2-4a5d-9f50-c32cf02d057e tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: 1062234d-4890-46df-bb52-49c55b4af32b] Start building networks asynchronously for instance. {{(pid=75176) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 16:00:30 user nova-compute[75176]: DEBUG nova.compute.manager [None req-fbc17638-4ec2-4a5d-9f50-c32cf02d057e tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: 1062234d-4890-46df-bb52-49c55b4af32b] Allocating IP information in the background. {{(pid=75176) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 16:00:30 user nova-compute[75176]: DEBUG nova.network.neutron [None req-fbc17638-4ec2-4a5d-9f50-c32cf02d057e tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: 1062234d-4890-46df-bb52-49c55b4af32b] allocate_for_instance() {{(pid=75176) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 16:00:30 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-fbc17638-4ec2-4a5d-9f50-c32cf02d057e tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: 1062234d-4890-46df-bb52-49c55b4af32b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 16:00:30 user nova-compute[75176]: DEBUG nova.compute.manager [None req-fbc17638-4ec2-4a5d-9f50-c32cf02d057e tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: 1062234d-4890-46df-bb52-49c55b4af32b] Start building block device mappings for instance. {{(pid=75176) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 16:00:30 user nova-compute[75176]: INFO nova.virt.block_device [None req-fbc17638-4ec2-4a5d-9f50-c32cf02d057e tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: 1062234d-4890-46df-bb52-49c55b4af32b] Booting with volume-backed-image 1f41819e-c93f-4dc7-b253-37a27bbbbc74 at /dev/vda
Nov 28 16:00:30 user nova-compute[75176]: DEBUG nova.policy [None req-fbc17638-4ec2-4a5d-9f50-c32cf02d057e tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f24cedac95a44bb5a9ee54cc4713945c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf05c8836b8a40de8e64c2d046ed71ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75176) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 16:00:31 user nova-compute[75176]: DEBUG nova.network.neutron [None req-fbc17638-4ec2-4a5d-9f50-c32cf02d057e tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: 1062234d-4890-46df-bb52-49c55b4af32b] Successfully created port: 3dd39a62-ef9c-4870-be88-578e41ff5013 {{(pid=75176) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 16:00:32 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 16:00:32 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 16:00:32 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75176) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 16:00:32 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75176) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 16:00:32 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75176) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 16:00:32 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:00:32 user nova-compute[75176]: DEBUG nova.network.neutron [None req-fbc17638-4ec2-4a5d-9f50-c32cf02d057e tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: 1062234d-4890-46df-bb52-49c55b4af32b] Successfully updated port: 3dd39a62-ef9c-4870-be88-578e41ff5013 {{(pid=75176) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 16:00:32 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-fbc17638-4ec2-4a5d-9f50-c32cf02d057e tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Acquiring lock "refresh_cache-1062234d-4890-46df-bb52-49c55b4af32b" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 16:00:32 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-fbc17638-4ec2-4a5d-9f50-c32cf02d057e tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Acquired lock "refresh_cache-1062234d-4890-46df-bb52-49c55b4af32b" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 16:00:32 user nova-compute[75176]: DEBUG nova.network.neutron [None req-fbc17638-4ec2-4a5d-9f50-c32cf02d057e tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: 1062234d-4890-46df-bb52-49c55b4af32b] Building network info cache for instance {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 16:00:32 user nova-compute[75176]: DEBUG nova.compute.manager [req-4714ed86-a2ba-4e26-8398-617417dac925 req-687f91d9-556e-41fe-aa32-56c9edf531c6 service nova] [instance: 1062234d-4890-46df-bb52-49c55b4af32b] Received event network-changed-3dd39a62-ef9c-4870-be88-578e41ff5013 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 16:00:32 user nova-compute[75176]: DEBUG nova.compute.manager [req-4714ed86-a2ba-4e26-8398-617417dac925 req-687f91d9-556e-41fe-aa32-56c9edf531c6 service nova] [instance: 1062234d-4890-46df-bb52-49c55b4af32b] Refreshing instance network info cache due to event network-changed-3dd39a62-ef9c-4870-be88-578e41ff5013. {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 16:00:32 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-4714ed86-a2ba-4e26-8398-617417dac925 req-687f91d9-556e-41fe-aa32-56c9edf531c6 service nova] Acquiring lock "refresh_cache-1062234d-4890-46df-bb52-49c55b4af32b" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 16:00:32 user nova-compute[75176]: DEBUG nova.network.neutron [None req-fbc17638-4ec2-4a5d-9f50-c32cf02d057e tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: 1062234d-4890-46df-bb52-49c55b4af32b] Instance cache missing network info. {{(pid=75176) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 16:00:33 user nova-compute[75176]: DEBUG nova.network.neutron [None req-fbc17638-4ec2-4a5d-9f50-c32cf02d057e tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: 1062234d-4890-46df-bb52-49c55b4af32b] Updating instance_info_cache with network_info: [{"id": "3dd39a62-ef9c-4870-be88-578e41ff5013", "address": "fa:16:3e:10:e7:45", "network": {"id": "998766cd-2e8e-4e39-add9-286086640993", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-989265510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf05c8836b8a40de8e64c2d046ed71ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dd39a62-ef", "ovs_interfaceid": "3dd39a62-ef9c-4870-be88-578e41ff5013", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 16:00:33 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-fbc17638-4ec2-4a5d-9f50-c32cf02d057e tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Releasing lock "refresh_cache-1062234d-4890-46df-bb52-49c55b4af32b" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 16:00:33 user nova-compute[75176]: DEBUG nova.compute.manager [None req-fbc17638-4ec2-4a5d-9f50-c32cf02d057e tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: 1062234d-4890-46df-bb52-49c55b4af32b] Instance network_info: |[{"id": "3dd39a62-ef9c-4870-be88-578e41ff5013", "address": "fa:16:3e:10:e7:45", "network": {"id": "998766cd-2e8e-4e39-add9-286086640993", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-989265510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf05c8836b8a40de8e64c2d046ed71ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dd39a62-ef", "ovs_interfaceid": "3dd39a62-ef9c-4870-be88-578e41ff5013", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75176) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 16:00:33 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-4714ed86-a2ba-4e26-8398-617417dac925 req-687f91d9-556e-41fe-aa32-56c9edf531c6 service nova] Acquired lock "refresh_cache-1062234d-4890-46df-bb52-49c55b4af32b" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 16:00:33 user nova-compute[75176]: DEBUG nova.network.neutron [req-4714ed86-a2ba-4e26-8398-617417dac925 req-687f91d9-556e-41fe-aa32-56c9edf531c6 service nova] [instance: 1062234d-4890-46df-bb52-49c55b4af32b] Refreshing network info cache for port 3dd39a62-ef9c-4870-be88-578e41ff5013 {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 16:00:33 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:00:33 user nova-compute[75176]: DEBUG nova.network.neutron [req-4714ed86-a2ba-4e26-8398-617417dac925 req-687f91d9-556e-41fe-aa32-56c9edf531c6 service nova] [instance: 1062234d-4890-46df-bb52-49c55b4af32b] Updated VIF entry in instance network info cache for port 3dd39a62-ef9c-4870-be88-578e41ff5013. {{(pid=75176) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 16:00:33 user nova-compute[75176]: DEBUG nova.network.neutron [req-4714ed86-a2ba-4e26-8398-617417dac925 req-687f91d9-556e-41fe-aa32-56c9edf531c6 service nova] [instance: 1062234d-4890-46df-bb52-49c55b4af32b] Updating instance_info_cache with network_info: [{"id": "3dd39a62-ef9c-4870-be88-578e41ff5013", "address": "fa:16:3e:10:e7:45", "network": {"id": "998766cd-2e8e-4e39-add9-286086640993", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-989265510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf05c8836b8a40de8e64c2d046ed71ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dd39a62-ef", "ovs_interfaceid": "3dd39a62-ef9c-4870-be88-578e41ff5013", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 16:00:33 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-4714ed86-a2ba-4e26-8398-617417dac925 req-687f91d9-556e-41fe-aa32-56c9edf531c6 service nova] Releasing lock "refresh_cache-1062234d-4890-46df-bb52-49c55b4af32b" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 16:00:34 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-5b2b2b68-b799-4265-84ad-8018c8c71643 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Acquiring lock "ecabea76-6c29-412d-bf77-989917b449a9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:00:34 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-5b2b2b68-b799-4265-84ad-8018c8c71643 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Lock "ecabea76-6c29-412d-bf77-989917b449a9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:00:34 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-5b2b2b68-b799-4265-84ad-8018c8c71643 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Acquiring lock "ecabea76-6c29-412d-bf77-989917b449a9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:00:34 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-5b2b2b68-b799-4265-84ad-8018c8c71643 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Lock "ecabea76-6c29-412d-bf77-989917b449a9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:00:34 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-5b2b2b68-b799-4265-84ad-8018c8c71643 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Lock "ecabea76-6c29-412d-bf77-989917b449a9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:00:34 user nova-compute[75176]: INFO nova.compute.manager [None req-5b2b2b68-b799-4265-84ad-8018c8c71643 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] [instance: ecabea76-6c29-412d-bf77-989917b449a9] Terminating instance
Nov 28 16:00:34 user nova-compute[75176]: DEBUG nova.compute.manager [None req-5b2b2b68-b799-4265-84ad-8018c8c71643 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] [instance: ecabea76-6c29-412d-bf77-989917b449a9] Start destroying the instance on the hypervisor. {{(pid=75176) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 16:00:34 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:00:34 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:00:34 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:00:34 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:00:34 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:00:34 user nova-compute[75176]: DEBUG nova.compute.manager [req-7deb54f7-89a1-4a16-9921-5829e70420eb req-065af41d-7acd-41dd-8396-32346c270d7c service nova] [instance: ecabea76-6c29-412d-bf77-989917b449a9] Received event network-changed-1c8a679e-a301-43a1-81fa-6a80def1bade {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 16:00:34 user nova-compute[75176]: DEBUG nova.compute.manager [req-7deb54f7-89a1-4a16-9921-5829e70420eb req-065af41d-7acd-41dd-8396-32346c270d7c service nova] [instance: ecabea76-6c29-412d-bf77-989917b449a9] Refreshing instance network info cache due to event network-changed-1c8a679e-a301-43a1-81fa-6a80def1bade. {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 16:00:34 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-7deb54f7-89a1-4a16-9921-5829e70420eb req-065af41d-7acd-41dd-8396-32346c270d7c service nova] Acquiring lock "refresh_cache-ecabea76-6c29-412d-bf77-989917b449a9" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 16:00:34 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-7deb54f7-89a1-4a16-9921-5829e70420eb req-065af41d-7acd-41dd-8396-32346c270d7c service nova] Acquired lock "refresh_cache-ecabea76-6c29-412d-bf77-989917b449a9" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 16:00:34 user nova-compute[75176]: DEBUG nova.network.neutron [req-7deb54f7-89a1-4a16-9921-5829e70420eb req-065af41d-7acd-41dd-8396-32346c270d7c service nova] [instance: ecabea76-6c29-412d-bf77-989917b449a9] Refreshing network info cache for port 1c8a679e-a301-43a1-81fa-6a80def1bade {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 16:00:34 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:00:34 user nova-compute[75176]: DEBUG nova.compute.manager [req-1bf07d5d-8f93-4a0a-b5e4-e5958ee90771 req-6f957ff6-bf20-4083-9b85-fd3c89b513da service nova] [instance: ecabea76-6c29-412d-bf77-989917b449a9] Received event network-vif-unplugged-1c8a679e-a301-43a1-81fa-6a80def1bade {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 16:00:34 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-1bf07d5d-8f93-4a0a-b5e4-e5958ee90771 req-6f957ff6-bf20-4083-9b85-fd3c89b513da service nova] Acquiring lock "ecabea76-6c29-412d-bf77-989917b449a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:00:34 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-1bf07d5d-8f93-4a0a-b5e4-e5958ee90771 req-6f957ff6-bf20-4083-9b85-fd3c89b513da service nova] Lock "ecabea76-6c29-412d-bf77-989917b449a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:00:34 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-1bf07d5d-8f93-4a0a-b5e4-e5958ee90771 req-6f957ff6-bf20-4083-9b85-fd3c89b513da service nova] Lock "ecabea76-6c29-412d-bf77-989917b449a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:00:34 user nova-compute[75176]: DEBUG nova.compute.manager [req-1bf07d5d-8f93-4a0a-b5e4-e5958ee90771 req-6f957ff6-bf20-4083-9b85-fd3c89b513da service nova] [instance: ecabea76-6c29-412d-bf77-989917b449a9] No waiting events found dispatching network-vif-unplugged-1c8a679e-a301-43a1-81fa-6a80def1bade {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 16:00:34 user nova-compute[75176]: DEBUG nova.compute.manager [req-1bf07d5d-8f93-4a0a-b5e4-e5958ee90771 req-6f957ff6-bf20-4083-9b85-fd3c89b513da service nova] [instance: ecabea76-6c29-412d-bf77-989917b449a9] Received event network-vif-unplugged-1c8a679e-a301-43a1-81fa-6a80def1bade for instance with task_state deleting. {{(pid=75176) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 16:00:35 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-145c6dcd-056f-43f2-9534-6629b0759b06 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance e0b7a064-03b6-4a0d-88be-2f12c12a1ddb is timed out.
Nov 28 16:00:35 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-145c6dcd-056f-43f2-9534-6629b0759b06 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Successfully detached device vdb from instance e0b7a064-03b6-4a0d-88be-2f12c12a1ddb from the live domain config.
Nov 28 16:00:35 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-145c6dcd-056f-43f2-9534-6629b0759b06 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] [instance: e0b7a064-03b6-4a0d-88be-2f12c12a1ddb] calling os-brick to detach iSCSI Volume {{(pid=75176) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 16:00:35 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-145c6dcd-056f-43f2-9534-6629b0759b06 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c1b8a00>, {'target_iqn': 'iqn.2010-10.org.openstack:99552fd5-8d2b-4678-b859-a29382696bf5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jRoFxlMc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 16:00:35 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-145c6dcd-056f-43f2-9534-6629b0759b06 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 16:00:35 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-145c6dcd-056f-43f2-9534-6629b0759b06 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 16:00:35 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-145c6dcd-056f-43f2-9534-6629b0759b06 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.004s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 16:00:35 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:00:35 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:00:35 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9634a15-6274-4d36-9ecb-40cb384ca470]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6a0ac2c4-a491-487c-b957-f46813dd109d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:99552fd5-8d2b-4678-b859-a29382696bf5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4b1a81f9-4a84-4f9e-9b1a-86b0c17ed81c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:00:35 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-145c6dcd-056f-43f2-9534-6629b0759b06 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 16:00:35 user nova-compute[75176]: No targets found.
Nov 28 16:00:35 user nova-compute[75176]: iSNS:
Nov 28 16:00:35 user nova-compute[75176]: No targets found.
Nov 28 16:00:35 user nova-compute[75176]: STATIC:
Nov 28 16:00:35 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:6a0ac2c4-a491-487c-b957-f46813dd109d
Nov 28 16:00:35 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 16:00:35 user nova-compute[75176]:                 Iface Name: default
Nov 28 16:00:35 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0
Nov 28 16:00:35 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 16:00:35 user nova-compute[75176]:                 Iface Name: default
Nov 28 16:00:35 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6
Nov 28 16:00:35 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 16:00:35 user nova-compute[75176]:                 Iface Name: default
Nov 28 16:00:35 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:99552fd5-8d2b-4678-b859-a29382696bf5
Nov 28 16:00:35 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 16:00:35 user nova-compute[75176]:                 Iface Name: default
Nov 28 16:00:35 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:4b1a81f9-4a84-4f9e-9b1a-86b0c17ed81c
Nov 28 16:00:35 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 16:00:35 user nova-compute[75176]:                 Iface Name: default
Nov 28 16:00:35 user nova-compute[75176]: FIRMWARE:
Nov 28 16:00:35 user nova-compute[75176]: No targets found.
Nov 28 16:00:35 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 16:00:35 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-145c6dcd-056f-43f2-9534-6629b0759b06 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 16:00:35 user nova-compute[75176]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 16:00:35 user nova-compute[75176]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75176) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 16:00:35 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-145c6dcd-056f-43f2-9534-6629b0759b06 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:99552fd5-8d2b-4678-b859-a29382696bf5', 0)] {{(pid=75176) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 16:00:35 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:00:35 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:00:35 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:00:35 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b07ec39-ba8f-4f88-8020-b914e24cf476]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4b1a81f9-4a84-4f9e-9b1a-86b0c17ed81c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6a0ac2c4-a491-487c-b957-f46813dd109d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:99552fd5-8d2b-4678-b859-a29382696bf5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:00:35 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:00:35 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:00:35 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.041s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:00:35 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[db55dccc-6689-4564-aa22-fdb56b9e76fe]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a0ac2c4-a491-487c-b957-f46813dd109d (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b1a81f9-4a84-4f9e-9b1a-86b0c17ed81c (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99552fd5-8d2b-4678-b859-a29382696bf5 (non-flash)\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:00:35 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-145c6dcd-056f-43f2-9534-6629b0759b06 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 (non-flash)
Nov 28 16:00:35 user nova-compute[75176]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0 (non-flash)
Nov 28 16:00:35 user nova-compute[75176]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a0ac2c4-a491-487c-b957-f46813dd109d (non-flash)
Nov 28 16:00:35 user nova-compute[75176]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b1a81f9-4a84-4f9e-9b1a-86b0c17ed81c (non-flash)
Nov 28 16:00:35 user nova-compute[75176]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99552fd5-8d2b-4678-b859-a29382696bf5 (non-flash)
Nov 28 16:00:35 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 16:00:35 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-145c6dcd-056f-43f2-9534-6629b0759b06 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 (non-flash)
Nov 28 16:00:35 user nova-compute[75176]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0 (non-flash)
Nov 28 16:00:35 user nova-compute[75176]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a0ac2c4-a491-487c-b957-f46813dd109d (non-flash)
Nov 28 16:00:35 user nova-compute[75176]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b1a81f9-4a84-4f9e-9b1a-86b0c17ed81c (non-flash)
Nov 28 16:00:35 user nova-compute[75176]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99552fd5-8d2b-4678-b859-a29382696bf5 (non-flash)
Nov 28 16:00:35 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 16:00:35 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-145c6dcd-056f-43f2-9534-6629b0759b06 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f462c5eb250>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:99552fd5-8d2b-4678-b859-a29382696bf5'): ({'sdf'}, set())}) {{(pid=75176) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 16:00:35 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-145c6dcd-056f-43f2-9534-6629b0759b06 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Removing single pathed devices sdf {{(pid=75176) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 16:00:35 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:00:35 user nova-compute[75176]: INFO nova.virt.libvirt.driver [-] [instance: ecabea76-6c29-412d-bf77-989917b449a9] Instance destroyed successfully.
Nov 28 16:00:35 user nova-compute[75176]: DEBUG nova.objects.instance [None req-5b2b2b68-b799-4265-84ad-8018c8c71643 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Lazy-loading 'resources' on Instance uuid ecabea76-6c29-412d-bf77-989917b449a9 {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 16:00:35 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-5b2b2b68-b799-4265-84ad-8018c8c71643 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T15:53:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-545953161',display_name='tempest-TestStampPattern-server-545953161',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-545953161',id=38,image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJDBFhGQGpvl0PzqrMCTu0nZeD/U57w9NaBED1EztO7Blxs28QRqXvlfz9rV68t1LblFY2IOCQcQRNQ31eEMoYQx8drae7GcY4KAfy8XhLJfS2RIdXJ5ySbX/yQzldJoeQ==',key_name='tempest-TestStampPattern-557159962',keypairs=<?>,launch_index=0,launched_at=2023-11-28T15:53:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c4a10ba40c844955b63cb8603dd548cf',ramdisk_id='',reservation_id='r-5rp9008j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-286689652',owner_user_name='tempest-TestStampPattern-286689652-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T15:56:38Z,user_data=None,user_id='0dcee22ed63f40fab2ee0e42f5f38e13',uuid=ecabea76-6c29-412d-bf77-989917b449a9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1c8a679e-a301-43a1-81fa-6a80def1bade", "address": "fa:16:3e:7e:b3:fc", "network": {"id": "1fd59c02-7617-4d0e-9456-84d6cc91ce3b", "bridge": "br-int", "label": "tempest-TestStampPattern-116968826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4a10ba40c844955b63cb8603dd548cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c8a679e-a3", "ovs_interfaceid": "1c8a679e-a301-43a1-81fa-6a80def1bade", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 16:00:35 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-5b2b2b68-b799-4265-84ad-8018c8c71643 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Converting VIF {"id": "1c8a679e-a301-43a1-81fa-6a80def1bade", "address": "fa:16:3e:7e:b3:fc", "network": {"id": "1fd59c02-7617-4d0e-9456-84d6cc91ce3b", "bridge": "br-int", "label": "tempest-TestStampPattern-116968826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4a10ba40c844955b63cb8603dd548cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c8a679e-a3", "ovs_interfaceid": "1c8a679e-a301-43a1-81fa-6a80def1bade", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 16:00:35 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-5b2b2b68-b799-4265-84ad-8018c8c71643 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7e:b3:fc,bridge_name='br-int',has_traffic_filtering=True,id=1c8a679e-a301-43a1-81fa-6a80def1bade,network=Network(1fd59c02-7617-4d0e-9456-84d6cc91ce3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c8a679e-a3') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 16:00:35 user nova-compute[75176]: DEBUG os_vif [None req-5b2b2b68-b799-4265-84ad-8018c8c71643 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7e:b3:fc,bridge_name='br-int',has_traffic_filtering=True,id=1c8a679e-a301-43a1-81fa-6a80def1bade,network=Network(1fd59c02-7617-4d0e-9456-84d6cc91ce3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c8a679e-a3') {{(pid=75176) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 16:00:35 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:00:35 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e16d044-242c-46fa-b795-bf36a8fc2416]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:00:35 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:00:35 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1c8a679e-a3, bridge=br-int, if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 16:00:35 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:00:35 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:00:35 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 16:00:35 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:00:35 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=791ca999-0e0f-41a8-bfd6-a71a2d382afc) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 16:00:35 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:00:35 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:00:35 user nova-compute[75176]: INFO os_vif [None req-5b2b2b68-b799-4265-84ad-8018c8c71643 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7e:b3:fc,bridge_name='br-int',has_traffic_filtering=True,id=1c8a679e-a301-43a1-81fa-6a80def1bade,network=Network(1fd59c02-7617-4d0e-9456-84d6cc91ce3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c8a679e-a3')
Nov 28 16:00:35 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-5b2b2b68-b799-4265-84ad-8018c8c71643 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] [instance: ecabea76-6c29-412d-bf77-989917b449a9] Deleting instance files /opt/stack/data/nova/instances/ecabea76-6c29-412d-bf77-989917b449a9_del
Nov 28 16:00:35 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-5b2b2b68-b799-4265-84ad-8018c8c71643 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] [instance: ecabea76-6c29-412d-bf77-989917b449a9] Deletion of /opt/stack/data/nova/instances/ecabea76-6c29-412d-bf77-989917b449a9_del complete
Nov 28 16:00:35 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.023s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:00:35 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[710d8620-96c7-434a-b4d7-1a0d8fe71c9e]: (4, ('ok\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:00:35 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-145c6dcd-056f-43f2-9534-6629b0759b06 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Flushing IO for device /dev/sdf {{(pid=75176) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 16:00:35 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:00:35 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:00:35 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[b83a83ba-5a9d-4d6d-928c-8b4267d97f04]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:00:35 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-145c6dcd-056f-43f2-9534-6629b0759b06 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75176) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 16:00:35 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:00:35 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.043s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:00:35 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dfa0d15-0c51-43f2-8684-758619ad1fb9]: (4, ('1', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:00:35 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-145c6dcd-056f-43f2-9534-6629b0759b06 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75176) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 16:00:35 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-145c6dcd-056f-43f2-9534-6629b0759b06 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] SCSI volumes sdf have been removed. {{(pid=75176) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 16:00:35 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-145c6dcd-056f-43f2-9534-6629b0759b06 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:99552fd5-8d2b-4678-b859-a29382696bf5')] {{(pid=75176) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 16:00:35 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99552fd5-8d2b-4678-b859-a29382696bf5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:00:35 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99552fd5-8d2b-4678-b859-a29382696bf5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:00:35 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[790a5105-0f89-468d-9c0a-4fc768f8561e]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:00:35 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-145c6dcd-056f-43f2-9534-6629b0759b06 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 16:00:35 user nova-compute[75176]: INFO nova.compute.manager [None req-5b2b2b68-b799-4265-84ad-8018c8c71643 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] [instance: ecabea76-6c29-412d-bf77-989917b449a9] Took 0.96 seconds to destroy the instance on the hypervisor.
Nov 28 16:00:35 user nova-compute[75176]: DEBUG oslo.service.loopingcall [None req-5b2b2b68-b799-4265-84ad-8018c8c71643 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75176) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 16:00:35 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99552fd5-8d2b-4678-b859-a29382696bf5 -p 172.16.0.220:3260 --logout {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:00:35 user nova-compute[75176]: DEBUG nova.compute.manager [-] [instance: ecabea76-6c29-412d-bf77-989917b449a9] Deallocating network for instance {{(pid=75176) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 16:00:35 user nova-compute[75176]: DEBUG nova.network.neutron [-] [instance: ecabea76-6c29-412d-bf77-989917b449a9] deallocate_for_instance() {{(pid=75176) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 16:00:35 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99552fd5-8d2b-4678-b859-a29382696bf5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:00:35 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[bae7cad7-ebbe-4ab9-99fd-0abccf724bf3]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:99552fd5-8d2b-4678-b859-a29382696bf5, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:99552fd5-8d2b-4678-b859-a29382696bf5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:00:35 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-145c6dcd-056f-43f2-9534-6629b0759b06 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:99552fd5-8d2b-4678-b859-a29382696bf5, portal: 172.16.0.220,3260]
Nov 28 16:00:35 user nova-compute[75176]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:99552fd5-8d2b-4678-b859-a29382696bf5, portal: 172.16.0.220,3260] successful.
Nov 28 16:00:35 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 16:00:35 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99552fd5-8d2b-4678-b859-a29382696bf5 -p 172.16.0.220:3260 --op delete {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:00:35 user nova-compute[75176]: DEBUG nova.network.neutron [req-7deb54f7-89a1-4a16-9921-5829e70420eb req-065af41d-7acd-41dd-8396-32346c270d7c service nova] [instance: ecabea76-6c29-412d-bf77-989917b449a9] Updated VIF entry in instance network info cache for port 1c8a679e-a301-43a1-81fa-6a80def1bade. {{(pid=75176) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 16:00:35 user nova-compute[75176]: DEBUG nova.network.neutron [req-7deb54f7-89a1-4a16-9921-5829e70420eb req-065af41d-7acd-41dd-8396-32346c270d7c service nova] [instance: ecabea76-6c29-412d-bf77-989917b449a9] Updating instance_info_cache with network_info: [{"id": "1c8a679e-a301-43a1-81fa-6a80def1bade", "address": "fa:16:3e:7e:b3:fc", "network": {"id": "1fd59c02-7617-4d0e-9456-84d6cc91ce3b", "bridge": "br-int", "label": "tempest-TestStampPattern-116968826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4a10ba40c844955b63cb8603dd548cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c8a679e-a3", "ovs_interfaceid": "1c8a679e-a301-43a1-81fa-6a80def1bade", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 16:00:35 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99552fd5-8d2b-4678-b859-a29382696bf5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:00:35 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[b504b4d7-defe-4786-bd7e-543ac0fb1efe]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:00:35 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-145c6dcd-056f-43f2-9534-6629b0759b06 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 16:00:35 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-145c6dcd-056f-43f2-9534-6629b0759b06 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.397s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 16:00:35 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-145c6dcd-056f-43f2-9534-6629b0759b06 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] <== disconnect_volume: return (401ms) None {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 16:00:35 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-145c6dcd-056f-43f2-9534-6629b0759b06 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] [instance: e0b7a064-03b6-4a0d-88be-2f12c12a1ddb] Disconnected iSCSI Volume {{(pid=75176) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 16:00:35 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-7deb54f7-89a1-4a16-9921-5829e70420eb req-065af41d-7acd-41dd-8396-32346c270d7c service nova] Releasing lock "refresh_cache-ecabea76-6c29-412d-bf77-989917b449a9" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 16:00:35 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:00:35 user nova-compute[75176]: DEBUG nova.network.neutron [-] [instance: ecabea76-6c29-412d-bf77-989917b449a9] Updating instance_info_cache with network_info: [] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 16:00:36 user nova-compute[75176]: INFO nova.compute.manager [-] [instance: ecabea76-6c29-412d-bf77-989917b449a9] Took 0.67 seconds to deallocate network for instance.
Nov 28 16:00:36 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-5b2b2b68-b799-4265-84ad-8018c8c71643 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:00:36 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-5b2b2b68-b799-4265-84ad-8018c8c71643 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:00:36 user nova-compute[75176]: DEBUG os_brick.utils [None req-fbc17638-4ec2-4a5d-9f50-c32cf02d057e tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 16:00:36 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:00:36 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:00:36 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9e15f89-b972-4ecb-b7bb-4d46a82696c0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:edc924a949b2\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:00:36 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:00:36 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:00:36 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[0603a9d6-fc64-4f62-8dc3-e0ed7d9b50b4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:00:36 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:00:36 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:00:36 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[ead1e4d9-12f4-4f3e-8ea2-8d18d1b18074]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:00:36 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0049096-1843-44ea-a199-5f83278ff788]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:00:36 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-fbc17638-4ec2-4a5d-9f50-c32cf02d057e tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Running cmd (subprocess): nvme version {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:00:36 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-fbc17638-4ec2-4a5d-9f50-c32cf02d057e tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] 'nvme version' failed. Not Retrying. {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 16:00:36 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fbc17638-4ec2-4a5d-9f50-c32cf02d057e tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] nvme not present on system {{(pid=75176) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 16:00:36 user nova-compute[75176]: DEBUG nova.objects.instance [None req-145c6dcd-056f-43f2-9534-6629b0759b06 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Lazy-loading 'flavor' on Instance uuid e0b7a064-03b6-4a0d-88be-2f12c12a1ddb {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 16:00:36 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:00:36 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 16:00:36 user nova-compute[75176]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 16:00:36 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac2b7377-fd16-437d-ae23-3697cf75ab4b]: (4, '') {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:00:36 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.lightos [None req-fbc17638-4ec2-4a5d-9f50-c32cf02d057e tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75176) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 16:00:36 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.lightos [None req-fbc17638-4ec2-4a5d-9f50-c32cf02d057e tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75176) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 16:00:36 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.lightos [None req-fbc17638-4ec2-4a5d-9f50-c32cf02d057e tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] LIGHTOS: no hostnqn found. {{(pid=75176) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 16:00:36 user nova-compute[75176]: DEBUG os_brick.utils [None req-fbc17638-4ec2-4a5d-9f50-c32cf02d057e tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:edc924a949b2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 16:00:36 user nova-compute[75176]: DEBUG nova.virt.block_device [None req-fbc17638-4ec2-4a5d-9f50-c32cf02d057e tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: 1062234d-4890-46df-bb52-49c55b4af32b] Updating existing volume attachment record: 699befcc-5f40-4437-9ca0-d26ccd12bc59 {{(pid=75176) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 16:00:36 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-145c6dcd-056f-43f2-9534-6629b0759b06 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Lock "e0b7a064-03b6-4a0d-88be-2f12c12a1ddb" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.121s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:00:36 user nova-compute[75176]: DEBUG nova.compute.provider_tree [None req-5b2b2b68-b799-4265-84ad-8018c8c71643 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Inventory has not changed in ProviderTree for provider: b37848d8-f401-4155-a029-b0ffa09ff85b {{(pid=75176) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 16:00:36 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-5b2b2b68-b799-4265-84ad-8018c8c71643 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Inventory has not changed for provider b37848d8-f401-4155-a029-b0ffa09ff85b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75176) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 16:00:36 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-5b2b2b68-b799-4265-84ad-8018c8c71643 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.529s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:00:36 user nova-compute[75176]: INFO nova.scheduler.client.report [None req-5b2b2b68-b799-4265-84ad-8018c8c71643 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Deleted allocations for instance ecabea76-6c29-412d-bf77-989917b449a9
Nov 28 16:00:36 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-5b2b2b68-b799-4265-84ad-8018c8c71643 tempest-TestStampPattern-286689652 tempest-TestStampPattern-286689652-project-member] Lock "ecabea76-6c29-412d-bf77-989917b449a9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.388s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:00:36 user nova-compute[75176]: DEBUG nova.compute.manager [req-91e7ce79-3d74-460d-82e6-bf19dec2f4d4 req-ad1089e8-765c-477a-8b1b-2602701a20b5 service nova] [instance: ecabea76-6c29-412d-bf77-989917b449a9] Received event network-vif-plugged-1c8a679e-a301-43a1-81fa-6a80def1bade {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 16:00:36 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-91e7ce79-3d74-460d-82e6-bf19dec2f4d4 req-ad1089e8-765c-477a-8b1b-2602701a20b5 service nova] Acquiring lock "ecabea76-6c29-412d-bf77-989917b449a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:00:36 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-91e7ce79-3d74-460d-82e6-bf19dec2f4d4 req-ad1089e8-765c-477a-8b1b-2602701a20b5 service nova] Lock "ecabea76-6c29-412d-bf77-989917b449a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:00:36 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-91e7ce79-3d74-460d-82e6-bf19dec2f4d4 req-ad1089e8-765c-477a-8b1b-2602701a20b5 service nova] Lock "ecabea76-6c29-412d-bf77-989917b449a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:00:36 user nova-compute[75176]: DEBUG nova.compute.manager [req-91e7ce79-3d74-460d-82e6-bf19dec2f4d4 req-ad1089e8-765c-477a-8b1b-2602701a20b5 service nova] [instance: ecabea76-6c29-412d-bf77-989917b449a9] No waiting events found dispatching network-vif-plugged-1c8a679e-a301-43a1-81fa-6a80def1bade {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 16:00:36 user nova-compute[75176]: WARNING nova.compute.manager [req-91e7ce79-3d74-460d-82e6-bf19dec2f4d4 req-ad1089e8-765c-477a-8b1b-2602701a20b5 service nova] [instance: ecabea76-6c29-412d-bf77-989917b449a9] Received unexpected event network-vif-plugged-1c8a679e-a301-43a1-81fa-6a80def1bade for instance with vm_state deleted and task_state None.
Nov 28 16:00:36 user nova-compute[75176]: DEBUG nova.compute.manager [req-91e7ce79-3d74-460d-82e6-bf19dec2f4d4 req-ad1089e8-765c-477a-8b1b-2602701a20b5 service nova] [instance: ecabea76-6c29-412d-bf77-989917b449a9] Received event network-vif-deleted-1c8a679e-a301-43a1-81fa-6a80def1bade {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 16:00:37 user nova-compute[75176]: DEBUG nova.compute.manager [req-6ae3dc03-e7ea-4a82-9919-069d29c8120a req-89416ff5-70b4-4b78-ab98-2c69359551d2 service nova] [instance: 216e9ce3-28d7-4282-ae91-3aa6282626e1] Received event network-changed-f099a41b-937c-4a91-bcc8-d194cd644485 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 16:00:37 user nova-compute[75176]: DEBUG nova.compute.manager [req-6ae3dc03-e7ea-4a82-9919-069d29c8120a req-89416ff5-70b4-4b78-ab98-2c69359551d2 service nova] [instance: 216e9ce3-28d7-4282-ae91-3aa6282626e1] Refreshing instance network info cache due to event network-changed-f099a41b-937c-4a91-bcc8-d194cd644485. {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 16:00:37 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-6ae3dc03-e7ea-4a82-9919-069d29c8120a req-89416ff5-70b4-4b78-ab98-2c69359551d2 service nova] Acquiring lock "refresh_cache-216e9ce3-28d7-4282-ae91-3aa6282626e1" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 16:00:37 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-6ae3dc03-e7ea-4a82-9919-069d29c8120a req-89416ff5-70b4-4b78-ab98-2c69359551d2 service nova] Acquired lock "refresh_cache-216e9ce3-28d7-4282-ae91-3aa6282626e1" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 16:00:37 user nova-compute[75176]: DEBUG nova.network.neutron [req-6ae3dc03-e7ea-4a82-9919-069d29c8120a req-89416ff5-70b4-4b78-ab98-2c69359551d2 service nova] [instance: 216e9ce3-28d7-4282-ae91-3aa6282626e1] Refreshing network info cache for port f099a41b-937c-4a91-bcc8-d194cd644485 {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 16:00:38 user nova-compute[75176]: DEBUG nova.network.neutron [req-6ae3dc03-e7ea-4a82-9919-069d29c8120a req-89416ff5-70b4-4b78-ab98-2c69359551d2 service nova] [instance: 216e9ce3-28d7-4282-ae91-3aa6282626e1] Updated VIF entry in instance network info cache for port f099a41b-937c-4a91-bcc8-d194cd644485. {{(pid=75176) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 16:00:38 user nova-compute[75176]: DEBUG nova.network.neutron [req-6ae3dc03-e7ea-4a82-9919-069d29c8120a req-89416ff5-70b4-4b78-ab98-2c69359551d2 service nova] [instance: 216e9ce3-28d7-4282-ae91-3aa6282626e1] Updating instance_info_cache with network_info: [{"id": "f099a41b-937c-4a91-bcc8-d194cd644485", "address": "fa:16:3e:e9:1a:8d", "network": {"id": "5ec264ad-3459-468c-bdbf-c6a4ef016951", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1574289626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07c7783cc16049208421204910982c79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf099a41b-93", "ovs_interfaceid": "f099a41b-937c-4a91-bcc8-d194cd644485", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 16:00:38 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-6ae3dc03-e7ea-4a82-9919-069d29c8120a req-89416ff5-70b4-4b78-ab98-2c69359551d2 service nova] Releasing lock "refresh_cache-216e9ce3-28d7-4282-ae91-3aa6282626e1" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 16:00:38 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-d5105451-4526-426a-861d-b653aec0d5c1 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Acquiring lock "6c6a4729-9d51-4ebf-bad6-2022f35cbe3b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:00:38 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-d5105451-4526-426a-861d-b653aec0d5c1 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Lock "6c6a4729-9d51-4ebf-bad6-2022f35cbe3b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:00:38 user nova-compute[75176]: DEBUG nova.compute.manager [None req-d5105451-4526-426a-861d-b653aec0d5c1 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] [instance: 6c6a4729-9d51-4ebf-bad6-2022f35cbe3b] Starting instance... {{(pid=75176) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 16:00:38 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-d5105451-4526-426a-861d-b653aec0d5c1 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:00:38 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-d5105451-4526-426a-861d-b653aec0d5c1 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:00:38 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-d5105451-4526-426a-861d-b653aec0d5c1 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75176) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 16:00:38 user nova-compute[75176]: INFO nova.compute.claims [None req-d5105451-4526-426a-861d-b653aec0d5c1 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] [instance: 6c6a4729-9d51-4ebf-bad6-2022f35cbe3b] Claim successful on node user
Nov 28 16:00:38 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-c621ed57-5129-421f-8aec-a6590ecd88c8 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Acquiring lock "216e9ce3-28d7-4282-ae91-3aa6282626e1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:00:38 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-c621ed57-5129-421f-8aec-a6590ecd88c8 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Lock "216e9ce3-28d7-4282-ae91-3aa6282626e1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:00:38 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-c621ed57-5129-421f-8aec-a6590ecd88c8 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Acquiring lock "216e9ce3-28d7-4282-ae91-3aa6282626e1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:00:38 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-c621ed57-5129-421f-8aec-a6590ecd88c8 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Lock "216e9ce3-28d7-4282-ae91-3aa6282626e1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:00:38 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-c621ed57-5129-421f-8aec-a6590ecd88c8 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Lock "216e9ce3-28d7-4282-ae91-3aa6282626e1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:00:38 user nova-compute[75176]: INFO nova.compute.manager [None req-c621ed57-5129-421f-8aec-a6590ecd88c8 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: 216e9ce3-28d7-4282-ae91-3aa6282626e1] Terminating instance
Nov 28 16:00:38 user nova-compute[75176]: DEBUG nova.compute.manager [None req-c621ed57-5129-421f-8aec-a6590ecd88c8 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: 216e9ce3-28d7-4282-ae91-3aa6282626e1] Start destroying the instance on the hypervisor. {{(pid=75176) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 16:00:38 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:00:38 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:00:38 user nova-compute[75176]: DEBUG nova.compute.manager [req-14fff024-1ac3-4c8a-8617-e08bcd536975 req-f3ee92cc-ebf4-44e9-95c4-5de494d43960 service nova] [instance: 216e9ce3-28d7-4282-ae91-3aa6282626e1] Received event network-vif-unplugged-f099a41b-937c-4a91-bcc8-d194cd644485 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 16:00:38 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-14fff024-1ac3-4c8a-8617-e08bcd536975 req-f3ee92cc-ebf4-44e9-95c4-5de494d43960 service nova] Acquiring lock "216e9ce3-28d7-4282-ae91-3aa6282626e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:00:38 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-14fff024-1ac3-4c8a-8617-e08bcd536975 req-f3ee92cc-ebf4-44e9-95c4-5de494d43960 service nova] Lock "216e9ce3-28d7-4282-ae91-3aa6282626e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:00:38 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-14fff024-1ac3-4c8a-8617-e08bcd536975 req-f3ee92cc-ebf4-44e9-95c4-5de494d43960 service nova] Lock "216e9ce3-28d7-4282-ae91-3aa6282626e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:00:38 user nova-compute[75176]: DEBUG nova.compute.manager [req-14fff024-1ac3-4c8a-8617-e08bcd536975 req-f3ee92cc-ebf4-44e9-95c4-5de494d43960 service nova] [instance: 216e9ce3-28d7-4282-ae91-3aa6282626e1] No waiting events found dispatching network-vif-unplugged-f099a41b-937c-4a91-bcc8-d194cd644485 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 16:00:38 user nova-compute[75176]: DEBUG nova.compute.manager [req-14fff024-1ac3-4c8a-8617-e08bcd536975 req-f3ee92cc-ebf4-44e9-95c4-5de494d43960 service nova] [instance: 216e9ce3-28d7-4282-ae91-3aa6282626e1] Received event network-vif-unplugged-f099a41b-937c-4a91-bcc8-d194cd644485 for instance with task_state deleting. {{(pid=75176) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 16:00:39 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:00:39 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:00:39 user nova-compute[75176]: DEBUG nova.compute.provider_tree [None req-d5105451-4526-426a-861d-b653aec0d5c1 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Inventory has not changed in ProviderTree for provider: b37848d8-f401-4155-a029-b0ffa09ff85b {{(pid=75176) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 16:00:39 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-d5105451-4526-426a-861d-b653aec0d5c1 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Inventory has not changed for provider b37848d8-f401-4155-a029-b0ffa09ff85b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75176) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 16:00:39 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-d5105451-4526-426a-861d-b653aec0d5c1 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.521s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:00:39 user nova-compute[75176]: DEBUG nova.compute.manager [None req-d5105451-4526-426a-861d-b653aec0d5c1 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] [instance: 6c6a4729-9d51-4ebf-bad6-2022f35cbe3b] Start building networks asynchronously for instance. {{(pid=75176) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 16:00:39 user nova-compute[75176]: DEBUG nova.compute.manager [None req-d5105451-4526-426a-861d-b653aec0d5c1 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] [instance: 6c6a4729-9d51-4ebf-bad6-2022f35cbe3b] Allocating IP information in the background. {{(pid=75176) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 16:00:39 user nova-compute[75176]: DEBUG nova.network.neutron [None req-d5105451-4526-426a-861d-b653aec0d5c1 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] [instance: 6c6a4729-9d51-4ebf-bad6-2022f35cbe3b] allocate_for_instance() {{(pid=75176) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 16:00:39 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-d5105451-4526-426a-861d-b653aec0d5c1 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] [instance: 6c6a4729-9d51-4ebf-bad6-2022f35cbe3b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 16:00:39 user nova-compute[75176]: DEBUG nova.compute.manager [None req-d5105451-4526-426a-861d-b653aec0d5c1 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] [instance: 6c6a4729-9d51-4ebf-bad6-2022f35cbe3b] Start building block device mappings for instance. {{(pid=75176) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 16:00:39 user nova-compute[75176]: DEBUG nova.policy [None req-d5105451-4526-426a-861d-b653aec0d5c1 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '60b513cfc58647d49fc084d51964a4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aab7b19b9414b5da476b87e144cc40b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75176) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 16:00:39 user nova-compute[75176]: DEBUG nova.compute.manager [None req-d5105451-4526-426a-861d-b653aec0d5c1 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] [instance: 6c6a4729-9d51-4ebf-bad6-2022f35cbe3b] Start spawning the instance on the hypervisor. {{(pid=75176) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 16:00:39 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-d5105451-4526-426a-861d-b653aec0d5c1 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] [instance: 6c6a4729-9d51-4ebf-bad6-2022f35cbe3b] Creating instance directory {{(pid=75176) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 16:00:39 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-d5105451-4526-426a-861d-b653aec0d5c1 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] [instance: 6c6a4729-9d51-4ebf-bad6-2022f35cbe3b] Creating image(s)
Nov 28 16:00:39 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-d5105451-4526-426a-861d-b653aec0d5c1 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Acquiring lock "/opt/stack/data/nova/instances/6c6a4729-9d51-4ebf-bad6-2022f35cbe3b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:00:39 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-d5105451-4526-426a-861d-b653aec0d5c1 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Lock "/opt/stack/data/nova/instances/6c6a4729-9d51-4ebf-bad6-2022f35cbe3b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:00:39 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-d5105451-4526-426a-861d-b653aec0d5c1 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Lock "/opt/stack/data/nova/instances/6c6a4729-9d51-4ebf-bad6-2022f35cbe3b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:00:39 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-d5105451-4526-426a-861d-b653aec0d5c1 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:00:39 user nova-compute[75176]: INFO nova.virt.libvirt.driver [-] [instance: 216e9ce3-28d7-4282-ae91-3aa6282626e1] Instance destroyed successfully.
Nov 28 16:00:39 user nova-compute[75176]: DEBUG nova.objects.instance [None req-c621ed57-5129-421f-8aec-a6590ecd88c8 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Lazy-loading 'resources' on Instance uuid 216e9ce3-28d7-4282-ae91-3aa6282626e1 {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 16:00:39 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-c621ed57-5129-421f-8aec-a6590ecd88c8 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T15:58:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-685970400',display_name='tempest-TestVolumeBootPattern-server-685970400',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-685970400',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAT4j4MwMCXcgxPv2ypvh6Le18WUkR/7PQX0ERUSwv8uiHb35AkMlGdcRbKgULWyfAemfpuoTAyzTZycSyQIMMK+kqb2pUHOOT/5otX0G6BKfJMaYPfRy2E0NOlU0WUh/Q==',key_name='tempest-TestVolumeBootPattern-94664483',keypairs=<?>,launch_index=0,launched_at=2023-11-28T15:58:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='07c7783cc16049208421204910982c79',ramdisk_id='',reservation_id='r-b3jl9i5m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1695196118',owner_user_name='tempest-TestVolumeBootPattern-1695196118-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T15:58:59Z,user_data=None,user_id='081bf84d24194b81be4e0a6638db9b66',uuid=216e9ce3-28d7-4282-ae91-3aa6282626e1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f099a41b-937c-4a91-bcc8-d194cd644485", "address": "fa:16:3e:e9:1a:8d", "network": {"id": "5ec264ad-3459-468c-bdbf-c6a4ef016951", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1574289626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07c7783cc16049208421204910982c79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf099a41b-93", "ovs_interfaceid": "f099a41b-937c-4a91-bcc8-d194cd644485", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 16:00:39 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-c621ed57-5129-421f-8aec-a6590ecd88c8 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Converting VIF {"id": "f099a41b-937c-4a91-bcc8-d194cd644485", "address": "fa:16:3e:e9:1a:8d", "network": {"id": "5ec264ad-3459-468c-bdbf-c6a4ef016951", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1574289626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07c7783cc16049208421204910982c79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf099a41b-93", "ovs_interfaceid": "f099a41b-937c-4a91-bcc8-d194cd644485", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 16:00:39 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-c621ed57-5129-421f-8aec-a6590ecd88c8 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e9:1a:8d,bridge_name='br-int',has_traffic_filtering=True,id=f099a41b-937c-4a91-bcc8-d194cd644485,network=Network(5ec264ad-3459-468c-bdbf-c6a4ef016951),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf099a41b-93') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 16:00:39 user nova-compute[75176]: DEBUG os_vif [None req-c621ed57-5129-421f-8aec-a6590ecd88c8 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e9:1a:8d,bridge_name='br-int',has_traffic_filtering=True,id=f099a41b-937c-4a91-bcc8-d194cd644485,network=Network(5ec264ad-3459-468c-bdbf-c6a4ef016951),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf099a41b-93') {{(pid=75176) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 16:00:39 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:00:39 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf099a41b-93, bridge=br-int, if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 16:00:39 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:00:39 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 16:00:39 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:00:39 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=691641c7-002c-405f-bf6f-cf125c1d5cf9) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 16:00:39 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:00:39 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:00:39 user nova-compute[75176]: INFO os_vif [None req-c621ed57-5129-421f-8aec-a6590ecd88c8 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e9:1a:8d,bridge_name='br-int',has_traffic_filtering=True,id=f099a41b-937c-4a91-bcc8-d194cd644485,network=Network(5ec264ad-3459-468c-bdbf-c6a4ef016951),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf099a41b-93')
Nov 28 16:00:39 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c621ed57-5129-421f-8aec-a6590ecd88c8 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: 216e9ce3-28d7-4282-ae91-3aa6282626e1] calling os-brick to detach iSCSI Volume {{(pid=75176) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 16:00:39 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-c621ed57-5129-421f-8aec-a6590ecd88c8 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c1b8a00>, {'target_iqn': 'iqn.2010-10.org.openstack:6a0ac2c4-a491-487c-b957-f46813dd109d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jVGCWnxp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 16:00:39 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-c621ed57-5129-421f-8aec-a6590ecd88c8 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 16:00:39 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-c621ed57-5129-421f-8aec-a6590ecd88c8 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 16:00:39 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-c621ed57-5129-421f-8aec-a6590ecd88c8 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 16:00:39 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:00:39 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:00:39 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c18b8d3-dca9-4847-b9cf-fb9ccb5fc3c7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6a0ac2c4-a491-487c-b957-f46813dd109d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4b1a81f9-4a84-4f9e-9b1a-86b0c17ed81c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:00:39 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-c621ed57-5129-421f-8aec-a6590ecd88c8 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 16:00:39 user nova-compute[75176]: No targets found.
Nov 28 16:00:39 user nova-compute[75176]: iSNS:
Nov 28 16:00:39 user nova-compute[75176]: No targets found.
Nov 28 16:00:39 user nova-compute[75176]: STATIC:
Nov 28 16:00:39 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:6a0ac2c4-a491-487c-b957-f46813dd109d
Nov 28 16:00:39 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 16:00:39 user nova-compute[75176]:                 Iface Name: default
Nov 28 16:00:39 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0
Nov 28 16:00:39 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 16:00:39 user nova-compute[75176]:                 Iface Name: default
Nov 28 16:00:39 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6
Nov 28 16:00:39 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 16:00:39 user nova-compute[75176]:                 Iface Name: default
Nov 28 16:00:39 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:4b1a81f9-4a84-4f9e-9b1a-86b0c17ed81c
Nov 28 16:00:39 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 16:00:39 user nova-compute[75176]:                 Iface Name: default
Nov 28 16:00:39 user nova-compute[75176]: FIRMWARE:
Nov 28 16:00:39 user nova-compute[75176]: No targets found.
Nov 28 16:00:39 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 16:00:39 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-c621ed57-5129-421f-8aec-a6590ecd88c8 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 16:00:39 user nova-compute[75176]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 16:00:39 user nova-compute[75176]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75176) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 16:00:39 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-c621ed57-5129-421f-8aec-a6590ecd88c8 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6a0ac2c4-a491-487c-b957-f46813dd109d', 0)] {{(pid=75176) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 16:00:39 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-d5105451-4526-426a-861d-b653aec0d5c1 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json" returned: 0 in 0.199s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:00:39 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-d5105451-4526-426a-861d-b653aec0d5c1 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Acquiring lock "5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:00:39 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-d5105451-4526-426a-861d-b653aec0d5c1 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Lock "5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:00:39 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-d5105451-4526-426a-861d-b653aec0d5c1 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:00:39 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:00:39 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:00:39 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[00699f22-13a6-4fd9-a8de-cead158e0a76]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4b1a81f9-4a84-4f9e-9b1a-86b0c17ed81c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6a0ac2c4-a491-487c-b957-f46813dd109d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:00:39 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:00:39 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:00:39 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c27932e-c573-4716-90b7-a49e0455802b]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a0ac2c4-a491-487c-b957-f46813dd109d (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b1a81f9-4a84-4f9e-9b1a-86b0c17ed81c (non-flash)\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:00:39 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-c621ed57-5129-421f-8aec-a6590ecd88c8 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 (non-flash)
Nov 28 16:00:39 user nova-compute[75176]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0 (non-flash)
Nov 28 16:00:39 user nova-compute[75176]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a0ac2c4-a491-487c-b957-f46813dd109d (non-flash)
Nov 28 16:00:39 user nova-compute[75176]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b1a81f9-4a84-4f9e-9b1a-86b0c17ed81c (non-flash)
Nov 28 16:00:39 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 16:00:39 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-c621ed57-5129-421f-8aec-a6590ecd88c8 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 (non-flash)
Nov 28 16:00:39 user nova-compute[75176]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0 (non-flash)
Nov 28 16:00:39 user nova-compute[75176]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a0ac2c4-a491-487c-b957-f46813dd109d (non-flash)
Nov 28 16:00:39 user nova-compute[75176]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b1a81f9-4a84-4f9e-9b1a-86b0c17ed81c (non-flash)
Nov 28 16:00:39 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 16:00:39 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-c621ed57-5129-421f-8aec-a6590ecd88c8 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f464417c280>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6a0ac2c4-a491-487c-b957-f46813dd109d'): ({'sde'}, set())}) {{(pid=75176) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 16:00:39 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-c621ed57-5129-421f-8aec-a6590ecd88c8 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Removing single pathed devices sde {{(pid=75176) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 16:00:39 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:00:39 user nova-compute[75176]: DEBUG nova.compute.manager [req-71f50450-ed5c-4a09-a5b1-b5569583bfe3 req-9a5f1442-7d0b-4d41-af9b-fadea6f10dbd service nova] [instance: 216e9ce3-28d7-4282-ae91-3aa6282626e1] Received event network-changed-f099a41b-937c-4a91-bcc8-d194cd644485 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 16:00:39 user nova-compute[75176]: DEBUG nova.compute.manager [req-71f50450-ed5c-4a09-a5b1-b5569583bfe3 req-9a5f1442-7d0b-4d41-af9b-fadea6f10dbd service nova] [instance: 216e9ce3-28d7-4282-ae91-3aa6282626e1] Refreshing instance network info cache due to event network-changed-f099a41b-937c-4a91-bcc8-d194cd644485. {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 16:00:39 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-71f50450-ed5c-4a09-a5b1-b5569583bfe3 req-9a5f1442-7d0b-4d41-af9b-fadea6f10dbd service nova] Acquiring lock "refresh_cache-216e9ce3-28d7-4282-ae91-3aa6282626e1" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 16:00:39 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-71f50450-ed5c-4a09-a5b1-b5569583bfe3 req-9a5f1442-7d0b-4d41-af9b-fadea6f10dbd service nova] Acquired lock "refresh_cache-216e9ce3-28d7-4282-ae91-3aa6282626e1" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 16:00:39 user nova-compute[75176]: DEBUG nova.network.neutron [req-71f50450-ed5c-4a09-a5b1-b5569583bfe3 req-9a5f1442-7d0b-4d41-af9b-fadea6f10dbd service nova] [instance: 216e9ce3-28d7-4282-ae91-3aa6282626e1] Refreshing network info cache for port f099a41b-937c-4a91-bcc8-d194cd644485 {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 16:00:39 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:00:39 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:00:39 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[764f3779-a9ba-4a00-8d8f-26d2c95ebb78]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:00:39 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:00:39 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.022s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:00:39 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe03f4dc-8c24-4dcb-bdb4-ec49ab85697b]: (4, ('ok\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:00:39 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-c621ed57-5129-421f-8aec-a6590ecd88c8 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Flushing IO for device /dev/sde {{(pid=75176) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 16:00:39 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:00:39 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.022s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:00:39 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cc6e259-8d68-4ea4-af89-9d8f49619784]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:00:39 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-c621ed57-5129-421f-8aec-a6590ecd88c8 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75176) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 16:00:39 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:00:39 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.053s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:00:39 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[0945ad82-8dfa-42ab-807f-6e96c6b1c775]: (4, ('1', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:00:39 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-c621ed57-5129-421f-8aec-a6590ecd88c8 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75176) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 16:00:39 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-c621ed57-5129-421f-8aec-a6590ecd88c8 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] SCSI volumes sde have been removed. {{(pid=75176) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 16:00:39 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-c621ed57-5129-421f-8aec-a6590ecd88c8 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6a0ac2c4-a491-487c-b957-f46813dd109d')] {{(pid=75176) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 16:00:39 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a0ac2c4-a491-487c-b957-f46813dd109d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:00:39 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-d5105451-4526-426a-861d-b653aec0d5c1 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json" returned: 0 in 0.224s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:00:39 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-d5105451-4526-426a-861d-b653aec0d5c1 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2,backing_fmt=raw /opt/stack/data/nova/instances/6c6a4729-9d51-4ebf-bad6-2022f35cbe3b/disk 1073741824 {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:00:39 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a0ac2c4-a491-487c-b957-f46813dd109d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:00:39 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d8d2b13-2fb5-4dd1-904b-1878835de320]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:00:39 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-c621ed57-5129-421f-8aec-a6590ecd88c8 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 16:00:39 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a0ac2c4-a491-487c-b957-f46813dd109d -p 172.16.0.220:3260 --logout {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:00:39 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-d5105451-4526-426a-861d-b653aec0d5c1 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2,backing_fmt=raw /opt/stack/data/nova/instances/6c6a4729-9d51-4ebf-bad6-2022f35cbe3b/disk 1073741824" returned: 0 in 0.063s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:00:39 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-d5105451-4526-426a-861d-b653aec0d5c1 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Lock "5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.292s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:00:39 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-d5105451-4526-426a-861d-b653aec0d5c1 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:00:40 user nova-compute[75176]: DEBUG nova.network.neutron [None req-d5105451-4526-426a-861d-b653aec0d5c1 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] [instance: 6c6a4729-9d51-4ebf-bad6-2022f35cbe3b] Successfully created port: 85a1de78-2430-4835-8122-95570636e300 {{(pid=75176) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 16:00:40 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a0ac2c4-a491-487c-b957-f46813dd109d -p 172.16.0.220:3260 --logout" returned: 0 in 0.086s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:00:40 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a38613f-fcbf-4745-bdf5-cd4f50cfb74b]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:6a0ac2c4-a491-487c-b957-f46813dd109d, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:6a0ac2c4-a491-487c-b957-f46813dd109d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:00:40 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-c621ed57-5129-421f-8aec-a6590ecd88c8 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:6a0ac2c4-a491-487c-b957-f46813dd109d, portal: 172.16.0.220,3260]
Nov 28 16:00:40 user nova-compute[75176]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:6a0ac2c4-a491-487c-b957-f46813dd109d, portal: 172.16.0.220,3260] successful.
Nov 28 16:00:40 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 16:00:40 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a0ac2c4-a491-487c-b957-f46813dd109d -p 172.16.0.220:3260 --op delete {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:00:40 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a0ac2c4-a491-487c-b957-f46813dd109d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.085s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:00:40 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a3dc80f-b50c-4b83-8df6-5fa87dbc69ea]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:00:40 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-c621ed57-5129-421f-8aec-a6590ecd88c8 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 16:00:40 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-c621ed57-5129-421f-8aec-a6590ecd88c8 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.490s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 16:00:40 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-c621ed57-5129-421f-8aec-a6590ecd88c8 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] <== disconnect_volume: return (493ms) None {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 16:00:40 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c621ed57-5129-421f-8aec-a6590ecd88c8 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: 216e9ce3-28d7-4282-ae91-3aa6282626e1] Disconnected iSCSI Volume {{(pid=75176) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 16:00:40 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-c621ed57-5129-421f-8aec-a6590ecd88c8 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: 216e9ce3-28d7-4282-ae91-3aa6282626e1] Deleting instance files /opt/stack/data/nova/instances/216e9ce3-28d7-4282-ae91-3aa6282626e1_del
Nov 28 16:00:40 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-c621ed57-5129-421f-8aec-a6590ecd88c8 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: 216e9ce3-28d7-4282-ae91-3aa6282626e1] Deletion of /opt/stack/data/nova/instances/216e9ce3-28d7-4282-ae91-3aa6282626e1_del complete
Nov 28 16:00:40 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-d5105451-4526-426a-861d-b653aec0d5c1 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json" returned: 0 in 0.219s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:00:40 user nova-compute[75176]: DEBUG nova.virt.disk.api [None req-d5105451-4526-426a-861d-b653aec0d5c1 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6c6a4729-9d51-4ebf-bad6-2022f35cbe3b/disk. size=1073741824 {{(pid=75176) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 16:00:40 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-d5105451-4526-426a-861d-b653aec0d5c1 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c6a4729-9d51-4ebf-bad6-2022f35cbe3b/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:00:40 user nova-compute[75176]: INFO nova.compute.manager [None req-c621ed57-5129-421f-8aec-a6590ecd88c8 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: 216e9ce3-28d7-4282-ae91-3aa6282626e1] Took 1.51 seconds to destroy the instance on the hypervisor.
Nov 28 16:00:40 user nova-compute[75176]: DEBUG oslo.service.loopingcall [None req-c621ed57-5129-421f-8aec-a6590ecd88c8 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75176) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 16:00:40 user nova-compute[75176]: DEBUG nova.compute.manager [-] [instance: 216e9ce3-28d7-4282-ae91-3aa6282626e1] Deallocating network for instance {{(pid=75176) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 16:00:40 user nova-compute[75176]: DEBUG nova.network.neutron [-] [instance: 216e9ce3-28d7-4282-ae91-3aa6282626e1] deallocate_for_instance() {{(pid=75176) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 16:00:40 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-d5105451-4526-426a-861d-b653aec0d5c1 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c6a4729-9d51-4ebf-bad6-2022f35cbe3b/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:00:40 user nova-compute[75176]: DEBUG nova.virt.disk.api [None req-d5105451-4526-426a-861d-b653aec0d5c1 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Cannot resize image /opt/stack/data/nova/instances/6c6a4729-9d51-4ebf-bad6-2022f35cbe3b/disk to a smaller size. {{(pid=75176) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 16:00:40 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-d5105451-4526-426a-861d-b653aec0d5c1 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] [instance: 6c6a4729-9d51-4ebf-bad6-2022f35cbe3b] Created local disks {{(pid=75176) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 16:00:40 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-d5105451-4526-426a-861d-b653aec0d5c1 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] [instance: 6c6a4729-9d51-4ebf-bad6-2022f35cbe3b] Ensure instance console log exists: /opt/stack/data/nova/instances/6c6a4729-9d51-4ebf-bad6-2022f35cbe3b/console.log {{(pid=75176) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 16:00:40 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-d5105451-4526-426a-861d-b653aec0d5c1 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:00:40 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-d5105451-4526-426a-861d-b653aec0d5c1 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:00:40 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-d5105451-4526-426a-861d-b653aec0d5c1 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:00:40 user nova-compute[75176]: DEBUG nova.network.neutron [req-71f50450-ed5c-4a09-a5b1-b5569583bfe3 req-9a5f1442-7d0b-4d41-af9b-fadea6f10dbd service nova] [instance: 216e9ce3-28d7-4282-ae91-3aa6282626e1] Updated VIF entry in instance network info cache for port f099a41b-937c-4a91-bcc8-d194cd644485. {{(pid=75176) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 16:00:40 user nova-compute[75176]: DEBUG nova.network.neutron [req-71f50450-ed5c-4a09-a5b1-b5569583bfe3 req-9a5f1442-7d0b-4d41-af9b-fadea6f10dbd service nova] [instance: 216e9ce3-28d7-4282-ae91-3aa6282626e1] Updating instance_info_cache with network_info: [{"id": "f099a41b-937c-4a91-bcc8-d194cd644485", "address": "fa:16:3e:e9:1a:8d", "network": {"id": "5ec264ad-3459-468c-bdbf-c6a4ef016951", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1574289626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07c7783cc16049208421204910982c79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf099a41b-93", "ovs_interfaceid": "f099a41b-937c-4a91-bcc8-d194cd644485", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 16:00:40 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-71f50450-ed5c-4a09-a5b1-b5569583bfe3 req-9a5f1442-7d0b-4d41-af9b-fadea6f10dbd service nova] Releasing lock "refresh_cache-216e9ce3-28d7-4282-ae91-3aa6282626e1" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 16:00:40 user nova-compute[75176]: DEBUG nova.network.neutron [None req-d5105451-4526-426a-861d-b653aec0d5c1 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] [instance: 6c6a4729-9d51-4ebf-bad6-2022f35cbe3b] Successfully updated port: 85a1de78-2430-4835-8122-95570636e300 {{(pid=75176) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 16:00:40 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-d5105451-4526-426a-861d-b653aec0d5c1 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Acquiring lock "refresh_cache-6c6a4729-9d51-4ebf-bad6-2022f35cbe3b" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 16:00:40 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-d5105451-4526-426a-861d-b653aec0d5c1 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Acquired lock "refresh_cache-6c6a4729-9d51-4ebf-bad6-2022f35cbe3b" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 16:00:40 user nova-compute[75176]: DEBUG nova.network.neutron [None req-d5105451-4526-426a-861d-b653aec0d5c1 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] [instance: 6c6a4729-9d51-4ebf-bad6-2022f35cbe3b] Building network info cache for instance {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 16:00:40 user nova-compute[75176]: DEBUG nova.network.neutron [-] [instance: 216e9ce3-28d7-4282-ae91-3aa6282626e1] Updating instance_info_cache with network_info: [] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 16:00:40 user nova-compute[75176]: DEBUG nova.network.neutron [None req-d5105451-4526-426a-861d-b653aec0d5c1 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] [instance: 6c6a4729-9d51-4ebf-bad6-2022f35cbe3b] Instance cache missing network info. {{(pid=75176) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 16:00:40 user nova-compute[75176]: INFO nova.compute.manager [-] [instance: 216e9ce3-28d7-4282-ae91-3aa6282626e1] Took 0.58 seconds to deallocate network for instance.
Nov 28 16:00:40 user nova-compute[75176]: DEBUG nova.compute.manager [req-c5bc4c5a-b412-458d-97ae-2ad899cd9c62 req-cad19392-50c3-42a4-aab3-4073416e430c service nova] [instance: 216e9ce3-28d7-4282-ae91-3aa6282626e1] Received event network-vif-deleted-f099a41b-937c-4a91-bcc8-d194cd644485 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 16:00:41 user nova-compute[75176]: DEBUG nova.compute.manager [req-1499176c-629c-4bbf-a32d-022f01806c35 req-5a8dbf6b-ebc1-4d6a-bf60-323564c6b5ac service nova] [instance: 216e9ce3-28d7-4282-ae91-3aa6282626e1] Received event network-vif-plugged-f099a41b-937c-4a91-bcc8-d194cd644485 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 16:00:41 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-1499176c-629c-4bbf-a32d-022f01806c35 req-5a8dbf6b-ebc1-4d6a-bf60-323564c6b5ac service nova] Acquiring lock "216e9ce3-28d7-4282-ae91-3aa6282626e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:00:41 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-1499176c-629c-4bbf-a32d-022f01806c35 req-5a8dbf6b-ebc1-4d6a-bf60-323564c6b5ac service nova] Lock "216e9ce3-28d7-4282-ae91-3aa6282626e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:00:41 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-1499176c-629c-4bbf-a32d-022f01806c35 req-5a8dbf6b-ebc1-4d6a-bf60-323564c6b5ac service nova] Lock "216e9ce3-28d7-4282-ae91-3aa6282626e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:00:41 user nova-compute[75176]: DEBUG nova.compute.manager [req-1499176c-629c-4bbf-a32d-022f01806c35 req-5a8dbf6b-ebc1-4d6a-bf60-323564c6b5ac service nova] [instance: 216e9ce3-28d7-4282-ae91-3aa6282626e1] No waiting events found dispatching network-vif-plugged-f099a41b-937c-4a91-bcc8-d194cd644485 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 16:00:41 user nova-compute[75176]: WARNING nova.compute.manager [req-1499176c-629c-4bbf-a32d-022f01806c35 req-5a8dbf6b-ebc1-4d6a-bf60-323564c6b5ac service nova] [instance: 216e9ce3-28d7-4282-ae91-3aa6282626e1] Received unexpected event network-vif-plugged-f099a41b-937c-4a91-bcc8-d194cd644485 for instance with vm_state active and task_state deleting.
Nov 28 16:00:41 user nova-compute[75176]: DEBUG nova.compute.manager [req-1499176c-629c-4bbf-a32d-022f01806c35 req-5a8dbf6b-ebc1-4d6a-bf60-323564c6b5ac service nova] [instance: 6c6a4729-9d51-4ebf-bad6-2022f35cbe3b] Received event network-changed-85a1de78-2430-4835-8122-95570636e300 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 16:00:41 user nova-compute[75176]: DEBUG nova.compute.manager [req-1499176c-629c-4bbf-a32d-022f01806c35 req-5a8dbf6b-ebc1-4d6a-bf60-323564c6b5ac service nova] [instance: 6c6a4729-9d51-4ebf-bad6-2022f35cbe3b] Refreshing instance network info cache due to event network-changed-85a1de78-2430-4835-8122-95570636e300. {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 16:00:41 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-1499176c-629c-4bbf-a32d-022f01806c35 req-5a8dbf6b-ebc1-4d6a-bf60-323564c6b5ac service nova] Acquiring lock "refresh_cache-6c6a4729-9d51-4ebf-bad6-2022f35cbe3b" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 16:00:41 user nova-compute[75176]: DEBUG nova.network.neutron [None req-d5105451-4526-426a-861d-b653aec0d5c1 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] [instance: 6c6a4729-9d51-4ebf-bad6-2022f35cbe3b] Updating instance_info_cache with network_info: [{"id": "85a1de78-2430-4835-8122-95570636e300", "address": "fa:16:3e:f4:49:91", "network": {"id": "9faaeac5-1688-436d-90fb-38bb1c4d3da4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1225296735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6aab7b19b9414b5da476b87e144cc40b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85a1de78-24", "ovs_interfaceid": "85a1de78-2430-4835-8122-95570636e300", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 16:00:41 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-d5105451-4526-426a-861d-b653aec0d5c1 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Releasing lock "refresh_cache-6c6a4729-9d51-4ebf-bad6-2022f35cbe3b" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 16:00:41 user nova-compute[75176]: DEBUG nova.compute.manager [None req-d5105451-4526-426a-861d-b653aec0d5c1 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] [instance: 6c6a4729-9d51-4ebf-bad6-2022f35cbe3b] Instance network_info: |[{"id": "85a1de78-2430-4835-8122-95570636e300", "address": "fa:16:3e:f4:49:91", "network": {"id": "9faaeac5-1688-436d-90fb-38bb1c4d3da4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1225296735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6aab7b19b9414b5da476b87e144cc40b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85a1de78-24", "ovs_interfaceid": "85a1de78-2430-4835-8122-95570636e300", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75176) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 16:00:41 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-1499176c-629c-4bbf-a32d-022f01806c35 req-5a8dbf6b-ebc1-4d6a-bf60-323564c6b5ac service nova] Acquired lock "refresh_cache-6c6a4729-9d51-4ebf-bad6-2022f35cbe3b" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 16:00:41 user nova-compute[75176]: DEBUG nova.network.neutron [req-1499176c-629c-4bbf-a32d-022f01806c35 req-5a8dbf6b-ebc1-4d6a-bf60-323564c6b5ac service nova] [instance: 6c6a4729-9d51-4ebf-bad6-2022f35cbe3b] Refreshing network info cache for port 85a1de78-2430-4835-8122-95570636e300 {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 16:00:41 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-d5105451-4526-426a-861d-b653aec0d5c1 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] [instance: 6c6a4729-9d51-4ebf-bad6-2022f35cbe3b] Start _get_guest_xml network_info=[{"id": "85a1de78-2430-4835-8122-95570636e300", "address": "fa:16:3e:f4:49:91", "network": {"id": "9faaeac5-1688-436d-90fb-38bb1c4d3da4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1225296735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6aab7b19b9414b5da476b87e144cc40b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85a1de78-24", "ovs_interfaceid": "85a1de78-2430-4835-8122-95570636e300", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T15:35:12Z,direct_url=<?>,disk_format='qcow2',id=1f41819e-c93f-4dc7-b253-37a27bbbbc74,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1b91c5d0672c4224a48df2e1f92688e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T15:35:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'size': 0, 'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'image_id': '1f41819e-c93f-4dc7-b253-37a27bbbbc74'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75176) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 16:00:41 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-d5105451-4526-426a-861d-b653aec0d5c1 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 16:00:41 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-d5105451-4526-426a-861d-b653aec0d5c1 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 16:00:41 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-d5105451-4526-426a-861d-b653aec0d5c1 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75176) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 16:00:41 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-d5105451-4526-426a-861d-b653aec0d5c1 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] CPU controller missing on host. {{(pid=75176) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 16:00:41 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-d5105451-4526-426a-861d-b653aec0d5c1 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75176) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 16:00:41 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-d5105451-4526-426a-861d-b653aec0d5c1 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] CPU controller found on host. {{(pid=75176) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 16:00:41 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-d5105451-4526-426a-861d-b653aec0d5c1 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75176) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 16:00:41 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-d5105451-4526-426a-861d-b653aec0d5c1 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T15:35:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T15:35:12Z,direct_url=<?>,disk_format='qcow2',id=1f41819e-c93f-4dc7-b253-37a27bbbbc74,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1b91c5d0672c4224a48df2e1f92688e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T15:35:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 16:00:41 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-d5105451-4526-426a-861d-b653aec0d5c1 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Flavor limits 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 16:00:41 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-d5105451-4526-426a-861d-b653aec0d5c1 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Image limits 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 16:00:41 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-d5105451-4526-426a-861d-b653aec0d5c1 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Flavor pref 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 16:00:41 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-d5105451-4526-426a-861d-b653aec0d5c1 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Image pref 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 16:00:41 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-d5105451-4526-426a-861d-b653aec0d5c1 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 16:00:41 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-d5105451-4526-426a-861d-b653aec0d5c1 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 16:00:41 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-d5105451-4526-426a-861d-b653aec0d5c1 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75176) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 16:00:41 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-d5105451-4526-426a-861d-b653aec0d5c1 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Got 1 possible topologies {{(pid=75176) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 16:00:41 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-d5105451-4526-426a-861d-b653aec0d5c1 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 16:00:41 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-d5105451-4526-426a-861d-b653aec0d5c1 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 16:00:41 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-d5105451-4526-426a-861d-b653aec0d5c1 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T16:00:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-691561062',display_name='tempest-AttachVolumeTestJSON-server-691561062',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-691561062',id=48,image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD9HYYuhew+HwSlGLCtnm5QU3CE4PWqBzdirX5E0yDwA3ZIjV/d7lqYB/DPfiezleSueBjZ4jvmSISqP2Nc+aT8uhbuWQyy+x6kGVNBbHAicQWf8CVd+FflN0YxTFd39NA==',key_name='tempest-keypair-1245727303',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6aab7b19b9414b5da476b87e144cc40b',ramdisk_id='',reservation_id='r-m99ag9fz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-365725655',owner_user_name='tempest-AttachVolumeTestJSON-365725655-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T16:00:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='60b513cfc58647d49fc084d51964a4c6',uuid=6c6a4729-9d51-4ebf-bad6-2022f35cbe3b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "85a1de78-2430-4835-8122-95570636e300", "address": "fa:16:3e:f4:49:91", "network": {"id": "9faaeac5-1688-436d-90fb-38bb1c4d3da4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1225296735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6aab7b19b9414b5da476b87e144cc40b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85a1de78-24", "ovs_interfaceid": "85a1de78-2430-4835-8122-95570636e300", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75176) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 16:00:41 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-d5105451-4526-426a-861d-b653aec0d5c1 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Converting VIF {"id": "85a1de78-2430-4835-8122-95570636e300", "address": "fa:16:3e:f4:49:91", "network": {"id": "9faaeac5-1688-436d-90fb-38bb1c4d3da4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1225296735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6aab7b19b9414b5da476b87e144cc40b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85a1de78-24", "ovs_interfaceid": "85a1de78-2430-4835-8122-95570636e300", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 16:00:41 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-d5105451-4526-426a-861d-b653aec0d5c1 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:49:91,bridge_name='br-int',has_traffic_filtering=True,id=85a1de78-2430-4835-8122-95570636e300,network=Network(9faaeac5-1688-436d-90fb-38bb1c4d3da4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85a1de78-24') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 16:00:41 user nova-compute[75176]: DEBUG nova.objects.instance [None req-d5105451-4526-426a-861d-b653aec0d5c1 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Lazy-loading 'pci_devices' on Instance uuid 6c6a4729-9d51-4ebf-bad6-2022f35cbe3b {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 16:00:41 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-d5105451-4526-426a-861d-b653aec0d5c1 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] [instance: 6c6a4729-9d51-4ebf-bad6-2022f35cbe3b] End _get_guest_xml xml=<domain type="kvm">
Nov 28 16:00:41 user nova-compute[75176]:   <uuid>6c6a4729-9d51-4ebf-bad6-2022f35cbe3b</uuid>
Nov 28 16:00:41 user nova-compute[75176]:   <name>instance-00000030</name>
Nov 28 16:00:41 user nova-compute[75176]:   <memory>524288</memory>
Nov 28 16:00:41 user nova-compute[75176]:   <vcpu>1</vcpu>
Nov 28 16:00:41 user nova-compute[75176]:   <metadata>
Nov 28 16:00:41 user nova-compute[75176]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 16:00:41 user nova-compute[75176]:       <nova:package version="0.0.0"/>
Nov 28 16:00:41 user nova-compute[75176]:       <nova:name>tempest-AttachVolumeTestJSON-server-691561062</nova:name>
Nov 28 16:00:41 user nova-compute[75176]:       <nova:creationTime>2023-11-28 16:00:41</nova:creationTime>
Nov 28 16:00:41 user nova-compute[75176]:       <nova:flavor name="m1.tiny">
Nov 28 16:00:41 user nova-compute[75176]:         <nova:memory>512</nova:memory>
Nov 28 16:00:41 user nova-compute[75176]:         <nova:disk>1</nova:disk>
Nov 28 16:00:41 user nova-compute[75176]:         <nova:swap>0</nova:swap>
Nov 28 16:00:41 user nova-compute[75176]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 16:00:41 user nova-compute[75176]:         <nova:vcpus>1</nova:vcpus>
Nov 28 16:00:41 user nova-compute[75176]:       </nova:flavor>
Nov 28 16:00:41 user nova-compute[75176]:       <nova:owner>
Nov 28 16:00:41 user nova-compute[75176]:         <nova:user uuid="60b513cfc58647d49fc084d51964a4c6">tempest-AttachVolumeTestJSON-365725655-project-member</nova:user>
Nov 28 16:00:41 user nova-compute[75176]:         <nova:project uuid="6aab7b19b9414b5da476b87e144cc40b">tempest-AttachVolumeTestJSON-365725655</nova:project>
Nov 28 16:00:41 user nova-compute[75176]:       </nova:owner>
Nov 28 16:00:41 user nova-compute[75176]:       <nova:root type="image" uuid="1f41819e-c93f-4dc7-b253-37a27bbbbc74"/>
Nov 28 16:00:41 user nova-compute[75176]:       <nova:ports>
Nov 28 16:00:41 user nova-compute[75176]:         <nova:port uuid="85a1de78-2430-4835-8122-95570636e300">
Nov 28 16:00:41 user nova-compute[75176]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 28 16:00:41 user nova-compute[75176]:         </nova:port>
Nov 28 16:00:41 user nova-compute[75176]:       </nova:ports>
Nov 28 16:00:41 user nova-compute[75176]:     </nova:instance>
Nov 28 16:00:41 user nova-compute[75176]:   </metadata>
Nov 28 16:00:41 user nova-compute[75176]:   <sysinfo type="smbios">
Nov 28 16:00:41 user nova-compute[75176]:     <system>
Nov 28 16:00:41 user nova-compute[75176]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 16:00:41 user nova-compute[75176]:       <entry name="product">OpenStack Nova</entry>
Nov 28 16:00:41 user nova-compute[75176]:       <entry name="version">0.0.0</entry>
Nov 28 16:00:41 user nova-compute[75176]:       <entry name="serial">6c6a4729-9d51-4ebf-bad6-2022f35cbe3b</entry>
Nov 28 16:00:41 user nova-compute[75176]:       <entry name="uuid">6c6a4729-9d51-4ebf-bad6-2022f35cbe3b</entry>
Nov 28 16:00:41 user nova-compute[75176]:       <entry name="family">Virtual Machine</entry>
Nov 28 16:00:41 user nova-compute[75176]:     </system>
Nov 28 16:00:41 user nova-compute[75176]:   </sysinfo>
Nov 28 16:00:41 user nova-compute[75176]:   <os>
Nov 28 16:00:41 user nova-compute[75176]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 16:00:41 user nova-compute[75176]:     <boot dev="hd"/>
Nov 28 16:00:41 user nova-compute[75176]:     <smbios mode="sysinfo"/>
Nov 28 16:00:41 user nova-compute[75176]:   </os>
Nov 28 16:00:41 user nova-compute[75176]:   <features>
Nov 28 16:00:41 user nova-compute[75176]:     <acpi/>
Nov 28 16:00:41 user nova-compute[75176]:     <apic/>
Nov 28 16:00:41 user nova-compute[75176]:     <vmcoreinfo/>
Nov 28 16:00:41 user nova-compute[75176]:   </features>
Nov 28 16:00:41 user nova-compute[75176]:   <clock offset="utc">
Nov 28 16:00:41 user nova-compute[75176]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 16:00:41 user nova-compute[75176]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 16:00:41 user nova-compute[75176]:     <timer name="hpet" present="no"/>
Nov 28 16:00:41 user nova-compute[75176]:   </clock>
Nov 28 16:00:41 user nova-compute[75176]:   <cpu mode="custom" match="exact">
Nov 28 16:00:41 user nova-compute[75176]:     <model>Nehalem</model>
Nov 28 16:00:41 user nova-compute[75176]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 16:00:41 user nova-compute[75176]:   </cpu>
Nov 28 16:00:41 user nova-compute[75176]:   <devices>
Nov 28 16:00:41 user nova-compute[75176]:     <disk type="file" device="disk">
Nov 28 16:00:41 user nova-compute[75176]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 16:00:41 user nova-compute[75176]:       <source file="/opt/stack/data/nova/instances/6c6a4729-9d51-4ebf-bad6-2022f35cbe3b/disk"/>
Nov 28 16:00:41 user nova-compute[75176]:       <target dev="vda" bus="virtio"/>
Nov 28 16:00:41 user nova-compute[75176]:     </disk>
Nov 28 16:00:41 user nova-compute[75176]:     <interface type="ethernet">
Nov 28 16:00:41 user nova-compute[75176]:       <mac address="fa:16:3e:f4:49:91"/>
Nov 28 16:00:41 user nova-compute[75176]:       <model type="virtio"/>
Nov 28 16:00:41 user nova-compute[75176]:       <mtu size="1442"/>
Nov 28 16:00:41 user nova-compute[75176]:       <target dev="tap85a1de78-24"/>
Nov 28 16:00:41 user nova-compute[75176]:     </interface>
Nov 28 16:00:41 user nova-compute[75176]:     <serial type="pty">
Nov 28 16:00:41 user nova-compute[75176]:       <log file="/opt/stack/data/nova/instances/6c6a4729-9d51-4ebf-bad6-2022f35cbe3b/console.log" append="off"/>
Nov 28 16:00:41 user nova-compute[75176]:     </serial>
Nov 28 16:00:41 user nova-compute[75176]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 16:00:41 user nova-compute[75176]:     <video>
Nov 28 16:00:41 user nova-compute[75176]:       <model type="virtio"/>
Nov 28 16:00:41 user nova-compute[75176]:     </video>
Nov 28 16:00:41 user nova-compute[75176]:     <rng model="virtio">
Nov 28 16:00:41 user nova-compute[75176]:       <backend model="random">/dev/urandom</backend>
Nov 28 16:00:41 user nova-compute[75176]:     </rng>
Nov 28 16:00:41 user nova-compute[75176]:     <controller type="usb" index="0" model="none"/>
Nov 28 16:00:41 user nova-compute[75176]:     <memballoon model="virtio">
Nov 28 16:00:41 user nova-compute[75176]:       <stats period="10"/>
Nov 28 16:00:41 user nova-compute[75176]:     </memballoon>
Nov 28 16:00:41 user nova-compute[75176]:   </devices>
Nov 28 16:00:41 user nova-compute[75176]: </domain>
Nov 28 16:00:41 user nova-compute[75176]:  {{(pid=75176) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 16:00:41 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-d5105451-4526-426a-861d-b653aec0d5c1 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T16:00:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-691561062',display_name='tempest-AttachVolumeTestJSON-server-691561062',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-691561062',id=48,image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD9HYYuhew+HwSlGLCtnm5QU3CE4PWqBzdirX5E0yDwA3ZIjV/d7lqYB/DPfiezleSueBjZ4jvmSISqP2Nc+aT8uhbuWQyy+x6kGVNBbHAicQWf8CVd+FflN0YxTFd39NA==',key_name='tempest-keypair-1245727303',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6aab7b19b9414b5da476b87e144cc40b',ramdisk_id='',reservation_id='r-m99ag9fz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-365725655',owner_user_name='tempest-AttachVolumeTestJSON-365725655-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T16:00:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='60b513cfc58647d49fc084d51964a4c6',uuid=6c6a4729-9d51-4ebf-bad6-2022f35cbe3b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "85a1de78-2430-4835-8122-95570636e300", "address": "fa:16:3e:f4:49:91", "network": {"id": "9faaeac5-1688-436d-90fb-38bb1c4d3da4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1225296735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6aab7b19b9414b5da476b87e144cc40b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85a1de78-24", "ovs_interfaceid": "85a1de78-2430-4835-8122-95570636e300", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 16:00:41 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-d5105451-4526-426a-861d-b653aec0d5c1 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Converting VIF {"id": "85a1de78-2430-4835-8122-95570636e300", "address": "fa:16:3e:f4:49:91", "network": {"id": "9faaeac5-1688-436d-90fb-38bb1c4d3da4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1225296735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6aab7b19b9414b5da476b87e144cc40b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85a1de78-24", "ovs_interfaceid": "85a1de78-2430-4835-8122-95570636e300", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 16:00:41 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-d5105451-4526-426a-861d-b653aec0d5c1 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:49:91,bridge_name='br-int',has_traffic_filtering=True,id=85a1de78-2430-4835-8122-95570636e300,network=Network(9faaeac5-1688-436d-90fb-38bb1c4d3da4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85a1de78-24') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 16:00:41 user nova-compute[75176]: DEBUG os_vif [None req-d5105451-4526-426a-861d-b653aec0d5c1 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:49:91,bridge_name='br-int',has_traffic_filtering=True,id=85a1de78-2430-4835-8122-95570636e300,network=Network(9faaeac5-1688-436d-90fb-38bb1c4d3da4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85a1de78-24') {{(pid=75176) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 16:00:41 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:00:41 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 16:00:41 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 16:00:41 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:00:41 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e880c5d5-4e14-57e8-9b30-bc4eeed8a398', '_type': 'linux-noop'}}, row=False) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 16:00:41 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:00:41 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 16:00:41 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:00:41 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap85a1de78-24, may_exist=True, interface_attrs={}) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 16:00:41 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap85a1de78-24, col_values=(('qos', UUID('0fb3a802-1538-4aa2-8401-cd9d475648c1')),), if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 16:00:41 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap85a1de78-24, col_values=(('external_ids', {'iface-id': '85a1de78-2430-4835-8122-95570636e300', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f4:49:91', 'vm-uuid': '6c6a4729-9d51-4ebf-bad6-2022f35cbe3b'}),), if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 16:00:41 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:00:41 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 16:00:41 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:00:41 user nova-compute[75176]: INFO os_vif [None req-d5105451-4526-426a-861d-b653aec0d5c1 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:49:91,bridge_name='br-int',has_traffic_filtering=True,id=85a1de78-2430-4835-8122-95570636e300,network=Network(9faaeac5-1688-436d-90fb-38bb1c4d3da4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85a1de78-24')
Nov 28 16:00:41 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-d5105451-4526-426a-861d-b653aec0d5c1 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] No BDM found with device name vda, not building metadata. {{(pid=75176) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 16:00:41 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-d5105451-4526-426a-861d-b653aec0d5c1 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] No VIF found with MAC fa:16:3e:f4:49:91, not building metadata {{(pid=75176) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 16:00:41 user nova-compute[75176]: DEBUG nova.network.neutron [req-1499176c-629c-4bbf-a32d-022f01806c35 req-5a8dbf6b-ebc1-4d6a-bf60-323564c6b5ac service nova] [instance: 6c6a4729-9d51-4ebf-bad6-2022f35cbe3b] Updated VIF entry in instance network info cache for port 85a1de78-2430-4835-8122-95570636e300. {{(pid=75176) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 16:00:41 user nova-compute[75176]: DEBUG nova.network.neutron [req-1499176c-629c-4bbf-a32d-022f01806c35 req-5a8dbf6b-ebc1-4d6a-bf60-323564c6b5ac service nova] [instance: 6c6a4729-9d51-4ebf-bad6-2022f35cbe3b] Updating instance_info_cache with network_info: [{"id": "85a1de78-2430-4835-8122-95570636e300", "address": "fa:16:3e:f4:49:91", "network": {"id": "9faaeac5-1688-436d-90fb-38bb1c4d3da4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1225296735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6aab7b19b9414b5da476b87e144cc40b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85a1de78-24", "ovs_interfaceid": "85a1de78-2430-4835-8122-95570636e300", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 16:00:41 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-1499176c-629c-4bbf-a32d-022f01806c35 req-5a8dbf6b-ebc1-4d6a-bf60-323564c6b5ac service nova] Releasing lock "refresh_cache-6c6a4729-9d51-4ebf-bad6-2022f35cbe3b" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 16:00:41 user nova-compute[75176]: INFO nova.compute.manager [None req-c621ed57-5129-421f-8aec-a6590ecd88c8 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: 216e9ce3-28d7-4282-ae91-3aa6282626e1] Took 0.82 seconds to detach 1 volumes for instance.
Nov 28 16:00:41 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-c621ed57-5129-421f-8aec-a6590ecd88c8 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:00:41 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-c621ed57-5129-421f-8aec-a6590ecd88c8 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:00:42 user nova-compute[75176]: DEBUG nova.compute.provider_tree [None req-c621ed57-5129-421f-8aec-a6590ecd88c8 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Inventory has not changed in ProviderTree for provider: b37848d8-f401-4155-a029-b0ffa09ff85b {{(pid=75176) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 16:00:42 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-c621ed57-5129-421f-8aec-a6590ecd88c8 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Inventory has not changed for provider b37848d8-f401-4155-a029-b0ffa09ff85b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75176) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 16:00:42 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-c621ed57-5129-421f-8aec-a6590ecd88c8 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.369s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:00:42 user nova-compute[75176]: INFO nova.scheduler.client.report [None req-c621ed57-5129-421f-8aec-a6590ecd88c8 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Deleted allocations for instance 216e9ce3-28d7-4282-ae91-3aa6282626e1
Nov 28 16:00:42 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-c621ed57-5129-421f-8aec-a6590ecd88c8 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Lock "216e9ce3-28d7-4282-ae91-3aa6282626e1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.509s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:00:42 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:00:42 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:00:42 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:00:43 user nova-compute[75176]: DEBUG nova.compute.manager [req-aedb919e-37af-46f8-bb92-b2aa2b24f6f3 req-73cdf671-5901-4531-9455-e7c97743413a service nova] [instance: 6c6a4729-9d51-4ebf-bad6-2022f35cbe3b] Received event network-vif-plugged-85a1de78-2430-4835-8122-95570636e300 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 16:00:43 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-aedb919e-37af-46f8-bb92-b2aa2b24f6f3 req-73cdf671-5901-4531-9455-e7c97743413a service nova] Acquiring lock "6c6a4729-9d51-4ebf-bad6-2022f35cbe3b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:00:43 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-aedb919e-37af-46f8-bb92-b2aa2b24f6f3 req-73cdf671-5901-4531-9455-e7c97743413a service nova] Lock "6c6a4729-9d51-4ebf-bad6-2022f35cbe3b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:00:43 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-aedb919e-37af-46f8-bb92-b2aa2b24f6f3 req-73cdf671-5901-4531-9455-e7c97743413a service nova] Lock "6c6a4729-9d51-4ebf-bad6-2022f35cbe3b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:00:43 user nova-compute[75176]: DEBUG nova.compute.manager [req-aedb919e-37af-46f8-bb92-b2aa2b24f6f3 req-73cdf671-5901-4531-9455-e7c97743413a service nova] [instance: 6c6a4729-9d51-4ebf-bad6-2022f35cbe3b] No waiting events found dispatching network-vif-plugged-85a1de78-2430-4835-8122-95570636e300 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 16:00:43 user nova-compute[75176]: WARNING nova.compute.manager [req-aedb919e-37af-46f8-bb92-b2aa2b24f6f3 req-73cdf671-5901-4531-9455-e7c97743413a service nova] [instance: 6c6a4729-9d51-4ebf-bad6-2022f35cbe3b] Received unexpected event network-vif-plugged-85a1de78-2430-4835-8122-95570636e300 for instance with vm_state building and task_state spawning.
Nov 28 16:00:43 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:00:43 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:00:43 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:00:43 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:00:44 user nova-compute[75176]: DEBUG nova.compute.manager [None req-fbc17638-4ec2-4a5d-9f50-c32cf02d057e tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: 1062234d-4890-46df-bb52-49c55b4af32b] Start spawning the instance on the hypervisor. {{(pid=75176) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 16:00:44 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-fbc17638-4ec2-4a5d-9f50-c32cf02d057e tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: 1062234d-4890-46df-bb52-49c55b4af32b] Creating instance directory {{(pid=75176) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 16:00:44 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-fbc17638-4ec2-4a5d-9f50-c32cf02d057e tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: 1062234d-4890-46df-bb52-49c55b4af32b] Creating image(s)
Nov 28 16:00:44 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-fbc17638-4ec2-4a5d-9f50-c32cf02d057e tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: 1062234d-4890-46df-bb52-49c55b4af32b] Did not create local disks {{(pid=75176) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 28 16:00:44 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-fbc17638-4ec2-4a5d-9f50-c32cf02d057e tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: 1062234d-4890-46df-bb52-49c55b4af32b] Ensure instance console log exists: /opt/stack/data/nova/instances/1062234d-4890-46df-bb52-49c55b4af32b/console.log {{(pid=75176) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 16:00:44 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-fbc17638-4ec2-4a5d-9f50-c32cf02d057e tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:00:44 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-fbc17638-4ec2-4a5d-9f50-c32cf02d057e tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:00:44 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-fbc17638-4ec2-4a5d-9f50-c32cf02d057e tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:00:44 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-fbc17638-4ec2-4a5d-9f50-c32cf02d057e tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: 1062234d-4890-46df-bb52-49c55b4af32b] Start _get_guest_xml network_info=[{"id": "3dd39a62-ef9c-4870-be88-578e41ff5013", "address": "fa:16:3e:10:e7:45", "network": {"id": "998766cd-2e8e-4e39-add9-286086640993", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-989265510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf05c8836b8a40de8e64c2d046ed71ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dd39a62-ef", "ovs_interfaceid": "3dd39a62-ef9c-4870-be88-578e41ff5013", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T15:35:12Z,direct_url=<?>,disk_format='qcow2',id=1f41819e-c93f-4dc7-b253-37a27bbbbc74,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1b91c5d0672c4224a48df2e1f92688e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T15:35:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6ec9410d-747d-475e-999c-672f87917a20', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iqKQHyYp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '1062234d-4890-46df-bb52-49c55b4af32b', 'attached_at': '', 'detached_at': '', 'volume_id': '6ec9410d-747d-475e-999c-672f87917a20', 'serial': '6ec9410d-747d-475e-999c-672f87917a20'}, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'delete_on_termination': False, 'mount_device': '/dev/vda', 'attachment_id': '699befcc-5f40-4437-9ca0-d26ccd12bc59', 'volume_type': None} {{(pid=75176) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 16:00:44 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-fbc17638-4ec2-4a5d-9f50-c32cf02d057e tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 16:00:44 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-fbc17638-4ec2-4a5d-9f50-c32cf02d057e tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 16:00:44 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-fbc17638-4ec2-4a5d-9f50-c32cf02d057e tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75176) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 16:00:44 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-fbc17638-4ec2-4a5d-9f50-c32cf02d057e tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] CPU controller missing on host. {{(pid=75176) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 16:00:44 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-fbc17638-4ec2-4a5d-9f50-c32cf02d057e tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75176) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 16:00:44 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-fbc17638-4ec2-4a5d-9f50-c32cf02d057e tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] CPU controller found on host. {{(pid=75176) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 16:00:44 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-fbc17638-4ec2-4a5d-9f50-c32cf02d057e tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75176) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 16:00:44 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-fbc17638-4ec2-4a5d-9f50-c32cf02d057e tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T15:35:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T15:35:12Z,direct_url=<?>,disk_format='qcow2',id=1f41819e-c93f-4dc7-b253-37a27bbbbc74,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1b91c5d0672c4224a48df2e1f92688e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T15:35:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 16:00:44 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-fbc17638-4ec2-4a5d-9f50-c32cf02d057e tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Flavor limits 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 16:00:44 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-fbc17638-4ec2-4a5d-9f50-c32cf02d057e tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Image limits 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 16:00:44 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-fbc17638-4ec2-4a5d-9f50-c32cf02d057e tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Flavor pref 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 16:00:44 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-fbc17638-4ec2-4a5d-9f50-c32cf02d057e tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Image pref 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 16:00:44 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-fbc17638-4ec2-4a5d-9f50-c32cf02d057e tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 16:00:44 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-fbc17638-4ec2-4a5d-9f50-c32cf02d057e tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 16:00:44 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-fbc17638-4ec2-4a5d-9f50-c32cf02d057e tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75176) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 16:00:44 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-fbc17638-4ec2-4a5d-9f50-c32cf02d057e tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Got 1 possible topologies {{(pid=75176) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 16:00:44 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-fbc17638-4ec2-4a5d-9f50-c32cf02d057e tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 16:00:44 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-fbc17638-4ec2-4a5d-9f50-c32cf02d057e tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 16:00:44 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fbc17638-4ec2-4a5d-9f50-c32cf02d057e tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: 1062234d-4890-46df-bb52-49c55b4af32b] Calling os-brick to attach iSCSI Volume {{(pid=75176) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 16:00:44 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbc17638-4ec2-4a5d-9f50-c32cf02d057e tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c1b8a00>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6ec9410d-747d-475e-999c-672f87917a20', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iqKQHyYp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 16:00:44 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-fbc17638-4ec2-4a5d-9f50-c32cf02d057e tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 16:00:44 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-fbc17638-4ec2-4a5d-9f50-c32cf02d057e tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 16:00:44 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-fbc17638-4ec2-4a5d-9f50-c32cf02d057e tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 16:00:44 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-fbc17638-4ec2-4a5d-9f50-c32cf02d057e tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 16:00:44 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-fbc17638-4ec2-4a5d-9f50-c32cf02d057e tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6ec9410d-747d-475e-999c-672f87917a20" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 16:00:44 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-fbc17638-4ec2-4a5d-9f50-c32cf02d057e tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6ec9410d-747d-475e-999c-672f87917a20" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 16:00:44 user nova-compute[75176]: INFO os_brick.initiator.connectors.iscsi [None req-fbc17638-4ec2-4a5d-9f50-c32cf02d057e tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 16:00:44 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ec9410d-747d-475e-999c-672f87917a20 -p 172.16.0.220:3260 {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:00:44 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ec9410d-747d-475e-999c-672f87917a20 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:00:44 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa82abc5-b364-4f11-8577-b4583666d1a7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:00:44 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbc17638-4ec2-4a5d-9f50-c32cf02d057e tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 16:00:44 user nova-compute[75176]:  {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 16:00:44 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ec9410d-747d-475e-999c-672f87917a20 -p 172.16.0.220:3260 --interface default --op new {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:00:44 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ec9410d-747d-475e-999c-672f87917a20 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:00:44 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad893b37-39c4-4b87-98c5-215d4ff4662d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6ec9410d-747d-475e-999c-672f87917a20] added\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:00:44 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbc17638-4ec2-4a5d-9f50-c32cf02d057e tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6ec9410d-747d-475e-999c-672f87917a20] added
Nov 28 16:00:44 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 16:00:44 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ec9410d-747d-475e-999c-672f87917a20 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:00:44 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ec9410d-747d-475e-999c-672f87917a20 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:00:44 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9ca7565-02ca-4031-9fcb-6b3d5911e481]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:00:44 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbc17638-4ec2-4a5d-9f50-c32cf02d057e tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 16:00:44 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ec9410d-747d-475e-999c-672f87917a20 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:00:44 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ec9410d-747d-475e-999c-672f87917a20 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:00:44 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc23732b-8a44-4c5b-82e6-7504b131697f]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:00:44 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbc17638-4ec2-4a5d-9f50-c32cf02d057e tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 16:00:44 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ec9410d-747d-475e-999c-672f87917a20 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iqKQHyYp {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:00:44 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ec9410d-747d-475e-999c-672f87917a20 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iqKQHyYp" returned: 0 in 0.020s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:00:44 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8871973-05e3-42cf-9d95-3b3d81195574]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:00:44 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbc17638-4ec2-4a5d-9f50-c32cf02d057e tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iqKQHyYp'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 16:00:44 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ec9410d-747d-475e-999c-672f87917a20 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:00:44 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ec9410d-747d-475e-999c-672f87917a20 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:00:44 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[fca943a1-3026-4ac6-a28e-145365a18387]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:00:44 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbc17638-4ec2-4a5d-9f50-c32cf02d057e tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 16:00:44 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:00:44 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:00:44 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[057f1603-0c7a-4663-98f9-46f64c1b94ca]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b1a81f9-4a84-4f9e-9b1a-86b0c17ed81c (non-flash)\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:00:44 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbc17638-4ec2-4a5d-9f50-c32cf02d057e tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 (non-flash)
Nov 28 16:00:44 user nova-compute[75176]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0 (non-flash)
Nov 28 16:00:44 user nova-compute[75176]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b1a81f9-4a84-4f9e-9b1a-86b0c17ed81c (non-flash)
Nov 28 16:00:44 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 16:00:44 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbc17638-4ec2-4a5d-9f50-c32cf02d057e tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 (non-flash)
Nov 28 16:00:44 user nova-compute[75176]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0 (non-flash)
Nov 28 16:00:44 user nova-compute[75176]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b1a81f9-4a84-4f9e-9b1a-86b0c17ed81c (non-flash)
Nov 28 16:00:44 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 16:00:44 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ec9410d-747d-475e-999c-672f87917a20 -p 172.16.0.220:3260 --login {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:00:44 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ec9410d-747d-475e-999c-672f87917a20 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:00:44 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f37085c-1af2-4d2b-96ff-6cca1966df05]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6ec9410d-747d-475e-999c-672f87917a20, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6ec9410d-747d-475e-999c-672f87917a20, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:00:44 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbc17638-4ec2-4a5d-9f50-c32cf02d057e tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6ec9410d-747d-475e-999c-672f87917a20, portal: 172.16.0.220,3260]
Nov 28 16:00:44 user nova-compute[75176]: Login to [iface: default, target: iqn.2010-10.org.openstack:6ec9410d-747d-475e-999c-672f87917a20, portal: 172.16.0.220,3260] successful.
Nov 28 16:00:44 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 16:00:44 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ec9410d-747d-475e-999c-672f87917a20 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:00:44 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ec9410d-747d-475e-999c-672f87917a20 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:00:44 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[ace0b62f-b2a9-49ec-92e8-6d35e5cb7b80]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:00:44 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbc17638-4ec2-4a5d-9f50-c32cf02d057e tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 16:00:44 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:00:44 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:00:44 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[d26dfbf4-9dd7-436c-9cfa-47726f274146]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b1a81f9-4a84-4f9e-9b1a-86b0c17ed81c (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ec9410d-747d-475e-999c-672f87917a20 (non-flash)\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:00:44 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbc17638-4ec2-4a5d-9f50-c32cf02d057e tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 (non-flash)
Nov 28 16:00:44 user nova-compute[75176]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0 (non-flash)
Nov 28 16:00:44 user nova-compute[75176]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b1a81f9-4a84-4f9e-9b1a-86b0c17ed81c (non-flash)
Nov 28 16:00:44 user nova-compute[75176]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ec9410d-747d-475e-999c-672f87917a20 (non-flash)
Nov 28 16:00:44 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 16:00:44 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbc17638-4ec2-4a5d-9f50-c32cf02d057e tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 (non-flash)
Nov 28 16:00:44 user nova-compute[75176]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0 (non-flash)
Nov 28 16:00:44 user nova-compute[75176]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b1a81f9-4a84-4f9e-9b1a-86b0c17ed81c (non-flash)
Nov 28 16:00:44 user nova-compute[75176]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ec9410d-747d-475e-999c-672f87917a20 (non-flash)
Nov 28 16:00:44 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 16:00:44 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-fbc17638-4ec2-4a5d-9f50-c32cf02d057e tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6ec9410d-747d-475e-999c-672f87917a20" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.286s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 16:00:44 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbc17638-4ec2-4a5d-9f50-c32cf02d057e tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Connected to 172.16.0.220:3260 {{(pid=75176) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 16:00:44 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-fbc17638-4ec2-4a5d-9f50-c32cf02d057e tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] HCTL ('36', '-', '-', 0) found on session 57 with lun 0 {{(pid=75176) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 16:00:44 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-fbc17638-4ec2-4a5d-9f50-c32cf02d057e tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75176) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 16:00:44 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:00:44 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:00:44 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[79a5d43f-1f54-4c7d-832b-216e3b09c96f]: (4, ('- - 0', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:00:44 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-fbc17638-4ec2-4a5d-9f50-c32cf02d057e tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Searching for a device in session 57 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75176) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 16:00:44 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbc17638-4ec2-4a5d-9f50-c32cf02d057e tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:6ec9410d-747d-475e-999c-672f87917a20', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iqKQHyYp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75176) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 16:00:44 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:00:45 user nova-compute[75176]: DEBUG nova.compute.manager [req-ce316800-8f9e-4885-a076-4bcce5e2d953 req-5fae592e-688e-45bb-804d-22609123800f service nova] [instance: 6c6a4729-9d51-4ebf-bad6-2022f35cbe3b] Received event network-vif-plugged-85a1de78-2430-4835-8122-95570636e300 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 16:00:45 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-ce316800-8f9e-4885-a076-4bcce5e2d953 req-5fae592e-688e-45bb-804d-22609123800f service nova] Acquiring lock "6c6a4729-9d51-4ebf-bad6-2022f35cbe3b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:00:45 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-ce316800-8f9e-4885-a076-4bcce5e2d953 req-5fae592e-688e-45bb-804d-22609123800f service nova] Lock "6c6a4729-9d51-4ebf-bad6-2022f35cbe3b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:00:45 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-ce316800-8f9e-4885-a076-4bcce5e2d953 req-5fae592e-688e-45bb-804d-22609123800f service nova] Lock "6c6a4729-9d51-4ebf-bad6-2022f35cbe3b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:00:45 user nova-compute[75176]: DEBUG nova.compute.manager [req-ce316800-8f9e-4885-a076-4bcce5e2d953 req-5fae592e-688e-45bb-804d-22609123800f service nova] [instance: 6c6a4729-9d51-4ebf-bad6-2022f35cbe3b] No waiting events found dispatching network-vif-plugged-85a1de78-2430-4835-8122-95570636e300 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 16:00:45 user nova-compute[75176]: WARNING nova.compute.manager [req-ce316800-8f9e-4885-a076-4bcce5e2d953 req-5fae592e-688e-45bb-804d-22609123800f service nova] [instance: 6c6a4729-9d51-4ebf-bad6-2022f35cbe3b] Received unexpected event network-vif-plugged-85a1de78-2430-4835-8122-95570636e300 for instance with vm_state building and task_state spawning.
Nov 28 16:00:45 user nova-compute[75176]: DEBUG nova.compute.manager [None req-d5105451-4526-426a-861d-b653aec0d5c1 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] [instance: 6c6a4729-9d51-4ebf-bad6-2022f35cbe3b] Instance event wait completed in 0 seconds for  {{(pid=75176) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 16:00:45 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-d5105451-4526-426a-861d-b653aec0d5c1 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] [instance: 6c6a4729-9d51-4ebf-bad6-2022f35cbe3b] Guest created on hypervisor {{(pid=75176) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 16:00:45 user nova-compute[75176]: INFO nova.virt.libvirt.driver [-] [instance: 6c6a4729-9d51-4ebf-bad6-2022f35cbe3b] Instance spawned successfully.
Nov 28 16:00:45 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-d5105451-4526-426a-861d-b653aec0d5c1 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] [instance: 6c6a4729-9d51-4ebf-bad6-2022f35cbe3b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 16:00:45 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-d5105451-4526-426a-861d-b653aec0d5c1 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] [instance: 6c6a4729-9d51-4ebf-bad6-2022f35cbe3b] Found default for hw_cdrom_bus of ide {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 16:00:45 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-d5105451-4526-426a-861d-b653aec0d5c1 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] [instance: 6c6a4729-9d51-4ebf-bad6-2022f35cbe3b] Found default for hw_disk_bus of virtio {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 16:00:45 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-d5105451-4526-426a-861d-b653aec0d5c1 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] [instance: 6c6a4729-9d51-4ebf-bad6-2022f35cbe3b] Found default for hw_input_bus of None {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 16:00:45 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-d5105451-4526-426a-861d-b653aec0d5c1 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] [instance: 6c6a4729-9d51-4ebf-bad6-2022f35cbe3b] Found default for hw_pointer_model of None {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 16:00:45 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-d5105451-4526-426a-861d-b653aec0d5c1 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] [instance: 6c6a4729-9d51-4ebf-bad6-2022f35cbe3b] Found default for hw_video_model of virtio {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 16:00:45 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-d5105451-4526-426a-861d-b653aec0d5c1 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] [instance: 6c6a4729-9d51-4ebf-bad6-2022f35cbe3b] Found default for hw_vif_model of virtio {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 16:00:45 user nova-compute[75176]: INFO nova.compute.manager [None req-d5105451-4526-426a-861d-b653aec0d5c1 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] [instance: 6c6a4729-9d51-4ebf-bad6-2022f35cbe3b] Took 5.77 seconds to spawn the instance on the hypervisor.
Nov 28 16:00:45 user nova-compute[75176]: DEBUG nova.compute.manager [None req-d5105451-4526-426a-861d-b653aec0d5c1 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] [instance: 6c6a4729-9d51-4ebf-bad6-2022f35cbe3b] Checking state {{(pid=75176) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 16:00:45 user nova-compute[75176]: INFO nova.compute.manager [None req-d5105451-4526-426a-861d-b653aec0d5c1 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] [instance: 6c6a4729-9d51-4ebf-bad6-2022f35cbe3b] Took 6.66 seconds to build instance.
Nov 28 16:00:45 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-d5105451-4526-426a-861d-b653aec0d5c1 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Lock "6c6a4729-9d51-4ebf-bad6-2022f35cbe3b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.763s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:00:45 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-fbc17638-4ec2-4a5d-9f50-c32cf02d057e tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.323s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 16:00:45 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbc17638-4ec2-4a5d-9f50-c32cf02d057e tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] <== connect_volume: return (1325ms) {'type': 'block', 'scsi_wwn': '23061623566656138', 'path': '/dev/sde'} {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 16:00:45 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fbc17638-4ec2-4a5d-9f50-c32cf02d057e tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: 1062234d-4890-46df-bb52-49c55b4af32b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23061623566656138', 'path': '/dev/sde'} {{(pid=75176) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 16:00:45 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-fbc17638-4ec2-4a5d-9f50-c32cf02d057e tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T16:00:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1609172901',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1609172901',id=47,image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bf05c8836b8a40de8e64c2d046ed71ff',ramdisk_id='',reservation_id='r-0qjqy9lv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1648409789',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T16:00:30Z,user_data=None,user_id='f24cedac95a44bb5a9ee54cc4713945c',uuid=1062234d-4890-46df-bb52-49c55b4af32b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3dd39a62-ef9c-4870-be88-578e41ff5013", "address": "fa:16:3e:10:e7:45", "network": {"id": "998766cd-2e8e-4e39-add9-286086640993", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-989265510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf05c8836b8a40de8e64c2d046ed71ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dd39a62-ef", "ovs_interfaceid": "3dd39a62-ef9c-4870-be88-578e41ff5013", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75176) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 16:00:45 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-fbc17638-4ec2-4a5d-9f50-c32cf02d057e tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Converting VIF {"id": "3dd39a62-ef9c-4870-be88-578e41ff5013", "address": "fa:16:3e:10:e7:45", "network": {"id": "998766cd-2e8e-4e39-add9-286086640993", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-989265510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf05c8836b8a40de8e64c2d046ed71ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dd39a62-ef", "ovs_interfaceid": "3dd39a62-ef9c-4870-be88-578e41ff5013", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 16:00:45 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-fbc17638-4ec2-4a5d-9f50-c32cf02d057e tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:e7:45,bridge_name='br-int',has_traffic_filtering=True,id=3dd39a62-ef9c-4870-be88-578e41ff5013,network=Network(998766cd-2e8e-4e39-add9-286086640993),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3dd39a62-ef') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 16:00:45 user nova-compute[75176]: DEBUG nova.objects.instance [None req-fbc17638-4ec2-4a5d-9f50-c32cf02d057e tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Lazy-loading 'pci_devices' on Instance uuid 1062234d-4890-46df-bb52-49c55b4af32b {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 16:00:45 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-fbc17638-4ec2-4a5d-9f50-c32cf02d057e tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: 1062234d-4890-46df-bb52-49c55b4af32b] End _get_guest_xml xml=<domain type="kvm">
Nov 28 16:00:45 user nova-compute[75176]:   <uuid>1062234d-4890-46df-bb52-49c55b4af32b</uuid>
Nov 28 16:00:45 user nova-compute[75176]:   <name>instance-0000002f</name>
Nov 28 16:00:45 user nova-compute[75176]:   <memory>524288</memory>
Nov 28 16:00:45 user nova-compute[75176]:   <vcpu>1</vcpu>
Nov 28 16:00:45 user nova-compute[75176]:   <metadata>
Nov 28 16:00:45 user nova-compute[75176]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 16:00:45 user nova-compute[75176]:       <nova:package version="0.0.0"/>
Nov 28 16:00:45 user nova-compute[75176]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1609172901</nova:name>
Nov 28 16:00:45 user nova-compute[75176]:       <nova:creationTime>2023-11-28 16:00:44</nova:creationTime>
Nov 28 16:00:45 user nova-compute[75176]:       <nova:flavor name="m1.tiny">
Nov 28 16:00:45 user nova-compute[75176]:         <nova:memory>512</nova:memory>
Nov 28 16:00:45 user nova-compute[75176]:         <nova:disk>1</nova:disk>
Nov 28 16:00:45 user nova-compute[75176]:         <nova:swap>0</nova:swap>
Nov 28 16:00:45 user nova-compute[75176]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 16:00:45 user nova-compute[75176]:         <nova:vcpus>1</nova:vcpus>
Nov 28 16:00:45 user nova-compute[75176]:       </nova:flavor>
Nov 28 16:00:45 user nova-compute[75176]:       <nova:owner>
Nov 28 16:00:45 user nova-compute[75176]:         <nova:user uuid="f24cedac95a44bb5a9ee54cc4713945c">tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member</nova:user>
Nov 28 16:00:45 user nova-compute[75176]:         <nova:project uuid="bf05c8836b8a40de8e64c2d046ed71ff">tempest-ServerBootFromVolumeStableRescueTest-1648409789</nova:project>
Nov 28 16:00:45 user nova-compute[75176]:       </nova:owner>
Nov 28 16:00:45 user nova-compute[75176]:       <nova:root type="image" uuid="1f41819e-c93f-4dc7-b253-37a27bbbbc74"/>
Nov 28 16:00:45 user nova-compute[75176]:       <nova:ports>
Nov 28 16:00:45 user nova-compute[75176]:         <nova:port uuid="3dd39a62-ef9c-4870-be88-578e41ff5013">
Nov 28 16:00:45 user nova-compute[75176]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 28 16:00:45 user nova-compute[75176]:         </nova:port>
Nov 28 16:00:45 user nova-compute[75176]:       </nova:ports>
Nov 28 16:00:45 user nova-compute[75176]:     </nova:instance>
Nov 28 16:00:45 user nova-compute[75176]:   </metadata>
Nov 28 16:00:45 user nova-compute[75176]:   <sysinfo type="smbios">
Nov 28 16:00:45 user nova-compute[75176]:     <system>
Nov 28 16:00:45 user nova-compute[75176]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 16:00:45 user nova-compute[75176]:       <entry name="product">OpenStack Nova</entry>
Nov 28 16:00:45 user nova-compute[75176]:       <entry name="version">0.0.0</entry>
Nov 28 16:00:45 user nova-compute[75176]:       <entry name="serial">1062234d-4890-46df-bb52-49c55b4af32b</entry>
Nov 28 16:00:45 user nova-compute[75176]:       <entry name="uuid">1062234d-4890-46df-bb52-49c55b4af32b</entry>
Nov 28 16:00:45 user nova-compute[75176]:       <entry name="family">Virtual Machine</entry>
Nov 28 16:00:45 user nova-compute[75176]:     </system>
Nov 28 16:00:45 user nova-compute[75176]:   </sysinfo>
Nov 28 16:00:45 user nova-compute[75176]:   <os>
Nov 28 16:00:45 user nova-compute[75176]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 16:00:45 user nova-compute[75176]:     <boot dev="hd"/>
Nov 28 16:00:45 user nova-compute[75176]:     <smbios mode="sysinfo"/>
Nov 28 16:00:45 user nova-compute[75176]:   </os>
Nov 28 16:00:45 user nova-compute[75176]:   <features>
Nov 28 16:00:45 user nova-compute[75176]:     <acpi/>
Nov 28 16:00:45 user nova-compute[75176]:     <apic/>
Nov 28 16:00:45 user nova-compute[75176]:     <vmcoreinfo/>
Nov 28 16:00:45 user nova-compute[75176]:   </features>
Nov 28 16:00:45 user nova-compute[75176]:   <clock offset="utc">
Nov 28 16:00:45 user nova-compute[75176]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 16:00:45 user nova-compute[75176]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 16:00:45 user nova-compute[75176]:     <timer name="hpet" present="no"/>
Nov 28 16:00:45 user nova-compute[75176]:   </clock>
Nov 28 16:00:45 user nova-compute[75176]:   <cpu mode="custom" match="exact">
Nov 28 16:00:45 user nova-compute[75176]:     <model>Nehalem</model>
Nov 28 16:00:45 user nova-compute[75176]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 16:00:45 user nova-compute[75176]:   </cpu>
Nov 28 16:00:45 user nova-compute[75176]:   <devices>
Nov 28 16:00:45 user nova-compute[75176]:     <disk type="block" device="disk">
Nov 28 16:00:45 user nova-compute[75176]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 16:00:45 user nova-compute[75176]:       <source dev="/dev/sde"/>
Nov 28 16:00:45 user nova-compute[75176]:       <target dev="vda" bus="virtio"/>
Nov 28 16:00:45 user nova-compute[75176]:       <serial>6ec9410d-747d-475e-999c-672f87917a20</serial>
Nov 28 16:00:45 user nova-compute[75176]:     </disk>
Nov 28 16:00:45 user nova-compute[75176]:     <interface type="ethernet">
Nov 28 16:00:45 user nova-compute[75176]:       <mac address="fa:16:3e:10:e7:45"/>
Nov 28 16:00:45 user nova-compute[75176]:       <model type="virtio"/>
Nov 28 16:00:45 user nova-compute[75176]:       <mtu size="1442"/>
Nov 28 16:00:45 user nova-compute[75176]:       <target dev="tap3dd39a62-ef"/>
Nov 28 16:00:45 user nova-compute[75176]:     </interface>
Nov 28 16:00:45 user nova-compute[75176]:     <serial type="pty">
Nov 28 16:00:45 user nova-compute[75176]:       <log file="/opt/stack/data/nova/instances/1062234d-4890-46df-bb52-49c55b4af32b/console.log" append="off"/>
Nov 28 16:00:45 user nova-compute[75176]:     </serial>
Nov 28 16:00:45 user nova-compute[75176]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 16:00:45 user nova-compute[75176]:     <video>
Nov 28 16:00:45 user nova-compute[75176]:       <model type="virtio"/>
Nov 28 16:00:45 user nova-compute[75176]:     </video>
Nov 28 16:00:45 user nova-compute[75176]:     <rng model="virtio">
Nov 28 16:00:45 user nova-compute[75176]:       <backend model="random">/dev/urandom</backend>
Nov 28 16:00:45 user nova-compute[75176]:     </rng>
Nov 28 16:00:45 user nova-compute[75176]:     <controller type="usb" index="0" model="none"/>
Nov 28 16:00:45 user nova-compute[75176]:     <memballoon model="virtio">
Nov 28 16:00:45 user nova-compute[75176]:       <stats period="10"/>
Nov 28 16:00:45 user nova-compute[75176]:     </memballoon>
Nov 28 16:00:45 user nova-compute[75176]:   </devices>
Nov 28 16:00:45 user nova-compute[75176]: </domain>
Nov 28 16:00:45 user nova-compute[75176]:  {{(pid=75176) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 16:00:45 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-fbc17638-4ec2-4a5d-9f50-c32cf02d057e tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T16:00:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1609172901',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1609172901',id=47,image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bf05c8836b8a40de8e64c2d046ed71ff',ramdisk_id='',reservation_id='r-0qjqy9lv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1648409789',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T16:00:30Z,user_data=None,user_id='f24cedac95a44bb5a9ee54cc4713945c',uuid=1062234d-4890-46df-bb52-49c55b4af32b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3dd39a62-ef9c-4870-be88-578e41ff5013", "address": "fa:16:3e:10:e7:45", "network": {"id": "998766cd-2e8e-4e39-add9-286086640993", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-989265510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf05c8836b8a40de8e64c2d046ed71ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dd39a62-ef", "ovs_interfaceid": "3dd39a62-ef9c-4870-be88-578e41ff5013", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 16:00:45 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-fbc17638-4ec2-4a5d-9f50-c32cf02d057e tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Converting VIF {"id": "3dd39a62-ef9c-4870-be88-578e41ff5013", "address": "fa:16:3e:10:e7:45", "network": {"id": "998766cd-2e8e-4e39-add9-286086640993", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-989265510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf05c8836b8a40de8e64c2d046ed71ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dd39a62-ef", "ovs_interfaceid": "3dd39a62-ef9c-4870-be88-578e41ff5013", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 16:00:45 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-fbc17638-4ec2-4a5d-9f50-c32cf02d057e tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:e7:45,bridge_name='br-int',has_traffic_filtering=True,id=3dd39a62-ef9c-4870-be88-578e41ff5013,network=Network(998766cd-2e8e-4e39-add9-286086640993),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3dd39a62-ef') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 16:00:45 user nova-compute[75176]: DEBUG os_vif [None req-fbc17638-4ec2-4a5d-9f50-c32cf02d057e tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:e7:45,bridge_name='br-int',has_traffic_filtering=True,id=3dd39a62-ef9c-4870-be88-578e41ff5013,network=Network(998766cd-2e8e-4e39-add9-286086640993),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3dd39a62-ef') {{(pid=75176) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 16:00:45 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:00:45 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 16:00:45 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 16:00:45 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:00:45 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a35eba53-ef8b-5ada-9120-f5168a6b459e', '_type': 'linux-noop'}}, row=False) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 16:00:45 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:00:45 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:00:45 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:00:45 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3dd39a62-ef, may_exist=True, interface_attrs={}) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 16:00:45 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3dd39a62-ef, col_values=(('qos', UUID('bbfc0a4a-d7f5-45c2-9fb3-dae4b590f683')),), if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 16:00:45 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3dd39a62-ef, col_values=(('external_ids', {'iface-id': '3dd39a62-ef9c-4870-be88-578e41ff5013', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:10:e7:45', 'vm-uuid': '1062234d-4890-46df-bb52-49c55b4af32b'}),), if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 16:00:45 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:00:45 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 16:00:45 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:00:45 user nova-compute[75176]: INFO os_vif [None req-fbc17638-4ec2-4a5d-9f50-c32cf02d057e tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:e7:45,bridge_name='br-int',has_traffic_filtering=True,id=3dd39a62-ef9c-4870-be88-578e41ff5013,network=Network(998766cd-2e8e-4e39-add9-286086640993),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3dd39a62-ef')
Nov 28 16:00:45 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-fbc17638-4ec2-4a5d-9f50-c32cf02d057e tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] No BDM found with device name vda, not building metadata. {{(pid=75176) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 16:00:45 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-fbc17638-4ec2-4a5d-9f50-c32cf02d057e tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] No VIF found with MAC fa:16:3e:10:e7:45, not building metadata {{(pid=75176) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 16:00:46 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:00:47 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:00:47 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:00:47 user nova-compute[75176]: DEBUG nova.compute.manager [req-81fac094-637a-4c63-be26-08d09c5787ca req-8e46a5fe-eecd-4075-a915-4198bb094739 service nova] [instance: 1062234d-4890-46df-bb52-49c55b4af32b] Received event network-vif-plugged-3dd39a62-ef9c-4870-be88-578e41ff5013 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 16:00:47 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-81fac094-637a-4c63-be26-08d09c5787ca req-8e46a5fe-eecd-4075-a915-4198bb094739 service nova] Acquiring lock "1062234d-4890-46df-bb52-49c55b4af32b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:00:47 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-81fac094-637a-4c63-be26-08d09c5787ca req-8e46a5fe-eecd-4075-a915-4198bb094739 service nova] Lock "1062234d-4890-46df-bb52-49c55b4af32b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:00:47 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-81fac094-637a-4c63-be26-08d09c5787ca req-8e46a5fe-eecd-4075-a915-4198bb094739 service nova] Lock "1062234d-4890-46df-bb52-49c55b4af32b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:00:47 user nova-compute[75176]: DEBUG nova.compute.manager [req-81fac094-637a-4c63-be26-08d09c5787ca req-8e46a5fe-eecd-4075-a915-4198bb094739 service nova] [instance: 1062234d-4890-46df-bb52-49c55b4af32b] No waiting events found dispatching network-vif-plugged-3dd39a62-ef9c-4870-be88-578e41ff5013 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 16:00:47 user nova-compute[75176]: WARNING nova.compute.manager [req-81fac094-637a-4c63-be26-08d09c5787ca req-8e46a5fe-eecd-4075-a915-4198bb094739 service nova] [instance: 1062234d-4890-46df-bb52-49c55b4af32b] Received unexpected event network-vif-plugged-3dd39a62-ef9c-4870-be88-578e41ff5013 for instance with vm_state building and task_state spawning.
Nov 28 16:00:47 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:00:47 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:00:49 user nova-compute[75176]: DEBUG nova.compute.manager [None req-fbc17638-4ec2-4a5d-9f50-c32cf02d057e tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: 1062234d-4890-46df-bb52-49c55b4af32b] Instance event wait completed in 0 seconds for  {{(pid=75176) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 16:00:49 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-fbc17638-4ec2-4a5d-9f50-c32cf02d057e tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: 1062234d-4890-46df-bb52-49c55b4af32b] Guest created on hypervisor {{(pid=75176) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 16:00:49 user nova-compute[75176]: INFO nova.virt.libvirt.driver [-] [instance: 1062234d-4890-46df-bb52-49c55b4af32b] Instance spawned successfully.
Nov 28 16:00:49 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-fbc17638-4ec2-4a5d-9f50-c32cf02d057e tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: 1062234d-4890-46df-bb52-49c55b4af32b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 16:00:49 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-fbc17638-4ec2-4a5d-9f50-c32cf02d057e tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: 1062234d-4890-46df-bb52-49c55b4af32b] Found default for hw_cdrom_bus of ide {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 16:00:49 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-fbc17638-4ec2-4a5d-9f50-c32cf02d057e tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: 1062234d-4890-46df-bb52-49c55b4af32b] Found default for hw_disk_bus of virtio {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 16:00:49 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-fbc17638-4ec2-4a5d-9f50-c32cf02d057e tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: 1062234d-4890-46df-bb52-49c55b4af32b] Found default for hw_input_bus of None {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 16:00:49 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-fbc17638-4ec2-4a5d-9f50-c32cf02d057e tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: 1062234d-4890-46df-bb52-49c55b4af32b] Found default for hw_pointer_model of None {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 16:00:49 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-fbc17638-4ec2-4a5d-9f50-c32cf02d057e tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: 1062234d-4890-46df-bb52-49c55b4af32b] Found default for hw_video_model of virtio {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 16:00:49 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-fbc17638-4ec2-4a5d-9f50-c32cf02d057e tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: 1062234d-4890-46df-bb52-49c55b4af32b] Found default for hw_vif_model of virtio {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 16:00:49 user nova-compute[75176]: DEBUG nova.compute.manager [req-a6f119f6-3a18-4092-81a7-bb1e8f00060e req-08461dbe-b3ea-40c2-a0d2-ff9fe82a03ea service nova] [instance: 1062234d-4890-46df-bb52-49c55b4af32b] Received event network-vif-plugged-3dd39a62-ef9c-4870-be88-578e41ff5013 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 16:00:49 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-a6f119f6-3a18-4092-81a7-bb1e8f00060e req-08461dbe-b3ea-40c2-a0d2-ff9fe82a03ea service nova] Acquiring lock "1062234d-4890-46df-bb52-49c55b4af32b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:00:49 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-a6f119f6-3a18-4092-81a7-bb1e8f00060e req-08461dbe-b3ea-40c2-a0d2-ff9fe82a03ea service nova] Lock "1062234d-4890-46df-bb52-49c55b4af32b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:00:49 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-a6f119f6-3a18-4092-81a7-bb1e8f00060e req-08461dbe-b3ea-40c2-a0d2-ff9fe82a03ea service nova] Lock "1062234d-4890-46df-bb52-49c55b4af32b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:00:49 user nova-compute[75176]: DEBUG nova.compute.manager [req-a6f119f6-3a18-4092-81a7-bb1e8f00060e req-08461dbe-b3ea-40c2-a0d2-ff9fe82a03ea service nova] [instance: 1062234d-4890-46df-bb52-49c55b4af32b] No waiting events found dispatching network-vif-plugged-3dd39a62-ef9c-4870-be88-578e41ff5013 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 16:00:49 user nova-compute[75176]: WARNING nova.compute.manager [req-a6f119f6-3a18-4092-81a7-bb1e8f00060e req-08461dbe-b3ea-40c2-a0d2-ff9fe82a03ea service nova] [instance: 1062234d-4890-46df-bb52-49c55b4af32b] Received unexpected event network-vif-plugged-3dd39a62-ef9c-4870-be88-578e41ff5013 for instance with vm_state building and task_state spawning.
Nov 28 16:00:49 user nova-compute[75176]: INFO nova.compute.manager [None req-fbc17638-4ec2-4a5d-9f50-c32cf02d057e tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: 1062234d-4890-46df-bb52-49c55b4af32b] Took 5.17 seconds to spawn the instance on the hypervisor.
Nov 28 16:00:49 user nova-compute[75176]: DEBUG nova.compute.manager [None req-fbc17638-4ec2-4a5d-9f50-c32cf02d057e tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: 1062234d-4890-46df-bb52-49c55b4af32b] Checking state {{(pid=75176) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 16:00:49 user nova-compute[75176]: INFO nova.compute.manager [None req-fbc17638-4ec2-4a5d-9f50-c32cf02d057e tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: 1062234d-4890-46df-bb52-49c55b4af32b] Took 19.83 seconds to build instance.
Nov 28 16:00:49 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-fbc17638-4ec2-4a5d-9f50-c32cf02d057e tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Lock "1062234d-4890-46df-bb52-49c55b4af32b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.939s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:00:49 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:00:50 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:00:55 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 16:00:58 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:00:58 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:00:59 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:01:00 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:01:02 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:01:04 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:01:05 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:01:05 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:01:06 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:01:06 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:01:06 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75176) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 16:01:07 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-b0e3a84f-ed56-4cda-8c12-dc4b244758f0 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Acquiring lock "e0b7a064-03b6-4a0d-88be-2f12c12a1ddb" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:01:07 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-b0e3a84f-ed56-4cda-8c12-dc4b244758f0 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Lock "e0b7a064-03b6-4a0d-88be-2f12c12a1ddb" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:01:07 user nova-compute[75176]: DEBUG nova.objects.instance [None req-b0e3a84f-ed56-4cda-8c12-dc4b244758f0 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Lazy-loading 'flavor' on Instance uuid e0b7a064-03b6-4a0d-88be-2f12c12a1ddb {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 16:01:07 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-b0e3a84f-ed56-4cda-8c12-dc4b244758f0 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Lock "e0b7a064-03b6-4a0d-88be-2f12c12a1ddb" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:01:07 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-b0e3a84f-ed56-4cda-8c12-dc4b244758f0 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Acquiring lock "e0b7a064-03b6-4a0d-88be-2f12c12a1ddb" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:01:07 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-b0e3a84f-ed56-4cda-8c12-dc4b244758f0 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Lock "e0b7a064-03b6-4a0d-88be-2f12c12a1ddb" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:01:07 user nova-compute[75176]: INFO nova.compute.manager [None req-b0e3a84f-ed56-4cda-8c12-dc4b244758f0 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] [instance: e0b7a064-03b6-4a0d-88be-2f12c12a1ddb] Attaching volume 62c5ff84-c288-4a6d-b7c1-9e7beccc4c85 to /dev/vdb
Nov 28 16:01:07 user nova-compute[75176]: DEBUG os_brick.utils [None req-b0e3a84f-ed56-4cda-8c12-dc4b244758f0 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 16:01:07 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:01:07 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:01:07 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[21904f18-b5e4-44f3-b8a8-442fbf0dbe9d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:edc924a949b2\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:01:07 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:01:07 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:01:07 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[977bd0fd-998d-45c0-a868-6a62fe5f023e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:01:07 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:01:07 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:01:07 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[b54f20c6-6ade-4013-b5d1-344759736427]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:01:07 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3c9578f-f28c-4bf8-a81d-9146de5eed85]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:01:07 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-b0e3a84f-ed56-4cda-8c12-dc4b244758f0 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Running cmd (subprocess): nvme version {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:01:07 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-b0e3a84f-ed56-4cda-8c12-dc4b244758f0 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] 'nvme version' failed. Not Retrying. {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 16:01:07 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b0e3a84f-ed56-4cda-8c12-dc4b244758f0 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] nvme not present on system {{(pid=75176) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 16:01:07 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:01:07 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 16:01:07 user nova-compute[75176]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 16:01:07 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdfc4e9a-29bd-4b75-b671-fb5506359ef3]: (4, '') {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:01:08 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.lightos [None req-b0e3a84f-ed56-4cda-8c12-dc4b244758f0 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75176) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 16:01:08 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.lightos [None req-b0e3a84f-ed56-4cda-8c12-dc4b244758f0 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75176) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 16:01:08 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.lightos [None req-b0e3a84f-ed56-4cda-8c12-dc4b244758f0 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] LIGHTOS: no hostnqn found. {{(pid=75176) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 16:01:08 user nova-compute[75176]: DEBUG os_brick.utils [None req-b0e3a84f-ed56-4cda-8c12-dc4b244758f0 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:edc924a949b2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 16:01:08 user nova-compute[75176]: DEBUG nova.virt.block_device [None req-b0e3a84f-ed56-4cda-8c12-dc4b244758f0 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] [instance: e0b7a064-03b6-4a0d-88be-2f12c12a1ddb] Updating existing volume attachment record: 1461baf3-bb30-4c66-9ef0-a411ab46c3d9 {{(pid=75176) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 16:01:08 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:01:08 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Starting heal instance info cache {{(pid=75176) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 16:01:08 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquiring lock "refresh_cache-8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 16:01:08 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquired lock "refresh_cache-8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 16:01:08 user nova-compute[75176]: DEBUG nova.network.neutron [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] [instance: 8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7] Forcefully refreshing network info cache for instance {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 16:01:09 user nova-compute[75176]: DEBUG nova.network.neutron [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] [instance: 8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7] Updating instance_info_cache with network_info: [{"id": "dcbed8eb-5414-44c1-a7d9-2358d4549f99", "address": "fa:16:3e:fd:e1:90", "network": {"id": "d47c1797-a66f-4f2d-b83e-903b5bd3251c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1416388789-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd2856ce0a2545cda0b796eb0be10a40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcbed8eb-54", "ovs_interfaceid": "dcbed8eb-5414-44c1-a7d9-2358d4549f99", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 16:01:09 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Releasing lock "refresh_cache-8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 16:01:09 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] [instance: 8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7] Updated the network info_cache for instance {{(pid=75176) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 16:01:09 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:01:09 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:01:10 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:01:14 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:01:14 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:01:14 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:01:14 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:01:14 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Auditing locally available compute resources for user (node: user) {{(pid=75176) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 16:01:14 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:01:14 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75176) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 16:01:14 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55febf04-14ea-4903-8692-c7cc6115de75/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:01:15 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55febf04-14ea-4903-8692-c7cc6115de75/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:01:15 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55febf04-14ea-4903-8692-c7cc6115de75/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:01:15 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55febf04-14ea-4903-8692-c7cc6115de75/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:01:15 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c6a4729-9d51-4ebf-bad6-2022f35cbe3b/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:01:15 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c6a4729-9d51-4ebf-bad6-2022f35cbe3b/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:01:15 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c6a4729-9d51-4ebf-bad6-2022f35cbe3b/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:01:15 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b0e3a84f-ed56-4cda-8c12-dc4b244758f0 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] [instance: e0b7a064-03b6-4a0d-88be-2f12c12a1ddb] Calling os-brick to attach iSCSI Volume {{(pid=75176) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 16:01:15 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0e3a84f-ed56-4cda-8c12-dc4b244758f0 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c1b8a00>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:62c5ff84-c288-4a6d-b7c1-9e7beccc4c85', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dsuRWUlF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 16:01:15 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-b0e3a84f-ed56-4cda-8c12-dc4b244758f0 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 16:01:15 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-b0e3a84f-ed56-4cda-8c12-dc4b244758f0 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 16:01:15 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-b0e3a84f-ed56-4cda-8c12-dc4b244758f0 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 16:01:15 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-b0e3a84f-ed56-4cda-8c12-dc4b244758f0 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 16:01:15 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-b0e3a84f-ed56-4cda-8c12-dc4b244758f0 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:62c5ff84-c288-4a6d-b7c1-9e7beccc4c85" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 16:01:15 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-b0e3a84f-ed56-4cda-8c12-dc4b244758f0 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:62c5ff84-c288-4a6d-b7c1-9e7beccc4c85" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 16:01:15 user nova-compute[75176]: INFO os_brick.initiator.connectors.iscsi [None req-b0e3a84f-ed56-4cda-8c12-dc4b244758f0 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 16:01:15 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62c5ff84-c288-4a6d-b7c1-9e7beccc4c85 -p 172.16.0.220:3260 {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:01:15 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62c5ff84-c288-4a6d-b7c1-9e7beccc4c85 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:01:15 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[db82d80f-e55d-4d1f-b392-7ff15b2cca54]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:01:15 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0e3a84f-ed56-4cda-8c12-dc4b244758f0 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 16:01:15 user nova-compute[75176]:  {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 16:01:15 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62c5ff84-c288-4a6d-b7c1-9e7beccc4c85 -p 172.16.0.220:3260 --interface default --op new {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:01:15 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62c5ff84-c288-4a6d-b7c1-9e7beccc4c85 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:01:15 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[439c225f-7581-4e09-9529-9762f13a4714]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:62c5ff84-c288-4a6d-b7c1-9e7beccc4c85] added\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:01:15 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0e3a84f-ed56-4cda-8c12-dc4b244758f0 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:62c5ff84-c288-4a6d-b7c1-9e7beccc4c85] added
Nov 28 16:01:15 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 16:01:15 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62c5ff84-c288-4a6d-b7c1-9e7beccc4c85 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:01:15 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62c5ff84-c288-4a6d-b7c1-9e7beccc4c85 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:01:15 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[22455b3a-9940-405a-ba13-255677fd7661]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:01:15 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0e3a84f-ed56-4cda-8c12-dc4b244758f0 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 16:01:15 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62c5ff84-c288-4a6d-b7c1-9e7beccc4c85 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:01:15 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:01:15 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c6a4729-9d51-4ebf-bad6-2022f35cbe3b/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:01:15 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecf38787-0a69-4f35-b121-3dc6e70023a1/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:01:15 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62c5ff84-c288-4a6d-b7c1-9e7beccc4c85 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:01:15 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ce69ff8-4817-4fbb-bcc6-9a6d9761813e]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:01:15 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0e3a84f-ed56-4cda-8c12-dc4b244758f0 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 16:01:15 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62c5ff84-c288-4a6d-b7c1-9e7beccc4c85 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dsuRWUlF {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:01:15 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62c5ff84-c288-4a6d-b7c1-9e7beccc4c85 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dsuRWUlF" returned: 0 in 0.019s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:01:15 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[39359952-caed-4605-b669-8e4723fc2f3c]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:01:15 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0e3a84f-ed56-4cda-8c12-dc4b244758f0 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dsuRWUlF'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 16:01:15 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62c5ff84-c288-4a6d-b7c1-9e7beccc4c85 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:01:15 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62c5ff84-c288-4a6d-b7c1-9e7beccc4c85 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:01:15 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bcc6488-1ec8-4fe7-bc0c-bbc64d9fa6c6]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:01:15 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0e3a84f-ed56-4cda-8c12-dc4b244758f0 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 16:01:15 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:01:15 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:01:15 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0d33415-3461-4f4c-84e7-b42521713776]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b1a81f9-4a84-4f9e-9b1a-86b0c17ed81c (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ec9410d-747d-475e-999c-672f87917a20 (non-flash)\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:01:15 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0e3a84f-ed56-4cda-8c12-dc4b244758f0 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 (non-flash)
Nov 28 16:01:15 user nova-compute[75176]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0 (non-flash)
Nov 28 16:01:15 user nova-compute[75176]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b1a81f9-4a84-4f9e-9b1a-86b0c17ed81c (non-flash)
Nov 28 16:01:15 user nova-compute[75176]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ec9410d-747d-475e-999c-672f87917a20 (non-flash)
Nov 28 16:01:15 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 16:01:15 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0e3a84f-ed56-4cda-8c12-dc4b244758f0 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 (non-flash)
Nov 28 16:01:15 user nova-compute[75176]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0 (non-flash)
Nov 28 16:01:15 user nova-compute[75176]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b1a81f9-4a84-4f9e-9b1a-86b0c17ed81c (non-flash)
Nov 28 16:01:15 user nova-compute[75176]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ec9410d-747d-475e-999c-672f87917a20 (non-flash)
Nov 28 16:01:15 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 16:01:15 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62c5ff84-c288-4a6d-b7c1-9e7beccc4c85 -p 172.16.0.220:3260 --login {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:01:15 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecf38787-0a69-4f35-b121-3dc6e70023a1/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:01:15 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecf38787-0a69-4f35-b121-3dc6e70023a1/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:01:15 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62c5ff84-c288-4a6d-b7c1-9e7beccc4c85 -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:01:15 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2b87b9f-95a4-49e0-b68d-5bc0660b8673]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:62c5ff84-c288-4a6d-b7c1-9e7beccc4c85, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:62c5ff84-c288-4a6d-b7c1-9e7beccc4c85, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:01:15 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0e3a84f-ed56-4cda-8c12-dc4b244758f0 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:62c5ff84-c288-4a6d-b7c1-9e7beccc4c85, portal: 172.16.0.220,3260]
Nov 28 16:01:15 user nova-compute[75176]: Login to [iface: default, target: iqn.2010-10.org.openstack:62c5ff84-c288-4a6d-b7c1-9e7beccc4c85, portal: 172.16.0.220,3260] successful.
Nov 28 16:01:15 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 16:01:15 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62c5ff84-c288-4a6d-b7c1-9e7beccc4c85 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:01:15 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62c5ff84-c288-4a6d-b7c1-9e7beccc4c85 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:01:15 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[3591ad56-8c03-448b-965a-f97081dc5ec3]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:01:15 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0e3a84f-ed56-4cda-8c12-dc4b244758f0 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 16:01:15 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:01:15 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:01:15 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[672ca551-3d8a-43b0-a614-0e88308d072a]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b1a81f9-4a84-4f9e-9b1a-86b0c17ed81c (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ec9410d-747d-475e-999c-672f87917a20 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62c5ff84-c288-4a6d-b7c1-9e7beccc4c85 (non-flash)\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:01:15 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0e3a84f-ed56-4cda-8c12-dc4b244758f0 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 (non-flash)
Nov 28 16:01:15 user nova-compute[75176]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0 (non-flash)
Nov 28 16:01:15 user nova-compute[75176]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b1a81f9-4a84-4f9e-9b1a-86b0c17ed81c (non-flash)
Nov 28 16:01:15 user nova-compute[75176]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ec9410d-747d-475e-999c-672f87917a20 (non-flash)
Nov 28 16:01:15 user nova-compute[75176]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62c5ff84-c288-4a6d-b7c1-9e7beccc4c85 (non-flash)
Nov 28 16:01:15 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 16:01:15 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0e3a84f-ed56-4cda-8c12-dc4b244758f0 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 (non-flash)
Nov 28 16:01:15 user nova-compute[75176]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0 (non-flash)
Nov 28 16:01:15 user nova-compute[75176]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b1a81f9-4a84-4f9e-9b1a-86b0c17ed81c (non-flash)
Nov 28 16:01:15 user nova-compute[75176]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ec9410d-747d-475e-999c-672f87917a20 (non-flash)
Nov 28 16:01:15 user nova-compute[75176]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62c5ff84-c288-4a6d-b7c1-9e7beccc4c85 (non-flash)
Nov 28 16:01:15 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 16:01:15 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-b0e3a84f-ed56-4cda-8c12-dc4b244758f0 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:62c5ff84-c288-4a6d-b7c1-9e7beccc4c85" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.372s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 16:01:15 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0e3a84f-ed56-4cda-8c12-dc4b244758f0 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Connected to 172.16.0.220:3260 {{(pid=75176) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 16:01:15 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-b0e3a84f-ed56-4cda-8c12-dc4b244758f0 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] HCTL ('37', '-', '-', 0) found on session 58 with lun 0 {{(pid=75176) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 16:01:15 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-b0e3a84f-ed56-4cda-8c12-dc4b244758f0 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75176) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 16:01:15 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:01:16 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:01:16 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[53779fc7-24d8-47b8-a7a2-19ee4531f8f0]: (4, ('- - 0', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:01:16 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-b0e3a84f-ed56-4cda-8c12-dc4b244758f0 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Searching for a device in session 58 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75176) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 16:01:16 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0e3a84f-ed56-4cda-8c12-dc4b244758f0 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:62c5ff84-c288-4a6d-b7c1-9e7beccc4c85', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dsuRWUlF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75176) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 16:01:16 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecf38787-0a69-4f35-b121-3dc6e70023a1/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:01:16 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0b7a064-03b6-4a0d-88be-2f12c12a1ddb/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:01:16 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0b7a064-03b6-4a0d-88be-2f12c12a1ddb/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:01:16 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0b7a064-03b6-4a0d-88be-2f12c12a1ddb/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:01:16 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0b7a064-03b6-4a0d-88be-2f12c12a1ddb/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:01:16 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/726344c0-a0dc-48d5-a18f-8a258ebde87d/disk.rescue --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:01:16 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/726344c0-a0dc-48d5-a18f-8a258ebde87d/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:01:16 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/726344c0-a0dc-48d5-a18f-8a258ebde87d/disk.rescue --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:01:16 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/726344c0-a0dc-48d5-a18f-8a258ebde87d/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:01:16 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] skipping disk /opt/stack/data/nova/instances/726344c0-a0dc-48d5-a18f-8a258ebde87d/disk (vdb) as it is a volume {{(pid=75176) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 16:01:16 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75176) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 16:01:16 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66ead7d-98f4-4822-9dce-f2ea0206a58d/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:01:17 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-b0e3a84f-ed56-4cda-8c12-dc4b244758f0 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.412s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 16:01:17 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0e3a84f-ed56-4cda-8c12-dc4b244758f0 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] <== connect_volume: return (1417ms) {'type': 'block', 'scsi_wwn': '23866323661653661', 'path': '/dev/sdf'} {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 16:01:17 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b0e3a84f-ed56-4cda-8c12-dc4b244758f0 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] [instance: e0b7a064-03b6-4a0d-88be-2f12c12a1ddb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23866323661653661', 'path': '/dev/sdf'} {{(pid=75176) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 16:01:17 user nova-compute[75176]: DEBUG nova.objects.instance [None req-b0e3a84f-ed56-4cda-8c12-dc4b244758f0 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Lazy-loading 'flavor' on Instance uuid e0b7a064-03b6-4a0d-88be-2f12c12a1ddb {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 16:01:17 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66ead7d-98f4-4822-9dce-f2ea0206a58d/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:01:17 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66ead7d-98f4-4822-9dce-f2ea0206a58d/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:01:17 user nova-compute[75176]: DEBUG nova.virt.libvirt.guest [None req-b0e3a84f-ed56-4cda-8c12-dc4b244758f0 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 16:01:17 user nova-compute[75176]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 16:01:17 user nova-compute[75176]:   <source dev="/dev/sdf"/>
Nov 28 16:01:17 user nova-compute[75176]:   <target dev="vdb" bus="virtio"/>
Nov 28 16:01:17 user nova-compute[75176]:   <serial>62c5ff84-c288-4a6d-b7c1-9e7beccc4c85</serial>
Nov 28 16:01:17 user nova-compute[75176]: </disk>
Nov 28 16:01:17 user nova-compute[75176]:  {{(pid=75176) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 16:01:17 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66ead7d-98f4-4822-9dce-f2ea0206a58d/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:01:17 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7/disk.rescue --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:01:17 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:01:17 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7/disk.rescue --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:01:17 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-b0e3a84f-ed56-4cda-8c12-dc4b244758f0 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] No BDM found with device name vda, not building metadata. {{(pid=75176) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 16:01:17 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-b0e3a84f-ed56-4cda-8c12-dc4b244758f0 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75176) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 16:01:17 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-b0e3a84f-ed56-4cda-8c12-dc4b244758f0 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] No VIF found with MAC fa:16:3e:92:22:dd, not building metadata {{(pid=75176) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 16:01:17 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:01:17 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:01:17 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-b0e3a84f-ed56-4cda-8c12-dc4b244758f0 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Lock "e0b7a064-03b6-4a0d-88be-2f12c12a1ddb" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.854s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:01:17 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:01:17 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:01:17 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:01:17 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75176) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 16:01:18 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 16:01:18 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 16:01:18 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Hypervisor/Node resource view: name=user free_ram=7724MB free_disk=24.848037719726562GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75176) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 16:01:18 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:01:18 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:01:18 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance f66ead7d-98f4-4822-9dce-f2ea0206a58d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 16:01:18 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance 55febf04-14ea-4903-8692-c7cc6115de75 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 16:01:18 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance 8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 16:01:18 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance dc4e6d39-adfb-4d26-afef-46f316ff7846 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 16:01:18 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance e0b7a064-03b6-4a0d-88be-2f12c12a1ddb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 16:01:18 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance 525c3cc4-9cc4-470b-bf72-5e53d80cea6f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 16:01:18 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance ecf38787-0a69-4f35-b121-3dc6e70023a1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 16:01:18 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance 726344c0-a0dc-48d5-a18f-8a258ebde87d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 16:01:18 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance 1062234d-4890-46df-bb52-49c55b4af32b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 16:01:18 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance 6c6a4729-9d51-4ebf-bad6-2022f35cbe3b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 16:01:18 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75176) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 16:01:18 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75176) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 16:01:18 user nova-compute[75176]: DEBUG nova.compute.provider_tree [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Inventory has not changed in ProviderTree for provider: b37848d8-f401-4155-a029-b0ffa09ff85b {{(pid=75176) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 16:01:18 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Inventory has not changed for provider b37848d8-f401-4155-a029-b0ffa09ff85b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75176) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 16:01:18 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Compute_service record updated for user:user {{(pid=75176) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 16:01:18 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.461s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:01:19 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:01:19 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:01:20 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-2c8e57ad-12be-4365-ad47-4542475e9fc2 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Acquiring lock "e0b7a064-03b6-4a0d-88be-2f12c12a1ddb" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:01:20 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-2c8e57ad-12be-4365-ad47-4542475e9fc2 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Lock "e0b7a064-03b6-4a0d-88be-2f12c12a1ddb" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:01:20 user nova-compute[75176]: INFO nova.compute.manager [None req-2c8e57ad-12be-4365-ad47-4542475e9fc2 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] [instance: e0b7a064-03b6-4a0d-88be-2f12c12a1ddb] Detaching volume 62c5ff84-c288-4a6d-b7c1-9e7beccc4c85
Nov 28 16:01:20 user nova-compute[75176]: INFO nova.virt.block_device [None req-2c8e57ad-12be-4365-ad47-4542475e9fc2 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] [instance: e0b7a064-03b6-4a0d-88be-2f12c12a1ddb] Attempting to driver detach volume 62c5ff84-c288-4a6d-b7c1-9e7beccc4c85 from mountpoint /dev/vdb
Nov 28 16:01:20 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-2c8e57ad-12be-4365-ad47-4542475e9fc2 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Attempting to detach device vdb from instance e0b7a064-03b6-4a0d-88be-2f12c12a1ddb from the persistent domain config. {{(pid=75176) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 16:01:20 user nova-compute[75176]: DEBUG nova.virt.libvirt.guest [None req-2c8e57ad-12be-4365-ad47-4542475e9fc2 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 16:01:20 user nova-compute[75176]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 16:01:20 user nova-compute[75176]:   <source dev="/dev/sdf"/>
Nov 28 16:01:20 user nova-compute[75176]:   <target dev="vdb" bus="virtio"/>
Nov 28 16:01:20 user nova-compute[75176]:   <serial>62c5ff84-c288-4a6d-b7c1-9e7beccc4c85</serial>
Nov 28 16:01:20 user nova-compute[75176]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 16:01:20 user nova-compute[75176]: </disk>
Nov 28 16:01:20 user nova-compute[75176]:  {{(pid=75176) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 16:01:20 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-2c8e57ad-12be-4365-ad47-4542475e9fc2 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Successfully detached device vdb from instance e0b7a064-03b6-4a0d-88be-2f12c12a1ddb from the persistent domain config.
Nov 28 16:01:20 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-2c8e57ad-12be-4365-ad47-4542475e9fc2 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e0b7a064-03b6-4a0d-88be-2f12c12a1ddb from the live domain config. {{(pid=75176) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 16:01:20 user nova-compute[75176]: DEBUG nova.virt.libvirt.guest [None req-2c8e57ad-12be-4365-ad47-4542475e9fc2 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 16:01:20 user nova-compute[75176]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 16:01:20 user nova-compute[75176]:   <source dev="/dev/sdf"/>
Nov 28 16:01:20 user nova-compute[75176]:   <target dev="vdb" bus="virtio"/>
Nov 28 16:01:20 user nova-compute[75176]:   <serial>62c5ff84-c288-4a6d-b7c1-9e7beccc4c85</serial>
Nov 28 16:01:20 user nova-compute[75176]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 16:01:20 user nova-compute[75176]: </disk>
Nov 28 16:01:20 user nova-compute[75176]:  {{(pid=75176) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 16:01:20 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:01:20 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-2c8e57ad-12be-4365-ad47-4542475e9fc2 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e0b7a064-03b6-4a0d-88be-2f12c12a1ddb {{(pid=75176) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 16:01:24 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:01:25 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:01:27 user nova-compute[75176]: INFO nova.compute.manager [None req-f7d61b35-7524-4cbd-adc6-28b228649aef tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] [instance: 726344c0-a0dc-48d5-a18f-8a258ebde87d] Unrescuing
Nov 28 16:01:27 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-f7d61b35-7524-4cbd-adc6-28b228649aef tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Acquiring lock "refresh_cache-726344c0-a0dc-48d5-a18f-8a258ebde87d" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 16:01:27 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-f7d61b35-7524-4cbd-adc6-28b228649aef tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Acquired lock "refresh_cache-726344c0-a0dc-48d5-a18f-8a258ebde87d" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 16:01:27 user nova-compute[75176]: DEBUG nova.network.neutron [None req-f7d61b35-7524-4cbd-adc6-28b228649aef tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] [instance: 726344c0-a0dc-48d5-a18f-8a258ebde87d] Building network info cache for instance {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 16:01:28 user nova-compute[75176]: DEBUG nova.network.neutron [None req-f7d61b35-7524-4cbd-adc6-28b228649aef tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] [instance: 726344c0-a0dc-48d5-a18f-8a258ebde87d] Updating instance_info_cache with network_info: [{"id": "966907f1-2c5f-4c34-b155-b1b3b4176f5f", "address": "fa:16:3e:0d:da:42", "network": {"id": "d47c1797-a66f-4f2d-b83e-903b5bd3251c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1416388789-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd2856ce0a2545cda0b796eb0be10a40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap966907f1-2c", "ovs_interfaceid": "966907f1-2c5f-4c34-b155-b1b3b4176f5f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 16:01:28 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-f7d61b35-7524-4cbd-adc6-28b228649aef tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Releasing lock "refresh_cache-726344c0-a0dc-48d5-a18f-8a258ebde87d" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 16:01:28 user nova-compute[75176]: DEBUG nova.objects.instance [None req-f7d61b35-7524-4cbd-adc6-28b228649aef tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Lazy-loading 'flavor' on Instance uuid 726344c0-a0dc-48d5-a18f-8a258ebde87d {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 16:01:28 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:01:28 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:01:28 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:01:28 user nova-compute[75176]: DEBUG nova.compute.manager [req-8f6cc12b-ea6d-479a-92f0-3a33210d67ac req-02ddb198-5a7e-4cd9-9591-3eb8a96b29d8 service nova] [instance: 726344c0-a0dc-48d5-a18f-8a258ebde87d] Received event network-vif-unplugged-966907f1-2c5f-4c34-b155-b1b3b4176f5f {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 16:01:28 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-8f6cc12b-ea6d-479a-92f0-3a33210d67ac req-02ddb198-5a7e-4cd9-9591-3eb8a96b29d8 service nova] Acquiring lock "726344c0-a0dc-48d5-a18f-8a258ebde87d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:01:28 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-8f6cc12b-ea6d-479a-92f0-3a33210d67ac req-02ddb198-5a7e-4cd9-9591-3eb8a96b29d8 service nova] Lock "726344c0-a0dc-48d5-a18f-8a258ebde87d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:01:28 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-8f6cc12b-ea6d-479a-92f0-3a33210d67ac req-02ddb198-5a7e-4cd9-9591-3eb8a96b29d8 service nova] Lock "726344c0-a0dc-48d5-a18f-8a258ebde87d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:01:28 user nova-compute[75176]: DEBUG nova.compute.manager [req-8f6cc12b-ea6d-479a-92f0-3a33210d67ac req-02ddb198-5a7e-4cd9-9591-3eb8a96b29d8 service nova] [instance: 726344c0-a0dc-48d5-a18f-8a258ebde87d] No waiting events found dispatching network-vif-unplugged-966907f1-2c5f-4c34-b155-b1b3b4176f5f {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 16:01:28 user nova-compute[75176]: WARNING nova.compute.manager [req-8f6cc12b-ea6d-479a-92f0-3a33210d67ac req-02ddb198-5a7e-4cd9-9591-3eb8a96b29d8 service nova] [instance: 726344c0-a0dc-48d5-a18f-8a258ebde87d] Received unexpected event network-vif-unplugged-966907f1-2c5f-4c34-b155-b1b3b4176f5f for instance with vm_state rescued and task_state unrescuing.
Nov 28 16:01:28 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:01:28 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:01:28 user nova-compute[75176]: INFO nova.virt.libvirt.driver [-] [instance: 726344c0-a0dc-48d5-a18f-8a258ebde87d] Instance destroyed successfully.
Nov 28 16:01:30 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:01:30 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:01:30 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:01:30 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:01:30 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:01:30 user nova-compute[75176]: DEBUG nova.compute.manager [req-b1f4e46f-54dc-4dca-8f70-02d99fc13f69 req-d9956f93-6a80-4096-9df1-8c4d2e4a724d service nova] [instance: 726344c0-a0dc-48d5-a18f-8a258ebde87d] Received event network-vif-plugged-966907f1-2c5f-4c34-b155-b1b3b4176f5f {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 16:01:30 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-b1f4e46f-54dc-4dca-8f70-02d99fc13f69 req-d9956f93-6a80-4096-9df1-8c4d2e4a724d service nova] Acquiring lock "726344c0-a0dc-48d5-a18f-8a258ebde87d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:01:30 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-b1f4e46f-54dc-4dca-8f70-02d99fc13f69 req-d9956f93-6a80-4096-9df1-8c4d2e4a724d service nova] Lock "726344c0-a0dc-48d5-a18f-8a258ebde87d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:01:30 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-b1f4e46f-54dc-4dca-8f70-02d99fc13f69 req-d9956f93-6a80-4096-9df1-8c4d2e4a724d service nova] Lock "726344c0-a0dc-48d5-a18f-8a258ebde87d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:01:30 user nova-compute[75176]: DEBUG nova.compute.manager [req-b1f4e46f-54dc-4dca-8f70-02d99fc13f69 req-d9956f93-6a80-4096-9df1-8c4d2e4a724d service nova] [instance: 726344c0-a0dc-48d5-a18f-8a258ebde87d] No waiting events found dispatching network-vif-plugged-966907f1-2c5f-4c34-b155-b1b3b4176f5f {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 16:01:30 user nova-compute[75176]: WARNING nova.compute.manager [req-b1f4e46f-54dc-4dca-8f70-02d99fc13f69 req-d9956f93-6a80-4096-9df1-8c4d2e4a724d service nova] [instance: 726344c0-a0dc-48d5-a18f-8a258ebde87d] Received unexpected event network-vif-plugged-966907f1-2c5f-4c34-b155-b1b3b4176f5f for instance with vm_state rescued and task_state unrescuing.
Nov 28 16:01:30 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:01:31 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:01:32 user nova-compute[75176]: DEBUG nova.compute.manager [req-7760bc44-2b8b-4663-b833-441a8d800a25 req-2eccbd2e-053c-4f66-a6b4-c2fe6a375ae7 service nova] [instance: 726344c0-a0dc-48d5-a18f-8a258ebde87d] Received event network-vif-plugged-966907f1-2c5f-4c34-b155-b1b3b4176f5f {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 16:01:32 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-7760bc44-2b8b-4663-b833-441a8d800a25 req-2eccbd2e-053c-4f66-a6b4-c2fe6a375ae7 service nova] Acquiring lock "726344c0-a0dc-48d5-a18f-8a258ebde87d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:01:32 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-7760bc44-2b8b-4663-b833-441a8d800a25 req-2eccbd2e-053c-4f66-a6b4-c2fe6a375ae7 service nova] Lock "726344c0-a0dc-48d5-a18f-8a258ebde87d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:01:32 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-7760bc44-2b8b-4663-b833-441a8d800a25 req-2eccbd2e-053c-4f66-a6b4-c2fe6a375ae7 service nova] Lock "726344c0-a0dc-48d5-a18f-8a258ebde87d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:01:32 user nova-compute[75176]: DEBUG nova.compute.manager [req-7760bc44-2b8b-4663-b833-441a8d800a25 req-2eccbd2e-053c-4f66-a6b4-c2fe6a375ae7 service nova] [instance: 726344c0-a0dc-48d5-a18f-8a258ebde87d] No waiting events found dispatching network-vif-plugged-966907f1-2c5f-4c34-b155-b1b3b4176f5f {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 16:01:32 user nova-compute[75176]: WARNING nova.compute.manager [req-7760bc44-2b8b-4663-b833-441a8d800a25 req-2eccbd2e-053c-4f66-a6b4-c2fe6a375ae7 service nova] [instance: 726344c0-a0dc-48d5-a18f-8a258ebde87d] Received unexpected event network-vif-plugged-966907f1-2c5f-4c34-b155-b1b3b4176f5f for instance with vm_state rescued and task_state unrescuing.
Nov 28 16:01:32 user nova-compute[75176]: DEBUG nova.compute.manager [req-7760bc44-2b8b-4663-b833-441a8d800a25 req-2eccbd2e-053c-4f66-a6b4-c2fe6a375ae7 service nova] [instance: 726344c0-a0dc-48d5-a18f-8a258ebde87d] Received event network-vif-plugged-966907f1-2c5f-4c34-b155-b1b3b4176f5f {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 16:01:32 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-7760bc44-2b8b-4663-b833-441a8d800a25 req-2eccbd2e-053c-4f66-a6b4-c2fe6a375ae7 service nova] Acquiring lock "726344c0-a0dc-48d5-a18f-8a258ebde87d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:01:32 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-7760bc44-2b8b-4663-b833-441a8d800a25 req-2eccbd2e-053c-4f66-a6b4-c2fe6a375ae7 service nova] Lock "726344c0-a0dc-48d5-a18f-8a258ebde87d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:01:32 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-7760bc44-2b8b-4663-b833-441a8d800a25 req-2eccbd2e-053c-4f66-a6b4-c2fe6a375ae7 service nova] Lock "726344c0-a0dc-48d5-a18f-8a258ebde87d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:01:32 user nova-compute[75176]: DEBUG nova.compute.manager [req-7760bc44-2b8b-4663-b833-441a8d800a25 req-2eccbd2e-053c-4f66-a6b4-c2fe6a375ae7 service nova] [instance: 726344c0-a0dc-48d5-a18f-8a258ebde87d] No waiting events found dispatching network-vif-plugged-966907f1-2c5f-4c34-b155-b1b3b4176f5f {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 16:01:32 user nova-compute[75176]: WARNING nova.compute.manager [req-7760bc44-2b8b-4663-b833-441a8d800a25 req-2eccbd2e-053c-4f66-a6b4-c2fe6a375ae7 service nova] [instance: 726344c0-a0dc-48d5-a18f-8a258ebde87d] Received unexpected event network-vif-plugged-966907f1-2c5f-4c34-b155-b1b3b4176f5f for instance with vm_state rescued and task_state unrescuing.
Nov 28 16:01:32 user nova-compute[75176]: DEBUG nova.compute.manager [None req-f7d61b35-7524-4cbd-adc6-28b228649aef tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] [instance: 726344c0-a0dc-48d5-a18f-8a258ebde87d] Checking state {{(pid=75176) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 16:01:34 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:01:35 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:01:35 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:01:37 user nova-compute[75176]: DEBUG nova.compute.manager [req-09b4ddbd-231e-4d82-ba24-d5edc5eaf852 req-d6444377-4dc1-4984-b172-a5fa1b9436d9 service nova] [instance: 525c3cc4-9cc4-470b-bf72-5e53d80cea6f] Received event network-changed-6c64d8cb-6ee1-4d8f-8898-3e70b5e17b9e {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 16:01:37 user nova-compute[75176]: DEBUG nova.compute.manager [req-09b4ddbd-231e-4d82-ba24-d5edc5eaf852 req-d6444377-4dc1-4984-b172-a5fa1b9436d9 service nova] [instance: 525c3cc4-9cc4-470b-bf72-5e53d80cea6f] Refreshing instance network info cache due to event network-changed-6c64d8cb-6ee1-4d8f-8898-3e70b5e17b9e. {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 16:01:37 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-09b4ddbd-231e-4d82-ba24-d5edc5eaf852 req-d6444377-4dc1-4984-b172-a5fa1b9436d9 service nova] Acquiring lock "refresh_cache-525c3cc4-9cc4-470b-bf72-5e53d80cea6f" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 16:01:37 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-09b4ddbd-231e-4d82-ba24-d5edc5eaf852 req-d6444377-4dc1-4984-b172-a5fa1b9436d9 service nova] Acquired lock "refresh_cache-525c3cc4-9cc4-470b-bf72-5e53d80cea6f" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 16:01:37 user nova-compute[75176]: DEBUG nova.network.neutron [req-09b4ddbd-231e-4d82-ba24-d5edc5eaf852 req-d6444377-4dc1-4984-b172-a5fa1b9436d9 service nova] [instance: 525c3cc4-9cc4-470b-bf72-5e53d80cea6f] Refreshing network info cache for port 6c64d8cb-6ee1-4d8f-8898-3e70b5e17b9e {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 16:01:37 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-bad98626-dcf1-447d-a014-4802da1eff71 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Acquiring lock "525c3cc4-9cc4-470b-bf72-5e53d80cea6f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:01:37 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-bad98626-dcf1-447d-a014-4802da1eff71 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Lock "525c3cc4-9cc4-470b-bf72-5e53d80cea6f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:01:37 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-bad98626-dcf1-447d-a014-4802da1eff71 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Acquiring lock "525c3cc4-9cc4-470b-bf72-5e53d80cea6f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:01:37 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-bad98626-dcf1-447d-a014-4802da1eff71 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Lock "525c3cc4-9cc4-470b-bf72-5e53d80cea6f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:01:37 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-bad98626-dcf1-447d-a014-4802da1eff71 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Lock "525c3cc4-9cc4-470b-bf72-5e53d80cea6f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:01:37 user nova-compute[75176]: INFO nova.compute.manager [None req-bad98626-dcf1-447d-a014-4802da1eff71 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: 525c3cc4-9cc4-470b-bf72-5e53d80cea6f] Terminating instance
Nov 28 16:01:37 user nova-compute[75176]: DEBUG nova.compute.manager [None req-bad98626-dcf1-447d-a014-4802da1eff71 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: 525c3cc4-9cc4-470b-bf72-5e53d80cea6f] Start destroying the instance on the hypervisor. {{(pid=75176) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 16:01:37 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:01:37 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:01:37 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:01:37 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:01:38 user nova-compute[75176]: DEBUG nova.network.neutron [req-09b4ddbd-231e-4d82-ba24-d5edc5eaf852 req-d6444377-4dc1-4984-b172-a5fa1b9436d9 service nova] [instance: 525c3cc4-9cc4-470b-bf72-5e53d80cea6f] Updated VIF entry in instance network info cache for port 6c64d8cb-6ee1-4d8f-8898-3e70b5e17b9e. {{(pid=75176) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 16:01:38 user nova-compute[75176]: DEBUG nova.network.neutron [req-09b4ddbd-231e-4d82-ba24-d5edc5eaf852 req-d6444377-4dc1-4984-b172-a5fa1b9436d9 service nova] [instance: 525c3cc4-9cc4-470b-bf72-5e53d80cea6f] Updating instance_info_cache with network_info: [{"id": "6c64d8cb-6ee1-4d8f-8898-3e70b5e17b9e", "address": "fa:16:3e:93:0e:39", "network": {"id": "5ec264ad-3459-468c-bdbf-c6a4ef016951", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1574289626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07c7783cc16049208421204910982c79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c64d8cb-6e", "ovs_interfaceid": "6c64d8cb-6ee1-4d8f-8898-3e70b5e17b9e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 16:01:38 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-09b4ddbd-231e-4d82-ba24-d5edc5eaf852 req-d6444377-4dc1-4984-b172-a5fa1b9436d9 service nova] Releasing lock "refresh_cache-525c3cc4-9cc4-470b-bf72-5e53d80cea6f" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 16:01:38 user nova-compute[75176]: INFO nova.virt.libvirt.driver [-] [instance: 525c3cc4-9cc4-470b-bf72-5e53d80cea6f] Instance destroyed successfully.
Nov 28 16:01:38 user nova-compute[75176]: DEBUG nova.objects.instance [None req-bad98626-dcf1-447d-a014-4802da1eff71 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Lazy-loading 'resources' on Instance uuid 525c3cc4-9cc4-470b-bf72-5e53d80cea6f {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 16:01:38 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-bad98626-dcf1-447d-a014-4802da1eff71 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T15:56:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-367386830',display_name='tempest-TestVolumeBootPattern-server-367386830',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-367386830',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAT4j4MwMCXcgxPv2ypvh6Le18WUkR/7PQX0ERUSwv8uiHb35AkMlGdcRbKgULWyfAemfpuoTAyzTZycSyQIMMK+kqb2pUHOOT/5otX0G6BKfJMaYPfRy2E0NOlU0WUh/Q==',key_name='tempest-TestVolumeBootPattern-94664483',keypairs=<?>,launch_index=0,launched_at=2023-11-28T15:56:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='07c7783cc16049208421204910982c79',ramdisk_id='',reservation_id='r-mqqbey4c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1695196118',owner_user_name='tempest-TestVolumeBootPattern-1695196118-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T15:57:00Z,user_data=None,user_id='081bf84d24194b81be4e0a6638db9b66',uuid=525c3cc4-9cc4-470b-bf72-5e53d80cea6f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6c64d8cb-6ee1-4d8f-8898-3e70b5e17b9e", "address": "fa:16:3e:93:0e:39", "network": {"id": "5ec264ad-3459-468c-bdbf-c6a4ef016951", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1574289626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07c7783cc16049208421204910982c79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c64d8cb-6e", "ovs_interfaceid": "6c64d8cb-6ee1-4d8f-8898-3e70b5e17b9e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 16:01:38 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-bad98626-dcf1-447d-a014-4802da1eff71 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Converting VIF {"id": "6c64d8cb-6ee1-4d8f-8898-3e70b5e17b9e", "address": "fa:16:3e:93:0e:39", "network": {"id": "5ec264ad-3459-468c-bdbf-c6a4ef016951", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1574289626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07c7783cc16049208421204910982c79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c64d8cb-6e", "ovs_interfaceid": "6c64d8cb-6ee1-4d8f-8898-3e70b5e17b9e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 16:01:38 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-bad98626-dcf1-447d-a014-4802da1eff71 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:93:0e:39,bridge_name='br-int',has_traffic_filtering=True,id=6c64d8cb-6ee1-4d8f-8898-3e70b5e17b9e,network=Network(5ec264ad-3459-468c-bdbf-c6a4ef016951),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c64d8cb-6e') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 16:01:38 user nova-compute[75176]: DEBUG os_vif [None req-bad98626-dcf1-447d-a014-4802da1eff71 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:93:0e:39,bridge_name='br-int',has_traffic_filtering=True,id=6c64d8cb-6ee1-4d8f-8898-3e70b5e17b9e,network=Network(5ec264ad-3459-468c-bdbf-c6a4ef016951),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c64d8cb-6e') {{(pid=75176) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 16:01:38 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:01:38 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6c64d8cb-6e, bridge=br-int, if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 16:01:38 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:01:38 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 16:01:38 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:01:38 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6a7da5fe-7356-4b4a-86c9-67eee8450d26) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 16:01:38 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:01:38 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:01:38 user nova-compute[75176]: INFO os_vif [None req-bad98626-dcf1-447d-a014-4802da1eff71 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:93:0e:39,bridge_name='br-int',has_traffic_filtering=True,id=6c64d8cb-6ee1-4d8f-8898-3e70b5e17b9e,network=Network(5ec264ad-3459-468c-bdbf-c6a4ef016951),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c64d8cb-6e')
Nov 28 16:01:38 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bad98626-dcf1-447d-a014-4802da1eff71 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: 525c3cc4-9cc4-470b-bf72-5e53d80cea6f] calling os-brick to detach iSCSI Volume {{(pid=75176) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 16:01:38 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-bad98626-dcf1-447d-a014-4802da1eff71 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c1b8a00>, {'target_iqn': 'iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tspqduOv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 16:01:38 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-bad98626-dcf1-447d-a014-4802da1eff71 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 16:01:38 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-bad98626-dcf1-447d-a014-4802da1eff71 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 16:01:38 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-bad98626-dcf1-447d-a014-4802da1eff71 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 16:01:38 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:01:38 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:01:38 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf14587b-f464-472c-a1df-e29b2a0e677e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6ec9410d-747d-475e-999c-672f87917a20\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4b1a81f9-4a84-4f9e-9b1a-86b0c17ed81c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:62c5ff84-c288-4a6d-b7c1-9e7beccc4c85\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:01:38 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-bad98626-dcf1-447d-a014-4802da1eff71 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 16:01:38 user nova-compute[75176]: No targets found.
Nov 28 16:01:38 user nova-compute[75176]: iSNS:
Nov 28 16:01:38 user nova-compute[75176]: No targets found.
Nov 28 16:01:38 user nova-compute[75176]: STATIC:
Nov 28 16:01:38 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0
Nov 28 16:01:38 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 16:01:38 user nova-compute[75176]:                 Iface Name: default
Nov 28 16:01:38 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6
Nov 28 16:01:38 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 16:01:38 user nova-compute[75176]:                 Iface Name: default
Nov 28 16:01:38 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:6ec9410d-747d-475e-999c-672f87917a20
Nov 28 16:01:38 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 16:01:38 user nova-compute[75176]:                 Iface Name: default
Nov 28 16:01:38 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:4b1a81f9-4a84-4f9e-9b1a-86b0c17ed81c
Nov 28 16:01:38 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 16:01:38 user nova-compute[75176]:                 Iface Name: default
Nov 28 16:01:38 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:62c5ff84-c288-4a6d-b7c1-9e7beccc4c85
Nov 28 16:01:38 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 16:01:38 user nova-compute[75176]:                 Iface Name: default
Nov 28 16:01:38 user nova-compute[75176]: FIRMWARE:
Nov 28 16:01:38 user nova-compute[75176]: No targets found.
Nov 28 16:01:38 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 16:01:38 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-bad98626-dcf1-447d-a014-4802da1eff71 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 16:01:38 user nova-compute[75176]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 16:01:38 user nova-compute[75176]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75176) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 16:01:38 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-bad98626-dcf1-447d-a014-4802da1eff71 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0', 0)] {{(pid=75176) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 16:01:38 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:01:38 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:01:38 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[49f7ecad-d55b-4618-8bcd-367850c0f819]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4b1a81f9-4a84-4f9e-9b1a-86b0c17ed81c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:62c5ff84-c288-4a6d-b7c1-9e7beccc4c85\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ec9410d-747d-475e-999c-672f87917a20\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:01:38 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:01:38 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:01:38 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[45137c10-25af-4729-af49-46014e37c739]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b1a81f9-4a84-4f9e-9b1a-86b0c17ed81c (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ec9410d-747d-475e-999c-672f87917a20 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62c5ff84-c288-4a6d-b7c1-9e7beccc4c85 (non-flash)\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:01:38 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-bad98626-dcf1-447d-a014-4802da1eff71 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 (non-flash)
Nov 28 16:01:38 user nova-compute[75176]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0 (non-flash)
Nov 28 16:01:38 user nova-compute[75176]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b1a81f9-4a84-4f9e-9b1a-86b0c17ed81c (non-flash)
Nov 28 16:01:38 user nova-compute[75176]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ec9410d-747d-475e-999c-672f87917a20 (non-flash)
Nov 28 16:01:38 user nova-compute[75176]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62c5ff84-c288-4a6d-b7c1-9e7beccc4c85 (non-flash)
Nov 28 16:01:38 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 16:01:38 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-bad98626-dcf1-447d-a014-4802da1eff71 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 (non-flash)
Nov 28 16:01:38 user nova-compute[75176]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0 (non-flash)
Nov 28 16:01:38 user nova-compute[75176]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b1a81f9-4a84-4f9e-9b1a-86b0c17ed81c (non-flash)
Nov 28 16:01:38 user nova-compute[75176]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ec9410d-747d-475e-999c-672f87917a20 (non-flash)
Nov 28 16:01:38 user nova-compute[75176]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62c5ff84-c288-4a6d-b7c1-9e7beccc4c85 (non-flash)
Nov 28 16:01:38 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 16:01:38 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-bad98626-dcf1-447d-a014-4802da1eff71 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f465171d6c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0'): ({'sdb'}, set())}) {{(pid=75176) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 16:01:38 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-bad98626-dcf1-447d-a014-4802da1eff71 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Removing single pathed devices sdb {{(pid=75176) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 16:01:38 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:01:38 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:01:38 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c99101e-adb6-4e1d-97af-61b56bc9178f]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:01:38 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:01:38 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:01:38 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[98564f17-4629-4a01-9bf7-9bbda39f23b0]: (4, ('ok\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:01:38 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-bad98626-dcf1-447d-a014-4802da1eff71 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Flushing IO for device /dev/sdb {{(pid=75176) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 16:01:38 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:01:38 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.019s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:01:38 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[edfb3edd-ebcc-4d23-847d-50a7b76b05f4]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:01:38 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-bad98626-dcf1-447d-a014-4802da1eff71 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75176) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 16:01:38 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:01:38 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:01:38 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[d20ca779-adaa-4990-9f6f-936251ada014]: (4, ('1', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:01:38 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-bad98626-dcf1-447d-a014-4802da1eff71 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75176) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 16:01:38 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-bad98626-dcf1-447d-a014-4802da1eff71 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] SCSI volumes sdb have been removed. {{(pid=75176) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 16:01:38 user nova-compute[75176]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO89c2075c-49c62a25d3ebf848', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_89c2075c', '/dev/disk/by-id/scsi-23439633632613235') {{(pid=85736) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 28 16:01:38 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[a024ad0c-55a2-446c-ba35-f5016d8b9982]: (4, None) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:01:38 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-bad98626-dcf1-447d-a014-4802da1eff71 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0')] {{(pid=75176) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 16:01:38 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:01:38 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.037s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:01:38 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb629ef4-2615-493a-9556-ebc9afc87443]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:01:38 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-bad98626-dcf1-447d-a014-4802da1eff71 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 16:01:38 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0 -p 172.16.0.220:3260 --logout {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:01:38 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:01:38 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4c777d2-b6fd-4611-be43-1646982221d9]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:01:38 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-bad98626-dcf1-447d-a014-4802da1eff71 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0, portal: 172.16.0.220,3260]
Nov 28 16:01:38 user nova-compute[75176]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0, portal: 172.16.0.220,3260] successful.
Nov 28 16:01:38 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 16:01:38 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0 -p 172.16.0.220:3260 --op delete {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:01:38 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2389818d-1c3f-46d9-a70a-1330da1b94e0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:01:38 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[99c1c870-865c-4614-aade-663807c1a612]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:01:38 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-bad98626-dcf1-447d-a014-4802da1eff71 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 16:01:38 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-bad98626-dcf1-447d-a014-4802da1eff71 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.372s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 16:01:38 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-bad98626-dcf1-447d-a014-4802da1eff71 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] <== disconnect_volume: return (374ms) None {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 16:01:38 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bad98626-dcf1-447d-a014-4802da1eff71 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: 525c3cc4-9cc4-470b-bf72-5e53d80cea6f] Disconnected iSCSI Volume {{(pid=75176) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 16:01:38 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-bad98626-dcf1-447d-a014-4802da1eff71 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: 525c3cc4-9cc4-470b-bf72-5e53d80cea6f] Deleting instance files /opt/stack/data/nova/instances/525c3cc4-9cc4-470b-bf72-5e53d80cea6f_del
Nov 28 16:01:38 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-bad98626-dcf1-447d-a014-4802da1eff71 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: 525c3cc4-9cc4-470b-bf72-5e53d80cea6f] Deletion of /opt/stack/data/nova/instances/525c3cc4-9cc4-470b-bf72-5e53d80cea6f_del complete
Nov 28 16:01:39 user nova-compute[75176]: INFO nova.compute.manager [None req-bad98626-dcf1-447d-a014-4802da1eff71 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: 525c3cc4-9cc4-470b-bf72-5e53d80cea6f] Took 1.27 seconds to destroy the instance on the hypervisor.
Nov 28 16:01:39 user nova-compute[75176]: DEBUG oslo.service.loopingcall [None req-bad98626-dcf1-447d-a014-4802da1eff71 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75176) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 16:01:39 user nova-compute[75176]: DEBUG nova.compute.manager [-] [instance: 525c3cc4-9cc4-470b-bf72-5e53d80cea6f] Deallocating network for instance {{(pid=75176) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 16:01:39 user nova-compute[75176]: DEBUG nova.network.neutron [-] [instance: 525c3cc4-9cc4-470b-bf72-5e53d80cea6f] deallocate_for_instance() {{(pid=75176) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 16:01:39 user nova-compute[75176]: DEBUG nova.network.neutron [-] [instance: 525c3cc4-9cc4-470b-bf72-5e53d80cea6f] Updating instance_info_cache with network_info: [] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 16:01:39 user nova-compute[75176]: INFO nova.compute.manager [-] [instance: 525c3cc4-9cc4-470b-bf72-5e53d80cea6f] Took 0.46 seconds to deallocate network for instance.
Nov 28 16:01:39 user nova-compute[75176]: DEBUG nova.compute.manager [req-201c2376-4ff6-46c3-a0e1-b3887b8c85cb req-0542a395-b175-4b3e-8779-dd07399220d9 service nova] [instance: 525c3cc4-9cc4-470b-bf72-5e53d80cea6f] Received event network-vif-deleted-6c64d8cb-6ee1-4d8f-8898-3e70b5e17b9e {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 16:01:39 user nova-compute[75176]: INFO nova.compute.manager [req-201c2376-4ff6-46c3-a0e1-b3887b8c85cb req-0542a395-b175-4b3e-8779-dd07399220d9 service nova] [instance: 525c3cc4-9cc4-470b-bf72-5e53d80cea6f] Neutron deleted interface 6c64d8cb-6ee1-4d8f-8898-3e70b5e17b9e; detaching it from the instance and deleting it from the info cache
Nov 28 16:01:39 user nova-compute[75176]: DEBUG nova.network.neutron [req-201c2376-4ff6-46c3-a0e1-b3887b8c85cb req-0542a395-b175-4b3e-8779-dd07399220d9 service nova] [instance: 525c3cc4-9cc4-470b-bf72-5e53d80cea6f] Updating instance_info_cache with network_info: [] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 16:01:39 user nova-compute[75176]: DEBUG nova.compute.manager [req-201c2376-4ff6-46c3-a0e1-b3887b8c85cb req-0542a395-b175-4b3e-8779-dd07399220d9 service nova] [instance: 525c3cc4-9cc4-470b-bf72-5e53d80cea6f] Detach interface failed, port_id=6c64d8cb-6ee1-4d8f-8898-3e70b5e17b9e, reason: Instance 525c3cc4-9cc4-470b-bf72-5e53d80cea6f could not be found. {{(pid=75176) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 28 16:01:39 user nova-compute[75176]: DEBUG nova.compute.manager [req-ae373d87-a45c-43fe-ab12-204cce7153ce req-6b0161a0-15d0-455e-9e2b-4a5155f2906a service nova] [instance: 525c3cc4-9cc4-470b-bf72-5e53d80cea6f] Received event network-vif-unplugged-6c64d8cb-6ee1-4d8f-8898-3e70b5e17b9e {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 16:01:39 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-ae373d87-a45c-43fe-ab12-204cce7153ce req-6b0161a0-15d0-455e-9e2b-4a5155f2906a service nova] Acquiring lock "525c3cc4-9cc4-470b-bf72-5e53d80cea6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:01:39 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-ae373d87-a45c-43fe-ab12-204cce7153ce req-6b0161a0-15d0-455e-9e2b-4a5155f2906a service nova] Lock "525c3cc4-9cc4-470b-bf72-5e53d80cea6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:01:39 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-ae373d87-a45c-43fe-ab12-204cce7153ce req-6b0161a0-15d0-455e-9e2b-4a5155f2906a service nova] Lock "525c3cc4-9cc4-470b-bf72-5e53d80cea6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:01:39 user nova-compute[75176]: DEBUG nova.compute.manager [req-ae373d87-a45c-43fe-ab12-204cce7153ce req-6b0161a0-15d0-455e-9e2b-4a5155f2906a service nova] [instance: 525c3cc4-9cc4-470b-bf72-5e53d80cea6f] No waiting events found dispatching network-vif-unplugged-6c64d8cb-6ee1-4d8f-8898-3e70b5e17b9e {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 16:01:39 user nova-compute[75176]: DEBUG nova.compute.manager [req-ae373d87-a45c-43fe-ab12-204cce7153ce req-6b0161a0-15d0-455e-9e2b-4a5155f2906a service nova] [instance: 525c3cc4-9cc4-470b-bf72-5e53d80cea6f] Received event network-vif-unplugged-6c64d8cb-6ee1-4d8f-8898-3e70b5e17b9e for instance with task_state deleting. {{(pid=75176) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 16:01:39 user nova-compute[75176]: DEBUG nova.compute.manager [req-ae373d87-a45c-43fe-ab12-204cce7153ce req-6b0161a0-15d0-455e-9e2b-4a5155f2906a service nova] [instance: 525c3cc4-9cc4-470b-bf72-5e53d80cea6f] Received event network-vif-plugged-6c64d8cb-6ee1-4d8f-8898-3e70b5e17b9e {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 16:01:39 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-ae373d87-a45c-43fe-ab12-204cce7153ce req-6b0161a0-15d0-455e-9e2b-4a5155f2906a service nova] Acquiring lock "525c3cc4-9cc4-470b-bf72-5e53d80cea6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:01:39 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-ae373d87-a45c-43fe-ab12-204cce7153ce req-6b0161a0-15d0-455e-9e2b-4a5155f2906a service nova] Lock "525c3cc4-9cc4-470b-bf72-5e53d80cea6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:01:39 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-ae373d87-a45c-43fe-ab12-204cce7153ce req-6b0161a0-15d0-455e-9e2b-4a5155f2906a service nova] Lock "525c3cc4-9cc4-470b-bf72-5e53d80cea6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:01:39 user nova-compute[75176]: DEBUG nova.compute.manager [req-ae373d87-a45c-43fe-ab12-204cce7153ce req-6b0161a0-15d0-455e-9e2b-4a5155f2906a service nova] [instance: 525c3cc4-9cc4-470b-bf72-5e53d80cea6f] No waiting events found dispatching network-vif-plugged-6c64d8cb-6ee1-4d8f-8898-3e70b5e17b9e {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 16:01:39 user nova-compute[75176]: WARNING nova.compute.manager [req-ae373d87-a45c-43fe-ab12-204cce7153ce req-6b0161a0-15d0-455e-9e2b-4a5155f2906a service nova] [instance: 525c3cc4-9cc4-470b-bf72-5e53d80cea6f] Received unexpected event network-vif-plugged-6c64d8cb-6ee1-4d8f-8898-3e70b5e17b9e for instance with vm_state active and task_state deleting.
Nov 28 16:01:40 user nova-compute[75176]: INFO nova.compute.manager [None req-bad98626-dcf1-447d-a014-4802da1eff71 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] [instance: 525c3cc4-9cc4-470b-bf72-5e53d80cea6f] Took 0.78 seconds to detach 1 volumes for instance.
Nov 28 16:01:40 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-bad98626-dcf1-447d-a014-4802da1eff71 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:01:40 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-bad98626-dcf1-447d-a014-4802da1eff71 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:01:40 user nova-compute[75176]: DEBUG nova.compute.provider_tree [None req-bad98626-dcf1-447d-a014-4802da1eff71 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Inventory has not changed in ProviderTree for provider: b37848d8-f401-4155-a029-b0ffa09ff85b {{(pid=75176) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 16:01:40 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-bad98626-dcf1-447d-a014-4802da1eff71 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Inventory has not changed for provider b37848d8-f401-4155-a029-b0ffa09ff85b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75176) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 16:01:40 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-bad98626-dcf1-447d-a014-4802da1eff71 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.332s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:01:40 user nova-compute[75176]: INFO nova.scheduler.client.report [None req-bad98626-dcf1-447d-a014-4802da1eff71 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Deleted allocations for instance 525c3cc4-9cc4-470b-bf72-5e53d80cea6f
Nov 28 16:01:40 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-bad98626-dcf1-447d-a014-4802da1eff71 tempest-TestVolumeBootPattern-1695196118 tempest-TestVolumeBootPattern-1695196118-project-member] Lock "525c3cc4-9cc4-470b-bf72-5e53d80cea6f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.042s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:01:40 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-2c8e57ad-12be-4365-ad47-4542475e9fc2 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance e0b7a064-03b6-4a0d-88be-2f12c12a1ddb is timed out.
Nov 28 16:01:40 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-2c8e57ad-12be-4365-ad47-4542475e9fc2 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Successfully detached device vdb from instance e0b7a064-03b6-4a0d-88be-2f12c12a1ddb from the live domain config.
Nov 28 16:01:40 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c8e57ad-12be-4365-ad47-4542475e9fc2 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] [instance: e0b7a064-03b6-4a0d-88be-2f12c12a1ddb] calling os-brick to detach iSCSI Volume {{(pid=75176) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 16:01:40 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c8e57ad-12be-4365-ad47-4542475e9fc2 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c1b8a00>, {'target_iqn': 'iqn.2010-10.org.openstack:62c5ff84-c288-4a6d-b7c1-9e7beccc4c85', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dsuRWUlF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 16:01:40 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-2c8e57ad-12be-4365-ad47-4542475e9fc2 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 16:01:40 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-2c8e57ad-12be-4365-ad47-4542475e9fc2 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 16:01:40 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-2c8e57ad-12be-4365-ad47-4542475e9fc2 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 16:01:40 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:01:41 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:01:41 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[129a41f8-8609-4e50-bad9-9c7089ade813]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6ec9410d-747d-475e-999c-672f87917a20\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4b1a81f9-4a84-4f9e-9b1a-86b0c17ed81c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:62c5ff84-c288-4a6d-b7c1-9e7beccc4c85\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:01:41 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c8e57ad-12be-4365-ad47-4542475e9fc2 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 16:01:41 user nova-compute[75176]: No targets found.
Nov 28 16:01:41 user nova-compute[75176]: iSNS:
Nov 28 16:01:41 user nova-compute[75176]: No targets found.
Nov 28 16:01:41 user nova-compute[75176]: STATIC:
Nov 28 16:01:41 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6
Nov 28 16:01:41 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 16:01:41 user nova-compute[75176]:                 Iface Name: default
Nov 28 16:01:41 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:6ec9410d-747d-475e-999c-672f87917a20
Nov 28 16:01:41 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 16:01:41 user nova-compute[75176]:                 Iface Name: default
Nov 28 16:01:41 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:4b1a81f9-4a84-4f9e-9b1a-86b0c17ed81c
Nov 28 16:01:41 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 16:01:41 user nova-compute[75176]:                 Iface Name: default
Nov 28 16:01:41 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:62c5ff84-c288-4a6d-b7c1-9e7beccc4c85
Nov 28 16:01:41 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 16:01:41 user nova-compute[75176]:                 Iface Name: default
Nov 28 16:01:41 user nova-compute[75176]: FIRMWARE:
Nov 28 16:01:41 user nova-compute[75176]: No targets found.
Nov 28 16:01:41 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 16:01:41 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c8e57ad-12be-4365-ad47-4542475e9fc2 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 16:01:41 user nova-compute[75176]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 16:01:41 user nova-compute[75176]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75176) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 16:01:41 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c8e57ad-12be-4365-ad47-4542475e9fc2 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:62c5ff84-c288-4a6d-b7c1-9e7beccc4c85', 0)] {{(pid=75176) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 16:01:41 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:01:41 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:01:41 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[36b0edaf-4119-473d-8583-1f94736cc1ee]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4b1a81f9-4a84-4f9e-9b1a-86b0c17ed81c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:62c5ff84-c288-4a6d-b7c1-9e7beccc4c85\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ec9410d-747d-475e-999c-672f87917a20\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:01:41 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:01:41 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:01:41 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[df7b270b-c25a-4f60-be83-14d96bf81dd4]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b1a81f9-4a84-4f9e-9b1a-86b0c17ed81c (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ec9410d-747d-475e-999c-672f87917a20 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62c5ff84-c288-4a6d-b7c1-9e7beccc4c85 (non-flash)\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:01:41 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c8e57ad-12be-4365-ad47-4542475e9fc2 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 (non-flash)
Nov 28 16:01:41 user nova-compute[75176]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b1a81f9-4a84-4f9e-9b1a-86b0c17ed81c (non-flash)
Nov 28 16:01:41 user nova-compute[75176]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ec9410d-747d-475e-999c-672f87917a20 (non-flash)
Nov 28 16:01:41 user nova-compute[75176]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62c5ff84-c288-4a6d-b7c1-9e7beccc4c85 (non-flash)
Nov 28 16:01:41 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 16:01:41 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c8e57ad-12be-4365-ad47-4542475e9fc2 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 (non-flash)
Nov 28 16:01:41 user nova-compute[75176]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b1a81f9-4a84-4f9e-9b1a-86b0c17ed81c (non-flash)
Nov 28 16:01:41 user nova-compute[75176]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ec9410d-747d-475e-999c-672f87917a20 (non-flash)
Nov 28 16:01:41 user nova-compute[75176]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62c5ff84-c288-4a6d-b7c1-9e7beccc4c85 (non-flash)
Nov 28 16:01:41 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 16:01:41 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c8e57ad-12be-4365-ad47-4542475e9fc2 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f46443372e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:62c5ff84-c288-4a6d-b7c1-9e7beccc4c85'): ({'sdf'}, set())}) {{(pid=75176) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 16:01:41 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-2c8e57ad-12be-4365-ad47-4542475e9fc2 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Removing single pathed devices sdf {{(pid=75176) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 16:01:41 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:01:41 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:01:41 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[b211a721-ba6f-43da-ab4c-01e79f1e8cbe]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:01:41 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:01:41 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:01:41 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfc341f7-f42e-4eeb-91d6-e306c13ea903]: (4, ('ok\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:01:41 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-2c8e57ad-12be-4365-ad47-4542475e9fc2 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Flushing IO for device /dev/sdf {{(pid=75176) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 16:01:41 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:01:41 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.012s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:01:41 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[42541236-27bd-4e4e-b77a-a58c38539628]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:01:41 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-2c8e57ad-12be-4365-ad47-4542475e9fc2 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75176) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 16:01:41 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:01:41 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.050s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:01:41 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[41508309-165f-4d3e-afc7-45a15336efda]: (4, ('1', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:01:41 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-2c8e57ad-12be-4365-ad47-4542475e9fc2 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75176) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 16:01:41 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-2c8e57ad-12be-4365-ad47-4542475e9fc2 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] SCSI volumes sdf have been removed. {{(pid=75176) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 16:01:41 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c8e57ad-12be-4365-ad47-4542475e9fc2 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:62c5ff84-c288-4a6d-b7c1-9e7beccc4c85')] {{(pid=75176) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 16:01:41 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62c5ff84-c288-4a6d-b7c1-9e7beccc4c85 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:01:41 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62c5ff84-c288-4a6d-b7c1-9e7beccc4c85 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:01:41 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b7281e1-6920-4b5c-8922-667c9cf60a4d]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:01:41 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c8e57ad-12be-4365-ad47-4542475e9fc2 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 16:01:41 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62c5ff84-c288-4a6d-b7c1-9e7beccc4c85 -p 172.16.0.220:3260 --logout {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:01:41 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62c5ff84-c288-4a6d-b7c1-9e7beccc4c85 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:01:41 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[69e14cf6-5188-47fa-9a5e-34bddf055c4d]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:62c5ff84-c288-4a6d-b7c1-9e7beccc4c85, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:62c5ff84-c288-4a6d-b7c1-9e7beccc4c85, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:01:41 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c8e57ad-12be-4365-ad47-4542475e9fc2 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:62c5ff84-c288-4a6d-b7c1-9e7beccc4c85, portal: 172.16.0.220,3260]
Nov 28 16:01:41 user nova-compute[75176]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:62c5ff84-c288-4a6d-b7c1-9e7beccc4c85, portal: 172.16.0.220,3260] successful.
Nov 28 16:01:41 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 16:01:41 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62c5ff84-c288-4a6d-b7c1-9e7beccc4c85 -p 172.16.0.220:3260 --op delete {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:01:41 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62c5ff84-c288-4a6d-b7c1-9e7beccc4c85 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:01:41 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[5add14a9-e1e9-45cc-9183-17986405c379]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:01:41 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c8e57ad-12be-4365-ad47-4542475e9fc2 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 16:01:41 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-2c8e57ad-12be-4365-ad47-4542475e9fc2 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.339s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 16:01:41 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c8e57ad-12be-4365-ad47-4542475e9fc2 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] <== disconnect_volume: return (340ms) None {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 16:01:41 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c8e57ad-12be-4365-ad47-4542475e9fc2 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] [instance: e0b7a064-03b6-4a0d-88be-2f12c12a1ddb] Disconnected iSCSI Volume {{(pid=75176) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 16:01:42 user nova-compute[75176]: DEBUG nova.objects.instance [None req-2c8e57ad-12be-4365-ad47-4542475e9fc2 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Lazy-loading 'flavor' on Instance uuid e0b7a064-03b6-4a0d-88be-2f12c12a1ddb {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 16:01:42 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-2c8e57ad-12be-4365-ad47-4542475e9fc2 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Lock "e0b7a064-03b6-4a0d-88be-2f12c12a1ddb" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.881s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:01:43 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:01:48 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:01:49 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:01:53 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:01:54 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:01:55 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-66962211-7315-4f9c-830f-bb95a3d944cf tempest-VolumesNegativeTest-226359169 tempest-VolumesNegativeTest-226359169-project-member] Acquiring lock "423e0b0c-8714-47cb-a7b7-791d28b18f06" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:01:55 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-66962211-7315-4f9c-830f-bb95a3d944cf tempest-VolumesNegativeTest-226359169 tempest-VolumesNegativeTest-226359169-project-member] Lock "423e0b0c-8714-47cb-a7b7-791d28b18f06" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:01:55 user nova-compute[75176]: DEBUG nova.compute.manager [None req-66962211-7315-4f9c-830f-bb95a3d944cf tempest-VolumesNegativeTest-226359169 tempest-VolumesNegativeTest-226359169-project-member] [instance: 423e0b0c-8714-47cb-a7b7-791d28b18f06] Starting instance... {{(pid=75176) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 16:01:55 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-66962211-7315-4f9c-830f-bb95a3d944cf tempest-VolumesNegativeTest-226359169 tempest-VolumesNegativeTest-226359169-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:01:55 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-66962211-7315-4f9c-830f-bb95a3d944cf tempest-VolumesNegativeTest-226359169 tempest-VolumesNegativeTest-226359169-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:01:56 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-66962211-7315-4f9c-830f-bb95a3d944cf tempest-VolumesNegativeTest-226359169 tempest-VolumesNegativeTest-226359169-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75176) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 16:01:56 user nova-compute[75176]: INFO nova.compute.claims [None req-66962211-7315-4f9c-830f-bb95a3d944cf tempest-VolumesNegativeTest-226359169 tempest-VolumesNegativeTest-226359169-project-member] [instance: 423e0b0c-8714-47cb-a7b7-791d28b18f06] Claim successful on node user
Nov 28 16:01:56 user nova-compute[75176]: DEBUG nova.compute.provider_tree [None req-66962211-7315-4f9c-830f-bb95a3d944cf tempest-VolumesNegativeTest-226359169 tempest-VolumesNegativeTest-226359169-project-member] Inventory has not changed in ProviderTree for provider: b37848d8-f401-4155-a029-b0ffa09ff85b {{(pid=75176) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 16:01:56 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-66962211-7315-4f9c-830f-bb95a3d944cf tempest-VolumesNegativeTest-226359169 tempest-VolumesNegativeTest-226359169-project-member] Inventory has not changed for provider b37848d8-f401-4155-a029-b0ffa09ff85b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75176) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 16:01:56 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-66962211-7315-4f9c-830f-bb95a3d944cf tempest-VolumesNegativeTest-226359169 tempest-VolumesNegativeTest-226359169-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.495s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:01:56 user nova-compute[75176]: DEBUG nova.compute.manager [None req-66962211-7315-4f9c-830f-bb95a3d944cf tempest-VolumesNegativeTest-226359169 tempest-VolumesNegativeTest-226359169-project-member] [instance: 423e0b0c-8714-47cb-a7b7-791d28b18f06] Start building networks asynchronously for instance. {{(pid=75176) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 16:01:56 user nova-compute[75176]: DEBUG nova.compute.manager [None req-66962211-7315-4f9c-830f-bb95a3d944cf tempest-VolumesNegativeTest-226359169 tempest-VolumesNegativeTest-226359169-project-member] [instance: 423e0b0c-8714-47cb-a7b7-791d28b18f06] Allocating IP information in the background. {{(pid=75176) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 16:01:56 user nova-compute[75176]: DEBUG nova.network.neutron [None req-66962211-7315-4f9c-830f-bb95a3d944cf tempest-VolumesNegativeTest-226359169 tempest-VolumesNegativeTest-226359169-project-member] [instance: 423e0b0c-8714-47cb-a7b7-791d28b18f06] allocate_for_instance() {{(pid=75176) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 16:01:56 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-66962211-7315-4f9c-830f-bb95a3d944cf tempest-VolumesNegativeTest-226359169 tempest-VolumesNegativeTest-226359169-project-member] [instance: 423e0b0c-8714-47cb-a7b7-791d28b18f06] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 16:01:56 user nova-compute[75176]: DEBUG nova.compute.manager [None req-66962211-7315-4f9c-830f-bb95a3d944cf tempest-VolumesNegativeTest-226359169 tempest-VolumesNegativeTest-226359169-project-member] [instance: 423e0b0c-8714-47cb-a7b7-791d28b18f06] Start building block device mappings for instance. {{(pid=75176) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 16:01:56 user nova-compute[75176]: DEBUG nova.policy [None req-66962211-7315-4f9c-830f-bb95a3d944cf tempest-VolumesNegativeTest-226359169 tempest-VolumesNegativeTest-226359169-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e73b4233feac4ecc99babdf01eaaaced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2382bf1fb7b7466da42b8da1c4c88129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75176) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 16:01:56 user nova-compute[75176]: DEBUG nova.compute.manager [None req-66962211-7315-4f9c-830f-bb95a3d944cf tempest-VolumesNegativeTest-226359169 tempest-VolumesNegativeTest-226359169-project-member] [instance: 423e0b0c-8714-47cb-a7b7-791d28b18f06] Start spawning the instance on the hypervisor. {{(pid=75176) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 16:01:56 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-66962211-7315-4f9c-830f-bb95a3d944cf tempest-VolumesNegativeTest-226359169 tempest-VolumesNegativeTest-226359169-project-member] [instance: 423e0b0c-8714-47cb-a7b7-791d28b18f06] Creating instance directory {{(pid=75176) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 16:01:56 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-66962211-7315-4f9c-830f-bb95a3d944cf tempest-VolumesNegativeTest-226359169 tempest-VolumesNegativeTest-226359169-project-member] [instance: 423e0b0c-8714-47cb-a7b7-791d28b18f06] Creating image(s)
Nov 28 16:01:56 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-66962211-7315-4f9c-830f-bb95a3d944cf tempest-VolumesNegativeTest-226359169 tempest-VolumesNegativeTest-226359169-project-member] Acquiring lock "/opt/stack/data/nova/instances/423e0b0c-8714-47cb-a7b7-791d28b18f06/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:01:56 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-66962211-7315-4f9c-830f-bb95a3d944cf tempest-VolumesNegativeTest-226359169 tempest-VolumesNegativeTest-226359169-project-member] Lock "/opt/stack/data/nova/instances/423e0b0c-8714-47cb-a7b7-791d28b18f06/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:01:56 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-66962211-7315-4f9c-830f-bb95a3d944cf tempest-VolumesNegativeTest-226359169 tempest-VolumesNegativeTest-226359169-project-member] Lock "/opt/stack/data/nova/instances/423e0b0c-8714-47cb-a7b7-791d28b18f06/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:01:56 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-66962211-7315-4f9c-830f-bb95a3d944cf tempest-VolumesNegativeTest-226359169 tempest-VolumesNegativeTest-226359169-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:01:56 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-66962211-7315-4f9c-830f-bb95a3d944cf tempest-VolumesNegativeTest-226359169 tempest-VolumesNegativeTest-226359169-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json" returned: 0 in 0.193s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:01:56 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-66962211-7315-4f9c-830f-bb95a3d944cf tempest-VolumesNegativeTest-226359169 tempest-VolumesNegativeTest-226359169-project-member] Acquiring lock "5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:01:56 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-66962211-7315-4f9c-830f-bb95a3d944cf tempest-VolumesNegativeTest-226359169 tempest-VolumesNegativeTest-226359169-project-member] Lock "5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:01:56 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-66962211-7315-4f9c-830f-bb95a3d944cf tempest-VolumesNegativeTest-226359169 tempest-VolumesNegativeTest-226359169-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:01:57 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-66962211-7315-4f9c-830f-bb95a3d944cf tempest-VolumesNegativeTest-226359169 tempest-VolumesNegativeTest-226359169-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json" returned: 0 in 0.188s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:01:57 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-66962211-7315-4f9c-830f-bb95a3d944cf tempest-VolumesNegativeTest-226359169 tempest-VolumesNegativeTest-226359169-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2,backing_fmt=raw /opt/stack/data/nova/instances/423e0b0c-8714-47cb-a7b7-791d28b18f06/disk 1073741824 {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:01:57 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-66962211-7315-4f9c-830f-bb95a3d944cf tempest-VolumesNegativeTest-226359169 tempest-VolumesNegativeTest-226359169-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2,backing_fmt=raw /opt/stack/data/nova/instances/423e0b0c-8714-47cb-a7b7-791d28b18f06/disk 1073741824" returned: 0 in 0.061s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:01:57 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-66962211-7315-4f9c-830f-bb95a3d944cf tempest-VolumesNegativeTest-226359169 tempest-VolumesNegativeTest-226359169-project-member] Lock "5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.257s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:01:57 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-66962211-7315-4f9c-830f-bb95a3d944cf tempest-VolumesNegativeTest-226359169 tempest-VolumesNegativeTest-226359169-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:01:57 user nova-compute[75176]: DEBUG nova.network.neutron [None req-66962211-7315-4f9c-830f-bb95a3d944cf tempest-VolumesNegativeTest-226359169 tempest-VolumesNegativeTest-226359169-project-member] [instance: 423e0b0c-8714-47cb-a7b7-791d28b18f06] Successfully created port: cf9178a0-d59d-4370-8482-fcf2d6558076 {{(pid=75176) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 16:01:57 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-66962211-7315-4f9c-830f-bb95a3d944cf tempest-VolumesNegativeTest-226359169 tempest-VolumesNegativeTest-226359169-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json" returned: 0 in 0.183s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:01:57 user nova-compute[75176]: DEBUG nova.virt.disk.api [None req-66962211-7315-4f9c-830f-bb95a3d944cf tempest-VolumesNegativeTest-226359169 tempest-VolumesNegativeTest-226359169-project-member] Checking if we can resize image /opt/stack/data/nova/instances/423e0b0c-8714-47cb-a7b7-791d28b18f06/disk. size=1073741824 {{(pid=75176) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 16:01:57 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-66962211-7315-4f9c-830f-bb95a3d944cf tempest-VolumesNegativeTest-226359169 tempest-VolumesNegativeTest-226359169-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/423e0b0c-8714-47cb-a7b7-791d28b18f06/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:01:57 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-66962211-7315-4f9c-830f-bb95a3d944cf tempest-VolumesNegativeTest-226359169 tempest-VolumesNegativeTest-226359169-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/423e0b0c-8714-47cb-a7b7-791d28b18f06/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:01:57 user nova-compute[75176]: DEBUG nova.virt.disk.api [None req-66962211-7315-4f9c-830f-bb95a3d944cf tempest-VolumesNegativeTest-226359169 tempest-VolumesNegativeTest-226359169-project-member] Cannot resize image /opt/stack/data/nova/instances/423e0b0c-8714-47cb-a7b7-791d28b18f06/disk to a smaller size. {{(pid=75176) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 16:01:57 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-66962211-7315-4f9c-830f-bb95a3d944cf tempest-VolumesNegativeTest-226359169 tempest-VolumesNegativeTest-226359169-project-member] [instance: 423e0b0c-8714-47cb-a7b7-791d28b18f06] Created local disks {{(pid=75176) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 16:01:57 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-66962211-7315-4f9c-830f-bb95a3d944cf tempest-VolumesNegativeTest-226359169 tempest-VolumesNegativeTest-226359169-project-member] [instance: 423e0b0c-8714-47cb-a7b7-791d28b18f06] Ensure instance console log exists: /opt/stack/data/nova/instances/423e0b0c-8714-47cb-a7b7-791d28b18f06/console.log {{(pid=75176) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 16:01:57 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-66962211-7315-4f9c-830f-bb95a3d944cf tempest-VolumesNegativeTest-226359169 tempest-VolumesNegativeTest-226359169-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:01:57 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-66962211-7315-4f9c-830f-bb95a3d944cf tempest-VolumesNegativeTest-226359169 tempest-VolumesNegativeTest-226359169-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:01:57 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-66962211-7315-4f9c-830f-bb95a3d944cf tempest-VolumesNegativeTest-226359169 tempest-VolumesNegativeTest-226359169-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:01:57 user nova-compute[75176]: DEBUG nova.network.neutron [None req-66962211-7315-4f9c-830f-bb95a3d944cf tempest-VolumesNegativeTest-226359169 tempest-VolumesNegativeTest-226359169-project-member] [instance: 423e0b0c-8714-47cb-a7b7-791d28b18f06] Successfully updated port: cf9178a0-d59d-4370-8482-fcf2d6558076 {{(pid=75176) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 16:01:57 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-66962211-7315-4f9c-830f-bb95a3d944cf tempest-VolumesNegativeTest-226359169 tempest-VolumesNegativeTest-226359169-project-member] Acquiring lock "refresh_cache-423e0b0c-8714-47cb-a7b7-791d28b18f06" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 16:01:57 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-66962211-7315-4f9c-830f-bb95a3d944cf tempest-VolumesNegativeTest-226359169 tempest-VolumesNegativeTest-226359169-project-member] Acquired lock "refresh_cache-423e0b0c-8714-47cb-a7b7-791d28b18f06" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 16:01:57 user nova-compute[75176]: DEBUG nova.network.neutron [None req-66962211-7315-4f9c-830f-bb95a3d944cf tempest-VolumesNegativeTest-226359169 tempest-VolumesNegativeTest-226359169-project-member] [instance: 423e0b0c-8714-47cb-a7b7-791d28b18f06] Building network info cache for instance {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 16:01:57 user nova-compute[75176]: DEBUG nova.compute.manager [req-07febb02-539b-4212-9054-62251da0c775 req-a1c476af-2037-4234-94b0-35b0bb99ebd5 service nova] [instance: 423e0b0c-8714-47cb-a7b7-791d28b18f06] Received event network-changed-cf9178a0-d59d-4370-8482-fcf2d6558076 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 16:01:57 user nova-compute[75176]: DEBUG nova.compute.manager [req-07febb02-539b-4212-9054-62251da0c775 req-a1c476af-2037-4234-94b0-35b0bb99ebd5 service nova] [instance: 423e0b0c-8714-47cb-a7b7-791d28b18f06] Refreshing instance network info cache due to event network-changed-cf9178a0-d59d-4370-8482-fcf2d6558076. {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 16:01:57 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-07febb02-539b-4212-9054-62251da0c775 req-a1c476af-2037-4234-94b0-35b0bb99ebd5 service nova] Acquiring lock "refresh_cache-423e0b0c-8714-47cb-a7b7-791d28b18f06" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 16:01:57 user nova-compute[75176]: DEBUG nova.network.neutron [None req-66962211-7315-4f9c-830f-bb95a3d944cf tempest-VolumesNegativeTest-226359169 tempest-VolumesNegativeTest-226359169-project-member] [instance: 423e0b0c-8714-47cb-a7b7-791d28b18f06] Instance cache missing network info. {{(pid=75176) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 16:01:58 user nova-compute[75176]: DEBUG nova.network.neutron [None req-66962211-7315-4f9c-830f-bb95a3d944cf tempest-VolumesNegativeTest-226359169 tempest-VolumesNegativeTest-226359169-project-member] [instance: 423e0b0c-8714-47cb-a7b7-791d28b18f06] Updating instance_info_cache with network_info: [{"id": "cf9178a0-d59d-4370-8482-fcf2d6558076", "address": "fa:16:3e:2c:da:2b", "network": {"id": "799e857e-f9a6-4c99-8f85-f117f7e47961", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.46", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "1b91c5d0672c4224a48df2e1f92688e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf9178a0-d5", "ovs_interfaceid": "cf9178a0-d59d-4370-8482-fcf2d6558076", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 16:01:58 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-66962211-7315-4f9c-830f-bb95a3d944cf tempest-VolumesNegativeTest-226359169 tempest-VolumesNegativeTest-226359169-project-member] Releasing lock "refresh_cache-423e0b0c-8714-47cb-a7b7-791d28b18f06" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 16:01:58 user nova-compute[75176]: DEBUG nova.compute.manager [None req-66962211-7315-4f9c-830f-bb95a3d944cf tempest-VolumesNegativeTest-226359169 tempest-VolumesNegativeTest-226359169-project-member] [instance: 423e0b0c-8714-47cb-a7b7-791d28b18f06] Instance network_info: |[{"id": "cf9178a0-d59d-4370-8482-fcf2d6558076", "address": "fa:16:3e:2c:da:2b", "network": {"id": "799e857e-f9a6-4c99-8f85-f117f7e47961", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.46", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "1b91c5d0672c4224a48df2e1f92688e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf9178a0-d5", "ovs_interfaceid": "cf9178a0-d59d-4370-8482-fcf2d6558076", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75176) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 16:01:58 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-07febb02-539b-4212-9054-62251da0c775 req-a1c476af-2037-4234-94b0-35b0bb99ebd5 service nova] Acquired lock "refresh_cache-423e0b0c-8714-47cb-a7b7-791d28b18f06" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 16:01:58 user nova-compute[75176]: DEBUG nova.network.neutron [req-07febb02-539b-4212-9054-62251da0c775 req-a1c476af-2037-4234-94b0-35b0bb99ebd5 service nova] [instance: 423e0b0c-8714-47cb-a7b7-791d28b18f06] Refreshing network info cache for port cf9178a0-d59d-4370-8482-fcf2d6558076 {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 16:01:58 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-66962211-7315-4f9c-830f-bb95a3d944cf tempest-VolumesNegativeTest-226359169 tempest-VolumesNegativeTest-226359169-project-member] [instance: 423e0b0c-8714-47cb-a7b7-791d28b18f06] Start _get_guest_xml network_info=[{"id": "cf9178a0-d59d-4370-8482-fcf2d6558076", "address": "fa:16:3e:2c:da:2b", "network": {"id": "799e857e-f9a6-4c99-8f85-f117f7e47961", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.46", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "1b91c5d0672c4224a48df2e1f92688e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf9178a0-d5", "ovs_interfaceid": "cf9178a0-d59d-4370-8482-fcf2d6558076", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T15:35:12Z,direct_url=<?>,disk_format='qcow2',id=1f41819e-c93f-4dc7-b253-37a27bbbbc74,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1b91c5d0672c4224a48df2e1f92688e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T15:35:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'size': 0, 'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'image_id': '1f41819e-c93f-4dc7-b253-37a27bbbbc74'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75176) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 16:01:58 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-66962211-7315-4f9c-830f-bb95a3d944cf tempest-VolumesNegativeTest-226359169 tempest-VolumesNegativeTest-226359169-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 16:01:58 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-66962211-7315-4f9c-830f-bb95a3d944cf tempest-VolumesNegativeTest-226359169 tempest-VolumesNegativeTest-226359169-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 16:01:58 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-66962211-7315-4f9c-830f-bb95a3d944cf tempest-VolumesNegativeTest-226359169 tempest-VolumesNegativeTest-226359169-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75176) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 16:01:58 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-66962211-7315-4f9c-830f-bb95a3d944cf tempest-VolumesNegativeTest-226359169 tempest-VolumesNegativeTest-226359169-project-member] CPU controller missing on host. {{(pid=75176) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 16:01:58 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-66962211-7315-4f9c-830f-bb95a3d944cf tempest-VolumesNegativeTest-226359169 tempest-VolumesNegativeTest-226359169-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75176) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 16:01:58 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-66962211-7315-4f9c-830f-bb95a3d944cf tempest-VolumesNegativeTest-226359169 tempest-VolumesNegativeTest-226359169-project-member] CPU controller found on host. {{(pid=75176) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 16:01:58 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-66962211-7315-4f9c-830f-bb95a3d944cf tempest-VolumesNegativeTest-226359169 tempest-VolumesNegativeTest-226359169-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75176) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 16:01:58 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-66962211-7315-4f9c-830f-bb95a3d944cf tempest-VolumesNegativeTest-226359169 tempest-VolumesNegativeTest-226359169-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T15:35:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T15:35:12Z,direct_url=<?>,disk_format='qcow2',id=1f41819e-c93f-4dc7-b253-37a27bbbbc74,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1b91c5d0672c4224a48df2e1f92688e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T15:35:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 16:01:58 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-66962211-7315-4f9c-830f-bb95a3d944cf tempest-VolumesNegativeTest-226359169 tempest-VolumesNegativeTest-226359169-project-member] Flavor limits 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 16:01:58 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-66962211-7315-4f9c-830f-bb95a3d944cf tempest-VolumesNegativeTest-226359169 tempest-VolumesNegativeTest-226359169-project-member] Image limits 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 16:01:58 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-66962211-7315-4f9c-830f-bb95a3d944cf tempest-VolumesNegativeTest-226359169 tempest-VolumesNegativeTest-226359169-project-member] Flavor pref 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 16:01:58 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-66962211-7315-4f9c-830f-bb95a3d944cf tempest-VolumesNegativeTest-226359169 tempest-VolumesNegativeTest-226359169-project-member] Image pref 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 16:01:58 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-66962211-7315-4f9c-830f-bb95a3d944cf tempest-VolumesNegativeTest-226359169 tempest-VolumesNegativeTest-226359169-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 16:01:58 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-66962211-7315-4f9c-830f-bb95a3d944cf tempest-VolumesNegativeTest-226359169 tempest-VolumesNegativeTest-226359169-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 16:01:58 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-66962211-7315-4f9c-830f-bb95a3d944cf tempest-VolumesNegativeTest-226359169 tempest-VolumesNegativeTest-226359169-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75176) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 16:01:58 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-66962211-7315-4f9c-830f-bb95a3d944cf tempest-VolumesNegativeTest-226359169 tempest-VolumesNegativeTest-226359169-project-member] Got 1 possible topologies {{(pid=75176) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 16:01:58 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-66962211-7315-4f9c-830f-bb95a3d944cf tempest-VolumesNegativeTest-226359169 tempest-VolumesNegativeTest-226359169-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 16:01:58 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-66962211-7315-4f9c-830f-bb95a3d944cf tempest-VolumesNegativeTest-226359169 tempest-VolumesNegativeTest-226359169-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 16:01:58 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-66962211-7315-4f9c-830f-bb95a3d944cf tempest-VolumesNegativeTest-226359169 tempest-VolumesNegativeTest-226359169-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T16:01:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1557314343',display_name='tempest-VolumesNegativeTest-instance-1557314343',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1557314343',id=49,image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2382bf1fb7b7466da42b8da1c4c88129',ramdisk_id='',reservation_id='r-nq89lt0i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-226359169',owner_user_name='tempest-VolumesNegativeTest-226359169-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T16:01:57Z,user_data=None,user_id='e73b4233feac4ecc99babdf01eaaaced',uuid=423e0b0c-8714-47cb-a7b7-791d28b18f06,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cf9178a0-d59d-4370-8482-fcf2d6558076", "address": "fa:16:3e:2c:da:2b", "network": {"id": "799e857e-f9a6-4c99-8f85-f117f7e47961", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.46", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "1b91c5d0672c4224a48df2e1f92688e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf9178a0-d5", "ovs_interfaceid": "cf9178a0-d59d-4370-8482-fcf2d6558076", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75176) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 16:01:58 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-66962211-7315-4f9c-830f-bb95a3d944cf tempest-VolumesNegativeTest-226359169 tempest-VolumesNegativeTest-226359169-project-member] Converting VIF {"id": "cf9178a0-d59d-4370-8482-fcf2d6558076", "address": "fa:16:3e:2c:da:2b", "network": {"id": "799e857e-f9a6-4c99-8f85-f117f7e47961", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.46", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "1b91c5d0672c4224a48df2e1f92688e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf9178a0-d5", "ovs_interfaceid": "cf9178a0-d59d-4370-8482-fcf2d6558076", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 16:01:58 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-66962211-7315-4f9c-830f-bb95a3d944cf tempest-VolumesNegativeTest-226359169 tempest-VolumesNegativeTest-226359169-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2c:da:2b,bridge_name='br-int',has_traffic_filtering=True,id=cf9178a0-d59d-4370-8482-fcf2d6558076,network=Network(799e857e-f9a6-4c99-8f85-f117f7e47961),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf9178a0-d5') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 16:01:58 user nova-compute[75176]: DEBUG nova.objects.instance [None req-66962211-7315-4f9c-830f-bb95a3d944cf tempest-VolumesNegativeTest-226359169 tempest-VolumesNegativeTest-226359169-project-member] Lazy-loading 'pci_devices' on Instance uuid 423e0b0c-8714-47cb-a7b7-791d28b18f06 {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 16:01:58 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-66962211-7315-4f9c-830f-bb95a3d944cf tempest-VolumesNegativeTest-226359169 tempest-VolumesNegativeTest-226359169-project-member] [instance: 423e0b0c-8714-47cb-a7b7-791d28b18f06] End _get_guest_xml xml=<domain type="kvm">
Nov 28 16:01:58 user nova-compute[75176]:   <uuid>423e0b0c-8714-47cb-a7b7-791d28b18f06</uuid>
Nov 28 16:01:58 user nova-compute[75176]:   <name>instance-00000031</name>
Nov 28 16:01:58 user nova-compute[75176]:   <memory>524288</memory>
Nov 28 16:01:58 user nova-compute[75176]:   <vcpu>1</vcpu>
Nov 28 16:01:58 user nova-compute[75176]:   <metadata>
Nov 28 16:01:58 user nova-compute[75176]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 16:01:58 user nova-compute[75176]:       <nova:package version="0.0.0"/>
Nov 28 16:01:58 user nova-compute[75176]:       <nova:name>tempest-VolumesNegativeTest-instance-1557314343</nova:name>
Nov 28 16:01:58 user nova-compute[75176]:       <nova:creationTime>2023-11-28 16:01:58</nova:creationTime>
Nov 28 16:01:58 user nova-compute[75176]:       <nova:flavor name="m1.tiny">
Nov 28 16:01:58 user nova-compute[75176]:         <nova:memory>512</nova:memory>
Nov 28 16:01:58 user nova-compute[75176]:         <nova:disk>1</nova:disk>
Nov 28 16:01:58 user nova-compute[75176]:         <nova:swap>0</nova:swap>
Nov 28 16:01:58 user nova-compute[75176]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 16:01:58 user nova-compute[75176]:         <nova:vcpus>1</nova:vcpus>
Nov 28 16:01:58 user nova-compute[75176]:       </nova:flavor>
Nov 28 16:01:58 user nova-compute[75176]:       <nova:owner>
Nov 28 16:01:58 user nova-compute[75176]:         <nova:user uuid="e73b4233feac4ecc99babdf01eaaaced">tempest-VolumesNegativeTest-226359169-project-member</nova:user>
Nov 28 16:01:58 user nova-compute[75176]:         <nova:project uuid="2382bf1fb7b7466da42b8da1c4c88129">tempest-VolumesNegativeTest-226359169</nova:project>
Nov 28 16:01:58 user nova-compute[75176]:       </nova:owner>
Nov 28 16:01:58 user nova-compute[75176]:       <nova:root type="image" uuid="1f41819e-c93f-4dc7-b253-37a27bbbbc74"/>
Nov 28 16:01:58 user nova-compute[75176]:       <nova:ports>
Nov 28 16:01:58 user nova-compute[75176]:         <nova:port uuid="cf9178a0-d59d-4370-8482-fcf2d6558076">
Nov 28 16:01:58 user nova-compute[75176]:           <nova:ip type="fixed" address="192.168.233.46" ipVersion="4"/>
Nov 28 16:01:58 user nova-compute[75176]:         </nova:port>
Nov 28 16:01:58 user nova-compute[75176]:       </nova:ports>
Nov 28 16:01:58 user nova-compute[75176]:     </nova:instance>
Nov 28 16:01:58 user nova-compute[75176]:   </metadata>
Nov 28 16:01:58 user nova-compute[75176]:   <sysinfo type="smbios">
Nov 28 16:01:58 user nova-compute[75176]:     <system>
Nov 28 16:01:58 user nova-compute[75176]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 16:01:58 user nova-compute[75176]:       <entry name="product">OpenStack Nova</entry>
Nov 28 16:01:58 user nova-compute[75176]:       <entry name="version">0.0.0</entry>
Nov 28 16:01:58 user nova-compute[75176]:       <entry name="serial">423e0b0c-8714-47cb-a7b7-791d28b18f06</entry>
Nov 28 16:01:58 user nova-compute[75176]:       <entry name="uuid">423e0b0c-8714-47cb-a7b7-791d28b18f06</entry>
Nov 28 16:01:58 user nova-compute[75176]:       <entry name="family">Virtual Machine</entry>
Nov 28 16:01:58 user nova-compute[75176]:     </system>
Nov 28 16:01:58 user nova-compute[75176]:   </sysinfo>
Nov 28 16:01:58 user nova-compute[75176]:   <os>
Nov 28 16:01:58 user nova-compute[75176]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 16:01:58 user nova-compute[75176]:     <boot dev="hd"/>
Nov 28 16:01:58 user nova-compute[75176]:     <smbios mode="sysinfo"/>
Nov 28 16:01:58 user nova-compute[75176]:   </os>
Nov 28 16:01:58 user nova-compute[75176]:   <features>
Nov 28 16:01:58 user nova-compute[75176]:     <acpi/>
Nov 28 16:01:58 user nova-compute[75176]:     <apic/>
Nov 28 16:01:58 user nova-compute[75176]:     <vmcoreinfo/>
Nov 28 16:01:58 user nova-compute[75176]:   </features>
Nov 28 16:01:58 user nova-compute[75176]:   <clock offset="utc">
Nov 28 16:01:58 user nova-compute[75176]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 16:01:58 user nova-compute[75176]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 16:01:58 user nova-compute[75176]:     <timer name="hpet" present="no"/>
Nov 28 16:01:58 user nova-compute[75176]:   </clock>
Nov 28 16:01:58 user nova-compute[75176]:   <cpu mode="custom" match="exact">
Nov 28 16:01:58 user nova-compute[75176]:     <model>Nehalem</model>
Nov 28 16:01:58 user nova-compute[75176]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 16:01:58 user nova-compute[75176]:   </cpu>
Nov 28 16:01:58 user nova-compute[75176]:   <devices>
Nov 28 16:01:58 user nova-compute[75176]:     <disk type="file" device="disk">
Nov 28 16:01:58 user nova-compute[75176]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 16:01:58 user nova-compute[75176]:       <source file="/opt/stack/data/nova/instances/423e0b0c-8714-47cb-a7b7-791d28b18f06/disk"/>
Nov 28 16:01:58 user nova-compute[75176]:       <target dev="vda" bus="virtio"/>
Nov 28 16:01:58 user nova-compute[75176]:     </disk>
Nov 28 16:01:58 user nova-compute[75176]:     <interface type="ethernet">
Nov 28 16:01:58 user nova-compute[75176]:       <mac address="fa:16:3e:2c:da:2b"/>
Nov 28 16:01:58 user nova-compute[75176]:       <model type="virtio"/>
Nov 28 16:01:58 user nova-compute[75176]:       <mtu size="1442"/>
Nov 28 16:01:58 user nova-compute[75176]:       <target dev="tapcf9178a0-d5"/>
Nov 28 16:01:58 user nova-compute[75176]:     </interface>
Nov 28 16:01:58 user nova-compute[75176]:     <serial type="pty">
Nov 28 16:01:58 user nova-compute[75176]:       <log file="/opt/stack/data/nova/instances/423e0b0c-8714-47cb-a7b7-791d28b18f06/console.log" append="off"/>
Nov 28 16:01:58 user nova-compute[75176]:     </serial>
Nov 28 16:01:58 user nova-compute[75176]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 16:01:58 user nova-compute[75176]:     <video>
Nov 28 16:01:58 user nova-compute[75176]:       <model type="virtio"/>
Nov 28 16:01:58 user nova-compute[75176]:     </video>
Nov 28 16:01:58 user nova-compute[75176]:     <rng model="virtio">
Nov 28 16:01:58 user nova-compute[75176]:       <backend model="random">/dev/urandom</backend>
Nov 28 16:01:58 user nova-compute[75176]:     </rng>
Nov 28 16:01:58 user nova-compute[75176]:     <controller type="usb" index="0" model="none"/>
Nov 28 16:01:58 user nova-compute[75176]:     <memballoon model="virtio">
Nov 28 16:01:58 user nova-compute[75176]:       <stats period="10"/>
Nov 28 16:01:58 user nova-compute[75176]:     </memballoon>
Nov 28 16:01:58 user nova-compute[75176]:   </devices>
Nov 28 16:01:58 user nova-compute[75176]: </domain>
Nov 28 16:01:58 user nova-compute[75176]:  {{(pid=75176) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 16:01:58 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-66962211-7315-4f9c-830f-bb95a3d944cf tempest-VolumesNegativeTest-226359169 tempest-VolumesNegativeTest-226359169-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T16:01:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1557314343',display_name='tempest-VolumesNegativeTest-instance-1557314343',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1557314343',id=49,image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2382bf1fb7b7466da42b8da1c4c88129',ramdisk_id='',reservation_id='r-nq89lt0i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-226359169',owner_user_name='tempest-VolumesNegativeTest-226359169-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T16:01:57Z,user_data=None,user_id='e73b4233feac4ecc99babdf01eaaaced',uuid=423e0b0c-8714-47cb-a7b7-791d28b18f06,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cf9178a0-d59d-4370-8482-fcf2d6558076", "address": "fa:16:3e:2c:da:2b", "network": {"id": "799e857e-f9a6-4c99-8f85-f117f7e47961", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.46", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "1b91c5d0672c4224a48df2e1f92688e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf9178a0-d5", "ovs_interfaceid": "cf9178a0-d59d-4370-8482-fcf2d6558076", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 16:01:58 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-66962211-7315-4f9c-830f-bb95a3d944cf tempest-VolumesNegativeTest-226359169 tempest-VolumesNegativeTest-226359169-project-member] Converting VIF {"id": "cf9178a0-d59d-4370-8482-fcf2d6558076", "address": "fa:16:3e:2c:da:2b", "network": {"id": "799e857e-f9a6-4c99-8f85-f117f7e47961", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.46", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "1b91c5d0672c4224a48df2e1f92688e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf9178a0-d5", "ovs_interfaceid": "cf9178a0-d59d-4370-8482-fcf2d6558076", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 16:01:58 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-66962211-7315-4f9c-830f-bb95a3d944cf tempest-VolumesNegativeTest-226359169 tempest-VolumesNegativeTest-226359169-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2c:da:2b,bridge_name='br-int',has_traffic_filtering=True,id=cf9178a0-d59d-4370-8482-fcf2d6558076,network=Network(799e857e-f9a6-4c99-8f85-f117f7e47961),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf9178a0-d5') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 16:01:58 user nova-compute[75176]: DEBUG os_vif [None req-66962211-7315-4f9c-830f-bb95a3d944cf tempest-VolumesNegativeTest-226359169 tempest-VolumesNegativeTest-226359169-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2c:da:2b,bridge_name='br-int',has_traffic_filtering=True,id=cf9178a0-d59d-4370-8482-fcf2d6558076,network=Network(799e857e-f9a6-4c99-8f85-f117f7e47961),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf9178a0-d5') {{(pid=75176) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 16:01:58 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:01:58 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 16:01:58 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 16:01:58 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:01:58 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '823f2467-ba38-5a77-a8eb-a61c5da9dbb4', '_type': 'linux-noop'}}, row=False) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 16:01:58 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:01:58 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:01:58 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:01:58 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcf9178a0-d5, may_exist=True, interface_attrs={}) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 16:01:58 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcf9178a0-d5, col_values=(('qos', UUID('33d42f55-fe59-4416-908f-5cc9d94945c6')),), if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 16:01:58 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcf9178a0-d5, col_values=(('external_ids', {'iface-id': 'cf9178a0-d59d-4370-8482-fcf2d6558076', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2c:da:2b', 'vm-uuid': '423e0b0c-8714-47cb-a7b7-791d28b18f06'}),), if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 16:01:58 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:01:58 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 16:01:58 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:01:58 user nova-compute[75176]: INFO os_vif [None req-66962211-7315-4f9c-830f-bb95a3d944cf tempest-VolumesNegativeTest-226359169 tempest-VolumesNegativeTest-226359169-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2c:da:2b,bridge_name='br-int',has_traffic_filtering=True,id=cf9178a0-d59d-4370-8482-fcf2d6558076,network=Network(799e857e-f9a6-4c99-8f85-f117f7e47961),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf9178a0-d5')
Nov 28 16:01:58 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-66962211-7315-4f9c-830f-bb95a3d944cf tempest-VolumesNegativeTest-226359169 tempest-VolumesNegativeTest-226359169-project-member] No BDM found with device name vda, not building metadata. {{(pid=75176) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 16:01:58 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-66962211-7315-4f9c-830f-bb95a3d944cf tempest-VolumesNegativeTest-226359169 tempest-VolumesNegativeTest-226359169-project-member] No VIF found with MAC fa:16:3e:2c:da:2b, not building metadata {{(pid=75176) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 16:01:58 user nova-compute[75176]: DEBUG nova.network.neutron [req-07febb02-539b-4212-9054-62251da0c775 req-a1c476af-2037-4234-94b0-35b0bb99ebd5 service nova] [instance: 423e0b0c-8714-47cb-a7b7-791d28b18f06] Updated VIF entry in instance network info cache for port cf9178a0-d59d-4370-8482-fcf2d6558076. {{(pid=75176) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 16:01:58 user nova-compute[75176]: DEBUG nova.network.neutron [req-07febb02-539b-4212-9054-62251da0c775 req-a1c476af-2037-4234-94b0-35b0bb99ebd5 service nova] [instance: 423e0b0c-8714-47cb-a7b7-791d28b18f06] Updating instance_info_cache with network_info: [{"id": "cf9178a0-d59d-4370-8482-fcf2d6558076", "address": "fa:16:3e:2c:da:2b", "network": {"id": "799e857e-f9a6-4c99-8f85-f117f7e47961", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.46", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "1b91c5d0672c4224a48df2e1f92688e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf9178a0-d5", "ovs_interfaceid": "cf9178a0-d59d-4370-8482-fcf2d6558076", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 16:01:58 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-07febb02-539b-4212-9054-62251da0c775 req-a1c476af-2037-4234-94b0-35b0bb99ebd5 service nova] Releasing lock "refresh_cache-423e0b0c-8714-47cb-a7b7-791d28b18f06" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 16:01:59 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:01:59 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:01:59 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:01:59 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:01:59 user nova-compute[75176]: DEBUG nova.compute.manager [req-a31b3d1a-6cfc-45eb-b874-8caa5140b275 req-3d295cb5-0c4a-461e-9b6b-7833c8d0607f service nova] [instance: 423e0b0c-8714-47cb-a7b7-791d28b18f06] Received event network-vif-plugged-cf9178a0-d59d-4370-8482-fcf2d6558076 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 16:01:59 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-a31b3d1a-6cfc-45eb-b874-8caa5140b275 req-3d295cb5-0c4a-461e-9b6b-7833c8d0607f service nova] Acquiring lock "423e0b0c-8714-47cb-a7b7-791d28b18f06-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:01:59 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-a31b3d1a-6cfc-45eb-b874-8caa5140b275 req-3d295cb5-0c4a-461e-9b6b-7833c8d0607f service nova] Lock "423e0b0c-8714-47cb-a7b7-791d28b18f06-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:01:59 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-a31b3d1a-6cfc-45eb-b874-8caa5140b275 req-3d295cb5-0c4a-461e-9b6b-7833c8d0607f service nova] Lock "423e0b0c-8714-47cb-a7b7-791d28b18f06-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:01:59 user nova-compute[75176]: DEBUG nova.compute.manager [req-a31b3d1a-6cfc-45eb-b874-8caa5140b275 req-3d295cb5-0c4a-461e-9b6b-7833c8d0607f service nova] [instance: 423e0b0c-8714-47cb-a7b7-791d28b18f06] No waiting events found dispatching network-vif-plugged-cf9178a0-d59d-4370-8482-fcf2d6558076 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 16:01:59 user nova-compute[75176]: WARNING nova.compute.manager [req-a31b3d1a-6cfc-45eb-b874-8caa5140b275 req-3d295cb5-0c4a-461e-9b6b-7833c8d0607f service nova] [instance: 423e0b0c-8714-47cb-a7b7-791d28b18f06] Received unexpected event network-vif-plugged-cf9178a0-d59d-4370-8482-fcf2d6558076 for instance with vm_state building and task_state spawning.
Nov 28 16:02:00 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:02:00 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:02:00 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:02:00 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:02:00 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:02:00 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:02:01 user nova-compute[75176]: DEBUG nova.compute.manager [None req-66962211-7315-4f9c-830f-bb95a3d944cf tempest-VolumesNegativeTest-226359169 tempest-VolumesNegativeTest-226359169-project-member] [instance: 423e0b0c-8714-47cb-a7b7-791d28b18f06] Instance event wait completed in 0 seconds for  {{(pid=75176) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 16:02:01 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-66962211-7315-4f9c-830f-bb95a3d944cf tempest-VolumesNegativeTest-226359169 tempest-VolumesNegativeTest-226359169-project-member] [instance: 423e0b0c-8714-47cb-a7b7-791d28b18f06] Guest created on hypervisor {{(pid=75176) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 16:02:01 user nova-compute[75176]: INFO nova.virt.libvirt.driver [-] [instance: 423e0b0c-8714-47cb-a7b7-791d28b18f06] Instance spawned successfully.
Nov 28 16:02:01 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-66962211-7315-4f9c-830f-bb95a3d944cf tempest-VolumesNegativeTest-226359169 tempest-VolumesNegativeTest-226359169-project-member] [instance: 423e0b0c-8714-47cb-a7b7-791d28b18f06] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 16:02:01 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-66962211-7315-4f9c-830f-bb95a3d944cf tempest-VolumesNegativeTest-226359169 tempest-VolumesNegativeTest-226359169-project-member] [instance: 423e0b0c-8714-47cb-a7b7-791d28b18f06] Found default for hw_cdrom_bus of ide {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 16:02:01 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-66962211-7315-4f9c-830f-bb95a3d944cf tempest-VolumesNegativeTest-226359169 tempest-VolumesNegativeTest-226359169-project-member] [instance: 423e0b0c-8714-47cb-a7b7-791d28b18f06] Found default for hw_disk_bus of virtio {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 16:02:01 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-66962211-7315-4f9c-830f-bb95a3d944cf tempest-VolumesNegativeTest-226359169 tempest-VolumesNegativeTest-226359169-project-member] [instance: 423e0b0c-8714-47cb-a7b7-791d28b18f06] Found default for hw_input_bus of None {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 16:02:01 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-66962211-7315-4f9c-830f-bb95a3d944cf tempest-VolumesNegativeTest-226359169 tempest-VolumesNegativeTest-226359169-project-member] [instance: 423e0b0c-8714-47cb-a7b7-791d28b18f06] Found default for hw_pointer_model of None {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 16:02:01 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-66962211-7315-4f9c-830f-bb95a3d944cf tempest-VolumesNegativeTest-226359169 tempest-VolumesNegativeTest-226359169-project-member] [instance: 423e0b0c-8714-47cb-a7b7-791d28b18f06] Found default for hw_video_model of virtio {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 16:02:01 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-66962211-7315-4f9c-830f-bb95a3d944cf tempest-VolumesNegativeTest-226359169 tempest-VolumesNegativeTest-226359169-project-member] [instance: 423e0b0c-8714-47cb-a7b7-791d28b18f06] Found default for hw_vif_model of virtio {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 16:02:01 user nova-compute[75176]: INFO nova.compute.manager [None req-66962211-7315-4f9c-830f-bb95a3d944cf tempest-VolumesNegativeTest-226359169 tempest-VolumesNegativeTest-226359169-project-member] [instance: 423e0b0c-8714-47cb-a7b7-791d28b18f06] Took 5.19 seconds to spawn the instance on the hypervisor.
Nov 28 16:02:01 user nova-compute[75176]: DEBUG nova.compute.manager [None req-66962211-7315-4f9c-830f-bb95a3d944cf tempest-VolumesNegativeTest-226359169 tempest-VolumesNegativeTest-226359169-project-member] [instance: 423e0b0c-8714-47cb-a7b7-791d28b18f06] Checking state {{(pid=75176) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 16:02:01 user nova-compute[75176]: INFO nova.compute.manager [None req-66962211-7315-4f9c-830f-bb95a3d944cf tempest-VolumesNegativeTest-226359169 tempest-VolumesNegativeTest-226359169-project-member] [instance: 423e0b0c-8714-47cb-a7b7-791d28b18f06] Took 6.00 seconds to build instance.
Nov 28 16:02:01 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-66962211-7315-4f9c-830f-bb95a3d944cf tempest-VolumesNegativeTest-226359169 tempest-VolumesNegativeTest-226359169-project-member] Lock "423e0b0c-8714-47cb-a7b7-791d28b18f06" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.104s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:02:02 user nova-compute[75176]: DEBUG nova.compute.manager [req-f11f1ea0-7598-45c0-8b23-c0b74a7c4523 req-cc53ec98-89b8-4330-a49d-c624a5f17b5d service nova] [instance: 423e0b0c-8714-47cb-a7b7-791d28b18f06] Received event network-vif-plugged-cf9178a0-d59d-4370-8482-fcf2d6558076 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 16:02:02 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-f11f1ea0-7598-45c0-8b23-c0b74a7c4523 req-cc53ec98-89b8-4330-a49d-c624a5f17b5d service nova] Acquiring lock "423e0b0c-8714-47cb-a7b7-791d28b18f06-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:02:02 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-f11f1ea0-7598-45c0-8b23-c0b74a7c4523 req-cc53ec98-89b8-4330-a49d-c624a5f17b5d service nova] Lock "423e0b0c-8714-47cb-a7b7-791d28b18f06-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:02:02 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-f11f1ea0-7598-45c0-8b23-c0b74a7c4523 req-cc53ec98-89b8-4330-a49d-c624a5f17b5d service nova] Lock "423e0b0c-8714-47cb-a7b7-791d28b18f06-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:02:02 user nova-compute[75176]: DEBUG nova.compute.manager [req-f11f1ea0-7598-45c0-8b23-c0b74a7c4523 req-cc53ec98-89b8-4330-a49d-c624a5f17b5d service nova] [instance: 423e0b0c-8714-47cb-a7b7-791d28b18f06] No waiting events found dispatching network-vif-plugged-cf9178a0-d59d-4370-8482-fcf2d6558076 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 16:02:02 user nova-compute[75176]: WARNING nova.compute.manager [req-f11f1ea0-7598-45c0-8b23-c0b74a7c4523 req-cc53ec98-89b8-4330-a49d-c624a5f17b5d service nova] [instance: 423e0b0c-8714-47cb-a7b7-791d28b18f06] Received unexpected event network-vif-plugged-cf9178a0-d59d-4370-8482-fcf2d6558076 for instance with vm_state active and task_state None.
Nov 28 16:02:03 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:02:04 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:02:04 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:02:07 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:02:08 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:02:08 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:02:08 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Starting heal instance info cache {{(pid=75176) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 16:02:08 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquiring lock "refresh_cache-dc4e6d39-adfb-4d26-afef-46f316ff7846" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 16:02:08 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquired lock "refresh_cache-dc4e6d39-adfb-4d26-afef-46f316ff7846" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 16:02:08 user nova-compute[75176]: DEBUG nova.network.neutron [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] [instance: dc4e6d39-adfb-4d26-afef-46f316ff7846] Forcefully refreshing network info cache for instance {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 16:02:09 user nova-compute[75176]: DEBUG nova.network.neutron [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] [instance: dc4e6d39-adfb-4d26-afef-46f316ff7846] Updating instance_info_cache with network_info: [{"id": "65eb3123-182c-40fd-b20c-48b19b833f14", "address": "fa:16:3e:59:4a:59", "network": {"id": "998766cd-2e8e-4e39-add9-286086640993", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-989265510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf05c8836b8a40de8e64c2d046ed71ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65eb3123-18", "ovs_interfaceid": "65eb3123-182c-40fd-b20c-48b19b833f14", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 16:02:09 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Releasing lock "refresh_cache-dc4e6d39-adfb-4d26-afef-46f316ff7846" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 16:02:09 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] [instance: dc4e6d39-adfb-4d26-afef-46f316ff7846] Updated the network info_cache for instance {{(pid=75176) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 16:02:09 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:02:09 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:02:09 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75176) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 16:02:09 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:02:13 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 16:02:13 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:02:13 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75176) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 16:02:13 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75176) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 16:02:13 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75176) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 16:02:13 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:02:14 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:02:14 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:02:14 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:02:14 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:02:14 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Auditing locally available compute resources for user (node: user) {{(pid=75176) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 16:02:14 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75176) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 16:02:14 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55febf04-14ea-4903-8692-c7cc6115de75/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:02:15 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55febf04-14ea-4903-8692-c7cc6115de75/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:02:15 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55febf04-14ea-4903-8692-c7cc6115de75/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:02:15 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55febf04-14ea-4903-8692-c7cc6115de75/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:02:15 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c6a4729-9d51-4ebf-bad6-2022f35cbe3b/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:02:15 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c6a4729-9d51-4ebf-bad6-2022f35cbe3b/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:02:15 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c6a4729-9d51-4ebf-bad6-2022f35cbe3b/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:02:15 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c6a4729-9d51-4ebf-bad6-2022f35cbe3b/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:02:15 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecf38787-0a69-4f35-b121-3dc6e70023a1/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:02:15 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecf38787-0a69-4f35-b121-3dc6e70023a1/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:02:15 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecf38787-0a69-4f35-b121-3dc6e70023a1/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:02:16 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecf38787-0a69-4f35-b121-3dc6e70023a1/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:02:16 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0b7a064-03b6-4a0d-88be-2f12c12a1ddb/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:02:16 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0b7a064-03b6-4a0d-88be-2f12c12a1ddb/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:02:16 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0b7a064-03b6-4a0d-88be-2f12c12a1ddb/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:02:16 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0b7a064-03b6-4a0d-88be-2f12c12a1ddb/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:02:16 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/726344c0-a0dc-48d5-a18f-8a258ebde87d/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:02:16 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/726344c0-a0dc-48d5-a18f-8a258ebde87d/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:02:16 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/726344c0-a0dc-48d5-a18f-8a258ebde87d/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:02:16 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/726344c0-a0dc-48d5-a18f-8a258ebde87d/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:02:16 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75176) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 16:02:16 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75176) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 16:02:16 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66ead7d-98f4-4822-9dce-f2ea0206a58d/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:02:17 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66ead7d-98f4-4822-9dce-f2ea0206a58d/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:02:17 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66ead7d-98f4-4822-9dce-f2ea0206a58d/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:02:17 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66ead7d-98f4-4822-9dce-f2ea0206a58d/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:02:17 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7/disk.rescue --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:02:17 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7/disk.rescue --force-share --output=json" returned: 0 in 0.204s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:02:17 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7/disk.rescue --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:02:17 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:02:17 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:02:17 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:02:17 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:02:18 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:02:18 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/423e0b0c-8714-47cb-a7b7-791d28b18f06/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:02:18 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/423e0b0c-8714-47cb-a7b7-791d28b18f06/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:02:18 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/423e0b0c-8714-47cb-a7b7-791d28b18f06/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:02:18 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:02:18 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/423e0b0c-8714-47cb-a7b7-791d28b18f06/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:02:18 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 16:02:18 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 16:02:18 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Hypervisor/Node resource view: name=user free_ram=7869MB free_disk=24.83529281616211GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75176) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 16:02:18 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:02:18 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:02:19 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance f66ead7d-98f4-4822-9dce-f2ea0206a58d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 16:02:19 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance 55febf04-14ea-4903-8692-c7cc6115de75 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 16:02:19 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance 8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 16:02:19 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance dc4e6d39-adfb-4d26-afef-46f316ff7846 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 16:02:19 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance e0b7a064-03b6-4a0d-88be-2f12c12a1ddb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 16:02:19 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance ecf38787-0a69-4f35-b121-3dc6e70023a1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 16:02:19 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance 726344c0-a0dc-48d5-a18f-8a258ebde87d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 16:02:19 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance 1062234d-4890-46df-bb52-49c55b4af32b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 16:02:19 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance 6c6a4729-9d51-4ebf-bad6-2022f35cbe3b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 16:02:19 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance 423e0b0c-8714-47cb-a7b7-791d28b18f06 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 16:02:19 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75176) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 16:02:19 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75176) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 16:02:19 user nova-compute[75176]: DEBUG nova.compute.provider_tree [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Inventory has not changed in ProviderTree for provider: b37848d8-f401-4155-a029-b0ffa09ff85b {{(pid=75176) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 16:02:19 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Inventory has not changed for provider b37848d8-f401-4155-a029-b0ffa09ff85b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75176) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 16:02:19 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Compute_service record updated for user:user {{(pid=75176) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 16:02:19 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.522s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:02:19 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:02:20 user nova-compute[75176]: INFO nova.compute.manager [None req-3aa62b9e-bc86-4c89-b59a-4684139ae3b2 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: 1062234d-4890-46df-bb52-49c55b4af32b] Rescuing
Nov 28 16:02:20 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-3aa62b9e-bc86-4c89-b59a-4684139ae3b2 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Acquiring lock "refresh_cache-1062234d-4890-46df-bb52-49c55b4af32b" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 16:02:20 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-3aa62b9e-bc86-4c89-b59a-4684139ae3b2 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Acquired lock "refresh_cache-1062234d-4890-46df-bb52-49c55b4af32b" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 16:02:20 user nova-compute[75176]: DEBUG nova.network.neutron [None req-3aa62b9e-bc86-4c89-b59a-4684139ae3b2 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: 1062234d-4890-46df-bb52-49c55b4af32b] Building network info cache for instance {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 16:02:20 user nova-compute[75176]: DEBUG nova.network.neutron [None req-3aa62b9e-bc86-4c89-b59a-4684139ae3b2 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: 1062234d-4890-46df-bb52-49c55b4af32b] Updating instance_info_cache with network_info: [{"id": "3dd39a62-ef9c-4870-be88-578e41ff5013", "address": "fa:16:3e:10:e7:45", "network": {"id": "998766cd-2e8e-4e39-add9-286086640993", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-989265510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf05c8836b8a40de8e64c2d046ed71ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dd39a62-ef", "ovs_interfaceid": "3dd39a62-ef9c-4870-be88-578e41ff5013", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 16:02:20 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-3aa62b9e-bc86-4c89-b59a-4684139ae3b2 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Releasing lock "refresh_cache-1062234d-4890-46df-bb52-49c55b4af32b" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 16:02:20 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:02:20 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:02:21 user nova-compute[75176]: DEBUG nova.compute.manager [req-3ec51e00-7450-43fa-9d0c-f99dd8a36593 req-a1f813b7-795a-462e-8aaa-fa8c8d3ec0ca service nova] [instance: 1062234d-4890-46df-bb52-49c55b4af32b] Received event network-vif-unplugged-3dd39a62-ef9c-4870-be88-578e41ff5013 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 16:02:21 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-3ec51e00-7450-43fa-9d0c-f99dd8a36593 req-a1f813b7-795a-462e-8aaa-fa8c8d3ec0ca service nova] Acquiring lock "1062234d-4890-46df-bb52-49c55b4af32b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:02:21 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-3ec51e00-7450-43fa-9d0c-f99dd8a36593 req-a1f813b7-795a-462e-8aaa-fa8c8d3ec0ca service nova] Lock "1062234d-4890-46df-bb52-49c55b4af32b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:02:21 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-3ec51e00-7450-43fa-9d0c-f99dd8a36593 req-a1f813b7-795a-462e-8aaa-fa8c8d3ec0ca service nova] Lock "1062234d-4890-46df-bb52-49c55b4af32b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:02:21 user nova-compute[75176]: DEBUG nova.compute.manager [req-3ec51e00-7450-43fa-9d0c-f99dd8a36593 req-a1f813b7-795a-462e-8aaa-fa8c8d3ec0ca service nova] [instance: 1062234d-4890-46df-bb52-49c55b4af32b] No waiting events found dispatching network-vif-unplugged-3dd39a62-ef9c-4870-be88-578e41ff5013 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 16:02:21 user nova-compute[75176]: WARNING nova.compute.manager [req-3ec51e00-7450-43fa-9d0c-f99dd8a36593 req-a1f813b7-795a-462e-8aaa-fa8c8d3ec0ca service nova] [instance: 1062234d-4890-46df-bb52-49c55b4af32b] Received unexpected event network-vif-unplugged-3dd39a62-ef9c-4870-be88-578e41ff5013 for instance with vm_state active and task_state rescuing.
Nov 28 16:02:21 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:02:21 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:02:21 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:02:21 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:02:21 user nova-compute[75176]: INFO nova.virt.libvirt.driver [-] [instance: 1062234d-4890-46df-bb52-49c55b4af32b] Instance destroyed successfully.
Nov 28 16:02:21 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-3aa62b9e-bc86-4c89-b59a-4684139ae3b2 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: 1062234d-4890-46df-bb52-49c55b4af32b] Attempting a stable device rescue
Nov 28 16:02:21 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-3aa62b9e-bc86-4c89-b59a-4684139ae3b2 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75176) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 28 16:02:21 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-3aa62b9e-bc86-4c89-b59a-4684139ae3b2 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: 1062234d-4890-46df-bb52-49c55b4af32b] Instance directory exists: not creating {{(pid=75176) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 28 16:02:21 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-3aa62b9e-bc86-4c89-b59a-4684139ae3b2 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: 1062234d-4890-46df-bb52-49c55b4af32b] Creating image(s)
Nov 28 16:02:21 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-3aa62b9e-bc86-4c89-b59a-4684139ae3b2 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Acquiring lock "/opt/stack/data/nova/instances/1062234d-4890-46df-bb52-49c55b4af32b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:02:21 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-3aa62b9e-bc86-4c89-b59a-4684139ae3b2 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Lock "/opt/stack/data/nova/instances/1062234d-4890-46df-bb52-49c55b4af32b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:02:21 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-3aa62b9e-bc86-4c89-b59a-4684139ae3b2 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Lock "/opt/stack/data/nova/instances/1062234d-4890-46df-bb52-49c55b4af32b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:02:21 user nova-compute[75176]: DEBUG nova.objects.instance [None req-3aa62b9e-bc86-4c89-b59a-4684139ae3b2 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Lazy-loading 'trusted_certs' on Instance uuid 1062234d-4890-46df-bb52-49c55b4af32b {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 16:02:21 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-3aa62b9e-bc86-4c89-b59a-4684139ae3b2 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Acquiring lock "4243035a4821e85426317e400c4810142a3fd3e3" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:02:21 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-3aa62b9e-bc86-4c89-b59a-4684139ae3b2 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Lock "4243035a4821e85426317e400c4810142a3fd3e3" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:02:22 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-3aa62b9e-bc86-4c89-b59a-4684139ae3b2 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4243035a4821e85426317e400c4810142a3fd3e3.part --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:02:22 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-3aa62b9e-bc86-4c89-b59a-4684139ae3b2 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4243035a4821e85426317e400c4810142a3fd3e3.part --force-share --output=json" returned: 0 in 0.179s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:02:22 user nova-compute[75176]: DEBUG nova.virt.images [None req-3aa62b9e-bc86-4c89-b59a-4684139ae3b2 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] 56ee6ab1-8111-4de1-a092-20d1c5ecc85a was qcow2, converting to raw {{(pid=75176) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 28 16:02:22 user nova-compute[75176]: DEBUG nova.privsep.utils [None req-3aa62b9e-bc86-4c89-b59a-4684139ae3b2 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75176) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 28 16:02:22 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-3aa62b9e-bc86-4c89-b59a-4684139ae3b2 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/4243035a4821e85426317e400c4810142a3fd3e3.part /opt/stack/data/nova/instances/_base/4243035a4821e85426317e400c4810142a3fd3e3.converted {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:02:22 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-3aa62b9e-bc86-4c89-b59a-4684139ae3b2 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/4243035a4821e85426317e400c4810142a3fd3e3.part /opt/stack/data/nova/instances/_base/4243035a4821e85426317e400c4810142a3fd3e3.converted" returned: 0 in 0.281s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:02:22 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-3aa62b9e-bc86-4c89-b59a-4684139ae3b2 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4243035a4821e85426317e400c4810142a3fd3e3.converted --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:02:23 user nova-compute[75176]: DEBUG nova.compute.manager [req-a8a310ec-66c4-4061-8a06-c5f963a6efa3 req-35f896b9-51ab-4e10-9470-89f069ed9da5 service nova] [instance: 1062234d-4890-46df-bb52-49c55b4af32b] Received event network-vif-plugged-3dd39a62-ef9c-4870-be88-578e41ff5013 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 16:02:23 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-a8a310ec-66c4-4061-8a06-c5f963a6efa3 req-35f896b9-51ab-4e10-9470-89f069ed9da5 service nova] Acquiring lock "1062234d-4890-46df-bb52-49c55b4af32b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:02:23 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-a8a310ec-66c4-4061-8a06-c5f963a6efa3 req-35f896b9-51ab-4e10-9470-89f069ed9da5 service nova] Lock "1062234d-4890-46df-bb52-49c55b4af32b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:02:23 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-a8a310ec-66c4-4061-8a06-c5f963a6efa3 req-35f896b9-51ab-4e10-9470-89f069ed9da5 service nova] Lock "1062234d-4890-46df-bb52-49c55b4af32b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:02:23 user nova-compute[75176]: DEBUG nova.compute.manager [req-a8a310ec-66c4-4061-8a06-c5f963a6efa3 req-35f896b9-51ab-4e10-9470-89f069ed9da5 service nova] [instance: 1062234d-4890-46df-bb52-49c55b4af32b] No waiting events found dispatching network-vif-plugged-3dd39a62-ef9c-4870-be88-578e41ff5013 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 16:02:23 user nova-compute[75176]: WARNING nova.compute.manager [req-a8a310ec-66c4-4061-8a06-c5f963a6efa3 req-35f896b9-51ab-4e10-9470-89f069ed9da5 service nova] [instance: 1062234d-4890-46df-bb52-49c55b4af32b] Received unexpected event network-vif-plugged-3dd39a62-ef9c-4870-be88-578e41ff5013 for instance with vm_state active and task_state rescuing.
Nov 28 16:02:23 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-3aa62b9e-bc86-4c89-b59a-4684139ae3b2 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4243035a4821e85426317e400c4810142a3fd3e3.converted --force-share --output=json" returned: 0 in 0.201s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:02:23 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-3aa62b9e-bc86-4c89-b59a-4684139ae3b2 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Lock "4243035a4821e85426317e400c4810142a3fd3e3" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.646s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:02:23 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-3aa62b9e-bc86-4c89-b59a-4684139ae3b2 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Acquiring lock "4243035a4821e85426317e400c4810142a3fd3e3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:02:23 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-3aa62b9e-bc86-4c89-b59a-4684139ae3b2 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Lock "4243035a4821e85426317e400c4810142a3fd3e3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:02:23 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-3aa62b9e-bc86-4c89-b59a-4684139ae3b2 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4243035a4821e85426317e400c4810142a3fd3e3 --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:02:23 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:02:23 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-3aa62b9e-bc86-4c89-b59a-4684139ae3b2 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4243035a4821e85426317e400c4810142a3fd3e3 --force-share --output=json" returned: 0 in 0.171s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:02:23 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-3aa62b9e-bc86-4c89-b59a-4684139ae3b2 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4243035a4821e85426317e400c4810142a3fd3e3,backing_fmt=raw /opt/stack/data/nova/instances/1062234d-4890-46df-bb52-49c55b4af32b/disk.rescue {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:02:23 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-3aa62b9e-bc86-4c89-b59a-4684139ae3b2 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4243035a4821e85426317e400c4810142a3fd3e3,backing_fmt=raw /opt/stack/data/nova/instances/1062234d-4890-46df-bb52-49c55b4af32b/disk.rescue" returned: 0 in 0.048s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:02:23 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-3aa62b9e-bc86-4c89-b59a-4684139ae3b2 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Lock "4243035a4821e85426317e400c4810142a3fd3e3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.226s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:02:23 user nova-compute[75176]: DEBUG nova.objects.instance [None req-3aa62b9e-bc86-4c89-b59a-4684139ae3b2 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Lazy-loading 'migration_context' on Instance uuid 1062234d-4890-46df-bb52-49c55b4af32b {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 16:02:23 user nova-compute[75176]: DEBUG nova.objects.base [None req-3aa62b9e-bc86-4c89-b59a-4684139ae3b2 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Object Instance<1062234d-4890-46df-bb52-49c55b4af32b> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75176) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 16:02:23 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-3aa62b9e-bc86-4c89-b59a-4684139ae3b2 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: 1062234d-4890-46df-bb52-49c55b4af32b] Created local disks {{(pid=75176) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 16:02:23 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-3aa62b9e-bc86-4c89-b59a-4684139ae3b2 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: 1062234d-4890-46df-bb52-49c55b4af32b] Start _get_guest_xml network_info=[{"id": "3dd39a62-ef9c-4870-be88-578e41ff5013", "address": "fa:16:3e:10:e7:45", "network": {"id": "998766cd-2e8e-4e39-add9-286086640993", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-989265510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-989265510-network", "vif_mac": "fa:16:3e:10:e7:45"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf05c8836b8a40de8e64c2d046ed71ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dd39a62-ef", "ovs_interfaceid": "3dd39a62-ef9c-4870-be88-578e41ff5013", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T15:35:12Z,direct_url=<?>,disk_format='qcow2',id=1f41819e-c93f-4dc7-b253-37a27bbbbc74,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1b91c5d0672c4224a48df2e1f92688e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T15:35:13Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '56ee6ab1-8111-4de1-a092-20d1c5ecc85a', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6ec9410d-747d-475e-999c-672f87917a20', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iqKQHyYp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': '1062234d-4890-46df-bb52-49c55b4af32b', 'attached_at': '', 'detached_at': '', 'volume_id': '6ec9410d-747d-475e-999c-672f87917a20', 'serial': '6ec9410d-747d-475e-999c-672f87917a20'}, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'delete_on_termination': False, 'mount_device': '/dev/vda', 'attachment_id': '699befcc-5f40-4437-9ca0-d26ccd12bc59', 'volume_type': None} {{(pid=75176) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 16:02:23 user nova-compute[75176]: DEBUG nova.objects.instance [None req-3aa62b9e-bc86-4c89-b59a-4684139ae3b2 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Lazy-loading 'resources' on Instance uuid 1062234d-4890-46df-bb52-49c55b4af32b {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 16:02:23 user nova-compute[75176]: DEBUG nova.objects.base [None req-3aa62b9e-bc86-4c89-b59a-4684139ae3b2 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Object Instance<1062234d-4890-46df-bb52-49c55b4af32b> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75176) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 16:02:23 user nova-compute[75176]: DEBUG nova.objects.instance [None req-3aa62b9e-bc86-4c89-b59a-4684139ae3b2 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Lazy-loading 'numa_topology' on Instance uuid 1062234d-4890-46df-bb52-49c55b4af32b {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 16:02:23 user nova-compute[75176]: DEBUG nova.objects.base [None req-3aa62b9e-bc86-4c89-b59a-4684139ae3b2 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Object Instance<1062234d-4890-46df-bb52-49c55b4af32b> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75176) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 16:02:23 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-3aa62b9e-bc86-4c89-b59a-4684139ae3b2 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 16:02:23 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-3aa62b9e-bc86-4c89-b59a-4684139ae3b2 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 16:02:23 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-3aa62b9e-bc86-4c89-b59a-4684139ae3b2 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75176) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 16:02:23 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-3aa62b9e-bc86-4c89-b59a-4684139ae3b2 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] CPU controller missing on host. {{(pid=75176) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 16:02:23 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-3aa62b9e-bc86-4c89-b59a-4684139ae3b2 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75176) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 16:02:23 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-3aa62b9e-bc86-4c89-b59a-4684139ae3b2 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] CPU controller found on host. {{(pid=75176) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 16:02:23 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-3aa62b9e-bc86-4c89-b59a-4684139ae3b2 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75176) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 16:02:23 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-3aa62b9e-bc86-4c89-b59a-4684139ae3b2 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T15:35:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T15:35:12Z,direct_url=<?>,disk_format='qcow2',id=1f41819e-c93f-4dc7-b253-37a27bbbbc74,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1b91c5d0672c4224a48df2e1f92688e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T15:35:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 16:02:23 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-3aa62b9e-bc86-4c89-b59a-4684139ae3b2 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Flavor limits 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 16:02:23 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-3aa62b9e-bc86-4c89-b59a-4684139ae3b2 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Image limits 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 16:02:23 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-3aa62b9e-bc86-4c89-b59a-4684139ae3b2 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Flavor pref 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 16:02:23 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-3aa62b9e-bc86-4c89-b59a-4684139ae3b2 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Image pref 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 16:02:23 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-3aa62b9e-bc86-4c89-b59a-4684139ae3b2 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 16:02:23 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-3aa62b9e-bc86-4c89-b59a-4684139ae3b2 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 16:02:23 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-3aa62b9e-bc86-4c89-b59a-4684139ae3b2 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75176) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 16:02:23 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-3aa62b9e-bc86-4c89-b59a-4684139ae3b2 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Got 1 possible topologies {{(pid=75176) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 16:02:23 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-3aa62b9e-bc86-4c89-b59a-4684139ae3b2 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 16:02:23 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-3aa62b9e-bc86-4c89-b59a-4684139ae3b2 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 16:02:23 user nova-compute[75176]: DEBUG nova.objects.instance [None req-3aa62b9e-bc86-4c89-b59a-4684139ae3b2 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Lazy-loading 'vcpu_model' on Instance uuid 1062234d-4890-46df-bb52-49c55b4af32b {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 16:02:23 user nova-compute[75176]: DEBUG nova.objects.base [None req-3aa62b9e-bc86-4c89-b59a-4684139ae3b2 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Object Instance<1062234d-4890-46df-bb52-49c55b4af32b> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75176) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 16:02:23 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3aa62b9e-bc86-4c89-b59a-4684139ae3b2 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: 1062234d-4890-46df-bb52-49c55b4af32b] Calling os-brick to attach iSCSI Volume {{(pid=75176) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 16:02:23 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aa62b9e-bc86-4c89-b59a-4684139ae3b2 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c1b8a00>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6ec9410d-747d-475e-999c-672f87917a20', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iqKQHyYp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 16:02:23 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-3aa62b9e-bc86-4c89-b59a-4684139ae3b2 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 16:02:23 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-3aa62b9e-bc86-4c89-b59a-4684139ae3b2 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 16:02:23 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-3aa62b9e-bc86-4c89-b59a-4684139ae3b2 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 16:02:23 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-3aa62b9e-bc86-4c89-b59a-4684139ae3b2 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 16:02:23 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-3aa62b9e-bc86-4c89-b59a-4684139ae3b2 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6ec9410d-747d-475e-999c-672f87917a20" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 16:02:23 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-3aa62b9e-bc86-4c89-b59a-4684139ae3b2 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6ec9410d-747d-475e-999c-672f87917a20" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 16:02:23 user nova-compute[75176]: INFO os_brick.initiator.connectors.iscsi [None req-3aa62b9e-bc86-4c89-b59a-4684139ae3b2 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 16:02:23 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ec9410d-747d-475e-999c-672f87917a20 -p 172.16.0.220:3260 {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:02:23 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ec9410d-747d-475e-999c-672f87917a20 -p 172.16.0.220:3260" returned: 0 in 0.018s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:02:23 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcdee2cc-6fbb-4ca4-a335-4679544466e3]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:6ec9410d-747d-475e-999c-672f87917a20\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = iqKQHyYp\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:02:23 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aa62b9e-bc86-4c89-b59a-4684139ae3b2 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 28 16:02:23 user nova-compute[75176]: node.name = iqn.2010-10.org.openstack:6ec9410d-747d-475e-999c-672f87917a20
Nov 28 16:02:23 user nova-compute[75176]: node.tpgt = -1
Nov 28 16:02:23 user nova-compute[75176]: node.startup = automatic
Nov 28 16:02:23 user nova-compute[75176]: node.leading_login = No
Nov 28 16:02:23 user nova-compute[75176]: iface.iscsi_ifacename = default
Nov 28 16:02:23 user nova-compute[75176]: iface.net_ifacename = <empty>
Nov 28 16:02:23 user nova-compute[75176]: iface.ipaddress = <empty>
Nov 28 16:02:23 user nova-compute[75176]: iface.prefix_len = 0
Nov 28 16:02:23 user nova-compute[75176]: iface.hwaddress = <empty>
Nov 28 16:02:23 user nova-compute[75176]: iface.transport_name = tcp
Nov 28 16:02:23 user nova-compute[75176]: iface.initiatorname = <empty>
Nov 28 16:02:23 user nova-compute[75176]: iface.state = <empty>
Nov 28 16:02:23 user nova-compute[75176]: iface.vlan_id = 0
Nov 28 16:02:23 user nova-compute[75176]: iface.vlan_priority = 0
Nov 28 16:02:23 user nova-compute[75176]: iface.vlan_state = <empty>
Nov 28 16:02:23 user nova-compute[75176]: iface.iface_num = 0
Nov 28 16:02:23 user nova-compute[75176]: iface.mtu = 0
Nov 28 16:02:23 user nova-compute[75176]: iface.port = 0
Nov 28 16:02:23 user nova-compute[75176]: iface.bootproto = <empty>
Nov 28 16:02:23 user nova-compute[75176]: iface.subnet_mask = <empty>
Nov 28 16:02:23 user nova-compute[75176]: iface.gateway = <empty>
Nov 28 16:02:23 user nova-compute[75176]: iface.dhcp_alt_client_id_state = <empty>
Nov 28 16:02:23 user nova-compute[75176]: iface.dhcp_alt_client_id = <empty>
Nov 28 16:02:23 user nova-compute[75176]: iface.dhcp_dns = <empty>
Nov 28 16:02:23 user nova-compute[75176]: iface.dhcp_learn_iqn = <empty>
Nov 28 16:02:23 user nova-compute[75176]: iface.dhcp_req_vendor_id_state = <empty>
Nov 28 16:02:23 user nova-compute[75176]: iface.dhcp_vendor_id_state = <empty>
Nov 28 16:02:23 user nova-compute[75176]: iface.dhcp_vendor_id = <empty>
Nov 28 16:02:23 user nova-compute[75176]: iface.dhcp_slp_da = <empty>
Nov 28 16:02:23 user nova-compute[75176]: iface.fragmentation = <empty>
Nov 28 16:02:23 user nova-compute[75176]: iface.gratuitous_arp = <empty>
Nov 28 16:02:23 user nova-compute[75176]: iface.incoming_forwarding = <empty>
Nov 28 16:02:23 user nova-compute[75176]: iface.tos_state = <empty>
Nov 28 16:02:23 user nova-compute[75176]: iface.tos = 0
Nov 28 16:02:23 user nova-compute[75176]: iface.ttl = 0
Nov 28 16:02:23 user nova-compute[75176]: iface.delayed_ack = <empty>
Nov 28 16:02:23 user nova-compute[75176]: iface.tcp_nagle = <empty>
Nov 28 16:02:23 user nova-compute[75176]: iface.tcp_wsf_state = <empty>
Nov 28 16:02:23 user nova-compute[75176]: iface.tcp_wsf = 0
Nov 28 16:02:23 user nova-compute[75176]: iface.tcp_timer_scale = 0
Nov 28 16:02:23 user nova-compute[75176]: iface.tcp_timestamp = <empty>
Nov 28 16:02:23 user nova-compute[75176]: iface.redirect = <empty>
Nov 28 16:02:23 user nova-compute[75176]: iface.def_task_mgmt_timeout = 0
Nov 28 16:02:23 user nova-compute[75176]: iface.header_digest = <empty>
Nov 28 16:02:23 user nova-compute[75176]: iface.data_digest = <empty>
Nov 28 16:02:23 user nova-compute[75176]: iface.immediate_data = <empty>
Nov 28 16:02:23 user nova-compute[75176]: iface.initial_r2t = <empty>
Nov 28 16:02:23 user nova-compute[75176]: iface.data_seq_inorder = <empty>
Nov 28 16:02:23 user nova-compute[75176]: iface.data_pdu_inorder = <empty>
Nov 28 16:02:23 user nova-compute[75176]: iface.erl = 0
Nov 28 16:02:23 user nova-compute[75176]: iface.max_receive_data_len = 0
Nov 28 16:02:23 user nova-compute[75176]: iface.first_burst_len = 0
Nov 28 16:02:23 user nova-compute[75176]: iface.max_outstanding_r2t = 0
Nov 28 16:02:23 user nova-compute[75176]: iface.max_burst_len = 0
Nov 28 16:02:23 user nova-compute[75176]: iface.chap_auth = <empty>
Nov 28 16:02:23 user nova-compute[75176]: iface.bidi_chap = <empty>
Nov 28 16:02:23 user nova-compute[75176]: iface.strict_login_compliance = <empty>
Nov 28 16:02:23 user nova-compute[75176]: iface.discovery_auth = <empty>
Nov 28 16:02:23 user nova-compute[75176]: iface.discovery_logout = <empty>
Nov 28 16:02:23 user nova-compute[75176]: node.discovery_address = <empty>
Nov 28 16:02:23 user nova-compute[75176]: node.discovery_port = 0
Nov 28 16:02:23 user nova-compute[75176]: node.discovery_type = static
Nov 28 16:02:23 user nova-compute[75176]: node.session.initial_cmdsn = 0
Nov 28 16:02:23 user nova-compute[75176]: node.session.initial_login_retry_max = 8
Nov 28 16:02:23 user nova-compute[75176]: node.session.xmit_thread_priority = -20
Nov 28 16:02:23 user nova-compute[75176]: node.session.cmds_max = 128
Nov 28 16:02:23 user nova-compute[75176]: node.session.queue_depth = 32
Nov 28 16:02:23 user nova-compute[75176]: node.session.nr_sessions = 1
Nov 28 16:02:23 user nova-compute[75176]: node.session.auth.authmethod = CHAP
Nov 28 16:02:23 user nova-compute[75176]: node.session.auth.username = iqKQHyYp
Nov 28 16:02:23 user nova-compute[75176]: node.session.auth.password = ***
Nov 28 16:02:23 user nova-compute[75176]: node.session.auth.username_in = <empty>
Nov 28 16:02:23 user nova-compute[75176]: node.session.auth.password_in = <empty>
Nov 28 16:02:23 user nova-compute[75176]: node.session.auth.chap_algs = MD5
Nov 28 16:02:23 user nova-compute[75176]: node.session.timeo.replacement_timeout = 120
Nov 28 16:02:23 user nova-compute[75176]: node.session.err_timeo.abort_timeout = 15
Nov 28 16:02:23 user nova-compute[75176]: node.session.err_timeo.lu_reset_timeout = 30
Nov 28 16:02:23 user nova-compute[75176]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 28 16:02:23 user nova-compute[75176]: node.session.err_timeo.host_reset_timeout = 60
Nov 28 16:02:23 user nova-compute[75176]: node.session.iscsi.FastAbort = Yes
Nov 28 16:02:23 user nova-compute[75176]: node.session.iscsi.InitialR2T = No
Nov 28 16:02:23 user nova-compute[75176]: node.session.iscsi.ImmediateData = Yes
Nov 28 16:02:23 user nova-compute[75176]: node.session.iscsi.FirstBurstLength = 262144
Nov 28 16:02:23 user nova-compute[75176]: node.session.iscsi.MaxBurstLength = 16776192
Nov 28 16:02:23 user nova-compute[75176]: node.session.iscsi.DefaultTime2Retain = 0
Nov 28 16:02:23 user nova-compute[75176]: node.session.iscsi.DefaultTime2Wait = 2
Nov 28 16:02:23 user nova-compute[75176]: node.session.iscsi.MaxConnections = 1
Nov 28 16:02:23 user nova-compute[75176]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 28 16:02:23 user nova-compute[75176]: node.session.iscsi.ERL = 0
Nov 28 16:02:23 user nova-compute[75176]: node.session.scan = manual
Nov 28 16:02:23 user nova-compute[75176]: node.session.reopen_max = 0
Nov 28 16:02:23 user nova-compute[75176]: node.conn[0].address = 172.16.0.220
Nov 28 16:02:23 user nova-compute[75176]: node.conn[0].port = 3260
Nov 28 16:02:23 user nova-compute[75176]: node.conn[0].startup = manual
Nov 28 16:02:23 user nova-compute[75176]: node.conn[0].tcp.window_size = 524288
Nov 28 16:02:23 user nova-compute[75176]: node.conn[0].tcp.type_of_service = 0
Nov 28 16:02:23 user nova-compute[75176]: node.conn[0].timeo.logout_timeout = 15
Nov 28 16:02:23 user nova-compute[75176]: node.conn[0].timeo.login_timeout = 15
Nov 28 16:02:23 user nova-compute[75176]: node.conn[0].timeo.auth_timeout = 45
Nov 28 16:02:23 user nova-compute[75176]: node.conn[0].timeo.noop_out_interval = 5
Nov 28 16:02:23 user nova-compute[75176]: node.conn[0].timeo.noop_out_timeout = 5
Nov 28 16:02:23 user nova-compute[75176]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 28 16:02:23 user nova-compute[75176]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 28 16:02:23 user nova-compute[75176]: node.conn[0].iscsi.HeaderDigest = None
Nov 28 16:02:23 user nova-compute[75176]: node.conn[0].iscsi.DataDigest = None
Nov 28 16:02:23 user nova-compute[75176]: node.conn[0].iscsi.IFMarker = No
Nov 28 16:02:23 user nova-compute[75176]: node.conn[0].iscsi.OFMarker = No
Nov 28 16:02:23 user nova-compute[75176]: # END RECORD
Nov 28 16:02:23 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 16:02:23 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ec9410d-747d-475e-999c-672f87917a20 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:02:23 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ec9410d-747d-475e-999c-672f87917a20 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:02:23 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[8853ab76-d4d7-420f-b263-30414522e888]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:02:23 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aa62b9e-bc86-4c89-b59a-4684139ae3b2 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 16:02:23 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ec9410d-747d-475e-999c-672f87917a20 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:02:23 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ec9410d-747d-475e-999c-672f87917a20 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:02:23 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[4913c353-b046-47de-94d7-112f4a17b03d]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:02:23 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aa62b9e-bc86-4c89-b59a-4684139ae3b2 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 16:02:23 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ec9410d-747d-475e-999c-672f87917a20 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iqKQHyYp {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:02:23 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ec9410d-747d-475e-999c-672f87917a20 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iqKQHyYp" returned: 0 in 0.018s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:02:23 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[a97cdf1f-52da-49ee-999a-404ff30a93c5]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:02:23 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aa62b9e-bc86-4c89-b59a-4684139ae3b2 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iqKQHyYp'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 16:02:23 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ec9410d-747d-475e-999c-672f87917a20 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:02:23 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ec9410d-747d-475e-999c-672f87917a20 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:02:23 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[96e6bb54-5040-4b07-b8ea-61e24d6e2934]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:02:23 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aa62b9e-bc86-4c89-b59a-4684139ae3b2 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 16:02:23 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:02:23 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:02:23 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[03836a64-befc-4e63-97bc-2097fd10944b]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b1a81f9-4a84-4f9e-9b1a-86b0c17ed81c (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ec9410d-747d-475e-999c-672f87917a20 (non-flash)\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:02:23 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aa62b9e-bc86-4c89-b59a-4684139ae3b2 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 (non-flash)
Nov 28 16:02:23 user nova-compute[75176]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b1a81f9-4a84-4f9e-9b1a-86b0c17ed81c (non-flash)
Nov 28 16:02:23 user nova-compute[75176]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ec9410d-747d-475e-999c-672f87917a20 (non-flash)
Nov 28 16:02:23 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 16:02:23 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aa62b9e-bc86-4c89-b59a-4684139ae3b2 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 (non-flash)
Nov 28 16:02:23 user nova-compute[75176]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b1a81f9-4a84-4f9e-9b1a-86b0c17ed81c (non-flash)
Nov 28 16:02:23 user nova-compute[75176]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ec9410d-747d-475e-999c-672f87917a20 (non-flash)
Nov 28 16:02:23 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 16:02:23 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-3aa62b9e-bc86-4c89-b59a-4684139ae3b2 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6ec9410d-747d-475e-999c-672f87917a20" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.149s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 16:02:23 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aa62b9e-bc86-4c89-b59a-4684139ae3b2 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Connected to 172.16.0.220:3260 {{(pid=75176) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 16:02:23 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-3aa62b9e-bc86-4c89-b59a-4684139ae3b2 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] HCTL ('36', '0', '0', 0) found on session 57 with lun 0 {{(pid=75176) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 16:02:23 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-3aa62b9e-bc86-4c89-b59a-4684139ae3b2 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Scanning host 36 c: 0, t: 0, l: 0) {{(pid=75176) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 16:02:23 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:02:23 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:02:23 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[c07cdf70-d887-4306-9cfe-4acf009fd603]: (4, ('0 0 0', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:02:23 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-3aa62b9e-bc86-4c89-b59a-4684139ae3b2 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Searching for a device in session 57 and hctl ('36', '0', '0', 0) yield: sde {{(pid=75176) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 16:02:23 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aa62b9e-bc86-4c89-b59a-4684139ae3b2 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:6ec9410d-747d-475e-999c-672f87917a20', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iqKQHyYp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75176) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 16:02:23 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-3aa62b9e-bc86-4c89-b59a-4684139ae3b2 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.179s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 16:02:23 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aa62b9e-bc86-4c89-b59a-4684139ae3b2 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] <== connect_volume: return (181ms) {'type': 'block', 'scsi_wwn': '23061623566656138', 'path': '/dev/sde'} {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 16:02:23 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3aa62b9e-bc86-4c89-b59a-4684139ae3b2 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: 1062234d-4890-46df-bb52-49c55b4af32b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23061623566656138', 'path': '/dev/sde'} {{(pid=75176) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 16:02:23 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-3aa62b9e-bc86-4c89-b59a-4684139ae3b2 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T16:00:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1609172901',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1609172901',id=47,image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-28T16:00:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bf05c8836b8a40de8e64c2d046ed71ff',ramdisk_id='',reservation_id='r-0qjqy9lv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1648409789',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T16:00:50Z,user_data=None,user_id='f24cedac95a44bb5a9ee54cc4713945c',uuid=1062234d-4890-46df-bb52-49c55b4af32b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3dd39a62-ef9c-4870-be88-578e41ff5013", "address": "fa:16:3e:10:e7:45", "network": {"id": "998766cd-2e8e-4e39-add9-286086640993", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-989265510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-989265510-network", "vif_mac": "fa:16:3e:10:e7:45"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf05c8836b8a40de8e64c2d046ed71ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dd39a62-ef", "ovs_interfaceid": "3dd39a62-ef9c-4870-be88-578e41ff5013", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75176) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 16:02:23 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-3aa62b9e-bc86-4c89-b59a-4684139ae3b2 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Converting VIF {"id": "3dd39a62-ef9c-4870-be88-578e41ff5013", "address": "fa:16:3e:10:e7:45", "network": {"id": "998766cd-2e8e-4e39-add9-286086640993", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-989265510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-989265510-network", "vif_mac": "fa:16:3e:10:e7:45"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf05c8836b8a40de8e64c2d046ed71ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dd39a62-ef", "ovs_interfaceid": "3dd39a62-ef9c-4870-be88-578e41ff5013", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 16:02:23 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-3aa62b9e-bc86-4c89-b59a-4684139ae3b2 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:10:e7:45,bridge_name='br-int',has_traffic_filtering=True,id=3dd39a62-ef9c-4870-be88-578e41ff5013,network=Network(998766cd-2e8e-4e39-add9-286086640993),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3dd39a62-ef') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 16:02:23 user nova-compute[75176]: DEBUG nova.objects.instance [None req-3aa62b9e-bc86-4c89-b59a-4684139ae3b2 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Lazy-loading 'pci_devices' on Instance uuid 1062234d-4890-46df-bb52-49c55b4af32b {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 16:02:23 user nova-compute[75176]: DEBUG nova.objects.base [None req-3aa62b9e-bc86-4c89-b59a-4684139ae3b2 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Object Instance<1062234d-4890-46df-bb52-49c55b4af32b> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75176) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 16:02:23 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-3aa62b9e-bc86-4c89-b59a-4684139ae3b2 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: 1062234d-4890-46df-bb52-49c55b4af32b] End _get_guest_xml xml=<domain type="kvm">
Nov 28 16:02:23 user nova-compute[75176]:   <uuid>1062234d-4890-46df-bb52-49c55b4af32b</uuid>
Nov 28 16:02:23 user nova-compute[75176]:   <name>instance-0000002f</name>
Nov 28 16:02:23 user nova-compute[75176]:   <memory>524288</memory>
Nov 28 16:02:23 user nova-compute[75176]:   <vcpu>1</vcpu>
Nov 28 16:02:23 user nova-compute[75176]:   <metadata>
Nov 28 16:02:23 user nova-compute[75176]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 16:02:23 user nova-compute[75176]:       <nova:package version="0.0.0"/>
Nov 28 16:02:23 user nova-compute[75176]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1609172901</nova:name>
Nov 28 16:02:23 user nova-compute[75176]:       <nova:creationTime>2023-11-28 16:02:23</nova:creationTime>
Nov 28 16:02:23 user nova-compute[75176]:       <nova:flavor name="m1.tiny">
Nov 28 16:02:23 user nova-compute[75176]:         <nova:memory>512</nova:memory>
Nov 28 16:02:23 user nova-compute[75176]:         <nova:disk>1</nova:disk>
Nov 28 16:02:23 user nova-compute[75176]:         <nova:swap>0</nova:swap>
Nov 28 16:02:23 user nova-compute[75176]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 16:02:23 user nova-compute[75176]:         <nova:vcpus>1</nova:vcpus>
Nov 28 16:02:23 user nova-compute[75176]:       </nova:flavor>
Nov 28 16:02:23 user nova-compute[75176]:       <nova:owner>
Nov 28 16:02:23 user nova-compute[75176]:         <nova:user uuid="f24cedac95a44bb5a9ee54cc4713945c">tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member</nova:user>
Nov 28 16:02:23 user nova-compute[75176]:         <nova:project uuid="bf05c8836b8a40de8e64c2d046ed71ff">tempest-ServerBootFromVolumeStableRescueTest-1648409789</nova:project>
Nov 28 16:02:23 user nova-compute[75176]:       </nova:owner>
Nov 28 16:02:23 user nova-compute[75176]:       <nova:root type="image" uuid="1f41819e-c93f-4dc7-b253-37a27bbbbc74"/>
Nov 28 16:02:23 user nova-compute[75176]:       <nova:ports>
Nov 28 16:02:23 user nova-compute[75176]:         <nova:port uuid="3dd39a62-ef9c-4870-be88-578e41ff5013">
Nov 28 16:02:23 user nova-compute[75176]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 28 16:02:23 user nova-compute[75176]:         </nova:port>
Nov 28 16:02:23 user nova-compute[75176]:       </nova:ports>
Nov 28 16:02:23 user nova-compute[75176]:     </nova:instance>
Nov 28 16:02:23 user nova-compute[75176]:   </metadata>
Nov 28 16:02:23 user nova-compute[75176]:   <sysinfo type="smbios">
Nov 28 16:02:23 user nova-compute[75176]:     <system>
Nov 28 16:02:23 user nova-compute[75176]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 16:02:23 user nova-compute[75176]:       <entry name="product">OpenStack Nova</entry>
Nov 28 16:02:23 user nova-compute[75176]:       <entry name="version">0.0.0</entry>
Nov 28 16:02:23 user nova-compute[75176]:       <entry name="serial">1062234d-4890-46df-bb52-49c55b4af32b</entry>
Nov 28 16:02:23 user nova-compute[75176]:       <entry name="uuid">1062234d-4890-46df-bb52-49c55b4af32b</entry>
Nov 28 16:02:23 user nova-compute[75176]:       <entry name="family">Virtual Machine</entry>
Nov 28 16:02:23 user nova-compute[75176]:     </system>
Nov 28 16:02:23 user nova-compute[75176]:   </sysinfo>
Nov 28 16:02:23 user nova-compute[75176]:   <os>
Nov 28 16:02:23 user nova-compute[75176]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 16:02:23 user nova-compute[75176]:     <smbios mode="sysinfo"/>
Nov 28 16:02:23 user nova-compute[75176]:   </os>
Nov 28 16:02:23 user nova-compute[75176]:   <features>
Nov 28 16:02:23 user nova-compute[75176]:     <acpi/>
Nov 28 16:02:23 user nova-compute[75176]:     <apic/>
Nov 28 16:02:23 user nova-compute[75176]:     <vmcoreinfo/>
Nov 28 16:02:23 user nova-compute[75176]:   </features>
Nov 28 16:02:23 user nova-compute[75176]:   <clock offset="utc">
Nov 28 16:02:23 user nova-compute[75176]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 16:02:23 user nova-compute[75176]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 16:02:23 user nova-compute[75176]:     <timer name="hpet" present="no"/>
Nov 28 16:02:23 user nova-compute[75176]:   </clock>
Nov 28 16:02:23 user nova-compute[75176]:   <cpu mode="custom" match="exact">
Nov 28 16:02:23 user nova-compute[75176]:     <model>Nehalem</model>
Nov 28 16:02:23 user nova-compute[75176]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 16:02:23 user nova-compute[75176]:   </cpu>
Nov 28 16:02:23 user nova-compute[75176]:   <devices>
Nov 28 16:02:23 user nova-compute[75176]:     <disk type="block" device="disk">
Nov 28 16:02:23 user nova-compute[75176]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 16:02:23 user nova-compute[75176]:       <source dev="/dev/sde"/>
Nov 28 16:02:23 user nova-compute[75176]:       <target dev="vda" bus="virtio"/>
Nov 28 16:02:23 user nova-compute[75176]:       <serial>6ec9410d-747d-475e-999c-672f87917a20</serial>
Nov 28 16:02:23 user nova-compute[75176]:     </disk>
Nov 28 16:02:23 user nova-compute[75176]:     <disk type="file" device="disk">
Nov 28 16:02:23 user nova-compute[75176]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 16:02:23 user nova-compute[75176]:       <source file="/opt/stack/data/nova/instances/1062234d-4890-46df-bb52-49c55b4af32b/disk.rescue"/>
Nov 28 16:02:23 user nova-compute[75176]:       <target dev="vdb" bus="virtio"/>
Nov 28 16:02:23 user nova-compute[75176]:       <boot order="1"/>
Nov 28 16:02:23 user nova-compute[75176]:     </disk>
Nov 28 16:02:23 user nova-compute[75176]:     <interface type="ethernet">
Nov 28 16:02:23 user nova-compute[75176]:       <mac address="fa:16:3e:10:e7:45"/>
Nov 28 16:02:23 user nova-compute[75176]:       <model type="virtio"/>
Nov 28 16:02:23 user nova-compute[75176]:       <mtu size="1442"/>
Nov 28 16:02:23 user nova-compute[75176]:       <target dev="tap3dd39a62-ef"/>
Nov 28 16:02:23 user nova-compute[75176]:     </interface>
Nov 28 16:02:23 user nova-compute[75176]:     <serial type="pty">
Nov 28 16:02:23 user nova-compute[75176]:       <log file="/opt/stack/data/nova/instances/1062234d-4890-46df-bb52-49c55b4af32b/console.log" append="off"/>
Nov 28 16:02:23 user nova-compute[75176]:     </serial>
Nov 28 16:02:23 user nova-compute[75176]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 16:02:23 user nova-compute[75176]:     <video>
Nov 28 16:02:23 user nova-compute[75176]:       <model type="virtio"/>
Nov 28 16:02:23 user nova-compute[75176]:     </video>
Nov 28 16:02:23 user nova-compute[75176]:     <rng model="virtio">
Nov 28 16:02:23 user nova-compute[75176]:       <backend model="random">/dev/urandom</backend>
Nov 28 16:02:23 user nova-compute[75176]:     </rng>
Nov 28 16:02:23 user nova-compute[75176]:     <controller type="usb" index="0" model="none"/>
Nov 28 16:02:23 user nova-compute[75176]:     <memballoon model="virtio">
Nov 28 16:02:23 user nova-compute[75176]:       <stats period="10"/>
Nov 28 16:02:23 user nova-compute[75176]:     </memballoon>
Nov 28 16:02:23 user nova-compute[75176]:   </devices>
Nov 28 16:02:23 user nova-compute[75176]: </domain>
Nov 28 16:02:23 user nova-compute[75176]:  {{(pid=75176) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 16:02:23 user nova-compute[75176]: INFO nova.virt.libvirt.driver [-] [instance: 1062234d-4890-46df-bb52-49c55b4af32b] Instance destroyed successfully.
Nov 28 16:02:23 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-3aa62b9e-bc86-4c89-b59a-4684139ae3b2 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] No BDM found with device name vda, not building metadata. {{(pid=75176) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 16:02:23 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-3aa62b9e-bc86-4c89-b59a-4684139ae3b2 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75176) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 16:02:23 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-3aa62b9e-bc86-4c89-b59a-4684139ae3b2 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] No VIF found with MAC fa:16:3e:10:e7:45, not building metadata {{(pid=75176) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 16:02:24 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:02:25 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:02:25 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:02:25 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:02:25 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:02:25 user nova-compute[75176]: DEBUG nova.compute.manager [req-5a1c72bc-66c2-42a5-8f84-6d648af8214f req-56f9545a-6b16-4c91-b03d-b0431af7a6d4 service nova] [instance: 1062234d-4890-46df-bb52-49c55b4af32b] Received event network-vif-plugged-3dd39a62-ef9c-4870-be88-578e41ff5013 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 16:02:25 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-5a1c72bc-66c2-42a5-8f84-6d648af8214f req-56f9545a-6b16-4c91-b03d-b0431af7a6d4 service nova] Acquiring lock "1062234d-4890-46df-bb52-49c55b4af32b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:02:25 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-5a1c72bc-66c2-42a5-8f84-6d648af8214f req-56f9545a-6b16-4c91-b03d-b0431af7a6d4 service nova] Lock "1062234d-4890-46df-bb52-49c55b4af32b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:02:25 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-5a1c72bc-66c2-42a5-8f84-6d648af8214f req-56f9545a-6b16-4c91-b03d-b0431af7a6d4 service nova] Lock "1062234d-4890-46df-bb52-49c55b4af32b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:02:25 user nova-compute[75176]: DEBUG nova.compute.manager [req-5a1c72bc-66c2-42a5-8f84-6d648af8214f req-56f9545a-6b16-4c91-b03d-b0431af7a6d4 service nova] [instance: 1062234d-4890-46df-bb52-49c55b4af32b] No waiting events found dispatching network-vif-plugged-3dd39a62-ef9c-4870-be88-578e41ff5013 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 16:02:25 user nova-compute[75176]: WARNING nova.compute.manager [req-5a1c72bc-66c2-42a5-8f84-6d648af8214f req-56f9545a-6b16-4c91-b03d-b0431af7a6d4 service nova] [instance: 1062234d-4890-46df-bb52-49c55b4af32b] Received unexpected event network-vif-plugged-3dd39a62-ef9c-4870-be88-578e41ff5013 for instance with vm_state active and task_state rescuing.
Nov 28 16:02:25 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:02:25 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:02:27 user nova-compute[75176]: DEBUG nova.compute.manager [None req-3aa62b9e-bc86-4c89-b59a-4684139ae3b2 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: 1062234d-4890-46df-bb52-49c55b4af32b] Checking state {{(pid=75176) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 16:02:27 user nova-compute[75176]: DEBUG nova.compute.manager [req-5d630cc7-42b2-4b77-81c0-b97fd83368f8 req-a8f65621-b89b-46b9-aa7d-b39328e4b98b service nova] [instance: 1062234d-4890-46df-bb52-49c55b4af32b] Received event network-vif-plugged-3dd39a62-ef9c-4870-be88-578e41ff5013 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 16:02:27 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-5d630cc7-42b2-4b77-81c0-b97fd83368f8 req-a8f65621-b89b-46b9-aa7d-b39328e4b98b service nova] Acquiring lock "1062234d-4890-46df-bb52-49c55b4af32b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:02:27 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-5d630cc7-42b2-4b77-81c0-b97fd83368f8 req-a8f65621-b89b-46b9-aa7d-b39328e4b98b service nova] Lock "1062234d-4890-46df-bb52-49c55b4af32b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:02:27 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-5d630cc7-42b2-4b77-81c0-b97fd83368f8 req-a8f65621-b89b-46b9-aa7d-b39328e4b98b service nova] Lock "1062234d-4890-46df-bb52-49c55b4af32b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:02:27 user nova-compute[75176]: DEBUG nova.compute.manager [req-5d630cc7-42b2-4b77-81c0-b97fd83368f8 req-a8f65621-b89b-46b9-aa7d-b39328e4b98b service nova] [instance: 1062234d-4890-46df-bb52-49c55b4af32b] No waiting events found dispatching network-vif-plugged-3dd39a62-ef9c-4870-be88-578e41ff5013 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 16:02:27 user nova-compute[75176]: WARNING nova.compute.manager [req-5d630cc7-42b2-4b77-81c0-b97fd83368f8 req-a8f65621-b89b-46b9-aa7d-b39328e4b98b service nova] [instance: 1062234d-4890-46df-bb52-49c55b4af32b] Received unexpected event network-vif-plugged-3dd39a62-ef9c-4870-be88-578e41ff5013 for instance with vm_state rescued and task_state None.
Nov 28 16:02:28 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:02:29 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:02:29 user nova-compute[75176]: DEBUG nova.compute.manager [req-d8c690fb-86b4-47d4-900d-e4010ea4fce9 req-a91241cc-4c00-415f-9a3a-eabb39cf46b9 service nova] [instance: 6c6a4729-9d51-4ebf-bad6-2022f35cbe3b] Received event network-changed-85a1de78-2430-4835-8122-95570636e300 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 16:02:29 user nova-compute[75176]: DEBUG nova.compute.manager [req-d8c690fb-86b4-47d4-900d-e4010ea4fce9 req-a91241cc-4c00-415f-9a3a-eabb39cf46b9 service nova] [instance: 6c6a4729-9d51-4ebf-bad6-2022f35cbe3b] Refreshing instance network info cache due to event network-changed-85a1de78-2430-4835-8122-95570636e300. {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 16:02:29 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-d8c690fb-86b4-47d4-900d-e4010ea4fce9 req-a91241cc-4c00-415f-9a3a-eabb39cf46b9 service nova] Acquiring lock "refresh_cache-6c6a4729-9d51-4ebf-bad6-2022f35cbe3b" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 16:02:29 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-d8c690fb-86b4-47d4-900d-e4010ea4fce9 req-a91241cc-4c00-415f-9a3a-eabb39cf46b9 service nova] Acquired lock "refresh_cache-6c6a4729-9d51-4ebf-bad6-2022f35cbe3b" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 16:02:29 user nova-compute[75176]: DEBUG nova.network.neutron [req-d8c690fb-86b4-47d4-900d-e4010ea4fce9 req-a91241cc-4c00-415f-9a3a-eabb39cf46b9 service nova] [instance: 6c6a4729-9d51-4ebf-bad6-2022f35cbe3b] Refreshing network info cache for port 85a1de78-2430-4835-8122-95570636e300 {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 16:02:29 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:02:30 user nova-compute[75176]: DEBUG nova.network.neutron [req-d8c690fb-86b4-47d4-900d-e4010ea4fce9 req-a91241cc-4c00-415f-9a3a-eabb39cf46b9 service nova] [instance: 6c6a4729-9d51-4ebf-bad6-2022f35cbe3b] Updated VIF entry in instance network info cache for port 85a1de78-2430-4835-8122-95570636e300. {{(pid=75176) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 16:02:30 user nova-compute[75176]: DEBUG nova.network.neutron [req-d8c690fb-86b4-47d4-900d-e4010ea4fce9 req-a91241cc-4c00-415f-9a3a-eabb39cf46b9 service nova] [instance: 6c6a4729-9d51-4ebf-bad6-2022f35cbe3b] Updating instance_info_cache with network_info: [{"id": "85a1de78-2430-4835-8122-95570636e300", "address": "fa:16:3e:f4:49:91", "network": {"id": "9faaeac5-1688-436d-90fb-38bb1c4d3da4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1225296735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6aab7b19b9414b5da476b87e144cc40b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85a1de78-24", "ovs_interfaceid": "85a1de78-2430-4835-8122-95570636e300", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 16:02:30 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-d8c690fb-86b4-47d4-900d-e4010ea4fce9 req-a91241cc-4c00-415f-9a3a-eabb39cf46b9 service nova] Releasing lock "refresh_cache-6c6a4729-9d51-4ebf-bad6-2022f35cbe3b" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 16:02:33 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-3d378347-7765-42fa-b98d-ee831689b2b5 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Acquiring lock "6c6a4729-9d51-4ebf-bad6-2022f35cbe3b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:02:33 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-3d378347-7765-42fa-b98d-ee831689b2b5 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Lock "6c6a4729-9d51-4ebf-bad6-2022f35cbe3b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:02:33 user nova-compute[75176]: DEBUG nova.objects.instance [None req-3d378347-7765-42fa-b98d-ee831689b2b5 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Lazy-loading 'flavor' on Instance uuid 6c6a4729-9d51-4ebf-bad6-2022f35cbe3b {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 16:02:33 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-3d378347-7765-42fa-b98d-ee831689b2b5 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Lock "6c6a4729-9d51-4ebf-bad6-2022f35cbe3b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:02:33 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-3d378347-7765-42fa-b98d-ee831689b2b5 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Acquiring lock "6c6a4729-9d51-4ebf-bad6-2022f35cbe3b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:02:33 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-3d378347-7765-42fa-b98d-ee831689b2b5 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Lock "6c6a4729-9d51-4ebf-bad6-2022f35cbe3b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:02:33 user nova-compute[75176]: INFO nova.compute.manager [None req-3d378347-7765-42fa-b98d-ee831689b2b5 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] [instance: 6c6a4729-9d51-4ebf-bad6-2022f35cbe3b] Attaching volume 3676a213-38f2-4682-a210-16696ea2f6ad to /dev/vdb
Nov 28 16:02:33 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:02:33 user nova-compute[75176]: DEBUG os_brick.utils [None req-3d378347-7765-42fa-b98d-ee831689b2b5 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 16:02:33 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:02:33 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:02:33 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d6f45f2-2c98-4f1c-83bb-fb58f6d0ad67]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:edc924a949b2\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:02:33 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:02:33 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:02:33 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e46f969-f302-479a-8329-4951edc8ef00]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:02:33 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:02:33 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:02:33 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3ea4c2b-03f7-4833-839d-fac9f450c7b6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:02:33 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[75cbe17c-e6d9-443c-b12d-d7d7270aa199]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:02:33 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-3d378347-7765-42fa-b98d-ee831689b2b5 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Running cmd (subprocess): nvme version {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:02:33 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-3d378347-7765-42fa-b98d-ee831689b2b5 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] 'nvme version' failed. Not Retrying. {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 16:02:33 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3d378347-7765-42fa-b98d-ee831689b2b5 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] nvme not present on system {{(pid=75176) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 16:02:33 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:02:33 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 16:02:33 user nova-compute[75176]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 16:02:33 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[faa6bbd6-6aca-43f3-a904-17c285b94140]: (4, '') {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:02:33 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.lightos [None req-3d378347-7765-42fa-b98d-ee831689b2b5 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75176) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 16:02:33 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.lightos [None req-3d378347-7765-42fa-b98d-ee831689b2b5 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75176) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 16:02:33 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.lightos [None req-3d378347-7765-42fa-b98d-ee831689b2b5 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] LIGHTOS: no hostnqn found. {{(pid=75176) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 16:02:33 user nova-compute[75176]: DEBUG os_brick.utils [None req-3d378347-7765-42fa-b98d-ee831689b2b5 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:edc924a949b2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 16:02:33 user nova-compute[75176]: DEBUG nova.virt.block_device [None req-3d378347-7765-42fa-b98d-ee831689b2b5 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] [instance: 6c6a4729-9d51-4ebf-bad6-2022f35cbe3b] Updating existing volume attachment record: cb00e08b-5ee1-4c5b-8502-09a3b9ac4586 {{(pid=75176) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 16:02:34 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:02:36 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-88963dd8-3590-4a51-9ef0-4666b1902714 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Acquiring lock "e0b7a064-03b6-4a0d-88be-2f12c12a1ddb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:02:36 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-88963dd8-3590-4a51-9ef0-4666b1902714 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Lock "e0b7a064-03b6-4a0d-88be-2f12c12a1ddb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:02:36 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-88963dd8-3590-4a51-9ef0-4666b1902714 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Acquiring lock "e0b7a064-03b6-4a0d-88be-2f12c12a1ddb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:02:36 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-88963dd8-3590-4a51-9ef0-4666b1902714 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Lock "e0b7a064-03b6-4a0d-88be-2f12c12a1ddb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:02:36 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-88963dd8-3590-4a51-9ef0-4666b1902714 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Lock "e0b7a064-03b6-4a0d-88be-2f12c12a1ddb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:02:36 user nova-compute[75176]: INFO nova.compute.manager [None req-88963dd8-3590-4a51-9ef0-4666b1902714 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] [instance: e0b7a064-03b6-4a0d-88be-2f12c12a1ddb] Terminating instance
Nov 28 16:02:36 user nova-compute[75176]: DEBUG nova.compute.manager [None req-88963dd8-3590-4a51-9ef0-4666b1902714 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] [instance: e0b7a064-03b6-4a0d-88be-2f12c12a1ddb] Start destroying the instance on the hypervisor. {{(pid=75176) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 16:02:36 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:02:36 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:02:36 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:02:36 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:02:36 user nova-compute[75176]: DEBUG nova.compute.manager [req-9f518679-6c5c-4260-a82b-7e48572abcc6 req-dcd0b780-1ab7-4b92-bf6c-56c3c9cc7841 service nova] [instance: e0b7a064-03b6-4a0d-88be-2f12c12a1ddb] Received event network-vif-unplugged-76c02515-a349-4b46-939a-cf520b5f3b33 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 16:02:36 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-9f518679-6c5c-4260-a82b-7e48572abcc6 req-dcd0b780-1ab7-4b92-bf6c-56c3c9cc7841 service nova] Acquiring lock "e0b7a064-03b6-4a0d-88be-2f12c12a1ddb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:02:36 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-9f518679-6c5c-4260-a82b-7e48572abcc6 req-dcd0b780-1ab7-4b92-bf6c-56c3c9cc7841 service nova] Lock "e0b7a064-03b6-4a0d-88be-2f12c12a1ddb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:02:36 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-9f518679-6c5c-4260-a82b-7e48572abcc6 req-dcd0b780-1ab7-4b92-bf6c-56c3c9cc7841 service nova] Lock "e0b7a064-03b6-4a0d-88be-2f12c12a1ddb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:02:36 user nova-compute[75176]: DEBUG nova.compute.manager [req-9f518679-6c5c-4260-a82b-7e48572abcc6 req-dcd0b780-1ab7-4b92-bf6c-56c3c9cc7841 service nova] [instance: e0b7a064-03b6-4a0d-88be-2f12c12a1ddb] No waiting events found dispatching network-vif-unplugged-76c02515-a349-4b46-939a-cf520b5f3b33 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 16:02:36 user nova-compute[75176]: DEBUG nova.compute.manager [req-9f518679-6c5c-4260-a82b-7e48572abcc6 req-dcd0b780-1ab7-4b92-bf6c-56c3c9cc7841 service nova] [instance: e0b7a064-03b6-4a0d-88be-2f12c12a1ddb] Received event network-vif-unplugged-76c02515-a349-4b46-939a-cf520b5f3b33 for instance with task_state deleting. {{(pid=75176) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 16:02:36 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:02:36 user nova-compute[75176]: INFO nova.virt.libvirt.driver [-] [instance: e0b7a064-03b6-4a0d-88be-2f12c12a1ddb] Instance destroyed successfully.
Nov 28 16:02:36 user nova-compute[75176]: DEBUG nova.objects.instance [None req-88963dd8-3590-4a51-9ef0-4666b1902714 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Lazy-loading 'resources' on Instance uuid e0b7a064-03b6-4a0d-88be-2f12c12a1ddb {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 16:02:36 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-88963dd8-3590-4a51-9ef0-4666b1902714 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T15:55:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-2053745581',display_name='tempest-SnapshotDataIntegrityTests-server-2053745581',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-2053745581',id=41,image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIy6wWSRGfZyXiGXXkXqBToeU1zWHjsklWsHjMraT19dqDHgHnUBb0EJ2/rKWCrgBX/Ffh25spRK4jFsAVCoejLyMgoL/ZTbY2aZwpWbx0WqyhU7zAeG2zpcrTZFr0qPNA==',key_name='tempest-keypair-1174293917',keypairs=<?>,launch_index=0,launched_at=2023-11-28T15:55:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='16cf33057bf84d25bae4a90b74bd7754',ramdisk_id='',reservation_id='r-73vllbci',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1194433303',owner_user_name='tempest-SnapshotDataIntegrityTests-1194433303-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T15:55:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='af0306d7f5704ccc8bf1fe056c8e779e',uuid=e0b7a064-03b6-4a0d-88be-2f12c12a1ddb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "76c02515-a349-4b46-939a-cf520b5f3b33", "address": "fa:16:3e:92:22:dd", "network": {"id": "459cb688-3ab2-41c9-8b98-296b629e36b6", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1294058889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16cf33057bf84d25bae4a90b74bd7754", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76c02515-a3", "ovs_interfaceid": "76c02515-a349-4b46-939a-cf520b5f3b33", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 16:02:36 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-88963dd8-3590-4a51-9ef0-4666b1902714 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Converting VIF {"id": "76c02515-a349-4b46-939a-cf520b5f3b33", "address": "fa:16:3e:92:22:dd", "network": {"id": "459cb688-3ab2-41c9-8b98-296b629e36b6", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1294058889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16cf33057bf84d25bae4a90b74bd7754", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76c02515-a3", "ovs_interfaceid": "76c02515-a349-4b46-939a-cf520b5f3b33", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 16:02:36 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-88963dd8-3590-4a51-9ef0-4666b1902714 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:92:22:dd,bridge_name='br-int',has_traffic_filtering=True,id=76c02515-a349-4b46-939a-cf520b5f3b33,network=Network(459cb688-3ab2-41c9-8b98-296b629e36b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76c02515-a3') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 16:02:36 user nova-compute[75176]: DEBUG os_vif [None req-88963dd8-3590-4a51-9ef0-4666b1902714 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:92:22:dd,bridge_name='br-int',has_traffic_filtering=True,id=76c02515-a349-4b46-939a-cf520b5f3b33,network=Network(459cb688-3ab2-41c9-8b98-296b629e36b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76c02515-a3') {{(pid=75176) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 16:02:36 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:02:36 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap76c02515-a3, bridge=br-int, if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 16:02:36 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:02:36 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:02:36 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:02:36 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4ac5b2fb-3d75-4b35-9be7-e4b72dabad7c) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 16:02:36 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:02:36 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:02:36 user nova-compute[75176]: INFO os_vif [None req-88963dd8-3590-4a51-9ef0-4666b1902714 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:92:22:dd,bridge_name='br-int',has_traffic_filtering=True,id=76c02515-a349-4b46-939a-cf520b5f3b33,network=Network(459cb688-3ab2-41c9-8b98-296b629e36b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76c02515-a3')
Nov 28 16:02:36 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-88963dd8-3590-4a51-9ef0-4666b1902714 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] [instance: e0b7a064-03b6-4a0d-88be-2f12c12a1ddb] Deleting instance files /opt/stack/data/nova/instances/e0b7a064-03b6-4a0d-88be-2f12c12a1ddb_del
Nov 28 16:02:36 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-88963dd8-3590-4a51-9ef0-4666b1902714 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] [instance: e0b7a064-03b6-4a0d-88be-2f12c12a1ddb] Deletion of /opt/stack/data/nova/instances/e0b7a064-03b6-4a0d-88be-2f12c12a1ddb_del complete
Nov 28 16:02:37 user nova-compute[75176]: INFO nova.compute.manager [None req-88963dd8-3590-4a51-9ef0-4666b1902714 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] [instance: e0b7a064-03b6-4a0d-88be-2f12c12a1ddb] Took 0.95 seconds to destroy the instance on the hypervisor.
Nov 28 16:02:37 user nova-compute[75176]: DEBUG oslo.service.loopingcall [None req-88963dd8-3590-4a51-9ef0-4666b1902714 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75176) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 16:02:37 user nova-compute[75176]: DEBUG nova.compute.manager [-] [instance: e0b7a064-03b6-4a0d-88be-2f12c12a1ddb] Deallocating network for instance {{(pid=75176) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 16:02:37 user nova-compute[75176]: DEBUG nova.network.neutron [-] [instance: e0b7a064-03b6-4a0d-88be-2f12c12a1ddb] deallocate_for_instance() {{(pid=75176) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 16:02:37 user nova-compute[75176]: DEBUG nova.network.neutron [-] [instance: e0b7a064-03b6-4a0d-88be-2f12c12a1ddb] Updating instance_info_cache with network_info: [] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 16:02:37 user nova-compute[75176]: INFO nova.compute.manager [-] [instance: e0b7a064-03b6-4a0d-88be-2f12c12a1ddb] Took 0.74 seconds to deallocate network for instance.
Nov 28 16:02:37 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-88963dd8-3590-4a51-9ef0-4666b1902714 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:02:37 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-88963dd8-3590-4a51-9ef0-4666b1902714 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:02:38 user nova-compute[75176]: DEBUG nova.compute.provider_tree [None req-88963dd8-3590-4a51-9ef0-4666b1902714 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Inventory has not changed in ProviderTree for provider: b37848d8-f401-4155-a029-b0ffa09ff85b {{(pid=75176) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 16:02:38 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-88963dd8-3590-4a51-9ef0-4666b1902714 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Inventory has not changed for provider b37848d8-f401-4155-a029-b0ffa09ff85b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75176) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 16:02:38 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-88963dd8-3590-4a51-9ef0-4666b1902714 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.379s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:02:38 user nova-compute[75176]: INFO nova.scheduler.client.report [None req-88963dd8-3590-4a51-9ef0-4666b1902714 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Deleted allocations for instance e0b7a064-03b6-4a0d-88be-2f12c12a1ddb
Nov 28 16:02:38 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-88963dd8-3590-4a51-9ef0-4666b1902714 tempest-SnapshotDataIntegrityTests-1194433303 tempest-SnapshotDataIntegrityTests-1194433303-project-member] Lock "e0b7a064-03b6-4a0d-88be-2f12c12a1ddb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.315s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:02:38 user nova-compute[75176]: DEBUG nova.compute.manager [req-9ea9813e-9a43-4cfc-abdc-d683d40770d0 req-3033f337-c71a-4018-87ff-4d05bb738a12 service nova] [instance: e0b7a064-03b6-4a0d-88be-2f12c12a1ddb] Received event network-vif-plugged-76c02515-a349-4b46-939a-cf520b5f3b33 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 16:02:38 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-9ea9813e-9a43-4cfc-abdc-d683d40770d0 req-3033f337-c71a-4018-87ff-4d05bb738a12 service nova] Acquiring lock "e0b7a064-03b6-4a0d-88be-2f12c12a1ddb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:02:38 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-9ea9813e-9a43-4cfc-abdc-d683d40770d0 req-3033f337-c71a-4018-87ff-4d05bb738a12 service nova] Lock "e0b7a064-03b6-4a0d-88be-2f12c12a1ddb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:02:38 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-9ea9813e-9a43-4cfc-abdc-d683d40770d0 req-3033f337-c71a-4018-87ff-4d05bb738a12 service nova] Lock "e0b7a064-03b6-4a0d-88be-2f12c12a1ddb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:02:38 user nova-compute[75176]: DEBUG nova.compute.manager [req-9ea9813e-9a43-4cfc-abdc-d683d40770d0 req-3033f337-c71a-4018-87ff-4d05bb738a12 service nova] [instance: e0b7a064-03b6-4a0d-88be-2f12c12a1ddb] No waiting events found dispatching network-vif-plugged-76c02515-a349-4b46-939a-cf520b5f3b33 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 16:02:38 user nova-compute[75176]: WARNING nova.compute.manager [req-9ea9813e-9a43-4cfc-abdc-d683d40770d0 req-3033f337-c71a-4018-87ff-4d05bb738a12 service nova] [instance: e0b7a064-03b6-4a0d-88be-2f12c12a1ddb] Received unexpected event network-vif-plugged-76c02515-a349-4b46-939a-cf520b5f3b33 for instance with vm_state deleted and task_state None.
Nov 28 16:02:38 user nova-compute[75176]: DEBUG nova.compute.manager [req-9ea9813e-9a43-4cfc-abdc-d683d40770d0 req-3033f337-c71a-4018-87ff-4d05bb738a12 service nova] [instance: e0b7a064-03b6-4a0d-88be-2f12c12a1ddb] Received event network-vif-deleted-76c02515-a349-4b46-939a-cf520b5f3b33 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 16:02:39 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:02:40 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:02:41 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3d378347-7765-42fa-b98d-ee831689b2b5 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] [instance: 6c6a4729-9d51-4ebf-bad6-2022f35cbe3b] Calling os-brick to attach iSCSI Volume {{(pid=75176) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 16:02:41 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d378347-7765-42fa-b98d-ee831689b2b5 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c1b8a00>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3676a213-38f2-4682-a210-16696ea2f6ad', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aoEkygwO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 16:02:41 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-3d378347-7765-42fa-b98d-ee831689b2b5 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 16:02:41 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-3d378347-7765-42fa-b98d-ee831689b2b5 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 16:02:41 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-3d378347-7765-42fa-b98d-ee831689b2b5 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 16:02:41 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-3d378347-7765-42fa-b98d-ee831689b2b5 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 16:02:41 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-3d378347-7765-42fa-b98d-ee831689b2b5 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3676a213-38f2-4682-a210-16696ea2f6ad" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 16:02:41 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-3d378347-7765-42fa-b98d-ee831689b2b5 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3676a213-38f2-4682-a210-16696ea2f6ad" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 16:02:41 user nova-compute[75176]: INFO os_brick.initiator.connectors.iscsi [None req-3d378347-7765-42fa-b98d-ee831689b2b5 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 16:02:41 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3676a213-38f2-4682-a210-16696ea2f6ad -p 172.16.0.220:3260 {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:02:41 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3676a213-38f2-4682-a210-16696ea2f6ad -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:02:41 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[755aad4f-cd16-4c20-9481-c7bd983fa49b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:02:41 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d378347-7765-42fa-b98d-ee831689b2b5 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 16:02:41 user nova-compute[75176]:  {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 16:02:41 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3676a213-38f2-4682-a210-16696ea2f6ad -p 172.16.0.220:3260 --interface default --op new {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:02:41 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3676a213-38f2-4682-a210-16696ea2f6ad -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:02:41 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad7060bb-4f7d-489c-94ff-a33b72caf903]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3676a213-38f2-4682-a210-16696ea2f6ad] added\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:02:41 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d378347-7765-42fa-b98d-ee831689b2b5 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3676a213-38f2-4682-a210-16696ea2f6ad] added
Nov 28 16:02:41 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 16:02:41 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3676a213-38f2-4682-a210-16696ea2f6ad -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:02:41 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3676a213-38f2-4682-a210-16696ea2f6ad -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:02:41 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[16c865e8-9e20-445c-8808-a554545f0d0d]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:02:41 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d378347-7765-42fa-b98d-ee831689b2b5 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 16:02:41 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3676a213-38f2-4682-a210-16696ea2f6ad -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:02:41 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3676a213-38f2-4682-a210-16696ea2f6ad -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:02:41 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa1dd303-e3cd-42df-88fc-f0c786498cdd]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:02:41 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d378347-7765-42fa-b98d-ee831689b2b5 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 16:02:41 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3676a213-38f2-4682-a210-16696ea2f6ad -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aoEkygwO {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:02:41 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3676a213-38f2-4682-a210-16696ea2f6ad -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aoEkygwO" returned: 0 in 0.019s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:02:41 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[01e7ef6c-11de-4081-80e2-427c2c9cd249]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:02:41 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d378347-7765-42fa-b98d-ee831689b2b5 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'aoEkygwO'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 16:02:41 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3676a213-38f2-4682-a210-16696ea2f6ad -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:02:41 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3676a213-38f2-4682-a210-16696ea2f6ad -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:02:41 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[f809e905-986d-4b2d-94ac-4ba540b1bd32]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:02:41 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d378347-7765-42fa-b98d-ee831689b2b5 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 16:02:41 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:02:41 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:02:41 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2dec6c7-d0d4-4942-96ca-ca694896106f]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b1a81f9-4a84-4f9e-9b1a-86b0c17ed81c (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ec9410d-747d-475e-999c-672f87917a20 (non-flash)\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:02:41 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d378347-7765-42fa-b98d-ee831689b2b5 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 (non-flash)
Nov 28 16:02:41 user nova-compute[75176]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b1a81f9-4a84-4f9e-9b1a-86b0c17ed81c (non-flash)
Nov 28 16:02:41 user nova-compute[75176]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ec9410d-747d-475e-999c-672f87917a20 (non-flash)
Nov 28 16:02:41 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 16:02:41 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d378347-7765-42fa-b98d-ee831689b2b5 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 (non-flash)
Nov 28 16:02:41 user nova-compute[75176]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b1a81f9-4a84-4f9e-9b1a-86b0c17ed81c (non-flash)
Nov 28 16:02:41 user nova-compute[75176]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ec9410d-747d-475e-999c-672f87917a20 (non-flash)
Nov 28 16:02:41 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 16:02:41 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3676a213-38f2-4682-a210-16696ea2f6ad -p 172.16.0.220:3260 --login {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:02:41 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3676a213-38f2-4682-a210-16696ea2f6ad -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:02:41 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[786c4756-60c0-404a-a687-3f1a23460ecd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3676a213-38f2-4682-a210-16696ea2f6ad, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3676a213-38f2-4682-a210-16696ea2f6ad, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:02:41 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d378347-7765-42fa-b98d-ee831689b2b5 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3676a213-38f2-4682-a210-16696ea2f6ad, portal: 172.16.0.220,3260]
Nov 28 16:02:41 user nova-compute[75176]: Login to [iface: default, target: iqn.2010-10.org.openstack:3676a213-38f2-4682-a210-16696ea2f6ad, portal: 172.16.0.220,3260] successful.
Nov 28 16:02:41 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 16:02:41 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3676a213-38f2-4682-a210-16696ea2f6ad -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:02:41 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3676a213-38f2-4682-a210-16696ea2f6ad -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:02:41 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b281879-99fb-45e1-b20d-194af958bab8]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:02:41 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d378347-7765-42fa-b98d-ee831689b2b5 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 16:02:41 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:02:41 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:02:41 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8630130-1778-4189-b6ad-01a3828d1089]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b1a81f9-4a84-4f9e-9b1a-86b0c17ed81c (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ec9410d-747d-475e-999c-672f87917a20 (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3676a213-38f2-4682-a210-16696ea2f6ad (non-flash)\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:02:41 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d378347-7765-42fa-b98d-ee831689b2b5 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 (non-flash)
Nov 28 16:02:41 user nova-compute[75176]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b1a81f9-4a84-4f9e-9b1a-86b0c17ed81c (non-flash)
Nov 28 16:02:41 user nova-compute[75176]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ec9410d-747d-475e-999c-672f87917a20 (non-flash)
Nov 28 16:02:41 user nova-compute[75176]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3676a213-38f2-4682-a210-16696ea2f6ad (non-flash)
Nov 28 16:02:41 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 16:02:41 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d378347-7765-42fa-b98d-ee831689b2b5 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 (non-flash)
Nov 28 16:02:41 user nova-compute[75176]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b1a81f9-4a84-4f9e-9b1a-86b0c17ed81c (non-flash)
Nov 28 16:02:41 user nova-compute[75176]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ec9410d-747d-475e-999c-672f87917a20 (non-flash)
Nov 28 16:02:41 user nova-compute[75176]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3676a213-38f2-4682-a210-16696ea2f6ad (non-flash)
Nov 28 16:02:41 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 16:02:41 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-3d378347-7765-42fa-b98d-ee831689b2b5 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3676a213-38f2-4682-a210-16696ea2f6ad" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.296s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 16:02:41 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d378347-7765-42fa-b98d-ee831689b2b5 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Connected to 172.16.0.220:3260 {{(pid=75176) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 16:02:41 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-3d378347-7765-42fa-b98d-ee831689b2b5 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] HCTL ('33', '-', '-', 0) found on session 59 with lun 0 {{(pid=75176) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 16:02:41 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-3d378347-7765-42fa-b98d-ee831689b2b5 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75176) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 16:02:41 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:02:41 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:02:41 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ad88a1e-7c8a-41ab-b4ab-f25682831dff]: (4, ('- - 0', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:02:41 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-3d378347-7765-42fa-b98d-ee831689b2b5 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Searching for a device in session 59 and hctl ['33', '*', '*', 0] yield: None {{(pid=75176) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 16:02:41 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:02:42 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-3d378347-7765-42fa-b98d-ee831689b2b5 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Searching for a device in session 59 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75176) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 16:02:42 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d378347-7765-42fa-b98d-ee831689b2b5 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:3676a213-38f2-4682-a210-16696ea2f6ad', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aoEkygwO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75176) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 16:02:42 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-3d378347-7765-42fa-b98d-ee831689b2b5 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.327s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 16:02:42 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d378347-7765-42fa-b98d-ee831689b2b5 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] <== connect_volume: return (1329ms) {'type': 'block', 'scsi_wwn': '26666393732326131', 'path': '/dev/sdb'} {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 16:02:42 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3d378347-7765-42fa-b98d-ee831689b2b5 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] [instance: 6c6a4729-9d51-4ebf-bad6-2022f35cbe3b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26666393732326131', 'path': '/dev/sdb'} {{(pid=75176) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 16:02:42 user nova-compute[75176]: DEBUG nova.objects.instance [None req-3d378347-7765-42fa-b98d-ee831689b2b5 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Lazy-loading 'flavor' on Instance uuid 6c6a4729-9d51-4ebf-bad6-2022f35cbe3b {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 16:02:42 user nova-compute[75176]: DEBUG nova.virt.libvirt.guest [None req-3d378347-7765-42fa-b98d-ee831689b2b5 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 16:02:42 user nova-compute[75176]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 16:02:42 user nova-compute[75176]:   <source dev="/dev/sdb"/>
Nov 28 16:02:42 user nova-compute[75176]:   <target dev="vdb" bus="virtio"/>
Nov 28 16:02:42 user nova-compute[75176]:   <serial>3676a213-38f2-4682-a210-16696ea2f6ad</serial>
Nov 28 16:02:42 user nova-compute[75176]: </disk>
Nov 28 16:02:42 user nova-compute[75176]:  {{(pid=75176) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 16:02:43 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-3d378347-7765-42fa-b98d-ee831689b2b5 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] No BDM found with device name vda, not building metadata. {{(pid=75176) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 16:02:43 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-3d378347-7765-42fa-b98d-ee831689b2b5 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75176) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 16:02:43 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-3d378347-7765-42fa-b98d-ee831689b2b5 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] No VIF found with MAC fa:16:3e:f4:49:91, not building metadata {{(pid=75176) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 16:02:43 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-3d378347-7765-42fa-b98d-ee831689b2b5 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Lock "6c6a4729-9d51-4ebf-bad6-2022f35cbe3b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.895s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:02:44 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-f4fcb2b4-0dcf-4fd1-ad2d-e0f3310ab835 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Acquiring lock "6c6a4729-9d51-4ebf-bad6-2022f35cbe3b" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:02:44 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-f4fcb2b4-0dcf-4fd1-ad2d-e0f3310ab835 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Lock "6c6a4729-9d51-4ebf-bad6-2022f35cbe3b" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:02:44 user nova-compute[75176]: DEBUG nova.compute.manager [None req-f4fcb2b4-0dcf-4fd1-ad2d-e0f3310ab835 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] [instance: 6c6a4729-9d51-4ebf-bad6-2022f35cbe3b] Checking state {{(pid=75176) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 16:02:44 user nova-compute[75176]: DEBUG nova.compute.manager [None req-f4fcb2b4-0dcf-4fd1-ad2d-e0f3310ab835 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] [instance: 6c6a4729-9d51-4ebf-bad6-2022f35cbe3b] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=75176) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 28 16:02:44 user nova-compute[75176]: DEBUG nova.objects.instance [None req-f4fcb2b4-0dcf-4fd1-ad2d-e0f3310ab835 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Lazy-loading 'flavor' on Instance uuid 6c6a4729-9d51-4ebf-bad6-2022f35cbe3b {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 16:02:44 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:02:44 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:02:44 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:02:44 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:02:44 user nova-compute[75176]: DEBUG nova.compute.manager [req-67212605-e4b2-4cc3-b8d2-c1005b37a43c req-11bdb1ff-f0c8-4435-9069-e80c4ea3663e service nova] [instance: 6c6a4729-9d51-4ebf-bad6-2022f35cbe3b] Received event network-vif-unplugged-85a1de78-2430-4835-8122-95570636e300 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 16:02:44 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-67212605-e4b2-4cc3-b8d2-c1005b37a43c req-11bdb1ff-f0c8-4435-9069-e80c4ea3663e service nova] Acquiring lock "6c6a4729-9d51-4ebf-bad6-2022f35cbe3b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:02:44 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-67212605-e4b2-4cc3-b8d2-c1005b37a43c req-11bdb1ff-f0c8-4435-9069-e80c4ea3663e service nova] Lock "6c6a4729-9d51-4ebf-bad6-2022f35cbe3b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:02:44 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-67212605-e4b2-4cc3-b8d2-c1005b37a43c req-11bdb1ff-f0c8-4435-9069-e80c4ea3663e service nova] Lock "6c6a4729-9d51-4ebf-bad6-2022f35cbe3b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:02:44 user nova-compute[75176]: DEBUG nova.compute.manager [req-67212605-e4b2-4cc3-b8d2-c1005b37a43c req-11bdb1ff-f0c8-4435-9069-e80c4ea3663e service nova] [instance: 6c6a4729-9d51-4ebf-bad6-2022f35cbe3b] No waiting events found dispatching network-vif-unplugged-85a1de78-2430-4835-8122-95570636e300 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 16:02:44 user nova-compute[75176]: WARNING nova.compute.manager [req-67212605-e4b2-4cc3-b8d2-c1005b37a43c req-11bdb1ff-f0c8-4435-9069-e80c4ea3663e service nova] [instance: 6c6a4729-9d51-4ebf-bad6-2022f35cbe3b] Received unexpected event network-vif-unplugged-85a1de78-2430-4835-8122-95570636e300 for instance with vm_state active and task_state powering-off.
Nov 28 16:02:44 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:02:45 user nova-compute[75176]: INFO nova.virt.libvirt.driver [-] [instance: 6c6a4729-9d51-4ebf-bad6-2022f35cbe3b] Instance destroyed successfully.
Nov 28 16:02:45 user nova-compute[75176]: DEBUG nova.compute.manager [None req-f4fcb2b4-0dcf-4fd1-ad2d-e0f3310ab835 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] [instance: 6c6a4729-9d51-4ebf-bad6-2022f35cbe3b] Checking state {{(pid=75176) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 16:02:45 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-f4fcb2b4-0dcf-4fd1-ad2d-e0f3310ab835 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Lock "6c6a4729-9d51-4ebf-bad6-2022f35cbe3b" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.860s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:02:46 user nova-compute[75176]: DEBUG nova.compute.manager [req-b17f381d-a9bb-4a0b-973f-595dddc1f0cb req-f54e47a7-3afe-4bce-9cda-8a071d542971 service nova] [instance: 6c6a4729-9d51-4ebf-bad6-2022f35cbe3b] Received event network-vif-plugged-85a1de78-2430-4835-8122-95570636e300 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 16:02:46 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-b17f381d-a9bb-4a0b-973f-595dddc1f0cb req-f54e47a7-3afe-4bce-9cda-8a071d542971 service nova] Acquiring lock "6c6a4729-9d51-4ebf-bad6-2022f35cbe3b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:02:46 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-b17f381d-a9bb-4a0b-973f-595dddc1f0cb req-f54e47a7-3afe-4bce-9cda-8a071d542971 service nova] Lock "6c6a4729-9d51-4ebf-bad6-2022f35cbe3b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:02:46 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-b17f381d-a9bb-4a0b-973f-595dddc1f0cb req-f54e47a7-3afe-4bce-9cda-8a071d542971 service nova] Lock "6c6a4729-9d51-4ebf-bad6-2022f35cbe3b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:02:46 user nova-compute[75176]: DEBUG nova.compute.manager [req-b17f381d-a9bb-4a0b-973f-595dddc1f0cb req-f54e47a7-3afe-4bce-9cda-8a071d542971 service nova] [instance: 6c6a4729-9d51-4ebf-bad6-2022f35cbe3b] No waiting events found dispatching network-vif-plugged-85a1de78-2430-4835-8122-95570636e300 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 16:02:46 user nova-compute[75176]: WARNING nova.compute.manager [req-b17f381d-a9bb-4a0b-973f-595dddc1f0cb req-f54e47a7-3afe-4bce-9cda-8a071d542971 service nova] [instance: 6c6a4729-9d51-4ebf-bad6-2022f35cbe3b] Received unexpected event network-vif-plugged-85a1de78-2430-4835-8122-95570636e300 for instance with vm_state stopped and task_state None.
Nov 28 16:02:46 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:02:49 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:02:51 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:02:54 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:02:57 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:02:59 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:03:02 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:03:04 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:03:06 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:03:06 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:03:06 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:03:07 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:03:09 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:03:09 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:03:10 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:03:10 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Starting heal instance info cache {{(pid=75176) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 16:03:10 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquiring lock "refresh_cache-ecf38787-0a69-4f35-b121-3dc6e70023a1" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 16:03:10 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquired lock "refresh_cache-ecf38787-0a69-4f35-b121-3dc6e70023a1" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 16:03:10 user nova-compute[75176]: DEBUG nova.network.neutron [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] [instance: ecf38787-0a69-4f35-b121-3dc6e70023a1] Forcefully refreshing network info cache for instance {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 16:03:11 user nova-compute[75176]: DEBUG nova.network.neutron [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] [instance: ecf38787-0a69-4f35-b121-3dc6e70023a1] Updating instance_info_cache with network_info: [{"id": "29444d70-7dc7-4e88-9856-cab5ebd77464", "address": "fa:16:3e:37:aa:5a", "network": {"id": "998766cd-2e8e-4e39-add9-286086640993", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-989265510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf05c8836b8a40de8e64c2d046ed71ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29444d70-7d", "ovs_interfaceid": "29444d70-7dc7-4e88-9856-cab5ebd77464", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 16:03:11 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Releasing lock "refresh_cache-ecf38787-0a69-4f35-b121-3dc6e70023a1" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 16:03:11 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] [instance: ecf38787-0a69-4f35-b121-3dc6e70023a1] Updated the network info_cache for instance {{(pid=75176) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 16:03:11 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:03:11 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:03:11 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75176) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 16:03:12 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 16:03:12 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:03:12 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75176) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 16:03:12 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75176) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 16:03:12 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75176) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 16:03:12 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:03:14 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:03:14 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:03:14 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:03:14 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:03:14 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Auditing locally available compute resources for user (node: user) {{(pid=75176) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 16:03:14 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75176) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 16:03:14 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1062234d-4890-46df-bb52-49c55b4af32b/disk.rescue --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:03:15 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1062234d-4890-46df-bb52-49c55b4af32b/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:03:15 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1062234d-4890-46df-bb52-49c55b4af32b/disk.rescue --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:03:15 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1062234d-4890-46df-bb52-49c55b4af32b/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:03:15 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55febf04-14ea-4903-8692-c7cc6115de75/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:03:15 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55febf04-14ea-4903-8692-c7cc6115de75/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:03:15 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55febf04-14ea-4903-8692-c7cc6115de75/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:03:15 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55febf04-14ea-4903-8692-c7cc6115de75/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:03:15 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c6a4729-9d51-4ebf-bad6-2022f35cbe3b/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:03:15 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c6a4729-9d51-4ebf-bad6-2022f35cbe3b/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:03:15 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c6a4729-9d51-4ebf-bad6-2022f35cbe3b/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:03:15 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c6a4729-9d51-4ebf-bad6-2022f35cbe3b/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:03:15 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75176) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 16:03:15 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecf38787-0a69-4f35-b121-3dc6e70023a1/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:03:16 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecf38787-0a69-4f35-b121-3dc6e70023a1/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:03:16 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecf38787-0a69-4f35-b121-3dc6e70023a1/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:03:16 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecf38787-0a69-4f35-b121-3dc6e70023a1/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:03:16 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/726344c0-a0dc-48d5-a18f-8a258ebde87d/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:03:16 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/726344c0-a0dc-48d5-a18f-8a258ebde87d/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:03:16 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/726344c0-a0dc-48d5-a18f-8a258ebde87d/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:03:16 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/726344c0-a0dc-48d5-a18f-8a258ebde87d/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:03:16 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75176) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 16:03:16 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75176) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 16:03:16 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66ead7d-98f4-4822-9dce-f2ea0206a58d/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:03:16 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66ead7d-98f4-4822-9dce-f2ea0206a58d/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:03:16 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66ead7d-98f4-4822-9dce-f2ea0206a58d/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:03:17 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:03:17 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66ead7d-98f4-4822-9dce-f2ea0206a58d/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:03:17 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7/disk.rescue --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:03:17 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:03:17 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7/disk.rescue --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:03:17 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:03:17 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:03:17 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:03:17 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:03:17 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:03:17 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/423e0b0c-8714-47cb-a7b7-791d28b18f06/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:03:17 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/423e0b0c-8714-47cb-a7b7-791d28b18f06/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:03:17 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/423e0b0c-8714-47cb-a7b7-791d28b18f06/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:03:18 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/423e0b0c-8714-47cb-a7b7-791d28b18f06/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:03:18 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 16:03:18 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 16:03:18 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Hypervisor/Node resource view: name=user free_ram=8150MB free_disk=24.737316131591797GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75176) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 16:03:18 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:03:18 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:03:18 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance f66ead7d-98f4-4822-9dce-f2ea0206a58d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 16:03:18 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance 55febf04-14ea-4903-8692-c7cc6115de75 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 16:03:18 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance 8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 16:03:18 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance dc4e6d39-adfb-4d26-afef-46f316ff7846 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 16:03:18 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance ecf38787-0a69-4f35-b121-3dc6e70023a1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 16:03:18 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance 726344c0-a0dc-48d5-a18f-8a258ebde87d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 16:03:18 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance 1062234d-4890-46df-bb52-49c55b4af32b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 16:03:18 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance 6c6a4729-9d51-4ebf-bad6-2022f35cbe3b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 16:03:18 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance 423e0b0c-8714-47cb-a7b7-791d28b18f06 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 16:03:18 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75176) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 16:03:18 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75176) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 16:03:18 user nova-compute[75176]: DEBUG nova.compute.provider_tree [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Inventory has not changed in ProviderTree for provider: b37848d8-f401-4155-a029-b0ffa09ff85b {{(pid=75176) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 16:03:19 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Inventory has not changed for provider b37848d8-f401-4155-a029-b0ffa09ff85b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75176) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 16:03:19 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Compute_service record updated for user:user {{(pid=75176) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 16:03:19 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.491s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:03:19 user nova-compute[75176]: DEBUG nova.compute.manager [req-e7e34a7a-c80b-4ee6-9b02-1aa3bae94d7a req-bd1989cc-2e37-4b02-9c40-8e7f368463de service nova] [instance: 726344c0-a0dc-48d5-a18f-8a258ebde87d] Received event network-changed-966907f1-2c5f-4c34-b155-b1b3b4176f5f {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 16:03:19 user nova-compute[75176]: DEBUG nova.compute.manager [req-e7e34a7a-c80b-4ee6-9b02-1aa3bae94d7a req-bd1989cc-2e37-4b02-9c40-8e7f368463de service nova] [instance: 726344c0-a0dc-48d5-a18f-8a258ebde87d] Refreshing instance network info cache due to event network-changed-966907f1-2c5f-4c34-b155-b1b3b4176f5f. {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 16:03:19 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-e7e34a7a-c80b-4ee6-9b02-1aa3bae94d7a req-bd1989cc-2e37-4b02-9c40-8e7f368463de service nova] Acquiring lock "refresh_cache-726344c0-a0dc-48d5-a18f-8a258ebde87d" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 16:03:19 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-e7e34a7a-c80b-4ee6-9b02-1aa3bae94d7a req-bd1989cc-2e37-4b02-9c40-8e7f368463de service nova] Acquired lock "refresh_cache-726344c0-a0dc-48d5-a18f-8a258ebde87d" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 16:03:19 user nova-compute[75176]: DEBUG nova.network.neutron [req-e7e34a7a-c80b-4ee6-9b02-1aa3bae94d7a req-bd1989cc-2e37-4b02-9c40-8e7f368463de service nova] [instance: 726344c0-a0dc-48d5-a18f-8a258ebde87d] Refreshing network info cache for port 966907f1-2c5f-4c34-b155-b1b3b4176f5f {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 16:03:19 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-449c9e76-37db-43c3-9c7b-a40d2f4574e3 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Acquiring lock "726344c0-a0dc-48d5-a18f-8a258ebde87d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:03:19 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-449c9e76-37db-43c3-9c7b-a40d2f4574e3 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Lock "726344c0-a0dc-48d5-a18f-8a258ebde87d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:03:19 user nova-compute[75176]: DEBUG nova.network.neutron [req-e7e34a7a-c80b-4ee6-9b02-1aa3bae94d7a req-bd1989cc-2e37-4b02-9c40-8e7f368463de service nova] [instance: 726344c0-a0dc-48d5-a18f-8a258ebde87d] Updated VIF entry in instance network info cache for port 966907f1-2c5f-4c34-b155-b1b3b4176f5f. {{(pid=75176) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 16:03:19 user nova-compute[75176]: DEBUG nova.network.neutron [req-e7e34a7a-c80b-4ee6-9b02-1aa3bae94d7a req-bd1989cc-2e37-4b02-9c40-8e7f368463de service nova] [instance: 726344c0-a0dc-48d5-a18f-8a258ebde87d] Updating instance_info_cache with network_info: [{"id": "966907f1-2c5f-4c34-b155-b1b3b4176f5f", "address": "fa:16:3e:0d:da:42", "network": {"id": "d47c1797-a66f-4f2d-b83e-903b5bd3251c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1416388789-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd2856ce0a2545cda0b796eb0be10a40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap966907f1-2c", "ovs_interfaceid": "966907f1-2c5f-4c34-b155-b1b3b4176f5f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 16:03:19 user nova-compute[75176]: INFO nova.compute.manager [None req-449c9e76-37db-43c3-9c7b-a40d2f4574e3 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] [instance: 726344c0-a0dc-48d5-a18f-8a258ebde87d] Detaching volume 4b1a81f9-4a84-4f9e-9b1a-86b0c17ed81c
Nov 28 16:03:19 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:03:19 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-e7e34a7a-c80b-4ee6-9b02-1aa3bae94d7a req-bd1989cc-2e37-4b02-9c40-8e7f368463de service nova] Releasing lock "refresh_cache-726344c0-a0dc-48d5-a18f-8a258ebde87d" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 16:03:19 user nova-compute[75176]: INFO nova.virt.block_device [None req-449c9e76-37db-43c3-9c7b-a40d2f4574e3 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] [instance: 726344c0-a0dc-48d5-a18f-8a258ebde87d] Attempting to driver detach volume 4b1a81f9-4a84-4f9e-9b1a-86b0c17ed81c from mountpoint /dev/vdb
Nov 28 16:03:19 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-449c9e76-37db-43c3-9c7b-a40d2f4574e3 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Attempting to detach device vdb from instance 726344c0-a0dc-48d5-a18f-8a258ebde87d from the persistent domain config. {{(pid=75176) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 16:03:19 user nova-compute[75176]: DEBUG nova.virt.libvirt.guest [None req-449c9e76-37db-43c3-9c7b-a40d2f4574e3 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 16:03:19 user nova-compute[75176]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 16:03:19 user nova-compute[75176]:   <source dev="/dev/sdc"/>
Nov 28 16:03:19 user nova-compute[75176]:   <target dev="vdb" bus="virtio"/>
Nov 28 16:03:19 user nova-compute[75176]:   <serial>4b1a81f9-4a84-4f9e-9b1a-86b0c17ed81c</serial>
Nov 28 16:03:19 user nova-compute[75176]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 16:03:19 user nova-compute[75176]: </disk>
Nov 28 16:03:19 user nova-compute[75176]:  {{(pid=75176) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 16:03:19 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-449c9e76-37db-43c3-9c7b-a40d2f4574e3 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Successfully detached device vdb from instance 726344c0-a0dc-48d5-a18f-8a258ebde87d from the persistent domain config.
Nov 28 16:03:19 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-449c9e76-37db-43c3-9c7b-a40d2f4574e3 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 726344c0-a0dc-48d5-a18f-8a258ebde87d from the live domain config. {{(pid=75176) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 16:03:19 user nova-compute[75176]: DEBUG nova.virt.libvirt.guest [None req-449c9e76-37db-43c3-9c7b-a40d2f4574e3 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 16:03:19 user nova-compute[75176]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 16:03:19 user nova-compute[75176]:   <source dev="/dev/sdc"/>
Nov 28 16:03:19 user nova-compute[75176]:   <target dev="vdb" bus="virtio"/>
Nov 28 16:03:19 user nova-compute[75176]:   <serial>4b1a81f9-4a84-4f9e-9b1a-86b0c17ed81c</serial>
Nov 28 16:03:19 user nova-compute[75176]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 16:03:19 user nova-compute[75176]: </disk>
Nov 28 16:03:19 user nova-compute[75176]:  {{(pid=75176) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 16:03:20 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:03:20 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-449c9e76-37db-43c3-9c7b-a40d2f4574e3 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 726344c0-a0dc-48d5-a18f-8a258ebde87d {{(pid=75176) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 16:03:21 user nova-compute[75176]: DEBUG nova.compute.manager [req-16b6d772-874f-42be-82c0-65430733f0d0 req-9620eb21-d225-4318-9e7a-a8202dd86a1d service nova] [instance: 726344c0-a0dc-48d5-a18f-8a258ebde87d] Received event network-changed-966907f1-2c5f-4c34-b155-b1b3b4176f5f {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 16:03:21 user nova-compute[75176]: DEBUG nova.compute.manager [req-16b6d772-874f-42be-82c0-65430733f0d0 req-9620eb21-d225-4318-9e7a-a8202dd86a1d service nova] [instance: 726344c0-a0dc-48d5-a18f-8a258ebde87d] Refreshing instance network info cache due to event network-changed-966907f1-2c5f-4c34-b155-b1b3b4176f5f. {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 16:03:21 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-16b6d772-874f-42be-82c0-65430733f0d0 req-9620eb21-d225-4318-9e7a-a8202dd86a1d service nova] Acquiring lock "refresh_cache-726344c0-a0dc-48d5-a18f-8a258ebde87d" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 16:03:21 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-16b6d772-874f-42be-82c0-65430733f0d0 req-9620eb21-d225-4318-9e7a-a8202dd86a1d service nova] Acquired lock "refresh_cache-726344c0-a0dc-48d5-a18f-8a258ebde87d" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 16:03:21 user nova-compute[75176]: DEBUG nova.network.neutron [req-16b6d772-874f-42be-82c0-65430733f0d0 req-9620eb21-d225-4318-9e7a-a8202dd86a1d service nova] [instance: 726344c0-a0dc-48d5-a18f-8a258ebde87d] Refreshing network info cache for port 966907f1-2c5f-4c34-b155-b1b3b4176f5f {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 16:03:21 user nova-compute[75176]: DEBUG nova.network.neutron [req-16b6d772-874f-42be-82c0-65430733f0d0 req-9620eb21-d225-4318-9e7a-a8202dd86a1d service nova] [instance: 726344c0-a0dc-48d5-a18f-8a258ebde87d] Updated VIF entry in instance network info cache for port 966907f1-2c5f-4c34-b155-b1b3b4176f5f. {{(pid=75176) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 16:03:21 user nova-compute[75176]: DEBUG nova.network.neutron [req-16b6d772-874f-42be-82c0-65430733f0d0 req-9620eb21-d225-4318-9e7a-a8202dd86a1d service nova] [instance: 726344c0-a0dc-48d5-a18f-8a258ebde87d] Updating instance_info_cache with network_info: [{"id": "966907f1-2c5f-4c34-b155-b1b3b4176f5f", "address": "fa:16:3e:0d:da:42", "network": {"id": "d47c1797-a66f-4f2d-b83e-903b5bd3251c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1416388789-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd2856ce0a2545cda0b796eb0be10a40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap966907f1-2c", "ovs_interfaceid": "966907f1-2c5f-4c34-b155-b1b3b4176f5f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 16:03:21 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-16b6d772-874f-42be-82c0-65430733f0d0 req-9620eb21-d225-4318-9e7a-a8202dd86a1d service nova] Releasing lock "refresh_cache-726344c0-a0dc-48d5-a18f-8a258ebde87d" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 16:03:22 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:03:24 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:03:27 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:03:30 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:03:30 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:03:32 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:03:33 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:03:37 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:03:40 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-449c9e76-37db-43c3-9c7b-a40d2f4574e3 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 726344c0-a0dc-48d5-a18f-8a258ebde87d is timed out.
Nov 28 16:03:40 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-449c9e76-37db-43c3-9c7b-a40d2f4574e3 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Successfully detached device vdb from instance 726344c0-a0dc-48d5-a18f-8a258ebde87d from the live domain config.
Nov 28 16:03:40 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-449c9e76-37db-43c3-9c7b-a40d2f4574e3 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] [instance: 726344c0-a0dc-48d5-a18f-8a258ebde87d] calling os-brick to detach iSCSI Volume {{(pid=75176) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 16:03:40 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-449c9e76-37db-43c3-9c7b-a40d2f4574e3 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c1b8a00>, {'target_iqn': 'iqn.2010-10.org.openstack:4b1a81f9-4a84-4f9e-9b1a-86b0c17ed81c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mEwKVNHQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 16:03:40 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-449c9e76-37db-43c3-9c7b-a40d2f4574e3 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 16:03:40 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-449c9e76-37db-43c3-9c7b-a40d2f4574e3 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 16:03:40 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-449c9e76-37db-43c3-9c7b-a40d2f4574e3 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 16:03:40 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:03:40 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:03:40 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[91203f58-4767-4202-9f45-01672733fb21]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3676a213-38f2-4682-a210-16696ea2f6ad\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6ec9410d-747d-475e-999c-672f87917a20\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4b1a81f9-4a84-4f9e-9b1a-86b0c17ed81c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:03:40 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-449c9e76-37db-43c3-9c7b-a40d2f4574e3 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 16:03:40 user nova-compute[75176]: No targets found.
Nov 28 16:03:40 user nova-compute[75176]: iSNS:
Nov 28 16:03:40 user nova-compute[75176]: No targets found.
Nov 28 16:03:40 user nova-compute[75176]: STATIC:
Nov 28 16:03:40 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:3676a213-38f2-4682-a210-16696ea2f6ad
Nov 28 16:03:40 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 16:03:40 user nova-compute[75176]:                 Iface Name: default
Nov 28 16:03:40 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6
Nov 28 16:03:40 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 16:03:40 user nova-compute[75176]:                 Iface Name: default
Nov 28 16:03:40 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:6ec9410d-747d-475e-999c-672f87917a20
Nov 28 16:03:40 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 16:03:40 user nova-compute[75176]:                 Iface Name: default
Nov 28 16:03:40 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:4b1a81f9-4a84-4f9e-9b1a-86b0c17ed81c
Nov 28 16:03:40 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 16:03:40 user nova-compute[75176]:                 Iface Name: default
Nov 28 16:03:40 user nova-compute[75176]: FIRMWARE:
Nov 28 16:03:40 user nova-compute[75176]: No targets found.
Nov 28 16:03:40 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 16:03:40 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-449c9e76-37db-43c3-9c7b-a40d2f4574e3 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 16:03:40 user nova-compute[75176]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 16:03:40 user nova-compute[75176]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75176) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 16:03:40 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-449c9e76-37db-43c3-9c7b-a40d2f4574e3 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4b1a81f9-4a84-4f9e-9b1a-86b0c17ed81c', 0)] {{(pid=75176) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 16:03:40 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:03:40 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:03:40 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[1835293a-9677-4999-8962-a756a9bfd609]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3676a213-38f2-4682-a210-16696ea2f6ad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4b1a81f9-4a84-4f9e-9b1a-86b0c17ed81c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ec9410d-747d-475e-999c-672f87917a20\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:03:40 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:03:40 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:03:40 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3f30525-70d5-4a47-9ae0-615adfc58d9a]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b1a81f9-4a84-4f9e-9b1a-86b0c17ed81c (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ec9410d-747d-475e-999c-672f87917a20 (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3676a213-38f2-4682-a210-16696ea2f6ad (non-flash)\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:03:40 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-449c9e76-37db-43c3-9c7b-a40d2f4574e3 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 (non-flash)
Nov 28 16:03:40 user nova-compute[75176]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b1a81f9-4a84-4f9e-9b1a-86b0c17ed81c (non-flash)
Nov 28 16:03:40 user nova-compute[75176]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ec9410d-747d-475e-999c-672f87917a20 (non-flash)
Nov 28 16:03:40 user nova-compute[75176]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3676a213-38f2-4682-a210-16696ea2f6ad (non-flash)
Nov 28 16:03:40 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 16:03:40 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-449c9e76-37db-43c3-9c7b-a40d2f4574e3 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 (non-flash)
Nov 28 16:03:40 user nova-compute[75176]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b1a81f9-4a84-4f9e-9b1a-86b0c17ed81c (non-flash)
Nov 28 16:03:40 user nova-compute[75176]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ec9410d-747d-475e-999c-672f87917a20 (non-flash)
Nov 28 16:03:40 user nova-compute[75176]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3676a213-38f2-4682-a210-16696ea2f6ad (non-flash)
Nov 28 16:03:40 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 16:03:40 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-449c9e76-37db-43c3-9c7b-a40d2f4574e3 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f464c1fe440>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4b1a81f9-4a84-4f9e-9b1a-86b0c17ed81c'): ({'sdc'}, set())}) {{(pid=75176) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 16:03:40 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-449c9e76-37db-43c3-9c7b-a40d2f4574e3 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Removing single pathed devices sdc {{(pid=75176) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 16:03:40 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:03:40 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:03:40 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[233fc3e2-7cb0-48cc-8211-3dae5147cb23]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:03:40 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:03:40 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:03:40 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4fcea13-0fb7-40d3-994c-56c792cb3f6e]: (4, ('ok\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:03:40 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-449c9e76-37db-43c3-9c7b-a40d2f4574e3 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Flushing IO for device /dev/sdc {{(pid=75176) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 16:03:40 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:03:40 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:03:40 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1a5bfd0-cbce-44ff-bcb2-13e9239250cc]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:03:40 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-449c9e76-37db-43c3-9c7b-a40d2f4574e3 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75176) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 16:03:40 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:03:40 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.033s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:03:40 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[13b45efb-7305-4882-a299-7a6dc6832881]: (4, ('1', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:03:40 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-449c9e76-37db-43c3-9c7b-a40d2f4574e3 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75176) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 16:03:40 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-449c9e76-37db-43c3-9c7b-a40d2f4574e3 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] SCSI volumes sdc have been removed. {{(pid=75176) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 16:03:40 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-449c9e76-37db-43c3-9c7b-a40d2f4574e3 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4b1a81f9-4a84-4f9e-9b1a-86b0c17ed81c')] {{(pid=75176) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 16:03:40 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b1a81f9-4a84-4f9e-9b1a-86b0c17ed81c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:03:40 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b1a81f9-4a84-4f9e-9b1a-86b0c17ed81c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:03:40 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[19a8594f-5c51-4617-a583-3ce83416ac46]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:03:40 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-449c9e76-37db-43c3-9c7b-a40d2f4574e3 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 16:03:40 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b1a81f9-4a84-4f9e-9b1a-86b0c17ed81c -p 172.16.0.220:3260 --logout {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:03:40 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b1a81f9-4a84-4f9e-9b1a-86b0c17ed81c -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:03:40 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[468edec0-49e4-4453-8fed-fa1e38085604]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:4b1a81f9-4a84-4f9e-9b1a-86b0c17ed81c, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:4b1a81f9-4a84-4f9e-9b1a-86b0c17ed81c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:03:40 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-449c9e76-37db-43c3-9c7b-a40d2f4574e3 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:4b1a81f9-4a84-4f9e-9b1a-86b0c17ed81c, portal: 172.16.0.220,3260]
Nov 28 16:03:40 user nova-compute[75176]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:4b1a81f9-4a84-4f9e-9b1a-86b0c17ed81c, portal: 172.16.0.220,3260] successful.
Nov 28 16:03:40 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 16:03:40 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b1a81f9-4a84-4f9e-9b1a-86b0c17ed81c -p 172.16.0.220:3260 --op delete {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:03:40 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b1a81f9-4a84-4f9e-9b1a-86b0c17ed81c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:03:40 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[785d670c-94f1-4445-bc8d-1210afc0f1b4]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:03:40 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-449c9e76-37db-43c3-9c7b-a40d2f4574e3 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 16:03:40 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-449c9e76-37db-43c3-9c7b-a40d2f4574e3 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.320s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 16:03:40 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-449c9e76-37db-43c3-9c7b-a40d2f4574e3 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] <== disconnect_volume: return (321ms) None {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 16:03:40 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-449c9e76-37db-43c3-9c7b-a40d2f4574e3 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] [instance: 726344c0-a0dc-48d5-a18f-8a258ebde87d] Disconnected iSCSI Volume {{(pid=75176) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 16:03:41 user nova-compute[75176]: DEBUG nova.objects.instance [None req-449c9e76-37db-43c3-9c7b-a40d2f4574e3 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Lazy-loading 'flavor' on Instance uuid 726344c0-a0dc-48d5-a18f-8a258ebde87d {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 16:03:41 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-449c9e76-37db-43c3-9c7b-a40d2f4574e3 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Lock "726344c0-a0dc-48d5-a18f-8a258ebde87d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.644s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:03:42 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 16:03:42 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 16:03:42 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75176) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 16:03:42 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75176) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 16:03:42 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75176) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 16:03:42 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:03:46 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-6490e6f2-d831-4544-8bcc-d66820358fe4 tempest-VolumesNegativeTest-226359169 tempest-VolumesNegativeTest-226359169-project-member] Acquiring lock "423e0b0c-8714-47cb-a7b7-791d28b18f06" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:03:46 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-6490e6f2-d831-4544-8bcc-d66820358fe4 tempest-VolumesNegativeTest-226359169 tempest-VolumesNegativeTest-226359169-project-member] Lock "423e0b0c-8714-47cb-a7b7-791d28b18f06" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:03:46 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-6490e6f2-d831-4544-8bcc-d66820358fe4 tempest-VolumesNegativeTest-226359169 tempest-VolumesNegativeTest-226359169-project-member] Acquiring lock "423e0b0c-8714-47cb-a7b7-791d28b18f06-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:03:46 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-6490e6f2-d831-4544-8bcc-d66820358fe4 tempest-VolumesNegativeTest-226359169 tempest-VolumesNegativeTest-226359169-project-member] Lock "423e0b0c-8714-47cb-a7b7-791d28b18f06-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:03:46 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-6490e6f2-d831-4544-8bcc-d66820358fe4 tempest-VolumesNegativeTest-226359169 tempest-VolumesNegativeTest-226359169-project-member] Lock "423e0b0c-8714-47cb-a7b7-791d28b18f06-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:03:46 user nova-compute[75176]: INFO nova.compute.manager [None req-6490e6f2-d831-4544-8bcc-d66820358fe4 tempest-VolumesNegativeTest-226359169 tempest-VolumesNegativeTest-226359169-project-member] [instance: 423e0b0c-8714-47cb-a7b7-791d28b18f06] Terminating instance
Nov 28 16:03:46 user nova-compute[75176]: DEBUG nova.compute.manager [None req-6490e6f2-d831-4544-8bcc-d66820358fe4 tempest-VolumesNegativeTest-226359169 tempest-VolumesNegativeTest-226359169-project-member] [instance: 423e0b0c-8714-47cb-a7b7-791d28b18f06] Start destroying the instance on the hypervisor. {{(pid=75176) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 16:03:46 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:03:46 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:03:46 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:03:46 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:03:46 user nova-compute[75176]: DEBUG nova.compute.manager [req-56d08869-0d3d-4a56-870d-21f8e4ad7dd4 req-cf31eef9-7258-484f-a1a6-bba1a784bf0b service nova] [instance: 423e0b0c-8714-47cb-a7b7-791d28b18f06] Received event network-vif-unplugged-cf9178a0-d59d-4370-8482-fcf2d6558076 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 16:03:46 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-56d08869-0d3d-4a56-870d-21f8e4ad7dd4 req-cf31eef9-7258-484f-a1a6-bba1a784bf0b service nova] Acquiring lock "423e0b0c-8714-47cb-a7b7-791d28b18f06-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:03:46 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-56d08869-0d3d-4a56-870d-21f8e4ad7dd4 req-cf31eef9-7258-484f-a1a6-bba1a784bf0b service nova] Lock "423e0b0c-8714-47cb-a7b7-791d28b18f06-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:03:46 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-56d08869-0d3d-4a56-870d-21f8e4ad7dd4 req-cf31eef9-7258-484f-a1a6-bba1a784bf0b service nova] Lock "423e0b0c-8714-47cb-a7b7-791d28b18f06-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:03:46 user nova-compute[75176]: DEBUG nova.compute.manager [req-56d08869-0d3d-4a56-870d-21f8e4ad7dd4 req-cf31eef9-7258-484f-a1a6-bba1a784bf0b service nova] [instance: 423e0b0c-8714-47cb-a7b7-791d28b18f06] No waiting events found dispatching network-vif-unplugged-cf9178a0-d59d-4370-8482-fcf2d6558076 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 16:03:46 user nova-compute[75176]: DEBUG nova.compute.manager [req-56d08869-0d3d-4a56-870d-21f8e4ad7dd4 req-cf31eef9-7258-484f-a1a6-bba1a784bf0b service nova] [instance: 423e0b0c-8714-47cb-a7b7-791d28b18f06] Received event network-vif-unplugged-cf9178a0-d59d-4370-8482-fcf2d6558076 for instance with task_state deleting. {{(pid=75176) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 16:03:46 user nova-compute[75176]: INFO nova.virt.libvirt.driver [-] [instance: 423e0b0c-8714-47cb-a7b7-791d28b18f06] Instance destroyed successfully.
Nov 28 16:03:46 user nova-compute[75176]: DEBUG nova.objects.instance [None req-6490e6f2-d831-4544-8bcc-d66820358fe4 tempest-VolumesNegativeTest-226359169 tempest-VolumesNegativeTest-226359169-project-member] Lazy-loading 'resources' on Instance uuid 423e0b0c-8714-47cb-a7b7-791d28b18f06 {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 16:03:46 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-6490e6f2-d831-4544-8bcc-d66820358fe4 tempest-VolumesNegativeTest-226359169 tempest-VolumesNegativeTest-226359169-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T16:01:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1557314343',display_name='tempest-VolumesNegativeTest-instance-1557314343',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1557314343',id=49,image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-28T16:02:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2382bf1fb7b7466da42b8da1c4c88129',ramdisk_id='',reservation_id='r-nq89lt0i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-226359169',owner_user_name='tempest-VolumesNegativeTest-226359169-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T16:02:02Z,user_data=None,user_id='e73b4233feac4ecc99babdf01eaaaced',uuid=423e0b0c-8714-47cb-a7b7-791d28b18f06,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cf9178a0-d59d-4370-8482-fcf2d6558076", "address": "fa:16:3e:2c:da:2b", "network": {"id": "799e857e-f9a6-4c99-8f85-f117f7e47961", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.46", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "1b91c5d0672c4224a48df2e1f92688e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf9178a0-d5", "ovs_interfaceid": "cf9178a0-d59d-4370-8482-fcf2d6558076", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 16:03:46 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-6490e6f2-d831-4544-8bcc-d66820358fe4 tempest-VolumesNegativeTest-226359169 tempest-VolumesNegativeTest-226359169-project-member] Converting VIF {"id": "cf9178a0-d59d-4370-8482-fcf2d6558076", "address": "fa:16:3e:2c:da:2b", "network": {"id": "799e857e-f9a6-4c99-8f85-f117f7e47961", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.46", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "1b91c5d0672c4224a48df2e1f92688e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf9178a0-d5", "ovs_interfaceid": "cf9178a0-d59d-4370-8482-fcf2d6558076", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 16:03:46 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-6490e6f2-d831-4544-8bcc-d66820358fe4 tempest-VolumesNegativeTest-226359169 tempest-VolumesNegativeTest-226359169-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2c:da:2b,bridge_name='br-int',has_traffic_filtering=True,id=cf9178a0-d59d-4370-8482-fcf2d6558076,network=Network(799e857e-f9a6-4c99-8f85-f117f7e47961),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf9178a0-d5') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 16:03:46 user nova-compute[75176]: DEBUG os_vif [None req-6490e6f2-d831-4544-8bcc-d66820358fe4 tempest-VolumesNegativeTest-226359169 tempest-VolumesNegativeTest-226359169-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2c:da:2b,bridge_name='br-int',has_traffic_filtering=True,id=cf9178a0-d59d-4370-8482-fcf2d6558076,network=Network(799e857e-f9a6-4c99-8f85-f117f7e47961),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf9178a0-d5') {{(pid=75176) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 16:03:46 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:03:46 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcf9178a0-d5, bridge=br-int, if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 16:03:46 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:03:46 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 16:03:46 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:03:46 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:03:46 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=33d42f55-fe59-4416-908f-5cc9d94945c6) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 16:03:46 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:03:46 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 16:03:46 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:03:46 user nova-compute[75176]: INFO os_vif [None req-6490e6f2-d831-4544-8bcc-d66820358fe4 tempest-VolumesNegativeTest-226359169 tempest-VolumesNegativeTest-226359169-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2c:da:2b,bridge_name='br-int',has_traffic_filtering=True,id=cf9178a0-d59d-4370-8482-fcf2d6558076,network=Network(799e857e-f9a6-4c99-8f85-f117f7e47961),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf9178a0-d5')
Nov 28 16:03:46 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-6490e6f2-d831-4544-8bcc-d66820358fe4 tempest-VolumesNegativeTest-226359169 tempest-VolumesNegativeTest-226359169-project-member] [instance: 423e0b0c-8714-47cb-a7b7-791d28b18f06] Deleting instance files /opt/stack/data/nova/instances/423e0b0c-8714-47cb-a7b7-791d28b18f06_del
Nov 28 16:03:46 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-6490e6f2-d831-4544-8bcc-d66820358fe4 tempest-VolumesNegativeTest-226359169 tempest-VolumesNegativeTest-226359169-project-member] [instance: 423e0b0c-8714-47cb-a7b7-791d28b18f06] Deletion of /opt/stack/data/nova/instances/423e0b0c-8714-47cb-a7b7-791d28b18f06_del complete
Nov 28 16:03:46 user nova-compute[75176]: INFO nova.compute.manager [None req-6490e6f2-d831-4544-8bcc-d66820358fe4 tempest-VolumesNegativeTest-226359169 tempest-VolumesNegativeTest-226359169-project-member] [instance: 423e0b0c-8714-47cb-a7b7-791d28b18f06] Took 0.68 seconds to destroy the instance on the hypervisor.
Nov 28 16:03:46 user nova-compute[75176]: DEBUG oslo.service.loopingcall [None req-6490e6f2-d831-4544-8bcc-d66820358fe4 tempest-VolumesNegativeTest-226359169 tempest-VolumesNegativeTest-226359169-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75176) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 16:03:46 user nova-compute[75176]: DEBUG nova.compute.manager [-] [instance: 423e0b0c-8714-47cb-a7b7-791d28b18f06] Deallocating network for instance {{(pid=75176) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 16:03:46 user nova-compute[75176]: DEBUG nova.network.neutron [-] [instance: 423e0b0c-8714-47cb-a7b7-791d28b18f06] deallocate_for_instance() {{(pid=75176) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 16:03:47 user nova-compute[75176]: DEBUG nova.network.neutron [-] [instance: 423e0b0c-8714-47cb-a7b7-791d28b18f06] Updating instance_info_cache with network_info: [] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 16:03:47 user nova-compute[75176]: INFO nova.compute.manager [-] [instance: 423e0b0c-8714-47cb-a7b7-791d28b18f06] Took 0.54 seconds to deallocate network for instance.
Nov 28 16:03:47 user nova-compute[75176]: DEBUG nova.compute.manager [req-5eaa9e7e-9e04-48dc-9d70-b020503277cf req-c8f0bd17-2cc4-4bd9-9756-90225ea5eea3 service nova] [instance: 423e0b0c-8714-47cb-a7b7-791d28b18f06] Received event network-vif-deleted-cf9178a0-d59d-4370-8482-fcf2d6558076 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 16:03:47 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-6490e6f2-d831-4544-8bcc-d66820358fe4 tempest-VolumesNegativeTest-226359169 tempest-VolumesNegativeTest-226359169-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:03:47 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-6490e6f2-d831-4544-8bcc-d66820358fe4 tempest-VolumesNegativeTest-226359169 tempest-VolumesNegativeTest-226359169-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:03:47 user nova-compute[75176]: DEBUG nova.compute.provider_tree [None req-6490e6f2-d831-4544-8bcc-d66820358fe4 tempest-VolumesNegativeTest-226359169 tempest-VolumesNegativeTest-226359169-project-member] Inventory has not changed in ProviderTree for provider: b37848d8-f401-4155-a029-b0ffa09ff85b {{(pid=75176) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 16:03:47 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-6490e6f2-d831-4544-8bcc-d66820358fe4 tempest-VolumesNegativeTest-226359169 tempest-VolumesNegativeTest-226359169-project-member] Inventory has not changed for provider b37848d8-f401-4155-a029-b0ffa09ff85b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75176) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 16:03:47 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-6490e6f2-d831-4544-8bcc-d66820358fe4 tempest-VolumesNegativeTest-226359169 tempest-VolumesNegativeTest-226359169-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.283s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:03:47 user nova-compute[75176]: INFO nova.scheduler.client.report [None req-6490e6f2-d831-4544-8bcc-d66820358fe4 tempest-VolumesNegativeTest-226359169 tempest-VolumesNegativeTest-226359169-project-member] Deleted allocations for instance 423e0b0c-8714-47cb-a7b7-791d28b18f06
Nov 28 16:03:47 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-6490e6f2-d831-4544-8bcc-d66820358fe4 tempest-VolumesNegativeTest-226359169 tempest-VolumesNegativeTest-226359169-project-member] Lock "423e0b0c-8714-47cb-a7b7-791d28b18f06" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.664s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:03:48 user nova-compute[75176]: DEBUG nova.compute.manager [req-e91ab99e-b5a4-482a-85f5-44f3f3e8e503 req-230bb0a3-737d-4576-b92e-ede44e0ceedb service nova] [instance: 423e0b0c-8714-47cb-a7b7-791d28b18f06] Received event network-vif-plugged-cf9178a0-d59d-4370-8482-fcf2d6558076 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 16:03:48 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-e91ab99e-b5a4-482a-85f5-44f3f3e8e503 req-230bb0a3-737d-4576-b92e-ede44e0ceedb service nova] Acquiring lock "423e0b0c-8714-47cb-a7b7-791d28b18f06-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:03:48 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-e91ab99e-b5a4-482a-85f5-44f3f3e8e503 req-230bb0a3-737d-4576-b92e-ede44e0ceedb service nova] Lock "423e0b0c-8714-47cb-a7b7-791d28b18f06-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:03:48 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-e91ab99e-b5a4-482a-85f5-44f3f3e8e503 req-230bb0a3-737d-4576-b92e-ede44e0ceedb service nova] Lock "423e0b0c-8714-47cb-a7b7-791d28b18f06-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:03:48 user nova-compute[75176]: DEBUG nova.compute.manager [req-e91ab99e-b5a4-482a-85f5-44f3f3e8e503 req-230bb0a3-737d-4576-b92e-ede44e0ceedb service nova] [instance: 423e0b0c-8714-47cb-a7b7-791d28b18f06] No waiting events found dispatching network-vif-plugged-cf9178a0-d59d-4370-8482-fcf2d6558076 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 16:03:48 user nova-compute[75176]: WARNING nova.compute.manager [req-e91ab99e-b5a4-482a-85f5-44f3f3e8e503 req-230bb0a3-737d-4576-b92e-ede44e0ceedb service nova] [instance: 423e0b0c-8714-47cb-a7b7-791d28b18f06] Received unexpected event network-vif-plugged-cf9178a0-d59d-4370-8482-fcf2d6558076 for instance with vm_state deleted and task_state None.
Nov 28 16:03:51 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:03:56 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 16:04:01 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 16:04:01 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:04:02 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:04:06 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 16:04:07 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:04:09 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:04:10 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-3b2fbee8-301c-4285-b43e-07464e1f26cf tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Acquiring lock "726344c0-a0dc-48d5-a18f-8a258ebde87d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:04:10 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-3b2fbee8-301c-4285-b43e-07464e1f26cf tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Lock "726344c0-a0dc-48d5-a18f-8a258ebde87d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:04:10 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-3b2fbee8-301c-4285-b43e-07464e1f26cf tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Acquiring lock "726344c0-a0dc-48d5-a18f-8a258ebde87d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:04:10 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-3b2fbee8-301c-4285-b43e-07464e1f26cf tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Lock "726344c0-a0dc-48d5-a18f-8a258ebde87d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:04:10 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-3b2fbee8-301c-4285-b43e-07464e1f26cf tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Lock "726344c0-a0dc-48d5-a18f-8a258ebde87d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:04:10 user nova-compute[75176]: INFO nova.compute.manager [None req-3b2fbee8-301c-4285-b43e-07464e1f26cf tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] [instance: 726344c0-a0dc-48d5-a18f-8a258ebde87d] Terminating instance
Nov 28 16:04:10 user nova-compute[75176]: DEBUG nova.compute.manager [None req-3b2fbee8-301c-4285-b43e-07464e1f26cf tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] [instance: 726344c0-a0dc-48d5-a18f-8a258ebde87d] Start destroying the instance on the hypervisor. {{(pid=75176) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 16:04:10 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:04:10 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:04:10 user nova-compute[75176]: DEBUG nova.compute.manager [req-f477de47-57f2-4645-a5e3-037fd17a1f3b req-45ac6329-e28a-46c0-bd28-eca5460deba0 service nova] [instance: 726344c0-a0dc-48d5-a18f-8a258ebde87d] Received event network-vif-unplugged-966907f1-2c5f-4c34-b155-b1b3b4176f5f {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 16:04:10 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-f477de47-57f2-4645-a5e3-037fd17a1f3b req-45ac6329-e28a-46c0-bd28-eca5460deba0 service nova] Acquiring lock "726344c0-a0dc-48d5-a18f-8a258ebde87d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:04:10 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-f477de47-57f2-4645-a5e3-037fd17a1f3b req-45ac6329-e28a-46c0-bd28-eca5460deba0 service nova] Lock "726344c0-a0dc-48d5-a18f-8a258ebde87d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:04:10 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-f477de47-57f2-4645-a5e3-037fd17a1f3b req-45ac6329-e28a-46c0-bd28-eca5460deba0 service nova] Lock "726344c0-a0dc-48d5-a18f-8a258ebde87d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:04:10 user nova-compute[75176]: DEBUG nova.compute.manager [req-f477de47-57f2-4645-a5e3-037fd17a1f3b req-45ac6329-e28a-46c0-bd28-eca5460deba0 service nova] [instance: 726344c0-a0dc-48d5-a18f-8a258ebde87d] No waiting events found dispatching network-vif-unplugged-966907f1-2c5f-4c34-b155-b1b3b4176f5f {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 16:04:10 user nova-compute[75176]: DEBUG nova.compute.manager [req-f477de47-57f2-4645-a5e3-037fd17a1f3b req-45ac6329-e28a-46c0-bd28-eca5460deba0 service nova] [instance: 726344c0-a0dc-48d5-a18f-8a258ebde87d] Received event network-vif-unplugged-966907f1-2c5f-4c34-b155-b1b3b4176f5f for instance with task_state deleting. {{(pid=75176) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 16:04:10 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:04:10 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:04:10 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:04:10 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Starting heal instance info cache {{(pid=75176) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 16:04:10 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:04:10 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] [instance: 726344c0-a0dc-48d5-a18f-8a258ebde87d] Skipping network cache update for instance because it is being deleted. {{(pid=75176) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9971}}
Nov 28 16:04:10 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Didn't find any instances for network info cache update. {{(pid=75176) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 28 16:04:10 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:04:10 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75176) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 16:04:10 user nova-compute[75176]: INFO nova.virt.libvirt.driver [-] [instance: 726344c0-a0dc-48d5-a18f-8a258ebde87d] Instance destroyed successfully.
Nov 28 16:04:10 user nova-compute[75176]: DEBUG nova.objects.instance [None req-3b2fbee8-301c-4285-b43e-07464e1f26cf tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Lazy-loading 'resources' on Instance uuid 726344c0-a0dc-48d5-a18f-8a258ebde87d {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 16:04:10 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-3b2fbee8-301c-4285-b43e-07464e1f26cf tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T15:57:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1122679672',display_name='tempest-ServerRescueNegativeTestJSON-server-1122679672',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1122679672',id=45,image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEZuNmXMFz6sBu04nshrF/BB/Cnv2fAQGDkY1pjVwPYLhAmT6GMTzKRLMsJCXLjGi+jXRTKDx4ZWnzYKB3Ckq5OigiPkcaffbdzn12nwNwhUqhkxX7xDpQqJpdgTCr30aA==',key_name='tempest-keypair-210592767',keypairs=<?>,launch_index=0,launched_at=2023-11-28T15:59:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fd2856ce0a2545cda0b796eb0be10a40',ramdisk_id='',reservation_id='r-wq0wf5rj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1263291627',owner_user_name='tempest-ServerRescueNegativeTestJSON-1263291627-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T16:01:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b7bd0e1b307f4d339ca2e540e063f028',uuid=726344c0-a0dc-48d5-a18f-8a258ebde87d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "966907f1-2c5f-4c34-b155-b1b3b4176f5f", "address": "fa:16:3e:0d:da:42", "network": {"id": "d47c1797-a66f-4f2d-b83e-903b5bd3251c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1416388789-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd2856ce0a2545cda0b796eb0be10a40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap966907f1-2c", "ovs_interfaceid": "966907f1-2c5f-4c34-b155-b1b3b4176f5f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 16:04:10 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-3b2fbee8-301c-4285-b43e-07464e1f26cf tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Converting VIF {"id": "966907f1-2c5f-4c34-b155-b1b3b4176f5f", "address": "fa:16:3e:0d:da:42", "network": {"id": "d47c1797-a66f-4f2d-b83e-903b5bd3251c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1416388789-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd2856ce0a2545cda0b796eb0be10a40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap966907f1-2c", "ovs_interfaceid": "966907f1-2c5f-4c34-b155-b1b3b4176f5f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 16:04:10 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-3b2fbee8-301c-4285-b43e-07464e1f26cf tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0d:da:42,bridge_name='br-int',has_traffic_filtering=True,id=966907f1-2c5f-4c34-b155-b1b3b4176f5f,network=Network(d47c1797-a66f-4f2d-b83e-903b5bd3251c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap966907f1-2c') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 16:04:10 user nova-compute[75176]: DEBUG os_vif [None req-3b2fbee8-301c-4285-b43e-07464e1f26cf tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0d:da:42,bridge_name='br-int',has_traffic_filtering=True,id=966907f1-2c5f-4c34-b155-b1b3b4176f5f,network=Network(d47c1797-a66f-4f2d-b83e-903b5bd3251c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap966907f1-2c') {{(pid=75176) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 16:04:10 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:04:10 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap966907f1-2c, bridge=br-int, if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 16:04:10 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:04:10 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 16:04:10 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:04:10 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:04:10 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9d00bdb3-4e05-486f-a42c-160b210bd7e5) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 16:04:10 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:04:10 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 16:04:10 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:04:10 user nova-compute[75176]: INFO os_vif [None req-3b2fbee8-301c-4285-b43e-07464e1f26cf tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0d:da:42,bridge_name='br-int',has_traffic_filtering=True,id=966907f1-2c5f-4c34-b155-b1b3b4176f5f,network=Network(d47c1797-a66f-4f2d-b83e-903b5bd3251c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap966907f1-2c')
Nov 28 16:04:10 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-3b2fbee8-301c-4285-b43e-07464e1f26cf tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] [instance: 726344c0-a0dc-48d5-a18f-8a258ebde87d] Deleting instance files /opt/stack/data/nova/instances/726344c0-a0dc-48d5-a18f-8a258ebde87d_del
Nov 28 16:04:10 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-3b2fbee8-301c-4285-b43e-07464e1f26cf tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] [instance: 726344c0-a0dc-48d5-a18f-8a258ebde87d] Deletion of /opt/stack/data/nova/instances/726344c0-a0dc-48d5-a18f-8a258ebde87d_del complete
Nov 28 16:04:11 user nova-compute[75176]: INFO nova.compute.manager [None req-3b2fbee8-301c-4285-b43e-07464e1f26cf tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] [instance: 726344c0-a0dc-48d5-a18f-8a258ebde87d] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 28 16:04:11 user nova-compute[75176]: DEBUG oslo.service.loopingcall [None req-3b2fbee8-301c-4285-b43e-07464e1f26cf tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75176) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 16:04:11 user nova-compute[75176]: DEBUG nova.compute.manager [-] [instance: 726344c0-a0dc-48d5-a18f-8a258ebde87d] Deallocating network for instance {{(pid=75176) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 16:04:11 user nova-compute[75176]: DEBUG nova.network.neutron [-] [instance: 726344c0-a0dc-48d5-a18f-8a258ebde87d] deallocate_for_instance() {{(pid=75176) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 16:04:11 user nova-compute[75176]: INFO nova.compute.manager [None req-0aa7ec99-7a17-4fee-8dad-b7f0d6b9e2d3 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: 1062234d-4890-46df-bb52-49c55b4af32b] Unrescuing
Nov 28 16:04:11 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-0aa7ec99-7a17-4fee-8dad-b7f0d6b9e2d3 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Acquiring lock "refresh_cache-1062234d-4890-46df-bb52-49c55b4af32b" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 16:04:11 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-0aa7ec99-7a17-4fee-8dad-b7f0d6b9e2d3 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Acquired lock "refresh_cache-1062234d-4890-46df-bb52-49c55b4af32b" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 16:04:11 user nova-compute[75176]: DEBUG nova.network.neutron [None req-0aa7ec99-7a17-4fee-8dad-b7f0d6b9e2d3 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: 1062234d-4890-46df-bb52-49c55b4af32b] Building network info cache for instance {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 16:04:11 user nova-compute[75176]: DEBUG nova.network.neutron [-] [instance: 726344c0-a0dc-48d5-a18f-8a258ebde87d] Updating instance_info_cache with network_info: [] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 16:04:11 user nova-compute[75176]: INFO nova.compute.manager [-] [instance: 726344c0-a0dc-48d5-a18f-8a258ebde87d] Took 0.96 seconds to deallocate network for instance.
Nov 28 16:04:12 user nova-compute[75176]: DEBUG nova.network.neutron [None req-0aa7ec99-7a17-4fee-8dad-b7f0d6b9e2d3 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: 1062234d-4890-46df-bb52-49c55b4af32b] Updating instance_info_cache with network_info: [{"id": "3dd39a62-ef9c-4870-be88-578e41ff5013", "address": "fa:16:3e:10:e7:45", "network": {"id": "998766cd-2e8e-4e39-add9-286086640993", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-989265510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf05c8836b8a40de8e64c2d046ed71ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dd39a62-ef", "ovs_interfaceid": "3dd39a62-ef9c-4870-be88-578e41ff5013", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 16:04:12 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-0aa7ec99-7a17-4fee-8dad-b7f0d6b9e2d3 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Releasing lock "refresh_cache-1062234d-4890-46df-bb52-49c55b4af32b" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 16:04:12 user nova-compute[75176]: DEBUG nova.objects.instance [None req-0aa7ec99-7a17-4fee-8dad-b7f0d6b9e2d3 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Lazy-loading 'flavor' on Instance uuid 1062234d-4890-46df-bb52-49c55b4af32b {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 16:04:12 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-3b2fbee8-301c-4285-b43e-07464e1f26cf tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:04:12 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-3b2fbee8-301c-4285-b43e-07464e1f26cf tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:04:12 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:04:12 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:04:12 user nova-compute[75176]: DEBUG nova.compute.provider_tree [None req-3b2fbee8-301c-4285-b43e-07464e1f26cf tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Inventory has not changed in ProviderTree for provider: b37848d8-f401-4155-a029-b0ffa09ff85b {{(pid=75176) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 16:04:12 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-3b2fbee8-301c-4285-b43e-07464e1f26cf tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Inventory has not changed for provider b37848d8-f401-4155-a029-b0ffa09ff85b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75176) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 16:04:12 user nova-compute[75176]: DEBUG nova.compute.manager [req-465251e0-c62e-4d13-9854-f89e4c38c4d3 req-68c868ff-867d-44df-8d1c-f27bab4c9587 service nova] [instance: 1062234d-4890-46df-bb52-49c55b4af32b] Received event network-vif-unplugged-3dd39a62-ef9c-4870-be88-578e41ff5013 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 16:04:12 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-465251e0-c62e-4d13-9854-f89e4c38c4d3 req-68c868ff-867d-44df-8d1c-f27bab4c9587 service nova] Acquiring lock "1062234d-4890-46df-bb52-49c55b4af32b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:04:12 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-465251e0-c62e-4d13-9854-f89e4c38c4d3 req-68c868ff-867d-44df-8d1c-f27bab4c9587 service nova] Lock "1062234d-4890-46df-bb52-49c55b4af32b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:04:12 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-465251e0-c62e-4d13-9854-f89e4c38c4d3 req-68c868ff-867d-44df-8d1c-f27bab4c9587 service nova] Lock "1062234d-4890-46df-bb52-49c55b4af32b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:04:12 user nova-compute[75176]: DEBUG nova.compute.manager [req-465251e0-c62e-4d13-9854-f89e4c38c4d3 req-68c868ff-867d-44df-8d1c-f27bab4c9587 service nova] [instance: 1062234d-4890-46df-bb52-49c55b4af32b] No waiting events found dispatching network-vif-unplugged-3dd39a62-ef9c-4870-be88-578e41ff5013 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 16:04:12 user nova-compute[75176]: WARNING nova.compute.manager [req-465251e0-c62e-4d13-9854-f89e4c38c4d3 req-68c868ff-867d-44df-8d1c-f27bab4c9587 service nova] [instance: 1062234d-4890-46df-bb52-49c55b4af32b] Received unexpected event network-vif-unplugged-3dd39a62-ef9c-4870-be88-578e41ff5013 for instance with vm_state rescued and task_state unrescuing.
Nov 28 16:04:12 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-3b2fbee8-301c-4285-b43e-07464e1f26cf tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.300s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:04:12 user nova-compute[75176]: INFO nova.scheduler.client.report [None req-3b2fbee8-301c-4285-b43e-07464e1f26cf tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Deleted allocations for instance 726344c0-a0dc-48d5-a18f-8a258ebde87d
Nov 28 16:04:12 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:04:12 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:04:12 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-3b2fbee8-301c-4285-b43e-07464e1f26cf tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Lock "726344c0-a0dc-48d5-a18f-8a258ebde87d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.299s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:04:12 user nova-compute[75176]: DEBUG nova.compute.manager [req-ac376988-bb3b-4365-9358-ccd5d1d3fbe4 req-58520a55-851f-4ef4-a134-ce11e6c76ddc service nova] [instance: 726344c0-a0dc-48d5-a18f-8a258ebde87d] Received event network-vif-plugged-966907f1-2c5f-4c34-b155-b1b3b4176f5f {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 16:04:12 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-ac376988-bb3b-4365-9358-ccd5d1d3fbe4 req-58520a55-851f-4ef4-a134-ce11e6c76ddc service nova] Acquiring lock "726344c0-a0dc-48d5-a18f-8a258ebde87d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:04:12 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-ac376988-bb3b-4365-9358-ccd5d1d3fbe4 req-58520a55-851f-4ef4-a134-ce11e6c76ddc service nova] Lock "726344c0-a0dc-48d5-a18f-8a258ebde87d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:04:12 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-ac376988-bb3b-4365-9358-ccd5d1d3fbe4 req-58520a55-851f-4ef4-a134-ce11e6c76ddc service nova] Lock "726344c0-a0dc-48d5-a18f-8a258ebde87d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:04:12 user nova-compute[75176]: DEBUG nova.compute.manager [req-ac376988-bb3b-4365-9358-ccd5d1d3fbe4 req-58520a55-851f-4ef4-a134-ce11e6c76ddc service nova] [instance: 726344c0-a0dc-48d5-a18f-8a258ebde87d] No waiting events found dispatching network-vif-plugged-966907f1-2c5f-4c34-b155-b1b3b4176f5f {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 16:04:12 user nova-compute[75176]: WARNING nova.compute.manager [req-ac376988-bb3b-4365-9358-ccd5d1d3fbe4 req-58520a55-851f-4ef4-a134-ce11e6c76ddc service nova] [instance: 726344c0-a0dc-48d5-a18f-8a258ebde87d] Received unexpected event network-vif-plugged-966907f1-2c5f-4c34-b155-b1b3b4176f5f for instance with vm_state deleted and task_state None.
Nov 28 16:04:12 user nova-compute[75176]: DEBUG nova.compute.manager [req-ac376988-bb3b-4365-9358-ccd5d1d3fbe4 req-58520a55-851f-4ef4-a134-ce11e6c76ddc service nova] [instance: 726344c0-a0dc-48d5-a18f-8a258ebde87d] Received event network-vif-deleted-966907f1-2c5f-4c34-b155-b1b3b4176f5f {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 16:04:12 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:04:12 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:04:12 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:04:12 user nova-compute[75176]: INFO nova.virt.libvirt.driver [-] [instance: 1062234d-4890-46df-bb52-49c55b4af32b] Instance destroyed successfully.
Nov 28 16:04:14 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:04:14 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:04:14 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:04:14 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:04:14 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:04:14 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:04:14 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:04:14 user nova-compute[75176]: DEBUG nova.compute.manager [req-89660f4c-b406-462f-8f1b-7e092bf19df2 req-10adb435-357f-46cf-8aa5-d11e5912e10c service nova] [instance: 1062234d-4890-46df-bb52-49c55b4af32b] Received event network-vif-plugged-3dd39a62-ef9c-4870-be88-578e41ff5013 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 16:04:14 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-89660f4c-b406-462f-8f1b-7e092bf19df2 req-10adb435-357f-46cf-8aa5-d11e5912e10c service nova] Acquiring lock "1062234d-4890-46df-bb52-49c55b4af32b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:04:14 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-89660f4c-b406-462f-8f1b-7e092bf19df2 req-10adb435-357f-46cf-8aa5-d11e5912e10c service nova] Lock "1062234d-4890-46df-bb52-49c55b4af32b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:04:14 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-89660f4c-b406-462f-8f1b-7e092bf19df2 req-10adb435-357f-46cf-8aa5-d11e5912e10c service nova] Lock "1062234d-4890-46df-bb52-49c55b4af32b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:04:14 user nova-compute[75176]: DEBUG nova.compute.manager [req-89660f4c-b406-462f-8f1b-7e092bf19df2 req-10adb435-357f-46cf-8aa5-d11e5912e10c service nova] [instance: 1062234d-4890-46df-bb52-49c55b4af32b] No waiting events found dispatching network-vif-plugged-3dd39a62-ef9c-4870-be88-578e41ff5013 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 16:04:14 user nova-compute[75176]: WARNING nova.compute.manager [req-89660f4c-b406-462f-8f1b-7e092bf19df2 req-10adb435-357f-46cf-8aa5-d11e5912e10c service nova] [instance: 1062234d-4890-46df-bb52-49c55b4af32b] Received unexpected event network-vif-plugged-3dd39a62-ef9c-4870-be88-578e41ff5013 for instance with vm_state rescued and task_state unrescuing.
Nov 28 16:04:14 user nova-compute[75176]: DEBUG nova.compute.manager [req-89660f4c-b406-462f-8f1b-7e092bf19df2 req-10adb435-357f-46cf-8aa5-d11e5912e10c service nova] [instance: 1062234d-4890-46df-bb52-49c55b4af32b] Received event network-vif-plugged-3dd39a62-ef9c-4870-be88-578e41ff5013 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 16:04:14 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-89660f4c-b406-462f-8f1b-7e092bf19df2 req-10adb435-357f-46cf-8aa5-d11e5912e10c service nova] Acquiring lock "1062234d-4890-46df-bb52-49c55b4af32b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:04:14 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-89660f4c-b406-462f-8f1b-7e092bf19df2 req-10adb435-357f-46cf-8aa5-d11e5912e10c service nova] Lock "1062234d-4890-46df-bb52-49c55b4af32b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:04:14 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-89660f4c-b406-462f-8f1b-7e092bf19df2 req-10adb435-357f-46cf-8aa5-d11e5912e10c service nova] Lock "1062234d-4890-46df-bb52-49c55b4af32b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:04:14 user nova-compute[75176]: DEBUG nova.compute.manager [req-89660f4c-b406-462f-8f1b-7e092bf19df2 req-10adb435-357f-46cf-8aa5-d11e5912e10c service nova] [instance: 1062234d-4890-46df-bb52-49c55b4af32b] No waiting events found dispatching network-vif-plugged-3dd39a62-ef9c-4870-be88-578e41ff5013 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 16:04:14 user nova-compute[75176]: WARNING nova.compute.manager [req-89660f4c-b406-462f-8f1b-7e092bf19df2 req-10adb435-357f-46cf-8aa5-d11e5912e10c service nova] [instance: 1062234d-4890-46df-bb52-49c55b4af32b] Received unexpected event network-vif-plugged-3dd39a62-ef9c-4870-be88-578e41ff5013 for instance with vm_state rescued and task_state unrescuing.
Nov 28 16:04:14 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:04:15 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:04:16 user nova-compute[75176]: DEBUG nova.compute.manager [None req-0aa7ec99-7a17-4fee-8dad-b7f0d6b9e2d3 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: 1062234d-4890-46df-bb52-49c55b4af32b] Checking state {{(pid=75176) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 16:04:16 user nova-compute[75176]: DEBUG nova.compute.manager [req-30fb833e-4854-4260-8841-6f7ed4f0dd95 req-b9c27dd9-51df-46ee-bae5-e991842237c0 service nova] [instance: 1062234d-4890-46df-bb52-49c55b4af32b] Received event network-vif-plugged-3dd39a62-ef9c-4870-be88-578e41ff5013 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 16:04:16 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-30fb833e-4854-4260-8841-6f7ed4f0dd95 req-b9c27dd9-51df-46ee-bae5-e991842237c0 service nova] Acquiring lock "1062234d-4890-46df-bb52-49c55b4af32b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:04:16 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-30fb833e-4854-4260-8841-6f7ed4f0dd95 req-b9c27dd9-51df-46ee-bae5-e991842237c0 service nova] Lock "1062234d-4890-46df-bb52-49c55b4af32b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:04:16 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-30fb833e-4854-4260-8841-6f7ed4f0dd95 req-b9c27dd9-51df-46ee-bae5-e991842237c0 service nova] Lock "1062234d-4890-46df-bb52-49c55b4af32b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:04:16 user nova-compute[75176]: DEBUG nova.compute.manager [req-30fb833e-4854-4260-8841-6f7ed4f0dd95 req-b9c27dd9-51df-46ee-bae5-e991842237c0 service nova] [instance: 1062234d-4890-46df-bb52-49c55b4af32b] No waiting events found dispatching network-vif-plugged-3dd39a62-ef9c-4870-be88-578e41ff5013 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 16:04:16 user nova-compute[75176]: WARNING nova.compute.manager [req-30fb833e-4854-4260-8841-6f7ed4f0dd95 req-b9c27dd9-51df-46ee-bae5-e991842237c0 service nova] [instance: 1062234d-4890-46df-bb52-49c55b4af32b] Received unexpected event network-vif-plugged-3dd39a62-ef9c-4870-be88-578e41ff5013 for instance with vm_state active and task_state None.
Nov 28 16:04:16 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:04:16 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:04:16 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:04:16 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:04:16 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Auditing locally available compute resources for user (node: user) {{(pid=75176) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 16:04:16 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75176) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 16:04:16 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55febf04-14ea-4903-8692-c7cc6115de75/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:04:17 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55febf04-14ea-4903-8692-c7cc6115de75/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:04:17 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55febf04-14ea-4903-8692-c7cc6115de75/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:04:17 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55febf04-14ea-4903-8692-c7cc6115de75/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:04:17 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c6a4729-9d51-4ebf-bad6-2022f35cbe3b/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:04:17 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c6a4729-9d51-4ebf-bad6-2022f35cbe3b/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:04:17 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c6a4729-9d51-4ebf-bad6-2022f35cbe3b/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:04:17 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c6a4729-9d51-4ebf-bad6-2022f35cbe3b/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:04:17 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75176) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 16:04:17 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecf38787-0a69-4f35-b121-3dc6e70023a1/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:04:17 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecf38787-0a69-4f35-b121-3dc6e70023a1/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:04:17 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecf38787-0a69-4f35-b121-3dc6e70023a1/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:04:17 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecf38787-0a69-4f35-b121-3dc6e70023a1/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:04:17 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75176) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 16:04:17 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66ead7d-98f4-4822-9dce-f2ea0206a58d/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:04:18 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66ead7d-98f4-4822-9dce-f2ea0206a58d/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:04:18 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66ead7d-98f4-4822-9dce-f2ea0206a58d/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:04:18 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66ead7d-98f4-4822-9dce-f2ea0206a58d/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:04:18 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7/disk.rescue --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:04:18 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:04:18 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7/disk.rescue --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:04:18 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:04:18 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:04:18 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:04:18 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:04:19 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:04:19 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 16:04:19 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 16:04:19 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Hypervisor/Node resource view: name=user free_ram=8559MB free_disk=24.792179107666016GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75176) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 16:04:19 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:04:19 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:04:19 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance f66ead7d-98f4-4822-9dce-f2ea0206a58d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 16:04:19 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance 55febf04-14ea-4903-8692-c7cc6115de75 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 16:04:19 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance 8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 16:04:19 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance dc4e6d39-adfb-4d26-afef-46f316ff7846 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 16:04:19 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance ecf38787-0a69-4f35-b121-3dc6e70023a1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 16:04:19 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance 1062234d-4890-46df-bb52-49c55b4af32b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 16:04:19 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance 6c6a4729-9d51-4ebf-bad6-2022f35cbe3b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 16:04:19 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75176) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 16:04:19 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75176) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 16:04:19 user nova-compute[75176]: DEBUG nova.compute.provider_tree [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Inventory has not changed in ProviderTree for provider: b37848d8-f401-4155-a029-b0ffa09ff85b {{(pid=75176) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 16:04:19 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Inventory has not changed for provider b37848d8-f401-4155-a029-b0ffa09ff85b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75176) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 16:04:19 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Compute_service record updated for user:user {{(pid=75176) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 16:04:19 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.352s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:04:20 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 16:04:25 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:04:29 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:04:30 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:04:34 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:04:35 user nova-compute[75176]: DEBUG nova.objects.instance [None req-fdb6dc63-0baa-4744-b9c9-16c363936593 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Lazy-loading 'flavor' on Instance uuid 6c6a4729-9d51-4ebf-bad6-2022f35cbe3b {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 16:04:35 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-fdb6dc63-0baa-4744-b9c9-16c363936593 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Acquiring lock "refresh_cache-6c6a4729-9d51-4ebf-bad6-2022f35cbe3b" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 16:04:35 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-fdb6dc63-0baa-4744-b9c9-16c363936593 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Acquired lock "refresh_cache-6c6a4729-9d51-4ebf-bad6-2022f35cbe3b" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 16:04:35 user nova-compute[75176]: DEBUG nova.network.neutron [None req-fdb6dc63-0baa-4744-b9c9-16c363936593 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] [instance: 6c6a4729-9d51-4ebf-bad6-2022f35cbe3b] Building network info cache for instance {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 16:04:35 user nova-compute[75176]: DEBUG nova.objects.instance [None req-fdb6dc63-0baa-4744-b9c9-16c363936593 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Lazy-loading 'info_cache' on Instance uuid 6c6a4729-9d51-4ebf-bad6-2022f35cbe3b {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 16:04:35 user nova-compute[75176]: DEBUG nova.objects.base [None req-fdb6dc63-0baa-4744-b9c9-16c363936593 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Object Instance<6c6a4729-9d51-4ebf-bad6-2022f35cbe3b> lazy-loaded attributes: flavor,info_cache {{(pid=75176) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 16:04:35 user nova-compute[75176]: DEBUG nova.network.neutron [None req-fdb6dc63-0baa-4744-b9c9-16c363936593 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] [instance: 6c6a4729-9d51-4ebf-bad6-2022f35cbe3b] Updating instance_info_cache with network_info: [{"id": "85a1de78-2430-4835-8122-95570636e300", "address": "fa:16:3e:f4:49:91", "network": {"id": "9faaeac5-1688-436d-90fb-38bb1c4d3da4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1225296735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6aab7b19b9414b5da476b87e144cc40b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85a1de78-24", "ovs_interfaceid": "85a1de78-2430-4835-8122-95570636e300", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 16:04:35 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-fdb6dc63-0baa-4744-b9c9-16c363936593 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Releasing lock "refresh_cache-6c6a4729-9d51-4ebf-bad6-2022f35cbe3b" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 16:04:35 user nova-compute[75176]: INFO nova.virt.libvirt.driver [-] [instance: 6c6a4729-9d51-4ebf-bad6-2022f35cbe3b] Instance destroyed successfully.
Nov 28 16:04:35 user nova-compute[75176]: DEBUG nova.objects.instance [None req-fdb6dc63-0baa-4744-b9c9-16c363936593 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Lazy-loading 'resources' on Instance uuid 6c6a4729-9d51-4ebf-bad6-2022f35cbe3b {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 16:04:35 user nova-compute[75176]: DEBUG nova.objects.base [None req-fdb6dc63-0baa-4744-b9c9-16c363936593 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Object Instance<6c6a4729-9d51-4ebf-bad6-2022f35cbe3b> lazy-loaded attributes: flavor,info_cache,resources {{(pid=75176) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 16:04:35 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-fdb6dc63-0baa-4744-b9c9-16c363936593 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T16:00:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-691561062',display_name='tempest-AttachVolumeTestJSON-server-691561062',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-691561062',id=48,image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD9HYYuhew+HwSlGLCtnm5QU3CE4PWqBzdirX5E0yDwA3ZIjV/d7lqYB/DPfiezleSueBjZ4jvmSISqP2Nc+aT8uhbuWQyy+x6kGVNBbHAicQWf8CVd+FflN0YxTFd39NA==',key_name='tempest-keypair-1245727303',keypairs=<?>,launch_index=0,launched_at=2023-11-28T16:00:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='6aab7b19b9414b5da476b87e144cc40b',ramdisk_id='',reservation_id='r-m99ag9fz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-365725655',owner_user_name='tempest-AttachVolumeTestJSON-365725655-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T16:02:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='60b513cfc58647d49fc084d51964a4c6',uuid=6c6a4729-9d51-4ebf-bad6-2022f35cbe3b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "85a1de78-2430-4835-8122-95570636e300", "address": "fa:16:3e:f4:49:91", "network": {"id": "9faaeac5-1688-436d-90fb-38bb1c4d3da4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1225296735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6aab7b19b9414b5da476b87e144cc40b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85a1de78-24", "ovs_interfaceid": "85a1de78-2430-4835-8122-95570636e300", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 16:04:35 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-fdb6dc63-0baa-4744-b9c9-16c363936593 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Converting VIF {"id": "85a1de78-2430-4835-8122-95570636e300", "address": "fa:16:3e:f4:49:91", "network": {"id": "9faaeac5-1688-436d-90fb-38bb1c4d3da4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1225296735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6aab7b19b9414b5da476b87e144cc40b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85a1de78-24", "ovs_interfaceid": "85a1de78-2430-4835-8122-95570636e300", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 16:04:35 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-fdb6dc63-0baa-4744-b9c9-16c363936593 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:49:91,bridge_name='br-int',has_traffic_filtering=True,id=85a1de78-2430-4835-8122-95570636e300,network=Network(9faaeac5-1688-436d-90fb-38bb1c4d3da4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85a1de78-24') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 16:04:35 user nova-compute[75176]: DEBUG os_vif [None req-fdb6dc63-0baa-4744-b9c9-16c363936593 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:49:91,bridge_name='br-int',has_traffic_filtering=True,id=85a1de78-2430-4835-8122-95570636e300,network=Network(9faaeac5-1688-436d-90fb-38bb1c4d3da4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85a1de78-24') {{(pid=75176) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 16:04:35 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:04:35 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap85a1de78-24, bridge=br-int, if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 16:04:35 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:04:35 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 16:04:35 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:04:35 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0fb3a802-1538-4aa2-8401-cd9d475648c1) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 16:04:35 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:04:35 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:04:35 user nova-compute[75176]: INFO os_vif [None req-fdb6dc63-0baa-4744-b9c9-16c363936593 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:49:91,bridge_name='br-int',has_traffic_filtering=True,id=85a1de78-2430-4835-8122-95570636e300,network=Network(9faaeac5-1688-436d-90fb-38bb1c4d3da4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85a1de78-24')
Nov 28 16:04:35 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fdb6dc63-0baa-4744-b9c9-16c363936593 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] [instance: 6c6a4729-9d51-4ebf-bad6-2022f35cbe3b] calling os-brick to detach iSCSI Volume {{(pid=75176) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 16:04:35 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdb6dc63-0baa-4744-b9c9-16c363936593 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c1b8a00>, {'target_iqn': 'iqn.2010-10.org.openstack:3676a213-38f2-4682-a210-16696ea2f6ad', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aoEkygwO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 16:04:35 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-fdb6dc63-0baa-4744-b9c9-16c363936593 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 16:04:35 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-fdb6dc63-0baa-4744-b9c9-16c363936593 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 16:04:35 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-fdb6dc63-0baa-4744-b9c9-16c363936593 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 16:04:35 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:04:35 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:04:35 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[85075289-b79f-467a-9f91-5e3abd552fa6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3676a213-38f2-4682-a210-16696ea2f6ad\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6ec9410d-747d-475e-999c-672f87917a20\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:04:35 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdb6dc63-0baa-4744-b9c9-16c363936593 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 16:04:35 user nova-compute[75176]: No targets found.
Nov 28 16:04:35 user nova-compute[75176]: iSNS:
Nov 28 16:04:35 user nova-compute[75176]: No targets found.
Nov 28 16:04:35 user nova-compute[75176]: STATIC:
Nov 28 16:04:35 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:3676a213-38f2-4682-a210-16696ea2f6ad
Nov 28 16:04:35 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 16:04:35 user nova-compute[75176]:                 Iface Name: default
Nov 28 16:04:35 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6
Nov 28 16:04:35 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 16:04:35 user nova-compute[75176]:                 Iface Name: default
Nov 28 16:04:35 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:6ec9410d-747d-475e-999c-672f87917a20
Nov 28 16:04:35 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 16:04:35 user nova-compute[75176]:                 Iface Name: default
Nov 28 16:04:35 user nova-compute[75176]: FIRMWARE:
Nov 28 16:04:35 user nova-compute[75176]: No targets found.
Nov 28 16:04:35 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 16:04:35 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdb6dc63-0baa-4744-b9c9-16c363936593 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 16:04:35 user nova-compute[75176]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 16:04:35 user nova-compute[75176]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75176) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 16:04:35 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdb6dc63-0baa-4744-b9c9-16c363936593 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3676a213-38f2-4682-a210-16696ea2f6ad', 0)] {{(pid=75176) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 16:04:35 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:04:35 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:04:35 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb3d20ff-d54f-41e5-bc9a-30134c88c519]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3676a213-38f2-4682-a210-16696ea2f6ad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ec9410d-747d-475e-999c-672f87917a20\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:04:35 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:04:35 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:04:35 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[92fdee30-9133-41e9-bdc4-e59353596abe]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ec9410d-747d-475e-999c-672f87917a20 (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3676a213-38f2-4682-a210-16696ea2f6ad (non-flash)\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:04:35 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdb6dc63-0baa-4744-b9c9-16c363936593 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 (non-flash)
Nov 28 16:04:35 user nova-compute[75176]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ec9410d-747d-475e-999c-672f87917a20 (non-flash)
Nov 28 16:04:35 user nova-compute[75176]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3676a213-38f2-4682-a210-16696ea2f6ad (non-flash)
Nov 28 16:04:35 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 16:04:35 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdb6dc63-0baa-4744-b9c9-16c363936593 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 (non-flash)
Nov 28 16:04:35 user nova-compute[75176]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ec9410d-747d-475e-999c-672f87917a20 (non-flash)
Nov 28 16:04:35 user nova-compute[75176]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3676a213-38f2-4682-a210-16696ea2f6ad (non-flash)
Nov 28 16:04:35 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 16:04:35 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdb6dc63-0baa-4744-b9c9-16c363936593 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f464417caf0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3676a213-38f2-4682-a210-16696ea2f6ad'): ({'sdb'}, set())}) {{(pid=75176) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 16:04:35 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-fdb6dc63-0baa-4744-b9c9-16c363936593 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Removing single pathed devices sdb {{(pid=75176) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 16:04:35 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:04:35 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:04:35 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[a10b15d7-3a7e-4e02-90fa-001586a5f71d]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:04:35 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:04:35 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:04:35 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[b93831ee-ab46-407a-8190-8549460441b9]: (4, ('ok\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:04:35 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-fdb6dc63-0baa-4744-b9c9-16c363936593 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Flushing IO for device /dev/sdb {{(pid=75176) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 16:04:35 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:04:35 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:04:35 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[d94dc0d2-ea8b-4181-bdf8-61a34aeb2f4f]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:04:35 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-fdb6dc63-0baa-4744-b9c9-16c363936593 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75176) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 16:04:35 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:04:36 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.034s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:04:36 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[030cc8c4-b443-48a0-aeba-402763137167]: (4, ('1', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:04:36 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-fdb6dc63-0baa-4744-b9c9-16c363936593 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75176) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 16:04:36 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-fdb6dc63-0baa-4744-b9c9-16c363936593 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] SCSI volumes sdb have been removed. {{(pid=75176) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 16:04:36 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdb6dc63-0baa-4744-b9c9-16c363936593 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3676a213-38f2-4682-a210-16696ea2f6ad')] {{(pid=75176) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 16:04:36 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3676a213-38f2-4682-a210-16696ea2f6ad -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:04:36 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3676a213-38f2-4682-a210-16696ea2f6ad -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:04:36 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d584bc2-1910-4f17-b1e2-d0685bc765a2]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:04:36 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdb6dc63-0baa-4744-b9c9-16c363936593 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 16:04:36 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3676a213-38f2-4682-a210-16696ea2f6ad -p 172.16.0.220:3260 --logout {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:04:36 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3676a213-38f2-4682-a210-16696ea2f6ad -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:04:36 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[674c7a16-e7b4-42e7-803e-4c1f824ffb92]: (4, ('Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:3676a213-38f2-4682-a210-16696ea2f6ad, portal: 172.16.0.220,3260]\nLogout of [sid: 59, target: iqn.2010-10.org.openstack:3676a213-38f2-4682-a210-16696ea2f6ad, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:04:36 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdb6dc63-0baa-4744-b9c9-16c363936593 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:3676a213-38f2-4682-a210-16696ea2f6ad, portal: 172.16.0.220,3260]
Nov 28 16:04:36 user nova-compute[75176]: Logout of [sid: 59, target: iqn.2010-10.org.openstack:3676a213-38f2-4682-a210-16696ea2f6ad, portal: 172.16.0.220,3260] successful.
Nov 28 16:04:36 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 16:04:36 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3676a213-38f2-4682-a210-16696ea2f6ad -p 172.16.0.220:3260 --op delete {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:04:36 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3676a213-38f2-4682-a210-16696ea2f6ad -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:04:36 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[b459f35a-f3fe-4a6f-bf17-22b7182f8ad6]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:04:36 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdb6dc63-0baa-4744-b9c9-16c363936593 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 16:04:36 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-fdb6dc63-0baa-4744-b9c9-16c363936593 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.294s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 16:04:36 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdb6dc63-0baa-4744-b9c9-16c363936593 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] <== disconnect_volume: return (296ms) None {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 16:04:36 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fdb6dc63-0baa-4744-b9c9-16c363936593 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] [instance: 6c6a4729-9d51-4ebf-bad6-2022f35cbe3b] Disconnected iSCSI Volume {{(pid=75176) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 16:04:36 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-fdb6dc63-0baa-4744-b9c9-16c363936593 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] [instance: 6c6a4729-9d51-4ebf-bad6-2022f35cbe3b] Start _get_guest_xml network_info=[{"id": "85a1de78-2430-4835-8122-95570636e300", "address": "fa:16:3e:f4:49:91", "network": {"id": "9faaeac5-1688-436d-90fb-38bb1c4d3da4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1225296735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6aab7b19b9414b5da476b87e144cc40b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85a1de78-24", "ovs_interfaceid": "85a1de78-2430-4835-8122-95570636e300", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=1f41819e-c93f-4dc7-b253-37a27bbbbc74,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'size': 0, 'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'image_id': '1f41819e-c93f-4dc7-b253-37a27bbbbc74'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3676a213-38f2-4682-a210-16696ea2f6ad', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aoEkygwO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '6c6a4729-9d51-4ebf-bad6-2022f35cbe3b', 'attached_at': '', 'detached_at': '', 'volume_id': '3676a213-38f2-4682-a210-16696ea2f6ad', 'serial': '3676a213-38f2-4682-a210-16696ea2f6ad'}, 'guest_format': None, 'device_type': 'disk', 'boot_index': None, 'disk_bus': 'virtio', 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'attachment_id': 'cb00e08b-5ee1-4c5b-8502-09a3b9ac4586', 'volume_type': None} {{(pid=75176) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 16:04:36 user nova-compute[75176]: DEBUG nova.objects.instance [None req-fdb6dc63-0baa-4744-b9c9-16c363936593 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Lazy-loading 'numa_topology' on Instance uuid 6c6a4729-9d51-4ebf-bad6-2022f35cbe3b {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 16:04:36 user nova-compute[75176]: DEBUG nova.objects.base [None req-fdb6dc63-0baa-4744-b9c9-16c363936593 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Object Instance<6c6a4729-9d51-4ebf-bad6-2022f35cbe3b> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=75176) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 16:04:36 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-fdb6dc63-0baa-4744-b9c9-16c363936593 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 16:04:36 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-fdb6dc63-0baa-4744-b9c9-16c363936593 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 16:04:36 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-fdb6dc63-0baa-4744-b9c9-16c363936593 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75176) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 16:04:36 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-fdb6dc63-0baa-4744-b9c9-16c363936593 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] CPU controller missing on host. {{(pid=75176) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 16:04:36 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-fdb6dc63-0baa-4744-b9c9-16c363936593 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75176) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 16:04:36 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-fdb6dc63-0baa-4744-b9c9-16c363936593 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] CPU controller found on host. {{(pid=75176) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 16:04:36 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-fdb6dc63-0baa-4744-b9c9-16c363936593 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75176) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 16:04:36 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-fdb6dc63-0baa-4744-b9c9-16c363936593 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T15:35:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=1f41819e-c93f-4dc7-b253-37a27bbbbc74,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 16:04:36 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-fdb6dc63-0baa-4744-b9c9-16c363936593 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Flavor limits 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 16:04:36 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-fdb6dc63-0baa-4744-b9c9-16c363936593 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Image limits 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 16:04:36 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-fdb6dc63-0baa-4744-b9c9-16c363936593 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Flavor pref 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 16:04:36 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-fdb6dc63-0baa-4744-b9c9-16c363936593 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Image pref 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 16:04:36 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-fdb6dc63-0baa-4744-b9c9-16c363936593 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 16:04:36 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-fdb6dc63-0baa-4744-b9c9-16c363936593 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 16:04:36 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-fdb6dc63-0baa-4744-b9c9-16c363936593 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75176) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 16:04:36 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-fdb6dc63-0baa-4744-b9c9-16c363936593 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Got 1 possible topologies {{(pid=75176) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 16:04:36 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-fdb6dc63-0baa-4744-b9c9-16c363936593 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 16:04:36 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-fdb6dc63-0baa-4744-b9c9-16c363936593 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 16:04:36 user nova-compute[75176]: DEBUG nova.objects.instance [None req-fdb6dc63-0baa-4744-b9c9-16c363936593 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Lazy-loading 'vcpu_model' on Instance uuid 6c6a4729-9d51-4ebf-bad6-2022f35cbe3b {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 16:04:36 user nova-compute[75176]: DEBUG nova.objects.base [None req-fdb6dc63-0baa-4744-b9c9-16c363936593 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Object Instance<6c6a4729-9d51-4ebf-bad6-2022f35cbe3b> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=75176) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 16:04:36 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fdb6dc63-0baa-4744-b9c9-16c363936593 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] [instance: 6c6a4729-9d51-4ebf-bad6-2022f35cbe3b] Calling os-brick to attach iSCSI Volume {{(pid=75176) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 16:04:36 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdb6dc63-0baa-4744-b9c9-16c363936593 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c1b8a00>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3676a213-38f2-4682-a210-16696ea2f6ad', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aoEkygwO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 16:04:36 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-fdb6dc63-0baa-4744-b9c9-16c363936593 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 16:04:36 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-fdb6dc63-0baa-4744-b9c9-16c363936593 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 16:04:36 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-fdb6dc63-0baa-4744-b9c9-16c363936593 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 16:04:36 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-fdb6dc63-0baa-4744-b9c9-16c363936593 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 16:04:36 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-fdb6dc63-0baa-4744-b9c9-16c363936593 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3676a213-38f2-4682-a210-16696ea2f6ad" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 16:04:36 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-fdb6dc63-0baa-4744-b9c9-16c363936593 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3676a213-38f2-4682-a210-16696ea2f6ad" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 16:04:36 user nova-compute[75176]: INFO os_brick.initiator.connectors.iscsi [None req-fdb6dc63-0baa-4744-b9c9-16c363936593 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 16:04:36 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3676a213-38f2-4682-a210-16696ea2f6ad -p 172.16.0.220:3260 {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:04:36 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3676a213-38f2-4682-a210-16696ea2f6ad -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:04:36 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cc9c182-64d3-491b-a10d-6fa73ac597ce]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:04:36 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdb6dc63-0baa-4744-b9c9-16c363936593 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 16:04:36 user nova-compute[75176]:  {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 16:04:36 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3676a213-38f2-4682-a210-16696ea2f6ad -p 172.16.0.220:3260 --interface default --op new {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:04:36 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3676a213-38f2-4682-a210-16696ea2f6ad -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:04:36 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[243ee682-e440-461c-9aed-7b63851eddf8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3676a213-38f2-4682-a210-16696ea2f6ad] added\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:04:36 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdb6dc63-0baa-4744-b9c9-16c363936593 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3676a213-38f2-4682-a210-16696ea2f6ad] added
Nov 28 16:04:36 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 16:04:36 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3676a213-38f2-4682-a210-16696ea2f6ad -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:04:36 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3676a213-38f2-4682-a210-16696ea2f6ad -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:04:36 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[f239441c-92ba-4e64-b36a-fcce1f768d85]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:04:36 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdb6dc63-0baa-4744-b9c9-16c363936593 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 16:04:36 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3676a213-38f2-4682-a210-16696ea2f6ad -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:04:36 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3676a213-38f2-4682-a210-16696ea2f6ad -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.036s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:04:36 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[3196c715-d654-4c8c-b47b-0c3c60a2e4a5]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:04:36 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdb6dc63-0baa-4744-b9c9-16c363936593 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 16:04:36 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3676a213-38f2-4682-a210-16696ea2f6ad -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aoEkygwO {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:04:36 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3676a213-38f2-4682-a210-16696ea2f6ad -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aoEkygwO" returned: 0 in 0.019s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:04:36 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[719e76c6-1bbe-42c2-9d9c-2e623aa871b5]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:04:36 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdb6dc63-0baa-4744-b9c9-16c363936593 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'aoEkygwO'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 16:04:36 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3676a213-38f2-4682-a210-16696ea2f6ad -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:04:36 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3676a213-38f2-4682-a210-16696ea2f6ad -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:04:36 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[da9c1fd5-9734-48f7-83cd-fdd31c994393]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:04:36 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdb6dc63-0baa-4744-b9c9-16c363936593 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 16:04:36 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:04:36 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:04:36 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee7ef1ee-2011-43ab-a726-648d1c71b713]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ec9410d-747d-475e-999c-672f87917a20 (non-flash)\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:04:36 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdb6dc63-0baa-4744-b9c9-16c363936593 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 (non-flash)
Nov 28 16:04:36 user nova-compute[75176]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ec9410d-747d-475e-999c-672f87917a20 (non-flash)
Nov 28 16:04:36 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 16:04:36 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdb6dc63-0baa-4744-b9c9-16c363936593 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 (non-flash)
Nov 28 16:04:36 user nova-compute[75176]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ec9410d-747d-475e-999c-672f87917a20 (non-flash)
Nov 28 16:04:36 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 16:04:36 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3676a213-38f2-4682-a210-16696ea2f6ad -p 172.16.0.220:3260 --login {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:04:36 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3676a213-38f2-4682-a210-16696ea2f6ad -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:04:36 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[89af93d9-6419-4748-8343-1c5323ca6eae]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3676a213-38f2-4682-a210-16696ea2f6ad, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3676a213-38f2-4682-a210-16696ea2f6ad, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:04:36 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdb6dc63-0baa-4744-b9c9-16c363936593 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3676a213-38f2-4682-a210-16696ea2f6ad, portal: 172.16.0.220,3260]
Nov 28 16:04:36 user nova-compute[75176]: Login to [iface: default, target: iqn.2010-10.org.openstack:3676a213-38f2-4682-a210-16696ea2f6ad, portal: 172.16.0.220,3260] successful.
Nov 28 16:04:36 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 16:04:36 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3676a213-38f2-4682-a210-16696ea2f6ad -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:04:36 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3676a213-38f2-4682-a210-16696ea2f6ad -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:04:36 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ef6eda6-8a45-4ba1-8e19-6f700e0bacfd]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:04:36 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdb6dc63-0baa-4744-b9c9-16c363936593 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 16:04:36 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:04:36 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:04:36 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[1896e767-25de-4771-942a-7a51d2b6d558]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ec9410d-747d-475e-999c-672f87917a20 (non-flash)\ntcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3676a213-38f2-4682-a210-16696ea2f6ad (non-flash)\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:04:36 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdb6dc63-0baa-4744-b9c9-16c363936593 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 (non-flash)
Nov 28 16:04:36 user nova-compute[75176]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ec9410d-747d-475e-999c-672f87917a20 (non-flash)
Nov 28 16:04:36 user nova-compute[75176]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3676a213-38f2-4682-a210-16696ea2f6ad (non-flash)
Nov 28 16:04:36 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 16:04:36 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdb6dc63-0baa-4744-b9c9-16c363936593 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 (non-flash)
Nov 28 16:04:36 user nova-compute[75176]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ec9410d-747d-475e-999c-672f87917a20 (non-flash)
Nov 28 16:04:36 user nova-compute[75176]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3676a213-38f2-4682-a210-16696ea2f6ad (non-flash)
Nov 28 16:04:36 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 16:04:36 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-fdb6dc63-0baa-4744-b9c9-16c363936593 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3676a213-38f2-4682-a210-16696ea2f6ad" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.299s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 16:04:36 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdb6dc63-0baa-4744-b9c9-16c363936593 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Connected to 172.16.0.220:3260 {{(pid=75176) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 16:04:36 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-fdb6dc63-0baa-4744-b9c9-16c363936593 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] HCTL ('33', '-', '-', 0) found on session 60 with lun 0 {{(pid=75176) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 16:04:36 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-fdb6dc63-0baa-4744-b9c9-16c363936593 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75176) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 16:04:36 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:04:36 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:04:36 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[79f903c2-3473-4963-a069-4b1d851d53fd]: (4, ('- - 0', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:04:36 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-fdb6dc63-0baa-4744-b9c9-16c363936593 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Searching for a device in session 60 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75176) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 16:04:36 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdb6dc63-0baa-4744-b9c9-16c363936593 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:3676a213-38f2-4682-a210-16696ea2f6ad', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aoEkygwO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75176) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 16:04:37 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-fdb6dc63-0baa-4744-b9c9-16c363936593 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.332s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 16:04:37 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdb6dc63-0baa-4744-b9c9-16c363936593 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] <== connect_volume: return (1333ms) {'type': 'block', 'scsi_wwn': '26666393732326131', 'path': '/dev/sdb'} {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 16:04:37 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fdb6dc63-0baa-4744-b9c9-16c363936593 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] [instance: 6c6a4729-9d51-4ebf-bad6-2022f35cbe3b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26666393732326131', 'path': '/dev/sdb'} {{(pid=75176) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 16:04:37 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-fdb6dc63-0baa-4744-b9c9-16c363936593 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T16:00:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-691561062',display_name='tempest-AttachVolumeTestJSON-server-691561062',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-691561062',id=48,image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD9HYYuhew+HwSlGLCtnm5QU3CE4PWqBzdirX5E0yDwA3ZIjV/d7lqYB/DPfiezleSueBjZ4jvmSISqP2Nc+aT8uhbuWQyy+x6kGVNBbHAicQWf8CVd+FflN0YxTFd39NA==',key_name='tempest-keypair-1245727303',keypairs=<?>,launch_index=0,launched_at=2023-11-28T16:00:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='6aab7b19b9414b5da476b87e144cc40b',ramdisk_id='',reservation_id='r-m99ag9fz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-365725655',owner_user_name='tempest-AttachVolumeTestJSON-365725655-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T16:02:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='60b513cfc58647d49fc084d51964a4c6',uuid=6c6a4729-9d51-4ebf-bad6-2022f35cbe3b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "85a1de78-2430-4835-8122-95570636e300", "address": "fa:16:3e:f4:49:91", "network": {"id": "9faaeac5-1688-436d-90fb-38bb1c4d3da4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1225296735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6aab7b19b9414b5da476b87e144cc40b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85a1de78-24", "ovs_interfaceid": "85a1de78-2430-4835-8122-95570636e300", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75176) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 16:04:37 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-fdb6dc63-0baa-4744-b9c9-16c363936593 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Converting VIF {"id": "85a1de78-2430-4835-8122-95570636e300", "address": "fa:16:3e:f4:49:91", "network": {"id": "9faaeac5-1688-436d-90fb-38bb1c4d3da4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1225296735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6aab7b19b9414b5da476b87e144cc40b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85a1de78-24", "ovs_interfaceid": "85a1de78-2430-4835-8122-95570636e300", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 16:04:37 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-fdb6dc63-0baa-4744-b9c9-16c363936593 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:49:91,bridge_name='br-int',has_traffic_filtering=True,id=85a1de78-2430-4835-8122-95570636e300,network=Network(9faaeac5-1688-436d-90fb-38bb1c4d3da4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85a1de78-24') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 16:04:37 user nova-compute[75176]: DEBUG nova.objects.instance [None req-fdb6dc63-0baa-4744-b9c9-16c363936593 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Lazy-loading 'pci_devices' on Instance uuid 6c6a4729-9d51-4ebf-bad6-2022f35cbe3b {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 16:04:37 user nova-compute[75176]: DEBUG nova.objects.base [None req-fdb6dc63-0baa-4744-b9c9-16c363936593 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Object Instance<6c6a4729-9d51-4ebf-bad6-2022f35cbe3b> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=75176) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 16:04:37 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-fdb6dc63-0baa-4744-b9c9-16c363936593 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] [instance: 6c6a4729-9d51-4ebf-bad6-2022f35cbe3b] End _get_guest_xml xml=<domain type="kvm">
Nov 28 16:04:37 user nova-compute[75176]:   <uuid>6c6a4729-9d51-4ebf-bad6-2022f35cbe3b</uuid>
Nov 28 16:04:37 user nova-compute[75176]:   <name>instance-00000030</name>
Nov 28 16:04:37 user nova-compute[75176]:   <memory>524288</memory>
Nov 28 16:04:37 user nova-compute[75176]:   <vcpu>1</vcpu>
Nov 28 16:04:37 user nova-compute[75176]:   <metadata>
Nov 28 16:04:37 user nova-compute[75176]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 16:04:37 user nova-compute[75176]:       <nova:package version="0.0.0"/>
Nov 28 16:04:37 user nova-compute[75176]:       <nova:name>tempest-AttachVolumeTestJSON-server-691561062</nova:name>
Nov 28 16:04:37 user nova-compute[75176]:       <nova:creationTime>2023-11-28 16:04:36</nova:creationTime>
Nov 28 16:04:37 user nova-compute[75176]:       <nova:flavor name="m1.tiny">
Nov 28 16:04:37 user nova-compute[75176]:         <nova:memory>512</nova:memory>
Nov 28 16:04:37 user nova-compute[75176]:         <nova:disk>1</nova:disk>
Nov 28 16:04:37 user nova-compute[75176]:         <nova:swap>0</nova:swap>
Nov 28 16:04:37 user nova-compute[75176]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 16:04:37 user nova-compute[75176]:         <nova:vcpus>1</nova:vcpus>
Nov 28 16:04:37 user nova-compute[75176]:       </nova:flavor>
Nov 28 16:04:37 user nova-compute[75176]:       <nova:owner>
Nov 28 16:04:37 user nova-compute[75176]:         <nova:user uuid="60b513cfc58647d49fc084d51964a4c6">tempest-AttachVolumeTestJSON-365725655-project-member</nova:user>
Nov 28 16:04:37 user nova-compute[75176]:         <nova:project uuid="6aab7b19b9414b5da476b87e144cc40b">tempest-AttachVolumeTestJSON-365725655</nova:project>
Nov 28 16:04:37 user nova-compute[75176]:       </nova:owner>
Nov 28 16:04:37 user nova-compute[75176]:       <nova:root type="image" uuid="1f41819e-c93f-4dc7-b253-37a27bbbbc74"/>
Nov 28 16:04:37 user nova-compute[75176]:       <nova:ports>
Nov 28 16:04:37 user nova-compute[75176]:         <nova:port uuid="85a1de78-2430-4835-8122-95570636e300">
Nov 28 16:04:37 user nova-compute[75176]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 28 16:04:37 user nova-compute[75176]:         </nova:port>
Nov 28 16:04:37 user nova-compute[75176]:       </nova:ports>
Nov 28 16:04:37 user nova-compute[75176]:     </nova:instance>
Nov 28 16:04:37 user nova-compute[75176]:   </metadata>
Nov 28 16:04:37 user nova-compute[75176]:   <sysinfo type="smbios">
Nov 28 16:04:37 user nova-compute[75176]:     <system>
Nov 28 16:04:37 user nova-compute[75176]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 16:04:37 user nova-compute[75176]:       <entry name="product">OpenStack Nova</entry>
Nov 28 16:04:37 user nova-compute[75176]:       <entry name="version">0.0.0</entry>
Nov 28 16:04:37 user nova-compute[75176]:       <entry name="serial">6c6a4729-9d51-4ebf-bad6-2022f35cbe3b</entry>
Nov 28 16:04:37 user nova-compute[75176]:       <entry name="uuid">6c6a4729-9d51-4ebf-bad6-2022f35cbe3b</entry>
Nov 28 16:04:37 user nova-compute[75176]:       <entry name="family">Virtual Machine</entry>
Nov 28 16:04:37 user nova-compute[75176]:     </system>
Nov 28 16:04:37 user nova-compute[75176]:   </sysinfo>
Nov 28 16:04:37 user nova-compute[75176]:   <os>
Nov 28 16:04:37 user nova-compute[75176]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 16:04:37 user nova-compute[75176]:     <boot dev="hd"/>
Nov 28 16:04:37 user nova-compute[75176]:     <smbios mode="sysinfo"/>
Nov 28 16:04:37 user nova-compute[75176]:   </os>
Nov 28 16:04:37 user nova-compute[75176]:   <features>
Nov 28 16:04:37 user nova-compute[75176]:     <acpi/>
Nov 28 16:04:37 user nova-compute[75176]:     <apic/>
Nov 28 16:04:37 user nova-compute[75176]:     <vmcoreinfo/>
Nov 28 16:04:37 user nova-compute[75176]:   </features>
Nov 28 16:04:37 user nova-compute[75176]:   <clock offset="utc">
Nov 28 16:04:37 user nova-compute[75176]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 16:04:37 user nova-compute[75176]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 16:04:37 user nova-compute[75176]:     <timer name="hpet" present="no"/>
Nov 28 16:04:37 user nova-compute[75176]:   </clock>
Nov 28 16:04:37 user nova-compute[75176]:   <cpu mode="custom" match="exact">
Nov 28 16:04:37 user nova-compute[75176]:     <model>Nehalem</model>
Nov 28 16:04:37 user nova-compute[75176]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 16:04:37 user nova-compute[75176]:   </cpu>
Nov 28 16:04:37 user nova-compute[75176]:   <devices>
Nov 28 16:04:37 user nova-compute[75176]:     <disk type="file" device="disk">
Nov 28 16:04:37 user nova-compute[75176]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 16:04:37 user nova-compute[75176]:       <source file="/opt/stack/data/nova/instances/6c6a4729-9d51-4ebf-bad6-2022f35cbe3b/disk"/>
Nov 28 16:04:37 user nova-compute[75176]:       <target dev="vda" bus="virtio"/>
Nov 28 16:04:37 user nova-compute[75176]:     </disk>
Nov 28 16:04:37 user nova-compute[75176]:     <disk type="block" device="disk">
Nov 28 16:04:37 user nova-compute[75176]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 16:04:37 user nova-compute[75176]:       <source dev="/dev/sdb"/>
Nov 28 16:04:37 user nova-compute[75176]:       <target dev="vdb" bus="virtio"/>
Nov 28 16:04:37 user nova-compute[75176]:       <serial>3676a213-38f2-4682-a210-16696ea2f6ad</serial>
Nov 28 16:04:37 user nova-compute[75176]:     </disk>
Nov 28 16:04:37 user nova-compute[75176]:     <interface type="ethernet">
Nov 28 16:04:37 user nova-compute[75176]:       <mac address="fa:16:3e:f4:49:91"/>
Nov 28 16:04:37 user nova-compute[75176]:       <model type="virtio"/>
Nov 28 16:04:37 user nova-compute[75176]:       <mtu size="1442"/>
Nov 28 16:04:37 user nova-compute[75176]:       <target dev="tap85a1de78-24"/>
Nov 28 16:04:37 user nova-compute[75176]:     </interface>
Nov 28 16:04:37 user nova-compute[75176]:     <serial type="pty">
Nov 28 16:04:37 user nova-compute[75176]:       <log file="/opt/stack/data/nova/instances/6c6a4729-9d51-4ebf-bad6-2022f35cbe3b/console.log" append="off"/>
Nov 28 16:04:37 user nova-compute[75176]:     </serial>
Nov 28 16:04:37 user nova-compute[75176]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 16:04:37 user nova-compute[75176]:     <video>
Nov 28 16:04:37 user nova-compute[75176]:       <model type="virtio"/>
Nov 28 16:04:37 user nova-compute[75176]:     </video>
Nov 28 16:04:37 user nova-compute[75176]:     <rng model="virtio">
Nov 28 16:04:37 user nova-compute[75176]:       <backend model="random">/dev/urandom</backend>
Nov 28 16:04:37 user nova-compute[75176]:     </rng>
Nov 28 16:04:37 user nova-compute[75176]:     <controller type="usb" index="0" model="none"/>
Nov 28 16:04:37 user nova-compute[75176]:     <memballoon model="virtio">
Nov 28 16:04:37 user nova-compute[75176]:       <stats period="10"/>
Nov 28 16:04:37 user nova-compute[75176]:     </memballoon>
Nov 28 16:04:37 user nova-compute[75176]:   </devices>
Nov 28 16:04:37 user nova-compute[75176]: </domain>
Nov 28 16:04:37 user nova-compute[75176]:  {{(pid=75176) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 16:04:37 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-fdb6dc63-0baa-4744-b9c9-16c363936593 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c6a4729-9d51-4ebf-bad6-2022f35cbe3b/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:04:37 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-fdb6dc63-0baa-4744-b9c9-16c363936593 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c6a4729-9d51-4ebf-bad6-2022f35cbe3b/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:04:37 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-fdb6dc63-0baa-4744-b9c9-16c363936593 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c6a4729-9d51-4ebf-bad6-2022f35cbe3b/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:04:37 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-fdb6dc63-0baa-4744-b9c9-16c363936593 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c6a4729-9d51-4ebf-bad6-2022f35cbe3b/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:04:37 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-fdb6dc63-0baa-4744-b9c9-16c363936593 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75176) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 16:04:37 user nova-compute[75176]: DEBUG nova.objects.instance [None req-fdb6dc63-0baa-4744-b9c9-16c363936593 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Lazy-loading 'trusted_certs' on Instance uuid 6c6a4729-9d51-4ebf-bad6-2022f35cbe3b {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 16:04:37 user nova-compute[75176]: DEBUG nova.objects.base [None req-fdb6dc63-0baa-4744-b9c9-16c363936593 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Object Instance<6c6a4729-9d51-4ebf-bad6-2022f35cbe3b> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=75176) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 16:04:37 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-fdb6dc63-0baa-4744-b9c9-16c363936593 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:04:38 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-fdb6dc63-0baa-4744-b9c9-16c363936593 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json" returned: 0 in 0.169s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:04:38 user nova-compute[75176]: DEBUG nova.virt.disk.api [None req-fdb6dc63-0baa-4744-b9c9-16c363936593 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6c6a4729-9d51-4ebf-bad6-2022f35cbe3b/disk. size=1073741824 {{(pid=75176) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 16:04:38 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-fdb6dc63-0baa-4744-b9c9-16c363936593 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c6a4729-9d51-4ebf-bad6-2022f35cbe3b/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:04:38 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-fdb6dc63-0baa-4744-b9c9-16c363936593 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c6a4729-9d51-4ebf-bad6-2022f35cbe3b/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:04:38 user nova-compute[75176]: DEBUG nova.virt.disk.api [None req-fdb6dc63-0baa-4744-b9c9-16c363936593 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Cannot resize image /opt/stack/data/nova/instances/6c6a4729-9d51-4ebf-bad6-2022f35cbe3b/disk to a smaller size. {{(pid=75176) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 16:04:38 user nova-compute[75176]: DEBUG nova.objects.instance [None req-fdb6dc63-0baa-4744-b9c9-16c363936593 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Lazy-loading 'migration_context' on Instance uuid 6c6a4729-9d51-4ebf-bad6-2022f35cbe3b {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 16:04:38 user nova-compute[75176]: DEBUG nova.objects.base [None req-fdb6dc63-0baa-4744-b9c9-16c363936593 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Object Instance<6c6a4729-9d51-4ebf-bad6-2022f35cbe3b> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75176) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 16:04:38 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-fdb6dc63-0baa-4744-b9c9-16c363936593 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T16:00:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-691561062',display_name='tempest-AttachVolumeTestJSON-server-691561062',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-691561062',id=48,image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD9HYYuhew+HwSlGLCtnm5QU3CE4PWqBzdirX5E0yDwA3ZIjV/d7lqYB/DPfiezleSueBjZ4jvmSISqP2Nc+aT8uhbuWQyy+x6kGVNBbHAicQWf8CVd+FflN0YxTFd39NA==',key_name='tempest-keypair-1245727303',keypairs=<?>,launch_index=0,launched_at=2023-11-28T16:00:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='6aab7b19b9414b5da476b87e144cc40b',ramdisk_id='',reservation_id='r-m99ag9fz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-365725655',owner_user_name='tempest-AttachVolumeTestJSON-365725655-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T16:02:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='60b513cfc58647d49fc084d51964a4c6',uuid=6c6a4729-9d51-4ebf-bad6-2022f35cbe3b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "85a1de78-2430-4835-8122-95570636e300", "address": "fa:16:3e:f4:49:91", "network": {"id": "9faaeac5-1688-436d-90fb-38bb1c4d3da4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1225296735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6aab7b19b9414b5da476b87e144cc40b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85a1de78-24", "ovs_interfaceid": "85a1de78-2430-4835-8122-95570636e300", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 16:04:38 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-fdb6dc63-0baa-4744-b9c9-16c363936593 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Converting VIF {"id": "85a1de78-2430-4835-8122-95570636e300", "address": "fa:16:3e:f4:49:91", "network": {"id": "9faaeac5-1688-436d-90fb-38bb1c4d3da4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1225296735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6aab7b19b9414b5da476b87e144cc40b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85a1de78-24", "ovs_interfaceid": "85a1de78-2430-4835-8122-95570636e300", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 16:04:38 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-fdb6dc63-0baa-4744-b9c9-16c363936593 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:49:91,bridge_name='br-int',has_traffic_filtering=True,id=85a1de78-2430-4835-8122-95570636e300,network=Network(9faaeac5-1688-436d-90fb-38bb1c4d3da4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85a1de78-24') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 16:04:38 user nova-compute[75176]: DEBUG os_vif [None req-fdb6dc63-0baa-4744-b9c9-16c363936593 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:49:91,bridge_name='br-int',has_traffic_filtering=True,id=85a1de78-2430-4835-8122-95570636e300,network=Network(9faaeac5-1688-436d-90fb-38bb1c4d3da4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85a1de78-24') {{(pid=75176) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 16:04:38 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:04:38 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 16:04:38 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 16:04:38 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:04:38 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e880c5d5-4e14-57e8-9b30-bc4eeed8a398', '_type': 'linux-noop'}}, row=False) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 16:04:38 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:04:38 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 16:04:38 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:04:38 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap85a1de78-24, may_exist=True, interface_attrs={}) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 16:04:38 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap85a1de78-24, col_values=(('qos', UUID('eaf2f9ed-b235-46cd-8ec5-f77d8783f1f7')),), if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 16:04:38 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap85a1de78-24, col_values=(('external_ids', {'iface-id': '85a1de78-2430-4835-8122-95570636e300', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f4:49:91', 'vm-uuid': '6c6a4729-9d51-4ebf-bad6-2022f35cbe3b'}),), if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 16:04:38 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:04:38 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 16:04:38 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:04:38 user nova-compute[75176]: INFO os_vif [None req-fdb6dc63-0baa-4744-b9c9-16c363936593 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:49:91,bridge_name='br-int',has_traffic_filtering=True,id=85a1de78-2430-4835-8122-95570636e300,network=Network(9faaeac5-1688-436d-90fb-38bb1c4d3da4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85a1de78-24')
Nov 28 16:04:39 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:04:39 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:04:39 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:04:39 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:04:40 user nova-compute[75176]: DEBUG nova.compute.manager [req-c826d7e2-f4b7-45b4-a6d9-496e92491376 req-936a38f0-84ce-401f-acdc-fa9734c9c83a service nova] [instance: 6c6a4729-9d51-4ebf-bad6-2022f35cbe3b] Received event network-vif-plugged-85a1de78-2430-4835-8122-95570636e300 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 16:04:40 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-c826d7e2-f4b7-45b4-a6d9-496e92491376 req-936a38f0-84ce-401f-acdc-fa9734c9c83a service nova] Acquiring lock "6c6a4729-9d51-4ebf-bad6-2022f35cbe3b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:04:40 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-c826d7e2-f4b7-45b4-a6d9-496e92491376 req-936a38f0-84ce-401f-acdc-fa9734c9c83a service nova] Lock "6c6a4729-9d51-4ebf-bad6-2022f35cbe3b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:04:40 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-c826d7e2-f4b7-45b4-a6d9-496e92491376 req-936a38f0-84ce-401f-acdc-fa9734c9c83a service nova] Lock "6c6a4729-9d51-4ebf-bad6-2022f35cbe3b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:04:40 user nova-compute[75176]: DEBUG nova.compute.manager [req-c826d7e2-f4b7-45b4-a6d9-496e92491376 req-936a38f0-84ce-401f-acdc-fa9734c9c83a service nova] [instance: 6c6a4729-9d51-4ebf-bad6-2022f35cbe3b] No waiting events found dispatching network-vif-plugged-85a1de78-2430-4835-8122-95570636e300 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 16:04:40 user nova-compute[75176]: WARNING nova.compute.manager [req-c826d7e2-f4b7-45b4-a6d9-496e92491376 req-936a38f0-84ce-401f-acdc-fa9734c9c83a service nova] [instance: 6c6a4729-9d51-4ebf-bad6-2022f35cbe3b] Received unexpected event network-vif-plugged-85a1de78-2430-4835-8122-95570636e300 for instance with vm_state stopped and task_state powering-on.
Nov 28 16:04:40 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:04:40 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:04:40 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:04:40 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:04:40 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:04:41 user nova-compute[75176]: DEBUG nova.compute.manager [None req-fdb6dc63-0baa-4744-b9c9-16c363936593 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] [instance: 6c6a4729-9d51-4ebf-bad6-2022f35cbe3b] Instance event wait completed in 0 seconds for  {{(pid=75176) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 16:04:41 user nova-compute[75176]: INFO nova.virt.libvirt.driver [-] [instance: 6c6a4729-9d51-4ebf-bad6-2022f35cbe3b] Instance rebooted successfully.
Nov 28 16:04:41 user nova-compute[75176]: DEBUG nova.compute.manager [None req-fdb6dc63-0baa-4744-b9c9-16c363936593 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] [instance: 6c6a4729-9d51-4ebf-bad6-2022f35cbe3b] Checking state {{(pid=75176) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 16:04:42 user nova-compute[75176]: DEBUG nova.compute.manager [req-ea2a4a95-bca9-42bd-b14c-5d6096a9363b req-bc19ff5d-42c3-470f-9e15-aaf5e66071f7 service nova] [instance: 6c6a4729-9d51-4ebf-bad6-2022f35cbe3b] Received event network-vif-plugged-85a1de78-2430-4835-8122-95570636e300 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 16:04:42 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-ea2a4a95-bca9-42bd-b14c-5d6096a9363b req-bc19ff5d-42c3-470f-9e15-aaf5e66071f7 service nova] Acquiring lock "6c6a4729-9d51-4ebf-bad6-2022f35cbe3b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:04:42 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-ea2a4a95-bca9-42bd-b14c-5d6096a9363b req-bc19ff5d-42c3-470f-9e15-aaf5e66071f7 service nova] Lock "6c6a4729-9d51-4ebf-bad6-2022f35cbe3b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:04:42 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-ea2a4a95-bca9-42bd-b14c-5d6096a9363b req-bc19ff5d-42c3-470f-9e15-aaf5e66071f7 service nova] Lock "6c6a4729-9d51-4ebf-bad6-2022f35cbe3b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:04:42 user nova-compute[75176]: DEBUG nova.compute.manager [req-ea2a4a95-bca9-42bd-b14c-5d6096a9363b req-bc19ff5d-42c3-470f-9e15-aaf5e66071f7 service nova] [instance: 6c6a4729-9d51-4ebf-bad6-2022f35cbe3b] No waiting events found dispatching network-vif-plugged-85a1de78-2430-4835-8122-95570636e300 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 16:04:42 user nova-compute[75176]: WARNING nova.compute.manager [req-ea2a4a95-bca9-42bd-b14c-5d6096a9363b req-bc19ff5d-42c3-470f-9e15-aaf5e66071f7 service nova] [instance: 6c6a4729-9d51-4ebf-bad6-2022f35cbe3b] Received unexpected event network-vif-plugged-85a1de78-2430-4835-8122-95570636e300 for instance with vm_state active and task_state None.
Nov 28 16:04:43 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:04:44 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:04:48 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:04:49 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:04:53 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:04:58 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 16:04:59 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:05:03 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:05:03 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:05:03 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:05:03 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Cleaning up deleted instances {{(pid=75176) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 28 16:05:03 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] There are 0 instances to clean {{(pid=75176) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 28 16:05:04 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:05:04 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:05:07 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:05:08 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-9be2b97f-b90c-4334-9e49-3816225e8187 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Acquiring lock "8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:05:08 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-9be2b97f-b90c-4334-9e49-3816225e8187 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Lock "8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:05:08 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-9be2b97f-b90c-4334-9e49-3816225e8187 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Acquiring lock "8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:05:08 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-9be2b97f-b90c-4334-9e49-3816225e8187 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Lock "8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:05:08 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-9be2b97f-b90c-4334-9e49-3816225e8187 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Lock "8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:05:08 user nova-compute[75176]: INFO nova.compute.manager [None req-9be2b97f-b90c-4334-9e49-3816225e8187 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] [instance: 8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7] Terminating instance
Nov 28 16:05:08 user nova-compute[75176]: DEBUG nova.compute.manager [None req-9be2b97f-b90c-4334-9e49-3816225e8187 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] [instance: 8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7] Start destroying the instance on the hypervisor. {{(pid=75176) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 16:05:08 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:05:08 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:05:08 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:05:08 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:05:08 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:05:08 user nova-compute[75176]: DEBUG nova.compute.manager [req-8ee256b8-801b-4f29-bfb5-6147c0a90b8c req-498604da-8cf7-45af-99ea-ba7407214aaa service nova] [instance: 8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7] Received event network-vif-unplugged-dcbed8eb-5414-44c1-a7d9-2358d4549f99 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 16:05:08 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-8ee256b8-801b-4f29-bfb5-6147c0a90b8c req-498604da-8cf7-45af-99ea-ba7407214aaa service nova] Acquiring lock "8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:05:08 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-8ee256b8-801b-4f29-bfb5-6147c0a90b8c req-498604da-8cf7-45af-99ea-ba7407214aaa service nova] Lock "8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:05:08 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-8ee256b8-801b-4f29-bfb5-6147c0a90b8c req-498604da-8cf7-45af-99ea-ba7407214aaa service nova] Lock "8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:05:08 user nova-compute[75176]: DEBUG nova.compute.manager [req-8ee256b8-801b-4f29-bfb5-6147c0a90b8c req-498604da-8cf7-45af-99ea-ba7407214aaa service nova] [instance: 8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7] No waiting events found dispatching network-vif-unplugged-dcbed8eb-5414-44c1-a7d9-2358d4549f99 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 16:05:08 user nova-compute[75176]: DEBUG nova.compute.manager [req-8ee256b8-801b-4f29-bfb5-6147c0a90b8c req-498604da-8cf7-45af-99ea-ba7407214aaa service nova] [instance: 8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7] Received event network-vif-unplugged-dcbed8eb-5414-44c1-a7d9-2358d4549f99 for instance with task_state deleting. {{(pid=75176) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 16:05:08 user nova-compute[75176]: INFO nova.virt.libvirt.driver [-] [instance: 8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7] Instance destroyed successfully.
Nov 28 16:05:08 user nova-compute[75176]: DEBUG nova.objects.instance [None req-9be2b97f-b90c-4334-9e49-3816225e8187 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Lazy-loading 'resources' on Instance uuid 8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7 {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 16:05:08 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-9be2b97f-b90c-4334-9e49-3816225e8187 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T15:49:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-912460137',display_name='tempest-ServerRescueNegativeTestJSON-server-912460137',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-912460137',id=32,image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-28T15:50:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fd2856ce0a2545cda0b796eb0be10a40',ramdisk_id='',reservation_id='r-buh2xw1r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1263291627',owner_user_name='tempest-ServerRescueNegativeTestJSON-1263291627-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T15:50:58Z,user_data=None,user_id='b7bd0e1b307f4d339ca2e540e063f028',uuid=8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "dcbed8eb-5414-44c1-a7d9-2358d4549f99", "address": "fa:16:3e:fd:e1:90", "network": {"id": "d47c1797-a66f-4f2d-b83e-903b5bd3251c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1416388789-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd2856ce0a2545cda0b796eb0be10a40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcbed8eb-54", "ovs_interfaceid": "dcbed8eb-5414-44c1-a7d9-2358d4549f99", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 16:05:08 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-9be2b97f-b90c-4334-9e49-3816225e8187 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Converting VIF {"id": "dcbed8eb-5414-44c1-a7d9-2358d4549f99", "address": "fa:16:3e:fd:e1:90", "network": {"id": "d47c1797-a66f-4f2d-b83e-903b5bd3251c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1416388789-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd2856ce0a2545cda0b796eb0be10a40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcbed8eb-54", "ovs_interfaceid": "dcbed8eb-5414-44c1-a7d9-2358d4549f99", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 16:05:08 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-9be2b97f-b90c-4334-9e49-3816225e8187 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fd:e1:90,bridge_name='br-int',has_traffic_filtering=True,id=dcbed8eb-5414-44c1-a7d9-2358d4549f99,network=Network(d47c1797-a66f-4f2d-b83e-903b5bd3251c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdcbed8eb-54') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 16:05:08 user nova-compute[75176]: DEBUG os_vif [None req-9be2b97f-b90c-4334-9e49-3816225e8187 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fd:e1:90,bridge_name='br-int',has_traffic_filtering=True,id=dcbed8eb-5414-44c1-a7d9-2358d4549f99,network=Network(d47c1797-a66f-4f2d-b83e-903b5bd3251c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdcbed8eb-54') {{(pid=75176) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 16:05:08 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:05:08 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdcbed8eb-54, bridge=br-int, if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 16:05:08 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:05:08 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 16:05:08 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:05:08 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c97dfaa1-4175-472b-b204-6cef4163125e) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 16:05:08 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:05:08 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 16:05:08 user nova-compute[75176]: INFO os_vif [None req-9be2b97f-b90c-4334-9e49-3816225e8187 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fd:e1:90,bridge_name='br-int',has_traffic_filtering=True,id=dcbed8eb-5414-44c1-a7d9-2358d4549f99,network=Network(d47c1797-a66f-4f2d-b83e-903b5bd3251c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdcbed8eb-54')
Nov 28 16:05:08 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-9be2b97f-b90c-4334-9e49-3816225e8187 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] [instance: 8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7] Deleting instance files /opt/stack/data/nova/instances/8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7_del
Nov 28 16:05:08 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-9be2b97f-b90c-4334-9e49-3816225e8187 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] [instance: 8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7] Deletion of /opt/stack/data/nova/instances/8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7_del complete
Nov 28 16:05:08 user nova-compute[75176]: INFO nova.compute.manager [None req-9be2b97f-b90c-4334-9e49-3816225e8187 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] [instance: 8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7] Took 0.69 seconds to destroy the instance on the hypervisor.
Nov 28 16:05:08 user nova-compute[75176]: DEBUG oslo.service.loopingcall [None req-9be2b97f-b90c-4334-9e49-3816225e8187 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75176) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 16:05:08 user nova-compute[75176]: DEBUG nova.compute.manager [-] [instance: 8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7] Deallocating network for instance {{(pid=75176) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 16:05:08 user nova-compute[75176]: DEBUG nova.network.neutron [-] [instance: 8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7] deallocate_for_instance() {{(pid=75176) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 16:05:09 user nova-compute[75176]: DEBUG nova.network.neutron [-] [instance: 8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7] Updating instance_info_cache with network_info: [] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 16:05:09 user nova-compute[75176]: INFO nova.compute.manager [-] [instance: 8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7] Took 0.52 seconds to deallocate network for instance.
Nov 28 16:05:09 user nova-compute[75176]: DEBUG nova.compute.manager [req-3221fa63-6024-4168-b1ea-a7b08674c9bf req-c172239e-c635-4730-b142-755e3a56f5ac service nova] [instance: 8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7] Received event network-vif-deleted-dcbed8eb-5414-44c1-a7d9-2358d4549f99 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 16:05:09 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-9be2b97f-b90c-4334-9e49-3816225e8187 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:05:09 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-9be2b97f-b90c-4334-9e49-3816225e8187 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:05:09 user nova-compute[75176]: DEBUG nova.compute.provider_tree [None req-9be2b97f-b90c-4334-9e49-3816225e8187 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Inventory has not changed in ProviderTree for provider: b37848d8-f401-4155-a029-b0ffa09ff85b {{(pid=75176) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 16:05:09 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-9be2b97f-b90c-4334-9e49-3816225e8187 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Inventory has not changed for provider b37848d8-f401-4155-a029-b0ffa09ff85b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75176) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 16:05:09 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-9be2b97f-b90c-4334-9e49-3816225e8187 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.293s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:05:09 user nova-compute[75176]: INFO nova.scheduler.client.report [None req-9be2b97f-b90c-4334-9e49-3816225e8187 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Deleted allocations for instance 8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7
Nov 28 16:05:09 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-9be2b97f-b90c-4334-9e49-3816225e8187 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Lock "8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.694s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:05:09 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:05:10 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:05:10 user nova-compute[75176]: DEBUG nova.compute.manager [req-9b278bd0-c765-4b8c-be28-b68b7e90c565 req-94c190ff-348f-4af1-8c40-3cc6fd1922b3 service nova] [instance: 8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7] Received event network-vif-plugged-dcbed8eb-5414-44c1-a7d9-2358d4549f99 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 16:05:10 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-9b278bd0-c765-4b8c-be28-b68b7e90c565 req-94c190ff-348f-4af1-8c40-3cc6fd1922b3 service nova] Acquiring lock "8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:05:10 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-9b278bd0-c765-4b8c-be28-b68b7e90c565 req-94c190ff-348f-4af1-8c40-3cc6fd1922b3 service nova] Lock "8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:05:10 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-9b278bd0-c765-4b8c-be28-b68b7e90c565 req-94c190ff-348f-4af1-8c40-3cc6fd1922b3 service nova] Lock "8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:05:10 user nova-compute[75176]: DEBUG nova.compute.manager [req-9b278bd0-c765-4b8c-be28-b68b7e90c565 req-94c190ff-348f-4af1-8c40-3cc6fd1922b3 service nova] [instance: 8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7] No waiting events found dispatching network-vif-plugged-dcbed8eb-5414-44c1-a7d9-2358d4549f99 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 16:05:10 user nova-compute[75176]: WARNING nova.compute.manager [req-9b278bd0-c765-4b8c-be28-b68b7e90c565 req-94c190ff-348f-4af1-8c40-3cc6fd1922b3 service nova] [instance: 8ba569e6-e024-4a10-93d0-6ef0cfbcc6a7] Received unexpected event network-vif-plugged-dcbed8eb-5414-44c1-a7d9-2358d4549f99 for instance with vm_state deleted and task_state None.
Nov 28 16:05:10 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:05:10 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Starting heal instance info cache {{(pid=75176) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 16:05:10 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Rebuilding the list of instances to heal {{(pid=75176) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 16:05:10 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquiring lock "refresh_cache-f66ead7d-98f4-4822-9dce-f2ea0206a58d" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 16:05:10 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquired lock "refresh_cache-f66ead7d-98f4-4822-9dce-f2ea0206a58d" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 16:05:10 user nova-compute[75176]: DEBUG nova.network.neutron [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] [instance: f66ead7d-98f4-4822-9dce-f2ea0206a58d] Forcefully refreshing network info cache for instance {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 16:05:10 user nova-compute[75176]: DEBUG nova.objects.instance [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lazy-loading 'info_cache' on Instance uuid f66ead7d-98f4-4822-9dce-f2ea0206a58d {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 16:05:11 user nova-compute[75176]: DEBUG nova.network.neutron [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] [instance: f66ead7d-98f4-4822-9dce-f2ea0206a58d] Updating instance_info_cache with network_info: [{"id": "30bb2de8-1609-4cd8-8bb1-e32f2c4bfa81", "address": "fa:16:3e:22:f2:8e", "network": {"id": "998766cd-2e8e-4e39-add9-286086640993", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-989265510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf05c8836b8a40de8e64c2d046ed71ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30bb2de8-16", "ovs_interfaceid": "30bb2de8-1609-4cd8-8bb1-e32f2c4bfa81", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 16:05:11 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Releasing lock "refresh_cache-f66ead7d-98f4-4822-9dce-f2ea0206a58d" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 16:05:11 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] [instance: f66ead7d-98f4-4822-9dce-f2ea0206a58d] Updated the network info_cache for instance {{(pid=75176) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 16:05:11 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:05:11 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:05:11 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75176) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 16:05:12 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:05:13 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:05:13 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:05:18 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:05:18 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:05:18 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:05:18 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:05:18 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Auditing locally available compute resources for user (node: user) {{(pid=75176) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 16:05:18 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:05:18 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75176) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 16:05:18 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55febf04-14ea-4903-8692-c7cc6115de75/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:05:19 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55febf04-14ea-4903-8692-c7cc6115de75/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:05:19 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55febf04-14ea-4903-8692-c7cc6115de75/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:05:19 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55febf04-14ea-4903-8692-c7cc6115de75/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:05:19 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c6a4729-9d51-4ebf-bad6-2022f35cbe3b/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:05:19 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c6a4729-9d51-4ebf-bad6-2022f35cbe3b/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:05:19 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c6a4729-9d51-4ebf-bad6-2022f35cbe3b/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:05:19 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c6a4729-9d51-4ebf-bad6-2022f35cbe3b/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:05:19 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75176) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 16:05:19 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecf38787-0a69-4f35-b121-3dc6e70023a1/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:05:19 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecf38787-0a69-4f35-b121-3dc6e70023a1/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:05:19 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecf38787-0a69-4f35-b121-3dc6e70023a1/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:05:19 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecf38787-0a69-4f35-b121-3dc6e70023a1/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:05:19 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75176) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 16:05:19 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66ead7d-98f4-4822-9dce-f2ea0206a58d/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:05:20 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66ead7d-98f4-4822-9dce-f2ea0206a58d/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:05:20 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66ead7d-98f4-4822-9dce-f2ea0206a58d/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:05:20 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66ead7d-98f4-4822-9dce-f2ea0206a58d/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:05:20 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 16:05:20 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 16:05:20 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Hypervisor/Node resource view: name=user free_ram=8473MB free_disk=24.810096740722656GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75176) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 16:05:20 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:05:20 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:05:20 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance f66ead7d-98f4-4822-9dce-f2ea0206a58d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 16:05:20 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance 55febf04-14ea-4903-8692-c7cc6115de75 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 16:05:20 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance dc4e6d39-adfb-4d26-afef-46f316ff7846 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 16:05:20 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance ecf38787-0a69-4f35-b121-3dc6e70023a1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 16:05:20 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance 1062234d-4890-46df-bb52-49c55b4af32b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 16:05:20 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance 6c6a4729-9d51-4ebf-bad6-2022f35cbe3b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 16:05:20 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=75176) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 16:05:20 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=75176) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 16:05:20 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Refreshing inventories for resource provider b37848d8-f401-4155-a029-b0ffa09ff85b {{(pid=75176) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 28 16:05:21 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Updating ProviderTree inventory for provider b37848d8-f401-4155-a029-b0ffa09ff85b from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75176) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 28 16:05:21 user nova-compute[75176]: DEBUG nova.compute.provider_tree [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Updating inventory in ProviderTree for provider b37848d8-f401-4155-a029-b0ffa09ff85b with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75176) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 28 16:05:21 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Refreshing aggregate associations for resource provider b37848d8-f401-4155-a029-b0ffa09ff85b, aggregates: None {{(pid=75176) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 28 16:05:21 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Refreshing trait associations for resource provider b37848d8-f401-4155-a029-b0ffa09ff85b, traits: COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_RESCUE_BFV,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NODE,HW_CPU_X86_SSSE3,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE42,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE2,COMPUTE_ACCELERATORS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VIRTIO {{(pid=75176) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 28 16:05:21 user nova-compute[75176]: DEBUG nova.compute.provider_tree [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Inventory has not changed in ProviderTree for provider: b37848d8-f401-4155-a029-b0ffa09ff85b {{(pid=75176) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 16:05:21 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Inventory has not changed for provider b37848d8-f401-4155-a029-b0ffa09ff85b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75176) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 16:05:21 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Compute_service record updated for user:user {{(pid=75176) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 16:05:21 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.604s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:05:21 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:05:21 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75176) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 28 16:05:22 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:05:23 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 16:05:28 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:05:28 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:05:33 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 16:05:38 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:05:43 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 16:05:48 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:05:53 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 16:05:58 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-60522cef-9f56-432e-b64a-6343ca94d5f5 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Acquiring lock "55febf04-14ea-4903-8692-c7cc6115de75" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:05:58 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-60522cef-9f56-432e-b64a-6343ca94d5f5 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Lock "55febf04-14ea-4903-8692-c7cc6115de75" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:05:58 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-60522cef-9f56-432e-b64a-6343ca94d5f5 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Acquiring lock "55febf04-14ea-4903-8692-c7cc6115de75-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:05:58 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-60522cef-9f56-432e-b64a-6343ca94d5f5 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Lock "55febf04-14ea-4903-8692-c7cc6115de75-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:05:58 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-60522cef-9f56-432e-b64a-6343ca94d5f5 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Lock "55febf04-14ea-4903-8692-c7cc6115de75-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:05:58 user nova-compute[75176]: INFO nova.compute.manager [None req-60522cef-9f56-432e-b64a-6343ca94d5f5 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] [instance: 55febf04-14ea-4903-8692-c7cc6115de75] Terminating instance
Nov 28 16:05:58 user nova-compute[75176]: DEBUG nova.compute.manager [None req-60522cef-9f56-432e-b64a-6343ca94d5f5 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] [instance: 55febf04-14ea-4903-8692-c7cc6115de75] Start destroying the instance on the hypervisor. {{(pid=75176) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 16:05:58 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:05:58 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:05:58 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:05:58 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:05:58 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:05:58 user nova-compute[75176]: DEBUG nova.compute.manager [req-98c1621c-418b-495c-84c5-0ec765a4a642 req-cbc74b98-99cd-45d9-ab8c-e767a50d5c1d service nova] [instance: 55febf04-14ea-4903-8692-c7cc6115de75] Received event network-vif-unplugged-e287ec1a-3726-4719-94b2-79764f7abd31 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 16:05:58 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-98c1621c-418b-495c-84c5-0ec765a4a642 req-cbc74b98-99cd-45d9-ab8c-e767a50d5c1d service nova] Acquiring lock "55febf04-14ea-4903-8692-c7cc6115de75-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:05:58 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-98c1621c-418b-495c-84c5-0ec765a4a642 req-cbc74b98-99cd-45d9-ab8c-e767a50d5c1d service nova] Lock "55febf04-14ea-4903-8692-c7cc6115de75-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:05:58 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-98c1621c-418b-495c-84c5-0ec765a4a642 req-cbc74b98-99cd-45d9-ab8c-e767a50d5c1d service nova] Lock "55febf04-14ea-4903-8692-c7cc6115de75-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:05:58 user nova-compute[75176]: DEBUG nova.compute.manager [req-98c1621c-418b-495c-84c5-0ec765a4a642 req-cbc74b98-99cd-45d9-ab8c-e767a50d5c1d service nova] [instance: 55febf04-14ea-4903-8692-c7cc6115de75] No waiting events found dispatching network-vif-unplugged-e287ec1a-3726-4719-94b2-79764f7abd31 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 16:05:58 user nova-compute[75176]: DEBUG nova.compute.manager [req-98c1621c-418b-495c-84c5-0ec765a4a642 req-cbc74b98-99cd-45d9-ab8c-e767a50d5c1d service nova] [instance: 55febf04-14ea-4903-8692-c7cc6115de75] Received event network-vif-unplugged-e287ec1a-3726-4719-94b2-79764f7abd31 for instance with task_state deleting. {{(pid=75176) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 16:05:59 user nova-compute[75176]: INFO nova.virt.libvirt.driver [-] [instance: 55febf04-14ea-4903-8692-c7cc6115de75] Instance destroyed successfully.
Nov 28 16:05:59 user nova-compute[75176]: DEBUG nova.objects.instance [None req-60522cef-9f56-432e-b64a-6343ca94d5f5 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Lazy-loading 'resources' on Instance uuid 55febf04-14ea-4903-8692-c7cc6115de75 {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 16:05:59 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-60522cef-9f56-432e-b64a-6343ca94d5f5 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T15:48:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1621955693',display_name='tempest-ServerRescueNegativeTestJSON-server-1621955693',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1621955693',id=31,image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-28T15:53:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fd2856ce0a2545cda0b796eb0be10a40',ramdisk_id='',reservation_id='r-r0jnkzy2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1263291627',owner_user_name='tempest-ServerRescueNegativeTestJSON-1263291627-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T15:55:42Z,user_data=None,user_id='b7bd0e1b307f4d339ca2e540e063f028',uuid=55febf04-14ea-4903-8692-c7cc6115de75,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e287ec1a-3726-4719-94b2-79764f7abd31", "address": "fa:16:3e:0c:d1:2f", "network": {"id": "d47c1797-a66f-4f2d-b83e-903b5bd3251c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1416388789-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd2856ce0a2545cda0b796eb0be10a40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape287ec1a-37", "ovs_interfaceid": "e287ec1a-3726-4719-94b2-79764f7abd31", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 16:05:59 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-60522cef-9f56-432e-b64a-6343ca94d5f5 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Converting VIF {"id": "e287ec1a-3726-4719-94b2-79764f7abd31", "address": "fa:16:3e:0c:d1:2f", "network": {"id": "d47c1797-a66f-4f2d-b83e-903b5bd3251c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1416388789-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd2856ce0a2545cda0b796eb0be10a40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape287ec1a-37", "ovs_interfaceid": "e287ec1a-3726-4719-94b2-79764f7abd31", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 16:05:59 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-60522cef-9f56-432e-b64a-6343ca94d5f5 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0c:d1:2f,bridge_name='br-int',has_traffic_filtering=True,id=e287ec1a-3726-4719-94b2-79764f7abd31,network=Network(d47c1797-a66f-4f2d-b83e-903b5bd3251c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape287ec1a-37') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 16:05:59 user nova-compute[75176]: DEBUG os_vif [None req-60522cef-9f56-432e-b64a-6343ca94d5f5 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0c:d1:2f,bridge_name='br-int',has_traffic_filtering=True,id=e287ec1a-3726-4719-94b2-79764f7abd31,network=Network(d47c1797-a66f-4f2d-b83e-903b5bd3251c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape287ec1a-37') {{(pid=75176) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 16:05:59 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:05:59 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape287ec1a-37, bridge=br-int, if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 16:05:59 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:05:59 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 16:05:59 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:05:59 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=12501ec4-3479-42b4-abfb-faf7bb6257ce) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 16:05:59 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:05:59 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:05:59 user nova-compute[75176]: INFO os_vif [None req-60522cef-9f56-432e-b64a-6343ca94d5f5 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0c:d1:2f,bridge_name='br-int',has_traffic_filtering=True,id=e287ec1a-3726-4719-94b2-79764f7abd31,network=Network(d47c1797-a66f-4f2d-b83e-903b5bd3251c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape287ec1a-37')
Nov 28 16:05:59 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-60522cef-9f56-432e-b64a-6343ca94d5f5 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] [instance: 55febf04-14ea-4903-8692-c7cc6115de75] Deleting instance files /opt/stack/data/nova/instances/55febf04-14ea-4903-8692-c7cc6115de75_del
Nov 28 16:05:59 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-60522cef-9f56-432e-b64a-6343ca94d5f5 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] [instance: 55febf04-14ea-4903-8692-c7cc6115de75] Deletion of /opt/stack/data/nova/instances/55febf04-14ea-4903-8692-c7cc6115de75_del complete
Nov 28 16:05:59 user nova-compute[75176]: INFO nova.compute.manager [None req-60522cef-9f56-432e-b64a-6343ca94d5f5 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] [instance: 55febf04-14ea-4903-8692-c7cc6115de75] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 28 16:05:59 user nova-compute[75176]: DEBUG oslo.service.loopingcall [None req-60522cef-9f56-432e-b64a-6343ca94d5f5 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75176) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 16:05:59 user nova-compute[75176]: DEBUG nova.compute.manager [-] [instance: 55febf04-14ea-4903-8692-c7cc6115de75] Deallocating network for instance {{(pid=75176) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 16:05:59 user nova-compute[75176]: DEBUG nova.network.neutron [-] [instance: 55febf04-14ea-4903-8692-c7cc6115de75] deallocate_for_instance() {{(pid=75176) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 16:05:59 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:05:59 user nova-compute[75176]: DEBUG nova.network.neutron [-] [instance: 55febf04-14ea-4903-8692-c7cc6115de75] Updating instance_info_cache with network_info: [] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 16:05:59 user nova-compute[75176]: DEBUG nova.compute.manager [req-4d6da567-b736-41fd-86d9-2e0b0ea299fe req-eaad2b59-c91e-4f70-93cd-1456e5a4c2c8 service nova] [instance: 55febf04-14ea-4903-8692-c7cc6115de75] Received event network-vif-deleted-e287ec1a-3726-4719-94b2-79764f7abd31 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 16:05:59 user nova-compute[75176]: INFO nova.compute.manager [req-4d6da567-b736-41fd-86d9-2e0b0ea299fe req-eaad2b59-c91e-4f70-93cd-1456e5a4c2c8 service nova] [instance: 55febf04-14ea-4903-8692-c7cc6115de75] Neutron deleted interface e287ec1a-3726-4719-94b2-79764f7abd31; detaching it from the instance and deleting it from the info cache
Nov 28 16:05:59 user nova-compute[75176]: DEBUG nova.network.neutron [req-4d6da567-b736-41fd-86d9-2e0b0ea299fe req-eaad2b59-c91e-4f70-93cd-1456e5a4c2c8 service nova] [instance: 55febf04-14ea-4903-8692-c7cc6115de75] Updating instance_info_cache with network_info: [] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 16:05:59 user nova-compute[75176]: INFO nova.compute.manager [-] [instance: 55febf04-14ea-4903-8692-c7cc6115de75] Took 0.43 seconds to deallocate network for instance.
Nov 28 16:05:59 user nova-compute[75176]: DEBUG nova.compute.manager [req-4d6da567-b736-41fd-86d9-2e0b0ea299fe req-eaad2b59-c91e-4f70-93cd-1456e5a4c2c8 service nova] [instance: 55febf04-14ea-4903-8692-c7cc6115de75] Detach interface failed, port_id=e287ec1a-3726-4719-94b2-79764f7abd31, reason: Instance 55febf04-14ea-4903-8692-c7cc6115de75 could not be found. {{(pid=75176) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 28 16:05:59 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-60522cef-9f56-432e-b64a-6343ca94d5f5 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:05:59 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-60522cef-9f56-432e-b64a-6343ca94d5f5 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:06:00 user nova-compute[75176]: DEBUG nova.compute.provider_tree [None req-60522cef-9f56-432e-b64a-6343ca94d5f5 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Inventory has not changed in ProviderTree for provider: b37848d8-f401-4155-a029-b0ffa09ff85b {{(pid=75176) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 16:06:00 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-60522cef-9f56-432e-b64a-6343ca94d5f5 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Inventory has not changed for provider b37848d8-f401-4155-a029-b0ffa09ff85b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75176) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 16:06:00 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-60522cef-9f56-432e-b64a-6343ca94d5f5 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.243s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:06:00 user nova-compute[75176]: INFO nova.scheduler.client.report [None req-60522cef-9f56-432e-b64a-6343ca94d5f5 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Deleted allocations for instance 55febf04-14ea-4903-8692-c7cc6115de75
Nov 28 16:06:00 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-60522cef-9f56-432e-b64a-6343ca94d5f5 tempest-ServerRescueNegativeTestJSON-1263291627 tempest-ServerRescueNegativeTestJSON-1263291627-project-member] Lock "55febf04-14ea-4903-8692-c7cc6115de75" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.768s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:06:00 user nova-compute[75176]: DEBUG nova.compute.manager [req-374518c1-bbdd-4c46-a361-35496e7550eb req-02c837c6-f1d2-4ff4-8407-76304dd52e68 service nova] [instance: 55febf04-14ea-4903-8692-c7cc6115de75] Received event network-vif-plugged-e287ec1a-3726-4719-94b2-79764f7abd31 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 16:06:00 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-374518c1-bbdd-4c46-a361-35496e7550eb req-02c837c6-f1d2-4ff4-8407-76304dd52e68 service nova] Acquiring lock "55febf04-14ea-4903-8692-c7cc6115de75-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:06:00 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-374518c1-bbdd-4c46-a361-35496e7550eb req-02c837c6-f1d2-4ff4-8407-76304dd52e68 service nova] Lock "55febf04-14ea-4903-8692-c7cc6115de75-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:06:00 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-374518c1-bbdd-4c46-a361-35496e7550eb req-02c837c6-f1d2-4ff4-8407-76304dd52e68 service nova] Lock "55febf04-14ea-4903-8692-c7cc6115de75-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:06:00 user nova-compute[75176]: DEBUG nova.compute.manager [req-374518c1-bbdd-4c46-a361-35496e7550eb req-02c837c6-f1d2-4ff4-8407-76304dd52e68 service nova] [instance: 55febf04-14ea-4903-8692-c7cc6115de75] No waiting events found dispatching network-vif-plugged-e287ec1a-3726-4719-94b2-79764f7abd31 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 16:06:00 user nova-compute[75176]: WARNING nova.compute.manager [req-374518c1-bbdd-4c46-a361-35496e7550eb req-02c837c6-f1d2-4ff4-8407-76304dd52e68 service nova] [instance: 55febf04-14ea-4903-8692-c7cc6115de75] Received unexpected event network-vif-plugged-e287ec1a-3726-4719-94b2-79764f7abd31 for instance with vm_state deleted and task_state None.
Nov 28 16:06:02 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-43e87918-5313-4033-8d8d-028f2b2d7a93 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Acquiring lock "1062234d-4890-46df-bb52-49c55b4af32b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:06:02 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-43e87918-5313-4033-8d8d-028f2b2d7a93 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Lock "1062234d-4890-46df-bb52-49c55b4af32b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:06:02 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-43e87918-5313-4033-8d8d-028f2b2d7a93 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Acquiring lock "1062234d-4890-46df-bb52-49c55b4af32b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:06:02 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-43e87918-5313-4033-8d8d-028f2b2d7a93 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Lock "1062234d-4890-46df-bb52-49c55b4af32b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:06:02 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-43e87918-5313-4033-8d8d-028f2b2d7a93 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Lock "1062234d-4890-46df-bb52-49c55b4af32b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:06:02 user nova-compute[75176]: INFO nova.compute.manager [None req-43e87918-5313-4033-8d8d-028f2b2d7a93 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: 1062234d-4890-46df-bb52-49c55b4af32b] Terminating instance
Nov 28 16:06:02 user nova-compute[75176]: DEBUG nova.compute.manager [None req-43e87918-5313-4033-8d8d-028f2b2d7a93 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: 1062234d-4890-46df-bb52-49c55b4af32b] Start destroying the instance on the hypervisor. {{(pid=75176) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 16:06:02 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:06:02 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:06:02 user nova-compute[75176]: DEBUG nova.compute.manager [req-415a5906-8be5-4bef-9f7b-ef171085c59f req-47b9ec9e-2725-4877-8a9b-5f308344b4e4 service nova] [instance: 1062234d-4890-46df-bb52-49c55b4af32b] Received event network-vif-unplugged-3dd39a62-ef9c-4870-be88-578e41ff5013 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 16:06:02 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-415a5906-8be5-4bef-9f7b-ef171085c59f req-47b9ec9e-2725-4877-8a9b-5f308344b4e4 service nova] Acquiring lock "1062234d-4890-46df-bb52-49c55b4af32b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:06:02 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-415a5906-8be5-4bef-9f7b-ef171085c59f req-47b9ec9e-2725-4877-8a9b-5f308344b4e4 service nova] Lock "1062234d-4890-46df-bb52-49c55b4af32b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:06:02 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-415a5906-8be5-4bef-9f7b-ef171085c59f req-47b9ec9e-2725-4877-8a9b-5f308344b4e4 service nova] Lock "1062234d-4890-46df-bb52-49c55b4af32b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:06:02 user nova-compute[75176]: DEBUG nova.compute.manager [req-415a5906-8be5-4bef-9f7b-ef171085c59f req-47b9ec9e-2725-4877-8a9b-5f308344b4e4 service nova] [instance: 1062234d-4890-46df-bb52-49c55b4af32b] No waiting events found dispatching network-vif-unplugged-3dd39a62-ef9c-4870-be88-578e41ff5013 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 16:06:02 user nova-compute[75176]: DEBUG nova.compute.manager [req-415a5906-8be5-4bef-9f7b-ef171085c59f req-47b9ec9e-2725-4877-8a9b-5f308344b4e4 service nova] [instance: 1062234d-4890-46df-bb52-49c55b4af32b] Received event network-vif-unplugged-3dd39a62-ef9c-4870-be88-578e41ff5013 for instance with task_state deleting. {{(pid=75176) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 16:06:02 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:06:02 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:06:03 user nova-compute[75176]: INFO nova.virt.libvirt.driver [-] [instance: 1062234d-4890-46df-bb52-49c55b4af32b] Instance destroyed successfully.
Nov 28 16:06:03 user nova-compute[75176]: DEBUG nova.objects.instance [None req-43e87918-5313-4033-8d8d-028f2b2d7a93 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Lazy-loading 'resources' on Instance uuid 1062234d-4890-46df-bb52-49c55b4af32b {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 16:06:03 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-43e87918-5313-4033-8d8d-028f2b2d7a93 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T16:00:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1609172901',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1609172901',id=47,image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-28T16:02:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bf05c8836b8a40de8e64c2d046ed71ff',ramdisk_id='',reservation_id='r-0qjqy9lv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1648409789',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T16:04:16Z,user_data=None,user_id='f24cedac95a44bb5a9ee54cc4713945c',uuid=1062234d-4890-46df-bb52-49c55b4af32b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3dd39a62-ef9c-4870-be88-578e41ff5013", "address": "fa:16:3e:10:e7:45", "network": {"id": "998766cd-2e8e-4e39-add9-286086640993", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-989265510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf05c8836b8a40de8e64c2d046ed71ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dd39a62-ef", "ovs_interfaceid": "3dd39a62-ef9c-4870-be88-578e41ff5013", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 16:06:03 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-43e87918-5313-4033-8d8d-028f2b2d7a93 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Converting VIF {"id": "3dd39a62-ef9c-4870-be88-578e41ff5013", "address": "fa:16:3e:10:e7:45", "network": {"id": "998766cd-2e8e-4e39-add9-286086640993", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-989265510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf05c8836b8a40de8e64c2d046ed71ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dd39a62-ef", "ovs_interfaceid": "3dd39a62-ef9c-4870-be88-578e41ff5013", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 16:06:03 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-43e87918-5313-4033-8d8d-028f2b2d7a93 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:10:e7:45,bridge_name='br-int',has_traffic_filtering=True,id=3dd39a62-ef9c-4870-be88-578e41ff5013,network=Network(998766cd-2e8e-4e39-add9-286086640993),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3dd39a62-ef') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 16:06:03 user nova-compute[75176]: DEBUG os_vif [None req-43e87918-5313-4033-8d8d-028f2b2d7a93 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:10:e7:45,bridge_name='br-int',has_traffic_filtering=True,id=3dd39a62-ef9c-4870-be88-578e41ff5013,network=Network(998766cd-2e8e-4e39-add9-286086640993),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3dd39a62-ef') {{(pid=75176) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 16:06:03 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:06:03 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3dd39a62-ef, bridge=br-int, if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 16:06:03 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:06:03 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 16:06:03 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:06:03 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bbfc0a4a-d7f5-45c2-9fb3-dae4b590f683) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 16:06:03 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:06:03 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 16:06:03 user nova-compute[75176]: INFO os_vif [None req-43e87918-5313-4033-8d8d-028f2b2d7a93 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:10:e7:45,bridge_name='br-int',has_traffic_filtering=True,id=3dd39a62-ef9c-4870-be88-578e41ff5013,network=Network(998766cd-2e8e-4e39-add9-286086640993),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3dd39a62-ef')
Nov 28 16:06:03 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-43e87918-5313-4033-8d8d-028f2b2d7a93 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: 1062234d-4890-46df-bb52-49c55b4af32b] calling os-brick to detach iSCSI Volume {{(pid=75176) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 16:06:03 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-43e87918-5313-4033-8d8d-028f2b2d7a93 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c1b8a00>, {'target_iqn': 'iqn.2010-10.org.openstack:6ec9410d-747d-475e-999c-672f87917a20', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iqKQHyYp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 16:06:03 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-43e87918-5313-4033-8d8d-028f2b2d7a93 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 16:06:03 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-43e87918-5313-4033-8d8d-028f2b2d7a93 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 16:06:03 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-43e87918-5313-4033-8d8d-028f2b2d7a93 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 16:06:03 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:06:03 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:06:03 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cde876b-f431-400e-bee6-70a505bbf5eb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3676a213-38f2-4682-a210-16696ea2f6ad\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6ec9410d-747d-475e-999c-672f87917a20\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:06:03 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-43e87918-5313-4033-8d8d-028f2b2d7a93 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 16:06:03 user nova-compute[75176]: No targets found.
Nov 28 16:06:03 user nova-compute[75176]: iSNS:
Nov 28 16:06:03 user nova-compute[75176]: No targets found.
Nov 28 16:06:03 user nova-compute[75176]: STATIC:
Nov 28 16:06:03 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:3676a213-38f2-4682-a210-16696ea2f6ad
Nov 28 16:06:03 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 16:06:03 user nova-compute[75176]:                 Iface Name: default
Nov 28 16:06:03 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6
Nov 28 16:06:03 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 16:06:03 user nova-compute[75176]:                 Iface Name: default
Nov 28 16:06:03 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:6ec9410d-747d-475e-999c-672f87917a20
Nov 28 16:06:03 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 16:06:03 user nova-compute[75176]:                 Iface Name: default
Nov 28 16:06:03 user nova-compute[75176]: FIRMWARE:
Nov 28 16:06:03 user nova-compute[75176]: No targets found.
Nov 28 16:06:03 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 16:06:03 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-43e87918-5313-4033-8d8d-028f2b2d7a93 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 16:06:03 user nova-compute[75176]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 16:06:03 user nova-compute[75176]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75176) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 16:06:03 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-43e87918-5313-4033-8d8d-028f2b2d7a93 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6ec9410d-747d-475e-999c-672f87917a20', 0)] {{(pid=75176) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 16:06:03 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:06:03 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:06:03 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[feb5df52-ef26-46be-bb8d-0585974d7dfe]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3676a213-38f2-4682-a210-16696ea2f6ad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ec9410d-747d-475e-999c-672f87917a20\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:06:03 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:06:03 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:06:03 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb327ebf-9162-4fcb-a671-ef0360cc0115]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ec9410d-747d-475e-999c-672f87917a20 (non-flash)\ntcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3676a213-38f2-4682-a210-16696ea2f6ad (non-flash)\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:06:03 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-43e87918-5313-4033-8d8d-028f2b2d7a93 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 (non-flash)
Nov 28 16:06:03 user nova-compute[75176]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ec9410d-747d-475e-999c-672f87917a20 (non-flash)
Nov 28 16:06:03 user nova-compute[75176]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3676a213-38f2-4682-a210-16696ea2f6ad (non-flash)
Nov 28 16:06:03 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 16:06:03 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-43e87918-5313-4033-8d8d-028f2b2d7a93 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 (non-flash)
Nov 28 16:06:03 user nova-compute[75176]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ec9410d-747d-475e-999c-672f87917a20 (non-flash)
Nov 28 16:06:03 user nova-compute[75176]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3676a213-38f2-4682-a210-16696ea2f6ad (non-flash)
Nov 28 16:06:03 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 16:06:03 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-43e87918-5313-4033-8d8d-028f2b2d7a93 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f464c3a2050>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6ec9410d-747d-475e-999c-672f87917a20'): ({'sde'}, set())}) {{(pid=75176) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 16:06:03 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-43e87918-5313-4033-8d8d-028f2b2d7a93 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Removing single pathed devices sde {{(pid=75176) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 16:06:03 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:06:03 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:06:03 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fdd38ed-d87e-4db1-ac56-31a0a3c1a6e3]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:06:03 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:06:03 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:06:03 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf42758e-06ee-468d-a8b4-c03e399a39c0]: (4, ('ok\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:06:03 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-43e87918-5313-4033-8d8d-028f2b2d7a93 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Flushing IO for device /dev/sde {{(pid=75176) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 16:06:03 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:06:03 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:06:03 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e14b036-84cb-4473-9064-f89908645267]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:06:03 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-43e87918-5313-4033-8d8d-028f2b2d7a93 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75176) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 16:06:03 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:06:03 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.039s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:06:03 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e1e405e-d960-4957-945c-120bfd4d87e7]: (4, ('1', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:06:03 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-43e87918-5313-4033-8d8d-028f2b2d7a93 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75176) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 16:06:03 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-43e87918-5313-4033-8d8d-028f2b2d7a93 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] SCSI volumes sde have been removed. {{(pid=75176) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 16:06:03 user nova-compute[75176]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOafedbc63-0ab5fea821eaca89', '/dev/disk/by-id/scsi-23061623566656138', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_afedbc63') {{(pid=85736) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 28 16:06:03 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[24863b41-1fb8-4001-ac23-a17a892ff543]: (4, None) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:06:03 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-43e87918-5313-4033-8d8d-028f2b2d7a93 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6ec9410d-747d-475e-999c-672f87917a20')] {{(pid=75176) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 16:06:03 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ec9410d-747d-475e-999c-672f87917a20 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:06:03 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ec9410d-747d-475e-999c-672f87917a20 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:06:03 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7619019-2d0a-467b-a323-942d5d4c83cc]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:06:03 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-43e87918-5313-4033-8d8d-028f2b2d7a93 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 16:06:03 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ec9410d-747d-475e-999c-672f87917a20 -p 172.16.0.220:3260 --logout {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:06:03 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ec9410d-747d-475e-999c-672f87917a20 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:06:03 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f70414b-e0d1-4276-8d17-6fa30c3a7c60]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:6ec9410d-747d-475e-999c-672f87917a20, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:6ec9410d-747d-475e-999c-672f87917a20, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:06:03 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-43e87918-5313-4033-8d8d-028f2b2d7a93 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:6ec9410d-747d-475e-999c-672f87917a20, portal: 172.16.0.220,3260]
Nov 28 16:06:03 user nova-compute[75176]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:6ec9410d-747d-475e-999c-672f87917a20, portal: 172.16.0.220,3260] successful.
Nov 28 16:06:03 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 16:06:03 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ec9410d-747d-475e-999c-672f87917a20 -p 172.16.0.220:3260 --op delete {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:06:03 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ec9410d-747d-475e-999c-672f87917a20 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:06:03 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2329dc0-6180-42b6-8765-79a330e344d6]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:06:03 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-43e87918-5313-4033-8d8d-028f2b2d7a93 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 16:06:03 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-43e87918-5313-4033-8d8d-028f2b2d7a93 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.297s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 16:06:03 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-43e87918-5313-4033-8d8d-028f2b2d7a93 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] <== disconnect_volume: return (299ms) None {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 16:06:03 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-43e87918-5313-4033-8d8d-028f2b2d7a93 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: 1062234d-4890-46df-bb52-49c55b4af32b] Disconnected iSCSI Volume {{(pid=75176) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 16:06:03 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-43e87918-5313-4033-8d8d-028f2b2d7a93 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: 1062234d-4890-46df-bb52-49c55b4af32b] Deleting instance files /opt/stack/data/nova/instances/1062234d-4890-46df-bb52-49c55b4af32b_del
Nov 28 16:06:03 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-43e87918-5313-4033-8d8d-028f2b2d7a93 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: 1062234d-4890-46df-bb52-49c55b4af32b] Deletion of /opt/stack/data/nova/instances/1062234d-4890-46df-bb52-49c55b4af32b_del complete
Nov 28 16:06:03 user nova-compute[75176]: INFO nova.compute.manager [None req-43e87918-5313-4033-8d8d-028f2b2d7a93 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: 1062234d-4890-46df-bb52-49c55b4af32b] Took 1.16 seconds to destroy the instance on the hypervisor.
Nov 28 16:06:03 user nova-compute[75176]: DEBUG oslo.service.loopingcall [None req-43e87918-5313-4033-8d8d-028f2b2d7a93 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75176) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 16:06:03 user nova-compute[75176]: DEBUG nova.compute.manager [-] [instance: 1062234d-4890-46df-bb52-49c55b4af32b] Deallocating network for instance {{(pid=75176) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 16:06:03 user nova-compute[75176]: DEBUG nova.network.neutron [-] [instance: 1062234d-4890-46df-bb52-49c55b4af32b] deallocate_for_instance() {{(pid=75176) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 16:06:03 user nova-compute[75176]: DEBUG nova.network.neutron [-] [instance: 1062234d-4890-46df-bb52-49c55b4af32b] Updating instance_info_cache with network_info: [] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 16:06:03 user nova-compute[75176]: INFO nova.compute.manager [-] [instance: 1062234d-4890-46df-bb52-49c55b4af32b] Took 0.42 seconds to deallocate network for instance.
Nov 28 16:06:04 user nova-compute[75176]: DEBUG nova.compute.manager [req-e6baeb28-7e87-43d4-8c5c-400099be2db9 req-0fcede1f-c05e-4f31-ae4a-0e437b9db1f1 service nova] [instance: 1062234d-4890-46df-bb52-49c55b4af32b] Received event network-vif-plugged-3dd39a62-ef9c-4870-be88-578e41ff5013 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 16:06:04 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-e6baeb28-7e87-43d4-8c5c-400099be2db9 req-0fcede1f-c05e-4f31-ae4a-0e437b9db1f1 service nova] Acquiring lock "1062234d-4890-46df-bb52-49c55b4af32b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:06:04 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-e6baeb28-7e87-43d4-8c5c-400099be2db9 req-0fcede1f-c05e-4f31-ae4a-0e437b9db1f1 service nova] Lock "1062234d-4890-46df-bb52-49c55b4af32b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:06:04 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-e6baeb28-7e87-43d4-8c5c-400099be2db9 req-0fcede1f-c05e-4f31-ae4a-0e437b9db1f1 service nova] Lock "1062234d-4890-46df-bb52-49c55b4af32b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:06:04 user nova-compute[75176]: DEBUG nova.compute.manager [req-e6baeb28-7e87-43d4-8c5c-400099be2db9 req-0fcede1f-c05e-4f31-ae4a-0e437b9db1f1 service nova] [instance: 1062234d-4890-46df-bb52-49c55b4af32b] No waiting events found dispatching network-vif-plugged-3dd39a62-ef9c-4870-be88-578e41ff5013 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 16:06:04 user nova-compute[75176]: WARNING nova.compute.manager [req-e6baeb28-7e87-43d4-8c5c-400099be2db9 req-0fcede1f-c05e-4f31-ae4a-0e437b9db1f1 service nova] [instance: 1062234d-4890-46df-bb52-49c55b4af32b] Received unexpected event network-vif-plugged-3dd39a62-ef9c-4870-be88-578e41ff5013 for instance with vm_state active and task_state deleting.
Nov 28 16:06:04 user nova-compute[75176]: DEBUG nova.compute.manager [req-e6baeb28-7e87-43d4-8c5c-400099be2db9 req-0fcede1f-c05e-4f31-ae4a-0e437b9db1f1 service nova] [instance: 1062234d-4890-46df-bb52-49c55b4af32b] Received event network-vif-deleted-3dd39a62-ef9c-4870-be88-578e41ff5013 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 16:06:04 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:06:04 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:06:04 user nova-compute[75176]: INFO nova.compute.manager [None req-43e87918-5313-4033-8d8d-028f2b2d7a93 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: 1062234d-4890-46df-bb52-49c55b4af32b] Took 0.74 seconds to detach 1 volumes for instance.
Nov 28 16:06:04 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-43e87918-5313-4033-8d8d-028f2b2d7a93 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:06:04 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-43e87918-5313-4033-8d8d-028f2b2d7a93 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:06:04 user nova-compute[75176]: DEBUG nova.compute.provider_tree [None req-43e87918-5313-4033-8d8d-028f2b2d7a93 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Inventory has not changed in ProviderTree for provider: b37848d8-f401-4155-a029-b0ffa09ff85b {{(pid=75176) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 16:06:04 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-43e87918-5313-4033-8d8d-028f2b2d7a93 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Inventory has not changed for provider b37848d8-f401-4155-a029-b0ffa09ff85b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75176) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 16:06:05 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-43e87918-5313-4033-8d8d-028f2b2d7a93 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.214s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:06:05 user nova-compute[75176]: INFO nova.scheduler.client.report [None req-43e87918-5313-4033-8d8d-028f2b2d7a93 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Deleted allocations for instance 1062234d-4890-46df-bb52-49c55b4af32b
Nov 28 16:06:05 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-43e87918-5313-4033-8d8d-028f2b2d7a93 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Lock "1062234d-4890-46df-bb52-49c55b4af32b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.704s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:06:06 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:06:06 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Triggering sync for uuid f66ead7d-98f4-4822-9dce-f2ea0206a58d {{(pid=75176) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 16:06:06 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Triggering sync for uuid dc4e6d39-adfb-4d26-afef-46f316ff7846 {{(pid=75176) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 16:06:06 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Triggering sync for uuid ecf38787-0a69-4f35-b121-3dc6e70023a1 {{(pid=75176) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 16:06:06 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Triggering sync for uuid 6c6a4729-9d51-4ebf-bad6-2022f35cbe3b {{(pid=75176) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 16:06:06 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquiring lock "f66ead7d-98f4-4822-9dce-f2ea0206a58d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:06:06 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "f66ead7d-98f4-4822-9dce-f2ea0206a58d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:06:06 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquiring lock "dc4e6d39-adfb-4d26-afef-46f316ff7846" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:06:06 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "dc4e6d39-adfb-4d26-afef-46f316ff7846" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:06:06 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquiring lock "ecf38787-0a69-4f35-b121-3dc6e70023a1" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:06:06 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "ecf38787-0a69-4f35-b121-3dc6e70023a1" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:06:06 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquiring lock "6c6a4729-9d51-4ebf-bad6-2022f35cbe3b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:06:06 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "6c6a4729-9d51-4ebf-bad6-2022f35cbe3b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:06:06 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "dc4e6d39-adfb-4d26-afef-46f316ff7846" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.028s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:06:06 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "ecf38787-0a69-4f35-b121-3dc6e70023a1" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.034s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:06:06 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "f66ead7d-98f4-4822-9dce-f2ea0206a58d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.041s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:06:06 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "6c6a4729-9d51-4ebf-bad6-2022f35cbe3b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.041s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:06:08 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:06:08 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:06:11 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:06:11 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Starting heal instance info cache {{(pid=75176) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 16:06:11 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquiring lock "refresh_cache-dc4e6d39-adfb-4d26-afef-46f316ff7846" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 16:06:11 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquired lock "refresh_cache-dc4e6d39-adfb-4d26-afef-46f316ff7846" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 16:06:11 user nova-compute[75176]: DEBUG nova.network.neutron [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] [instance: dc4e6d39-adfb-4d26-afef-46f316ff7846] Forcefully refreshing network info cache for instance {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 16:06:12 user nova-compute[75176]: DEBUG nova.network.neutron [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] [instance: dc4e6d39-adfb-4d26-afef-46f316ff7846] Updating instance_info_cache with network_info: [{"id": "65eb3123-182c-40fd-b20c-48b19b833f14", "address": "fa:16:3e:59:4a:59", "network": {"id": "998766cd-2e8e-4e39-add9-286086640993", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-989265510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf05c8836b8a40de8e64c2d046ed71ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65eb3123-18", "ovs_interfaceid": "65eb3123-182c-40fd-b20c-48b19b833f14", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 16:06:12 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Releasing lock "refresh_cache-dc4e6d39-adfb-4d26-afef-46f316ff7846" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 16:06:12 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] [instance: dc4e6d39-adfb-4d26-afef-46f316ff7846] Updated the network info_cache for instance {{(pid=75176) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 16:06:12 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:06:12 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:06:12 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75176) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 16:06:13 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 16:06:14 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:06:14 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:06:18 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 16:06:19 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:06:19 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:06:19 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:06:19 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:06:19 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Auditing locally available compute resources for user (node: user) {{(pid=75176) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 16:06:19 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c6a4729-9d51-4ebf-bad6-2022f35cbe3b/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:06:20 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c6a4729-9d51-4ebf-bad6-2022f35cbe3b/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:06:20 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c6a4729-9d51-4ebf-bad6-2022f35cbe3b/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:06:20 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c6a4729-9d51-4ebf-bad6-2022f35cbe3b/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:06:20 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75176) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 16:06:20 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecf38787-0a69-4f35-b121-3dc6e70023a1/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:06:20 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecf38787-0a69-4f35-b121-3dc6e70023a1/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:06:20 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecf38787-0a69-4f35-b121-3dc6e70023a1/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:06:20 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecf38787-0a69-4f35-b121-3dc6e70023a1/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:06:20 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75176) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 16:06:20 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66ead7d-98f4-4822-9dce-f2ea0206a58d/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:06:20 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66ead7d-98f4-4822-9dce-f2ea0206a58d/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:06:20 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66ead7d-98f4-4822-9dce-f2ea0206a58d/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:06:21 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66ead7d-98f4-4822-9dce-f2ea0206a58d/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:06:21 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 16:06:21 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 16:06:21 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Hypervisor/Node resource view: name=user free_ram=8695MB free_disk=24.837329864501953GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75176) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 16:06:21 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:06:21 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:06:21 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance f66ead7d-98f4-4822-9dce-f2ea0206a58d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 16:06:21 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance dc4e6d39-adfb-4d26-afef-46f316ff7846 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 16:06:21 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance ecf38787-0a69-4f35-b121-3dc6e70023a1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 16:06:21 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance 6c6a4729-9d51-4ebf-bad6-2022f35cbe3b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 16:06:21 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75176) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 16:06:21 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75176) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 16:06:21 user nova-compute[75176]: DEBUG nova.compute.provider_tree [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Inventory has not changed in ProviderTree for provider: b37848d8-f401-4155-a029-b0ffa09ff85b {{(pid=75176) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 16:06:21 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Inventory has not changed for provider b37848d8-f401-4155-a029-b0ffa09ff85b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75176) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 16:06:21 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Compute_service record updated for user:user {{(pid=75176) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 16:06:21 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.279s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:06:23 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 16:06:26 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-2bcf3617-1e15-4e6b-a7bd-dc322ae902a4 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Acquiring lock "6c6a4729-9d51-4ebf-bad6-2022f35cbe3b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:06:26 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-2bcf3617-1e15-4e6b-a7bd-dc322ae902a4 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Lock "6c6a4729-9d51-4ebf-bad6-2022f35cbe3b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:06:26 user nova-compute[75176]: INFO nova.compute.manager [None req-2bcf3617-1e15-4e6b-a7bd-dc322ae902a4 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] [instance: 6c6a4729-9d51-4ebf-bad6-2022f35cbe3b] Detaching volume 3676a213-38f2-4682-a210-16696ea2f6ad
Nov 28 16:06:26 user nova-compute[75176]: INFO nova.virt.block_device [None req-2bcf3617-1e15-4e6b-a7bd-dc322ae902a4 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] [instance: 6c6a4729-9d51-4ebf-bad6-2022f35cbe3b] Attempting to driver detach volume 3676a213-38f2-4682-a210-16696ea2f6ad from mountpoint /dev/vdb
Nov 28 16:06:26 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-2bcf3617-1e15-4e6b-a7bd-dc322ae902a4 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Attempting to detach device vdb from instance 6c6a4729-9d51-4ebf-bad6-2022f35cbe3b from the persistent domain config. {{(pid=75176) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 16:06:26 user nova-compute[75176]: DEBUG nova.virt.libvirt.guest [None req-2bcf3617-1e15-4e6b-a7bd-dc322ae902a4 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 16:06:26 user nova-compute[75176]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 16:06:26 user nova-compute[75176]:   <source dev="/dev/sdb"/>
Nov 28 16:06:26 user nova-compute[75176]:   <target dev="vdb" bus="virtio"/>
Nov 28 16:06:26 user nova-compute[75176]:   <serial>3676a213-38f2-4682-a210-16696ea2f6ad</serial>
Nov 28 16:06:26 user nova-compute[75176]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 28 16:06:26 user nova-compute[75176]: </disk>
Nov 28 16:06:26 user nova-compute[75176]:  {{(pid=75176) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 16:06:26 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-2bcf3617-1e15-4e6b-a7bd-dc322ae902a4 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Successfully detached device vdb from instance 6c6a4729-9d51-4ebf-bad6-2022f35cbe3b from the persistent domain config.
Nov 28 16:06:26 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-2bcf3617-1e15-4e6b-a7bd-dc322ae902a4 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6c6a4729-9d51-4ebf-bad6-2022f35cbe3b from the live domain config. {{(pid=75176) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 16:06:26 user nova-compute[75176]: DEBUG nova.virt.libvirt.guest [None req-2bcf3617-1e15-4e6b-a7bd-dc322ae902a4 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 16:06:26 user nova-compute[75176]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 16:06:26 user nova-compute[75176]:   <source dev="/dev/sdb"/>
Nov 28 16:06:26 user nova-compute[75176]:   <target dev="vdb" bus="virtio"/>
Nov 28 16:06:26 user nova-compute[75176]:   <serial>3676a213-38f2-4682-a210-16696ea2f6ad</serial>
Nov 28 16:06:26 user nova-compute[75176]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 28 16:06:26 user nova-compute[75176]: </disk>
Nov 28 16:06:26 user nova-compute[75176]:  {{(pid=75176) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 16:06:26 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-2bcf3617-1e15-4e6b-a7bd-dc322ae902a4 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6c6a4729-9d51-4ebf-bad6-2022f35cbe3b {{(pid=75176) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 16:06:28 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 16:06:28 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:06:28 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75176) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 16:06:28 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75176) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 16:06:28 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75176) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 16:06:28 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:06:29 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:06:33 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:06:34 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:06:38 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:06:43 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:06:46 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-2bcf3617-1e15-4e6b-a7bd-dc322ae902a4 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 6c6a4729-9d51-4ebf-bad6-2022f35cbe3b is timed out.
Nov 28 16:06:46 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-2bcf3617-1e15-4e6b-a7bd-dc322ae902a4 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Successfully detached device vdb from instance 6c6a4729-9d51-4ebf-bad6-2022f35cbe3b from the live domain config.
Nov 28 16:06:46 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2bcf3617-1e15-4e6b-a7bd-dc322ae902a4 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] [instance: 6c6a4729-9d51-4ebf-bad6-2022f35cbe3b] calling os-brick to detach iSCSI Volume {{(pid=75176) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 16:06:46 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bcf3617-1e15-4e6b-a7bd-dc322ae902a4 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c1b8a00>, {'target_iqn': 'iqn.2010-10.org.openstack:3676a213-38f2-4682-a210-16696ea2f6ad', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aoEkygwO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 16:06:46 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-2bcf3617-1e15-4e6b-a7bd-dc322ae902a4 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 16:06:46 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-2bcf3617-1e15-4e6b-a7bd-dc322ae902a4 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 16:06:46 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-2bcf3617-1e15-4e6b-a7bd-dc322ae902a4 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 16:06:46 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:06:46 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:06:46 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe9cc269-f484-463a-a4c1-af2fb3ebfbb5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3676a213-38f2-4682-a210-16696ea2f6ad\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:06:46 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bcf3617-1e15-4e6b-a7bd-dc322ae902a4 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 16:06:46 user nova-compute[75176]: No targets found.
Nov 28 16:06:46 user nova-compute[75176]: iSNS:
Nov 28 16:06:46 user nova-compute[75176]: No targets found.
Nov 28 16:06:46 user nova-compute[75176]: STATIC:
Nov 28 16:06:46 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:3676a213-38f2-4682-a210-16696ea2f6ad
Nov 28 16:06:46 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 16:06:46 user nova-compute[75176]:                 Iface Name: default
Nov 28 16:06:46 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6
Nov 28 16:06:46 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 16:06:46 user nova-compute[75176]:                 Iface Name: default
Nov 28 16:06:46 user nova-compute[75176]: FIRMWARE:
Nov 28 16:06:46 user nova-compute[75176]: No targets found.
Nov 28 16:06:46 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 16:06:46 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bcf3617-1e15-4e6b-a7bd-dc322ae902a4 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 16:06:46 user nova-compute[75176]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 16:06:46 user nova-compute[75176]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75176) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 16:06:46 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bcf3617-1e15-4e6b-a7bd-dc322ae902a4 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3676a213-38f2-4682-a210-16696ea2f6ad', 0)] {{(pid=75176) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 16:06:46 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:06:46 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:06:46 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[c71b38c9-82b9-4557-a1eb-6170f799a46e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3676a213-38f2-4682-a210-16696ea2f6ad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:06:46 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:06:47 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:06:47 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2a9d2be-078c-447f-8b27-7bfc77feb3d7]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 (non-flash)\ntcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3676a213-38f2-4682-a210-16696ea2f6ad (non-flash)\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:06:47 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bcf3617-1e15-4e6b-a7bd-dc322ae902a4 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 (non-flash)
Nov 28 16:06:47 user nova-compute[75176]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3676a213-38f2-4682-a210-16696ea2f6ad (non-flash)
Nov 28 16:06:47 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 16:06:47 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bcf3617-1e15-4e6b-a7bd-dc322ae902a4 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 (non-flash)
Nov 28 16:06:47 user nova-compute[75176]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3676a213-38f2-4682-a210-16696ea2f6ad (non-flash)
Nov 28 16:06:47 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 16:06:47 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bcf3617-1e15-4e6b-a7bd-dc322ae902a4 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f464c0d2170>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3676a213-38f2-4682-a210-16696ea2f6ad'): ({'sdb'}, set())}) {{(pid=75176) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 16:06:47 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-2bcf3617-1e15-4e6b-a7bd-dc322ae902a4 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Removing single pathed devices sdb {{(pid=75176) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 16:06:47 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:06:47 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:06:47 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b2a89e1-e0a2-4fe7-90b4-f4d196baf8c1]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:06:47 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:06:47 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:06:47 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[42884e3e-06e1-4ed4-b4dd-a528d92342b9]: (4, ('ok\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:06:47 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-2bcf3617-1e15-4e6b-a7bd-dc322ae902a4 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Flushing IO for device /dev/sdb {{(pid=75176) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 16:06:47 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:06:47 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:06:47 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[240927eb-103f-4241-b5c4-2b7a6d6346bd]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:06:47 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-2bcf3617-1e15-4e6b-a7bd-dc322ae902a4 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75176) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 16:06:47 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:06:47 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:06:47 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[45fbc423-6d0f-43e2-bc74-ca4a80f6e6fc]: (4, ('1', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:06:47 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-2bcf3617-1e15-4e6b-a7bd-dc322ae902a4 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75176) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 16:06:47 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-2bcf3617-1e15-4e6b-a7bd-dc322ae902a4 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] SCSI volumes sdb have been removed. {{(pid=75176) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 16:06:47 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bcf3617-1e15-4e6b-a7bd-dc322ae902a4 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3676a213-38f2-4682-a210-16696ea2f6ad')] {{(pid=75176) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 16:06:47 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3676a213-38f2-4682-a210-16696ea2f6ad -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:06:47 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3676a213-38f2-4682-a210-16696ea2f6ad -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:06:47 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[607bdd4f-693b-4a39-a054-8228c8a0ba1f]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:06:47 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bcf3617-1e15-4e6b-a7bd-dc322ae902a4 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 16:06:47 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3676a213-38f2-4682-a210-16696ea2f6ad -p 172.16.0.220:3260 --logout {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:06:47 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3676a213-38f2-4682-a210-16696ea2f6ad -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:06:47 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0c70e0c-8b09-47f5-8850-843e9c57a4bb]: (4, ('Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:3676a213-38f2-4682-a210-16696ea2f6ad, portal: 172.16.0.220,3260]\nLogout of [sid: 60, target: iqn.2010-10.org.openstack:3676a213-38f2-4682-a210-16696ea2f6ad, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:06:47 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bcf3617-1e15-4e6b-a7bd-dc322ae902a4 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:3676a213-38f2-4682-a210-16696ea2f6ad, portal: 172.16.0.220,3260]
Nov 28 16:06:47 user nova-compute[75176]: Logout of [sid: 60, target: iqn.2010-10.org.openstack:3676a213-38f2-4682-a210-16696ea2f6ad, portal: 172.16.0.220,3260] successful.
Nov 28 16:06:47 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 16:06:47 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3676a213-38f2-4682-a210-16696ea2f6ad -p 172.16.0.220:3260 --op delete {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:06:47 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3676a213-38f2-4682-a210-16696ea2f6ad -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:06:47 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[c398b454-7231-4ca2-b57a-00e188f55363]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:06:47 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bcf3617-1e15-4e6b-a7bd-dc322ae902a4 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 16:06:47 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-2bcf3617-1e15-4e6b-a7bd-dc322ae902a4 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.291s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 16:06:47 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bcf3617-1e15-4e6b-a7bd-dc322ae902a4 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] <== disconnect_volume: return (293ms) None {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 16:06:47 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2bcf3617-1e15-4e6b-a7bd-dc322ae902a4 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] [instance: 6c6a4729-9d51-4ebf-bad6-2022f35cbe3b] Disconnected iSCSI Volume {{(pid=75176) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 16:06:48 user nova-compute[75176]: DEBUG nova.objects.instance [None req-2bcf3617-1e15-4e6b-a7bd-dc322ae902a4 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Lazy-loading 'flavor' on Instance uuid 6c6a4729-9d51-4ebf-bad6-2022f35cbe3b {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 16:06:48 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-2bcf3617-1e15-4e6b-a7bd-dc322ae902a4 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Lock "6c6a4729-9d51-4ebf-bad6-2022f35cbe3b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.673s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:06:48 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 16:06:48 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:06:48 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75176) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 16:06:48 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75176) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 16:06:48 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75176) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 16:06:48 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:06:48 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-a86e424f-42fd-45e8-84c5-81ead09085bb tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Acquiring lock "6c6a4729-9d51-4ebf-bad6-2022f35cbe3b" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:06:48 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-a86e424f-42fd-45e8-84c5-81ead09085bb tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Lock "6c6a4729-9d51-4ebf-bad6-2022f35cbe3b" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:06:48 user nova-compute[75176]: DEBUG nova.compute.manager [None req-a86e424f-42fd-45e8-84c5-81ead09085bb tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] [instance: 6c6a4729-9d51-4ebf-bad6-2022f35cbe3b] Checking state {{(pid=75176) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 16:06:48 user nova-compute[75176]: DEBUG nova.compute.manager [None req-a86e424f-42fd-45e8-84c5-81ead09085bb tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] [instance: 6c6a4729-9d51-4ebf-bad6-2022f35cbe3b] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=75176) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 28 16:06:48 user nova-compute[75176]: DEBUG nova.objects.instance [None req-a86e424f-42fd-45e8-84c5-81ead09085bb tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Lazy-loading 'flavor' on Instance uuid 6c6a4729-9d51-4ebf-bad6-2022f35cbe3b {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 16:06:49 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:06:49 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:06:49 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:06:49 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:06:49 user nova-compute[75176]: DEBUG nova.compute.manager [req-f871a12c-d262-4484-a63b-7ca9c8957c51 req-593b00cc-4104-4021-ae4d-06a1323753f4 service nova] [instance: 6c6a4729-9d51-4ebf-bad6-2022f35cbe3b] Received event network-vif-unplugged-85a1de78-2430-4835-8122-95570636e300 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 16:06:49 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-f871a12c-d262-4484-a63b-7ca9c8957c51 req-593b00cc-4104-4021-ae4d-06a1323753f4 service nova] Acquiring lock "6c6a4729-9d51-4ebf-bad6-2022f35cbe3b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:06:49 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-f871a12c-d262-4484-a63b-7ca9c8957c51 req-593b00cc-4104-4021-ae4d-06a1323753f4 service nova] Lock "6c6a4729-9d51-4ebf-bad6-2022f35cbe3b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:06:49 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-f871a12c-d262-4484-a63b-7ca9c8957c51 req-593b00cc-4104-4021-ae4d-06a1323753f4 service nova] Lock "6c6a4729-9d51-4ebf-bad6-2022f35cbe3b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:06:49 user nova-compute[75176]: DEBUG nova.compute.manager [req-f871a12c-d262-4484-a63b-7ca9c8957c51 req-593b00cc-4104-4021-ae4d-06a1323753f4 service nova] [instance: 6c6a4729-9d51-4ebf-bad6-2022f35cbe3b] No waiting events found dispatching network-vif-unplugged-85a1de78-2430-4835-8122-95570636e300 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 16:06:49 user nova-compute[75176]: WARNING nova.compute.manager [req-f871a12c-d262-4484-a63b-7ca9c8957c51 req-593b00cc-4104-4021-ae4d-06a1323753f4 service nova] [instance: 6c6a4729-9d51-4ebf-bad6-2022f35cbe3b] Received unexpected event network-vif-unplugged-85a1de78-2430-4835-8122-95570636e300 for instance with vm_state active and task_state powering-off.
Nov 28 16:06:49 user nova-compute[75176]: INFO nova.virt.libvirt.driver [-] [instance: 6c6a4729-9d51-4ebf-bad6-2022f35cbe3b] Instance destroyed successfully.
Nov 28 16:06:49 user nova-compute[75176]: DEBUG nova.compute.manager [None req-a86e424f-42fd-45e8-84c5-81ead09085bb tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] [instance: 6c6a4729-9d51-4ebf-bad6-2022f35cbe3b] Checking state {{(pid=75176) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 16:06:49 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-a86e424f-42fd-45e8-84c5-81ead09085bb tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Lock "6c6a4729-9d51-4ebf-bad6-2022f35cbe3b" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.843s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:06:49 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:06:51 user nova-compute[75176]: DEBUG nova.compute.manager [req-eda6f182-8dee-456a-bb5f-9bc0072356bc req-e363aab4-2959-40a2-be57-38d133cc08de service nova] [instance: 6c6a4729-9d51-4ebf-bad6-2022f35cbe3b] Received event network-vif-plugged-85a1de78-2430-4835-8122-95570636e300 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 16:06:51 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-eda6f182-8dee-456a-bb5f-9bc0072356bc req-e363aab4-2959-40a2-be57-38d133cc08de service nova] Acquiring lock "6c6a4729-9d51-4ebf-bad6-2022f35cbe3b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:06:51 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-eda6f182-8dee-456a-bb5f-9bc0072356bc req-e363aab4-2959-40a2-be57-38d133cc08de service nova] Lock "6c6a4729-9d51-4ebf-bad6-2022f35cbe3b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:06:51 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-eda6f182-8dee-456a-bb5f-9bc0072356bc req-e363aab4-2959-40a2-be57-38d133cc08de service nova] Lock "6c6a4729-9d51-4ebf-bad6-2022f35cbe3b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:06:51 user nova-compute[75176]: DEBUG nova.compute.manager [req-eda6f182-8dee-456a-bb5f-9bc0072356bc req-e363aab4-2959-40a2-be57-38d133cc08de service nova] [instance: 6c6a4729-9d51-4ebf-bad6-2022f35cbe3b] No waiting events found dispatching network-vif-plugged-85a1de78-2430-4835-8122-95570636e300 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 16:06:51 user nova-compute[75176]: WARNING nova.compute.manager [req-eda6f182-8dee-456a-bb5f-9bc0072356bc req-e363aab4-2959-40a2-be57-38d133cc08de service nova] [instance: 6c6a4729-9d51-4ebf-bad6-2022f35cbe3b] Received unexpected event network-vif-plugged-85a1de78-2430-4835-8122-95570636e300 for instance with vm_state stopped and task_state None.
Nov 28 16:06:51 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:06:53 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-13975ef8-9cf5-40b1-beb8-96465e1246b0 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Acquiring lock "ecf38787-0a69-4f35-b121-3dc6e70023a1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:06:53 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-13975ef8-9cf5-40b1-beb8-96465e1246b0 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Lock "ecf38787-0a69-4f35-b121-3dc6e70023a1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:06:53 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-13975ef8-9cf5-40b1-beb8-96465e1246b0 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Acquiring lock "ecf38787-0a69-4f35-b121-3dc6e70023a1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:06:53 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-13975ef8-9cf5-40b1-beb8-96465e1246b0 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Lock "ecf38787-0a69-4f35-b121-3dc6e70023a1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:06:53 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-13975ef8-9cf5-40b1-beb8-96465e1246b0 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Lock "ecf38787-0a69-4f35-b121-3dc6e70023a1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:06:53 user nova-compute[75176]: INFO nova.compute.manager [None req-13975ef8-9cf5-40b1-beb8-96465e1246b0 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: ecf38787-0a69-4f35-b121-3dc6e70023a1] Terminating instance
Nov 28 16:06:53 user nova-compute[75176]: DEBUG nova.compute.manager [None req-13975ef8-9cf5-40b1-beb8-96465e1246b0 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: ecf38787-0a69-4f35-b121-3dc6e70023a1] Start destroying the instance on the hypervisor. {{(pid=75176) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 16:06:53 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:06:53 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:06:53 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:06:53 user nova-compute[75176]: DEBUG nova.compute.manager [req-190739ff-1b51-44d1-8b09-e54ec88a7327 req-e85fb4cf-f011-4141-a53f-ab7a65c2f4ea service nova] [instance: ecf38787-0a69-4f35-b121-3dc6e70023a1] Received event network-vif-unplugged-29444d70-7dc7-4e88-9856-cab5ebd77464 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 16:06:53 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-190739ff-1b51-44d1-8b09-e54ec88a7327 req-e85fb4cf-f011-4141-a53f-ab7a65c2f4ea service nova] Acquiring lock "ecf38787-0a69-4f35-b121-3dc6e70023a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:06:53 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-190739ff-1b51-44d1-8b09-e54ec88a7327 req-e85fb4cf-f011-4141-a53f-ab7a65c2f4ea service nova] Lock "ecf38787-0a69-4f35-b121-3dc6e70023a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:06:53 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-190739ff-1b51-44d1-8b09-e54ec88a7327 req-e85fb4cf-f011-4141-a53f-ab7a65c2f4ea service nova] Lock "ecf38787-0a69-4f35-b121-3dc6e70023a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:06:53 user nova-compute[75176]: DEBUG nova.compute.manager [req-190739ff-1b51-44d1-8b09-e54ec88a7327 req-e85fb4cf-f011-4141-a53f-ab7a65c2f4ea service nova] [instance: ecf38787-0a69-4f35-b121-3dc6e70023a1] No waiting events found dispatching network-vif-unplugged-29444d70-7dc7-4e88-9856-cab5ebd77464 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 16:06:53 user nova-compute[75176]: DEBUG nova.compute.manager [req-190739ff-1b51-44d1-8b09-e54ec88a7327 req-e85fb4cf-f011-4141-a53f-ab7a65c2f4ea service nova] [instance: ecf38787-0a69-4f35-b121-3dc6e70023a1] Received event network-vif-unplugged-29444d70-7dc7-4e88-9856-cab5ebd77464 for instance with task_state deleting. {{(pid=75176) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 16:06:53 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:06:53 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:06:53 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:06:53 user nova-compute[75176]: INFO nova.virt.libvirt.driver [-] [instance: ecf38787-0a69-4f35-b121-3dc6e70023a1] Instance destroyed successfully.
Nov 28 16:06:53 user nova-compute[75176]: DEBUG nova.objects.instance [None req-13975ef8-9cf5-40b1-beb8-96465e1246b0 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Lazy-loading 'resources' on Instance uuid ecf38787-0a69-4f35-b121-3dc6e70023a1 {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 16:06:53 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-13975ef8-9cf5-40b1-beb8-96465e1246b0 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T15:57:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-829781152',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-829781152',id=44,image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-28T15:57:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bf05c8836b8a40de8e64c2d046ed71ff',ramdisk_id='',reservation_id='r-kk1vp13q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1648409789',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T15:59:27Z,user_data=None,user_id='f24cedac95a44bb5a9ee54cc4713945c',uuid=ecf38787-0a69-4f35-b121-3dc6e70023a1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "29444d70-7dc7-4e88-9856-cab5ebd77464", "address": "fa:16:3e:37:aa:5a", "network": {"id": "998766cd-2e8e-4e39-add9-286086640993", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-989265510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf05c8836b8a40de8e64c2d046ed71ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29444d70-7d", "ovs_interfaceid": "29444d70-7dc7-4e88-9856-cab5ebd77464", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 16:06:53 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-13975ef8-9cf5-40b1-beb8-96465e1246b0 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Converting VIF {"id": "29444d70-7dc7-4e88-9856-cab5ebd77464", "address": "fa:16:3e:37:aa:5a", "network": {"id": "998766cd-2e8e-4e39-add9-286086640993", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-989265510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf05c8836b8a40de8e64c2d046ed71ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29444d70-7d", "ovs_interfaceid": "29444d70-7dc7-4e88-9856-cab5ebd77464", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 16:06:53 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-13975ef8-9cf5-40b1-beb8-96465e1246b0 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:37:aa:5a,bridge_name='br-int',has_traffic_filtering=True,id=29444d70-7dc7-4e88-9856-cab5ebd77464,network=Network(998766cd-2e8e-4e39-add9-286086640993),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29444d70-7d') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 16:06:53 user nova-compute[75176]: DEBUG os_vif [None req-13975ef8-9cf5-40b1-beb8-96465e1246b0 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:37:aa:5a,bridge_name='br-int',has_traffic_filtering=True,id=29444d70-7dc7-4e88-9856-cab5ebd77464,network=Network(998766cd-2e8e-4e39-add9-286086640993),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29444d70-7d') {{(pid=75176) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 16:06:53 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:06:53 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap29444d70-7d, bridge=br-int, if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 16:06:53 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:06:53 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 16:06:53 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:06:53 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:06:53 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ee65e93e-183d-4f38-964c-f3a0679410c2) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 16:06:53 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:06:53 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 16:06:53 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:06:53 user nova-compute[75176]: INFO os_vif [None req-13975ef8-9cf5-40b1-beb8-96465e1246b0 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:37:aa:5a,bridge_name='br-int',has_traffic_filtering=True,id=29444d70-7dc7-4e88-9856-cab5ebd77464,network=Network(998766cd-2e8e-4e39-add9-286086640993),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29444d70-7d')
Nov 28 16:06:53 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-13975ef8-9cf5-40b1-beb8-96465e1246b0 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: ecf38787-0a69-4f35-b121-3dc6e70023a1] Deleting instance files /opt/stack/data/nova/instances/ecf38787-0a69-4f35-b121-3dc6e70023a1_del
Nov 28 16:06:53 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-13975ef8-9cf5-40b1-beb8-96465e1246b0 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: ecf38787-0a69-4f35-b121-3dc6e70023a1] Deletion of /opt/stack/data/nova/instances/ecf38787-0a69-4f35-b121-3dc6e70023a1_del complete
Nov 28 16:06:53 user nova-compute[75176]: INFO nova.compute.manager [None req-13975ef8-9cf5-40b1-beb8-96465e1246b0 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: ecf38787-0a69-4f35-b121-3dc6e70023a1] Took 0.67 seconds to destroy the instance on the hypervisor.
Nov 28 16:06:53 user nova-compute[75176]: DEBUG oslo.service.loopingcall [None req-13975ef8-9cf5-40b1-beb8-96465e1246b0 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75176) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 16:06:53 user nova-compute[75176]: DEBUG nova.compute.manager [-] [instance: ecf38787-0a69-4f35-b121-3dc6e70023a1] Deallocating network for instance {{(pid=75176) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 16:06:53 user nova-compute[75176]: DEBUG nova.network.neutron [-] [instance: ecf38787-0a69-4f35-b121-3dc6e70023a1] deallocate_for_instance() {{(pid=75176) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 16:06:54 user nova-compute[75176]: DEBUG nova.network.neutron [-] [instance: ecf38787-0a69-4f35-b121-3dc6e70023a1] Updating instance_info_cache with network_info: [] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 16:06:54 user nova-compute[75176]: INFO nova.compute.manager [-] [instance: ecf38787-0a69-4f35-b121-3dc6e70023a1] Took 0.45 seconds to deallocate network for instance.
Nov 28 16:06:54 user nova-compute[75176]: DEBUG nova.compute.manager [req-5064c344-b2b2-4ad5-93c2-a156c9f3474c req-17e9007b-f7db-441f-8b73-28f77c520f43 service nova] [instance: ecf38787-0a69-4f35-b121-3dc6e70023a1] Received event network-vif-deleted-29444d70-7dc7-4e88-9856-cab5ebd77464 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 16:06:54 user nova-compute[75176]: INFO nova.compute.manager [req-5064c344-b2b2-4ad5-93c2-a156c9f3474c req-17e9007b-f7db-441f-8b73-28f77c520f43 service nova] [instance: ecf38787-0a69-4f35-b121-3dc6e70023a1] Neutron deleted interface 29444d70-7dc7-4e88-9856-cab5ebd77464; detaching it from the instance and deleting it from the info cache
Nov 28 16:06:54 user nova-compute[75176]: DEBUG nova.network.neutron [req-5064c344-b2b2-4ad5-93c2-a156c9f3474c req-17e9007b-f7db-441f-8b73-28f77c520f43 service nova] [instance: ecf38787-0a69-4f35-b121-3dc6e70023a1] Updating instance_info_cache with network_info: [] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 16:06:54 user nova-compute[75176]: DEBUG nova.compute.manager [req-5064c344-b2b2-4ad5-93c2-a156c9f3474c req-17e9007b-f7db-441f-8b73-28f77c520f43 service nova] [instance: ecf38787-0a69-4f35-b121-3dc6e70023a1] Detach interface failed, port_id=29444d70-7dc7-4e88-9856-cab5ebd77464, reason: Instance ecf38787-0a69-4f35-b121-3dc6e70023a1 could not be found. {{(pid=75176) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 28 16:06:54 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-13975ef8-9cf5-40b1-beb8-96465e1246b0 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:06:54 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-13975ef8-9cf5-40b1-beb8-96465e1246b0 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:06:54 user nova-compute[75176]: DEBUG nova.compute.provider_tree [None req-13975ef8-9cf5-40b1-beb8-96465e1246b0 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Inventory has not changed in ProviderTree for provider: b37848d8-f401-4155-a029-b0ffa09ff85b {{(pid=75176) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 16:06:54 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-13975ef8-9cf5-40b1-beb8-96465e1246b0 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Inventory has not changed for provider b37848d8-f401-4155-a029-b0ffa09ff85b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75176) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 16:06:54 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-13975ef8-9cf5-40b1-beb8-96465e1246b0 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.176s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:06:54 user nova-compute[75176]: INFO nova.scheduler.client.report [None req-13975ef8-9cf5-40b1-beb8-96465e1246b0 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Deleted allocations for instance ecf38787-0a69-4f35-b121-3dc6e70023a1
Nov 28 16:06:54 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-13975ef8-9cf5-40b1-beb8-96465e1246b0 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Lock "ecf38787-0a69-4f35-b121-3dc6e70023a1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.539s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:06:55 user nova-compute[75176]: DEBUG nova.compute.manager [req-860caf64-27ef-4c51-b2bf-0e020e2740d9 req-f2b14f07-a218-44de-a142-e921d227bffa service nova] [instance: ecf38787-0a69-4f35-b121-3dc6e70023a1] Received event network-vif-plugged-29444d70-7dc7-4e88-9856-cab5ebd77464 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 16:06:55 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-860caf64-27ef-4c51-b2bf-0e020e2740d9 req-f2b14f07-a218-44de-a142-e921d227bffa service nova] Acquiring lock "ecf38787-0a69-4f35-b121-3dc6e70023a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:06:55 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-860caf64-27ef-4c51-b2bf-0e020e2740d9 req-f2b14f07-a218-44de-a142-e921d227bffa service nova] Lock "ecf38787-0a69-4f35-b121-3dc6e70023a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:06:55 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-860caf64-27ef-4c51-b2bf-0e020e2740d9 req-f2b14f07-a218-44de-a142-e921d227bffa service nova] Lock "ecf38787-0a69-4f35-b121-3dc6e70023a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:06:55 user nova-compute[75176]: DEBUG nova.compute.manager [req-860caf64-27ef-4c51-b2bf-0e020e2740d9 req-f2b14f07-a218-44de-a142-e921d227bffa service nova] [instance: ecf38787-0a69-4f35-b121-3dc6e70023a1] No waiting events found dispatching network-vif-plugged-29444d70-7dc7-4e88-9856-cab5ebd77464 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 16:06:55 user nova-compute[75176]: WARNING nova.compute.manager [req-860caf64-27ef-4c51-b2bf-0e020e2740d9 req-f2b14f07-a218-44de-a142-e921d227bffa service nova] [instance: ecf38787-0a69-4f35-b121-3dc6e70023a1] Received unexpected event network-vif-plugged-29444d70-7dc7-4e88-9856-cab5ebd77464 for instance with vm_state deleted and task_state None.
Nov 28 16:06:58 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:07:03 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:07:07 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:07:07 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:07:08 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 16:07:08 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:07:08 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75176) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 16:07:08 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75176) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 16:07:08 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75176) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 16:07:08 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:07:09 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:07:11 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:07:11 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75176) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 16:07:12 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:07:12 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Starting heal instance info cache {{(pid=75176) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 16:07:12 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquiring lock "refresh_cache-6c6a4729-9d51-4ebf-bad6-2022f35cbe3b" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 16:07:12 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquired lock "refresh_cache-6c6a4729-9d51-4ebf-bad6-2022f35cbe3b" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 16:07:12 user nova-compute[75176]: DEBUG nova.network.neutron [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] [instance: 6c6a4729-9d51-4ebf-bad6-2022f35cbe3b] Forcefully refreshing network info cache for instance {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 16:07:13 user nova-compute[75176]: DEBUG nova.network.neutron [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] [instance: 6c6a4729-9d51-4ebf-bad6-2022f35cbe3b] Updating instance_info_cache with network_info: [{"id": "85a1de78-2430-4835-8122-95570636e300", "address": "fa:16:3e:f4:49:91", "network": {"id": "9faaeac5-1688-436d-90fb-38bb1c4d3da4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1225296735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6aab7b19b9414b5da476b87e144cc40b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85a1de78-24", "ovs_interfaceid": "85a1de78-2430-4835-8122-95570636e300", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 16:07:13 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Releasing lock "refresh_cache-6c6a4729-9d51-4ebf-bad6-2022f35cbe3b" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 16:07:13 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] [instance: 6c6a4729-9d51-4ebf-bad6-2022f35cbe3b] Updated the network info_cache for instance {{(pid=75176) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 16:07:13 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:07:13 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 16:07:13 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:07:14 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:07:15 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:07:15 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:07:15 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:07:18 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:07:19 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-828f9daa-d777-4a60-b062-67a93babf449 tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] Acquiring lock "c4a81a0b-1664-4652-a012-e46ba218ad6b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:07:19 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-828f9daa-d777-4a60-b062-67a93babf449 tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] Lock "c4a81a0b-1664-4652-a012-e46ba218ad6b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:07:19 user nova-compute[75176]: DEBUG nova.compute.manager [None req-828f9daa-d777-4a60-b062-67a93babf449 tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] [instance: c4a81a0b-1664-4652-a012-e46ba218ad6b] Starting instance... {{(pid=75176) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 16:07:19 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-828f9daa-d777-4a60-b062-67a93babf449 tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:07:19 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-828f9daa-d777-4a60-b062-67a93babf449 tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:07:19 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-828f9daa-d777-4a60-b062-67a93babf449 tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75176) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 16:07:19 user nova-compute[75176]: INFO nova.compute.claims [None req-828f9daa-d777-4a60-b062-67a93babf449 tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] [instance: c4a81a0b-1664-4652-a012-e46ba218ad6b] Claim successful on node user
Nov 28 16:07:19 user nova-compute[75176]: DEBUG nova.compute.provider_tree [None req-828f9daa-d777-4a60-b062-67a93babf449 tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] Inventory has not changed in ProviderTree for provider: b37848d8-f401-4155-a029-b0ffa09ff85b {{(pid=75176) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 16:07:19 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-828f9daa-d777-4a60-b062-67a93babf449 tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] Inventory has not changed for provider b37848d8-f401-4155-a029-b0ffa09ff85b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75176) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 16:07:19 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-828f9daa-d777-4a60-b062-67a93babf449 tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.241s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:07:19 user nova-compute[75176]: DEBUG nova.compute.manager [None req-828f9daa-d777-4a60-b062-67a93babf449 tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] [instance: c4a81a0b-1664-4652-a012-e46ba218ad6b] Start building networks asynchronously for instance. {{(pid=75176) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 16:07:19 user nova-compute[75176]: DEBUG nova.compute.manager [None req-828f9daa-d777-4a60-b062-67a93babf449 tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] [instance: c4a81a0b-1664-4652-a012-e46ba218ad6b] Allocating IP information in the background. {{(pid=75176) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 16:07:19 user nova-compute[75176]: DEBUG nova.network.neutron [None req-828f9daa-d777-4a60-b062-67a93babf449 tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] [instance: c4a81a0b-1664-4652-a012-e46ba218ad6b] allocate_for_instance() {{(pid=75176) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 16:07:19 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-828f9daa-d777-4a60-b062-67a93babf449 tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] [instance: c4a81a0b-1664-4652-a012-e46ba218ad6b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 16:07:19 user nova-compute[75176]: DEBUG nova.compute.manager [None req-828f9daa-d777-4a60-b062-67a93babf449 tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] [instance: c4a81a0b-1664-4652-a012-e46ba218ad6b] Start building block device mappings for instance. {{(pid=75176) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 16:07:19 user nova-compute[75176]: DEBUG nova.policy [None req-828f9daa-d777-4a60-b062-67a93babf449 tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '755305bd64eb4fdfafa111b8688d2c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80e74a1524540e4ac5fa47fd10d9f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75176) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 16:07:19 user nova-compute[75176]: DEBUG nova.compute.manager [None req-828f9daa-d777-4a60-b062-67a93babf449 tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] [instance: c4a81a0b-1664-4652-a012-e46ba218ad6b] Start spawning the instance on the hypervisor. {{(pid=75176) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 16:07:19 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-828f9daa-d777-4a60-b062-67a93babf449 tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] [instance: c4a81a0b-1664-4652-a012-e46ba218ad6b] Creating instance directory {{(pid=75176) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 16:07:19 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-828f9daa-d777-4a60-b062-67a93babf449 tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] [instance: c4a81a0b-1664-4652-a012-e46ba218ad6b] Creating image(s)
Nov 28 16:07:19 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-828f9daa-d777-4a60-b062-67a93babf449 tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] Acquiring lock "/opt/stack/data/nova/instances/c4a81a0b-1664-4652-a012-e46ba218ad6b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:07:19 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-828f9daa-d777-4a60-b062-67a93babf449 tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] Lock "/opt/stack/data/nova/instances/c4a81a0b-1664-4652-a012-e46ba218ad6b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:07:19 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-828f9daa-d777-4a60-b062-67a93babf449 tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] Lock "/opt/stack/data/nova/instances/c4a81a0b-1664-4652-a012-e46ba218ad6b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:07:19 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-828f9daa-d777-4a60-b062-67a93babf449 tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:07:19 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:07:20 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-828f9daa-d777-4a60-b062-67a93babf449 tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json" returned: 0 in 0.171s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:07:20 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-828f9daa-d777-4a60-b062-67a93babf449 tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] Acquiring lock "5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:07:20 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-828f9daa-d777-4a60-b062-67a93babf449 tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] Lock "5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:07:20 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-828f9daa-d777-4a60-b062-67a93babf449 tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:07:20 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-828f9daa-d777-4a60-b062-67a93babf449 tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json" returned: 0 in 0.176s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:07:20 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-828f9daa-d777-4a60-b062-67a93babf449 tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2,backing_fmt=raw /opt/stack/data/nova/instances/c4a81a0b-1664-4652-a012-e46ba218ad6b/disk 1073741824 {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:07:20 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-828f9daa-d777-4a60-b062-67a93babf449 tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2,backing_fmt=raw /opt/stack/data/nova/instances/c4a81a0b-1664-4652-a012-e46ba218ad6b/disk 1073741824" returned: 0 in 0.123s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:07:20 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-828f9daa-d777-4a60-b062-67a93babf449 tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] Lock "5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.308s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:07:20 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-828f9daa-d777-4a60-b062-67a93babf449 tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:07:20 user nova-compute[75176]: DEBUG nova.network.neutron [None req-828f9daa-d777-4a60-b062-67a93babf449 tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] [instance: c4a81a0b-1664-4652-a012-e46ba218ad6b] Successfully created port: 7412459a-0537-4479-a6d7-467e74b37b13 {{(pid=75176) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 16:07:20 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-828f9daa-d777-4a60-b062-67a93babf449 tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json" returned: 0 in 0.182s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:07:20 user nova-compute[75176]: DEBUG nova.virt.disk.api [None req-828f9daa-d777-4a60-b062-67a93babf449 tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c4a81a0b-1664-4652-a012-e46ba218ad6b/disk. size=1073741824 {{(pid=75176) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 16:07:20 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-828f9daa-d777-4a60-b062-67a93babf449 tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4a81a0b-1664-4652-a012-e46ba218ad6b/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:07:20 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-828f9daa-d777-4a60-b062-67a93babf449 tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4a81a0b-1664-4652-a012-e46ba218ad6b/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:07:20 user nova-compute[75176]: DEBUG nova.virt.disk.api [None req-828f9daa-d777-4a60-b062-67a93babf449 tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] Cannot resize image /opt/stack/data/nova/instances/c4a81a0b-1664-4652-a012-e46ba218ad6b/disk to a smaller size. {{(pid=75176) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 16:07:20 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-828f9daa-d777-4a60-b062-67a93babf449 tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] [instance: c4a81a0b-1664-4652-a012-e46ba218ad6b] Created local disks {{(pid=75176) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 16:07:20 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-828f9daa-d777-4a60-b062-67a93babf449 tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] [instance: c4a81a0b-1664-4652-a012-e46ba218ad6b] Ensure instance console log exists: /opt/stack/data/nova/instances/c4a81a0b-1664-4652-a012-e46ba218ad6b/console.log {{(pid=75176) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 16:07:20 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-828f9daa-d777-4a60-b062-67a93babf449 tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:07:20 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-828f9daa-d777-4a60-b062-67a93babf449 tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:07:20 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-828f9daa-d777-4a60-b062-67a93babf449 tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:07:21 user nova-compute[75176]: DEBUG nova.network.neutron [None req-828f9daa-d777-4a60-b062-67a93babf449 tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] [instance: c4a81a0b-1664-4652-a012-e46ba218ad6b] Successfully updated port: 7412459a-0537-4479-a6d7-467e74b37b13 {{(pid=75176) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 16:07:21 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-828f9daa-d777-4a60-b062-67a93babf449 tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] Acquiring lock "refresh_cache-c4a81a0b-1664-4652-a012-e46ba218ad6b" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 16:07:21 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-828f9daa-d777-4a60-b062-67a93babf449 tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] Acquired lock "refresh_cache-c4a81a0b-1664-4652-a012-e46ba218ad6b" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 16:07:21 user nova-compute[75176]: DEBUG nova.network.neutron [None req-828f9daa-d777-4a60-b062-67a93babf449 tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] [instance: c4a81a0b-1664-4652-a012-e46ba218ad6b] Building network info cache for instance {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 16:07:21 user nova-compute[75176]: DEBUG nova.compute.manager [req-b4600e8f-3d9d-42be-88f5-f9fbb2fe3e26 req-3b5d7551-c18f-42dc-8a88-e1b758ed2644 service nova] [instance: c4a81a0b-1664-4652-a012-e46ba218ad6b] Received event network-changed-7412459a-0537-4479-a6d7-467e74b37b13 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 16:07:21 user nova-compute[75176]: DEBUG nova.compute.manager [req-b4600e8f-3d9d-42be-88f5-f9fbb2fe3e26 req-3b5d7551-c18f-42dc-8a88-e1b758ed2644 service nova] [instance: c4a81a0b-1664-4652-a012-e46ba218ad6b] Refreshing instance network info cache due to event network-changed-7412459a-0537-4479-a6d7-467e74b37b13. {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 16:07:21 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-b4600e8f-3d9d-42be-88f5-f9fbb2fe3e26 req-3b5d7551-c18f-42dc-8a88-e1b758ed2644 service nova] Acquiring lock "refresh_cache-c4a81a0b-1664-4652-a012-e46ba218ad6b" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 16:07:21 user nova-compute[75176]: DEBUG nova.network.neutron [None req-828f9daa-d777-4a60-b062-67a93babf449 tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] [instance: c4a81a0b-1664-4652-a012-e46ba218ad6b] Instance cache missing network info. {{(pid=75176) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 16:07:21 user nova-compute[75176]: DEBUG nova.network.neutron [None req-828f9daa-d777-4a60-b062-67a93babf449 tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] [instance: c4a81a0b-1664-4652-a012-e46ba218ad6b] Updating instance_info_cache with network_info: [{"id": "7412459a-0537-4479-a6d7-467e74b37b13", "address": "fa:16:3e:ff:1c:42", "network": {"id": "25a35e69-32b6-4a72-8857-26a854eba808", "bridge": "br-int", "label": "tempest-VolumesActionsTest-262226956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a80e74a1524540e4ac5fa47fd10d9f91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7412459a-05", "ovs_interfaceid": "7412459a-0537-4479-a6d7-467e74b37b13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 16:07:21 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-828f9daa-d777-4a60-b062-67a93babf449 tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] Releasing lock "refresh_cache-c4a81a0b-1664-4652-a012-e46ba218ad6b" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 16:07:21 user nova-compute[75176]: DEBUG nova.compute.manager [None req-828f9daa-d777-4a60-b062-67a93babf449 tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] [instance: c4a81a0b-1664-4652-a012-e46ba218ad6b] Instance network_info: |[{"id": "7412459a-0537-4479-a6d7-467e74b37b13", "address": "fa:16:3e:ff:1c:42", "network": {"id": "25a35e69-32b6-4a72-8857-26a854eba808", "bridge": "br-int", "label": "tempest-VolumesActionsTest-262226956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a80e74a1524540e4ac5fa47fd10d9f91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7412459a-05", "ovs_interfaceid": "7412459a-0537-4479-a6d7-467e74b37b13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75176) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 16:07:21 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-b4600e8f-3d9d-42be-88f5-f9fbb2fe3e26 req-3b5d7551-c18f-42dc-8a88-e1b758ed2644 service nova] Acquired lock "refresh_cache-c4a81a0b-1664-4652-a012-e46ba218ad6b" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 16:07:21 user nova-compute[75176]: DEBUG nova.network.neutron [req-b4600e8f-3d9d-42be-88f5-f9fbb2fe3e26 req-3b5d7551-c18f-42dc-8a88-e1b758ed2644 service nova] [instance: c4a81a0b-1664-4652-a012-e46ba218ad6b] Refreshing network info cache for port 7412459a-0537-4479-a6d7-467e74b37b13 {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 16:07:21 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-828f9daa-d777-4a60-b062-67a93babf449 tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] [instance: c4a81a0b-1664-4652-a012-e46ba218ad6b] Start _get_guest_xml network_info=[{"id": "7412459a-0537-4479-a6d7-467e74b37b13", "address": "fa:16:3e:ff:1c:42", "network": {"id": "25a35e69-32b6-4a72-8857-26a854eba808", "bridge": "br-int", "label": "tempest-VolumesActionsTest-262226956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a80e74a1524540e4ac5fa47fd10d9f91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7412459a-05", "ovs_interfaceid": "7412459a-0537-4479-a6d7-467e74b37b13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T15:35:12Z,direct_url=<?>,disk_format='qcow2',id=1f41819e-c93f-4dc7-b253-37a27bbbbc74,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1b91c5d0672c4224a48df2e1f92688e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T15:35:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'size': 0, 'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'image_id': '1f41819e-c93f-4dc7-b253-37a27bbbbc74'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75176) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 16:07:21 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-828f9daa-d777-4a60-b062-67a93babf449 tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 16:07:21 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-828f9daa-d777-4a60-b062-67a93babf449 tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 16:07:21 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-828f9daa-d777-4a60-b062-67a93babf449 tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75176) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 16:07:21 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-828f9daa-d777-4a60-b062-67a93babf449 tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] CPU controller missing on host. {{(pid=75176) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 16:07:21 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-828f9daa-d777-4a60-b062-67a93babf449 tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75176) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 16:07:21 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-828f9daa-d777-4a60-b062-67a93babf449 tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] CPU controller found on host. {{(pid=75176) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 16:07:21 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-828f9daa-d777-4a60-b062-67a93babf449 tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75176) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 16:07:21 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-828f9daa-d777-4a60-b062-67a93babf449 tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T15:35:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T15:35:12Z,direct_url=<?>,disk_format='qcow2',id=1f41819e-c93f-4dc7-b253-37a27bbbbc74,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1b91c5d0672c4224a48df2e1f92688e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T15:35:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 16:07:21 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-828f9daa-d777-4a60-b062-67a93babf449 tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] Flavor limits 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 16:07:21 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-828f9daa-d777-4a60-b062-67a93babf449 tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] Image limits 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 16:07:21 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-828f9daa-d777-4a60-b062-67a93babf449 tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] Flavor pref 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 16:07:21 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-828f9daa-d777-4a60-b062-67a93babf449 tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] Image pref 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 16:07:21 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-828f9daa-d777-4a60-b062-67a93babf449 tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 16:07:21 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-828f9daa-d777-4a60-b062-67a93babf449 tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 16:07:21 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-828f9daa-d777-4a60-b062-67a93babf449 tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75176) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 16:07:21 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-828f9daa-d777-4a60-b062-67a93babf449 tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] Got 1 possible topologies {{(pid=75176) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 16:07:21 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-828f9daa-d777-4a60-b062-67a93babf449 tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 16:07:21 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-828f9daa-d777-4a60-b062-67a93babf449 tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 16:07:21 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-828f9daa-d777-4a60-b062-67a93babf449 tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T16:07:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1745128516',display_name='tempest-VolumesActionsTest-instance-1745128516',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1745128516',id=50,image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a80e74a1524540e4ac5fa47fd10d9f91',ramdisk_id='',reservation_id='r-6asqfeap',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1656567418',owner_user_name='tempest-VolumesActionsTest-1656567418-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T16:07:20Z,user_data=None,user_id='755305bd64eb4fdfafa111b8688d2c4b',uuid=c4a81a0b-1664-4652-a012-e46ba218ad6b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7412459a-0537-4479-a6d7-467e74b37b13", "address": "fa:16:3e:ff:1c:42", "network": {"id": "25a35e69-32b6-4a72-8857-26a854eba808", "bridge": "br-int", "label": "tempest-VolumesActionsTest-262226956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a80e74a1524540e4ac5fa47fd10d9f91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7412459a-05", "ovs_interfaceid": "7412459a-0537-4479-a6d7-467e74b37b13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75176) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 16:07:21 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-828f9daa-d777-4a60-b062-67a93babf449 tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] Converting VIF {"id": "7412459a-0537-4479-a6d7-467e74b37b13", "address": "fa:16:3e:ff:1c:42", "network": {"id": "25a35e69-32b6-4a72-8857-26a854eba808", "bridge": "br-int", "label": "tempest-VolumesActionsTest-262226956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a80e74a1524540e4ac5fa47fd10d9f91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7412459a-05", "ovs_interfaceid": "7412459a-0537-4479-a6d7-467e74b37b13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 16:07:21 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-828f9daa-d777-4a60-b062-67a93babf449 tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:1c:42,bridge_name='br-int',has_traffic_filtering=True,id=7412459a-0537-4479-a6d7-467e74b37b13,network=Network(25a35e69-32b6-4a72-8857-26a854eba808),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7412459a-05') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 16:07:21 user nova-compute[75176]: DEBUG nova.objects.instance [None req-828f9daa-d777-4a60-b062-67a93babf449 tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] Lazy-loading 'pci_devices' on Instance uuid c4a81a0b-1664-4652-a012-e46ba218ad6b {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 16:07:21 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-828f9daa-d777-4a60-b062-67a93babf449 tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] [instance: c4a81a0b-1664-4652-a012-e46ba218ad6b] End _get_guest_xml xml=<domain type="kvm">
Nov 28 16:07:21 user nova-compute[75176]:   <uuid>c4a81a0b-1664-4652-a012-e46ba218ad6b</uuid>
Nov 28 16:07:21 user nova-compute[75176]:   <name>instance-00000032</name>
Nov 28 16:07:21 user nova-compute[75176]:   <memory>524288</memory>
Nov 28 16:07:21 user nova-compute[75176]:   <vcpu>1</vcpu>
Nov 28 16:07:21 user nova-compute[75176]:   <metadata>
Nov 28 16:07:21 user nova-compute[75176]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 16:07:21 user nova-compute[75176]:       <nova:package version="0.0.0"/>
Nov 28 16:07:21 user nova-compute[75176]:       <nova:name>tempest-VolumesActionsTest-instance-1745128516</nova:name>
Nov 28 16:07:21 user nova-compute[75176]:       <nova:creationTime>2023-11-28 16:07:21</nova:creationTime>
Nov 28 16:07:21 user nova-compute[75176]:       <nova:flavor name="m1.tiny">
Nov 28 16:07:21 user nova-compute[75176]:         <nova:memory>512</nova:memory>
Nov 28 16:07:21 user nova-compute[75176]:         <nova:disk>1</nova:disk>
Nov 28 16:07:21 user nova-compute[75176]:         <nova:swap>0</nova:swap>
Nov 28 16:07:21 user nova-compute[75176]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 16:07:21 user nova-compute[75176]:         <nova:vcpus>1</nova:vcpus>
Nov 28 16:07:21 user nova-compute[75176]:       </nova:flavor>
Nov 28 16:07:21 user nova-compute[75176]:       <nova:owner>
Nov 28 16:07:21 user nova-compute[75176]:         <nova:user uuid="755305bd64eb4fdfafa111b8688d2c4b">tempest-VolumesActionsTest-1656567418-project-member</nova:user>
Nov 28 16:07:21 user nova-compute[75176]:         <nova:project uuid="a80e74a1524540e4ac5fa47fd10d9f91">tempest-VolumesActionsTest-1656567418</nova:project>
Nov 28 16:07:21 user nova-compute[75176]:       </nova:owner>
Nov 28 16:07:21 user nova-compute[75176]:       <nova:root type="image" uuid="1f41819e-c93f-4dc7-b253-37a27bbbbc74"/>
Nov 28 16:07:21 user nova-compute[75176]:       <nova:ports>
Nov 28 16:07:21 user nova-compute[75176]:         <nova:port uuid="7412459a-0537-4479-a6d7-467e74b37b13">
Nov 28 16:07:21 user nova-compute[75176]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 28 16:07:21 user nova-compute[75176]:         </nova:port>
Nov 28 16:07:21 user nova-compute[75176]:       </nova:ports>
Nov 28 16:07:21 user nova-compute[75176]:     </nova:instance>
Nov 28 16:07:21 user nova-compute[75176]:   </metadata>
Nov 28 16:07:21 user nova-compute[75176]:   <sysinfo type="smbios">
Nov 28 16:07:21 user nova-compute[75176]:     <system>
Nov 28 16:07:21 user nova-compute[75176]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 16:07:21 user nova-compute[75176]:       <entry name="product">OpenStack Nova</entry>
Nov 28 16:07:21 user nova-compute[75176]:       <entry name="version">0.0.0</entry>
Nov 28 16:07:21 user nova-compute[75176]:       <entry name="serial">c4a81a0b-1664-4652-a012-e46ba218ad6b</entry>
Nov 28 16:07:21 user nova-compute[75176]:       <entry name="uuid">c4a81a0b-1664-4652-a012-e46ba218ad6b</entry>
Nov 28 16:07:21 user nova-compute[75176]:       <entry name="family">Virtual Machine</entry>
Nov 28 16:07:21 user nova-compute[75176]:     </system>
Nov 28 16:07:21 user nova-compute[75176]:   </sysinfo>
Nov 28 16:07:21 user nova-compute[75176]:   <os>
Nov 28 16:07:21 user nova-compute[75176]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 16:07:21 user nova-compute[75176]:     <boot dev="hd"/>
Nov 28 16:07:21 user nova-compute[75176]:     <smbios mode="sysinfo"/>
Nov 28 16:07:21 user nova-compute[75176]:   </os>
Nov 28 16:07:21 user nova-compute[75176]:   <features>
Nov 28 16:07:21 user nova-compute[75176]:     <acpi/>
Nov 28 16:07:21 user nova-compute[75176]:     <apic/>
Nov 28 16:07:21 user nova-compute[75176]:     <vmcoreinfo/>
Nov 28 16:07:21 user nova-compute[75176]:   </features>
Nov 28 16:07:21 user nova-compute[75176]:   <clock offset="utc">
Nov 28 16:07:21 user nova-compute[75176]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 16:07:21 user nova-compute[75176]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 16:07:21 user nova-compute[75176]:     <timer name="hpet" present="no"/>
Nov 28 16:07:21 user nova-compute[75176]:   </clock>
Nov 28 16:07:21 user nova-compute[75176]:   <cpu mode="custom" match="exact">
Nov 28 16:07:21 user nova-compute[75176]:     <model>Nehalem</model>
Nov 28 16:07:21 user nova-compute[75176]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 16:07:21 user nova-compute[75176]:   </cpu>
Nov 28 16:07:21 user nova-compute[75176]:   <devices>
Nov 28 16:07:21 user nova-compute[75176]:     <disk type="file" device="disk">
Nov 28 16:07:21 user nova-compute[75176]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 16:07:21 user nova-compute[75176]:       <source file="/opt/stack/data/nova/instances/c4a81a0b-1664-4652-a012-e46ba218ad6b/disk"/>
Nov 28 16:07:21 user nova-compute[75176]:       <target dev="vda" bus="virtio"/>
Nov 28 16:07:21 user nova-compute[75176]:     </disk>
Nov 28 16:07:21 user nova-compute[75176]:     <interface type="ethernet">
Nov 28 16:07:21 user nova-compute[75176]:       <mac address="fa:16:3e:ff:1c:42"/>
Nov 28 16:07:21 user nova-compute[75176]:       <model type="virtio"/>
Nov 28 16:07:21 user nova-compute[75176]:       <mtu size="1442"/>
Nov 28 16:07:21 user nova-compute[75176]:       <target dev="tap7412459a-05"/>
Nov 28 16:07:21 user nova-compute[75176]:     </interface>
Nov 28 16:07:21 user nova-compute[75176]:     <serial type="pty">
Nov 28 16:07:21 user nova-compute[75176]:       <log file="/opt/stack/data/nova/instances/c4a81a0b-1664-4652-a012-e46ba218ad6b/console.log" append="off"/>
Nov 28 16:07:21 user nova-compute[75176]:     </serial>
Nov 28 16:07:21 user nova-compute[75176]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 16:07:21 user nova-compute[75176]:     <video>
Nov 28 16:07:21 user nova-compute[75176]:       <model type="virtio"/>
Nov 28 16:07:21 user nova-compute[75176]:     </video>
Nov 28 16:07:21 user nova-compute[75176]:     <rng model="virtio">
Nov 28 16:07:21 user nova-compute[75176]:       <backend model="random">/dev/urandom</backend>
Nov 28 16:07:21 user nova-compute[75176]:     </rng>
Nov 28 16:07:21 user nova-compute[75176]:     <controller type="usb" index="0" model="none"/>
Nov 28 16:07:21 user nova-compute[75176]:     <memballoon model="virtio">
Nov 28 16:07:21 user nova-compute[75176]:       <stats period="10"/>
Nov 28 16:07:21 user nova-compute[75176]:     </memballoon>
Nov 28 16:07:21 user nova-compute[75176]:   </devices>
Nov 28 16:07:21 user nova-compute[75176]: </domain>
Nov 28 16:07:21 user nova-compute[75176]:  {{(pid=75176) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 16:07:21 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-828f9daa-d777-4a60-b062-67a93babf449 tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T16:07:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1745128516',display_name='tempest-VolumesActionsTest-instance-1745128516',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1745128516',id=50,image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a80e74a1524540e4ac5fa47fd10d9f91',ramdisk_id='',reservation_id='r-6asqfeap',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1656567418',owner_user_name='tempest-VolumesActionsTest-1656567418-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T16:07:20Z,user_data=None,user_id='755305bd64eb4fdfafa111b8688d2c4b',uuid=c4a81a0b-1664-4652-a012-e46ba218ad6b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7412459a-0537-4479-a6d7-467e74b37b13", "address": "fa:16:3e:ff:1c:42", "network": {"id": "25a35e69-32b6-4a72-8857-26a854eba808", "bridge": "br-int", "label": "tempest-VolumesActionsTest-262226956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a80e74a1524540e4ac5fa47fd10d9f91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7412459a-05", "ovs_interfaceid": "7412459a-0537-4479-a6d7-467e74b37b13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 16:07:21 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-828f9daa-d777-4a60-b062-67a93babf449 tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] Converting VIF {"id": "7412459a-0537-4479-a6d7-467e74b37b13", "address": "fa:16:3e:ff:1c:42", "network": {"id": "25a35e69-32b6-4a72-8857-26a854eba808", "bridge": "br-int", "label": "tempest-VolumesActionsTest-262226956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a80e74a1524540e4ac5fa47fd10d9f91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7412459a-05", "ovs_interfaceid": "7412459a-0537-4479-a6d7-467e74b37b13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 16:07:21 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-828f9daa-d777-4a60-b062-67a93babf449 tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:1c:42,bridge_name='br-int',has_traffic_filtering=True,id=7412459a-0537-4479-a6d7-467e74b37b13,network=Network(25a35e69-32b6-4a72-8857-26a854eba808),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7412459a-05') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 16:07:21 user nova-compute[75176]: DEBUG os_vif [None req-828f9daa-d777-4a60-b062-67a93babf449 tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:1c:42,bridge_name='br-int',has_traffic_filtering=True,id=7412459a-0537-4479-a6d7-467e74b37b13,network=Network(25a35e69-32b6-4a72-8857-26a854eba808),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7412459a-05') {{(pid=75176) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 16:07:21 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:07:21 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 16:07:21 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 16:07:21 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:07:21 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e83b177d-f5b5-525d-811d-14b597c9409d', '_type': 'linux-noop'}}, row=False) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 16:07:21 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:07:21 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 16:07:21 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:07:21 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:07:21 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7412459a-05, may_exist=True, interface_attrs={}) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 16:07:21 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7412459a-05, col_values=(('qos', UUID('834cf72d-5213-4295-be67-4c1677597525')),), if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 16:07:21 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7412459a-05, col_values=(('external_ids', {'iface-id': '7412459a-0537-4479-a6d7-467e74b37b13', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ff:1c:42', 'vm-uuid': 'c4a81a0b-1664-4652-a012-e46ba218ad6b'}),), if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 16:07:21 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:07:21 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 16:07:21 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:07:21 user nova-compute[75176]: INFO os_vif [None req-828f9daa-d777-4a60-b062-67a93babf449 tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:1c:42,bridge_name='br-int',has_traffic_filtering=True,id=7412459a-0537-4479-a6d7-467e74b37b13,network=Network(25a35e69-32b6-4a72-8857-26a854eba808),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7412459a-05')
Nov 28 16:07:21 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-828f9daa-d777-4a60-b062-67a93babf449 tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] No BDM found with device name vda, not building metadata. {{(pid=75176) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 16:07:21 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-828f9daa-d777-4a60-b062-67a93babf449 tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] No VIF found with MAC fa:16:3e:ff:1c:42, not building metadata {{(pid=75176) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 16:07:21 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:07:21 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:07:21 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:07:21 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:07:21 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Auditing locally available compute resources for user (node: user) {{(pid=75176) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 16:07:21 user nova-compute[75176]: DEBUG nova.network.neutron [req-b4600e8f-3d9d-42be-88f5-f9fbb2fe3e26 req-3b5d7551-c18f-42dc-8a88-e1b758ed2644 service nova] [instance: c4a81a0b-1664-4652-a012-e46ba218ad6b] Updated VIF entry in instance network info cache for port 7412459a-0537-4479-a6d7-467e74b37b13. {{(pid=75176) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 16:07:21 user nova-compute[75176]: DEBUG nova.network.neutron [req-b4600e8f-3d9d-42be-88f5-f9fbb2fe3e26 req-3b5d7551-c18f-42dc-8a88-e1b758ed2644 service nova] [instance: c4a81a0b-1664-4652-a012-e46ba218ad6b] Updating instance_info_cache with network_info: [{"id": "7412459a-0537-4479-a6d7-467e74b37b13", "address": "fa:16:3e:ff:1c:42", "network": {"id": "25a35e69-32b6-4a72-8857-26a854eba808", "bridge": "br-int", "label": "tempest-VolumesActionsTest-262226956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a80e74a1524540e4ac5fa47fd10d9f91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7412459a-05", "ovs_interfaceid": "7412459a-0537-4479-a6d7-467e74b37b13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 16:07:21 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-b4600e8f-3d9d-42be-88f5-f9fbb2fe3e26 req-3b5d7551-c18f-42dc-8a88-e1b758ed2644 service nova] Releasing lock "refresh_cache-c4a81a0b-1664-4652-a012-e46ba218ad6b" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 16:07:22 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:07:22 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:07:22 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:07:22 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:07:23 user nova-compute[75176]: DEBUG nova.compute.manager [req-e6502b9c-30fa-4baa-80de-62249712d705 req-72db8cca-6a22-47ac-b369-d918fa136cb5 service nova] [instance: c4a81a0b-1664-4652-a012-e46ba218ad6b] Received event network-vif-plugged-7412459a-0537-4479-a6d7-467e74b37b13 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 16:07:23 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-e6502b9c-30fa-4baa-80de-62249712d705 req-72db8cca-6a22-47ac-b369-d918fa136cb5 service nova] Acquiring lock "c4a81a0b-1664-4652-a012-e46ba218ad6b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:07:23 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-e6502b9c-30fa-4baa-80de-62249712d705 req-72db8cca-6a22-47ac-b369-d918fa136cb5 service nova] Lock "c4a81a0b-1664-4652-a012-e46ba218ad6b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:07:23 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-e6502b9c-30fa-4baa-80de-62249712d705 req-72db8cca-6a22-47ac-b369-d918fa136cb5 service nova] Lock "c4a81a0b-1664-4652-a012-e46ba218ad6b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:07:23 user nova-compute[75176]: DEBUG nova.compute.manager [req-e6502b9c-30fa-4baa-80de-62249712d705 req-72db8cca-6a22-47ac-b369-d918fa136cb5 service nova] [instance: c4a81a0b-1664-4652-a012-e46ba218ad6b] No waiting events found dispatching network-vif-plugged-7412459a-0537-4479-a6d7-467e74b37b13 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 16:07:23 user nova-compute[75176]: WARNING nova.compute.manager [req-e6502b9c-30fa-4baa-80de-62249712d705 req-72db8cca-6a22-47ac-b369-d918fa136cb5 service nova] [instance: c4a81a0b-1664-4652-a012-e46ba218ad6b] Received unexpected event network-vif-plugged-7412459a-0537-4479-a6d7-467e74b37b13 for instance with vm_state building and task_state spawning.
Nov 28 16:07:23 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c6a4729-9d51-4ebf-bad6-2022f35cbe3b/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:07:23 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:07:23 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:07:23 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:07:23 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:07:23 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:07:23 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c6a4729-9d51-4ebf-bad6-2022f35cbe3b/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:07:23 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c6a4729-9d51-4ebf-bad6-2022f35cbe3b/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:07:23 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c6a4729-9d51-4ebf-bad6-2022f35cbe3b/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:07:23 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66ead7d-98f4-4822-9dce-f2ea0206a58d/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:07:23 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66ead7d-98f4-4822-9dce-f2ea0206a58d/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:07:23 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66ead7d-98f4-4822-9dce-f2ea0206a58d/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:07:24 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66ead7d-98f4-4822-9dce-f2ea0206a58d/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:07:24 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75176) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 16:07:24 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4a81a0b-1664-4652-a012-e46ba218ad6b/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:07:24 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4a81a0b-1664-4652-a012-e46ba218ad6b/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:07:24 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4a81a0b-1664-4652-a012-e46ba218ad6b/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:07:24 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4a81a0b-1664-4652-a012-e46ba218ad6b/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:07:24 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 16:07:24 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 16:07:24 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Hypervisor/Node resource view: name=user free_ram=8865MB free_disk=24.959529876708984GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75176) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 16:07:24 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:07:24 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:07:24 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance f66ead7d-98f4-4822-9dce-f2ea0206a58d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 16:07:24 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance dc4e6d39-adfb-4d26-afef-46f316ff7846 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 16:07:24 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance 6c6a4729-9d51-4ebf-bad6-2022f35cbe3b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 16:07:24 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance c4a81a0b-1664-4652-a012-e46ba218ad6b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 16:07:24 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75176) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 16:07:24 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75176) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 16:07:24 user nova-compute[75176]: DEBUG nova.compute.manager [None req-828f9daa-d777-4a60-b062-67a93babf449 tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] [instance: c4a81a0b-1664-4652-a012-e46ba218ad6b] Instance event wait completed in 0 seconds for  {{(pid=75176) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 16:07:24 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-828f9daa-d777-4a60-b062-67a93babf449 tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] [instance: c4a81a0b-1664-4652-a012-e46ba218ad6b] Guest created on hypervisor {{(pid=75176) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 16:07:24 user nova-compute[75176]: INFO nova.virt.libvirt.driver [-] [instance: c4a81a0b-1664-4652-a012-e46ba218ad6b] Instance spawned successfully.
Nov 28 16:07:24 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-828f9daa-d777-4a60-b062-67a93babf449 tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] [instance: c4a81a0b-1664-4652-a012-e46ba218ad6b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 16:07:24 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-828f9daa-d777-4a60-b062-67a93babf449 tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] [instance: c4a81a0b-1664-4652-a012-e46ba218ad6b] Found default for hw_cdrom_bus of ide {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 16:07:24 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-828f9daa-d777-4a60-b062-67a93babf449 tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] [instance: c4a81a0b-1664-4652-a012-e46ba218ad6b] Found default for hw_disk_bus of virtio {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 16:07:24 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-828f9daa-d777-4a60-b062-67a93babf449 tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] [instance: c4a81a0b-1664-4652-a012-e46ba218ad6b] Found default for hw_input_bus of None {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 16:07:24 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-828f9daa-d777-4a60-b062-67a93babf449 tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] [instance: c4a81a0b-1664-4652-a012-e46ba218ad6b] Found default for hw_pointer_model of None {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 16:07:24 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-828f9daa-d777-4a60-b062-67a93babf449 tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] [instance: c4a81a0b-1664-4652-a012-e46ba218ad6b] Found default for hw_video_model of virtio {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 16:07:24 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-828f9daa-d777-4a60-b062-67a93babf449 tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] [instance: c4a81a0b-1664-4652-a012-e46ba218ad6b] Found default for hw_vif_model of virtio {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 16:07:24 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:07:25 user nova-compute[75176]: INFO nova.compute.manager [None req-828f9daa-d777-4a60-b062-67a93babf449 tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] [instance: c4a81a0b-1664-4652-a012-e46ba218ad6b] Took 5.15 seconds to spawn the instance on the hypervisor.
Nov 28 16:07:25 user nova-compute[75176]: DEBUG nova.compute.manager [None req-828f9daa-d777-4a60-b062-67a93babf449 tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] [instance: c4a81a0b-1664-4652-a012-e46ba218ad6b] Checking state {{(pid=75176) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 16:07:25 user nova-compute[75176]: DEBUG nova.compute.provider_tree [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Inventory has not changed in ProviderTree for provider: b37848d8-f401-4155-a029-b0ffa09ff85b {{(pid=75176) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 16:07:25 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Inventory has not changed for provider b37848d8-f401-4155-a029-b0ffa09ff85b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75176) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 16:07:25 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Compute_service record updated for user:user {{(pid=75176) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 16:07:25 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.276s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:07:25 user nova-compute[75176]: INFO nova.compute.manager [None req-828f9daa-d777-4a60-b062-67a93babf449 tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] [instance: c4a81a0b-1664-4652-a012-e46ba218ad6b] Took 5.70 seconds to build instance.
Nov 28 16:07:25 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-828f9daa-d777-4a60-b062-67a93babf449 tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] Lock "c4a81a0b-1664-4652-a012-e46ba218ad6b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.794s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:07:25 user nova-compute[75176]: DEBUG nova.compute.manager [req-eb6e8c1b-a233-4d09-a0b3-6be6ea0485d9 req-1b78670d-a5e2-46bc-b7b7-02373fbb62be service nova] [instance: c4a81a0b-1664-4652-a012-e46ba218ad6b] Received event network-vif-plugged-7412459a-0537-4479-a6d7-467e74b37b13 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 16:07:25 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-eb6e8c1b-a233-4d09-a0b3-6be6ea0485d9 req-1b78670d-a5e2-46bc-b7b7-02373fbb62be service nova] Acquiring lock "c4a81a0b-1664-4652-a012-e46ba218ad6b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:07:25 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-eb6e8c1b-a233-4d09-a0b3-6be6ea0485d9 req-1b78670d-a5e2-46bc-b7b7-02373fbb62be service nova] Lock "c4a81a0b-1664-4652-a012-e46ba218ad6b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:07:25 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-eb6e8c1b-a233-4d09-a0b3-6be6ea0485d9 req-1b78670d-a5e2-46bc-b7b7-02373fbb62be service nova] Lock "c4a81a0b-1664-4652-a012-e46ba218ad6b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:07:25 user nova-compute[75176]: DEBUG nova.compute.manager [req-eb6e8c1b-a233-4d09-a0b3-6be6ea0485d9 req-1b78670d-a5e2-46bc-b7b7-02373fbb62be service nova] [instance: c4a81a0b-1664-4652-a012-e46ba218ad6b] No waiting events found dispatching network-vif-plugged-7412459a-0537-4479-a6d7-467e74b37b13 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 16:07:25 user nova-compute[75176]: WARNING nova.compute.manager [req-eb6e8c1b-a233-4d09-a0b3-6be6ea0485d9 req-1b78670d-a5e2-46bc-b7b7-02373fbb62be service nova] [instance: c4a81a0b-1664-4652-a012-e46ba218ad6b] Received unexpected event network-vif-plugged-7412459a-0537-4479-a6d7-467e74b37b13 for instance with vm_state active and task_state None.
Nov 28 16:07:26 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:07:28 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:07:29 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:07:31 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:07:36 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 16:07:36 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 16:07:36 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75176) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 16:07:36 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75176) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 16:07:36 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75176) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 16:07:36 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:07:39 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:07:41 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:07:43 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-068caca2-72fd-43bd-af60-90555b17fcdd tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Acquiring lock "dc4e6d39-adfb-4d26-afef-46f316ff7846" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:07:43 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-068caca2-72fd-43bd-af60-90555b17fcdd tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Lock "dc4e6d39-adfb-4d26-afef-46f316ff7846" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:07:43 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-068caca2-72fd-43bd-af60-90555b17fcdd tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Acquiring lock "dc4e6d39-adfb-4d26-afef-46f316ff7846-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:07:43 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-068caca2-72fd-43bd-af60-90555b17fcdd tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Lock "dc4e6d39-adfb-4d26-afef-46f316ff7846-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:07:43 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-068caca2-72fd-43bd-af60-90555b17fcdd tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Lock "dc4e6d39-adfb-4d26-afef-46f316ff7846-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:07:43 user nova-compute[75176]: INFO nova.compute.manager [None req-068caca2-72fd-43bd-af60-90555b17fcdd tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: dc4e6d39-adfb-4d26-afef-46f316ff7846] Terminating instance
Nov 28 16:07:43 user nova-compute[75176]: DEBUG nova.compute.manager [None req-068caca2-72fd-43bd-af60-90555b17fcdd tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: dc4e6d39-adfb-4d26-afef-46f316ff7846] Start destroying the instance on the hypervisor. {{(pid=75176) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 16:07:43 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:07:43 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:07:44 user nova-compute[75176]: DEBUG nova.compute.manager [req-5790ac1c-1cb5-48a7-8974-a3f78de65490 req-2c7f6e47-56a5-44c8-82a4-5a14b0357fc8 service nova] [instance: dc4e6d39-adfb-4d26-afef-46f316ff7846] Received event network-vif-unplugged-65eb3123-182c-40fd-b20c-48b19b833f14 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 16:07:44 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-5790ac1c-1cb5-48a7-8974-a3f78de65490 req-2c7f6e47-56a5-44c8-82a4-5a14b0357fc8 service nova] Acquiring lock "dc4e6d39-adfb-4d26-afef-46f316ff7846-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:07:44 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-5790ac1c-1cb5-48a7-8974-a3f78de65490 req-2c7f6e47-56a5-44c8-82a4-5a14b0357fc8 service nova] Lock "dc4e6d39-adfb-4d26-afef-46f316ff7846-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:07:44 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-5790ac1c-1cb5-48a7-8974-a3f78de65490 req-2c7f6e47-56a5-44c8-82a4-5a14b0357fc8 service nova] Lock "dc4e6d39-adfb-4d26-afef-46f316ff7846-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:07:44 user nova-compute[75176]: DEBUG nova.compute.manager [req-5790ac1c-1cb5-48a7-8974-a3f78de65490 req-2c7f6e47-56a5-44c8-82a4-5a14b0357fc8 service nova] [instance: dc4e6d39-adfb-4d26-afef-46f316ff7846] No waiting events found dispatching network-vif-unplugged-65eb3123-182c-40fd-b20c-48b19b833f14 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 16:07:44 user nova-compute[75176]: DEBUG nova.compute.manager [req-5790ac1c-1cb5-48a7-8974-a3f78de65490 req-2c7f6e47-56a5-44c8-82a4-5a14b0357fc8 service nova] [instance: dc4e6d39-adfb-4d26-afef-46f316ff7846] Received event network-vif-unplugged-65eb3123-182c-40fd-b20c-48b19b833f14 for instance with task_state deleting. {{(pid=75176) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 16:07:44 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:07:44 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:07:44 user nova-compute[75176]: INFO nova.virt.libvirt.driver [-] [instance: dc4e6d39-adfb-4d26-afef-46f316ff7846] Instance destroyed successfully.
Nov 28 16:07:44 user nova-compute[75176]: DEBUG nova.objects.instance [None req-068caca2-72fd-43bd-af60-90555b17fcdd tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Lazy-loading 'resources' on Instance uuid dc4e6d39-adfb-4d26-afef-46f316ff7846 {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 16:07:44 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-068caca2-72fd-43bd-af60-90555b17fcdd tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T15:51:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1353594468',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1353594468',id=35,image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-28T15:53:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bf05c8836b8a40de8e64c2d046ed71ff',ramdisk_id='',reservation_id='r-0xcr01a0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1648409789',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T15:55:46Z,user_data=None,user_id='f24cedac95a44bb5a9ee54cc4713945c',uuid=dc4e6d39-adfb-4d26-afef-46f316ff7846,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "65eb3123-182c-40fd-b20c-48b19b833f14", "address": "fa:16:3e:59:4a:59", "network": {"id": "998766cd-2e8e-4e39-add9-286086640993", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-989265510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf05c8836b8a40de8e64c2d046ed71ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65eb3123-18", "ovs_interfaceid": "65eb3123-182c-40fd-b20c-48b19b833f14", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 16:07:44 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-068caca2-72fd-43bd-af60-90555b17fcdd tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Converting VIF {"id": "65eb3123-182c-40fd-b20c-48b19b833f14", "address": "fa:16:3e:59:4a:59", "network": {"id": "998766cd-2e8e-4e39-add9-286086640993", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-989265510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf05c8836b8a40de8e64c2d046ed71ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65eb3123-18", "ovs_interfaceid": "65eb3123-182c-40fd-b20c-48b19b833f14", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 16:07:44 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-068caca2-72fd-43bd-af60-90555b17fcdd tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:59:4a:59,bridge_name='br-int',has_traffic_filtering=True,id=65eb3123-182c-40fd-b20c-48b19b833f14,network=Network(998766cd-2e8e-4e39-add9-286086640993),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65eb3123-18') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 16:07:44 user nova-compute[75176]: DEBUG os_vif [None req-068caca2-72fd-43bd-af60-90555b17fcdd tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:59:4a:59,bridge_name='br-int',has_traffic_filtering=True,id=65eb3123-182c-40fd-b20c-48b19b833f14,network=Network(998766cd-2e8e-4e39-add9-286086640993),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65eb3123-18') {{(pid=75176) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 16:07:44 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:07:44 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap65eb3123-18, bridge=br-int, if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 16:07:44 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:07:44 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 16:07:44 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:07:44 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:07:44 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3464fc32-305b-4f4e-97e7-1a8d6b813df2) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 16:07:44 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:07:44 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 16:07:44 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:07:44 user nova-compute[75176]: INFO os_vif [None req-068caca2-72fd-43bd-af60-90555b17fcdd tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:59:4a:59,bridge_name='br-int',has_traffic_filtering=True,id=65eb3123-182c-40fd-b20c-48b19b833f14,network=Network(998766cd-2e8e-4e39-add9-286086640993),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65eb3123-18')
Nov 28 16:07:44 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-068caca2-72fd-43bd-af60-90555b17fcdd tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: dc4e6d39-adfb-4d26-afef-46f316ff7846] calling os-brick to detach iSCSI Volume {{(pid=75176) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 16:07:44 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-068caca2-72fd-43bd-af60-90555b17fcdd tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c1b8a00>, {'target_iqn': 'iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sIJbvTel', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 16:07:44 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-068caca2-72fd-43bd-af60-90555b17fcdd tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 16:07:44 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-068caca2-72fd-43bd-af60-90555b17fcdd tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 16:07:44 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-068caca2-72fd-43bd-af60-90555b17fcdd tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 16:07:44 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:07:44 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:07:44 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[25abf9d8-2b1d-49d4-894f-f9a562e10b6a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:07:44 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-068caca2-72fd-43bd-af60-90555b17fcdd tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 16:07:44 user nova-compute[75176]: No targets found.
Nov 28 16:07:44 user nova-compute[75176]: iSNS:
Nov 28 16:07:44 user nova-compute[75176]: No targets found.
Nov 28 16:07:44 user nova-compute[75176]: STATIC:
Nov 28 16:07:44 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6
Nov 28 16:07:44 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 16:07:44 user nova-compute[75176]:                 Iface Name: default
Nov 28 16:07:44 user nova-compute[75176]: FIRMWARE:
Nov 28 16:07:44 user nova-compute[75176]: No targets found.
Nov 28 16:07:44 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 16:07:44 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-068caca2-72fd-43bd-af60-90555b17fcdd tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 16:07:44 user nova-compute[75176]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 16:07:44 user nova-compute[75176]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75176) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 16:07:44 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-068caca2-72fd-43bd-af60-90555b17fcdd tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6', 0)] {{(pid=75176) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 16:07:44 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:07:44 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:07:44 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[03736c68-0ed4-49c7-ad24-7b7960455d3f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:07:44 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:07:44 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:07:44 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ef27d70-4825-4944-9363-f3a134ec843b]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 (non-flash)\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:07:44 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-068caca2-72fd-43bd-af60-90555b17fcdd tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 (non-flash)
Nov 28 16:07:44 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 16:07:44 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-068caca2-72fd-43bd-af60-90555b17fcdd tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 (non-flash)
Nov 28 16:07:44 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 16:07:44 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-068caca2-72fd-43bd-af60-90555b17fcdd tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f464c3d6440>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6'): ({'sdd'}, set())}) {{(pid=75176) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 16:07:44 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-068caca2-72fd-43bd-af60-90555b17fcdd tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Removing single pathed devices sdd {{(pid=75176) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 16:07:44 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:07:44 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:07:44 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d9742ff-563a-4a6d-855d-be11e17de50e]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:07:44 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:07:44 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:07:44 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[90a4faca-709f-49c5-88c8-7f8d7d9918cc]: (4, ('ok\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:07:44 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-068caca2-72fd-43bd-af60-90555b17fcdd tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Flushing IO for device /dev/sdd {{(pid=75176) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 16:07:44 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:07:44 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:07:44 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bf53255-39e6-4e53-954b-9d98cee59b62]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:07:44 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-068caca2-72fd-43bd-af60-90555b17fcdd tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75176) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 16:07:44 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:07:44 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.047s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:07:44 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[57bdf866-57ab-4710-b7b2-46d8223f5f84]: (4, ('1', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:07:44 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-068caca2-72fd-43bd-af60-90555b17fcdd tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75176) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 16:07:44 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-068caca2-72fd-43bd-af60-90555b17fcdd tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] SCSI volumes sdd have been removed. {{(pid=75176) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 16:07:44 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-068caca2-72fd-43bd-af60-90555b17fcdd tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6')] {{(pid=75176) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 16:07:44 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:07:44 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:07:44 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[748d14be-90d2-41fa-aa38-eb2f66819c8c]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:07:44 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-068caca2-72fd-43bd-af60-90555b17fcdd tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 16:07:44 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 -p 172.16.0.220:3260 --logout {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:07:44 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:07:44 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb669c8f-5cc3-493b-bae4-bab6ec15cb6b]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:07:44 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-068caca2-72fd-43bd-af60-90555b17fcdd tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6, portal: 172.16.0.220,3260]
Nov 28 16:07:44 user nova-compute[75176]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6, portal: 172.16.0.220,3260] successful.
Nov 28 16:07:44 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 16:07:44 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 -p 172.16.0.220:3260 --op delete {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:07:44 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c4d9db6-5ee1-419c-8f2e-2a758e9798b6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:07:44 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3028da1-af25-41f6-ad84-ebfd569541fd]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:07:44 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-068caca2-72fd-43bd-af60-90555b17fcdd tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 16:07:44 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-068caca2-72fd-43bd-af60-90555b17fcdd tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.304s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 16:07:44 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-068caca2-72fd-43bd-af60-90555b17fcdd tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] <== disconnect_volume: return (305ms) None {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 16:07:44 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-068caca2-72fd-43bd-af60-90555b17fcdd tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: dc4e6d39-adfb-4d26-afef-46f316ff7846] Disconnected iSCSI Volume {{(pid=75176) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 16:07:44 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-068caca2-72fd-43bd-af60-90555b17fcdd tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: dc4e6d39-adfb-4d26-afef-46f316ff7846] Deleting instance files /opt/stack/data/nova/instances/dc4e6d39-adfb-4d26-afef-46f316ff7846_del
Nov 28 16:07:44 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-068caca2-72fd-43bd-af60-90555b17fcdd tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: dc4e6d39-adfb-4d26-afef-46f316ff7846] Deletion of /opt/stack/data/nova/instances/dc4e6d39-adfb-4d26-afef-46f316ff7846_del complete
Nov 28 16:07:44 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:07:45 user nova-compute[75176]: INFO nova.compute.manager [None req-068caca2-72fd-43bd-af60-90555b17fcdd tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: dc4e6d39-adfb-4d26-afef-46f316ff7846] Took 1.17 seconds to destroy the instance on the hypervisor.
Nov 28 16:07:45 user nova-compute[75176]: DEBUG oslo.service.loopingcall [None req-068caca2-72fd-43bd-af60-90555b17fcdd tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75176) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 16:07:45 user nova-compute[75176]: DEBUG nova.compute.manager [-] [instance: dc4e6d39-adfb-4d26-afef-46f316ff7846] Deallocating network for instance {{(pid=75176) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 16:07:45 user nova-compute[75176]: DEBUG nova.network.neutron [-] [instance: dc4e6d39-adfb-4d26-afef-46f316ff7846] deallocate_for_instance() {{(pid=75176) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 16:07:45 user nova-compute[75176]: DEBUG nova.network.neutron [-] [instance: dc4e6d39-adfb-4d26-afef-46f316ff7846] Updating instance_info_cache with network_info: [] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 16:07:45 user nova-compute[75176]: INFO nova.compute.manager [-] [instance: dc4e6d39-adfb-4d26-afef-46f316ff7846] Took 0.36 seconds to deallocate network for instance.
Nov 28 16:07:46 user nova-compute[75176]: INFO nova.compute.manager [None req-068caca2-72fd-43bd-af60-90555b17fcdd tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: dc4e6d39-adfb-4d26-afef-46f316ff7846] Took 0.79 seconds to detach 1 volumes for instance.
Nov 28 16:07:46 user nova-compute[75176]: DEBUG nova.compute.manager [req-bc6d771e-4326-4053-8fcc-cb7d382c29b8 req-ce9a7e22-e85a-4822-b785-b2b9b14625af service nova] [instance: dc4e6d39-adfb-4d26-afef-46f316ff7846] Received event network-vif-plugged-65eb3123-182c-40fd-b20c-48b19b833f14 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 16:07:46 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-bc6d771e-4326-4053-8fcc-cb7d382c29b8 req-ce9a7e22-e85a-4822-b785-b2b9b14625af service nova] Acquiring lock "dc4e6d39-adfb-4d26-afef-46f316ff7846-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:07:46 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-bc6d771e-4326-4053-8fcc-cb7d382c29b8 req-ce9a7e22-e85a-4822-b785-b2b9b14625af service nova] Lock "dc4e6d39-adfb-4d26-afef-46f316ff7846-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:07:46 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-bc6d771e-4326-4053-8fcc-cb7d382c29b8 req-ce9a7e22-e85a-4822-b785-b2b9b14625af service nova] Lock "dc4e6d39-adfb-4d26-afef-46f316ff7846-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:07:46 user nova-compute[75176]: DEBUG nova.compute.manager [req-bc6d771e-4326-4053-8fcc-cb7d382c29b8 req-ce9a7e22-e85a-4822-b785-b2b9b14625af service nova] [instance: dc4e6d39-adfb-4d26-afef-46f316ff7846] No waiting events found dispatching network-vif-plugged-65eb3123-182c-40fd-b20c-48b19b833f14 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 16:07:46 user nova-compute[75176]: WARNING nova.compute.manager [req-bc6d771e-4326-4053-8fcc-cb7d382c29b8 req-ce9a7e22-e85a-4822-b785-b2b9b14625af service nova] [instance: dc4e6d39-adfb-4d26-afef-46f316ff7846] Received unexpected event network-vif-plugged-65eb3123-182c-40fd-b20c-48b19b833f14 for instance with vm_state active and task_state deleting.
Nov 28 16:07:46 user nova-compute[75176]: DEBUG nova.compute.manager [req-bc6d771e-4326-4053-8fcc-cb7d382c29b8 req-ce9a7e22-e85a-4822-b785-b2b9b14625af service nova] [instance: dc4e6d39-adfb-4d26-afef-46f316ff7846] Received event network-vif-deleted-65eb3123-182c-40fd-b20c-48b19b833f14 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 16:07:46 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-068caca2-72fd-43bd-af60-90555b17fcdd tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:07:46 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-068caca2-72fd-43bd-af60-90555b17fcdd tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:07:46 user nova-compute[75176]: DEBUG nova.compute.provider_tree [None req-068caca2-72fd-43bd-af60-90555b17fcdd tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Inventory has not changed in ProviderTree for provider: b37848d8-f401-4155-a029-b0ffa09ff85b {{(pid=75176) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 16:07:46 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-068caca2-72fd-43bd-af60-90555b17fcdd tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Inventory has not changed for provider b37848d8-f401-4155-a029-b0ffa09ff85b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75176) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 16:07:46 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-068caca2-72fd-43bd-af60-90555b17fcdd tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.195s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:07:46 user nova-compute[75176]: INFO nova.scheduler.client.report [None req-068caca2-72fd-43bd-af60-90555b17fcdd tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Deleted allocations for instance dc4e6d39-adfb-4d26-afef-46f316ff7846
Nov 28 16:07:46 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-068caca2-72fd-43bd-af60-90555b17fcdd tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Lock "dc4e6d39-adfb-4d26-afef-46f316ff7846" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.696s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:07:49 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:07:49 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:07:54 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:07:54 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:07:59 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:07:59 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:08:04 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:08:05 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:08:07 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:08:09 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:08:09 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:08:13 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:08:13 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Starting heal instance info cache {{(pid=75176) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 16:08:13 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Rebuilding the list of instances to heal {{(pid=75176) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 16:08:13 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquiring lock "refresh_cache-f66ead7d-98f4-4822-9dce-f2ea0206a58d" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 16:08:13 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquired lock "refresh_cache-f66ead7d-98f4-4822-9dce-f2ea0206a58d" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 16:08:13 user nova-compute[75176]: DEBUG nova.network.neutron [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] [instance: f66ead7d-98f4-4822-9dce-f2ea0206a58d] Forcefully refreshing network info cache for instance {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 16:08:13 user nova-compute[75176]: DEBUG nova.objects.instance [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lazy-loading 'info_cache' on Instance uuid f66ead7d-98f4-4822-9dce-f2ea0206a58d {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 16:08:14 user nova-compute[75176]: DEBUG nova.network.neutron [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] [instance: f66ead7d-98f4-4822-9dce-f2ea0206a58d] Updating instance_info_cache with network_info: [{"id": "30bb2de8-1609-4cd8-8bb1-e32f2c4bfa81", "address": "fa:16:3e:22:f2:8e", "network": {"id": "998766cd-2e8e-4e39-add9-286086640993", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-989265510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf05c8836b8a40de8e64c2d046ed71ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30bb2de8-16", "ovs_interfaceid": "30bb2de8-1609-4cd8-8bb1-e32f2c4bfa81", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 16:08:14 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Releasing lock "refresh_cache-f66ead7d-98f4-4822-9dce-f2ea0206a58d" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 16:08:14 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] [instance: f66ead7d-98f4-4822-9dce-f2ea0206a58d] Updated the network info_cache for instance {{(pid=75176) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 16:08:14 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:08:14 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:08:14 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75176) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 16:08:14 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 16:08:15 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:08:15 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:08:19 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 16:08:22 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:08:22 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:08:22 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:08:22 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:08:22 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Auditing locally available compute resources for user (node: user) {{(pid=75176) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 16:08:22 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c6a4729-9d51-4ebf-bad6-2022f35cbe3b/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:08:22 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c6a4729-9d51-4ebf-bad6-2022f35cbe3b/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:08:22 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c6a4729-9d51-4ebf-bad6-2022f35cbe3b/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:08:23 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c6a4729-9d51-4ebf-bad6-2022f35cbe3b/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:08:23 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66ead7d-98f4-4822-9dce-f2ea0206a58d/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:08:23 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66ead7d-98f4-4822-9dce-f2ea0206a58d/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:08:23 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66ead7d-98f4-4822-9dce-f2ea0206a58d/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:08:23 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66ead7d-98f4-4822-9dce-f2ea0206a58d/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:08:23 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4a81a0b-1664-4652-a012-e46ba218ad6b/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:08:23 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4a81a0b-1664-4652-a012-e46ba218ad6b/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:08:23 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4a81a0b-1664-4652-a012-e46ba218ad6b/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:08:23 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4a81a0b-1664-4652-a012-e46ba218ad6b/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:08:24 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 16:08:24 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 16:08:24 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Hypervisor/Node resource view: name=user free_ram=8836MB free_disk=24.930370330810547GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75176) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 16:08:24 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:08:24 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:08:24 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance f66ead7d-98f4-4822-9dce-f2ea0206a58d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 16:08:24 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance 6c6a4729-9d51-4ebf-bad6-2022f35cbe3b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 16:08:24 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance c4a81a0b-1664-4652-a012-e46ba218ad6b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 16:08:24 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75176) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 16:08:24 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75176) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 16:08:24 user nova-compute[75176]: DEBUG nova.compute.provider_tree [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Inventory has not changed in ProviderTree for provider: b37848d8-f401-4155-a029-b0ffa09ff85b {{(pid=75176) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 16:08:24 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Inventory has not changed for provider b37848d8-f401-4155-a029-b0ffa09ff85b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75176) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 16:08:24 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Compute_service record updated for user:user {{(pid=75176) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 16:08:24 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.247s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:08:24 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 16:08:29 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:08:34 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 16:08:34 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-683fd8c0-e921-4179-9f05-33f67e0782e9 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Acquiring lock "f66ead7d-98f4-4822-9dce-f2ea0206a58d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:08:34 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-683fd8c0-e921-4179-9f05-33f67e0782e9 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Lock "f66ead7d-98f4-4822-9dce-f2ea0206a58d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:08:34 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-683fd8c0-e921-4179-9f05-33f67e0782e9 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Acquiring lock "f66ead7d-98f4-4822-9dce-f2ea0206a58d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:08:34 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-683fd8c0-e921-4179-9f05-33f67e0782e9 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Lock "f66ead7d-98f4-4822-9dce-f2ea0206a58d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:08:34 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-683fd8c0-e921-4179-9f05-33f67e0782e9 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Lock "f66ead7d-98f4-4822-9dce-f2ea0206a58d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:08:34 user nova-compute[75176]: INFO nova.compute.manager [None req-683fd8c0-e921-4179-9f05-33f67e0782e9 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: f66ead7d-98f4-4822-9dce-f2ea0206a58d] Terminating instance
Nov 28 16:08:34 user nova-compute[75176]: DEBUG nova.compute.manager [None req-683fd8c0-e921-4179-9f05-33f67e0782e9 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: f66ead7d-98f4-4822-9dce-f2ea0206a58d] Start destroying the instance on the hypervisor. {{(pid=75176) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 16:08:34 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:08:34 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:08:34 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:08:34 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:08:34 user nova-compute[75176]: DEBUG nova.compute.manager [req-5258e72d-05ac-4651-ad87-6365bbb9d56b req-c26a55f6-f8c4-4367-9e2e-e70103d00988 service nova] [instance: f66ead7d-98f4-4822-9dce-f2ea0206a58d] Received event network-vif-unplugged-30bb2de8-1609-4cd8-8bb1-e32f2c4bfa81 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 16:08:34 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-5258e72d-05ac-4651-ad87-6365bbb9d56b req-c26a55f6-f8c4-4367-9e2e-e70103d00988 service nova] Acquiring lock "f66ead7d-98f4-4822-9dce-f2ea0206a58d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:08:34 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-5258e72d-05ac-4651-ad87-6365bbb9d56b req-c26a55f6-f8c4-4367-9e2e-e70103d00988 service nova] Lock "f66ead7d-98f4-4822-9dce-f2ea0206a58d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:08:34 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-5258e72d-05ac-4651-ad87-6365bbb9d56b req-c26a55f6-f8c4-4367-9e2e-e70103d00988 service nova] Lock "f66ead7d-98f4-4822-9dce-f2ea0206a58d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:08:34 user nova-compute[75176]: DEBUG nova.compute.manager [req-5258e72d-05ac-4651-ad87-6365bbb9d56b req-c26a55f6-f8c4-4367-9e2e-e70103d00988 service nova] [instance: f66ead7d-98f4-4822-9dce-f2ea0206a58d] No waiting events found dispatching network-vif-unplugged-30bb2de8-1609-4cd8-8bb1-e32f2c4bfa81 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 16:08:34 user nova-compute[75176]: DEBUG nova.compute.manager [req-5258e72d-05ac-4651-ad87-6365bbb9d56b req-c26a55f6-f8c4-4367-9e2e-e70103d00988 service nova] [instance: f66ead7d-98f4-4822-9dce-f2ea0206a58d] Received event network-vif-unplugged-30bb2de8-1609-4cd8-8bb1-e32f2c4bfa81 for instance with task_state deleting. {{(pid=75176) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 16:08:35 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:08:35 user nova-compute[75176]: INFO nova.virt.libvirt.driver [-] [instance: f66ead7d-98f4-4822-9dce-f2ea0206a58d] Instance destroyed successfully.
Nov 28 16:08:35 user nova-compute[75176]: DEBUG nova.objects.instance [None req-683fd8c0-e921-4179-9f05-33f67e0782e9 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Lazy-loading 'resources' on Instance uuid f66ead7d-98f4-4822-9dce-f2ea0206a58d {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 16:08:35 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-683fd8c0-e921-4179-9f05-33f67e0782e9 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T15:48:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1211401386',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1211401386',id=30,image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-28T15:49:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bf05c8836b8a40de8e64c2d046ed71ff',ramdisk_id='',reservation_id='r-t3h4fnpo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1648409789',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T15:50:54Z,user_data=None,user_id='f24cedac95a44bb5a9ee54cc4713945c',uuid=f66ead7d-98f4-4822-9dce-f2ea0206a58d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "30bb2de8-1609-4cd8-8bb1-e32f2c4bfa81", "address": "fa:16:3e:22:f2:8e", "network": {"id": "998766cd-2e8e-4e39-add9-286086640993", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-989265510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf05c8836b8a40de8e64c2d046ed71ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30bb2de8-16", "ovs_interfaceid": "30bb2de8-1609-4cd8-8bb1-e32f2c4bfa81", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 16:08:35 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-683fd8c0-e921-4179-9f05-33f67e0782e9 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Converting VIF {"id": "30bb2de8-1609-4cd8-8bb1-e32f2c4bfa81", "address": "fa:16:3e:22:f2:8e", "network": {"id": "998766cd-2e8e-4e39-add9-286086640993", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-989265510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf05c8836b8a40de8e64c2d046ed71ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30bb2de8-16", "ovs_interfaceid": "30bb2de8-1609-4cd8-8bb1-e32f2c4bfa81", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 16:08:35 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-683fd8c0-e921-4179-9f05-33f67e0782e9 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:22:f2:8e,bridge_name='br-int',has_traffic_filtering=True,id=30bb2de8-1609-4cd8-8bb1-e32f2c4bfa81,network=Network(998766cd-2e8e-4e39-add9-286086640993),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30bb2de8-16') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 16:08:35 user nova-compute[75176]: DEBUG os_vif [None req-683fd8c0-e921-4179-9f05-33f67e0782e9 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:22:f2:8e,bridge_name='br-int',has_traffic_filtering=True,id=30bb2de8-1609-4cd8-8bb1-e32f2c4bfa81,network=Network(998766cd-2e8e-4e39-add9-286086640993),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30bb2de8-16') {{(pid=75176) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 16:08:35 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:08:35 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap30bb2de8-16, bridge=br-int, if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 16:08:35 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:08:35 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 16:08:35 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:08:35 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:08:35 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0775a78d-7e38-4bab-aa40-1922a87fc58b) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 16:08:35 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:08:35 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 16:08:35 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:08:35 user nova-compute[75176]: INFO os_vif [None req-683fd8c0-e921-4179-9f05-33f67e0782e9 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:22:f2:8e,bridge_name='br-int',has_traffic_filtering=True,id=30bb2de8-1609-4cd8-8bb1-e32f2c4bfa81,network=Network(998766cd-2e8e-4e39-add9-286086640993),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30bb2de8-16')
Nov 28 16:08:35 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-683fd8c0-e921-4179-9f05-33f67e0782e9 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: f66ead7d-98f4-4822-9dce-f2ea0206a58d] Deleting instance files /opt/stack/data/nova/instances/f66ead7d-98f4-4822-9dce-f2ea0206a58d_del
Nov 28 16:08:35 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-683fd8c0-e921-4179-9f05-33f67e0782e9 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: f66ead7d-98f4-4822-9dce-f2ea0206a58d] Deletion of /opt/stack/data/nova/instances/f66ead7d-98f4-4822-9dce-f2ea0206a58d_del complete
Nov 28 16:08:35 user nova-compute[75176]: INFO nova.compute.manager [None req-683fd8c0-e921-4179-9f05-33f67e0782e9 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] [instance: f66ead7d-98f4-4822-9dce-f2ea0206a58d] Took 0.70 seconds to destroy the instance on the hypervisor.
Nov 28 16:08:35 user nova-compute[75176]: DEBUG oslo.service.loopingcall [None req-683fd8c0-e921-4179-9f05-33f67e0782e9 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75176) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 16:08:35 user nova-compute[75176]: DEBUG nova.compute.manager [-] [instance: f66ead7d-98f4-4822-9dce-f2ea0206a58d] Deallocating network for instance {{(pid=75176) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 16:08:35 user nova-compute[75176]: DEBUG nova.network.neutron [-] [instance: f66ead7d-98f4-4822-9dce-f2ea0206a58d] deallocate_for_instance() {{(pid=75176) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 16:08:35 user nova-compute[75176]: DEBUG nova.network.neutron [-] [instance: f66ead7d-98f4-4822-9dce-f2ea0206a58d] Updating instance_info_cache with network_info: [] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 16:08:35 user nova-compute[75176]: INFO nova.compute.manager [-] [instance: f66ead7d-98f4-4822-9dce-f2ea0206a58d] Took 0.41 seconds to deallocate network for instance.
Nov 28 16:08:35 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-683fd8c0-e921-4179-9f05-33f67e0782e9 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:08:35 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-683fd8c0-e921-4179-9f05-33f67e0782e9 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:08:35 user nova-compute[75176]: DEBUG nova.compute.provider_tree [None req-683fd8c0-e921-4179-9f05-33f67e0782e9 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Inventory has not changed in ProviderTree for provider: b37848d8-f401-4155-a029-b0ffa09ff85b {{(pid=75176) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 16:08:35 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-683fd8c0-e921-4179-9f05-33f67e0782e9 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Inventory has not changed for provider b37848d8-f401-4155-a029-b0ffa09ff85b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75176) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 16:08:36 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-683fd8c0-e921-4179-9f05-33f67e0782e9 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.166s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:08:36 user nova-compute[75176]: INFO nova.scheduler.client.report [None req-683fd8c0-e921-4179-9f05-33f67e0782e9 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Deleted allocations for instance f66ead7d-98f4-4822-9dce-f2ea0206a58d
Nov 28 16:08:36 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-683fd8c0-e921-4179-9f05-33f67e0782e9 tempest-ServerBootFromVolumeStableRescueTest-1648409789 tempest-ServerBootFromVolumeStableRescueTest-1648409789-project-member] Lock "f66ead7d-98f4-4822-9dce-f2ea0206a58d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.455s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:08:36 user nova-compute[75176]: DEBUG nova.compute.manager [req-cfe13f5c-f91e-4a6f-8103-741d1a226fea req-3258f469-7c4a-490c-9ffd-930cec9579f3 service nova] [instance: f66ead7d-98f4-4822-9dce-f2ea0206a58d] Received event network-vif-plugged-30bb2de8-1609-4cd8-8bb1-e32f2c4bfa81 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 16:08:36 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-cfe13f5c-f91e-4a6f-8103-741d1a226fea req-3258f469-7c4a-490c-9ffd-930cec9579f3 service nova] Acquiring lock "f66ead7d-98f4-4822-9dce-f2ea0206a58d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:08:36 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-cfe13f5c-f91e-4a6f-8103-741d1a226fea req-3258f469-7c4a-490c-9ffd-930cec9579f3 service nova] Lock "f66ead7d-98f4-4822-9dce-f2ea0206a58d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:08:36 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-cfe13f5c-f91e-4a6f-8103-741d1a226fea req-3258f469-7c4a-490c-9ffd-930cec9579f3 service nova] Lock "f66ead7d-98f4-4822-9dce-f2ea0206a58d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:08:36 user nova-compute[75176]: DEBUG nova.compute.manager [req-cfe13f5c-f91e-4a6f-8103-741d1a226fea req-3258f469-7c4a-490c-9ffd-930cec9579f3 service nova] [instance: f66ead7d-98f4-4822-9dce-f2ea0206a58d] No waiting events found dispatching network-vif-plugged-30bb2de8-1609-4cd8-8bb1-e32f2c4bfa81 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 16:08:36 user nova-compute[75176]: WARNING nova.compute.manager [req-cfe13f5c-f91e-4a6f-8103-741d1a226fea req-3258f469-7c4a-490c-9ffd-930cec9579f3 service nova] [instance: f66ead7d-98f4-4822-9dce-f2ea0206a58d] Received unexpected event network-vif-plugged-30bb2de8-1609-4cd8-8bb1-e32f2c4bfa81 for instance with vm_state deleted and task_state None.
Nov 28 16:08:36 user nova-compute[75176]: DEBUG nova.compute.manager [req-cfe13f5c-f91e-4a6f-8103-741d1a226fea req-3258f469-7c4a-490c-9ffd-930cec9579f3 service nova] [instance: f66ead7d-98f4-4822-9dce-f2ea0206a58d] Received event network-vif-deleted-30bb2de8-1609-4cd8-8bb1-e32f2c4bfa81 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 16:08:40 user nova-compute[75176]: DEBUG nova.objects.instance [None req-e59715c4-361a-42be-b112-59def30f86a2 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Lazy-loading 'flavor' on Instance uuid 6c6a4729-9d51-4ebf-bad6-2022f35cbe3b {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 16:08:40 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-e59715c4-361a-42be-b112-59def30f86a2 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Acquiring lock "refresh_cache-6c6a4729-9d51-4ebf-bad6-2022f35cbe3b" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 16:08:40 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-e59715c4-361a-42be-b112-59def30f86a2 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Acquired lock "refresh_cache-6c6a4729-9d51-4ebf-bad6-2022f35cbe3b" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 16:08:40 user nova-compute[75176]: DEBUG nova.network.neutron [None req-e59715c4-361a-42be-b112-59def30f86a2 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] [instance: 6c6a4729-9d51-4ebf-bad6-2022f35cbe3b] Building network info cache for instance {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 16:08:40 user nova-compute[75176]: DEBUG nova.objects.instance [None req-e59715c4-361a-42be-b112-59def30f86a2 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Lazy-loading 'info_cache' on Instance uuid 6c6a4729-9d51-4ebf-bad6-2022f35cbe3b {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 16:08:40 user nova-compute[75176]: DEBUG nova.objects.base [None req-e59715c4-361a-42be-b112-59def30f86a2 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Object Instance<6c6a4729-9d51-4ebf-bad6-2022f35cbe3b> lazy-loaded attributes: flavor,info_cache {{(pid=75176) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 16:08:40 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:08:40 user nova-compute[75176]: DEBUG nova.network.neutron [None req-e59715c4-361a-42be-b112-59def30f86a2 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] [instance: 6c6a4729-9d51-4ebf-bad6-2022f35cbe3b] Updating instance_info_cache with network_info: [{"id": "85a1de78-2430-4835-8122-95570636e300", "address": "fa:16:3e:f4:49:91", "network": {"id": "9faaeac5-1688-436d-90fb-38bb1c4d3da4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1225296735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6aab7b19b9414b5da476b87e144cc40b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85a1de78-24", "ovs_interfaceid": "85a1de78-2430-4835-8122-95570636e300", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 16:08:40 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-e59715c4-361a-42be-b112-59def30f86a2 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Releasing lock "refresh_cache-6c6a4729-9d51-4ebf-bad6-2022f35cbe3b" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 16:08:40 user nova-compute[75176]: INFO nova.virt.libvirt.driver [-] [instance: 6c6a4729-9d51-4ebf-bad6-2022f35cbe3b] Instance destroyed successfully.
Nov 28 16:08:40 user nova-compute[75176]: DEBUG nova.objects.instance [None req-e59715c4-361a-42be-b112-59def30f86a2 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Lazy-loading 'resources' on Instance uuid 6c6a4729-9d51-4ebf-bad6-2022f35cbe3b {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 16:08:40 user nova-compute[75176]: DEBUG nova.objects.base [None req-e59715c4-361a-42be-b112-59def30f86a2 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Object Instance<6c6a4729-9d51-4ebf-bad6-2022f35cbe3b> lazy-loaded attributes: flavor,info_cache,resources {{(pid=75176) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 16:08:40 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-e59715c4-361a-42be-b112-59def30f86a2 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T16:00:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-691561062',display_name='tempest-AttachVolumeTestJSON-server-691561062',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-691561062',id=48,image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD9HYYuhew+HwSlGLCtnm5QU3CE4PWqBzdirX5E0yDwA3ZIjV/d7lqYB/DPfiezleSueBjZ4jvmSISqP2Nc+aT8uhbuWQyy+x6kGVNBbHAicQWf8CVd+FflN0YxTFd39NA==',key_name='tempest-keypair-1245727303',keypairs=<?>,launch_index=0,launched_at=2023-11-28T16:00:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='6aab7b19b9414b5da476b87e144cc40b',ramdisk_id='',reservation_id='r-m99ag9fz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-365725655',owner_user_name='tempest-AttachVolumeTestJSON-365725655-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T16:06:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='60b513cfc58647d49fc084d51964a4c6',uuid=6c6a4729-9d51-4ebf-bad6-2022f35cbe3b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "85a1de78-2430-4835-8122-95570636e300", "address": "fa:16:3e:f4:49:91", "network": {"id": "9faaeac5-1688-436d-90fb-38bb1c4d3da4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1225296735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6aab7b19b9414b5da476b87e144cc40b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85a1de78-24", "ovs_interfaceid": "85a1de78-2430-4835-8122-95570636e300", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 16:08:40 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-e59715c4-361a-42be-b112-59def30f86a2 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Converting VIF {"id": "85a1de78-2430-4835-8122-95570636e300", "address": "fa:16:3e:f4:49:91", "network": {"id": "9faaeac5-1688-436d-90fb-38bb1c4d3da4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1225296735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6aab7b19b9414b5da476b87e144cc40b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85a1de78-24", "ovs_interfaceid": "85a1de78-2430-4835-8122-95570636e300", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 16:08:40 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-e59715c4-361a-42be-b112-59def30f86a2 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:49:91,bridge_name='br-int',has_traffic_filtering=True,id=85a1de78-2430-4835-8122-95570636e300,network=Network(9faaeac5-1688-436d-90fb-38bb1c4d3da4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85a1de78-24') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 16:08:40 user nova-compute[75176]: DEBUG os_vif [None req-e59715c4-361a-42be-b112-59def30f86a2 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:49:91,bridge_name='br-int',has_traffic_filtering=True,id=85a1de78-2430-4835-8122-95570636e300,network=Network(9faaeac5-1688-436d-90fb-38bb1c4d3da4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85a1de78-24') {{(pid=75176) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 16:08:40 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:08:40 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap85a1de78-24, bridge=br-int, if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 16:08:40 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:08:40 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 16:08:40 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:08:40 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=eaf2f9ed-b235-46cd-8ec5-f77d8783f1f7) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 16:08:40 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:08:40 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 16:08:40 user nova-compute[75176]: INFO os_vif [None req-e59715c4-361a-42be-b112-59def30f86a2 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:49:91,bridge_name='br-int',has_traffic_filtering=True,id=85a1de78-2430-4835-8122-95570636e300,network=Network(9faaeac5-1688-436d-90fb-38bb1c4d3da4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85a1de78-24')
Nov 28 16:08:40 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-e59715c4-361a-42be-b112-59def30f86a2 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] [instance: 6c6a4729-9d51-4ebf-bad6-2022f35cbe3b] Start _get_guest_xml network_info=[{"id": "85a1de78-2430-4835-8122-95570636e300", "address": "fa:16:3e:f4:49:91", "network": {"id": "9faaeac5-1688-436d-90fb-38bb1c4d3da4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1225296735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6aab7b19b9414b5da476b87e144cc40b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85a1de78-24", "ovs_interfaceid": "85a1de78-2430-4835-8122-95570636e300", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=1f41819e-c93f-4dc7-b253-37a27bbbbc74,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'size': 0, 'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'image_id': '1f41819e-c93f-4dc7-b253-37a27bbbbc74'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75176) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 16:08:40 user nova-compute[75176]: DEBUG nova.objects.instance [None req-e59715c4-361a-42be-b112-59def30f86a2 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Lazy-loading 'numa_topology' on Instance uuid 6c6a4729-9d51-4ebf-bad6-2022f35cbe3b {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 16:08:40 user nova-compute[75176]: DEBUG nova.objects.base [None req-e59715c4-361a-42be-b112-59def30f86a2 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Object Instance<6c6a4729-9d51-4ebf-bad6-2022f35cbe3b> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=75176) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 16:08:40 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-e59715c4-361a-42be-b112-59def30f86a2 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 16:08:40 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-e59715c4-361a-42be-b112-59def30f86a2 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 16:08:40 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-e59715c4-361a-42be-b112-59def30f86a2 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75176) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 16:08:40 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-e59715c4-361a-42be-b112-59def30f86a2 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] CPU controller missing on host. {{(pid=75176) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 16:08:40 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-e59715c4-361a-42be-b112-59def30f86a2 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75176) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 16:08:40 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-e59715c4-361a-42be-b112-59def30f86a2 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] CPU controller found on host. {{(pid=75176) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 16:08:41 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-e59715c4-361a-42be-b112-59def30f86a2 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75176) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 16:08:41 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-e59715c4-361a-42be-b112-59def30f86a2 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T15:35:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=1f41819e-c93f-4dc7-b253-37a27bbbbc74,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 16:08:41 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-e59715c4-361a-42be-b112-59def30f86a2 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Flavor limits 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 16:08:41 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-e59715c4-361a-42be-b112-59def30f86a2 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Image limits 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 16:08:41 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-e59715c4-361a-42be-b112-59def30f86a2 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Flavor pref 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 16:08:41 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-e59715c4-361a-42be-b112-59def30f86a2 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Image pref 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 16:08:41 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-e59715c4-361a-42be-b112-59def30f86a2 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 16:08:41 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-e59715c4-361a-42be-b112-59def30f86a2 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 16:08:41 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-e59715c4-361a-42be-b112-59def30f86a2 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75176) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 16:08:41 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-e59715c4-361a-42be-b112-59def30f86a2 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Got 1 possible topologies {{(pid=75176) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 16:08:41 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-e59715c4-361a-42be-b112-59def30f86a2 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 16:08:41 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-e59715c4-361a-42be-b112-59def30f86a2 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 16:08:41 user nova-compute[75176]: DEBUG nova.objects.instance [None req-e59715c4-361a-42be-b112-59def30f86a2 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Lazy-loading 'vcpu_model' on Instance uuid 6c6a4729-9d51-4ebf-bad6-2022f35cbe3b {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 16:08:41 user nova-compute[75176]: DEBUG nova.objects.base [None req-e59715c4-361a-42be-b112-59def30f86a2 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Object Instance<6c6a4729-9d51-4ebf-bad6-2022f35cbe3b> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=75176) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 16:08:41 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-e59715c4-361a-42be-b112-59def30f86a2 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T16:00:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-691561062',display_name='tempest-AttachVolumeTestJSON-server-691561062',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-691561062',id=48,image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD9HYYuhew+HwSlGLCtnm5QU3CE4PWqBzdirX5E0yDwA3ZIjV/d7lqYB/DPfiezleSueBjZ4jvmSISqP2Nc+aT8uhbuWQyy+x6kGVNBbHAicQWf8CVd+FflN0YxTFd39NA==',key_name='tempest-keypair-1245727303',keypairs=<?>,launch_index=0,launched_at=2023-11-28T16:00:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='6aab7b19b9414b5da476b87e144cc40b',ramdisk_id='',reservation_id='r-m99ag9fz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-365725655',owner_user_name='tempest-AttachVolumeTestJSON-365725655-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T16:06:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='60b513cfc58647d49fc084d51964a4c6',uuid=6c6a4729-9d51-4ebf-bad6-2022f35cbe3b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "85a1de78-2430-4835-8122-95570636e300", "address": "fa:16:3e:f4:49:91", "network": {"id": "9faaeac5-1688-436d-90fb-38bb1c4d3da4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1225296735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6aab7b19b9414b5da476b87e144cc40b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85a1de78-24", "ovs_interfaceid": "85a1de78-2430-4835-8122-95570636e300", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75176) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 16:08:41 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-e59715c4-361a-42be-b112-59def30f86a2 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Converting VIF {"id": "85a1de78-2430-4835-8122-95570636e300", "address": "fa:16:3e:f4:49:91", "network": {"id": "9faaeac5-1688-436d-90fb-38bb1c4d3da4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1225296735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6aab7b19b9414b5da476b87e144cc40b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85a1de78-24", "ovs_interfaceid": "85a1de78-2430-4835-8122-95570636e300", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 16:08:41 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-e59715c4-361a-42be-b112-59def30f86a2 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:49:91,bridge_name='br-int',has_traffic_filtering=True,id=85a1de78-2430-4835-8122-95570636e300,network=Network(9faaeac5-1688-436d-90fb-38bb1c4d3da4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85a1de78-24') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 16:08:41 user nova-compute[75176]: DEBUG nova.objects.instance [None req-e59715c4-361a-42be-b112-59def30f86a2 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Lazy-loading 'pci_devices' on Instance uuid 6c6a4729-9d51-4ebf-bad6-2022f35cbe3b {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 16:08:41 user nova-compute[75176]: DEBUG nova.objects.base [None req-e59715c4-361a-42be-b112-59def30f86a2 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Object Instance<6c6a4729-9d51-4ebf-bad6-2022f35cbe3b> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=75176) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 16:08:41 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-e59715c4-361a-42be-b112-59def30f86a2 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] [instance: 6c6a4729-9d51-4ebf-bad6-2022f35cbe3b] End _get_guest_xml xml=<domain type="kvm">
Nov 28 16:08:41 user nova-compute[75176]:   <uuid>6c6a4729-9d51-4ebf-bad6-2022f35cbe3b</uuid>
Nov 28 16:08:41 user nova-compute[75176]:   <name>instance-00000030</name>
Nov 28 16:08:41 user nova-compute[75176]:   <memory>524288</memory>
Nov 28 16:08:41 user nova-compute[75176]:   <vcpu>1</vcpu>
Nov 28 16:08:41 user nova-compute[75176]:   <metadata>
Nov 28 16:08:41 user nova-compute[75176]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 16:08:41 user nova-compute[75176]:       <nova:package version="0.0.0"/>
Nov 28 16:08:41 user nova-compute[75176]:       <nova:name>tempest-AttachVolumeTestJSON-server-691561062</nova:name>
Nov 28 16:08:41 user nova-compute[75176]:       <nova:creationTime>2023-11-28 16:08:40</nova:creationTime>
Nov 28 16:08:41 user nova-compute[75176]:       <nova:flavor name="m1.tiny">
Nov 28 16:08:41 user nova-compute[75176]:         <nova:memory>512</nova:memory>
Nov 28 16:08:41 user nova-compute[75176]:         <nova:disk>1</nova:disk>
Nov 28 16:08:41 user nova-compute[75176]:         <nova:swap>0</nova:swap>
Nov 28 16:08:41 user nova-compute[75176]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 16:08:41 user nova-compute[75176]:         <nova:vcpus>1</nova:vcpus>
Nov 28 16:08:41 user nova-compute[75176]:       </nova:flavor>
Nov 28 16:08:41 user nova-compute[75176]:       <nova:owner>
Nov 28 16:08:41 user nova-compute[75176]:         <nova:user uuid="60b513cfc58647d49fc084d51964a4c6">tempest-AttachVolumeTestJSON-365725655-project-member</nova:user>
Nov 28 16:08:41 user nova-compute[75176]:         <nova:project uuid="6aab7b19b9414b5da476b87e144cc40b">tempest-AttachVolumeTestJSON-365725655</nova:project>
Nov 28 16:08:41 user nova-compute[75176]:       </nova:owner>
Nov 28 16:08:41 user nova-compute[75176]:       <nova:root type="image" uuid="1f41819e-c93f-4dc7-b253-37a27bbbbc74"/>
Nov 28 16:08:41 user nova-compute[75176]:       <nova:ports>
Nov 28 16:08:41 user nova-compute[75176]:         <nova:port uuid="85a1de78-2430-4835-8122-95570636e300">
Nov 28 16:08:41 user nova-compute[75176]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 28 16:08:41 user nova-compute[75176]:         </nova:port>
Nov 28 16:08:41 user nova-compute[75176]:       </nova:ports>
Nov 28 16:08:41 user nova-compute[75176]:     </nova:instance>
Nov 28 16:08:41 user nova-compute[75176]:   </metadata>
Nov 28 16:08:41 user nova-compute[75176]:   <sysinfo type="smbios">
Nov 28 16:08:41 user nova-compute[75176]:     <system>
Nov 28 16:08:41 user nova-compute[75176]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 16:08:41 user nova-compute[75176]:       <entry name="product">OpenStack Nova</entry>
Nov 28 16:08:41 user nova-compute[75176]:       <entry name="version">0.0.0</entry>
Nov 28 16:08:41 user nova-compute[75176]:       <entry name="serial">6c6a4729-9d51-4ebf-bad6-2022f35cbe3b</entry>
Nov 28 16:08:41 user nova-compute[75176]:       <entry name="uuid">6c6a4729-9d51-4ebf-bad6-2022f35cbe3b</entry>
Nov 28 16:08:41 user nova-compute[75176]:       <entry name="family">Virtual Machine</entry>
Nov 28 16:08:41 user nova-compute[75176]:     </system>
Nov 28 16:08:41 user nova-compute[75176]:   </sysinfo>
Nov 28 16:08:41 user nova-compute[75176]:   <os>
Nov 28 16:08:41 user nova-compute[75176]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 16:08:41 user nova-compute[75176]:     <boot dev="hd"/>
Nov 28 16:08:41 user nova-compute[75176]:     <smbios mode="sysinfo"/>
Nov 28 16:08:41 user nova-compute[75176]:   </os>
Nov 28 16:08:41 user nova-compute[75176]:   <features>
Nov 28 16:08:41 user nova-compute[75176]:     <acpi/>
Nov 28 16:08:41 user nova-compute[75176]:     <apic/>
Nov 28 16:08:41 user nova-compute[75176]:     <vmcoreinfo/>
Nov 28 16:08:41 user nova-compute[75176]:   </features>
Nov 28 16:08:41 user nova-compute[75176]:   <clock offset="utc">
Nov 28 16:08:41 user nova-compute[75176]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 16:08:41 user nova-compute[75176]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 16:08:41 user nova-compute[75176]:     <timer name="hpet" present="no"/>
Nov 28 16:08:41 user nova-compute[75176]:   </clock>
Nov 28 16:08:41 user nova-compute[75176]:   <cpu mode="custom" match="exact">
Nov 28 16:08:41 user nova-compute[75176]:     <model>Nehalem</model>
Nov 28 16:08:41 user nova-compute[75176]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 16:08:41 user nova-compute[75176]:   </cpu>
Nov 28 16:08:41 user nova-compute[75176]:   <devices>
Nov 28 16:08:41 user nova-compute[75176]:     <disk type="file" device="disk">
Nov 28 16:08:41 user nova-compute[75176]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 16:08:41 user nova-compute[75176]:       <source file="/opt/stack/data/nova/instances/6c6a4729-9d51-4ebf-bad6-2022f35cbe3b/disk"/>
Nov 28 16:08:41 user nova-compute[75176]:       <target dev="vda" bus="virtio"/>
Nov 28 16:08:41 user nova-compute[75176]:     </disk>
Nov 28 16:08:41 user nova-compute[75176]:     <interface type="ethernet">
Nov 28 16:08:41 user nova-compute[75176]:       <mac address="fa:16:3e:f4:49:91"/>
Nov 28 16:08:41 user nova-compute[75176]:       <model type="virtio"/>
Nov 28 16:08:41 user nova-compute[75176]:       <mtu size="1442"/>
Nov 28 16:08:41 user nova-compute[75176]:       <target dev="tap85a1de78-24"/>
Nov 28 16:08:41 user nova-compute[75176]:     </interface>
Nov 28 16:08:41 user nova-compute[75176]:     <serial type="pty">
Nov 28 16:08:41 user nova-compute[75176]:       <log file="/opt/stack/data/nova/instances/6c6a4729-9d51-4ebf-bad6-2022f35cbe3b/console.log" append="off"/>
Nov 28 16:08:41 user nova-compute[75176]:     </serial>
Nov 28 16:08:41 user nova-compute[75176]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 16:08:41 user nova-compute[75176]:     <video>
Nov 28 16:08:41 user nova-compute[75176]:       <model type="virtio"/>
Nov 28 16:08:41 user nova-compute[75176]:     </video>
Nov 28 16:08:41 user nova-compute[75176]:     <rng model="virtio">
Nov 28 16:08:41 user nova-compute[75176]:       <backend model="random">/dev/urandom</backend>
Nov 28 16:08:41 user nova-compute[75176]:     </rng>
Nov 28 16:08:41 user nova-compute[75176]:     <controller type="usb" index="0" model="none"/>
Nov 28 16:08:41 user nova-compute[75176]:     <memballoon model="virtio">
Nov 28 16:08:41 user nova-compute[75176]:       <stats period="10"/>
Nov 28 16:08:41 user nova-compute[75176]:     </memballoon>
Nov 28 16:08:41 user nova-compute[75176]:   </devices>
Nov 28 16:08:41 user nova-compute[75176]: </domain>
Nov 28 16:08:41 user nova-compute[75176]:  {{(pid=75176) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 16:08:41 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-e59715c4-361a-42be-b112-59def30f86a2 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c6a4729-9d51-4ebf-bad6-2022f35cbe3b/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:08:41 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-e59715c4-361a-42be-b112-59def30f86a2 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c6a4729-9d51-4ebf-bad6-2022f35cbe3b/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:08:41 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-e59715c4-361a-42be-b112-59def30f86a2 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c6a4729-9d51-4ebf-bad6-2022f35cbe3b/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:08:41 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-e59715c4-361a-42be-b112-59def30f86a2 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c6a4729-9d51-4ebf-bad6-2022f35cbe3b/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:08:41 user nova-compute[75176]: DEBUG nova.objects.instance [None req-e59715c4-361a-42be-b112-59def30f86a2 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Lazy-loading 'trusted_certs' on Instance uuid 6c6a4729-9d51-4ebf-bad6-2022f35cbe3b {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 16:08:41 user nova-compute[75176]: DEBUG nova.objects.base [None req-e59715c4-361a-42be-b112-59def30f86a2 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Object Instance<6c6a4729-9d51-4ebf-bad6-2022f35cbe3b> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=75176) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 16:08:41 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-e59715c4-361a-42be-b112-59def30f86a2 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:08:41 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-e59715c4-361a-42be-b112-59def30f86a2 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json" returned: 0 in 0.176s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:08:41 user nova-compute[75176]: DEBUG nova.virt.disk.api [None req-e59715c4-361a-42be-b112-59def30f86a2 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6c6a4729-9d51-4ebf-bad6-2022f35cbe3b/disk. size=1073741824 {{(pid=75176) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 16:08:41 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-e59715c4-361a-42be-b112-59def30f86a2 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c6a4729-9d51-4ebf-bad6-2022f35cbe3b/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:08:41 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-e59715c4-361a-42be-b112-59def30f86a2 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c6a4729-9d51-4ebf-bad6-2022f35cbe3b/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:08:41 user nova-compute[75176]: DEBUG nova.virt.disk.api [None req-e59715c4-361a-42be-b112-59def30f86a2 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Cannot resize image /opt/stack/data/nova/instances/6c6a4729-9d51-4ebf-bad6-2022f35cbe3b/disk to a smaller size. {{(pid=75176) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 16:08:41 user nova-compute[75176]: DEBUG nova.objects.instance [None req-e59715c4-361a-42be-b112-59def30f86a2 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Lazy-loading 'migration_context' on Instance uuid 6c6a4729-9d51-4ebf-bad6-2022f35cbe3b {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 16:08:41 user nova-compute[75176]: DEBUG nova.objects.base [None req-e59715c4-361a-42be-b112-59def30f86a2 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Object Instance<6c6a4729-9d51-4ebf-bad6-2022f35cbe3b> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75176) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 16:08:41 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-e59715c4-361a-42be-b112-59def30f86a2 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T16:00:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-691561062',display_name='tempest-AttachVolumeTestJSON-server-691561062',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-691561062',id=48,image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD9HYYuhew+HwSlGLCtnm5QU3CE4PWqBzdirX5E0yDwA3ZIjV/d7lqYB/DPfiezleSueBjZ4jvmSISqP2Nc+aT8uhbuWQyy+x6kGVNBbHAicQWf8CVd+FflN0YxTFd39NA==',key_name='tempest-keypair-1245727303',keypairs=<?>,launch_index=0,launched_at=2023-11-28T16:00:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='6aab7b19b9414b5da476b87e144cc40b',ramdisk_id='',reservation_id='r-m99ag9fz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-365725655',owner_user_name='tempest-AttachVolumeTestJSON-365725655-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T16:06:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='60b513cfc58647d49fc084d51964a4c6',uuid=6c6a4729-9d51-4ebf-bad6-2022f35cbe3b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "85a1de78-2430-4835-8122-95570636e300", "address": "fa:16:3e:f4:49:91", "network": {"id": "9faaeac5-1688-436d-90fb-38bb1c4d3da4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1225296735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6aab7b19b9414b5da476b87e144cc40b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85a1de78-24", "ovs_interfaceid": "85a1de78-2430-4835-8122-95570636e300", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 16:08:41 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-e59715c4-361a-42be-b112-59def30f86a2 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Converting VIF {"id": "85a1de78-2430-4835-8122-95570636e300", "address": "fa:16:3e:f4:49:91", "network": {"id": "9faaeac5-1688-436d-90fb-38bb1c4d3da4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1225296735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6aab7b19b9414b5da476b87e144cc40b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85a1de78-24", "ovs_interfaceid": "85a1de78-2430-4835-8122-95570636e300", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 16:08:41 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-e59715c4-361a-42be-b112-59def30f86a2 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:49:91,bridge_name='br-int',has_traffic_filtering=True,id=85a1de78-2430-4835-8122-95570636e300,network=Network(9faaeac5-1688-436d-90fb-38bb1c4d3da4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85a1de78-24') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 16:08:41 user nova-compute[75176]: DEBUG os_vif [None req-e59715c4-361a-42be-b112-59def30f86a2 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:49:91,bridge_name='br-int',has_traffic_filtering=True,id=85a1de78-2430-4835-8122-95570636e300,network=Network(9faaeac5-1688-436d-90fb-38bb1c4d3da4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85a1de78-24') {{(pid=75176) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 16:08:41 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:08:41 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 16:08:41 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 16:08:41 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:08:41 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e880c5d5-4e14-57e8-9b30-bc4eeed8a398', '_type': 'linux-noop'}}, row=False) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 16:08:41 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:08:41 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 16:08:41 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:08:41 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap85a1de78-24, may_exist=True, interface_attrs={}) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 16:08:41 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap85a1de78-24, col_values=(('qos', UUID('3f57d930-2201-4114-ada3-ef55e4c6e252')),), if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 16:08:41 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap85a1de78-24, col_values=(('external_ids', {'iface-id': '85a1de78-2430-4835-8122-95570636e300', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f4:49:91', 'vm-uuid': '6c6a4729-9d51-4ebf-bad6-2022f35cbe3b'}),), if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 16:08:41 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:08:41 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 16:08:41 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:08:41 user nova-compute[75176]: INFO os_vif [None req-e59715c4-361a-42be-b112-59def30f86a2 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:49:91,bridge_name='br-int',has_traffic_filtering=True,id=85a1de78-2430-4835-8122-95570636e300,network=Network(9faaeac5-1688-436d-90fb-38bb1c4d3da4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85a1de78-24')
Nov 28 16:08:43 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:08:43 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:08:43 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:08:43 user nova-compute[75176]: DEBUG nova.compute.manager [req-1cf277fe-6669-48d0-9ffa-3db93d3f09d2 req-b109b4c2-793c-40fc-8640-421c57d6bb39 service nova] [instance: 6c6a4729-9d51-4ebf-bad6-2022f35cbe3b] Received event network-vif-plugged-85a1de78-2430-4835-8122-95570636e300 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 16:08:43 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-1cf277fe-6669-48d0-9ffa-3db93d3f09d2 req-b109b4c2-793c-40fc-8640-421c57d6bb39 service nova] Acquiring lock "6c6a4729-9d51-4ebf-bad6-2022f35cbe3b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:08:43 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-1cf277fe-6669-48d0-9ffa-3db93d3f09d2 req-b109b4c2-793c-40fc-8640-421c57d6bb39 service nova] Lock "6c6a4729-9d51-4ebf-bad6-2022f35cbe3b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:08:43 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-1cf277fe-6669-48d0-9ffa-3db93d3f09d2 req-b109b4c2-793c-40fc-8640-421c57d6bb39 service nova] Lock "6c6a4729-9d51-4ebf-bad6-2022f35cbe3b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:08:43 user nova-compute[75176]: DEBUG nova.compute.manager [req-1cf277fe-6669-48d0-9ffa-3db93d3f09d2 req-b109b4c2-793c-40fc-8640-421c57d6bb39 service nova] [instance: 6c6a4729-9d51-4ebf-bad6-2022f35cbe3b] No waiting events found dispatching network-vif-plugged-85a1de78-2430-4835-8122-95570636e300 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 16:08:43 user nova-compute[75176]: WARNING nova.compute.manager [req-1cf277fe-6669-48d0-9ffa-3db93d3f09d2 req-b109b4c2-793c-40fc-8640-421c57d6bb39 service nova] [instance: 6c6a4729-9d51-4ebf-bad6-2022f35cbe3b] Received unexpected event network-vif-plugged-85a1de78-2430-4835-8122-95570636e300 for instance with vm_state stopped and task_state powering-on.
Nov 28 16:08:43 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:08:43 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:08:45 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:08:45 user nova-compute[75176]: DEBUG nova.compute.manager [None req-e59715c4-361a-42be-b112-59def30f86a2 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] [instance: 6c6a4729-9d51-4ebf-bad6-2022f35cbe3b] Instance event wait completed in 0 seconds for  {{(pid=75176) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 16:08:45 user nova-compute[75176]: INFO nova.virt.libvirt.driver [-] [instance: 6c6a4729-9d51-4ebf-bad6-2022f35cbe3b] Instance rebooted successfully.
Nov 28 16:08:45 user nova-compute[75176]: DEBUG nova.compute.manager [None req-e59715c4-361a-42be-b112-59def30f86a2 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] [instance: 6c6a4729-9d51-4ebf-bad6-2022f35cbe3b] Checking state {{(pid=75176) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 16:08:45 user nova-compute[75176]: DEBUG nova.compute.manager [req-80a21ed6-3212-49af-99c0-7e5ea3fb145e req-2fefd8e7-de12-4c10-b6be-c6393b18733b service nova] [instance: 6c6a4729-9d51-4ebf-bad6-2022f35cbe3b] Received event network-vif-plugged-85a1de78-2430-4835-8122-95570636e300 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 16:08:45 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-80a21ed6-3212-49af-99c0-7e5ea3fb145e req-2fefd8e7-de12-4c10-b6be-c6393b18733b service nova] Acquiring lock "6c6a4729-9d51-4ebf-bad6-2022f35cbe3b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:08:45 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-80a21ed6-3212-49af-99c0-7e5ea3fb145e req-2fefd8e7-de12-4c10-b6be-c6393b18733b service nova] Lock "6c6a4729-9d51-4ebf-bad6-2022f35cbe3b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:08:45 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-80a21ed6-3212-49af-99c0-7e5ea3fb145e req-2fefd8e7-de12-4c10-b6be-c6393b18733b service nova] Lock "6c6a4729-9d51-4ebf-bad6-2022f35cbe3b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:08:45 user nova-compute[75176]: DEBUG nova.compute.manager [req-80a21ed6-3212-49af-99c0-7e5ea3fb145e req-2fefd8e7-de12-4c10-b6be-c6393b18733b service nova] [instance: 6c6a4729-9d51-4ebf-bad6-2022f35cbe3b] No waiting events found dispatching network-vif-plugged-85a1de78-2430-4835-8122-95570636e300 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 16:08:45 user nova-compute[75176]: WARNING nova.compute.manager [req-80a21ed6-3212-49af-99c0-7e5ea3fb145e req-2fefd8e7-de12-4c10-b6be-c6393b18733b service nova] [instance: 6c6a4729-9d51-4ebf-bad6-2022f35cbe3b] Received unexpected event network-vif-plugged-85a1de78-2430-4835-8122-95570636e300 for instance with vm_state active and task_state None.
Nov 28 16:08:46 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:08:50 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:08:51 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:08:56 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 16:08:56 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:08:56 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75176) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 16:08:56 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75176) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 16:08:56 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75176) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 16:08:56 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:09:00 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:09:01 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:09:05 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:09:06 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:09:08 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:09:08 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:09:09 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:09:09 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-1d2a682f-d5bd-4484-b28f-cb71b9a803ba tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] Acquiring lock "c4a81a0b-1664-4652-a012-e46ba218ad6b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:09:09 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-1d2a682f-d5bd-4484-b28f-cb71b9a803ba tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] Lock "c4a81a0b-1664-4652-a012-e46ba218ad6b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:09:09 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-1d2a682f-d5bd-4484-b28f-cb71b9a803ba tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] Acquiring lock "c4a81a0b-1664-4652-a012-e46ba218ad6b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:09:09 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-1d2a682f-d5bd-4484-b28f-cb71b9a803ba tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] Lock "c4a81a0b-1664-4652-a012-e46ba218ad6b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:09:09 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-1d2a682f-d5bd-4484-b28f-cb71b9a803ba tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] Lock "c4a81a0b-1664-4652-a012-e46ba218ad6b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:09:09 user nova-compute[75176]: INFO nova.compute.manager [None req-1d2a682f-d5bd-4484-b28f-cb71b9a803ba tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] [instance: c4a81a0b-1664-4652-a012-e46ba218ad6b] Terminating instance
Nov 28 16:09:09 user nova-compute[75176]: DEBUG nova.compute.manager [None req-1d2a682f-d5bd-4484-b28f-cb71b9a803ba tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] [instance: c4a81a0b-1664-4652-a012-e46ba218ad6b] Start destroying the instance on the hypervisor. {{(pid=75176) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 16:09:09 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:09:09 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:09:09 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:09:09 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:09:10 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:09:10 user nova-compute[75176]: DEBUG nova.compute.manager [req-bea1e62b-8d1f-4330-bdf4-7b17afeb2947 req-c529a387-cb2c-4590-b270-dc74c4304d91 service nova] [instance: c4a81a0b-1664-4652-a012-e46ba218ad6b] Received event network-vif-unplugged-7412459a-0537-4479-a6d7-467e74b37b13 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 16:09:10 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-bea1e62b-8d1f-4330-bdf4-7b17afeb2947 req-c529a387-cb2c-4590-b270-dc74c4304d91 service nova] Acquiring lock "c4a81a0b-1664-4652-a012-e46ba218ad6b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:09:10 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-bea1e62b-8d1f-4330-bdf4-7b17afeb2947 req-c529a387-cb2c-4590-b270-dc74c4304d91 service nova] Lock "c4a81a0b-1664-4652-a012-e46ba218ad6b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:09:10 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-bea1e62b-8d1f-4330-bdf4-7b17afeb2947 req-c529a387-cb2c-4590-b270-dc74c4304d91 service nova] Lock "c4a81a0b-1664-4652-a012-e46ba218ad6b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:09:10 user nova-compute[75176]: DEBUG nova.compute.manager [req-bea1e62b-8d1f-4330-bdf4-7b17afeb2947 req-c529a387-cb2c-4590-b270-dc74c4304d91 service nova] [instance: c4a81a0b-1664-4652-a012-e46ba218ad6b] No waiting events found dispatching network-vif-unplugged-7412459a-0537-4479-a6d7-467e74b37b13 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 16:09:10 user nova-compute[75176]: DEBUG nova.compute.manager [req-bea1e62b-8d1f-4330-bdf4-7b17afeb2947 req-c529a387-cb2c-4590-b270-dc74c4304d91 service nova] [instance: c4a81a0b-1664-4652-a012-e46ba218ad6b] Received event network-vif-unplugged-7412459a-0537-4479-a6d7-467e74b37b13 for instance with task_state deleting. {{(pid=75176) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 16:09:10 user nova-compute[75176]: INFO nova.virt.libvirt.driver [-] [instance: c4a81a0b-1664-4652-a012-e46ba218ad6b] Instance destroyed successfully.
Nov 28 16:09:10 user nova-compute[75176]: DEBUG nova.objects.instance [None req-1d2a682f-d5bd-4484-b28f-cb71b9a803ba tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] Lazy-loading 'resources' on Instance uuid c4a81a0b-1664-4652-a012-e46ba218ad6b {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 16:09:10 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-1d2a682f-d5bd-4484-b28f-cb71b9a803ba tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T16:07:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1745128516',display_name='tempest-VolumesActionsTest-instance-1745128516',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1745128516',id=50,image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-28T16:07:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a80e74a1524540e4ac5fa47fd10d9f91',ramdisk_id='',reservation_id='r-6asqfeap',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1656567418',owner_user_name='tempest-VolumesActionsTest-1656567418-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T16:07:25Z,user_data=None,user_id='755305bd64eb4fdfafa111b8688d2c4b',uuid=c4a81a0b-1664-4652-a012-e46ba218ad6b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7412459a-0537-4479-a6d7-467e74b37b13", "address": "fa:16:3e:ff:1c:42", "network": {"id": "25a35e69-32b6-4a72-8857-26a854eba808", "bridge": "br-int", "label": "tempest-VolumesActionsTest-262226956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a80e74a1524540e4ac5fa47fd10d9f91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7412459a-05", "ovs_interfaceid": "7412459a-0537-4479-a6d7-467e74b37b13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 16:09:10 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-1d2a682f-d5bd-4484-b28f-cb71b9a803ba tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] Converting VIF {"id": "7412459a-0537-4479-a6d7-467e74b37b13", "address": "fa:16:3e:ff:1c:42", "network": {"id": "25a35e69-32b6-4a72-8857-26a854eba808", "bridge": "br-int", "label": "tempest-VolumesActionsTest-262226956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a80e74a1524540e4ac5fa47fd10d9f91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7412459a-05", "ovs_interfaceid": "7412459a-0537-4479-a6d7-467e74b37b13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 16:09:10 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-1d2a682f-d5bd-4484-b28f-cb71b9a803ba tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:1c:42,bridge_name='br-int',has_traffic_filtering=True,id=7412459a-0537-4479-a6d7-467e74b37b13,network=Network(25a35e69-32b6-4a72-8857-26a854eba808),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7412459a-05') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 16:09:10 user nova-compute[75176]: DEBUG os_vif [None req-1d2a682f-d5bd-4484-b28f-cb71b9a803ba tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:1c:42,bridge_name='br-int',has_traffic_filtering=True,id=7412459a-0537-4479-a6d7-467e74b37b13,network=Network(25a35e69-32b6-4a72-8857-26a854eba808),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7412459a-05') {{(pid=75176) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 16:09:10 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:09:10 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7412459a-05, bridge=br-int, if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 16:09:10 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:09:10 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 16:09:10 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:09:10 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=834cf72d-5213-4295-be67-4c1677597525) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 16:09:10 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:09:10 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 16:09:10 user nova-compute[75176]: INFO os_vif [None req-1d2a682f-d5bd-4484-b28f-cb71b9a803ba tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:1c:42,bridge_name='br-int',has_traffic_filtering=True,id=7412459a-0537-4479-a6d7-467e74b37b13,network=Network(25a35e69-32b6-4a72-8857-26a854eba808),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7412459a-05')
Nov 28 16:09:10 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-1d2a682f-d5bd-4484-b28f-cb71b9a803ba tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] [instance: c4a81a0b-1664-4652-a012-e46ba218ad6b] Deleting instance files /opt/stack/data/nova/instances/c4a81a0b-1664-4652-a012-e46ba218ad6b_del
Nov 28 16:09:10 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-1d2a682f-d5bd-4484-b28f-cb71b9a803ba tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] [instance: c4a81a0b-1664-4652-a012-e46ba218ad6b] Deletion of /opt/stack/data/nova/instances/c4a81a0b-1664-4652-a012-e46ba218ad6b_del complete
Nov 28 16:09:10 user nova-compute[75176]: INFO nova.compute.manager [None req-1d2a682f-d5bd-4484-b28f-cb71b9a803ba tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] [instance: c4a81a0b-1664-4652-a012-e46ba218ad6b] Took 0.83 seconds to destroy the instance on the hypervisor.
Nov 28 16:09:10 user nova-compute[75176]: DEBUG oslo.service.loopingcall [None req-1d2a682f-d5bd-4484-b28f-cb71b9a803ba tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75176) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 16:09:10 user nova-compute[75176]: DEBUG nova.compute.manager [-] [instance: c4a81a0b-1664-4652-a012-e46ba218ad6b] Deallocating network for instance {{(pid=75176) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 16:09:10 user nova-compute[75176]: DEBUG nova.network.neutron [-] [instance: c4a81a0b-1664-4652-a012-e46ba218ad6b] deallocate_for_instance() {{(pid=75176) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 16:09:11 user nova-compute[75176]: DEBUG nova.network.neutron [-] [instance: c4a81a0b-1664-4652-a012-e46ba218ad6b] Updating instance_info_cache with network_info: [] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 16:09:11 user nova-compute[75176]: INFO nova.compute.manager [-] [instance: c4a81a0b-1664-4652-a012-e46ba218ad6b] Took 0.43 seconds to deallocate network for instance.
Nov 28 16:09:11 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-1d2a682f-d5bd-4484-b28f-cb71b9a803ba tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:09:11 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-1d2a682f-d5bd-4484-b28f-cb71b9a803ba tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:09:11 user nova-compute[75176]: DEBUG nova.compute.provider_tree [None req-1d2a682f-d5bd-4484-b28f-cb71b9a803ba tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] Inventory has not changed in ProviderTree for provider: b37848d8-f401-4155-a029-b0ffa09ff85b {{(pid=75176) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 16:09:11 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-1d2a682f-d5bd-4484-b28f-cb71b9a803ba tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] Inventory has not changed for provider b37848d8-f401-4155-a029-b0ffa09ff85b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75176) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 16:09:11 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-1d2a682f-d5bd-4484-b28f-cb71b9a803ba tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.132s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:09:11 user nova-compute[75176]: INFO nova.scheduler.client.report [None req-1d2a682f-d5bd-4484-b28f-cb71b9a803ba tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] Deleted allocations for instance c4a81a0b-1664-4652-a012-e46ba218ad6b
Nov 28 16:09:11 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-1d2a682f-d5bd-4484-b28f-cb71b9a803ba tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] Lock "c4a81a0b-1664-4652-a012-e46ba218ad6b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.593s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:09:12 user nova-compute[75176]: DEBUG nova.compute.manager [req-439931f5-9d7c-446a-bdc5-41319dc8ac7c req-17eec5c1-030a-4499-99f6-fa0476824737 service nova] [instance: c4a81a0b-1664-4652-a012-e46ba218ad6b] Received event network-vif-plugged-7412459a-0537-4479-a6d7-467e74b37b13 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 16:09:12 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-439931f5-9d7c-446a-bdc5-41319dc8ac7c req-17eec5c1-030a-4499-99f6-fa0476824737 service nova] Acquiring lock "c4a81a0b-1664-4652-a012-e46ba218ad6b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:09:12 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-439931f5-9d7c-446a-bdc5-41319dc8ac7c req-17eec5c1-030a-4499-99f6-fa0476824737 service nova] Lock "c4a81a0b-1664-4652-a012-e46ba218ad6b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:09:12 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-439931f5-9d7c-446a-bdc5-41319dc8ac7c req-17eec5c1-030a-4499-99f6-fa0476824737 service nova] Lock "c4a81a0b-1664-4652-a012-e46ba218ad6b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:09:12 user nova-compute[75176]: DEBUG nova.compute.manager [req-439931f5-9d7c-446a-bdc5-41319dc8ac7c req-17eec5c1-030a-4499-99f6-fa0476824737 service nova] [instance: c4a81a0b-1664-4652-a012-e46ba218ad6b] No waiting events found dispatching network-vif-plugged-7412459a-0537-4479-a6d7-467e74b37b13 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 16:09:12 user nova-compute[75176]: WARNING nova.compute.manager [req-439931f5-9d7c-446a-bdc5-41319dc8ac7c req-17eec5c1-030a-4499-99f6-fa0476824737 service nova] [instance: c4a81a0b-1664-4652-a012-e46ba218ad6b] Received unexpected event network-vif-plugged-7412459a-0537-4479-a6d7-467e74b37b13 for instance with vm_state deleted and task_state None.
Nov 28 16:09:12 user nova-compute[75176]: DEBUG nova.compute.manager [req-439931f5-9d7c-446a-bdc5-41319dc8ac7c req-17eec5c1-030a-4499-99f6-fa0476824737 service nova] [instance: c4a81a0b-1664-4652-a012-e46ba218ad6b] Received event network-vif-deleted-7412459a-0537-4479-a6d7-467e74b37b13 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 16:09:13 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:09:15 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:09:15 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:09:15 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:09:15 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Starting heal instance info cache {{(pid=75176) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 16:09:15 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquiring lock "refresh_cache-6c6a4729-9d51-4ebf-bad6-2022f35cbe3b" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 16:09:15 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquired lock "refresh_cache-6c6a4729-9d51-4ebf-bad6-2022f35cbe3b" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 16:09:15 user nova-compute[75176]: DEBUG nova.network.neutron [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] [instance: 6c6a4729-9d51-4ebf-bad6-2022f35cbe3b] Forcefully refreshing network info cache for instance {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 16:09:16 user nova-compute[75176]: DEBUG nova.network.neutron [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] [instance: 6c6a4729-9d51-4ebf-bad6-2022f35cbe3b] Updating instance_info_cache with network_info: [{"id": "85a1de78-2430-4835-8122-95570636e300", "address": "fa:16:3e:f4:49:91", "network": {"id": "9faaeac5-1688-436d-90fb-38bb1c4d3da4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1225296735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6aab7b19b9414b5da476b87e144cc40b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85a1de78-24", "ovs_interfaceid": "85a1de78-2430-4835-8122-95570636e300", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 16:09:16 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Releasing lock "refresh_cache-6c6a4729-9d51-4ebf-bad6-2022f35cbe3b" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 16:09:16 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] [instance: 6c6a4729-9d51-4ebf-bad6-2022f35cbe3b] Updated the network info_cache for instance {{(pid=75176) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 16:09:16 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:09:16 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75176) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 16:09:16 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:09:16 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:09:20 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:09:23 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:09:23 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:09:23 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:09:23 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:09:23 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Auditing locally available compute resources for user (node: user) {{(pid=75176) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 16:09:23 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c6a4729-9d51-4ebf-bad6-2022f35cbe3b/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:09:23 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c6a4729-9d51-4ebf-bad6-2022f35cbe3b/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:09:23 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c6a4729-9d51-4ebf-bad6-2022f35cbe3b/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:09:24 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c6a4729-9d51-4ebf-bad6-2022f35cbe3b/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:09:24 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 16:09:24 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 16:09:24 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Hypervisor/Node resource view: name=user free_ram=8923MB free_disk=25.073989868164062GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75176) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 16:09:24 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:09:24 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:09:24 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance 6c6a4729-9d51-4ebf-bad6-2022f35cbe3b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 16:09:24 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75176) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 16:09:24 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75176) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 16:09:24 user nova-compute[75176]: DEBUG nova.compute.provider_tree [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Inventory has not changed in ProviderTree for provider: b37848d8-f401-4155-a029-b0ffa09ff85b {{(pid=75176) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 16:09:24 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Inventory has not changed for provider b37848d8-f401-4155-a029-b0ffa09ff85b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75176) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 16:09:24 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Compute_service record updated for user:user {{(pid=75176) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 16:09:24 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.192s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:09:25 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 16:09:26 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:09:27 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:09:28 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:09:30 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:09:35 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 16:09:40 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 16:09:40 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:09:40 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75176) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 16:09:40 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75176) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 16:09:40 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75176) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 16:09:40 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:09:45 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 16:09:50 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:09:55 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 16:10:00 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:10:01 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-dd47895c-12d4-4f07-a9b3-a3c42e0c1361 tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] Acquiring lock "10159a3d-8e58-4e42-87e1-9b8bf6638078" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:10:01 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-dd47895c-12d4-4f07-a9b3-a3c42e0c1361 tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] Lock "10159a3d-8e58-4e42-87e1-9b8bf6638078" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:10:01 user nova-compute[75176]: DEBUG nova.compute.manager [None req-dd47895c-12d4-4f07-a9b3-a3c42e0c1361 tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] [instance: 10159a3d-8e58-4e42-87e1-9b8bf6638078] Starting instance... {{(pid=75176) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 16:10:01 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-dd47895c-12d4-4f07-a9b3-a3c42e0c1361 tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:10:01 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-dd47895c-12d4-4f07-a9b3-a3c42e0c1361 tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:10:01 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-dd47895c-12d4-4f07-a9b3-a3c42e0c1361 tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75176) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 16:10:01 user nova-compute[75176]: INFO nova.compute.claims [None req-dd47895c-12d4-4f07-a9b3-a3c42e0c1361 tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] [instance: 10159a3d-8e58-4e42-87e1-9b8bf6638078] Claim successful on node user
Nov 28 16:10:01 user nova-compute[75176]: DEBUG nova.compute.provider_tree [None req-dd47895c-12d4-4f07-a9b3-a3c42e0c1361 tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] Inventory has not changed in ProviderTree for provider: b37848d8-f401-4155-a029-b0ffa09ff85b {{(pid=75176) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 16:10:01 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-dd47895c-12d4-4f07-a9b3-a3c42e0c1361 tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] Inventory has not changed for provider b37848d8-f401-4155-a029-b0ffa09ff85b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75176) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 16:10:01 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-dd47895c-12d4-4f07-a9b3-a3c42e0c1361 tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.217s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:10:01 user nova-compute[75176]: DEBUG nova.compute.manager [None req-dd47895c-12d4-4f07-a9b3-a3c42e0c1361 tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] [instance: 10159a3d-8e58-4e42-87e1-9b8bf6638078] Start building networks asynchronously for instance. {{(pid=75176) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 16:10:01 user nova-compute[75176]: DEBUG nova.compute.manager [None req-dd47895c-12d4-4f07-a9b3-a3c42e0c1361 tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] [instance: 10159a3d-8e58-4e42-87e1-9b8bf6638078] Allocating IP information in the background. {{(pid=75176) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 16:10:01 user nova-compute[75176]: DEBUG nova.network.neutron [None req-dd47895c-12d4-4f07-a9b3-a3c42e0c1361 tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] [instance: 10159a3d-8e58-4e42-87e1-9b8bf6638078] allocate_for_instance() {{(pid=75176) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 16:10:01 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-dd47895c-12d4-4f07-a9b3-a3c42e0c1361 tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] [instance: 10159a3d-8e58-4e42-87e1-9b8bf6638078] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 16:10:01 user nova-compute[75176]: DEBUG nova.compute.manager [None req-dd47895c-12d4-4f07-a9b3-a3c42e0c1361 tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] [instance: 10159a3d-8e58-4e42-87e1-9b8bf6638078] Start building block device mappings for instance. {{(pid=75176) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 16:10:01 user nova-compute[75176]: DEBUG nova.policy [None req-dd47895c-12d4-4f07-a9b3-a3c42e0c1361 tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '755305bd64eb4fdfafa111b8688d2c4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80e74a1524540e4ac5fa47fd10d9f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75176) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 16:10:01 user nova-compute[75176]: DEBUG nova.compute.manager [None req-dd47895c-12d4-4f07-a9b3-a3c42e0c1361 tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] [instance: 10159a3d-8e58-4e42-87e1-9b8bf6638078] Start spawning the instance on the hypervisor. {{(pid=75176) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 16:10:01 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-dd47895c-12d4-4f07-a9b3-a3c42e0c1361 tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] [instance: 10159a3d-8e58-4e42-87e1-9b8bf6638078] Creating instance directory {{(pid=75176) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 16:10:01 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-dd47895c-12d4-4f07-a9b3-a3c42e0c1361 tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] [instance: 10159a3d-8e58-4e42-87e1-9b8bf6638078] Creating image(s)
Nov 28 16:10:01 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-dd47895c-12d4-4f07-a9b3-a3c42e0c1361 tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] Acquiring lock "/opt/stack/data/nova/instances/10159a3d-8e58-4e42-87e1-9b8bf6638078/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:10:01 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-dd47895c-12d4-4f07-a9b3-a3c42e0c1361 tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] Lock "/opt/stack/data/nova/instances/10159a3d-8e58-4e42-87e1-9b8bf6638078/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:10:01 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-dd47895c-12d4-4f07-a9b3-a3c42e0c1361 tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] Lock "/opt/stack/data/nova/instances/10159a3d-8e58-4e42-87e1-9b8bf6638078/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:10:01 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-dd47895c-12d4-4f07-a9b3-a3c42e0c1361 tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:10:02 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-dd47895c-12d4-4f07-a9b3-a3c42e0c1361 tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json" returned: 0 in 0.176s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:10:02 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-dd47895c-12d4-4f07-a9b3-a3c42e0c1361 tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] Acquiring lock "5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:10:02 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-dd47895c-12d4-4f07-a9b3-a3c42e0c1361 tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] Lock "5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:10:02 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-dd47895c-12d4-4f07-a9b3-a3c42e0c1361 tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:10:02 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-dd47895c-12d4-4f07-a9b3-a3c42e0c1361 tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json" returned: 0 in 0.175s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:10:02 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-dd47895c-12d4-4f07-a9b3-a3c42e0c1361 tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2,backing_fmt=raw /opt/stack/data/nova/instances/10159a3d-8e58-4e42-87e1-9b8bf6638078/disk 1073741824 {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:10:02 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-dd47895c-12d4-4f07-a9b3-a3c42e0c1361 tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2,backing_fmt=raw /opt/stack/data/nova/instances/10159a3d-8e58-4e42-87e1-9b8bf6638078/disk 1073741824" returned: 0 in 0.050s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:10:02 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-dd47895c-12d4-4f07-a9b3-a3c42e0c1361 tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] Lock "5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.236s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:10:02 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-dd47895c-12d4-4f07-a9b3-a3c42e0c1361 tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:10:02 user nova-compute[75176]: DEBUG nova.network.neutron [None req-dd47895c-12d4-4f07-a9b3-a3c42e0c1361 tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] [instance: 10159a3d-8e58-4e42-87e1-9b8bf6638078] Successfully created port: 81ca8941-ecf0-432d-a9f0-7a92e37e13f8 {{(pid=75176) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 16:10:02 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-dd47895c-12d4-4f07-a9b3-a3c42e0c1361 tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json" returned: 0 in 0.172s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:10:02 user nova-compute[75176]: DEBUG nova.virt.disk.api [None req-dd47895c-12d4-4f07-a9b3-a3c42e0c1361 tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] Checking if we can resize image /opt/stack/data/nova/instances/10159a3d-8e58-4e42-87e1-9b8bf6638078/disk. size=1073741824 {{(pid=75176) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 16:10:02 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-dd47895c-12d4-4f07-a9b3-a3c42e0c1361 tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10159a3d-8e58-4e42-87e1-9b8bf6638078/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:10:02 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-dd47895c-12d4-4f07-a9b3-a3c42e0c1361 tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10159a3d-8e58-4e42-87e1-9b8bf6638078/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:10:02 user nova-compute[75176]: DEBUG nova.virt.disk.api [None req-dd47895c-12d4-4f07-a9b3-a3c42e0c1361 tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] Cannot resize image /opt/stack/data/nova/instances/10159a3d-8e58-4e42-87e1-9b8bf6638078/disk to a smaller size. {{(pid=75176) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 16:10:02 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-dd47895c-12d4-4f07-a9b3-a3c42e0c1361 tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] [instance: 10159a3d-8e58-4e42-87e1-9b8bf6638078] Created local disks {{(pid=75176) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 16:10:02 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-dd47895c-12d4-4f07-a9b3-a3c42e0c1361 tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] [instance: 10159a3d-8e58-4e42-87e1-9b8bf6638078] Ensure instance console log exists: /opt/stack/data/nova/instances/10159a3d-8e58-4e42-87e1-9b8bf6638078/console.log {{(pid=75176) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 16:10:02 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-dd47895c-12d4-4f07-a9b3-a3c42e0c1361 tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:10:02 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-dd47895c-12d4-4f07-a9b3-a3c42e0c1361 tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:10:02 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-dd47895c-12d4-4f07-a9b3-a3c42e0c1361 tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:10:03 user nova-compute[75176]: DEBUG nova.network.neutron [None req-dd47895c-12d4-4f07-a9b3-a3c42e0c1361 tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] [instance: 10159a3d-8e58-4e42-87e1-9b8bf6638078] Successfully updated port: 81ca8941-ecf0-432d-a9f0-7a92e37e13f8 {{(pid=75176) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 16:10:03 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-dd47895c-12d4-4f07-a9b3-a3c42e0c1361 tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] Acquiring lock "refresh_cache-10159a3d-8e58-4e42-87e1-9b8bf6638078" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 16:10:03 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-dd47895c-12d4-4f07-a9b3-a3c42e0c1361 tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] Acquired lock "refresh_cache-10159a3d-8e58-4e42-87e1-9b8bf6638078" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 16:10:03 user nova-compute[75176]: DEBUG nova.network.neutron [None req-dd47895c-12d4-4f07-a9b3-a3c42e0c1361 tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] [instance: 10159a3d-8e58-4e42-87e1-9b8bf6638078] Building network info cache for instance {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 16:10:03 user nova-compute[75176]: DEBUG nova.network.neutron [None req-dd47895c-12d4-4f07-a9b3-a3c42e0c1361 tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] [instance: 10159a3d-8e58-4e42-87e1-9b8bf6638078] Instance cache missing network info. {{(pid=75176) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 16:10:03 user nova-compute[75176]: DEBUG nova.compute.manager [req-389d3fc9-ce8c-48a4-9725-8b6f5829fa4f req-5e82bdb8-89ca-4c8d-a4f1-723a02fa19eb service nova] [instance: 10159a3d-8e58-4e42-87e1-9b8bf6638078] Received event network-changed-81ca8941-ecf0-432d-a9f0-7a92e37e13f8 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 16:10:03 user nova-compute[75176]: DEBUG nova.compute.manager [req-389d3fc9-ce8c-48a4-9725-8b6f5829fa4f req-5e82bdb8-89ca-4c8d-a4f1-723a02fa19eb service nova] [instance: 10159a3d-8e58-4e42-87e1-9b8bf6638078] Refreshing instance network info cache due to event network-changed-81ca8941-ecf0-432d-a9f0-7a92e37e13f8. {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 16:10:03 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-389d3fc9-ce8c-48a4-9725-8b6f5829fa4f req-5e82bdb8-89ca-4c8d-a4f1-723a02fa19eb service nova] Acquiring lock "refresh_cache-10159a3d-8e58-4e42-87e1-9b8bf6638078" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 16:10:03 user nova-compute[75176]: DEBUG nova.network.neutron [None req-dd47895c-12d4-4f07-a9b3-a3c42e0c1361 tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] [instance: 10159a3d-8e58-4e42-87e1-9b8bf6638078] Updating instance_info_cache with network_info: [{"id": "81ca8941-ecf0-432d-a9f0-7a92e37e13f8", "address": "fa:16:3e:5b:6d:fc", "network": {"id": "25a35e69-32b6-4a72-8857-26a854eba808", "bridge": "br-int", "label": "tempest-VolumesActionsTest-262226956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a80e74a1524540e4ac5fa47fd10d9f91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81ca8941-ec", "ovs_interfaceid": "81ca8941-ecf0-432d-a9f0-7a92e37e13f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 16:10:03 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-dd47895c-12d4-4f07-a9b3-a3c42e0c1361 tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] Releasing lock "refresh_cache-10159a3d-8e58-4e42-87e1-9b8bf6638078" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 16:10:03 user nova-compute[75176]: DEBUG nova.compute.manager [None req-dd47895c-12d4-4f07-a9b3-a3c42e0c1361 tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] [instance: 10159a3d-8e58-4e42-87e1-9b8bf6638078] Instance network_info: |[{"id": "81ca8941-ecf0-432d-a9f0-7a92e37e13f8", "address": "fa:16:3e:5b:6d:fc", "network": {"id": "25a35e69-32b6-4a72-8857-26a854eba808", "bridge": "br-int", "label": "tempest-VolumesActionsTest-262226956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a80e74a1524540e4ac5fa47fd10d9f91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81ca8941-ec", "ovs_interfaceid": "81ca8941-ecf0-432d-a9f0-7a92e37e13f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75176) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 16:10:03 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-389d3fc9-ce8c-48a4-9725-8b6f5829fa4f req-5e82bdb8-89ca-4c8d-a4f1-723a02fa19eb service nova] Acquired lock "refresh_cache-10159a3d-8e58-4e42-87e1-9b8bf6638078" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 16:10:03 user nova-compute[75176]: DEBUG nova.network.neutron [req-389d3fc9-ce8c-48a4-9725-8b6f5829fa4f req-5e82bdb8-89ca-4c8d-a4f1-723a02fa19eb service nova] [instance: 10159a3d-8e58-4e42-87e1-9b8bf6638078] Refreshing network info cache for port 81ca8941-ecf0-432d-a9f0-7a92e37e13f8 {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 16:10:03 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-dd47895c-12d4-4f07-a9b3-a3c42e0c1361 tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] [instance: 10159a3d-8e58-4e42-87e1-9b8bf6638078] Start _get_guest_xml network_info=[{"id": "81ca8941-ecf0-432d-a9f0-7a92e37e13f8", "address": "fa:16:3e:5b:6d:fc", "network": {"id": "25a35e69-32b6-4a72-8857-26a854eba808", "bridge": "br-int", "label": "tempest-VolumesActionsTest-262226956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a80e74a1524540e4ac5fa47fd10d9f91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81ca8941-ec", "ovs_interfaceid": "81ca8941-ecf0-432d-a9f0-7a92e37e13f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T15:35:12Z,direct_url=<?>,disk_format='qcow2',id=1f41819e-c93f-4dc7-b253-37a27bbbbc74,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1b91c5d0672c4224a48df2e1f92688e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T15:35:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'size': 0, 'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'image_id': '1f41819e-c93f-4dc7-b253-37a27bbbbc74'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75176) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 16:10:03 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-dd47895c-12d4-4f07-a9b3-a3c42e0c1361 tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 16:10:03 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-dd47895c-12d4-4f07-a9b3-a3c42e0c1361 tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 16:10:03 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-dd47895c-12d4-4f07-a9b3-a3c42e0c1361 tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75176) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 16:10:03 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-dd47895c-12d4-4f07-a9b3-a3c42e0c1361 tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] CPU controller missing on host. {{(pid=75176) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 16:10:03 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-dd47895c-12d4-4f07-a9b3-a3c42e0c1361 tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75176) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 16:10:03 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-dd47895c-12d4-4f07-a9b3-a3c42e0c1361 tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] CPU controller found on host. {{(pid=75176) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 16:10:03 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-dd47895c-12d4-4f07-a9b3-a3c42e0c1361 tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75176) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 16:10:03 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-dd47895c-12d4-4f07-a9b3-a3c42e0c1361 tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T15:35:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T15:35:12Z,direct_url=<?>,disk_format='qcow2',id=1f41819e-c93f-4dc7-b253-37a27bbbbc74,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1b91c5d0672c4224a48df2e1f92688e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T15:35:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 16:10:03 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-dd47895c-12d4-4f07-a9b3-a3c42e0c1361 tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] Flavor limits 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 16:10:03 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-dd47895c-12d4-4f07-a9b3-a3c42e0c1361 tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] Image limits 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 16:10:03 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-dd47895c-12d4-4f07-a9b3-a3c42e0c1361 tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] Flavor pref 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 16:10:03 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-dd47895c-12d4-4f07-a9b3-a3c42e0c1361 tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] Image pref 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 16:10:03 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-dd47895c-12d4-4f07-a9b3-a3c42e0c1361 tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 16:10:03 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-dd47895c-12d4-4f07-a9b3-a3c42e0c1361 tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 16:10:03 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-dd47895c-12d4-4f07-a9b3-a3c42e0c1361 tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75176) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 16:10:03 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-dd47895c-12d4-4f07-a9b3-a3c42e0c1361 tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] Got 1 possible topologies {{(pid=75176) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 16:10:03 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-dd47895c-12d4-4f07-a9b3-a3c42e0c1361 tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 16:10:03 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-dd47895c-12d4-4f07-a9b3-a3c42e0c1361 tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 16:10:03 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-dd47895c-12d4-4f07-a9b3-a3c42e0c1361 tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T16:10:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1913320624',display_name='tempest-VolumesActionsTest-instance-1913320624',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1913320624',id=51,image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a80e74a1524540e4ac5fa47fd10d9f91',ramdisk_id='',reservation_id='r-504rv6gf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1656567418',owner_user_name='tempest-VolumesActionsTest-1656567418-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T16:10:02Z,user_data=None,user_id='755305bd64eb4fdfafa111b8688d2c4b',uuid=10159a3d-8e58-4e42-87e1-9b8bf6638078,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "81ca8941-ecf0-432d-a9f0-7a92e37e13f8", "address": "fa:16:3e:5b:6d:fc", "network": {"id": "25a35e69-32b6-4a72-8857-26a854eba808", "bridge": "br-int", "label": "tempest-VolumesActionsTest-262226956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a80e74a1524540e4ac5fa47fd10d9f91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81ca8941-ec", "ovs_interfaceid": "81ca8941-ecf0-432d-a9f0-7a92e37e13f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75176) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 16:10:03 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-dd47895c-12d4-4f07-a9b3-a3c42e0c1361 tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] Converting VIF {"id": "81ca8941-ecf0-432d-a9f0-7a92e37e13f8", "address": "fa:16:3e:5b:6d:fc", "network": {"id": "25a35e69-32b6-4a72-8857-26a854eba808", "bridge": "br-int", "label": "tempest-VolumesActionsTest-262226956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a80e74a1524540e4ac5fa47fd10d9f91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81ca8941-ec", "ovs_interfaceid": "81ca8941-ecf0-432d-a9f0-7a92e37e13f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 16:10:03 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-dd47895c-12d4-4f07-a9b3-a3c42e0c1361 tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:6d:fc,bridge_name='br-int',has_traffic_filtering=True,id=81ca8941-ecf0-432d-a9f0-7a92e37e13f8,network=Network(25a35e69-32b6-4a72-8857-26a854eba808),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81ca8941-ec') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 16:10:03 user nova-compute[75176]: DEBUG nova.objects.instance [None req-dd47895c-12d4-4f07-a9b3-a3c42e0c1361 tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] Lazy-loading 'pci_devices' on Instance uuid 10159a3d-8e58-4e42-87e1-9b8bf6638078 {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 16:10:03 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-dd47895c-12d4-4f07-a9b3-a3c42e0c1361 tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] [instance: 10159a3d-8e58-4e42-87e1-9b8bf6638078] End _get_guest_xml xml=<domain type="kvm">
Nov 28 16:10:03 user nova-compute[75176]:   <uuid>10159a3d-8e58-4e42-87e1-9b8bf6638078</uuid>
Nov 28 16:10:03 user nova-compute[75176]:   <name>instance-00000033</name>
Nov 28 16:10:03 user nova-compute[75176]:   <memory>524288</memory>
Nov 28 16:10:03 user nova-compute[75176]:   <vcpu>1</vcpu>
Nov 28 16:10:03 user nova-compute[75176]:   <metadata>
Nov 28 16:10:03 user nova-compute[75176]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 16:10:03 user nova-compute[75176]:       <nova:package version="0.0.0"/>
Nov 28 16:10:03 user nova-compute[75176]:       <nova:name>tempest-VolumesActionsTest-instance-1913320624</nova:name>
Nov 28 16:10:03 user nova-compute[75176]:       <nova:creationTime>2023-11-28 16:10:03</nova:creationTime>
Nov 28 16:10:03 user nova-compute[75176]:       <nova:flavor name="m1.tiny">
Nov 28 16:10:03 user nova-compute[75176]:         <nova:memory>512</nova:memory>
Nov 28 16:10:03 user nova-compute[75176]:         <nova:disk>1</nova:disk>
Nov 28 16:10:03 user nova-compute[75176]:         <nova:swap>0</nova:swap>
Nov 28 16:10:03 user nova-compute[75176]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 16:10:03 user nova-compute[75176]:         <nova:vcpus>1</nova:vcpus>
Nov 28 16:10:03 user nova-compute[75176]:       </nova:flavor>
Nov 28 16:10:03 user nova-compute[75176]:       <nova:owner>
Nov 28 16:10:03 user nova-compute[75176]:         <nova:user uuid="755305bd64eb4fdfafa111b8688d2c4b">tempest-VolumesActionsTest-1656567418-project-member</nova:user>
Nov 28 16:10:03 user nova-compute[75176]:         <nova:project uuid="a80e74a1524540e4ac5fa47fd10d9f91">tempest-VolumesActionsTest-1656567418</nova:project>
Nov 28 16:10:03 user nova-compute[75176]:       </nova:owner>
Nov 28 16:10:03 user nova-compute[75176]:       <nova:root type="image" uuid="1f41819e-c93f-4dc7-b253-37a27bbbbc74"/>
Nov 28 16:10:03 user nova-compute[75176]:       <nova:ports>
Nov 28 16:10:03 user nova-compute[75176]:         <nova:port uuid="81ca8941-ecf0-432d-a9f0-7a92e37e13f8">
Nov 28 16:10:03 user nova-compute[75176]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 28 16:10:03 user nova-compute[75176]:         </nova:port>
Nov 28 16:10:03 user nova-compute[75176]:       </nova:ports>
Nov 28 16:10:03 user nova-compute[75176]:     </nova:instance>
Nov 28 16:10:03 user nova-compute[75176]:   </metadata>
Nov 28 16:10:03 user nova-compute[75176]:   <sysinfo type="smbios">
Nov 28 16:10:03 user nova-compute[75176]:     <system>
Nov 28 16:10:03 user nova-compute[75176]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 16:10:03 user nova-compute[75176]:       <entry name="product">OpenStack Nova</entry>
Nov 28 16:10:03 user nova-compute[75176]:       <entry name="version">0.0.0</entry>
Nov 28 16:10:03 user nova-compute[75176]:       <entry name="serial">10159a3d-8e58-4e42-87e1-9b8bf6638078</entry>
Nov 28 16:10:03 user nova-compute[75176]:       <entry name="uuid">10159a3d-8e58-4e42-87e1-9b8bf6638078</entry>
Nov 28 16:10:03 user nova-compute[75176]:       <entry name="family">Virtual Machine</entry>
Nov 28 16:10:03 user nova-compute[75176]:     </system>
Nov 28 16:10:03 user nova-compute[75176]:   </sysinfo>
Nov 28 16:10:03 user nova-compute[75176]:   <os>
Nov 28 16:10:03 user nova-compute[75176]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 16:10:03 user nova-compute[75176]:     <boot dev="hd"/>
Nov 28 16:10:03 user nova-compute[75176]:     <smbios mode="sysinfo"/>
Nov 28 16:10:03 user nova-compute[75176]:   </os>
Nov 28 16:10:03 user nova-compute[75176]:   <features>
Nov 28 16:10:03 user nova-compute[75176]:     <acpi/>
Nov 28 16:10:03 user nova-compute[75176]:     <apic/>
Nov 28 16:10:03 user nova-compute[75176]:     <vmcoreinfo/>
Nov 28 16:10:03 user nova-compute[75176]:   </features>
Nov 28 16:10:03 user nova-compute[75176]:   <clock offset="utc">
Nov 28 16:10:03 user nova-compute[75176]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 16:10:03 user nova-compute[75176]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 16:10:03 user nova-compute[75176]:     <timer name="hpet" present="no"/>
Nov 28 16:10:03 user nova-compute[75176]:   </clock>
Nov 28 16:10:03 user nova-compute[75176]:   <cpu mode="custom" match="exact">
Nov 28 16:10:03 user nova-compute[75176]:     <model>Nehalem</model>
Nov 28 16:10:03 user nova-compute[75176]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 16:10:03 user nova-compute[75176]:   </cpu>
Nov 28 16:10:03 user nova-compute[75176]:   <devices>
Nov 28 16:10:03 user nova-compute[75176]:     <disk type="file" device="disk">
Nov 28 16:10:03 user nova-compute[75176]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 16:10:03 user nova-compute[75176]:       <source file="/opt/stack/data/nova/instances/10159a3d-8e58-4e42-87e1-9b8bf6638078/disk"/>
Nov 28 16:10:03 user nova-compute[75176]:       <target dev="vda" bus="virtio"/>
Nov 28 16:10:03 user nova-compute[75176]:     </disk>
Nov 28 16:10:03 user nova-compute[75176]:     <interface type="ethernet">
Nov 28 16:10:03 user nova-compute[75176]:       <mac address="fa:16:3e:5b:6d:fc"/>
Nov 28 16:10:03 user nova-compute[75176]:       <model type="virtio"/>
Nov 28 16:10:03 user nova-compute[75176]:       <mtu size="1442"/>
Nov 28 16:10:03 user nova-compute[75176]:       <target dev="tap81ca8941-ec"/>
Nov 28 16:10:03 user nova-compute[75176]:     </interface>
Nov 28 16:10:03 user nova-compute[75176]:     <serial type="pty">
Nov 28 16:10:03 user nova-compute[75176]:       <log file="/opt/stack/data/nova/instances/10159a3d-8e58-4e42-87e1-9b8bf6638078/console.log" append="off"/>
Nov 28 16:10:03 user nova-compute[75176]:     </serial>
Nov 28 16:10:03 user nova-compute[75176]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 16:10:03 user nova-compute[75176]:     <video>
Nov 28 16:10:03 user nova-compute[75176]:       <model type="virtio"/>
Nov 28 16:10:03 user nova-compute[75176]:     </video>
Nov 28 16:10:03 user nova-compute[75176]:     <rng model="virtio">
Nov 28 16:10:03 user nova-compute[75176]:       <backend model="random">/dev/urandom</backend>
Nov 28 16:10:03 user nova-compute[75176]:     </rng>
Nov 28 16:10:03 user nova-compute[75176]:     <controller type="usb" index="0" model="none"/>
Nov 28 16:10:03 user nova-compute[75176]:     <memballoon model="virtio">
Nov 28 16:10:03 user nova-compute[75176]:       <stats period="10"/>
Nov 28 16:10:03 user nova-compute[75176]:     </memballoon>
Nov 28 16:10:03 user nova-compute[75176]:   </devices>
Nov 28 16:10:03 user nova-compute[75176]: </domain>
Nov 28 16:10:03 user nova-compute[75176]:  {{(pid=75176) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 16:10:03 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-dd47895c-12d4-4f07-a9b3-a3c42e0c1361 tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T16:10:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1913320624',display_name='tempest-VolumesActionsTest-instance-1913320624',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1913320624',id=51,image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a80e74a1524540e4ac5fa47fd10d9f91',ramdisk_id='',reservation_id='r-504rv6gf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1656567418',owner_user_name='tempest-VolumesActionsTest-1656567418-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T16:10:02Z,user_data=None,user_id='755305bd64eb4fdfafa111b8688d2c4b',uuid=10159a3d-8e58-4e42-87e1-9b8bf6638078,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "81ca8941-ecf0-432d-a9f0-7a92e37e13f8", "address": "fa:16:3e:5b:6d:fc", "network": {"id": "25a35e69-32b6-4a72-8857-26a854eba808", "bridge": "br-int", "label": "tempest-VolumesActionsTest-262226956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a80e74a1524540e4ac5fa47fd10d9f91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81ca8941-ec", "ovs_interfaceid": "81ca8941-ecf0-432d-a9f0-7a92e37e13f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 16:10:03 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-dd47895c-12d4-4f07-a9b3-a3c42e0c1361 tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] Converting VIF {"id": "81ca8941-ecf0-432d-a9f0-7a92e37e13f8", "address": "fa:16:3e:5b:6d:fc", "network": {"id": "25a35e69-32b6-4a72-8857-26a854eba808", "bridge": "br-int", "label": "tempest-VolumesActionsTest-262226956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a80e74a1524540e4ac5fa47fd10d9f91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81ca8941-ec", "ovs_interfaceid": "81ca8941-ecf0-432d-a9f0-7a92e37e13f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 16:10:03 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-dd47895c-12d4-4f07-a9b3-a3c42e0c1361 tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:6d:fc,bridge_name='br-int',has_traffic_filtering=True,id=81ca8941-ecf0-432d-a9f0-7a92e37e13f8,network=Network(25a35e69-32b6-4a72-8857-26a854eba808),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81ca8941-ec') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 16:10:03 user nova-compute[75176]: DEBUG os_vif [None req-dd47895c-12d4-4f07-a9b3-a3c42e0c1361 tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:6d:fc,bridge_name='br-int',has_traffic_filtering=True,id=81ca8941-ecf0-432d-a9f0-7a92e37e13f8,network=Network(25a35e69-32b6-4a72-8857-26a854eba808),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81ca8941-ec') {{(pid=75176) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 16:10:03 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:10:03 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 16:10:03 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 16:10:03 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:10:03 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '31653fd9-5727-5257-8416-b6499ba66273', '_type': 'linux-noop'}}, row=False) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 16:10:03 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:10:03 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 16:10:03 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:10:03 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap81ca8941-ec, may_exist=True, interface_attrs={}) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 16:10:03 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap81ca8941-ec, col_values=(('qos', UUID('0f140f66-c56a-4fd7-addd-487e6bcc3728')),), if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 16:10:03 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap81ca8941-ec, col_values=(('external_ids', {'iface-id': '81ca8941-ecf0-432d-a9f0-7a92e37e13f8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5b:6d:fc', 'vm-uuid': '10159a3d-8e58-4e42-87e1-9b8bf6638078'}),), if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 16:10:03 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:10:03 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 16:10:03 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:10:03 user nova-compute[75176]: INFO os_vif [None req-dd47895c-12d4-4f07-a9b3-a3c42e0c1361 tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:6d:fc,bridge_name='br-int',has_traffic_filtering=True,id=81ca8941-ecf0-432d-a9f0-7a92e37e13f8,network=Network(25a35e69-32b6-4a72-8857-26a854eba808),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81ca8941-ec')
Nov 28 16:10:03 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-dd47895c-12d4-4f07-a9b3-a3c42e0c1361 tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] No BDM found with device name vda, not building metadata. {{(pid=75176) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 16:10:03 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-dd47895c-12d4-4f07-a9b3-a3c42e0c1361 tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] No VIF found with MAC fa:16:3e:5b:6d:fc, not building metadata {{(pid=75176) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 16:10:03 user nova-compute[75176]: DEBUG nova.network.neutron [req-389d3fc9-ce8c-48a4-9725-8b6f5829fa4f req-5e82bdb8-89ca-4c8d-a4f1-723a02fa19eb service nova] [instance: 10159a3d-8e58-4e42-87e1-9b8bf6638078] Updated VIF entry in instance network info cache for port 81ca8941-ecf0-432d-a9f0-7a92e37e13f8. {{(pid=75176) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 16:10:03 user nova-compute[75176]: DEBUG nova.network.neutron [req-389d3fc9-ce8c-48a4-9725-8b6f5829fa4f req-5e82bdb8-89ca-4c8d-a4f1-723a02fa19eb service nova] [instance: 10159a3d-8e58-4e42-87e1-9b8bf6638078] Updating instance_info_cache with network_info: [{"id": "81ca8941-ecf0-432d-a9f0-7a92e37e13f8", "address": "fa:16:3e:5b:6d:fc", "network": {"id": "25a35e69-32b6-4a72-8857-26a854eba808", "bridge": "br-int", "label": "tempest-VolumesActionsTest-262226956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a80e74a1524540e4ac5fa47fd10d9f91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81ca8941-ec", "ovs_interfaceid": "81ca8941-ecf0-432d-a9f0-7a92e37e13f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 16:10:03 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-389d3fc9-ce8c-48a4-9725-8b6f5829fa4f req-5e82bdb8-89ca-4c8d-a4f1-723a02fa19eb service nova] Releasing lock "refresh_cache-10159a3d-8e58-4e42-87e1-9b8bf6638078" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 16:10:04 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:10:04 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:10:04 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:10:05 user nova-compute[75176]: DEBUG nova.compute.manager [req-f5938a66-b3e1-4c71-8149-95caccc08b01 req-68299517-8f88-4143-9fed-55f77f427f79 service nova] [instance: 10159a3d-8e58-4e42-87e1-9b8bf6638078] Received event network-vif-plugged-81ca8941-ecf0-432d-a9f0-7a92e37e13f8 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 16:10:05 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-f5938a66-b3e1-4c71-8149-95caccc08b01 req-68299517-8f88-4143-9fed-55f77f427f79 service nova] Acquiring lock "10159a3d-8e58-4e42-87e1-9b8bf6638078-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:10:05 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-f5938a66-b3e1-4c71-8149-95caccc08b01 req-68299517-8f88-4143-9fed-55f77f427f79 service nova] Lock "10159a3d-8e58-4e42-87e1-9b8bf6638078-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:10:05 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-f5938a66-b3e1-4c71-8149-95caccc08b01 req-68299517-8f88-4143-9fed-55f77f427f79 service nova] Lock "10159a3d-8e58-4e42-87e1-9b8bf6638078-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:10:05 user nova-compute[75176]: DEBUG nova.compute.manager [req-f5938a66-b3e1-4c71-8149-95caccc08b01 req-68299517-8f88-4143-9fed-55f77f427f79 service nova] [instance: 10159a3d-8e58-4e42-87e1-9b8bf6638078] No waiting events found dispatching network-vif-plugged-81ca8941-ecf0-432d-a9f0-7a92e37e13f8 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 16:10:05 user nova-compute[75176]: WARNING nova.compute.manager [req-f5938a66-b3e1-4c71-8149-95caccc08b01 req-68299517-8f88-4143-9fed-55f77f427f79 service nova] [instance: 10159a3d-8e58-4e42-87e1-9b8bf6638078] Received unexpected event network-vif-plugged-81ca8941-ecf0-432d-a9f0-7a92e37e13f8 for instance with vm_state building and task_state spawning.
Nov 28 16:10:05 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:10:05 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:10:05 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:10:05 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:10:06 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:10:06 user nova-compute[75176]: DEBUG nova.compute.manager [None req-dd47895c-12d4-4f07-a9b3-a3c42e0c1361 tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] [instance: 10159a3d-8e58-4e42-87e1-9b8bf6638078] Instance event wait completed in 0 seconds for  {{(pid=75176) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 16:10:06 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-dd47895c-12d4-4f07-a9b3-a3c42e0c1361 tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] [instance: 10159a3d-8e58-4e42-87e1-9b8bf6638078] Guest created on hypervisor {{(pid=75176) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 16:10:07 user nova-compute[75176]: INFO nova.virt.libvirt.driver [-] [instance: 10159a3d-8e58-4e42-87e1-9b8bf6638078] Instance spawned successfully.
Nov 28 16:10:07 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-dd47895c-12d4-4f07-a9b3-a3c42e0c1361 tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] [instance: 10159a3d-8e58-4e42-87e1-9b8bf6638078] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 16:10:07 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-dd47895c-12d4-4f07-a9b3-a3c42e0c1361 tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] [instance: 10159a3d-8e58-4e42-87e1-9b8bf6638078] Found default for hw_cdrom_bus of ide {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 16:10:07 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-dd47895c-12d4-4f07-a9b3-a3c42e0c1361 tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] [instance: 10159a3d-8e58-4e42-87e1-9b8bf6638078] Found default for hw_disk_bus of virtio {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 16:10:07 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-dd47895c-12d4-4f07-a9b3-a3c42e0c1361 tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] [instance: 10159a3d-8e58-4e42-87e1-9b8bf6638078] Found default for hw_input_bus of None {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 16:10:07 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-dd47895c-12d4-4f07-a9b3-a3c42e0c1361 tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] [instance: 10159a3d-8e58-4e42-87e1-9b8bf6638078] Found default for hw_pointer_model of None {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 16:10:07 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-dd47895c-12d4-4f07-a9b3-a3c42e0c1361 tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] [instance: 10159a3d-8e58-4e42-87e1-9b8bf6638078] Found default for hw_video_model of virtio {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 16:10:07 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-dd47895c-12d4-4f07-a9b3-a3c42e0c1361 tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] [instance: 10159a3d-8e58-4e42-87e1-9b8bf6638078] Found default for hw_vif_model of virtio {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 16:10:07 user nova-compute[75176]: INFO nova.compute.manager [None req-dd47895c-12d4-4f07-a9b3-a3c42e0c1361 tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] [instance: 10159a3d-8e58-4e42-87e1-9b8bf6638078] Took 5.26 seconds to spawn the instance on the hypervisor.
Nov 28 16:10:07 user nova-compute[75176]: DEBUG nova.compute.manager [None req-dd47895c-12d4-4f07-a9b3-a3c42e0c1361 tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] [instance: 10159a3d-8e58-4e42-87e1-9b8bf6638078] Checking state {{(pid=75176) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 16:10:07 user nova-compute[75176]: DEBUG nova.compute.manager [req-7ba7b6cf-0b1d-4a2b-bf57-0f934680f92f req-7ba7f3ae-1f00-43b7-8cec-f271478d86b2 service nova] [instance: 10159a3d-8e58-4e42-87e1-9b8bf6638078] Received event network-vif-plugged-81ca8941-ecf0-432d-a9f0-7a92e37e13f8 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 16:10:07 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-7ba7b6cf-0b1d-4a2b-bf57-0f934680f92f req-7ba7f3ae-1f00-43b7-8cec-f271478d86b2 service nova] Acquiring lock "10159a3d-8e58-4e42-87e1-9b8bf6638078-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:10:07 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-7ba7b6cf-0b1d-4a2b-bf57-0f934680f92f req-7ba7f3ae-1f00-43b7-8cec-f271478d86b2 service nova] Lock "10159a3d-8e58-4e42-87e1-9b8bf6638078-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:10:07 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-7ba7b6cf-0b1d-4a2b-bf57-0f934680f92f req-7ba7f3ae-1f00-43b7-8cec-f271478d86b2 service nova] Lock "10159a3d-8e58-4e42-87e1-9b8bf6638078-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:10:07 user nova-compute[75176]: DEBUG nova.compute.manager [req-7ba7b6cf-0b1d-4a2b-bf57-0f934680f92f req-7ba7f3ae-1f00-43b7-8cec-f271478d86b2 service nova] [instance: 10159a3d-8e58-4e42-87e1-9b8bf6638078] No waiting events found dispatching network-vif-plugged-81ca8941-ecf0-432d-a9f0-7a92e37e13f8 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 16:10:07 user nova-compute[75176]: WARNING nova.compute.manager [req-7ba7b6cf-0b1d-4a2b-bf57-0f934680f92f req-7ba7f3ae-1f00-43b7-8cec-f271478d86b2 service nova] [instance: 10159a3d-8e58-4e42-87e1-9b8bf6638078] Received unexpected event network-vif-plugged-81ca8941-ecf0-432d-a9f0-7a92e37e13f8 for instance with vm_state building and task_state spawning.
Nov 28 16:10:07 user nova-compute[75176]: INFO nova.compute.manager [None req-dd47895c-12d4-4f07-a9b3-a3c42e0c1361 tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] [instance: 10159a3d-8e58-4e42-87e1-9b8bf6638078] Took 5.81 seconds to build instance.
Nov 28 16:10:07 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-dd47895c-12d4-4f07-a9b3-a3c42e0c1361 tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] Lock "10159a3d-8e58-4e42-87e1-9b8bf6638078" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.927s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:10:07 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:10:07 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Cleaning up deleted instances {{(pid=75176) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 28 16:10:07 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] There are 0 instances to clean {{(pid=75176) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 28 16:10:08 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:10:09 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:10:10 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:10:10 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:10:13 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:10:14 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:10:15 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:10:15 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75176) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 16:10:16 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:10:16 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Starting heal instance info cache {{(pid=75176) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 16:10:16 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Didn't find any instances for network info cache update. {{(pid=75176) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 28 16:10:16 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:10:18 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 16:10:18 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:10:18 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75176) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 16:10:18 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75176) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 16:10:18 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75176) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 16:10:18 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:10:18 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:10:19 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:10:19 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75176) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 28 16:10:23 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:10:24 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:10:24 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:10:24 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:10:24 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:10:24 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Auditing locally available compute resources for user (node: user) {{(pid=75176) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 16:10:24 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c6a4729-9d51-4ebf-bad6-2022f35cbe3b/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:10:25 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c6a4729-9d51-4ebf-bad6-2022f35cbe3b/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:10:25 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c6a4729-9d51-4ebf-bad6-2022f35cbe3b/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:10:25 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:10:25 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c6a4729-9d51-4ebf-bad6-2022f35cbe3b/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:10:25 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10159a3d-8e58-4e42-87e1-9b8bf6638078/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:10:25 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10159a3d-8e58-4e42-87e1-9b8bf6638078/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:10:25 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10159a3d-8e58-4e42-87e1-9b8bf6638078/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:10:25 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10159a3d-8e58-4e42-87e1-9b8bf6638078/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:10:25 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 16:10:25 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 16:10:25 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Hypervisor/Node resource view: name=user free_ram=8798MB free_disk=25.04499053955078GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75176) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 16:10:25 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:10:25 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:10:26 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance 6c6a4729-9d51-4ebf-bad6-2022f35cbe3b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 16:10:26 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance 10159a3d-8e58-4e42-87e1-9b8bf6638078 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 16:10:26 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75176) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 16:10:26 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75176) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 16:10:26 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Refreshing inventories for resource provider b37848d8-f401-4155-a029-b0ffa09ff85b {{(pid=75176) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 28 16:10:26 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Updating ProviderTree inventory for provider b37848d8-f401-4155-a029-b0ffa09ff85b from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75176) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 28 16:10:26 user nova-compute[75176]: DEBUG nova.compute.provider_tree [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Updating inventory in ProviderTree for provider b37848d8-f401-4155-a029-b0ffa09ff85b with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75176) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 28 16:10:26 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Refreshing aggregate associations for resource provider b37848d8-f401-4155-a029-b0ffa09ff85b, aggregates: None {{(pid=75176) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 28 16:10:26 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Refreshing trait associations for resource provider b37848d8-f401-4155-a029-b0ffa09ff85b, traits: COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_RESCUE_BFV,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NODE,HW_CPU_X86_SSSE3,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE42,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE2,COMPUTE_ACCELERATORS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VIRTIO {{(pid=75176) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 28 16:10:26 user nova-compute[75176]: DEBUG nova.compute.provider_tree [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Inventory has not changed in ProviderTree for provider: b37848d8-f401-4155-a029-b0ffa09ff85b {{(pid=75176) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 16:10:26 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Inventory has not changed for provider b37848d8-f401-4155-a029-b0ffa09ff85b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75176) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 16:10:26 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Compute_service record updated for user:user {{(pid=75176) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 16:10:26 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.517s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:10:28 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:10:30 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:10:31 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-cfedf86a-6e02-4d2f-be2b-22b8d3e65012 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Acquiring lock "6c6a4729-9d51-4ebf-bad6-2022f35cbe3b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:10:31 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-cfedf86a-6e02-4d2f-be2b-22b8d3e65012 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Lock "6c6a4729-9d51-4ebf-bad6-2022f35cbe3b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:10:31 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-cfedf86a-6e02-4d2f-be2b-22b8d3e65012 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Acquiring lock "6c6a4729-9d51-4ebf-bad6-2022f35cbe3b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:10:31 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-cfedf86a-6e02-4d2f-be2b-22b8d3e65012 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Lock "6c6a4729-9d51-4ebf-bad6-2022f35cbe3b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:10:31 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-cfedf86a-6e02-4d2f-be2b-22b8d3e65012 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Lock "6c6a4729-9d51-4ebf-bad6-2022f35cbe3b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:10:31 user nova-compute[75176]: INFO nova.compute.manager [None req-cfedf86a-6e02-4d2f-be2b-22b8d3e65012 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] [instance: 6c6a4729-9d51-4ebf-bad6-2022f35cbe3b] Terminating instance
Nov 28 16:10:31 user nova-compute[75176]: DEBUG nova.compute.manager [None req-cfedf86a-6e02-4d2f-be2b-22b8d3e65012 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] [instance: 6c6a4729-9d51-4ebf-bad6-2022f35cbe3b] Start destroying the instance on the hypervisor. {{(pid=75176) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 16:10:31 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:10:31 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:10:31 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:10:31 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:10:31 user nova-compute[75176]: DEBUG nova.compute.manager [req-a4cef1a7-aa83-4722-b0b1-a03cd23b8e06 req-921a3286-f0ea-4316-ad76-88e38b4ad4df service nova] [instance: 6c6a4729-9d51-4ebf-bad6-2022f35cbe3b] Received event network-vif-unplugged-85a1de78-2430-4835-8122-95570636e300 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 16:10:31 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-a4cef1a7-aa83-4722-b0b1-a03cd23b8e06 req-921a3286-f0ea-4316-ad76-88e38b4ad4df service nova] Acquiring lock "6c6a4729-9d51-4ebf-bad6-2022f35cbe3b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:10:31 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-a4cef1a7-aa83-4722-b0b1-a03cd23b8e06 req-921a3286-f0ea-4316-ad76-88e38b4ad4df service nova] Lock "6c6a4729-9d51-4ebf-bad6-2022f35cbe3b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:10:31 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-a4cef1a7-aa83-4722-b0b1-a03cd23b8e06 req-921a3286-f0ea-4316-ad76-88e38b4ad4df service nova] Lock "6c6a4729-9d51-4ebf-bad6-2022f35cbe3b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:10:31 user nova-compute[75176]: DEBUG nova.compute.manager [req-a4cef1a7-aa83-4722-b0b1-a03cd23b8e06 req-921a3286-f0ea-4316-ad76-88e38b4ad4df service nova] [instance: 6c6a4729-9d51-4ebf-bad6-2022f35cbe3b] No waiting events found dispatching network-vif-unplugged-85a1de78-2430-4835-8122-95570636e300 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 16:10:31 user nova-compute[75176]: DEBUG nova.compute.manager [req-a4cef1a7-aa83-4722-b0b1-a03cd23b8e06 req-921a3286-f0ea-4316-ad76-88e38b4ad4df service nova] [instance: 6c6a4729-9d51-4ebf-bad6-2022f35cbe3b] Received event network-vif-unplugged-85a1de78-2430-4835-8122-95570636e300 for instance with task_state deleting. {{(pid=75176) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 16:10:32 user nova-compute[75176]: INFO nova.virt.libvirt.driver [-] [instance: 6c6a4729-9d51-4ebf-bad6-2022f35cbe3b] Instance destroyed successfully.
Nov 28 16:10:32 user nova-compute[75176]: DEBUG nova.objects.instance [None req-cfedf86a-6e02-4d2f-be2b-22b8d3e65012 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Lazy-loading 'resources' on Instance uuid 6c6a4729-9d51-4ebf-bad6-2022f35cbe3b {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 16:10:32 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-cfedf86a-6e02-4d2f-be2b-22b8d3e65012 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T16:00:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-691561062',display_name='tempest-AttachVolumeTestJSON-server-691561062',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-691561062',id=48,image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD9HYYuhew+HwSlGLCtnm5QU3CE4PWqBzdirX5E0yDwA3ZIjV/d7lqYB/DPfiezleSueBjZ4jvmSISqP2Nc+aT8uhbuWQyy+x6kGVNBbHAicQWf8CVd+FflN0YxTFd39NA==',key_name='tempest-keypair-1245727303',keypairs=<?>,launch_index=0,launched_at=2023-11-28T16:00:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6aab7b19b9414b5da476b87e144cc40b',ramdisk_id='',reservation_id='r-m99ag9fz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-365725655',owner_user_name='tempest-AttachVolumeTestJSON-365725655-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T16:08:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='60b513cfc58647d49fc084d51964a4c6',uuid=6c6a4729-9d51-4ebf-bad6-2022f35cbe3b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "85a1de78-2430-4835-8122-95570636e300", "address": "fa:16:3e:f4:49:91", "network": {"id": "9faaeac5-1688-436d-90fb-38bb1c4d3da4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1225296735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6aab7b19b9414b5da476b87e144cc40b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85a1de78-24", "ovs_interfaceid": "85a1de78-2430-4835-8122-95570636e300", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 16:10:32 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-cfedf86a-6e02-4d2f-be2b-22b8d3e65012 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Converting VIF {"id": "85a1de78-2430-4835-8122-95570636e300", "address": "fa:16:3e:f4:49:91", "network": {"id": "9faaeac5-1688-436d-90fb-38bb1c4d3da4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1225296735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6aab7b19b9414b5da476b87e144cc40b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85a1de78-24", "ovs_interfaceid": "85a1de78-2430-4835-8122-95570636e300", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 16:10:32 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-cfedf86a-6e02-4d2f-be2b-22b8d3e65012 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f4:49:91,bridge_name='br-int',has_traffic_filtering=True,id=85a1de78-2430-4835-8122-95570636e300,network=Network(9faaeac5-1688-436d-90fb-38bb1c4d3da4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85a1de78-24') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 16:10:32 user nova-compute[75176]: DEBUG os_vif [None req-cfedf86a-6e02-4d2f-be2b-22b8d3e65012 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f4:49:91,bridge_name='br-int',has_traffic_filtering=True,id=85a1de78-2430-4835-8122-95570636e300,network=Network(9faaeac5-1688-436d-90fb-38bb1c4d3da4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85a1de78-24') {{(pid=75176) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 16:10:32 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:10:32 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap85a1de78-24, bridge=br-int, if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 16:10:32 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:10:32 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 16:10:32 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:10:32 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3f57d930-2201-4114-ada3-ef55e4c6e252) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 16:10:32 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:10:32 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:10:32 user nova-compute[75176]: INFO os_vif [None req-cfedf86a-6e02-4d2f-be2b-22b8d3e65012 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f4:49:91,bridge_name='br-int',has_traffic_filtering=True,id=85a1de78-2430-4835-8122-95570636e300,network=Network(9faaeac5-1688-436d-90fb-38bb1c4d3da4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85a1de78-24')
Nov 28 16:10:32 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-cfedf86a-6e02-4d2f-be2b-22b8d3e65012 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] [instance: 6c6a4729-9d51-4ebf-bad6-2022f35cbe3b] Deleting instance files /opt/stack/data/nova/instances/6c6a4729-9d51-4ebf-bad6-2022f35cbe3b_del
Nov 28 16:10:32 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-cfedf86a-6e02-4d2f-be2b-22b8d3e65012 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] [instance: 6c6a4729-9d51-4ebf-bad6-2022f35cbe3b] Deletion of /opt/stack/data/nova/instances/6c6a4729-9d51-4ebf-bad6-2022f35cbe3b_del complete
Nov 28 16:10:32 user nova-compute[75176]: INFO nova.compute.manager [None req-cfedf86a-6e02-4d2f-be2b-22b8d3e65012 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] [instance: 6c6a4729-9d51-4ebf-bad6-2022f35cbe3b] Took 0.97 seconds to destroy the instance on the hypervisor.
Nov 28 16:10:32 user nova-compute[75176]: DEBUG oslo.service.loopingcall [None req-cfedf86a-6e02-4d2f-be2b-22b8d3e65012 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75176) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 16:10:32 user nova-compute[75176]: DEBUG nova.compute.manager [-] [instance: 6c6a4729-9d51-4ebf-bad6-2022f35cbe3b] Deallocating network for instance {{(pid=75176) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 16:10:32 user nova-compute[75176]: DEBUG nova.network.neutron [-] [instance: 6c6a4729-9d51-4ebf-bad6-2022f35cbe3b] deallocate_for_instance() {{(pid=75176) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 16:10:33 user nova-compute[75176]: DEBUG nova.network.neutron [-] [instance: 6c6a4729-9d51-4ebf-bad6-2022f35cbe3b] Updating instance_info_cache with network_info: [] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 16:10:33 user nova-compute[75176]: INFO nova.compute.manager [-] [instance: 6c6a4729-9d51-4ebf-bad6-2022f35cbe3b] Took 0.80 seconds to deallocate network for instance.
Nov 28 16:10:33 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-cfedf86a-6e02-4d2f-be2b-22b8d3e65012 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:10:33 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-cfedf86a-6e02-4d2f-be2b-22b8d3e65012 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:10:33 user nova-compute[75176]: DEBUG nova.compute.provider_tree [None req-cfedf86a-6e02-4d2f-be2b-22b8d3e65012 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Inventory has not changed in ProviderTree for provider: b37848d8-f401-4155-a029-b0ffa09ff85b {{(pid=75176) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 16:10:33 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-cfedf86a-6e02-4d2f-be2b-22b8d3e65012 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Inventory has not changed for provider b37848d8-f401-4155-a029-b0ffa09ff85b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75176) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 16:10:33 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-cfedf86a-6e02-4d2f-be2b-22b8d3e65012 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.145s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:10:33 user nova-compute[75176]: INFO nova.scheduler.client.report [None req-cfedf86a-6e02-4d2f-be2b-22b8d3e65012 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Deleted allocations for instance 6c6a4729-9d51-4ebf-bad6-2022f35cbe3b
Nov 28 16:10:33 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-cfedf86a-6e02-4d2f-be2b-22b8d3e65012 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Lock "6c6a4729-9d51-4ebf-bad6-2022f35cbe3b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.111s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:10:33 user nova-compute[75176]: DEBUG nova.compute.manager [req-8fbf2c41-1350-4e1d-9c44-41518c3c94df req-54e0e56a-edf5-4fe6-846a-7a36d84336ff service nova] [instance: 6c6a4729-9d51-4ebf-bad6-2022f35cbe3b] Received event network-vif-plugged-85a1de78-2430-4835-8122-95570636e300 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 16:10:33 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-8fbf2c41-1350-4e1d-9c44-41518c3c94df req-54e0e56a-edf5-4fe6-846a-7a36d84336ff service nova] Acquiring lock "6c6a4729-9d51-4ebf-bad6-2022f35cbe3b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:10:33 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-8fbf2c41-1350-4e1d-9c44-41518c3c94df req-54e0e56a-edf5-4fe6-846a-7a36d84336ff service nova] Lock "6c6a4729-9d51-4ebf-bad6-2022f35cbe3b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:10:33 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-8fbf2c41-1350-4e1d-9c44-41518c3c94df req-54e0e56a-edf5-4fe6-846a-7a36d84336ff service nova] Lock "6c6a4729-9d51-4ebf-bad6-2022f35cbe3b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:10:33 user nova-compute[75176]: DEBUG nova.compute.manager [req-8fbf2c41-1350-4e1d-9c44-41518c3c94df req-54e0e56a-edf5-4fe6-846a-7a36d84336ff service nova] [instance: 6c6a4729-9d51-4ebf-bad6-2022f35cbe3b] No waiting events found dispatching network-vif-plugged-85a1de78-2430-4835-8122-95570636e300 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 16:10:33 user nova-compute[75176]: WARNING nova.compute.manager [req-8fbf2c41-1350-4e1d-9c44-41518c3c94df req-54e0e56a-edf5-4fe6-846a-7a36d84336ff service nova] [instance: 6c6a4729-9d51-4ebf-bad6-2022f35cbe3b] Received unexpected event network-vif-plugged-85a1de78-2430-4835-8122-95570636e300 for instance with vm_state deleted and task_state None.
Nov 28 16:10:33 user nova-compute[75176]: DEBUG nova.compute.manager [req-8fbf2c41-1350-4e1d-9c44-41518c3c94df req-54e0e56a-edf5-4fe6-846a-7a36d84336ff service nova] [instance: 6c6a4729-9d51-4ebf-bad6-2022f35cbe3b] Received event network-vif-deleted-85a1de78-2430-4835-8122-95570636e300 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 16:10:35 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:10:37 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:10:39 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:10:40 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:10:42 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:10:47 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:10:52 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 16:10:57 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 16:10:57 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:10:57 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75176) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 16:10:57 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75176) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 16:10:57 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75176) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 16:10:57 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:11:02 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 16:11:07 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 16:11:08 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:11:10 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:11:11 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:11:12 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:11:15 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:11:15 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75176) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 16:11:16 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:11:17 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:11:17 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:11:17 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Starting heal instance info cache {{(pid=75176) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 16:11:17 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Rebuilding the list of instances to heal {{(pid=75176) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 16:11:17 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquiring lock "refresh_cache-10159a3d-8e58-4e42-87e1-9b8bf6638078" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 16:11:17 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquired lock "refresh_cache-10159a3d-8e58-4e42-87e1-9b8bf6638078" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 16:11:17 user nova-compute[75176]: DEBUG nova.network.neutron [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] [instance: 10159a3d-8e58-4e42-87e1-9b8bf6638078] Forcefully refreshing network info cache for instance {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 16:11:17 user nova-compute[75176]: DEBUG nova.objects.instance [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lazy-loading 'info_cache' on Instance uuid 10159a3d-8e58-4e42-87e1-9b8bf6638078 {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 16:11:18 user nova-compute[75176]: DEBUG nova.network.neutron [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] [instance: 10159a3d-8e58-4e42-87e1-9b8bf6638078] Updating instance_info_cache with network_info: [{"id": "81ca8941-ecf0-432d-a9f0-7a92e37e13f8", "address": "fa:16:3e:5b:6d:fc", "network": {"id": "25a35e69-32b6-4a72-8857-26a854eba808", "bridge": "br-int", "label": "tempest-VolumesActionsTest-262226956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a80e74a1524540e4ac5fa47fd10d9f91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81ca8941-ec", "ovs_interfaceid": "81ca8941-ecf0-432d-a9f0-7a92e37e13f8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 16:11:18 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Releasing lock "refresh_cache-10159a3d-8e58-4e42-87e1-9b8bf6638078" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 16:11:18 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] [instance: 10159a3d-8e58-4e42-87e1-9b8bf6638078] Updated the network info_cache for instance {{(pid=75176) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 16:11:18 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:11:20 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:11:22 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:11:22 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:11:25 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-52c5eca5-e787-4257-b645-eea6f403f999 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Acquiring lock "7af26650-2a61-4557-8c3d-0688ddbc6343" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:11:25 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-52c5eca5-e787-4257-b645-eea6f403f999 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Lock "7af26650-2a61-4557-8c3d-0688ddbc6343" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:11:25 user nova-compute[75176]: DEBUG nova.compute.manager [None req-52c5eca5-e787-4257-b645-eea6f403f999 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] [instance: 7af26650-2a61-4557-8c3d-0688ddbc6343] Starting instance... {{(pid=75176) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 16:11:25 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-52c5eca5-e787-4257-b645-eea6f403f999 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:11:25 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-52c5eca5-e787-4257-b645-eea6f403f999 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:11:25 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-52c5eca5-e787-4257-b645-eea6f403f999 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75176) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 16:11:25 user nova-compute[75176]: INFO nova.compute.claims [None req-52c5eca5-e787-4257-b645-eea6f403f999 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] [instance: 7af26650-2a61-4557-8c3d-0688ddbc6343] Claim successful on node user
Nov 28 16:11:25 user nova-compute[75176]: DEBUG nova.compute.provider_tree [None req-52c5eca5-e787-4257-b645-eea6f403f999 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Inventory has not changed in ProviderTree for provider: b37848d8-f401-4155-a029-b0ffa09ff85b {{(pid=75176) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 16:11:25 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-52c5eca5-e787-4257-b645-eea6f403f999 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Inventory has not changed for provider b37848d8-f401-4155-a029-b0ffa09ff85b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75176) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 16:11:25 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-52c5eca5-e787-4257-b645-eea6f403f999 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.233s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:11:25 user nova-compute[75176]: DEBUG nova.compute.manager [None req-52c5eca5-e787-4257-b645-eea6f403f999 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] [instance: 7af26650-2a61-4557-8c3d-0688ddbc6343] Start building networks asynchronously for instance. {{(pid=75176) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 16:11:25 user nova-compute[75176]: DEBUG nova.compute.manager [None req-52c5eca5-e787-4257-b645-eea6f403f999 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] [instance: 7af26650-2a61-4557-8c3d-0688ddbc6343] Allocating IP information in the background. {{(pid=75176) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 16:11:25 user nova-compute[75176]: DEBUG nova.network.neutron [None req-52c5eca5-e787-4257-b645-eea6f403f999 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] [instance: 7af26650-2a61-4557-8c3d-0688ddbc6343] allocate_for_instance() {{(pid=75176) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 16:11:25 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-52c5eca5-e787-4257-b645-eea6f403f999 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] [instance: 7af26650-2a61-4557-8c3d-0688ddbc6343] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 16:11:25 user nova-compute[75176]: DEBUG nova.compute.manager [None req-52c5eca5-e787-4257-b645-eea6f403f999 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] [instance: 7af26650-2a61-4557-8c3d-0688ddbc6343] Start building block device mappings for instance. {{(pid=75176) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 16:11:25 user nova-compute[75176]: DEBUG nova.policy [None req-52c5eca5-e787-4257-b645-eea6f403f999 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '60b513cfc58647d49fc084d51964a4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aab7b19b9414b5da476b87e144cc40b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75176) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 16:11:25 user nova-compute[75176]: DEBUG nova.compute.manager [None req-52c5eca5-e787-4257-b645-eea6f403f999 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] [instance: 7af26650-2a61-4557-8c3d-0688ddbc6343] Start spawning the instance on the hypervisor. {{(pid=75176) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 16:11:25 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-52c5eca5-e787-4257-b645-eea6f403f999 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] [instance: 7af26650-2a61-4557-8c3d-0688ddbc6343] Creating instance directory {{(pid=75176) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 16:11:25 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-52c5eca5-e787-4257-b645-eea6f403f999 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] [instance: 7af26650-2a61-4557-8c3d-0688ddbc6343] Creating image(s)
Nov 28 16:11:25 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-52c5eca5-e787-4257-b645-eea6f403f999 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Acquiring lock "/opt/stack/data/nova/instances/7af26650-2a61-4557-8c3d-0688ddbc6343/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:11:25 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-52c5eca5-e787-4257-b645-eea6f403f999 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Lock "/opt/stack/data/nova/instances/7af26650-2a61-4557-8c3d-0688ddbc6343/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:11:25 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-52c5eca5-e787-4257-b645-eea6f403f999 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Lock "/opt/stack/data/nova/instances/7af26650-2a61-4557-8c3d-0688ddbc6343/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:11:25 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-52c5eca5-e787-4257-b645-eea6f403f999 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:11:25 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:11:25 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:11:25 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:11:25 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:11:25 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Auditing locally available compute resources for user (node: user) {{(pid=75176) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 16:11:25 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10159a3d-8e58-4e42-87e1-9b8bf6638078/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:11:25 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-52c5eca5-e787-4257-b645-eea6f403f999 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json" returned: 0 in 0.197s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:11:25 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-52c5eca5-e787-4257-b645-eea6f403f999 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Acquiring lock "5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:11:25 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-52c5eca5-e787-4257-b645-eea6f403f999 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Lock "5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:11:25 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-52c5eca5-e787-4257-b645-eea6f403f999 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:11:25 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10159a3d-8e58-4e42-87e1-9b8bf6638078/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:11:25 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10159a3d-8e58-4e42-87e1-9b8bf6638078/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:11:26 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-52c5eca5-e787-4257-b645-eea6f403f999 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json" returned: 0 in 0.171s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:11:26 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-52c5eca5-e787-4257-b645-eea6f403f999 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2,backing_fmt=raw /opt/stack/data/nova/instances/7af26650-2a61-4557-8c3d-0688ddbc6343/disk 1073741824 {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:11:26 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-52c5eca5-e787-4257-b645-eea6f403f999 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2,backing_fmt=raw /opt/stack/data/nova/instances/7af26650-2a61-4557-8c3d-0688ddbc6343/disk 1073741824" returned: 0 in 0.050s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:11:26 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-52c5eca5-e787-4257-b645-eea6f403f999 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Lock "5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.230s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:11:26 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-52c5eca5-e787-4257-b645-eea6f403f999 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:11:26 user nova-compute[75176]: DEBUG nova.network.neutron [None req-52c5eca5-e787-4257-b645-eea6f403f999 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] [instance: 7af26650-2a61-4557-8c3d-0688ddbc6343] Successfully created port: ed4b6bff-3d17-4593-aabb-38a65b35aaea {{(pid=75176) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 16:11:26 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10159a3d-8e58-4e42-87e1-9b8bf6638078/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:11:26 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-52c5eca5-e787-4257-b645-eea6f403f999 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json" returned: 0 in 0.502s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:11:26 user nova-compute[75176]: DEBUG nova.virt.disk.api [None req-52c5eca5-e787-4257-b645-eea6f403f999 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7af26650-2a61-4557-8c3d-0688ddbc6343/disk. size=1073741824 {{(pid=75176) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 16:11:26 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-52c5eca5-e787-4257-b645-eea6f403f999 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7af26650-2a61-4557-8c3d-0688ddbc6343/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:11:26 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 16:11:26 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 16:11:26 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Hypervisor/Node resource view: name=user free_ram=8988MB free_disk=25.070281982421875GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75176) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 16:11:26 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:11:26 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:11:26 user nova-compute[75176]: DEBUG nova.network.neutron [None req-52c5eca5-e787-4257-b645-eea6f403f999 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] [instance: 7af26650-2a61-4557-8c3d-0688ddbc6343] Successfully updated port: ed4b6bff-3d17-4593-aabb-38a65b35aaea {{(pid=75176) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 16:11:27 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance 10159a3d-8e58-4e42-87e1-9b8bf6638078 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 16:11:27 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance 7af26650-2a61-4557-8c3d-0688ddbc6343 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 16:11:27 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75176) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 16:11:27 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75176) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 16:11:27 user nova-compute[75176]: DEBUG nova.compute.manager [req-6d183594-4ca3-49e3-9c61-3629f85f780a req-5cccbb3d-3c06-4593-8d41-2c2e3cb91b70 service nova] [instance: 7af26650-2a61-4557-8c3d-0688ddbc6343] Received event network-changed-ed4b6bff-3d17-4593-aabb-38a65b35aaea {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 16:11:27 user nova-compute[75176]: DEBUG nova.compute.manager [req-6d183594-4ca3-49e3-9c61-3629f85f780a req-5cccbb3d-3c06-4593-8d41-2c2e3cb91b70 service nova] [instance: 7af26650-2a61-4557-8c3d-0688ddbc6343] Refreshing instance network info cache due to event network-changed-ed4b6bff-3d17-4593-aabb-38a65b35aaea. {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 16:11:27 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-6d183594-4ca3-49e3-9c61-3629f85f780a req-5cccbb3d-3c06-4593-8d41-2c2e3cb91b70 service nova] Acquiring lock "refresh_cache-7af26650-2a61-4557-8c3d-0688ddbc6343" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 16:11:27 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-6d183594-4ca3-49e3-9c61-3629f85f780a req-5cccbb3d-3c06-4593-8d41-2c2e3cb91b70 service nova] Acquired lock "refresh_cache-7af26650-2a61-4557-8c3d-0688ddbc6343" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 16:11:27 user nova-compute[75176]: DEBUG nova.network.neutron [req-6d183594-4ca3-49e3-9c61-3629f85f780a req-5cccbb3d-3c06-4593-8d41-2c2e3cb91b70 service nova] [instance: 7af26650-2a61-4557-8c3d-0688ddbc6343] Refreshing network info cache for port ed4b6bff-3d17-4593-aabb-38a65b35aaea {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 16:11:27 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-52c5eca5-e787-4257-b645-eea6f403f999 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7af26650-2a61-4557-8c3d-0688ddbc6343/disk --force-share --output=json" returned: 0 in 0.443s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:11:27 user nova-compute[75176]: DEBUG nova.virt.disk.api [None req-52c5eca5-e787-4257-b645-eea6f403f999 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Cannot resize image /opt/stack/data/nova/instances/7af26650-2a61-4557-8c3d-0688ddbc6343/disk to a smaller size. {{(pid=75176) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 16:11:27 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-52c5eca5-e787-4257-b645-eea6f403f999 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] [instance: 7af26650-2a61-4557-8c3d-0688ddbc6343] Created local disks {{(pid=75176) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 16:11:27 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-52c5eca5-e787-4257-b645-eea6f403f999 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] [instance: 7af26650-2a61-4557-8c3d-0688ddbc6343] Ensure instance console log exists: /opt/stack/data/nova/instances/7af26650-2a61-4557-8c3d-0688ddbc6343/console.log {{(pid=75176) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 16:11:27 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-52c5eca5-e787-4257-b645-eea6f403f999 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:11:27 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-52c5eca5-e787-4257-b645-eea6f403f999 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:11:27 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-52c5eca5-e787-4257-b645-eea6f403f999 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:11:27 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-52c5eca5-e787-4257-b645-eea6f403f999 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Acquiring lock "refresh_cache-7af26650-2a61-4557-8c3d-0688ddbc6343" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 16:11:27 user nova-compute[75176]: DEBUG nova.network.neutron [req-6d183594-4ca3-49e3-9c61-3629f85f780a req-5cccbb3d-3c06-4593-8d41-2c2e3cb91b70 service nova] [instance: 7af26650-2a61-4557-8c3d-0688ddbc6343] Instance cache missing network info. {{(pid=75176) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 16:11:27 user nova-compute[75176]: DEBUG nova.compute.provider_tree [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Inventory has not changed in ProviderTree for provider: b37848d8-f401-4155-a029-b0ffa09ff85b {{(pid=75176) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 16:11:27 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Inventory has not changed for provider b37848d8-f401-4155-a029-b0ffa09ff85b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75176) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 16:11:27 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Compute_service record updated for user:user {{(pid=75176) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 16:11:27 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.539s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:11:27 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 16:11:27 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:11:27 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75176) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 16:11:27 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75176) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 16:11:27 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75176) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 16:11:27 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:11:27 user nova-compute[75176]: DEBUG nova.network.neutron [req-6d183594-4ca3-49e3-9c61-3629f85f780a req-5cccbb3d-3c06-4593-8d41-2c2e3cb91b70 service nova] [instance: 7af26650-2a61-4557-8c3d-0688ddbc6343] Updating instance_info_cache with network_info: [] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 16:11:27 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-6d183594-4ca3-49e3-9c61-3629f85f780a req-5cccbb3d-3c06-4593-8d41-2c2e3cb91b70 service nova] Releasing lock "refresh_cache-7af26650-2a61-4557-8c3d-0688ddbc6343" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 16:11:27 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-52c5eca5-e787-4257-b645-eea6f403f999 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Acquired lock "refresh_cache-7af26650-2a61-4557-8c3d-0688ddbc6343" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 16:11:27 user nova-compute[75176]: DEBUG nova.network.neutron [None req-52c5eca5-e787-4257-b645-eea6f403f999 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] [instance: 7af26650-2a61-4557-8c3d-0688ddbc6343] Building network info cache for instance {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 16:11:27 user nova-compute[75176]: DEBUG nova.network.neutron [None req-52c5eca5-e787-4257-b645-eea6f403f999 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] [instance: 7af26650-2a61-4557-8c3d-0688ddbc6343] Instance cache missing network info. {{(pid=75176) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 16:11:27 user nova-compute[75176]: DEBUG nova.network.neutron [None req-52c5eca5-e787-4257-b645-eea6f403f999 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] [instance: 7af26650-2a61-4557-8c3d-0688ddbc6343] Updating instance_info_cache with network_info: [{"id": "ed4b6bff-3d17-4593-aabb-38a65b35aaea", "address": "fa:16:3e:81:6d:41", "network": {"id": "9faaeac5-1688-436d-90fb-38bb1c4d3da4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1225296735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6aab7b19b9414b5da476b87e144cc40b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped4b6bff-3d", "ovs_interfaceid": "ed4b6bff-3d17-4593-aabb-38a65b35aaea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 16:11:27 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-52c5eca5-e787-4257-b645-eea6f403f999 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Releasing lock "refresh_cache-7af26650-2a61-4557-8c3d-0688ddbc6343" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 16:11:27 user nova-compute[75176]: DEBUG nova.compute.manager [None req-52c5eca5-e787-4257-b645-eea6f403f999 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] [instance: 7af26650-2a61-4557-8c3d-0688ddbc6343] Instance network_info: |[{"id": "ed4b6bff-3d17-4593-aabb-38a65b35aaea", "address": "fa:16:3e:81:6d:41", "network": {"id": "9faaeac5-1688-436d-90fb-38bb1c4d3da4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1225296735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6aab7b19b9414b5da476b87e144cc40b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped4b6bff-3d", "ovs_interfaceid": "ed4b6bff-3d17-4593-aabb-38a65b35aaea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75176) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 16:11:27 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-52c5eca5-e787-4257-b645-eea6f403f999 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] [instance: 7af26650-2a61-4557-8c3d-0688ddbc6343] Start _get_guest_xml network_info=[{"id": "ed4b6bff-3d17-4593-aabb-38a65b35aaea", "address": "fa:16:3e:81:6d:41", "network": {"id": "9faaeac5-1688-436d-90fb-38bb1c4d3da4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1225296735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6aab7b19b9414b5da476b87e144cc40b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped4b6bff-3d", "ovs_interfaceid": "ed4b6bff-3d17-4593-aabb-38a65b35aaea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T15:35:12Z,direct_url=<?>,disk_format='qcow2',id=1f41819e-c93f-4dc7-b253-37a27bbbbc74,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1b91c5d0672c4224a48df2e1f92688e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T15:35:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'size': 0, 'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'image_id': '1f41819e-c93f-4dc7-b253-37a27bbbbc74'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75176) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 16:11:27 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-52c5eca5-e787-4257-b645-eea6f403f999 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 16:11:27 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-52c5eca5-e787-4257-b645-eea6f403f999 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 16:11:27 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-52c5eca5-e787-4257-b645-eea6f403f999 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75176) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 16:11:27 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-52c5eca5-e787-4257-b645-eea6f403f999 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] CPU controller missing on host. {{(pid=75176) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 16:11:27 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-52c5eca5-e787-4257-b645-eea6f403f999 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75176) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 16:11:27 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-52c5eca5-e787-4257-b645-eea6f403f999 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] CPU controller found on host. {{(pid=75176) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 16:11:27 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-52c5eca5-e787-4257-b645-eea6f403f999 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75176) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 16:11:27 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-52c5eca5-e787-4257-b645-eea6f403f999 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T15:35:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T15:35:12Z,direct_url=<?>,disk_format='qcow2',id=1f41819e-c93f-4dc7-b253-37a27bbbbc74,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1b91c5d0672c4224a48df2e1f92688e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T15:35:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 16:11:27 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-52c5eca5-e787-4257-b645-eea6f403f999 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Flavor limits 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 16:11:27 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-52c5eca5-e787-4257-b645-eea6f403f999 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Image limits 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 16:11:27 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-52c5eca5-e787-4257-b645-eea6f403f999 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Flavor pref 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 16:11:27 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-52c5eca5-e787-4257-b645-eea6f403f999 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Image pref 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 16:11:27 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-52c5eca5-e787-4257-b645-eea6f403f999 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 16:11:27 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-52c5eca5-e787-4257-b645-eea6f403f999 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 16:11:27 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-52c5eca5-e787-4257-b645-eea6f403f999 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75176) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 16:11:27 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-52c5eca5-e787-4257-b645-eea6f403f999 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Got 1 possible topologies {{(pid=75176) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 16:11:27 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-52c5eca5-e787-4257-b645-eea6f403f999 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 16:11:27 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-52c5eca5-e787-4257-b645-eea6f403f999 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 16:11:27 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-52c5eca5-e787-4257-b645-eea6f403f999 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T16:11:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-943002828',display_name='tempest-AttachVolumeTestJSON-server-943002828',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-943002828',id=52,image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAcJdIqIdQzt0cHkTQAr4zbHkDyepmObwrfc8oOAY4jaezKsWqag8HJKtuLyoPnBmfV+JbJOGEKpt/rVBy0IxFm14gbiM+EXS0/KO4bWdbBNYXzrAN0w8aA7qmnamdWwNA==',key_name='tempest-keypair-1859788446',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6aab7b19b9414b5da476b87e144cc40b',ramdisk_id='',reservation_id='r-ygxmvi1h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-365725655',owner_user_name='tempest-AttachVolumeTestJSON-365725655-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T16:11:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='60b513cfc58647d49fc084d51964a4c6',uuid=7af26650-2a61-4557-8c3d-0688ddbc6343,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ed4b6bff-3d17-4593-aabb-38a65b35aaea", "address": "fa:16:3e:81:6d:41", "network": {"id": "9faaeac5-1688-436d-90fb-38bb1c4d3da4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1225296735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6aab7b19b9414b5da476b87e144cc40b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped4b6bff-3d", "ovs_interfaceid": "ed4b6bff-3d17-4593-aabb-38a65b35aaea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75176) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 16:11:27 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-52c5eca5-e787-4257-b645-eea6f403f999 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Converting VIF {"id": "ed4b6bff-3d17-4593-aabb-38a65b35aaea", "address": "fa:16:3e:81:6d:41", "network": {"id": "9faaeac5-1688-436d-90fb-38bb1c4d3da4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1225296735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6aab7b19b9414b5da476b87e144cc40b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped4b6bff-3d", "ovs_interfaceid": "ed4b6bff-3d17-4593-aabb-38a65b35aaea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 16:11:27 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-52c5eca5-e787-4257-b645-eea6f403f999 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:6d:41,bridge_name='br-int',has_traffic_filtering=True,id=ed4b6bff-3d17-4593-aabb-38a65b35aaea,network=Network(9faaeac5-1688-436d-90fb-38bb1c4d3da4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped4b6bff-3d') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 16:11:27 user nova-compute[75176]: DEBUG nova.objects.instance [None req-52c5eca5-e787-4257-b645-eea6f403f999 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Lazy-loading 'pci_devices' on Instance uuid 7af26650-2a61-4557-8c3d-0688ddbc6343 {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 16:11:27 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-52c5eca5-e787-4257-b645-eea6f403f999 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] [instance: 7af26650-2a61-4557-8c3d-0688ddbc6343] End _get_guest_xml xml=<domain type="kvm">
Nov 28 16:11:27 user nova-compute[75176]:   <uuid>7af26650-2a61-4557-8c3d-0688ddbc6343</uuid>
Nov 28 16:11:27 user nova-compute[75176]:   <name>instance-00000034</name>
Nov 28 16:11:27 user nova-compute[75176]:   <memory>524288</memory>
Nov 28 16:11:27 user nova-compute[75176]:   <vcpu>1</vcpu>
Nov 28 16:11:27 user nova-compute[75176]:   <metadata>
Nov 28 16:11:27 user nova-compute[75176]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 16:11:27 user nova-compute[75176]:       <nova:package version="0.0.0"/>
Nov 28 16:11:27 user nova-compute[75176]:       <nova:name>tempest-AttachVolumeTestJSON-server-943002828</nova:name>
Nov 28 16:11:27 user nova-compute[75176]:       <nova:creationTime>2023-11-28 16:11:27</nova:creationTime>
Nov 28 16:11:27 user nova-compute[75176]:       <nova:flavor name="m1.tiny">
Nov 28 16:11:27 user nova-compute[75176]:         <nova:memory>512</nova:memory>
Nov 28 16:11:27 user nova-compute[75176]:         <nova:disk>1</nova:disk>
Nov 28 16:11:27 user nova-compute[75176]:         <nova:swap>0</nova:swap>
Nov 28 16:11:27 user nova-compute[75176]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 16:11:27 user nova-compute[75176]:         <nova:vcpus>1</nova:vcpus>
Nov 28 16:11:27 user nova-compute[75176]:       </nova:flavor>
Nov 28 16:11:27 user nova-compute[75176]:       <nova:owner>
Nov 28 16:11:27 user nova-compute[75176]:         <nova:user uuid="60b513cfc58647d49fc084d51964a4c6">tempest-AttachVolumeTestJSON-365725655-project-member</nova:user>
Nov 28 16:11:27 user nova-compute[75176]:         <nova:project uuid="6aab7b19b9414b5da476b87e144cc40b">tempest-AttachVolumeTestJSON-365725655</nova:project>
Nov 28 16:11:27 user nova-compute[75176]:       </nova:owner>
Nov 28 16:11:27 user nova-compute[75176]:       <nova:root type="image" uuid="1f41819e-c93f-4dc7-b253-37a27bbbbc74"/>
Nov 28 16:11:27 user nova-compute[75176]:       <nova:ports>
Nov 28 16:11:27 user nova-compute[75176]:         <nova:port uuid="ed4b6bff-3d17-4593-aabb-38a65b35aaea">
Nov 28 16:11:27 user nova-compute[75176]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 28 16:11:27 user nova-compute[75176]:         </nova:port>
Nov 28 16:11:27 user nova-compute[75176]:       </nova:ports>
Nov 28 16:11:27 user nova-compute[75176]:     </nova:instance>
Nov 28 16:11:27 user nova-compute[75176]:   </metadata>
Nov 28 16:11:27 user nova-compute[75176]:   <sysinfo type="smbios">
Nov 28 16:11:27 user nova-compute[75176]:     <system>
Nov 28 16:11:27 user nova-compute[75176]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 16:11:27 user nova-compute[75176]:       <entry name="product">OpenStack Nova</entry>
Nov 28 16:11:27 user nova-compute[75176]:       <entry name="version">0.0.0</entry>
Nov 28 16:11:27 user nova-compute[75176]:       <entry name="serial">7af26650-2a61-4557-8c3d-0688ddbc6343</entry>
Nov 28 16:11:27 user nova-compute[75176]:       <entry name="uuid">7af26650-2a61-4557-8c3d-0688ddbc6343</entry>
Nov 28 16:11:27 user nova-compute[75176]:       <entry name="family">Virtual Machine</entry>
Nov 28 16:11:27 user nova-compute[75176]:     </system>
Nov 28 16:11:27 user nova-compute[75176]:   </sysinfo>
Nov 28 16:11:27 user nova-compute[75176]:   <os>
Nov 28 16:11:27 user nova-compute[75176]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 16:11:27 user nova-compute[75176]:     <boot dev="hd"/>
Nov 28 16:11:27 user nova-compute[75176]:     <smbios mode="sysinfo"/>
Nov 28 16:11:27 user nova-compute[75176]:   </os>
Nov 28 16:11:27 user nova-compute[75176]:   <features>
Nov 28 16:11:27 user nova-compute[75176]:     <acpi/>
Nov 28 16:11:27 user nova-compute[75176]:     <apic/>
Nov 28 16:11:27 user nova-compute[75176]:     <vmcoreinfo/>
Nov 28 16:11:27 user nova-compute[75176]:   </features>
Nov 28 16:11:27 user nova-compute[75176]:   <clock offset="utc">
Nov 28 16:11:27 user nova-compute[75176]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 16:11:27 user nova-compute[75176]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 16:11:27 user nova-compute[75176]:     <timer name="hpet" present="no"/>
Nov 28 16:11:27 user nova-compute[75176]:   </clock>
Nov 28 16:11:27 user nova-compute[75176]:   <cpu mode="custom" match="exact">
Nov 28 16:11:27 user nova-compute[75176]:     <model>Nehalem</model>
Nov 28 16:11:27 user nova-compute[75176]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 16:11:27 user nova-compute[75176]:   </cpu>
Nov 28 16:11:27 user nova-compute[75176]:   <devices>
Nov 28 16:11:27 user nova-compute[75176]:     <disk type="file" device="disk">
Nov 28 16:11:27 user nova-compute[75176]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 16:11:27 user nova-compute[75176]:       <source file="/opt/stack/data/nova/instances/7af26650-2a61-4557-8c3d-0688ddbc6343/disk"/>
Nov 28 16:11:27 user nova-compute[75176]:       <target dev="vda" bus="virtio"/>
Nov 28 16:11:27 user nova-compute[75176]:     </disk>
Nov 28 16:11:27 user nova-compute[75176]:     <interface type="ethernet">
Nov 28 16:11:27 user nova-compute[75176]:       <mac address="fa:16:3e:81:6d:41"/>
Nov 28 16:11:27 user nova-compute[75176]:       <model type="virtio"/>
Nov 28 16:11:27 user nova-compute[75176]:       <mtu size="1442"/>
Nov 28 16:11:27 user nova-compute[75176]:       <target dev="taped4b6bff-3d"/>
Nov 28 16:11:27 user nova-compute[75176]:     </interface>
Nov 28 16:11:27 user nova-compute[75176]:     <serial type="pty">
Nov 28 16:11:27 user nova-compute[75176]:       <log file="/opt/stack/data/nova/instances/7af26650-2a61-4557-8c3d-0688ddbc6343/console.log" append="off"/>
Nov 28 16:11:27 user nova-compute[75176]:     </serial>
Nov 28 16:11:27 user nova-compute[75176]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 16:11:27 user nova-compute[75176]:     <video>
Nov 28 16:11:27 user nova-compute[75176]:       <model type="virtio"/>
Nov 28 16:11:27 user nova-compute[75176]:     </video>
Nov 28 16:11:27 user nova-compute[75176]:     <rng model="virtio">
Nov 28 16:11:27 user nova-compute[75176]:       <backend model="random">/dev/urandom</backend>
Nov 28 16:11:27 user nova-compute[75176]:     </rng>
Nov 28 16:11:27 user nova-compute[75176]:     <controller type="usb" index="0" model="none"/>
Nov 28 16:11:27 user nova-compute[75176]:     <memballoon model="virtio">
Nov 28 16:11:27 user nova-compute[75176]:       <stats period="10"/>
Nov 28 16:11:27 user nova-compute[75176]:     </memballoon>
Nov 28 16:11:27 user nova-compute[75176]:   </devices>
Nov 28 16:11:27 user nova-compute[75176]: </domain>
Nov 28 16:11:27 user nova-compute[75176]:  {{(pid=75176) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 16:11:27 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-52c5eca5-e787-4257-b645-eea6f403f999 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T16:11:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-943002828',display_name='tempest-AttachVolumeTestJSON-server-943002828',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-943002828',id=52,image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAcJdIqIdQzt0cHkTQAr4zbHkDyepmObwrfc8oOAY4jaezKsWqag8HJKtuLyoPnBmfV+JbJOGEKpt/rVBy0IxFm14gbiM+EXS0/KO4bWdbBNYXzrAN0w8aA7qmnamdWwNA==',key_name='tempest-keypair-1859788446',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6aab7b19b9414b5da476b87e144cc40b',ramdisk_id='',reservation_id='r-ygxmvi1h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-365725655',owner_user_name='tempest-AttachVolumeTestJSON-365725655-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T16:11:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='60b513cfc58647d49fc084d51964a4c6',uuid=7af26650-2a61-4557-8c3d-0688ddbc6343,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ed4b6bff-3d17-4593-aabb-38a65b35aaea", "address": "fa:16:3e:81:6d:41", "network": {"id": "9faaeac5-1688-436d-90fb-38bb1c4d3da4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1225296735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6aab7b19b9414b5da476b87e144cc40b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped4b6bff-3d", "ovs_interfaceid": "ed4b6bff-3d17-4593-aabb-38a65b35aaea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 16:11:27 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-52c5eca5-e787-4257-b645-eea6f403f999 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Converting VIF {"id": "ed4b6bff-3d17-4593-aabb-38a65b35aaea", "address": "fa:16:3e:81:6d:41", "network": {"id": "9faaeac5-1688-436d-90fb-38bb1c4d3da4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1225296735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6aab7b19b9414b5da476b87e144cc40b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped4b6bff-3d", "ovs_interfaceid": "ed4b6bff-3d17-4593-aabb-38a65b35aaea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 16:11:27 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-52c5eca5-e787-4257-b645-eea6f403f999 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:6d:41,bridge_name='br-int',has_traffic_filtering=True,id=ed4b6bff-3d17-4593-aabb-38a65b35aaea,network=Network(9faaeac5-1688-436d-90fb-38bb1c4d3da4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped4b6bff-3d') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 16:11:27 user nova-compute[75176]: DEBUG os_vif [None req-52c5eca5-e787-4257-b645-eea6f403f999 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:6d:41,bridge_name='br-int',has_traffic_filtering=True,id=ed4b6bff-3d17-4593-aabb-38a65b35aaea,network=Network(9faaeac5-1688-436d-90fb-38bb1c4d3da4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped4b6bff-3d') {{(pid=75176) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 16:11:27 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:11:27 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 16:11:27 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 16:11:27 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:11:27 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bbebe1f4-9ed2-543d-ba36-7ac9a69c74c2', '_type': 'linux-noop'}}, row=False) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 16:11:27 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:11:27 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 16:11:27 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:11:27 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=taped4b6bff-3d, may_exist=True, interface_attrs={}) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 16:11:27 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=taped4b6bff-3d, col_values=(('qos', UUID('a3fd1d08-1fc5-4859-ae88-b1eb0be081ec')),), if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 16:11:27 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=taped4b6bff-3d, col_values=(('external_ids', {'iface-id': 'ed4b6bff-3d17-4593-aabb-38a65b35aaea', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:81:6d:41', 'vm-uuid': '7af26650-2a61-4557-8c3d-0688ddbc6343'}),), if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 16:11:27 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:11:27 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 16:11:27 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:11:27 user nova-compute[75176]: INFO os_vif [None req-52c5eca5-e787-4257-b645-eea6f403f999 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:6d:41,bridge_name='br-int',has_traffic_filtering=True,id=ed4b6bff-3d17-4593-aabb-38a65b35aaea,network=Network(9faaeac5-1688-436d-90fb-38bb1c4d3da4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped4b6bff-3d')
Nov 28 16:11:27 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-52c5eca5-e787-4257-b645-eea6f403f999 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] No BDM found with device name vda, not building metadata. {{(pid=75176) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 16:11:27 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-52c5eca5-e787-4257-b645-eea6f403f999 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] No VIF found with MAC fa:16:3e:81:6d:41, not building metadata {{(pid=75176) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 16:11:28 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:11:28 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:11:28 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:11:29 user nova-compute[75176]: DEBUG nova.compute.manager [req-19f01b2b-de3f-45f7-b665-c67e506f1cce req-02eb4226-bb4c-40d1-87e3-c51f9f0186ae service nova] [instance: 7af26650-2a61-4557-8c3d-0688ddbc6343] Received event network-vif-plugged-ed4b6bff-3d17-4593-aabb-38a65b35aaea {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 16:11:29 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-19f01b2b-de3f-45f7-b665-c67e506f1cce req-02eb4226-bb4c-40d1-87e3-c51f9f0186ae service nova] Acquiring lock "7af26650-2a61-4557-8c3d-0688ddbc6343-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:11:29 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-19f01b2b-de3f-45f7-b665-c67e506f1cce req-02eb4226-bb4c-40d1-87e3-c51f9f0186ae service nova] Lock "7af26650-2a61-4557-8c3d-0688ddbc6343-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:11:29 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-19f01b2b-de3f-45f7-b665-c67e506f1cce req-02eb4226-bb4c-40d1-87e3-c51f9f0186ae service nova] Lock "7af26650-2a61-4557-8c3d-0688ddbc6343-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:11:29 user nova-compute[75176]: DEBUG nova.compute.manager [req-19f01b2b-de3f-45f7-b665-c67e506f1cce req-02eb4226-bb4c-40d1-87e3-c51f9f0186ae service nova] [instance: 7af26650-2a61-4557-8c3d-0688ddbc6343] No waiting events found dispatching network-vif-plugged-ed4b6bff-3d17-4593-aabb-38a65b35aaea {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 16:11:29 user nova-compute[75176]: WARNING nova.compute.manager [req-19f01b2b-de3f-45f7-b665-c67e506f1cce req-02eb4226-bb4c-40d1-87e3-c51f9f0186ae service nova] [instance: 7af26650-2a61-4557-8c3d-0688ddbc6343] Received unexpected event network-vif-plugged-ed4b6bff-3d17-4593-aabb-38a65b35aaea for instance with vm_state building and task_state spawning.
Nov 28 16:11:29 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:11:29 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:11:29 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:11:29 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:11:30 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:11:31 user nova-compute[75176]: DEBUG nova.compute.manager [None req-52c5eca5-e787-4257-b645-eea6f403f999 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] [instance: 7af26650-2a61-4557-8c3d-0688ddbc6343] Instance event wait completed in 0 seconds for  {{(pid=75176) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 16:11:31 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-52c5eca5-e787-4257-b645-eea6f403f999 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] [instance: 7af26650-2a61-4557-8c3d-0688ddbc6343] Guest created on hypervisor {{(pid=75176) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 16:11:31 user nova-compute[75176]: INFO nova.virt.libvirt.driver [-] [instance: 7af26650-2a61-4557-8c3d-0688ddbc6343] Instance spawned successfully.
Nov 28 16:11:31 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-52c5eca5-e787-4257-b645-eea6f403f999 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] [instance: 7af26650-2a61-4557-8c3d-0688ddbc6343] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 16:11:31 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-52c5eca5-e787-4257-b645-eea6f403f999 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] [instance: 7af26650-2a61-4557-8c3d-0688ddbc6343] Found default for hw_cdrom_bus of ide {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 16:11:31 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-52c5eca5-e787-4257-b645-eea6f403f999 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] [instance: 7af26650-2a61-4557-8c3d-0688ddbc6343] Found default for hw_disk_bus of virtio {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 16:11:31 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-52c5eca5-e787-4257-b645-eea6f403f999 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] [instance: 7af26650-2a61-4557-8c3d-0688ddbc6343] Found default for hw_input_bus of None {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 16:11:31 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-52c5eca5-e787-4257-b645-eea6f403f999 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] [instance: 7af26650-2a61-4557-8c3d-0688ddbc6343] Found default for hw_pointer_model of None {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 16:11:31 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-52c5eca5-e787-4257-b645-eea6f403f999 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] [instance: 7af26650-2a61-4557-8c3d-0688ddbc6343] Found default for hw_video_model of virtio {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 16:11:31 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-52c5eca5-e787-4257-b645-eea6f403f999 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] [instance: 7af26650-2a61-4557-8c3d-0688ddbc6343] Found default for hw_vif_model of virtio {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 16:11:31 user nova-compute[75176]: INFO nova.compute.manager [None req-52c5eca5-e787-4257-b645-eea6f403f999 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] [instance: 7af26650-2a61-4557-8c3d-0688ddbc6343] Took 5.48 seconds to spawn the instance on the hypervisor.
Nov 28 16:11:31 user nova-compute[75176]: DEBUG nova.compute.manager [None req-52c5eca5-e787-4257-b645-eea6f403f999 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] [instance: 7af26650-2a61-4557-8c3d-0688ddbc6343] Checking state {{(pid=75176) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 16:11:31 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:11:31 user nova-compute[75176]: DEBUG nova.compute.manager [req-dceaa139-2846-4d63-a55d-1c7656d9fa01 req-8c9d655f-d484-4afb-8bf2-9afc812cf4f8 service nova] [instance: 7af26650-2a61-4557-8c3d-0688ddbc6343] Received event network-vif-plugged-ed4b6bff-3d17-4593-aabb-38a65b35aaea {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 16:11:31 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-dceaa139-2846-4d63-a55d-1c7656d9fa01 req-8c9d655f-d484-4afb-8bf2-9afc812cf4f8 service nova] Acquiring lock "7af26650-2a61-4557-8c3d-0688ddbc6343-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:11:31 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-dceaa139-2846-4d63-a55d-1c7656d9fa01 req-8c9d655f-d484-4afb-8bf2-9afc812cf4f8 service nova] Lock "7af26650-2a61-4557-8c3d-0688ddbc6343-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:11:31 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-dceaa139-2846-4d63-a55d-1c7656d9fa01 req-8c9d655f-d484-4afb-8bf2-9afc812cf4f8 service nova] Lock "7af26650-2a61-4557-8c3d-0688ddbc6343-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:11:31 user nova-compute[75176]: DEBUG nova.compute.manager [req-dceaa139-2846-4d63-a55d-1c7656d9fa01 req-8c9d655f-d484-4afb-8bf2-9afc812cf4f8 service nova] [instance: 7af26650-2a61-4557-8c3d-0688ddbc6343] No waiting events found dispatching network-vif-plugged-ed4b6bff-3d17-4593-aabb-38a65b35aaea {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 16:11:31 user nova-compute[75176]: WARNING nova.compute.manager [req-dceaa139-2846-4d63-a55d-1c7656d9fa01 req-8c9d655f-d484-4afb-8bf2-9afc812cf4f8 service nova] [instance: 7af26650-2a61-4557-8c3d-0688ddbc6343] Received unexpected event network-vif-plugged-ed4b6bff-3d17-4593-aabb-38a65b35aaea for instance with vm_state building and task_state spawning.
Nov 28 16:11:31 user nova-compute[75176]: INFO nova.compute.manager [None req-52c5eca5-e787-4257-b645-eea6f403f999 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] [instance: 7af26650-2a61-4557-8c3d-0688ddbc6343] Took 6.05 seconds to build instance.
Nov 28 16:11:31 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-52c5eca5-e787-4257-b645-eea6f403f999 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Lock "7af26650-2a61-4557-8c3d-0688ddbc6343" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.152s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:11:32 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:11:35 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:11:37 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:11:42 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 16:11:42 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:11:42 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75176) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 16:11:42 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75176) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 16:11:42 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75176) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 16:11:42 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:11:45 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:11:47 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:11:50 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:11:51 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-478492c6-e23f-48b0-9f57-8469863e400d tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] Acquiring lock "10159a3d-8e58-4e42-87e1-9b8bf6638078" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:11:51 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-478492c6-e23f-48b0-9f57-8469863e400d tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] Lock "10159a3d-8e58-4e42-87e1-9b8bf6638078" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:11:51 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-478492c6-e23f-48b0-9f57-8469863e400d tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] Acquiring lock "10159a3d-8e58-4e42-87e1-9b8bf6638078-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:11:51 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-478492c6-e23f-48b0-9f57-8469863e400d tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] Lock "10159a3d-8e58-4e42-87e1-9b8bf6638078-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:11:51 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-478492c6-e23f-48b0-9f57-8469863e400d tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] Lock "10159a3d-8e58-4e42-87e1-9b8bf6638078-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:11:51 user nova-compute[75176]: INFO nova.compute.manager [None req-478492c6-e23f-48b0-9f57-8469863e400d tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] [instance: 10159a3d-8e58-4e42-87e1-9b8bf6638078] Terminating instance
Nov 28 16:11:51 user nova-compute[75176]: DEBUG nova.compute.manager [None req-478492c6-e23f-48b0-9f57-8469863e400d tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] [instance: 10159a3d-8e58-4e42-87e1-9b8bf6638078] Start destroying the instance on the hypervisor. {{(pid=75176) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 16:11:52 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:11:52 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:11:52 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:11:52 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:11:52 user nova-compute[75176]: DEBUG nova.compute.manager [req-da1c0a80-6b7d-4a26-af67-4e8b3f90a2f8 req-41d9c536-00dc-485d-ae5b-2e6aadc65018 service nova] [instance: 10159a3d-8e58-4e42-87e1-9b8bf6638078] Received event network-vif-unplugged-81ca8941-ecf0-432d-a9f0-7a92e37e13f8 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 16:11:52 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-da1c0a80-6b7d-4a26-af67-4e8b3f90a2f8 req-41d9c536-00dc-485d-ae5b-2e6aadc65018 service nova] Acquiring lock "10159a3d-8e58-4e42-87e1-9b8bf6638078-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:11:52 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-da1c0a80-6b7d-4a26-af67-4e8b3f90a2f8 req-41d9c536-00dc-485d-ae5b-2e6aadc65018 service nova] Lock "10159a3d-8e58-4e42-87e1-9b8bf6638078-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:11:52 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-da1c0a80-6b7d-4a26-af67-4e8b3f90a2f8 req-41d9c536-00dc-485d-ae5b-2e6aadc65018 service nova] Lock "10159a3d-8e58-4e42-87e1-9b8bf6638078-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:11:52 user nova-compute[75176]: DEBUG nova.compute.manager [req-da1c0a80-6b7d-4a26-af67-4e8b3f90a2f8 req-41d9c536-00dc-485d-ae5b-2e6aadc65018 service nova] [instance: 10159a3d-8e58-4e42-87e1-9b8bf6638078] No waiting events found dispatching network-vif-unplugged-81ca8941-ecf0-432d-a9f0-7a92e37e13f8 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 16:11:52 user nova-compute[75176]: DEBUG nova.compute.manager [req-da1c0a80-6b7d-4a26-af67-4e8b3f90a2f8 req-41d9c536-00dc-485d-ae5b-2e6aadc65018 service nova] [instance: 10159a3d-8e58-4e42-87e1-9b8bf6638078] Received event network-vif-unplugged-81ca8941-ecf0-432d-a9f0-7a92e37e13f8 for instance with task_state deleting. {{(pid=75176) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 16:11:52 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:11:52 user nova-compute[75176]: INFO nova.virt.libvirt.driver [-] [instance: 10159a3d-8e58-4e42-87e1-9b8bf6638078] Instance destroyed successfully.
Nov 28 16:11:52 user nova-compute[75176]: DEBUG nova.objects.instance [None req-478492c6-e23f-48b0-9f57-8469863e400d tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] Lazy-loading 'resources' on Instance uuid 10159a3d-8e58-4e42-87e1-9b8bf6638078 {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 16:11:52 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-478492c6-e23f-48b0-9f57-8469863e400d tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T16:10:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1913320624',display_name='tempest-VolumesActionsTest-instance-1913320624',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1913320624',id=51,image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-28T16:10:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a80e74a1524540e4ac5fa47fd10d9f91',ramdisk_id='',reservation_id='r-504rv6gf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1656567418',owner_user_name='tempest-VolumesActionsTest-1656567418-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T16:10:07Z,user_data=None,user_id='755305bd64eb4fdfafa111b8688d2c4b',uuid=10159a3d-8e58-4e42-87e1-9b8bf6638078,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "81ca8941-ecf0-432d-a9f0-7a92e37e13f8", "address": "fa:16:3e:5b:6d:fc", "network": {"id": "25a35e69-32b6-4a72-8857-26a854eba808", "bridge": "br-int", "label": "tempest-VolumesActionsTest-262226956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a80e74a1524540e4ac5fa47fd10d9f91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81ca8941-ec", "ovs_interfaceid": "81ca8941-ecf0-432d-a9f0-7a92e37e13f8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 16:11:52 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-478492c6-e23f-48b0-9f57-8469863e400d tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] Converting VIF {"id": "81ca8941-ecf0-432d-a9f0-7a92e37e13f8", "address": "fa:16:3e:5b:6d:fc", "network": {"id": "25a35e69-32b6-4a72-8857-26a854eba808", "bridge": "br-int", "label": "tempest-VolumesActionsTest-262226956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a80e74a1524540e4ac5fa47fd10d9f91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81ca8941-ec", "ovs_interfaceid": "81ca8941-ecf0-432d-a9f0-7a92e37e13f8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 16:11:52 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-478492c6-e23f-48b0-9f57-8469863e400d tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5b:6d:fc,bridge_name='br-int',has_traffic_filtering=True,id=81ca8941-ecf0-432d-a9f0-7a92e37e13f8,network=Network(25a35e69-32b6-4a72-8857-26a854eba808),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81ca8941-ec') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 16:11:52 user nova-compute[75176]: DEBUG os_vif [None req-478492c6-e23f-48b0-9f57-8469863e400d tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5b:6d:fc,bridge_name='br-int',has_traffic_filtering=True,id=81ca8941-ecf0-432d-a9f0-7a92e37e13f8,network=Network(25a35e69-32b6-4a72-8857-26a854eba808),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81ca8941-ec') {{(pid=75176) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 16:11:52 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:11:52 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap81ca8941-ec, bridge=br-int, if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 16:11:52 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:11:52 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 16:11:52 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:11:52 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0f140f66-c56a-4fd7-addd-487e6bcc3728) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 16:11:52 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:11:52 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 16:11:52 user nova-compute[75176]: INFO os_vif [None req-478492c6-e23f-48b0-9f57-8469863e400d tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5b:6d:fc,bridge_name='br-int',has_traffic_filtering=True,id=81ca8941-ecf0-432d-a9f0-7a92e37e13f8,network=Network(25a35e69-32b6-4a72-8857-26a854eba808),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81ca8941-ec')
Nov 28 16:11:52 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-478492c6-e23f-48b0-9f57-8469863e400d tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] [instance: 10159a3d-8e58-4e42-87e1-9b8bf6638078] Deleting instance files /opt/stack/data/nova/instances/10159a3d-8e58-4e42-87e1-9b8bf6638078_del
Nov 28 16:11:52 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-478492c6-e23f-48b0-9f57-8469863e400d tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] [instance: 10159a3d-8e58-4e42-87e1-9b8bf6638078] Deletion of /opt/stack/data/nova/instances/10159a3d-8e58-4e42-87e1-9b8bf6638078_del complete
Nov 28 16:11:52 user nova-compute[75176]: INFO nova.compute.manager [None req-478492c6-e23f-48b0-9f57-8469863e400d tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] [instance: 10159a3d-8e58-4e42-87e1-9b8bf6638078] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 28 16:11:52 user nova-compute[75176]: DEBUG oslo.service.loopingcall [None req-478492c6-e23f-48b0-9f57-8469863e400d tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75176) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 16:11:52 user nova-compute[75176]: DEBUG nova.compute.manager [-] [instance: 10159a3d-8e58-4e42-87e1-9b8bf6638078] Deallocating network for instance {{(pid=75176) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 16:11:52 user nova-compute[75176]: DEBUG nova.network.neutron [-] [instance: 10159a3d-8e58-4e42-87e1-9b8bf6638078] deallocate_for_instance() {{(pid=75176) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 16:11:53 user nova-compute[75176]: DEBUG nova.network.neutron [-] [instance: 10159a3d-8e58-4e42-87e1-9b8bf6638078] Updating instance_info_cache with network_info: [] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 16:11:53 user nova-compute[75176]: INFO nova.compute.manager [-] [instance: 10159a3d-8e58-4e42-87e1-9b8bf6638078] Took 0.96 seconds to deallocate network for instance.
Nov 28 16:11:53 user nova-compute[75176]: DEBUG nova.compute.manager [req-afeaab3c-0ba3-476c-ad57-5c02d51b635e req-310ef193-e576-4010-957a-3debfdbbb381 service nova] [instance: 10159a3d-8e58-4e42-87e1-9b8bf6638078] Received event network-vif-deleted-81ca8941-ecf0-432d-a9f0-7a92e37e13f8 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 16:11:53 user nova-compute[75176]: INFO nova.compute.manager [req-afeaab3c-0ba3-476c-ad57-5c02d51b635e req-310ef193-e576-4010-957a-3debfdbbb381 service nova] [instance: 10159a3d-8e58-4e42-87e1-9b8bf6638078] Neutron deleted interface 81ca8941-ecf0-432d-a9f0-7a92e37e13f8; detaching it from the instance and deleting it from the info cache
Nov 28 16:11:53 user nova-compute[75176]: DEBUG nova.network.neutron [req-afeaab3c-0ba3-476c-ad57-5c02d51b635e req-310ef193-e576-4010-957a-3debfdbbb381 service nova] [instance: 10159a3d-8e58-4e42-87e1-9b8bf6638078] Updating instance_info_cache with network_info: [] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 16:11:53 user nova-compute[75176]: DEBUG nova.compute.manager [req-afeaab3c-0ba3-476c-ad57-5c02d51b635e req-310ef193-e576-4010-957a-3debfdbbb381 service nova] [instance: 10159a3d-8e58-4e42-87e1-9b8bf6638078] Detach interface failed, port_id=81ca8941-ecf0-432d-a9f0-7a92e37e13f8, reason: Instance 10159a3d-8e58-4e42-87e1-9b8bf6638078 could not be found. {{(pid=75176) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 28 16:11:53 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-478492c6-e23f-48b0-9f57-8469863e400d tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:11:53 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-478492c6-e23f-48b0-9f57-8469863e400d tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:11:53 user nova-compute[75176]: DEBUG nova.compute.provider_tree [None req-478492c6-e23f-48b0-9f57-8469863e400d tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] Inventory has not changed in ProviderTree for provider: b37848d8-f401-4155-a029-b0ffa09ff85b {{(pid=75176) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 16:11:53 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-478492c6-e23f-48b0-9f57-8469863e400d tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] Inventory has not changed for provider b37848d8-f401-4155-a029-b0ffa09ff85b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75176) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 16:11:53 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-478492c6-e23f-48b0-9f57-8469863e400d tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.147s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:11:54 user nova-compute[75176]: INFO nova.scheduler.client.report [None req-478492c6-e23f-48b0-9f57-8469863e400d tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] Deleted allocations for instance 10159a3d-8e58-4e42-87e1-9b8bf6638078
Nov 28 16:11:54 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-478492c6-e23f-48b0-9f57-8469863e400d tempest-VolumesActionsTest-1656567418 tempest-VolumesActionsTest-1656567418-project-member] Lock "10159a3d-8e58-4e42-87e1-9b8bf6638078" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.160s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:11:54 user nova-compute[75176]: DEBUG nova.compute.manager [req-da3d80b1-166a-4c4f-9ec8-cd78aa4c4994 req-202a8b19-2c66-4b3b-a83d-d9426c3dce0a service nova] [instance: 10159a3d-8e58-4e42-87e1-9b8bf6638078] Received event network-vif-plugged-81ca8941-ecf0-432d-a9f0-7a92e37e13f8 {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 16:11:54 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-da3d80b1-166a-4c4f-9ec8-cd78aa4c4994 req-202a8b19-2c66-4b3b-a83d-d9426c3dce0a service nova] Acquiring lock "10159a3d-8e58-4e42-87e1-9b8bf6638078-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:11:54 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-da3d80b1-166a-4c4f-9ec8-cd78aa4c4994 req-202a8b19-2c66-4b3b-a83d-d9426c3dce0a service nova] Lock "10159a3d-8e58-4e42-87e1-9b8bf6638078-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:11:54 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-da3d80b1-166a-4c4f-9ec8-cd78aa4c4994 req-202a8b19-2c66-4b3b-a83d-d9426c3dce0a service nova] Lock "10159a3d-8e58-4e42-87e1-9b8bf6638078-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:11:54 user nova-compute[75176]: DEBUG nova.compute.manager [req-da3d80b1-166a-4c4f-9ec8-cd78aa4c4994 req-202a8b19-2c66-4b3b-a83d-d9426c3dce0a service nova] [instance: 10159a3d-8e58-4e42-87e1-9b8bf6638078] No waiting events found dispatching network-vif-plugged-81ca8941-ecf0-432d-a9f0-7a92e37e13f8 {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 16:11:54 user nova-compute[75176]: WARNING nova.compute.manager [req-da3d80b1-166a-4c4f-9ec8-cd78aa4c4994 req-202a8b19-2c66-4b3b-a83d-d9426c3dce0a service nova] [instance: 10159a3d-8e58-4e42-87e1-9b8bf6638078] Received unexpected event network-vif-plugged-81ca8941-ecf0-432d-a9f0-7a92e37e13f8 for instance with vm_state deleted and task_state None.
Nov 28 16:11:55 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:11:57 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:12:00 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:12:02 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:12:07 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 16:12:07 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:12:07 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75176) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 16:12:07 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75176) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 16:12:07 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75176) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 16:12:07 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:12:10 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:12:12 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:12:12 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 16:12:13 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:12:15 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:12:15 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75176) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 16:12:17 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:12:17 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Starting heal instance info cache {{(pid=75176) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 16:12:17 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Rebuilding the list of instances to heal {{(pid=75176) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 16:12:17 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquiring lock "refresh_cache-7af26650-2a61-4557-8c3d-0688ddbc6343" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 16:12:17 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquired lock "refresh_cache-7af26650-2a61-4557-8c3d-0688ddbc6343" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 16:12:17 user nova-compute[75176]: DEBUG nova.network.neutron [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] [instance: 7af26650-2a61-4557-8c3d-0688ddbc6343] Forcefully refreshing network info cache for instance {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 16:12:17 user nova-compute[75176]: DEBUG nova.objects.instance [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lazy-loading 'info_cache' on Instance uuid 7af26650-2a61-4557-8c3d-0688ddbc6343 {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 16:12:17 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 16:12:17 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:12:17 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75176) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 16:12:17 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75176) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 16:12:17 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75176) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 16:12:17 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:12:18 user nova-compute[75176]: DEBUG nova.network.neutron [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] [instance: 7af26650-2a61-4557-8c3d-0688ddbc6343] Updating instance_info_cache with network_info: [{"id": "ed4b6bff-3d17-4593-aabb-38a65b35aaea", "address": "fa:16:3e:81:6d:41", "network": {"id": "9faaeac5-1688-436d-90fb-38bb1c4d3da4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1225296735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6aab7b19b9414b5da476b87e144cc40b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped4b6bff-3d", "ovs_interfaceid": "ed4b6bff-3d17-4593-aabb-38a65b35aaea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 16:12:18 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Releasing lock "refresh_cache-7af26650-2a61-4557-8c3d-0688ddbc6343" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 16:12:18 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] [instance: 7af26650-2a61-4557-8c3d-0688ddbc6343] Updated the network info_cache for instance {{(pid=75176) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 16:12:18 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:12:19 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:12:21 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:12:22 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:12:26 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:12:26 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:12:26 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:12:26 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:12:26 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Auditing locally available compute resources for user (node: user) {{(pid=75176) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 16:12:26 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7af26650-2a61-4557-8c3d-0688ddbc6343/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:12:26 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7af26650-2a61-4557-8c3d-0688ddbc6343/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:12:26 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7af26650-2a61-4557-8c3d-0688ddbc6343/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:12:27 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7af26650-2a61-4557-8c3d-0688ddbc6343/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:12:27 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 16:12:27 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 16:12:27 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Hypervisor/Node resource view: name=user free_ram=8956MB free_disk=25.068649291992188GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75176) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 16:12:27 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:12:27 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:12:27 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance 7af26650-2a61-4557-8c3d-0688ddbc6343 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 16:12:27 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75176) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 16:12:27 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75176) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 16:12:27 user nova-compute[75176]: DEBUG nova.compute.provider_tree [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Inventory has not changed in ProviderTree for provider: b37848d8-f401-4155-a029-b0ffa09ff85b {{(pid=75176) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 16:12:27 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Inventory has not changed for provider b37848d8-f401-4155-a029-b0ffa09ff85b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75176) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 16:12:27 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Compute_service record updated for user:user {{(pid=75176) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 16:12:27 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.201s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:12:27 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 16:12:32 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 16:12:32 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:12:32 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75176) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 16:12:32 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75176) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 16:12:32 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75176) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 16:12:32 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:12:37 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 16:12:42 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:12:47 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:12:52 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:12:57 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 16:13:02 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:13:07 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 16:13:07 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:13:07 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75176) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 16:13:07 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75176) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 16:13:07 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75176) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 16:13:07 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:13:11 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:13:12 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:13:12 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:13:14 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:13:15 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:13:16 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:13:16 user nova-compute[75176]: DEBUG nova.compute.manager [req-856a0302-bc94-4f81-8a51-21e9fb4d1ea6 req-a16c5214-f5ab-428d-8f29-3c01c2ab5507 service nova] [instance: 7af26650-2a61-4557-8c3d-0688ddbc6343] Received event network-changed-ed4b6bff-3d17-4593-aabb-38a65b35aaea {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 16:13:16 user nova-compute[75176]: DEBUG nova.compute.manager [req-856a0302-bc94-4f81-8a51-21e9fb4d1ea6 req-a16c5214-f5ab-428d-8f29-3c01c2ab5507 service nova] [instance: 7af26650-2a61-4557-8c3d-0688ddbc6343] Refreshing instance network info cache due to event network-changed-ed4b6bff-3d17-4593-aabb-38a65b35aaea. {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 16:13:16 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-856a0302-bc94-4f81-8a51-21e9fb4d1ea6 req-a16c5214-f5ab-428d-8f29-3c01c2ab5507 service nova] Acquiring lock "refresh_cache-7af26650-2a61-4557-8c3d-0688ddbc6343" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 16:13:16 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-856a0302-bc94-4f81-8a51-21e9fb4d1ea6 req-a16c5214-f5ab-428d-8f29-3c01c2ab5507 service nova] Acquired lock "refresh_cache-7af26650-2a61-4557-8c3d-0688ddbc6343" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 16:13:16 user nova-compute[75176]: DEBUG nova.network.neutron [req-856a0302-bc94-4f81-8a51-21e9fb4d1ea6 req-a16c5214-f5ab-428d-8f29-3c01c2ab5507 service nova] [instance: 7af26650-2a61-4557-8c3d-0688ddbc6343] Refreshing network info cache for port ed4b6bff-3d17-4593-aabb-38a65b35aaea {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 16:13:16 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:13:16 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75176) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 16:13:17 user nova-compute[75176]: DEBUG nova.network.neutron [req-856a0302-bc94-4f81-8a51-21e9fb4d1ea6 req-a16c5214-f5ab-428d-8f29-3c01c2ab5507 service nova] [instance: 7af26650-2a61-4557-8c3d-0688ddbc6343] Updated VIF entry in instance network info cache for port ed4b6bff-3d17-4593-aabb-38a65b35aaea. {{(pid=75176) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 16:13:17 user nova-compute[75176]: DEBUG nova.network.neutron [req-856a0302-bc94-4f81-8a51-21e9fb4d1ea6 req-a16c5214-f5ab-428d-8f29-3c01c2ab5507 service nova] [instance: 7af26650-2a61-4557-8c3d-0688ddbc6343] Updating instance_info_cache with network_info: [{"id": "ed4b6bff-3d17-4593-aabb-38a65b35aaea", "address": "fa:16:3e:81:6d:41", "network": {"id": "9faaeac5-1688-436d-90fb-38bb1c4d3da4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1225296735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6aab7b19b9414b5da476b87e144cc40b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped4b6bff-3d", "ovs_interfaceid": "ed4b6bff-3d17-4593-aabb-38a65b35aaea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 16:13:17 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-856a0302-bc94-4f81-8a51-21e9fb4d1ea6 req-a16c5214-f5ab-428d-8f29-3c01c2ab5507 service nova] Releasing lock "refresh_cache-7af26650-2a61-4557-8c3d-0688ddbc6343" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 16:13:17 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:13:18 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:13:18 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Starting heal instance info cache {{(pid=75176) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 16:13:18 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Rebuilding the list of instances to heal {{(pid=75176) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 16:13:18 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquiring lock "refresh_cache-7af26650-2a61-4557-8c3d-0688ddbc6343" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 16:13:18 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquired lock "refresh_cache-7af26650-2a61-4557-8c3d-0688ddbc6343" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 16:13:18 user nova-compute[75176]: DEBUG nova.network.neutron [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] [instance: 7af26650-2a61-4557-8c3d-0688ddbc6343] Forcefully refreshing network info cache for instance {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 16:13:18 user nova-compute[75176]: DEBUG nova.objects.instance [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lazy-loading 'info_cache' on Instance uuid 7af26650-2a61-4557-8c3d-0688ddbc6343 {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 16:13:19 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-37e9e778-7360-4828-b967-946814aba26f tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Acquiring lock "7af26650-2a61-4557-8c3d-0688ddbc6343" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:13:19 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-37e9e778-7360-4828-b967-946814aba26f tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Lock "7af26650-2a61-4557-8c3d-0688ddbc6343" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:13:19 user nova-compute[75176]: DEBUG nova.objects.instance [None req-37e9e778-7360-4828-b967-946814aba26f tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Lazy-loading 'flavor' on Instance uuid 7af26650-2a61-4557-8c3d-0688ddbc6343 {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 16:13:19 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-37e9e778-7360-4828-b967-946814aba26f tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Lock "7af26650-2a61-4557-8c3d-0688ddbc6343" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.067s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:13:19 user nova-compute[75176]: DEBUG nova.network.neutron [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] [instance: 7af26650-2a61-4557-8c3d-0688ddbc6343] Updating instance_info_cache with network_info: [{"id": "ed4b6bff-3d17-4593-aabb-38a65b35aaea", "address": "fa:16:3e:81:6d:41", "network": {"id": "9faaeac5-1688-436d-90fb-38bb1c4d3da4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1225296735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6aab7b19b9414b5da476b87e144cc40b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped4b6bff-3d", "ovs_interfaceid": "ed4b6bff-3d17-4593-aabb-38a65b35aaea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 16:13:19 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Releasing lock "refresh_cache-7af26650-2a61-4557-8c3d-0688ddbc6343" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 16:13:19 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] [instance: 7af26650-2a61-4557-8c3d-0688ddbc6343] Updated the network info_cache for instance {{(pid=75176) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 16:13:19 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-37e9e778-7360-4828-b967-946814aba26f tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Acquiring lock "7af26650-2a61-4557-8c3d-0688ddbc6343" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:13:19 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-37e9e778-7360-4828-b967-946814aba26f tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Lock "7af26650-2a61-4557-8c3d-0688ddbc6343" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:13:19 user nova-compute[75176]: INFO nova.compute.manager [None req-37e9e778-7360-4828-b967-946814aba26f tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] [instance: 7af26650-2a61-4557-8c3d-0688ddbc6343] Attaching volume 5b1dd73f-4c14-4416-9911-24ba37590848 to /dev/vdb
Nov 28 16:13:19 user nova-compute[75176]: DEBUG os_brick.utils [None req-37e9e778-7360-4828-b967-946814aba26f tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 16:13:19 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:13:19 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:13:19 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[bff5c380-a5cd-474c-82ed-5e9767b064ae]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:edc924a949b2\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:13:19 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:13:19 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:13:19 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[83b070df-ea3b-44ce-9c81-10c1b6dc943b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:13:19 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:13:19 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:13:19 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[741c0a86-25fd-4541-9d3f-2bc2479358b2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:13:19 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ca67bab-ad2c-4a94-8126-fa8b934f8136]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:13:19 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-37e9e778-7360-4828-b967-946814aba26f tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Running cmd (subprocess): nvme version {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:13:19 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-37e9e778-7360-4828-b967-946814aba26f tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] 'nvme version' failed. Not Retrying. {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 16:13:19 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.nvmeof [None req-37e9e778-7360-4828-b967-946814aba26f tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] nvme not present on system {{(pid=75176) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 16:13:19 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:13:19 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 16:13:19 user nova-compute[75176]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 16:13:19 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[4957cff9-3bc5-43eb-a031-cc18d41e1e2a]: (4, '') {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:13:19 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.lightos [None req-37e9e778-7360-4828-b967-946814aba26f tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75176) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 16:13:19 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.lightos [None req-37e9e778-7360-4828-b967-946814aba26f tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75176) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 16:13:19 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.lightos [None req-37e9e778-7360-4828-b967-946814aba26f tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] LIGHTOS: no hostnqn found. {{(pid=75176) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 16:13:19 user nova-compute[75176]: DEBUG os_brick.utils [None req-37e9e778-7360-4828-b967-946814aba26f tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:edc924a949b2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 16:13:19 user nova-compute[75176]: DEBUG nova.virt.block_device [None req-37e9e778-7360-4828-b967-946814aba26f tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] [instance: 7af26650-2a61-4557-8c3d-0688ddbc6343] Updating existing volume attachment record: 38880e9b-cf5f-4d53-9b20-b3504f7125b0 {{(pid=75176) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 16:13:19 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:13:20 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:13:20 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:13:22 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:13:23 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:13:25 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:13:26 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-37e9e778-7360-4828-b967-946814aba26f tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] [instance: 7af26650-2a61-4557-8c3d-0688ddbc6343] Calling os-brick to attach iSCSI Volume {{(pid=75176) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 16:13:26 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-37e9e778-7360-4828-b967-946814aba26f tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c1b8a00>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5b1dd73f-4c14-4416-9911-24ba37590848', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YuOdepSJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 16:13:26 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-37e9e778-7360-4828-b967-946814aba26f tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 16:13:26 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-37e9e778-7360-4828-b967-946814aba26f tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 16:13:26 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-37e9e778-7360-4828-b967-946814aba26f tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 16:13:26 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-37e9e778-7360-4828-b967-946814aba26f tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 16:13:26 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-37e9e778-7360-4828-b967-946814aba26f tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5b1dd73f-4c14-4416-9911-24ba37590848" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 16:13:26 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-37e9e778-7360-4828-b967-946814aba26f tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5b1dd73f-4c14-4416-9911-24ba37590848" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 16:13:26 user nova-compute[75176]: INFO os_brick.initiator.connectors.iscsi [None req-37e9e778-7360-4828-b967-946814aba26f tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 16:13:26 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b1dd73f-4c14-4416-9911-24ba37590848 -p 172.16.0.220:3260 {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:13:26 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b1dd73f-4c14-4416-9911-24ba37590848 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:13:26 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[04d9e775-bf32-414c-a020-f2d61f6598fa]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:13:26 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-37e9e778-7360-4828-b967-946814aba26f tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 16:13:26 user nova-compute[75176]:  {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 16:13:26 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b1dd73f-4c14-4416-9911-24ba37590848 -p 172.16.0.220:3260 --interface default --op new {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:13:26 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b1dd73f-4c14-4416-9911-24ba37590848 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:13:26 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[7987fc98-eb0a-40f5-8b6c-599c7f074fc7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5b1dd73f-4c14-4416-9911-24ba37590848] added\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:13:26 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-37e9e778-7360-4828-b967-946814aba26f tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5b1dd73f-4c14-4416-9911-24ba37590848] added
Nov 28 16:13:26 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 16:13:26 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b1dd73f-4c14-4416-9911-24ba37590848 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:13:26 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b1dd73f-4c14-4416-9911-24ba37590848 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:13:26 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d29962a-bfd6-4201-b02d-6f23e11fe43a]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:13:26 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-37e9e778-7360-4828-b967-946814aba26f tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 16:13:26 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b1dd73f-4c14-4416-9911-24ba37590848 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:13:26 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b1dd73f-4c14-4416-9911-24ba37590848 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:13:26 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f550943-e4f6-46f5-b5ba-9063a4e08077]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:13:26 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-37e9e778-7360-4828-b967-946814aba26f tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 16:13:26 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b1dd73f-4c14-4416-9911-24ba37590848 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YuOdepSJ {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:13:26 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b1dd73f-4c14-4416-9911-24ba37590848 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YuOdepSJ" returned: 0 in 0.024s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:13:26 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[832187f1-0709-4520-9af0-105107c16807]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:13:26 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-37e9e778-7360-4828-b967-946814aba26f tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YuOdepSJ'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 16:13:26 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b1dd73f-4c14-4416-9911-24ba37590848 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:13:26 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b1dd73f-4c14-4416-9911-24ba37590848 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:13:26 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[a331a34e-06a2-45b0-be33-c601744639b9]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:13:26 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-37e9e778-7360-4828-b967-946814aba26f tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 16:13:26 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:13:26 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:13:26 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[daa58e01-3930-4e18-8f8a-540ea33401a8]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:13:26 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-37e9e778-7360-4828-b967-946814aba26f tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 28 16:13:26 user nova-compute[75176]:  {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 16:13:26 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-37e9e778-7360-4828-b967-946814aba26f tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 28 16:13:26 user nova-compute[75176]:  {{(pid=75176) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 16:13:26 user nova-compute[75176]: WARNING os_brick.initiator.connectors.iscsi [None req-37e9e778-7360-4828-b967-946814aba26f tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 28 16:13:26 user nova-compute[75176]: 
Nov 28 16:13:26 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b1dd73f-4c14-4416-9911-24ba37590848 -p 172.16.0.220:3260 --login {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:13:26 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b1dd73f-4c14-4416-9911-24ba37590848 -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:13:26 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[b165f095-de98-4266-8ccd-b9023493b19b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5b1dd73f-4c14-4416-9911-24ba37590848, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5b1dd73f-4c14-4416-9911-24ba37590848, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:13:26 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-37e9e778-7360-4828-b967-946814aba26f tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5b1dd73f-4c14-4416-9911-24ba37590848, portal: 172.16.0.220,3260]
Nov 28 16:13:26 user nova-compute[75176]: Login to [iface: default, target: iqn.2010-10.org.openstack:5b1dd73f-4c14-4416-9911-24ba37590848, portal: 172.16.0.220,3260] successful.
Nov 28 16:13:26 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 16:13:26 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b1dd73f-4c14-4416-9911-24ba37590848 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:13:26 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b1dd73f-4c14-4416-9911-24ba37590848 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:13:26 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1ec110b-9c66-4600-b954-fe74c2ba2371]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:13:26 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-37e9e778-7360-4828-b967-946814aba26f tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 16:13:26 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:13:26 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:13:26 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a2ce675-5fd6-4876-81ee-f65dbeccd139]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b1dd73f-4c14-4416-9911-24ba37590848 (non-flash)\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:13:26 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-37e9e778-7360-4828-b967-946814aba26f tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b1dd73f-4c14-4416-9911-24ba37590848 (non-flash)
Nov 28 16:13:26 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 16:13:26 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-37e9e778-7360-4828-b967-946814aba26f tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b1dd73f-4c14-4416-9911-24ba37590848 (non-flash)
Nov 28 16:13:26 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 16:13:26 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-37e9e778-7360-4828-b967-946814aba26f tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5b1dd73f-4c14-4416-9911-24ba37590848" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.267s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 16:13:26 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-37e9e778-7360-4828-b967-946814aba26f tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Connected to 172.16.0.220:3260 {{(pid=75176) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 16:13:26 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-37e9e778-7360-4828-b967-946814aba26f tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] HCTL ('33', '-', '-', 0) found on session 62 with lun 0 {{(pid=75176) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 16:13:26 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-37e9e778-7360-4828-b967-946814aba26f tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75176) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 16:13:26 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:13:26 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:13:26 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[8df9ffb9-34ee-47ce-86a6-3e4f8511fb30]: (4, ('- - 0', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:13:26 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-37e9e778-7360-4828-b967-946814aba26f tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Searching for a device in session 62 and hctl ['33', '*', '*', 0] yield: None {{(pid=75176) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 16:13:27 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:13:27 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:13:27 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:13:27 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:13:27 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Auditing locally available compute resources for user (node: user) {{(pid=75176) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 16:13:27 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-37e9e778-7360-4828-b967-946814aba26f tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Searching for a device in session 62 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75176) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 16:13:27 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-37e9e778-7360-4828-b967-946814aba26f tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:5b1dd73f-4c14-4416-9911-24ba37590848', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YuOdepSJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75176) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 16:13:27 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-37e9e778-7360-4828-b967-946814aba26f tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.296s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 16:13:27 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-37e9e778-7360-4828-b967-946814aba26f tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] <== connect_volume: return (1298ms) {'type': 'block', 'scsi_wwn': '23333376336306630', 'path': '/dev/sdb'} {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 16:13:27 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-37e9e778-7360-4828-b967-946814aba26f tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] [instance: 7af26650-2a61-4557-8c3d-0688ddbc6343] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23333376336306630', 'path': '/dev/sdb'} {{(pid=75176) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 16:13:27 user nova-compute[75176]: DEBUG nova.objects.instance [None req-37e9e778-7360-4828-b967-946814aba26f tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Lazy-loading 'flavor' on Instance uuid 7af26650-2a61-4557-8c3d-0688ddbc6343 {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 16:13:27 user nova-compute[75176]: DEBUG nova.virt.libvirt.guest [None req-37e9e778-7360-4828-b967-946814aba26f tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 16:13:27 user nova-compute[75176]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 16:13:27 user nova-compute[75176]:   <source dev="/dev/sdb"/>
Nov 28 16:13:27 user nova-compute[75176]:   <target dev="vdb" bus="virtio"/>
Nov 28 16:13:27 user nova-compute[75176]:   <serial>5b1dd73f-4c14-4416-9911-24ba37590848</serial>
Nov 28 16:13:27 user nova-compute[75176]: </disk>
Nov 28 16:13:27 user nova-compute[75176]:  {{(pid=75176) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 16:13:27 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7af26650-2a61-4557-8c3d-0688ddbc6343/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:13:27 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:13:27 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7af26650-2a61-4557-8c3d-0688ddbc6343/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:13:27 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7af26650-2a61-4557-8c3d-0688ddbc6343/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:13:28 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7af26650-2a61-4557-8c3d-0688ddbc6343/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:13:28 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-37e9e778-7360-4828-b967-946814aba26f tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] No BDM found with device name vda, not building metadata. {{(pid=75176) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 16:13:28 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-37e9e778-7360-4828-b967-946814aba26f tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75176) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 16:13:28 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-37e9e778-7360-4828-b967-946814aba26f tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] No VIF found with MAC fa:16:3e:81:6d:41, not building metadata {{(pid=75176) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 16:13:28 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 16:13:28 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 16:13:28 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Hypervisor/Node resource view: name=user free_ram=8961MB free_disk=25.058818817138672GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75176) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 16:13:28 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:13:28 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:13:28 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance 7af26650-2a61-4557-8c3d-0688ddbc6343 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 16:13:28 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75176) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 16:13:28 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75176) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 16:13:28 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-37e9e778-7360-4828-b967-946814aba26f tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Lock "7af26650-2a61-4557-8c3d-0688ddbc6343" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.276s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:13:28 user nova-compute[75176]: DEBUG nova.compute.provider_tree [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Inventory has not changed in ProviderTree for provider: b37848d8-f401-4155-a029-b0ffa09ff85b {{(pid=75176) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 16:13:28 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Inventory has not changed for provider b37848d8-f401-4155-a029-b0ffa09ff85b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75176) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 16:13:28 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Compute_service record updated for user:user {{(pid=75176) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 16:13:28 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.153s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:13:31 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-8d20d9f5-70f6-4f41-abd6-68e6d45acbaa tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Acquiring lock "7af26650-2a61-4557-8c3d-0688ddbc6343" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:13:31 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-8d20d9f5-70f6-4f41-abd6-68e6d45acbaa tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Lock "7af26650-2a61-4557-8c3d-0688ddbc6343" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:13:31 user nova-compute[75176]: DEBUG nova.objects.instance [None req-8d20d9f5-70f6-4f41-abd6-68e6d45acbaa tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Lazy-loading 'flavor' on Instance uuid 7af26650-2a61-4557-8c3d-0688ddbc6343 {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 16:13:31 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-8d20d9f5-70f6-4f41-abd6-68e6d45acbaa tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Lock "7af26650-2a61-4557-8c3d-0688ddbc6343" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:13:32 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-8d20d9f5-70f6-4f41-abd6-68e6d45acbaa tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Acquiring lock "7af26650-2a61-4557-8c3d-0688ddbc6343" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:13:32 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-8d20d9f5-70f6-4f41-abd6-68e6d45acbaa tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Lock "7af26650-2a61-4557-8c3d-0688ddbc6343" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:13:32 user nova-compute[75176]: INFO nova.compute.manager [None req-8d20d9f5-70f6-4f41-abd6-68e6d45acbaa tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] [instance: 7af26650-2a61-4557-8c3d-0688ddbc6343] Attaching volume 16529d22-907c-4b24-91d1-d38911118dda to /dev/vdc
Nov 28 16:13:32 user nova-compute[75176]: DEBUG os_brick.utils [None req-8d20d9f5-70f6-4f41-abd6-68e6d45acbaa tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 16:13:32 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:13:32 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:13:32 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d1a2bff-b1fe-4c95-909e-4bf2c313a236]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:edc924a949b2\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:13:32 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:13:32 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:13:32 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[213e6f46-9a09-444a-98c5-7f15d0a378e0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:13:32 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:13:32 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:13:32 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cbfd7c3-7dcf-4204-8589-a46e41ddba6a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:13:32 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[196736d1-3176-4d29-8ddd-36d33e8c45b6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:13:32 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-8d20d9f5-70f6-4f41-abd6-68e6d45acbaa tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Running cmd (subprocess): nvme version {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:13:32 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-8d20d9f5-70f6-4f41-abd6-68e6d45acbaa tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] 'nvme version' failed. Not Retrying. {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 16:13:32 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8d20d9f5-70f6-4f41-abd6-68e6d45acbaa tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] nvme not present on system {{(pid=75176) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 16:13:32 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:13:32 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 16:13:32 user nova-compute[75176]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 16:13:32 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[82418a12-81e2-4dda-9bae-c22c4c77dbe6]: (4, '') {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:13:32 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.lightos [None req-8d20d9f5-70f6-4f41-abd6-68e6d45acbaa tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75176) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 16:13:32 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.lightos [None req-8d20d9f5-70f6-4f41-abd6-68e6d45acbaa tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75176) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 16:13:32 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.lightos [None req-8d20d9f5-70f6-4f41-abd6-68e6d45acbaa tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] LIGHTOS: no hostnqn found. {{(pid=75176) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 16:13:32 user nova-compute[75176]: DEBUG os_brick.utils [None req-8d20d9f5-70f6-4f41-abd6-68e6d45acbaa tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:edc924a949b2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 16:13:32 user nova-compute[75176]: DEBUG nova.virt.block_device [None req-8d20d9f5-70f6-4f41-abd6-68e6d45acbaa tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] [instance: 7af26650-2a61-4557-8c3d-0688ddbc6343] Updating existing volume attachment record: e40f9374-cb0e-4823-83a1-91f2c87fe300 {{(pid=75176) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 16:13:32 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 16:13:35 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:13:35 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:13:37 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:13:39 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8d20d9f5-70f6-4f41-abd6-68e6d45acbaa tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] [instance: 7af26650-2a61-4557-8c3d-0688ddbc6343] Calling os-brick to attach iSCSI Volume {{(pid=75176) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 16:13:39 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d20d9f5-70f6-4f41-abd6-68e6d45acbaa tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c1b8a00>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:16529d22-907c-4b24-91d1-d38911118dda', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ICgDcPwK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 16:13:39 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-8d20d9f5-70f6-4f41-abd6-68e6d45acbaa tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 16:13:39 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-8d20d9f5-70f6-4f41-abd6-68e6d45acbaa tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 16:13:39 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-8d20d9f5-70f6-4f41-abd6-68e6d45acbaa tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 16:13:39 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-8d20d9f5-70f6-4f41-abd6-68e6d45acbaa tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 16:13:39 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-8d20d9f5-70f6-4f41-abd6-68e6d45acbaa tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:16529d22-907c-4b24-91d1-d38911118dda" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 16:13:39 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-8d20d9f5-70f6-4f41-abd6-68e6d45acbaa tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:16529d22-907c-4b24-91d1-d38911118dda" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 16:13:39 user nova-compute[75176]: INFO os_brick.initiator.connectors.iscsi [None req-8d20d9f5-70f6-4f41-abd6-68e6d45acbaa tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 16:13:39 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16529d22-907c-4b24-91d1-d38911118dda -p 172.16.0.220:3260 {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:13:39 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16529d22-907c-4b24-91d1-d38911118dda -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:13:39 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[681315e5-b5cb-4cd3-b348-3587445159c7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:13:39 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d20d9f5-70f6-4f41-abd6-68e6d45acbaa tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 16:13:39 user nova-compute[75176]:  {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 16:13:39 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16529d22-907c-4b24-91d1-d38911118dda -p 172.16.0.220:3260 --interface default --op new {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:13:39 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16529d22-907c-4b24-91d1-d38911118dda -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:13:39 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[269badae-720c-4f27-b179-4cfdc2541317]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:16529d22-907c-4b24-91d1-d38911118dda] added\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:13:39 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d20d9f5-70f6-4f41-abd6-68e6d45acbaa tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:16529d22-907c-4b24-91d1-d38911118dda] added
Nov 28 16:13:39 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 16:13:39 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16529d22-907c-4b24-91d1-d38911118dda -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:13:39 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16529d22-907c-4b24-91d1-d38911118dda -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:13:39 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[de40604e-4533-47f8-894f-5a76ab74c818]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:13:39 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d20d9f5-70f6-4f41-abd6-68e6d45acbaa tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 16:13:39 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16529d22-907c-4b24-91d1-d38911118dda -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:13:39 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16529d22-907c-4b24-91d1-d38911118dda -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:13:39 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[431ebfee-9591-4fe5-af31-912b112cd705]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:13:39 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d20d9f5-70f6-4f41-abd6-68e6d45acbaa tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 16:13:39 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16529d22-907c-4b24-91d1-d38911118dda -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ICgDcPwK {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:13:39 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16529d22-907c-4b24-91d1-d38911118dda -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ICgDcPwK" returned: 0 in 0.018s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:13:39 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aaf87df-28ae-4f42-8331-705180fd6fa0]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:13:39 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d20d9f5-70f6-4f41-abd6-68e6d45acbaa tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ICgDcPwK'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 16:13:39 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16529d22-907c-4b24-91d1-d38911118dda -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:13:39 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16529d22-907c-4b24-91d1-d38911118dda -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:13:39 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[70efab83-0249-4572-bb71-03fcb6c40929]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:13:39 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d20d9f5-70f6-4f41-abd6-68e6d45acbaa tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 16:13:39 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:13:39 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:13:39 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[27a46400-3108-4711-b07b-e1f8d680c880]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b1dd73f-4c14-4416-9911-24ba37590848 (non-flash)\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:13:39 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d20d9f5-70f6-4f41-abd6-68e6d45acbaa tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b1dd73f-4c14-4416-9911-24ba37590848 (non-flash)
Nov 28 16:13:39 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 16:13:39 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d20d9f5-70f6-4f41-abd6-68e6d45acbaa tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b1dd73f-4c14-4416-9911-24ba37590848 (non-flash)
Nov 28 16:13:39 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 16:13:39 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16529d22-907c-4b24-91d1-d38911118dda -p 172.16.0.220:3260 --login {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:13:39 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16529d22-907c-4b24-91d1-d38911118dda -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:13:39 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7d74125-867e-4851-aa1d-54f79ab924b2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:16529d22-907c-4b24-91d1-d38911118dda, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:16529d22-907c-4b24-91d1-d38911118dda, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:13:39 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d20d9f5-70f6-4f41-abd6-68e6d45acbaa tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:16529d22-907c-4b24-91d1-d38911118dda, portal: 172.16.0.220,3260]
Nov 28 16:13:39 user nova-compute[75176]: Login to [iface: default, target: iqn.2010-10.org.openstack:16529d22-907c-4b24-91d1-d38911118dda, portal: 172.16.0.220,3260] successful.
Nov 28 16:13:39 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 16:13:39 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16529d22-907c-4b24-91d1-d38911118dda -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:13:39 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16529d22-907c-4b24-91d1-d38911118dda -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.052s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:13:39 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f4ff8e2-edfc-4d71-b9d7-97fba8f56d52]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:13:39 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d20d9f5-70f6-4f41-abd6-68e6d45acbaa tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 16:13:39 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:13:39 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:13:39 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c2112a6-f7b6-45e6-9eb5-16c31ac23590]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b1dd73f-4c14-4416-9911-24ba37590848 (non-flash)\ntcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16529d22-907c-4b24-91d1-d38911118dda (non-flash)\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:13:39 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d20d9f5-70f6-4f41-abd6-68e6d45acbaa tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b1dd73f-4c14-4416-9911-24ba37590848 (non-flash)
Nov 28 16:13:39 user nova-compute[75176]: tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16529d22-907c-4b24-91d1-d38911118dda (non-flash)
Nov 28 16:13:39 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 16:13:39 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d20d9f5-70f6-4f41-abd6-68e6d45acbaa tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b1dd73f-4c14-4416-9911-24ba37590848 (non-flash)
Nov 28 16:13:39 user nova-compute[75176]: tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16529d22-907c-4b24-91d1-d38911118dda (non-flash)
Nov 28 16:13:39 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 16:13:39 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-8d20d9f5-70f6-4f41-abd6-68e6d45acbaa tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:16529d22-907c-4b24-91d1-d38911118dda" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.308s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 16:13:39 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d20d9f5-70f6-4f41-abd6-68e6d45acbaa tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Connected to 172.16.0.220:3260 {{(pid=75176) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 16:13:39 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-8d20d9f5-70f6-4f41-abd6-68e6d45acbaa tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] HCTL ('34', '-', '-', 0) found on session 63 with lun 0 {{(pid=75176) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 16:13:39 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-8d20d9f5-70f6-4f41-abd6-68e6d45acbaa tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75176) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 16:13:39 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:13:39 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:13:39 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[89968e8e-8b5b-4f01-9ff9-34f4460a2910]: (4, ('- - 0', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:13:39 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-8d20d9f5-70f6-4f41-abd6-68e6d45acbaa tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Searching for a device in session 63 and hctl ['34', '*', '*', 0] yield: None {{(pid=75176) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 16:13:40 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-8d20d9f5-70f6-4f41-abd6-68e6d45acbaa tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Searching for a device in session 63 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75176) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 16:13:40 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d20d9f5-70f6-4f41-abd6-68e6d45acbaa tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:16529d22-907c-4b24-91d1-d38911118dda', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ICgDcPwK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75176) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 16:13:40 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-8d20d9f5-70f6-4f41-abd6-68e6d45acbaa tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.339s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 16:13:40 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d20d9f5-70f6-4f41-abd6-68e6d45acbaa tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] <== connect_volume: return (1340ms) {'type': 'block', 'scsi_wwn': '26237626139636638', 'path': '/dev/sdc'} {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 16:13:40 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8d20d9f5-70f6-4f41-abd6-68e6d45acbaa tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] [instance: 7af26650-2a61-4557-8c3d-0688ddbc6343] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26237626139636638', 'path': '/dev/sdc'} {{(pid=75176) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 16:13:40 user nova-compute[75176]: DEBUG nova.objects.instance [None req-8d20d9f5-70f6-4f41-abd6-68e6d45acbaa tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Lazy-loading 'flavor' on Instance uuid 7af26650-2a61-4557-8c3d-0688ddbc6343 {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 16:13:40 user nova-compute[75176]: DEBUG nova.virt.libvirt.guest [None req-8d20d9f5-70f6-4f41-abd6-68e6d45acbaa tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 16:13:40 user nova-compute[75176]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 16:13:40 user nova-compute[75176]:   <source dev="/dev/sdc"/>
Nov 28 16:13:40 user nova-compute[75176]:   <target dev="vdc" bus="virtio"/>
Nov 28 16:13:40 user nova-compute[75176]:   <serial>16529d22-907c-4b24-91d1-d38911118dda</serial>
Nov 28 16:13:40 user nova-compute[75176]: </disk>
Nov 28 16:13:40 user nova-compute[75176]:  {{(pid=75176) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 16:13:40 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-8d20d9f5-70f6-4f41-abd6-68e6d45acbaa tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] No BDM found with device name vda, not building metadata. {{(pid=75176) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 16:13:40 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-8d20d9f5-70f6-4f41-abd6-68e6d45acbaa tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75176) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 16:13:40 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-8d20d9f5-70f6-4f41-abd6-68e6d45acbaa tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75176) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 16:13:40 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-8d20d9f5-70f6-4f41-abd6-68e6d45acbaa tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] No VIF found with MAC fa:16:3e:81:6d:41, not building metadata {{(pid=75176) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 16:13:41 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-8d20d9f5-70f6-4f41-abd6-68e6d45acbaa tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Lock "7af26650-2a61-4557-8c3d-0688ddbc6343" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.916s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:13:42 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-8808b952-5af9-4516-9689-f9b18efd009e tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Acquiring lock "7af26650-2a61-4557-8c3d-0688ddbc6343" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:13:42 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-8808b952-5af9-4516-9689-f9b18efd009e tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Lock "7af26650-2a61-4557-8c3d-0688ddbc6343" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:13:42 user nova-compute[75176]: INFO nova.compute.manager [None req-8808b952-5af9-4516-9689-f9b18efd009e tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] [instance: 7af26650-2a61-4557-8c3d-0688ddbc6343] Detaching volume 5b1dd73f-4c14-4416-9911-24ba37590848
Nov 28 16:13:42 user nova-compute[75176]: INFO nova.virt.block_device [None req-8808b952-5af9-4516-9689-f9b18efd009e tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] [instance: 7af26650-2a61-4557-8c3d-0688ddbc6343] Attempting to driver detach volume 5b1dd73f-4c14-4416-9911-24ba37590848 from mountpoint /dev/vdb
Nov 28 16:13:42 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-8808b952-5af9-4516-9689-f9b18efd009e tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Attempting to detach device vdb from instance 7af26650-2a61-4557-8c3d-0688ddbc6343 from the persistent domain config. {{(pid=75176) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 16:13:42 user nova-compute[75176]: DEBUG nova.virt.libvirt.guest [None req-8808b952-5af9-4516-9689-f9b18efd009e tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 16:13:42 user nova-compute[75176]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 16:13:42 user nova-compute[75176]:   <source dev="/dev/sdb"/>
Nov 28 16:13:42 user nova-compute[75176]:   <target dev="vdb" bus="virtio"/>
Nov 28 16:13:42 user nova-compute[75176]:   <serial>5b1dd73f-4c14-4416-9911-24ba37590848</serial>
Nov 28 16:13:42 user nova-compute[75176]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 16:13:42 user nova-compute[75176]: </disk>
Nov 28 16:13:42 user nova-compute[75176]:  {{(pid=75176) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 16:13:42 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-8808b952-5af9-4516-9689-f9b18efd009e tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Successfully detached device vdb from instance 7af26650-2a61-4557-8c3d-0688ddbc6343 from the persistent domain config.
Nov 28 16:13:42 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-8808b952-5af9-4516-9689-f9b18efd009e tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7af26650-2a61-4557-8c3d-0688ddbc6343 from the live domain config. {{(pid=75176) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 16:13:42 user nova-compute[75176]: DEBUG nova.virt.libvirt.guest [None req-8808b952-5af9-4516-9689-f9b18efd009e tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 16:13:42 user nova-compute[75176]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 16:13:42 user nova-compute[75176]:   <source dev="/dev/sdb"/>
Nov 28 16:13:42 user nova-compute[75176]:   <target dev="vdb" bus="virtio"/>
Nov 28 16:13:42 user nova-compute[75176]:   <serial>5b1dd73f-4c14-4416-9911-24ba37590848</serial>
Nov 28 16:13:42 user nova-compute[75176]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 16:13:42 user nova-compute[75176]: </disk>
Nov 28 16:13:42 user nova-compute[75176]:  {{(pid=75176) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 16:13:42 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 16:13:42 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:13:42 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75176) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 16:13:42 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75176) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 16:13:42 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75176) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 16:13:42 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:13:42 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-8808b952-5af9-4516-9689-f9b18efd009e tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7af26650-2a61-4557-8c3d-0688ddbc6343 {{(pid=75176) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 16:13:45 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:13:47 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:13:50 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:13:52 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:13:57 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:14:02 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 16:14:02 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:14:02 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75176) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 16:14:02 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75176) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 16:14:02 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75176) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 16:14:02 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:14:02 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-8808b952-5af9-4516-9689-f9b18efd009e tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 7af26650-2a61-4557-8c3d-0688ddbc6343 is timed out.
Nov 28 16:14:02 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-8808b952-5af9-4516-9689-f9b18efd009e tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Successfully detached device vdb from instance 7af26650-2a61-4557-8c3d-0688ddbc6343 from the live domain config.
Nov 28 16:14:02 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8808b952-5af9-4516-9689-f9b18efd009e tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] [instance: 7af26650-2a61-4557-8c3d-0688ddbc6343] calling os-brick to detach iSCSI Volume {{(pid=75176) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 16:14:02 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-8808b952-5af9-4516-9689-f9b18efd009e tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c1b8a00>, {'target_iqn': 'iqn.2010-10.org.openstack:5b1dd73f-4c14-4416-9911-24ba37590848', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YuOdepSJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 16:14:02 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-8808b952-5af9-4516-9689-f9b18efd009e tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 16:14:02 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-8808b952-5af9-4516-9689-f9b18efd009e tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 16:14:02 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-8808b952-5af9-4516-9689-f9b18efd009e tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 16:14:02 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:14:02 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:14:02 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b829ebd-1bfe-4304-b8a8-43928ca15a0b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5b1dd73f-4c14-4416-9911-24ba37590848\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:16529d22-907c-4b24-91d1-d38911118dda\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:14:02 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-8808b952-5af9-4516-9689-f9b18efd009e tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 16:14:02 user nova-compute[75176]: No targets found.
Nov 28 16:14:02 user nova-compute[75176]: iSNS:
Nov 28 16:14:02 user nova-compute[75176]: No targets found.
Nov 28 16:14:02 user nova-compute[75176]: STATIC:
Nov 28 16:14:02 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:5b1dd73f-4c14-4416-9911-24ba37590848
Nov 28 16:14:02 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 16:14:02 user nova-compute[75176]:                 Iface Name: default
Nov 28 16:14:02 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:16529d22-907c-4b24-91d1-d38911118dda
Nov 28 16:14:02 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 16:14:02 user nova-compute[75176]:                 Iface Name: default
Nov 28 16:14:02 user nova-compute[75176]: FIRMWARE:
Nov 28 16:14:02 user nova-compute[75176]: No targets found.
Nov 28 16:14:02 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 16:14:02 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-8808b952-5af9-4516-9689-f9b18efd009e tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 16:14:02 user nova-compute[75176]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 16:14:02 user nova-compute[75176]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75176) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 16:14:02 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-8808b952-5af9-4516-9689-f9b18efd009e tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5b1dd73f-4c14-4416-9911-24ba37590848', 0)] {{(pid=75176) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 16:14:02 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:14:02 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:14:02 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[308eabff-8d52-4acb-b6cc-c9a52b580d97]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:16529d22-907c-4b24-91d1-d38911118dda\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b1dd73f-4c14-4416-9911-24ba37590848\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:14:02 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:14:02 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:14:02 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c305374-1bb4-491b-b21c-126f9f98bfb7]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b1dd73f-4c14-4416-9911-24ba37590848 (non-flash)\ntcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16529d22-907c-4b24-91d1-d38911118dda (non-flash)\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:14:02 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-8808b952-5af9-4516-9689-f9b18efd009e tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b1dd73f-4c14-4416-9911-24ba37590848 (non-flash)
Nov 28 16:14:02 user nova-compute[75176]: tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16529d22-907c-4b24-91d1-d38911118dda (non-flash)
Nov 28 16:14:02 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 16:14:02 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-8808b952-5af9-4516-9689-f9b18efd009e tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b1dd73f-4c14-4416-9911-24ba37590848 (non-flash)
Nov 28 16:14:02 user nova-compute[75176]: tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16529d22-907c-4b24-91d1-d38911118dda (non-flash)
Nov 28 16:14:02 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 16:14:02 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-8808b952-5af9-4516-9689-f9b18efd009e tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f464d96ba30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5b1dd73f-4c14-4416-9911-24ba37590848'): ({'sdb'}, set())}) {{(pid=75176) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 16:14:02 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-8808b952-5af9-4516-9689-f9b18efd009e tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Removing single pathed devices sdb {{(pid=75176) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 16:14:02 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:14:02 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:14:02 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[69f0de6c-8676-4a80-8eb5-86f88f509594]: (4, ('path checker states:\nup                  1\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:14:02 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:14:02 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:14:02 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eb3b100-92c3-4085-9625-d6c828f0de52]: (4, ('ok\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:14:02 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-8808b952-5af9-4516-9689-f9b18efd009e tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Flushing IO for device /dev/sdb {{(pid=75176) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 16:14:02 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:14:03 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:14:03 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[02fe0596-b97f-493b-8238-26e36e2a2f77]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:14:03 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-8808b952-5af9-4516-9689-f9b18efd009e tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75176) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 16:14:03 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:14:03 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.053s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:14:03 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[16fd699c-b3ec-4813-be33-3b1d577a92d2]: (4, ('1', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:14:03 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-8808b952-5af9-4516-9689-f9b18efd009e tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75176) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 16:14:03 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-8808b952-5af9-4516-9689-f9b18efd009e tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] SCSI volumes sdb have been removed. {{(pid=75176) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 16:14:03 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-8808b952-5af9-4516-9689-f9b18efd009e tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5b1dd73f-4c14-4416-9911-24ba37590848')] {{(pid=75176) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 16:14:03 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b1dd73f-4c14-4416-9911-24ba37590848 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:14:03 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b1dd73f-4c14-4416-9911-24ba37590848 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:14:03 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9730002-ca8c-435a-8691-dfa0ad6733c6]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:14:03 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-8808b952-5af9-4516-9689-f9b18efd009e tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 16:14:03 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b1dd73f-4c14-4416-9911-24ba37590848 -p 172.16.0.220:3260 --logout {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:14:03 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b1dd73f-4c14-4416-9911-24ba37590848 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:14:03 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[5016854f-b1c3-4f63-87da-15a97601a861]: (4, ('Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:5b1dd73f-4c14-4416-9911-24ba37590848, portal: 172.16.0.220,3260]\nLogout of [sid: 62, target: iqn.2010-10.org.openstack:5b1dd73f-4c14-4416-9911-24ba37590848, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:14:03 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-8808b952-5af9-4516-9689-f9b18efd009e tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:5b1dd73f-4c14-4416-9911-24ba37590848, portal: 172.16.0.220,3260]
Nov 28 16:14:03 user nova-compute[75176]: Logout of [sid: 62, target: iqn.2010-10.org.openstack:5b1dd73f-4c14-4416-9911-24ba37590848, portal: 172.16.0.220,3260] successful.
Nov 28 16:14:03 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 16:14:03 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b1dd73f-4c14-4416-9911-24ba37590848 -p 172.16.0.220:3260 --op delete {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:14:03 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b1dd73f-4c14-4416-9911-24ba37590848 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:14:03 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f858d61-dea6-4a5b-bf87-2cade73d4dfe]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:14:03 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-8808b952-5af9-4516-9689-f9b18efd009e tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 16:14:03 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-8808b952-5af9-4516-9689-f9b18efd009e tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.303s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 16:14:03 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-8808b952-5af9-4516-9689-f9b18efd009e tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] <== disconnect_volume: return (304ms) None {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 16:14:03 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8808b952-5af9-4516-9689-f9b18efd009e tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] [instance: 7af26650-2a61-4557-8c3d-0688ddbc6343] Disconnected iSCSI Volume {{(pid=75176) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 16:14:03 user nova-compute[75176]: DEBUG nova.objects.instance [None req-8808b952-5af9-4516-9689-f9b18efd009e tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Lazy-loading 'flavor' on Instance uuid 7af26650-2a61-4557-8c3d-0688ddbc6343 {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 16:14:04 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-8808b952-5af9-4516-9689-f9b18efd009e tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Lock "7af26650-2a61-4557-8c3d-0688ddbc6343" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.751s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:14:05 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-d5104317-3f68-4ae6-99de-a4c9f9cc839a tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Acquiring lock "7af26650-2a61-4557-8c3d-0688ddbc6343" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:14:05 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-d5104317-3f68-4ae6-99de-a4c9f9cc839a tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Lock "7af26650-2a61-4557-8c3d-0688ddbc6343" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:14:05 user nova-compute[75176]: INFO nova.compute.manager [None req-d5104317-3f68-4ae6-99de-a4c9f9cc839a tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] [instance: 7af26650-2a61-4557-8c3d-0688ddbc6343] Detaching volume 16529d22-907c-4b24-91d1-d38911118dda
Nov 28 16:14:05 user nova-compute[75176]: INFO nova.virt.block_device [None req-d5104317-3f68-4ae6-99de-a4c9f9cc839a tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] [instance: 7af26650-2a61-4557-8c3d-0688ddbc6343] Attempting to driver detach volume 16529d22-907c-4b24-91d1-d38911118dda from mountpoint /dev/vdc
Nov 28 16:14:05 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-d5104317-3f68-4ae6-99de-a4c9f9cc839a tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Attempting to detach device vdc from instance 7af26650-2a61-4557-8c3d-0688ddbc6343 from the persistent domain config. {{(pid=75176) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 16:14:05 user nova-compute[75176]: DEBUG nova.virt.libvirt.guest [None req-d5104317-3f68-4ae6-99de-a4c9f9cc839a tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 16:14:05 user nova-compute[75176]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 16:14:05 user nova-compute[75176]:   <source dev="/dev/sdc"/>
Nov 28 16:14:05 user nova-compute[75176]:   <target dev="vdc" bus="virtio"/>
Nov 28 16:14:05 user nova-compute[75176]:   <serial>16529d22-907c-4b24-91d1-d38911118dda</serial>
Nov 28 16:14:05 user nova-compute[75176]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 28 16:14:05 user nova-compute[75176]: </disk>
Nov 28 16:14:05 user nova-compute[75176]:  {{(pid=75176) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 16:14:05 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-d5104317-3f68-4ae6-99de-a4c9f9cc839a tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Successfully detached device vdc from instance 7af26650-2a61-4557-8c3d-0688ddbc6343 from the persistent domain config.
Nov 28 16:14:05 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-d5104317-3f68-4ae6-99de-a4c9f9cc839a tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 7af26650-2a61-4557-8c3d-0688ddbc6343 from the live domain config. {{(pid=75176) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 16:14:05 user nova-compute[75176]: DEBUG nova.virt.libvirt.guest [None req-d5104317-3f68-4ae6-99de-a4c9f9cc839a tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 16:14:05 user nova-compute[75176]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 16:14:05 user nova-compute[75176]:   <source dev="/dev/sdc"/>
Nov 28 16:14:05 user nova-compute[75176]:   <target dev="vdc" bus="virtio"/>
Nov 28 16:14:05 user nova-compute[75176]:   <serial>16529d22-907c-4b24-91d1-d38911118dda</serial>
Nov 28 16:14:05 user nova-compute[75176]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 28 16:14:05 user nova-compute[75176]: </disk>
Nov 28 16:14:05 user nova-compute[75176]:  {{(pid=75176) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 16:14:05 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-d5104317-3f68-4ae6-99de-a4c9f9cc839a tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 7af26650-2a61-4557-8c3d-0688ddbc6343 {{(pid=75176) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 16:14:07 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:14:10 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:14:12 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:14:13 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:14:15 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:14:17 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:14:17 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75176) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 16:14:17 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 16:14:20 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:14:20 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Starting heal instance info cache {{(pid=75176) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 16:14:20 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Rebuilding the list of instances to heal {{(pid=75176) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 16:14:20 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquiring lock "refresh_cache-7af26650-2a61-4557-8c3d-0688ddbc6343" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 16:14:20 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquired lock "refresh_cache-7af26650-2a61-4557-8c3d-0688ddbc6343" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 16:14:20 user nova-compute[75176]: DEBUG nova.network.neutron [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] [instance: 7af26650-2a61-4557-8c3d-0688ddbc6343] Forcefully refreshing network info cache for instance {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 16:14:20 user nova-compute[75176]: DEBUG nova.objects.instance [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lazy-loading 'info_cache' on Instance uuid 7af26650-2a61-4557-8c3d-0688ddbc6343 {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 16:14:21 user nova-compute[75176]: DEBUG nova.network.neutron [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] [instance: 7af26650-2a61-4557-8c3d-0688ddbc6343] Updating instance_info_cache with network_info: [{"id": "ed4b6bff-3d17-4593-aabb-38a65b35aaea", "address": "fa:16:3e:81:6d:41", "network": {"id": "9faaeac5-1688-436d-90fb-38bb1c4d3da4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1225296735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6aab7b19b9414b5da476b87e144cc40b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped4b6bff-3d", "ovs_interfaceid": "ed4b6bff-3d17-4593-aabb-38a65b35aaea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 16:14:21 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Releasing lock "refresh_cache-7af26650-2a61-4557-8c3d-0688ddbc6343" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 16:14:21 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] [instance: 7af26650-2a61-4557-8c3d-0688ddbc6343] Updated the network info_cache for instance {{(pid=75176) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 16:14:21 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:14:21 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:14:22 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:14:25 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-d5104317-3f68-4ae6-99de-a4c9f9cc839a tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 7af26650-2a61-4557-8c3d-0688ddbc6343 is timed out.
Nov 28 16:14:25 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-d5104317-3f68-4ae6-99de-a4c9f9cc839a tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Successfully detached device vdc from instance 7af26650-2a61-4557-8c3d-0688ddbc6343 from the live domain config.
Nov 28 16:14:25 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d5104317-3f68-4ae6-99de-a4c9f9cc839a tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] [instance: 7af26650-2a61-4557-8c3d-0688ddbc6343] calling os-brick to detach iSCSI Volume {{(pid=75176) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 16:14:25 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5104317-3f68-4ae6-99de-a4c9f9cc839a tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c1b8a00>, {'target_iqn': 'iqn.2010-10.org.openstack:16529d22-907c-4b24-91d1-d38911118dda', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ICgDcPwK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 16:14:25 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-d5104317-3f68-4ae6-99de-a4c9f9cc839a tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 16:14:25 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-d5104317-3f68-4ae6-99de-a4c9f9cc839a tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 16:14:25 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-d5104317-3f68-4ae6-99de-a4c9f9cc839a tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 16:14:25 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:14:25 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:14:25 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c3bc6fd-e112-4017-a125-035da49b2b96]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:16529d22-907c-4b24-91d1-d38911118dda\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:14:25 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5104317-3f68-4ae6-99de-a4c9f9cc839a tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 16:14:25 user nova-compute[75176]: No targets found.
Nov 28 16:14:25 user nova-compute[75176]: iSNS:
Nov 28 16:14:25 user nova-compute[75176]: No targets found.
Nov 28 16:14:25 user nova-compute[75176]: STATIC:
Nov 28 16:14:25 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:16529d22-907c-4b24-91d1-d38911118dda
Nov 28 16:14:25 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 16:14:25 user nova-compute[75176]:                 Iface Name: default
Nov 28 16:14:25 user nova-compute[75176]: FIRMWARE:
Nov 28 16:14:25 user nova-compute[75176]: No targets found.
Nov 28 16:14:25 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 16:14:25 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5104317-3f68-4ae6-99de-a4c9f9cc839a tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 16:14:25 user nova-compute[75176]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 16:14:25 user nova-compute[75176]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75176) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 16:14:25 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5104317-3f68-4ae6-99de-a4c9f9cc839a tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:16529d22-907c-4b24-91d1-d38911118dda', 0)] {{(pid=75176) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 16:14:25 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:14:25 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:14:25 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:14:25 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[c82a0330-b851-4840-9b92-a643956e634e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:16529d22-907c-4b24-91d1-d38911118dda\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:14:25 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:14:25 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:14:25 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a1b9f33-9114-4617-b193-ac4ff81ac540]: (4, ('tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16529d22-907c-4b24-91d1-d38911118dda (non-flash)\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:14:25 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5104317-3f68-4ae6-99de-a4c9f9cc839a tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16529d22-907c-4b24-91d1-d38911118dda (non-flash)
Nov 28 16:14:25 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 16:14:25 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5104317-3f68-4ae6-99de-a4c9f9cc839a tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] iscsi session list stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16529d22-907c-4b24-91d1-d38911118dda (non-flash)
Nov 28 16:14:25 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 16:14:25 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5104317-3f68-4ae6-99de-a4c9f9cc839a tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f462c6adfc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:16529d22-907c-4b24-91d1-d38911118dda'): ({'sdc'}, set())}) {{(pid=75176) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 16:14:25 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-d5104317-3f68-4ae6-99de-a4c9f9cc839a tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Removing single pathed devices sdc {{(pid=75176) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 16:14:25 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:14:25 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:14:25 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9aa7fc0-cb4c-4f30-b3ba-ff4626661cc6]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:14:25 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:14:25 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.017s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:14:25 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fc5055f-d044-4afe-a85e-2e2966e6c54d]: (4, ('ok\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:14:25 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-d5104317-3f68-4ae6-99de-a4c9f9cc839a tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Flushing IO for device /dev/sdc {{(pid=75176) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 16:14:25 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:14:25 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:14:25 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ca38f7e-5b9b-4ded-80ba-450298c16673]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:14:25 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-d5104317-3f68-4ae6-99de-a4c9f9cc839a tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75176) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 16:14:25 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:14:25 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.041s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:14:25 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[561bf98e-bed2-4e53-9142-9de6a4cdf5fb]: (4, ('1', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:14:25 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-d5104317-3f68-4ae6-99de-a4c9f9cc839a tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75176) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 16:14:25 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-d5104317-3f68-4ae6-99de-a4c9f9cc839a tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] SCSI volumes sdc have been removed. {{(pid=75176) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 16:14:25 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5104317-3f68-4ae6-99de-a4c9f9cc839a tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:16529d22-907c-4b24-91d1-d38911118dda')] {{(pid=75176) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 16:14:25 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16529d22-907c-4b24-91d1-d38911118dda -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:14:25 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16529d22-907c-4b24-91d1-d38911118dda -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:14:25 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[b28267fe-6996-45ef-a40d-7de647887ff0]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:14:25 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5104317-3f68-4ae6-99de-a4c9f9cc839a tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 16:14:25 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16529d22-907c-4b24-91d1-d38911118dda -p 172.16.0.220:3260 --logout {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:14:25 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16529d22-907c-4b24-91d1-d38911118dda -p 172.16.0.220:3260 --logout" returned: 0 in 0.041s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:14:25 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[3875a29c-c0d7-480f-aa1a-fe3a16856ce9]: (4, ('Logging out of session [sid: 63, target: iqn.2010-10.org.openstack:16529d22-907c-4b24-91d1-d38911118dda, portal: 172.16.0.220,3260]\nLogout of [sid: 63, target: iqn.2010-10.org.openstack:16529d22-907c-4b24-91d1-d38911118dda, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:14:25 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5104317-3f68-4ae6-99de-a4c9f9cc839a tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 63, target: iqn.2010-10.org.openstack:16529d22-907c-4b24-91d1-d38911118dda, portal: 172.16.0.220,3260]
Nov 28 16:14:25 user nova-compute[75176]: Logout of [sid: 63, target: iqn.2010-10.org.openstack:16529d22-907c-4b24-91d1-d38911118dda, portal: 172.16.0.220,3260] successful.
Nov 28 16:14:25 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 16:14:25 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16529d22-907c-4b24-91d1-d38911118dda -p 172.16.0.220:3260 --op delete {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:14:25 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16529d22-907c-4b24-91d1-d38911118dda -p 172.16.0.220:3260 --op delete" returned: 0 in 0.016s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:14:25 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cd5cdb6-4a60-4136-94b2-19edc1405455]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:14:25 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5104317-3f68-4ae6-99de-a4c9f9cc839a tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 16:14:25 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-d5104317-3f68-4ae6-99de-a4c9f9cc839a tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.248s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 16:14:25 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5104317-3f68-4ae6-99de-a4c9f9cc839a tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] <== disconnect_volume: return (250ms) None {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 16:14:25 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d5104317-3f68-4ae6-99de-a4c9f9cc839a tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] [instance: 7af26650-2a61-4557-8c3d-0688ddbc6343] Disconnected iSCSI Volume {{(pid=75176) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 16:14:26 user nova-compute[75176]: DEBUG nova.objects.instance [None req-d5104317-3f68-4ae6-99de-a4c9f9cc839a tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Lazy-loading 'flavor' on Instance uuid 7af26650-2a61-4557-8c3d-0688ddbc6343 {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 16:14:26 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-d5104317-3f68-4ae6-99de-a4c9f9cc839a tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Lock "7af26650-2a61-4557-8c3d-0688ddbc6343" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.840s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:14:27 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:14:28 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-86b46e87-f0ab-43b6-a89e-f7c86477c3a2 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Acquiring lock "7af26650-2a61-4557-8c3d-0688ddbc6343" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:14:28 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-86b46e87-f0ab-43b6-a89e-f7c86477c3a2 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Lock "7af26650-2a61-4557-8c3d-0688ddbc6343" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:14:28 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-86b46e87-f0ab-43b6-a89e-f7c86477c3a2 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Acquiring lock "7af26650-2a61-4557-8c3d-0688ddbc6343-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:14:28 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-86b46e87-f0ab-43b6-a89e-f7c86477c3a2 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Lock "7af26650-2a61-4557-8c3d-0688ddbc6343-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:14:28 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-86b46e87-f0ab-43b6-a89e-f7c86477c3a2 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Lock "7af26650-2a61-4557-8c3d-0688ddbc6343-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:14:28 user nova-compute[75176]: INFO nova.compute.manager [None req-86b46e87-f0ab-43b6-a89e-f7c86477c3a2 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] [instance: 7af26650-2a61-4557-8c3d-0688ddbc6343] Terminating instance
Nov 28 16:14:28 user nova-compute[75176]: DEBUG nova.compute.manager [None req-86b46e87-f0ab-43b6-a89e-f7c86477c3a2 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] [instance: 7af26650-2a61-4557-8c3d-0688ddbc6343] Start destroying the instance on the hypervisor. {{(pid=75176) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 16:14:28 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:14:28 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:14:28 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:14:28 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:14:28 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:14:28 user nova-compute[75176]: DEBUG nova.compute.manager [req-de33bda2-9340-4e3c-96b4-cbd7c5211d66 req-606228df-c9e4-4dae-a7ad-4d22a0cd9950 service nova] [instance: 7af26650-2a61-4557-8c3d-0688ddbc6343] Received event network-vif-unplugged-ed4b6bff-3d17-4593-aabb-38a65b35aaea {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 16:14:28 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-de33bda2-9340-4e3c-96b4-cbd7c5211d66 req-606228df-c9e4-4dae-a7ad-4d22a0cd9950 service nova] Acquiring lock "7af26650-2a61-4557-8c3d-0688ddbc6343-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:14:28 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-de33bda2-9340-4e3c-96b4-cbd7c5211d66 req-606228df-c9e4-4dae-a7ad-4d22a0cd9950 service nova] Lock "7af26650-2a61-4557-8c3d-0688ddbc6343-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:14:28 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-de33bda2-9340-4e3c-96b4-cbd7c5211d66 req-606228df-c9e4-4dae-a7ad-4d22a0cd9950 service nova] Lock "7af26650-2a61-4557-8c3d-0688ddbc6343-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:14:28 user nova-compute[75176]: DEBUG nova.compute.manager [req-de33bda2-9340-4e3c-96b4-cbd7c5211d66 req-606228df-c9e4-4dae-a7ad-4d22a0cd9950 service nova] [instance: 7af26650-2a61-4557-8c3d-0688ddbc6343] No waiting events found dispatching network-vif-unplugged-ed4b6bff-3d17-4593-aabb-38a65b35aaea {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 16:14:28 user nova-compute[75176]: DEBUG nova.compute.manager [req-de33bda2-9340-4e3c-96b4-cbd7c5211d66 req-606228df-c9e4-4dae-a7ad-4d22a0cd9950 service nova] [instance: 7af26650-2a61-4557-8c3d-0688ddbc6343] Received event network-vif-unplugged-ed4b6bff-3d17-4593-aabb-38a65b35aaea for instance with task_state deleting. {{(pid=75176) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 16:14:28 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:14:28 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:14:28 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:14:28 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:14:28 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:14:28 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Auditing locally available compute resources for user (node: user) {{(pid=75176) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 16:14:28 user nova-compute[75176]: INFO nova.virt.libvirt.driver [-] [instance: 7af26650-2a61-4557-8c3d-0688ddbc6343] Instance destroyed successfully.
Nov 28 16:14:28 user nova-compute[75176]: DEBUG nova.objects.instance [None req-86b46e87-f0ab-43b6-a89e-f7c86477c3a2 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Lazy-loading 'resources' on Instance uuid 7af26650-2a61-4557-8c3d-0688ddbc6343 {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 16:14:28 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-86b46e87-f0ab-43b6-a89e-f7c86477c3a2 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T16:11:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-943002828',display_name='tempest-AttachVolumeTestJSON-server-943002828',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-943002828',id=52,image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAcJdIqIdQzt0cHkTQAr4zbHkDyepmObwrfc8oOAY4jaezKsWqag8HJKtuLyoPnBmfV+JbJOGEKpt/rVBy0IxFm14gbiM+EXS0/KO4bWdbBNYXzrAN0w8aA7qmnamdWwNA==',key_name='tempest-keypair-1859788446',keypairs=<?>,launch_index=0,launched_at=2023-11-28T16:11:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6aab7b19b9414b5da476b87e144cc40b',ramdisk_id='',reservation_id='r-ygxmvi1h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-365725655',owner_user_name='tempest-AttachVolumeTestJSON-365725655-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T16:11:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='60b513cfc58647d49fc084d51964a4c6',uuid=7af26650-2a61-4557-8c3d-0688ddbc6343,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ed4b6bff-3d17-4593-aabb-38a65b35aaea", "address": "fa:16:3e:81:6d:41", "network": {"id": "9faaeac5-1688-436d-90fb-38bb1c4d3da4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1225296735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6aab7b19b9414b5da476b87e144cc40b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped4b6bff-3d", "ovs_interfaceid": "ed4b6bff-3d17-4593-aabb-38a65b35aaea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 16:14:28 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-86b46e87-f0ab-43b6-a89e-f7c86477c3a2 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Converting VIF {"id": "ed4b6bff-3d17-4593-aabb-38a65b35aaea", "address": "fa:16:3e:81:6d:41", "network": {"id": "9faaeac5-1688-436d-90fb-38bb1c4d3da4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1225296735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6aab7b19b9414b5da476b87e144cc40b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped4b6bff-3d", "ovs_interfaceid": "ed4b6bff-3d17-4593-aabb-38a65b35aaea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 16:14:28 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-86b46e87-f0ab-43b6-a89e-f7c86477c3a2 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:81:6d:41,bridge_name='br-int',has_traffic_filtering=True,id=ed4b6bff-3d17-4593-aabb-38a65b35aaea,network=Network(9faaeac5-1688-436d-90fb-38bb1c4d3da4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped4b6bff-3d') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 16:14:28 user nova-compute[75176]: DEBUG os_vif [None req-86b46e87-f0ab-43b6-a89e-f7c86477c3a2 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:81:6d:41,bridge_name='br-int',has_traffic_filtering=True,id=ed4b6bff-3d17-4593-aabb-38a65b35aaea,network=Network(9faaeac5-1688-436d-90fb-38bb1c4d3da4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped4b6bff-3d') {{(pid=75176) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 16:14:28 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:14:28 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=taped4b6bff-3d, bridge=br-int, if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 16:14:28 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:14:28 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 16:14:28 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:14:28 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a3fd1d08-1fc5-4859-ae88-b1eb0be081ec) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 16:14:28 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:14:28 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 16:14:28 user nova-compute[75176]: INFO os_vif [None req-86b46e87-f0ab-43b6-a89e-f7c86477c3a2 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:81:6d:41,bridge_name='br-int',has_traffic_filtering=True,id=ed4b6bff-3d17-4593-aabb-38a65b35aaea,network=Network(9faaeac5-1688-436d-90fb-38bb1c4d3da4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped4b6bff-3d')
Nov 28 16:14:28 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-86b46e87-f0ab-43b6-a89e-f7c86477c3a2 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] [instance: 7af26650-2a61-4557-8c3d-0688ddbc6343] Deleting instance files /opt/stack/data/nova/instances/7af26650-2a61-4557-8c3d-0688ddbc6343_del
Nov 28 16:14:28 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-86b46e87-f0ab-43b6-a89e-f7c86477c3a2 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] [instance: 7af26650-2a61-4557-8c3d-0688ddbc6343] Deletion of /opt/stack/data/nova/instances/7af26650-2a61-4557-8c3d-0688ddbc6343_del complete
Nov 28 16:14:28 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Periodic task is updating the host stats, it is trying to get disk info for instance-00000034, but the backing disk storage was removed by a concurrent operation such as resize. Error: No disk at /opt/stack/data/nova/instances/7af26650-2a61-4557-8c3d-0688ddbc6343/disk: nova.exception.DiskNotFound: No disk at /opt/stack/data/nova/instances/7af26650-2a61-4557-8c3d-0688ddbc6343/disk
Nov 28 16:14:28 user nova-compute[75176]: INFO nova.compute.manager [None req-86b46e87-f0ab-43b6-a89e-f7c86477c3a2 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] [instance: 7af26650-2a61-4557-8c3d-0688ddbc6343] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 28 16:14:28 user nova-compute[75176]: DEBUG oslo.service.loopingcall [None req-86b46e87-f0ab-43b6-a89e-f7c86477c3a2 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75176) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 16:14:28 user nova-compute[75176]: DEBUG nova.compute.manager [-] [instance: 7af26650-2a61-4557-8c3d-0688ddbc6343] Deallocating network for instance {{(pid=75176) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 16:14:28 user nova-compute[75176]: DEBUG nova.network.neutron [-] [instance: 7af26650-2a61-4557-8c3d-0688ddbc6343] deallocate_for_instance() {{(pid=75176) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 16:14:29 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 16:14:29 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 16:14:29 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Hypervisor/Node resource view: name=user free_ram=9162MB free_disk=25.05620574951172GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75176) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 16:14:29 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:14:29 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:14:29 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance 7af26650-2a61-4557-8c3d-0688ddbc6343 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 16:14:29 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75176) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 16:14:29 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75176) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 16:14:29 user nova-compute[75176]: DEBUG nova.compute.provider_tree [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Inventory has not changed in ProviderTree for provider: b37848d8-f401-4155-a029-b0ffa09ff85b {{(pid=75176) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 16:14:29 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Inventory has not changed for provider b37848d8-f401-4155-a029-b0ffa09ff85b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75176) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 16:14:29 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Compute_service record updated for user:user {{(pid=75176) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 16:14:29 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.201s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:14:29 user nova-compute[75176]: DEBUG nova.network.neutron [-] [instance: 7af26650-2a61-4557-8c3d-0688ddbc6343] Updating instance_info_cache with network_info: [] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 16:14:29 user nova-compute[75176]: INFO nova.compute.manager [-] [instance: 7af26650-2a61-4557-8c3d-0688ddbc6343] Took 0.96 seconds to deallocate network for instance.
Nov 28 16:14:29 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-86b46e87-f0ab-43b6-a89e-f7c86477c3a2 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:14:29 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-86b46e87-f0ab-43b6-a89e-f7c86477c3a2 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:14:29 user nova-compute[75176]: DEBUG nova.compute.provider_tree [None req-86b46e87-f0ab-43b6-a89e-f7c86477c3a2 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Inventory has not changed in ProviderTree for provider: b37848d8-f401-4155-a029-b0ffa09ff85b {{(pid=75176) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 16:14:29 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-86b46e87-f0ab-43b6-a89e-f7c86477c3a2 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Inventory has not changed for provider b37848d8-f401-4155-a029-b0ffa09ff85b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75176) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 16:14:30 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-86b46e87-f0ab-43b6-a89e-f7c86477c3a2 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.128s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:14:30 user nova-compute[75176]: INFO nova.scheduler.client.report [None req-86b46e87-f0ab-43b6-a89e-f7c86477c3a2 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Deleted allocations for instance 7af26650-2a61-4557-8c3d-0688ddbc6343
Nov 28 16:14:30 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-86b46e87-f0ab-43b6-a89e-f7c86477c3a2 tempest-AttachVolumeTestJSON-365725655 tempest-AttachVolumeTestJSON-365725655-project-member] Lock "7af26650-2a61-4557-8c3d-0688ddbc6343" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.120s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:14:30 user nova-compute[75176]: DEBUG nova.compute.manager [req-5f8c2e73-d431-4e96-a92a-c44f095cd3d1 req-dd5fc28b-d0c4-49a9-88bb-73e9fde459ce service nova] [instance: 7af26650-2a61-4557-8c3d-0688ddbc6343] Received event network-vif-plugged-ed4b6bff-3d17-4593-aabb-38a65b35aaea {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 16:14:30 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-5f8c2e73-d431-4e96-a92a-c44f095cd3d1 req-dd5fc28b-d0c4-49a9-88bb-73e9fde459ce service nova] Acquiring lock "7af26650-2a61-4557-8c3d-0688ddbc6343-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:14:30 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-5f8c2e73-d431-4e96-a92a-c44f095cd3d1 req-dd5fc28b-d0c4-49a9-88bb-73e9fde459ce service nova] Lock "7af26650-2a61-4557-8c3d-0688ddbc6343-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:14:30 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-5f8c2e73-d431-4e96-a92a-c44f095cd3d1 req-dd5fc28b-d0c4-49a9-88bb-73e9fde459ce service nova] Lock "7af26650-2a61-4557-8c3d-0688ddbc6343-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:14:30 user nova-compute[75176]: DEBUG nova.compute.manager [req-5f8c2e73-d431-4e96-a92a-c44f095cd3d1 req-dd5fc28b-d0c4-49a9-88bb-73e9fde459ce service nova] [instance: 7af26650-2a61-4557-8c3d-0688ddbc6343] No waiting events found dispatching network-vif-plugged-ed4b6bff-3d17-4593-aabb-38a65b35aaea {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 16:14:30 user nova-compute[75176]: WARNING nova.compute.manager [req-5f8c2e73-d431-4e96-a92a-c44f095cd3d1 req-dd5fc28b-d0c4-49a9-88bb-73e9fde459ce service nova] [instance: 7af26650-2a61-4557-8c3d-0688ddbc6343] Received unexpected event network-vif-plugged-ed4b6bff-3d17-4593-aabb-38a65b35aaea for instance with vm_state deleted and task_state None.
Nov 28 16:14:30 user nova-compute[75176]: DEBUG nova.compute.manager [req-5f8c2e73-d431-4e96-a92a-c44f095cd3d1 req-dd5fc28b-d0c4-49a9-88bb-73e9fde459ce service nova] [instance: 7af26650-2a61-4557-8c3d-0688ddbc6343] Received event network-vif-deleted-ed4b6bff-3d17-4593-aabb-38a65b35aaea {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 16:14:33 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:14:38 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 16:14:42 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:14:42 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:14:42 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:14:42 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:14:42 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:14:42 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:14:42 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:14:42 user nova-compute[75176]: DEBUG nova.virt.libvirt.imagecache [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Verify base images {{(pid=75176) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Nov 28 16:14:42 user nova-compute[75176]: WARNING nova.virt.libvirt.imagecache [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Unknown base file: /opt/stack/data/nova/instances/_base/f146e8f0887767cab5db3c3bbf1c8593b766c4dd
Nov 28 16:14:42 user nova-compute[75176]: WARNING nova.virt.libvirt.imagecache [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Unknown base file: /opt/stack/data/nova/instances/_base/4243035a4821e85426317e400c4810142a3fd3e3
Nov 28 16:14:42 user nova-compute[75176]: WARNING nova.virt.libvirt.imagecache [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Unknown base file: /opt/stack/data/nova/instances/_base/74aecd291fbec52d157938a688173a923d0d3efd
Nov 28 16:14:42 user nova-compute[75176]: WARNING nova.virt.libvirt.imagecache [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Unknown base file: /opt/stack/data/nova/instances/_base/8c801c4a08f51b6bad2df9b91a5eb50e82891ca5
Nov 28 16:14:42 user nova-compute[75176]: WARNING nova.virt.libvirt.imagecache [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Unknown base file: /opt/stack/data/nova/instances/_base/4b0340fffc5d9270b5c1dc2181ab32ed03e4df1f
Nov 28 16:14:42 user nova-compute[75176]: WARNING nova.virt.libvirt.imagecache [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Unknown base file: /opt/stack/data/nova/instances/_base/cbc26ed1db0759708530d18d919dd1a5a6c242dd
Nov 28 16:14:42 user nova-compute[75176]: WARNING nova.virt.libvirt.imagecache [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Unknown base file: /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2
Nov 28 16:14:42 user nova-compute[75176]: WARNING nova.virt.libvirt.imagecache [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Unknown base file: /opt/stack/data/nova/instances/_base/85a57ebfd6e0ad1c146d6c71208dc0756fe3c6ca
Nov 28 16:14:42 user nova-compute[75176]: WARNING nova.virt.libvirt.imagecache [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Unknown base file: /opt/stack/data/nova/instances/_base/16cc48526cd7fdbfb566de50bca691060eb0cf71
Nov 28 16:14:42 user nova-compute[75176]: WARNING nova.virt.libvirt.imagecache [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Unknown base file: /opt/stack/data/nova/instances/_base/0ea5ae5a4cf6c6e5a33a1491e0598683d30f0840
Nov 28 16:14:42 user nova-compute[75176]: INFO nova.virt.libvirt.imagecache [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Removable base files: /opt/stack/data/nova/instances/_base/f146e8f0887767cab5db3c3bbf1c8593b766c4dd /opt/stack/data/nova/instances/_base/4243035a4821e85426317e400c4810142a3fd3e3 /opt/stack/data/nova/instances/_base/74aecd291fbec52d157938a688173a923d0d3efd /opt/stack/data/nova/instances/_base/8c801c4a08f51b6bad2df9b91a5eb50e82891ca5 /opt/stack/data/nova/instances/_base/4b0340fffc5d9270b5c1dc2181ab32ed03e4df1f /opt/stack/data/nova/instances/_base/cbc26ed1db0759708530d18d919dd1a5a6c242dd /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 /opt/stack/data/nova/instances/_base/85a57ebfd6e0ad1c146d6c71208dc0756fe3c6ca /opt/stack/data/nova/instances/_base/16cc48526cd7fdbfb566de50bca691060eb0cf71 /opt/stack/data/nova/instances/_base/0ea5ae5a4cf6c6e5a33a1491e0598683d30f0840
Nov 28 16:14:42 user nova-compute[75176]: INFO nova.virt.libvirt.imagecache [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/f146e8f0887767cab5db3c3bbf1c8593b766c4dd
Nov 28 16:14:42 user nova-compute[75176]: INFO nova.virt.libvirt.imagecache [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/4243035a4821e85426317e400c4810142a3fd3e3
Nov 28 16:14:42 user nova-compute[75176]: INFO nova.virt.libvirt.imagecache [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/74aecd291fbec52d157938a688173a923d0d3efd
Nov 28 16:14:42 user nova-compute[75176]: INFO nova.virt.libvirt.imagecache [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/8c801c4a08f51b6bad2df9b91a5eb50e82891ca5
Nov 28 16:14:42 user nova-compute[75176]: INFO nova.virt.libvirt.imagecache [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/4b0340fffc5d9270b5c1dc2181ab32ed03e4df1f
Nov 28 16:14:42 user nova-compute[75176]: INFO nova.virt.libvirt.imagecache [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/cbc26ed1db0759708530d18d919dd1a5a6c242dd
Nov 28 16:14:42 user nova-compute[75176]: INFO nova.virt.libvirt.imagecache [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2
Nov 28 16:14:42 user nova-compute[75176]: INFO nova.virt.libvirt.imagecache [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/85a57ebfd6e0ad1c146d6c71208dc0756fe3c6ca
Nov 28 16:14:42 user nova-compute[75176]: INFO nova.virt.libvirt.imagecache [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/16cc48526cd7fdbfb566de50bca691060eb0cf71
Nov 28 16:14:42 user nova-compute[75176]: INFO nova.virt.libvirt.imagecache [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/0ea5ae5a4cf6c6e5a33a1491e0598683d30f0840
Nov 28 16:14:42 user nova-compute[75176]: DEBUG nova.virt.libvirt.imagecache [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Verification complete {{(pid=75176) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Nov 28 16:14:42 user nova-compute[75176]: DEBUG nova.virt.libvirt.imagecache [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Verify swap images {{(pid=75176) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Nov 28 16:14:42 user nova-compute[75176]: DEBUG nova.virt.libvirt.imagecache [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Verify ephemeral images {{(pid=75176) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Nov 28 16:14:43 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 16:14:43 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:14:43 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75176) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 16:14:43 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75176) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 16:14:43 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75176) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 16:14:43 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:14:48 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 16:14:48 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:14:48 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75176) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 16:14:48 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75176) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 16:14:48 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75176) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 16:14:48 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:14:53 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 16:14:58 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 16:15:03 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 16:15:08 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 16:15:11 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:15:13 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 16:15:14 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:15:17 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:15:18 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:15:18 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:15:18 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75176) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 16:15:18 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:15:19 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:15:19 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Cleaning up deleted instances {{(pid=75176) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 28 16:15:19 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] There are 0 instances to clean {{(pid=75176) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 28 16:15:22 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:15:22 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Starting heal instance info cache {{(pid=75176) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 16:15:22 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Rebuilding the list of instances to heal {{(pid=75176) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 16:15:22 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Didn't find any instances for network info cache update. {{(pid=75176) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 28 16:15:22 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:15:22 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:15:23 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:15:26 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:15:27 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:15:27 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75176) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 28 16:15:28 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 16:15:30 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:15:30 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:15:30 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:15:30 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:15:30 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Auditing locally available compute resources for user (node: user) {{(pid=75176) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 16:15:31 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 16:15:31 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 16:15:31 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Hypervisor/Node resource view: name=user free_ram=9177MB free_disk=25.08306884765625GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75176) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 16:15:31 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:15:31 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:15:31 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75176) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 16:15:31 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75176) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 16:15:31 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Refreshing inventories for resource provider b37848d8-f401-4155-a029-b0ffa09ff85b {{(pid=75176) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 28 16:15:31 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Updating ProviderTree inventory for provider b37848d8-f401-4155-a029-b0ffa09ff85b from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75176) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 28 16:15:31 user nova-compute[75176]: DEBUG nova.compute.provider_tree [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Updating inventory in ProviderTree for provider b37848d8-f401-4155-a029-b0ffa09ff85b with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75176) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 28 16:15:31 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Refreshing aggregate associations for resource provider b37848d8-f401-4155-a029-b0ffa09ff85b, aggregates: None {{(pid=75176) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 28 16:15:31 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:15:31 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Refreshing trait associations for resource provider b37848d8-f401-4155-a029-b0ffa09ff85b, traits: COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_RESCUE_BFV,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NODE,HW_CPU_X86_SSSE3,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE42,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE2,COMPUTE_ACCELERATORS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VIRTIO {{(pid=75176) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 28 16:15:31 user nova-compute[75176]: DEBUG nova.compute.provider_tree [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Inventory has not changed in ProviderTree for provider: b37848d8-f401-4155-a029-b0ffa09ff85b {{(pid=75176) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 16:15:31 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Inventory has not changed for provider b37848d8-f401-4155-a029-b0ffa09ff85b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75176) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 16:15:31 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Compute_service record updated for user:user {{(pid=75176) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 16:15:31 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.699s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:15:33 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:15:37 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:15:38 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:15:43 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 16:15:47 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:15:48 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 16:15:53 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 16:15:53 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:15:53 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75176) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 16:15:53 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75176) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 16:15:53 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75176) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 16:15:53 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:15:58 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:16:03 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 16:16:03 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:16:03 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75176) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 16:16:03 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75176) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 16:16:03 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75176) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 16:16:03 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:16:08 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:16:12 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:16:12 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:16:13 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 16:16:13 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:16:13 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75176) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 16:16:13 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75176) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 16:16:13 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75176) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 16:16:13 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:16:15 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:16:18 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:16:19 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:16:20 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:16:20 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75176) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 16:16:22 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:16:23 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:16:23 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Starting heal instance info cache {{(pid=75176) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 16:16:23 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Rebuilding the list of instances to heal {{(pid=75176) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 16:16:23 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Didn't find any instances for network info cache update. {{(pid=75176) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 28 16:16:23 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 16:16:23 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:16:23 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75176) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 16:16:23 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75176) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 16:16:23 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75176) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 16:16:23 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:16:24 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:16:27 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:16:28 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 16:16:30 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:16:30 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:16:30 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:16:30 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:16:30 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Auditing locally available compute resources for user (node: user) {{(pid=75176) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 16:16:31 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 16:16:31 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 16:16:31 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Hypervisor/Node resource view: name=user free_ram=9190MB free_disk=25.080780029296875GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75176) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 16:16:31 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:16:31 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:16:31 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75176) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 16:16:31 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75176) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 16:16:31 user nova-compute[75176]: DEBUG nova.compute.provider_tree [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Inventory has not changed in ProviderTree for provider: b37848d8-f401-4155-a029-b0ffa09ff85b {{(pid=75176) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 16:16:31 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Inventory has not changed for provider b37848d8-f401-4155-a029-b0ffa09ff85b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75176) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 16:16:31 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Compute_service record updated for user:user {{(pid=75176) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 16:16:31 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.166s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:16:33 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 16:16:38 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:16:43 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 16:16:48 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:16:53 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:16:58 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:16:59 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:17:03 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:17:08 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:17:13 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:17:15 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:17:17 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:17:18 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:17:19 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:17:21 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:17:21 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75176) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 16:17:23 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 16:17:24 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:17:25 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:17:25 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Starting heal instance info cache {{(pid=75176) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 16:17:25 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Rebuilding the list of instances to heal {{(pid=75176) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 16:17:25 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Didn't find any instances for network info cache update. {{(pid=75176) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 28 16:17:25 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:17:28 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:17:29 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:17:32 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:17:32 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:17:32 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:17:32 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:17:32 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Auditing locally available compute resources for user (node: user) {{(pid=75176) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 16:17:33 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 16:17:33 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 16:17:33 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Hypervisor/Node resource view: name=user free_ram=9202MB free_disk=25.074337005615234GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75176) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 16:17:33 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:17:33 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:17:33 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75176) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 16:17:33 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75176) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 16:17:33 user nova-compute[75176]: DEBUG nova.compute.provider_tree [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Inventory has not changed in ProviderTree for provider: b37848d8-f401-4155-a029-b0ffa09ff85b {{(pid=75176) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 16:17:33 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Inventory has not changed for provider b37848d8-f401-4155-a029-b0ffa09ff85b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75176) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 16:17:33 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Compute_service record updated for user:user {{(pid=75176) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 16:17:33 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.121s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:17:33 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 16:17:38 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 16:17:40 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:17:42 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:17:43 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:17:45 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:17:45 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:17:48 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:17:50 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:17:50 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:17:52 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:17:53 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:17:55 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:17:58 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:17:59 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-e876c1cb-0943-4f4a-93a8-e06407ad7916 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Acquiring lock "4f1d73b0-4c94-47f4-87e0-1546057dbcc6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:17:59 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-e876c1cb-0943-4f4a-93a8-e06407ad7916 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Lock "4f1d73b0-4c94-47f4-87e0-1546057dbcc6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:17:59 user nova-compute[75176]: DEBUG nova.compute.manager [None req-e876c1cb-0943-4f4a-93a8-e06407ad7916 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] [instance: 4f1d73b0-4c94-47f4-87e0-1546057dbcc6] Starting instance... {{(pid=75176) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 16:17:59 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-e876c1cb-0943-4f4a-93a8-e06407ad7916 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:17:59 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-e876c1cb-0943-4f4a-93a8-e06407ad7916 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:17:59 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-e876c1cb-0943-4f4a-93a8-e06407ad7916 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75176) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 16:17:59 user nova-compute[75176]: INFO nova.compute.claims [None req-e876c1cb-0943-4f4a-93a8-e06407ad7916 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] [instance: 4f1d73b0-4c94-47f4-87e0-1546057dbcc6] Claim successful on node user
Nov 28 16:18:00 user nova-compute[75176]: DEBUG nova.compute.provider_tree [None req-e876c1cb-0943-4f4a-93a8-e06407ad7916 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Inventory has not changed in ProviderTree for provider: b37848d8-f401-4155-a029-b0ffa09ff85b {{(pid=75176) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 16:18:00 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:18:00 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-e876c1cb-0943-4f4a-93a8-e06407ad7916 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Inventory has not changed for provider b37848d8-f401-4155-a029-b0ffa09ff85b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75176) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 16:18:00 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-e876c1cb-0943-4f4a-93a8-e06407ad7916 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.316s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:18:00 user nova-compute[75176]: DEBUG nova.compute.manager [None req-e876c1cb-0943-4f4a-93a8-e06407ad7916 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] [instance: 4f1d73b0-4c94-47f4-87e0-1546057dbcc6] Start building networks asynchronously for instance. {{(pid=75176) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 16:18:00 user nova-compute[75176]: DEBUG nova.compute.manager [None req-e876c1cb-0943-4f4a-93a8-e06407ad7916 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] [instance: 4f1d73b0-4c94-47f4-87e0-1546057dbcc6] Allocating IP information in the background. {{(pid=75176) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 16:18:00 user nova-compute[75176]: DEBUG nova.network.neutron [None req-e876c1cb-0943-4f4a-93a8-e06407ad7916 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] [instance: 4f1d73b0-4c94-47f4-87e0-1546057dbcc6] allocate_for_instance() {{(pid=75176) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 16:18:00 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-e876c1cb-0943-4f4a-93a8-e06407ad7916 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] [instance: 4f1d73b0-4c94-47f4-87e0-1546057dbcc6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 16:18:00 user nova-compute[75176]: DEBUG nova.compute.manager [None req-e876c1cb-0943-4f4a-93a8-e06407ad7916 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] [instance: 4f1d73b0-4c94-47f4-87e0-1546057dbcc6] Start building block device mappings for instance. {{(pid=75176) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 16:18:00 user nova-compute[75176]: DEBUG nova.policy [None req-e876c1cb-0943-4f4a-93a8-e06407ad7916 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9fe189a399c8497bb103dc79495444a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0061e3132e644211b0b252d75eca3cda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75176) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 16:18:00 user nova-compute[75176]: DEBUG nova.compute.manager [None req-e876c1cb-0943-4f4a-93a8-e06407ad7916 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] [instance: 4f1d73b0-4c94-47f4-87e0-1546057dbcc6] Start spawning the instance on the hypervisor. {{(pid=75176) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 16:18:00 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-e876c1cb-0943-4f4a-93a8-e06407ad7916 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] [instance: 4f1d73b0-4c94-47f4-87e0-1546057dbcc6] Creating instance directory {{(pid=75176) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 16:18:00 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-e876c1cb-0943-4f4a-93a8-e06407ad7916 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] [instance: 4f1d73b0-4c94-47f4-87e0-1546057dbcc6] Creating image(s)
Nov 28 16:18:00 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-e876c1cb-0943-4f4a-93a8-e06407ad7916 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Acquiring lock "/opt/stack/data/nova/instances/4f1d73b0-4c94-47f4-87e0-1546057dbcc6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:18:00 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-e876c1cb-0943-4f4a-93a8-e06407ad7916 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Lock "/opt/stack/data/nova/instances/4f1d73b0-4c94-47f4-87e0-1546057dbcc6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:18:00 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-e876c1cb-0943-4f4a-93a8-e06407ad7916 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Lock "/opt/stack/data/nova/instances/4f1d73b0-4c94-47f4-87e0-1546057dbcc6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.010s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:18:00 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-e876c1cb-0943-4f4a-93a8-e06407ad7916 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:18:00 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-e876c1cb-0943-4f4a-93a8-e06407ad7916 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json" returned: 0 in 0.219s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:18:00 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-e876c1cb-0943-4f4a-93a8-e06407ad7916 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Acquiring lock "5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:18:00 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-e876c1cb-0943-4f4a-93a8-e06407ad7916 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Lock "5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:18:00 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-e876c1cb-0943-4f4a-93a8-e06407ad7916 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:18:01 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-e876c1cb-0943-4f4a-93a8-e06407ad7916 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json" returned: 0 in 0.204s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:18:01 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-e876c1cb-0943-4f4a-93a8-e06407ad7916 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2,backing_fmt=raw /opt/stack/data/nova/instances/4f1d73b0-4c94-47f4-87e0-1546057dbcc6/disk 1073741824 {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:18:01 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-e876c1cb-0943-4f4a-93a8-e06407ad7916 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2,backing_fmt=raw /opt/stack/data/nova/instances/4f1d73b0-4c94-47f4-87e0-1546057dbcc6/disk 1073741824" returned: 0 in 0.065s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:18:01 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-e876c1cb-0943-4f4a-93a8-e06407ad7916 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Lock "5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.276s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:18:01 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-e876c1cb-0943-4f4a-93a8-e06407ad7916 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:18:01 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-e876c1cb-0943-4f4a-93a8-e06407ad7916 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dd40f62511b7ef21e7e601187c5f46c9e7ef2f2 --force-share --output=json" returned: 0 in 0.200s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:18:01 user nova-compute[75176]: DEBUG nova.virt.disk.api [None req-e876c1cb-0943-4f4a-93a8-e06407ad7916 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4f1d73b0-4c94-47f4-87e0-1546057dbcc6/disk. size=1073741824 {{(pid=75176) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 16:18:01 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-e876c1cb-0943-4f4a-93a8-e06407ad7916 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f1d73b0-4c94-47f4-87e0-1546057dbcc6/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:18:01 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:18:01 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-e876c1cb-0943-4f4a-93a8-e06407ad7916 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f1d73b0-4c94-47f4-87e0-1546057dbcc6/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:18:01 user nova-compute[75176]: DEBUG nova.virt.disk.api [None req-e876c1cb-0943-4f4a-93a8-e06407ad7916 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Cannot resize image /opt/stack/data/nova/instances/4f1d73b0-4c94-47f4-87e0-1546057dbcc6/disk to a smaller size. {{(pid=75176) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 16:18:01 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-e876c1cb-0943-4f4a-93a8-e06407ad7916 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] [instance: 4f1d73b0-4c94-47f4-87e0-1546057dbcc6] Created local disks {{(pid=75176) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 16:18:01 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-e876c1cb-0943-4f4a-93a8-e06407ad7916 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] [instance: 4f1d73b0-4c94-47f4-87e0-1546057dbcc6] Ensure instance console log exists: /opt/stack/data/nova/instances/4f1d73b0-4c94-47f4-87e0-1546057dbcc6/console.log {{(pid=75176) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 16:18:01 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-e876c1cb-0943-4f4a-93a8-e06407ad7916 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:18:01 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-e876c1cb-0943-4f4a-93a8-e06407ad7916 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:18:01 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-e876c1cb-0943-4f4a-93a8-e06407ad7916 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:18:01 user nova-compute[75176]: DEBUG nova.network.neutron [None req-e876c1cb-0943-4f4a-93a8-e06407ad7916 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] [instance: 4f1d73b0-4c94-47f4-87e0-1546057dbcc6] Successfully created port: 8e18e2a6-ee7e-4be2-8ffc-9b1c0c19c14f {{(pid=75176) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 16:18:02 user nova-compute[75176]: DEBUG nova.network.neutron [None req-e876c1cb-0943-4f4a-93a8-e06407ad7916 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] [instance: 4f1d73b0-4c94-47f4-87e0-1546057dbcc6] Successfully updated port: 8e18e2a6-ee7e-4be2-8ffc-9b1c0c19c14f {{(pid=75176) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 16:18:02 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-e876c1cb-0943-4f4a-93a8-e06407ad7916 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Acquiring lock "refresh_cache-4f1d73b0-4c94-47f4-87e0-1546057dbcc6" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 16:18:02 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-e876c1cb-0943-4f4a-93a8-e06407ad7916 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Acquired lock "refresh_cache-4f1d73b0-4c94-47f4-87e0-1546057dbcc6" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 16:18:02 user nova-compute[75176]: DEBUG nova.network.neutron [None req-e876c1cb-0943-4f4a-93a8-e06407ad7916 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] [instance: 4f1d73b0-4c94-47f4-87e0-1546057dbcc6] Building network info cache for instance {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 16:18:02 user nova-compute[75176]: DEBUG nova.network.neutron [None req-e876c1cb-0943-4f4a-93a8-e06407ad7916 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] [instance: 4f1d73b0-4c94-47f4-87e0-1546057dbcc6] Instance cache missing network info. {{(pid=75176) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 16:18:02 user nova-compute[75176]: DEBUG nova.compute.manager [req-ee2da912-2d8d-4408-87cc-944342f8b547 req-042394e2-c8db-4d68-84fc-09f0c28c3a64 service nova] [instance: 4f1d73b0-4c94-47f4-87e0-1546057dbcc6] Received event network-changed-8e18e2a6-ee7e-4be2-8ffc-9b1c0c19c14f {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 16:18:02 user nova-compute[75176]: DEBUG nova.compute.manager [req-ee2da912-2d8d-4408-87cc-944342f8b547 req-042394e2-c8db-4d68-84fc-09f0c28c3a64 service nova] [instance: 4f1d73b0-4c94-47f4-87e0-1546057dbcc6] Refreshing instance network info cache due to event network-changed-8e18e2a6-ee7e-4be2-8ffc-9b1c0c19c14f. {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 16:18:02 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-ee2da912-2d8d-4408-87cc-944342f8b547 req-042394e2-c8db-4d68-84fc-09f0c28c3a64 service nova] Acquiring lock "refresh_cache-4f1d73b0-4c94-47f4-87e0-1546057dbcc6" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 16:18:03 user nova-compute[75176]: DEBUG nova.network.neutron [None req-e876c1cb-0943-4f4a-93a8-e06407ad7916 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] [instance: 4f1d73b0-4c94-47f4-87e0-1546057dbcc6] Updating instance_info_cache with network_info: [{"id": "8e18e2a6-ee7e-4be2-8ffc-9b1c0c19c14f", "address": "fa:16:3e:be:c4:32", "network": {"id": "a7e97163-1481-4c1e-a7f0-8337451faa28", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-75224014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0061e3132e644211b0b252d75eca3cda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e18e2a6-ee", "ovs_interfaceid": "8e18e2a6-ee7e-4be2-8ffc-9b1c0c19c14f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 16:18:03 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-e876c1cb-0943-4f4a-93a8-e06407ad7916 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Releasing lock "refresh_cache-4f1d73b0-4c94-47f4-87e0-1546057dbcc6" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 16:18:03 user nova-compute[75176]: DEBUG nova.compute.manager [None req-e876c1cb-0943-4f4a-93a8-e06407ad7916 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] [instance: 4f1d73b0-4c94-47f4-87e0-1546057dbcc6] Instance network_info: |[{"id": "8e18e2a6-ee7e-4be2-8ffc-9b1c0c19c14f", "address": "fa:16:3e:be:c4:32", "network": {"id": "a7e97163-1481-4c1e-a7f0-8337451faa28", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-75224014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0061e3132e644211b0b252d75eca3cda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e18e2a6-ee", "ovs_interfaceid": "8e18e2a6-ee7e-4be2-8ffc-9b1c0c19c14f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75176) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 16:18:03 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-ee2da912-2d8d-4408-87cc-944342f8b547 req-042394e2-c8db-4d68-84fc-09f0c28c3a64 service nova] Acquired lock "refresh_cache-4f1d73b0-4c94-47f4-87e0-1546057dbcc6" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 16:18:03 user nova-compute[75176]: DEBUG nova.network.neutron [req-ee2da912-2d8d-4408-87cc-944342f8b547 req-042394e2-c8db-4d68-84fc-09f0c28c3a64 service nova] [instance: 4f1d73b0-4c94-47f4-87e0-1546057dbcc6] Refreshing network info cache for port 8e18e2a6-ee7e-4be2-8ffc-9b1c0c19c14f {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 16:18:03 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-e876c1cb-0943-4f4a-93a8-e06407ad7916 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] [instance: 4f1d73b0-4c94-47f4-87e0-1546057dbcc6] Start _get_guest_xml network_info=[{"id": "8e18e2a6-ee7e-4be2-8ffc-9b1c0c19c14f", "address": "fa:16:3e:be:c4:32", "network": {"id": "a7e97163-1481-4c1e-a7f0-8337451faa28", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-75224014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0061e3132e644211b0b252d75eca3cda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e18e2a6-ee", "ovs_interfaceid": "8e18e2a6-ee7e-4be2-8ffc-9b1c0c19c14f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T15:35:12Z,direct_url=<?>,disk_format='qcow2',id=1f41819e-c93f-4dc7-b253-37a27bbbbc74,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1b91c5d0672c4224a48df2e1f92688e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T15:35:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'size': 0, 'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'image_id': '1f41819e-c93f-4dc7-b253-37a27bbbbc74'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75176) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 16:18:03 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-e876c1cb-0943-4f4a-93a8-e06407ad7916 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 16:18:03 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-e876c1cb-0943-4f4a-93a8-e06407ad7916 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 16:18:03 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-e876c1cb-0943-4f4a-93a8-e06407ad7916 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75176) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 16:18:03 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-e876c1cb-0943-4f4a-93a8-e06407ad7916 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] CPU controller missing on host. {{(pid=75176) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 16:18:03 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-e876c1cb-0943-4f4a-93a8-e06407ad7916 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75176) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 16:18:03 user nova-compute[75176]: DEBUG nova.virt.libvirt.host [None req-e876c1cb-0943-4f4a-93a8-e06407ad7916 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] CPU controller found on host. {{(pid=75176) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 16:18:03 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-e876c1cb-0943-4f4a-93a8-e06407ad7916 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75176) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 16:18:03 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-e876c1cb-0943-4f4a-93a8-e06407ad7916 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T15:35:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T15:35:12Z,direct_url=<?>,disk_format='qcow2',id=1f41819e-c93f-4dc7-b253-37a27bbbbc74,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1b91c5d0672c4224a48df2e1f92688e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T15:35:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 16:18:03 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-e876c1cb-0943-4f4a-93a8-e06407ad7916 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Flavor limits 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 16:18:03 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-e876c1cb-0943-4f4a-93a8-e06407ad7916 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Image limits 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 16:18:03 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-e876c1cb-0943-4f4a-93a8-e06407ad7916 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Flavor pref 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 16:18:03 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-e876c1cb-0943-4f4a-93a8-e06407ad7916 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Image pref 0:0:0 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 16:18:03 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-e876c1cb-0943-4f4a-93a8-e06407ad7916 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 16:18:03 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-e876c1cb-0943-4f4a-93a8-e06407ad7916 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 16:18:03 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-e876c1cb-0943-4f4a-93a8-e06407ad7916 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75176) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 16:18:03 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-e876c1cb-0943-4f4a-93a8-e06407ad7916 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Got 1 possible topologies {{(pid=75176) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 16:18:03 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-e876c1cb-0943-4f4a-93a8-e06407ad7916 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 16:18:03 user nova-compute[75176]: DEBUG nova.virt.hardware [None req-e876c1cb-0943-4f4a-93a8-e06407ad7916 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75176) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 16:18:03 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-e876c1cb-0943-4f4a-93a8-e06407ad7916 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T16:17:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1339573268',display_name='tempest-SnapshotDataIntegrityTests-server-1339573268',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1339573268',id=53,image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMzzLzTSk0Cc5meX1dIbW+y9p1qp4f4l8VNGcCuHp/NhVw+DKI5Z6ODe5hOV0ijx+y0NxoTd4H/KowKErZ9rwm0urBBVgo0DUaIA1rL/wuORowHZEpeAGAdwnobJ2ijYrQ==',key_name='tempest-keypair-484651644',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0061e3132e644211b0b252d75eca3cda',ramdisk_id='',reservation_id='r-s7p71i5n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-317674187',owner_user_name='tempest-SnapshotDataIntegrityTests-317674187-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T16:18:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9fe189a399c8497bb103dc79495444a4',uuid=4f1d73b0-4c94-47f4-87e0-1546057dbcc6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8e18e2a6-ee7e-4be2-8ffc-9b1c0c19c14f", "address": "fa:16:3e:be:c4:32", "network": {"id": "a7e97163-1481-4c1e-a7f0-8337451faa28", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-75224014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0061e3132e644211b0b252d75eca3cda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e18e2a6-ee", "ovs_interfaceid": "8e18e2a6-ee7e-4be2-8ffc-9b1c0c19c14f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75176) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 16:18:03 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-e876c1cb-0943-4f4a-93a8-e06407ad7916 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Converting VIF {"id": "8e18e2a6-ee7e-4be2-8ffc-9b1c0c19c14f", "address": "fa:16:3e:be:c4:32", "network": {"id": "a7e97163-1481-4c1e-a7f0-8337451faa28", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-75224014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0061e3132e644211b0b252d75eca3cda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e18e2a6-ee", "ovs_interfaceid": "8e18e2a6-ee7e-4be2-8ffc-9b1c0c19c14f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 16:18:03 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-e876c1cb-0943-4f4a-93a8-e06407ad7916 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:c4:32,bridge_name='br-int',has_traffic_filtering=True,id=8e18e2a6-ee7e-4be2-8ffc-9b1c0c19c14f,network=Network(a7e97163-1481-4c1e-a7f0-8337451faa28),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e18e2a6-ee') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 16:18:03 user nova-compute[75176]: DEBUG nova.objects.instance [None req-e876c1cb-0943-4f4a-93a8-e06407ad7916 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Lazy-loading 'pci_devices' on Instance uuid 4f1d73b0-4c94-47f4-87e0-1546057dbcc6 {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 16:18:03 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-e876c1cb-0943-4f4a-93a8-e06407ad7916 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] [instance: 4f1d73b0-4c94-47f4-87e0-1546057dbcc6] End _get_guest_xml xml=<domain type="kvm">
Nov 28 16:18:03 user nova-compute[75176]:   <uuid>4f1d73b0-4c94-47f4-87e0-1546057dbcc6</uuid>
Nov 28 16:18:03 user nova-compute[75176]:   <name>instance-00000035</name>
Nov 28 16:18:03 user nova-compute[75176]:   <memory>524288</memory>
Nov 28 16:18:03 user nova-compute[75176]:   <vcpu>1</vcpu>
Nov 28 16:18:03 user nova-compute[75176]:   <metadata>
Nov 28 16:18:03 user nova-compute[75176]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 16:18:03 user nova-compute[75176]:       <nova:package version="0.0.0"/>
Nov 28 16:18:03 user nova-compute[75176]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1339573268</nova:name>
Nov 28 16:18:03 user nova-compute[75176]:       <nova:creationTime>2023-11-28 16:18:03</nova:creationTime>
Nov 28 16:18:03 user nova-compute[75176]:       <nova:flavor name="m1.tiny">
Nov 28 16:18:03 user nova-compute[75176]:         <nova:memory>512</nova:memory>
Nov 28 16:18:03 user nova-compute[75176]:         <nova:disk>1</nova:disk>
Nov 28 16:18:03 user nova-compute[75176]:         <nova:swap>0</nova:swap>
Nov 28 16:18:03 user nova-compute[75176]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 16:18:03 user nova-compute[75176]:         <nova:vcpus>1</nova:vcpus>
Nov 28 16:18:03 user nova-compute[75176]:       </nova:flavor>
Nov 28 16:18:03 user nova-compute[75176]:       <nova:owner>
Nov 28 16:18:03 user nova-compute[75176]:         <nova:user uuid="9fe189a399c8497bb103dc79495444a4">tempest-SnapshotDataIntegrityTests-317674187-project-member</nova:user>
Nov 28 16:18:03 user nova-compute[75176]:         <nova:project uuid="0061e3132e644211b0b252d75eca3cda">tempest-SnapshotDataIntegrityTests-317674187</nova:project>
Nov 28 16:18:03 user nova-compute[75176]:       </nova:owner>
Nov 28 16:18:03 user nova-compute[75176]:       <nova:root type="image" uuid="1f41819e-c93f-4dc7-b253-37a27bbbbc74"/>
Nov 28 16:18:03 user nova-compute[75176]:       <nova:ports>
Nov 28 16:18:03 user nova-compute[75176]:         <nova:port uuid="8e18e2a6-ee7e-4be2-8ffc-9b1c0c19c14f">
Nov 28 16:18:03 user nova-compute[75176]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 28 16:18:03 user nova-compute[75176]:         </nova:port>
Nov 28 16:18:03 user nova-compute[75176]:       </nova:ports>
Nov 28 16:18:03 user nova-compute[75176]:     </nova:instance>
Nov 28 16:18:03 user nova-compute[75176]:   </metadata>
Nov 28 16:18:03 user nova-compute[75176]:   <sysinfo type="smbios">
Nov 28 16:18:03 user nova-compute[75176]:     <system>
Nov 28 16:18:03 user nova-compute[75176]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 16:18:03 user nova-compute[75176]:       <entry name="product">OpenStack Nova</entry>
Nov 28 16:18:03 user nova-compute[75176]:       <entry name="version">0.0.0</entry>
Nov 28 16:18:03 user nova-compute[75176]:       <entry name="serial">4f1d73b0-4c94-47f4-87e0-1546057dbcc6</entry>
Nov 28 16:18:03 user nova-compute[75176]:       <entry name="uuid">4f1d73b0-4c94-47f4-87e0-1546057dbcc6</entry>
Nov 28 16:18:03 user nova-compute[75176]:       <entry name="family">Virtual Machine</entry>
Nov 28 16:18:03 user nova-compute[75176]:     </system>
Nov 28 16:18:03 user nova-compute[75176]:   </sysinfo>
Nov 28 16:18:03 user nova-compute[75176]:   <os>
Nov 28 16:18:03 user nova-compute[75176]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 16:18:03 user nova-compute[75176]:     <boot dev="hd"/>
Nov 28 16:18:03 user nova-compute[75176]:     <smbios mode="sysinfo"/>
Nov 28 16:18:03 user nova-compute[75176]:   </os>
Nov 28 16:18:03 user nova-compute[75176]:   <features>
Nov 28 16:18:03 user nova-compute[75176]:     <acpi/>
Nov 28 16:18:03 user nova-compute[75176]:     <apic/>
Nov 28 16:18:03 user nova-compute[75176]:     <vmcoreinfo/>
Nov 28 16:18:03 user nova-compute[75176]:   </features>
Nov 28 16:18:03 user nova-compute[75176]:   <clock offset="utc">
Nov 28 16:18:03 user nova-compute[75176]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 16:18:03 user nova-compute[75176]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 16:18:03 user nova-compute[75176]:     <timer name="hpet" present="no"/>
Nov 28 16:18:03 user nova-compute[75176]:   </clock>
Nov 28 16:18:03 user nova-compute[75176]:   <cpu mode="custom" match="exact">
Nov 28 16:18:03 user nova-compute[75176]:     <model>Nehalem</model>
Nov 28 16:18:03 user nova-compute[75176]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 16:18:03 user nova-compute[75176]:   </cpu>
Nov 28 16:18:03 user nova-compute[75176]:   <devices>
Nov 28 16:18:03 user nova-compute[75176]:     <disk type="file" device="disk">
Nov 28 16:18:03 user nova-compute[75176]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 16:18:03 user nova-compute[75176]:       <source file="/opt/stack/data/nova/instances/4f1d73b0-4c94-47f4-87e0-1546057dbcc6/disk"/>
Nov 28 16:18:03 user nova-compute[75176]:       <target dev="vda" bus="virtio"/>
Nov 28 16:18:03 user nova-compute[75176]:     </disk>
Nov 28 16:18:03 user nova-compute[75176]:     <interface type="ethernet">
Nov 28 16:18:03 user nova-compute[75176]:       <mac address="fa:16:3e:be:c4:32"/>
Nov 28 16:18:03 user nova-compute[75176]:       <model type="virtio"/>
Nov 28 16:18:03 user nova-compute[75176]:       <mtu size="1442"/>
Nov 28 16:18:03 user nova-compute[75176]:       <target dev="tap8e18e2a6-ee"/>
Nov 28 16:18:03 user nova-compute[75176]:     </interface>
Nov 28 16:18:03 user nova-compute[75176]:     <serial type="pty">
Nov 28 16:18:03 user nova-compute[75176]:       <log file="/opt/stack/data/nova/instances/4f1d73b0-4c94-47f4-87e0-1546057dbcc6/console.log" append="off"/>
Nov 28 16:18:03 user nova-compute[75176]:     </serial>
Nov 28 16:18:03 user nova-compute[75176]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 16:18:03 user nova-compute[75176]:     <video>
Nov 28 16:18:03 user nova-compute[75176]:       <model type="virtio"/>
Nov 28 16:18:03 user nova-compute[75176]:     </video>
Nov 28 16:18:03 user nova-compute[75176]:     <rng model="virtio">
Nov 28 16:18:03 user nova-compute[75176]:       <backend model="random">/dev/urandom</backend>
Nov 28 16:18:03 user nova-compute[75176]:     </rng>
Nov 28 16:18:03 user nova-compute[75176]:     <controller type="usb" index="0" model="none"/>
Nov 28 16:18:03 user nova-compute[75176]:     <memballoon model="virtio">
Nov 28 16:18:03 user nova-compute[75176]:       <stats period="10"/>
Nov 28 16:18:03 user nova-compute[75176]:     </memballoon>
Nov 28 16:18:03 user nova-compute[75176]:   </devices>
Nov 28 16:18:03 user nova-compute[75176]: </domain>
Nov 28 16:18:03 user nova-compute[75176]:  {{(pid=75176) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 16:18:03 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-e876c1cb-0943-4f4a-93a8-e06407ad7916 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T16:17:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1339573268',display_name='tempest-SnapshotDataIntegrityTests-server-1339573268',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1339573268',id=53,image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMzzLzTSk0Cc5meX1dIbW+y9p1qp4f4l8VNGcCuHp/NhVw+DKI5Z6ODe5hOV0ijx+y0NxoTd4H/KowKErZ9rwm0urBBVgo0DUaIA1rL/wuORowHZEpeAGAdwnobJ2ijYrQ==',key_name='tempest-keypair-484651644',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0061e3132e644211b0b252d75eca3cda',ramdisk_id='',reservation_id='r-s7p71i5n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-317674187',owner_user_name='tempest-SnapshotDataIntegrityTests-317674187-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T16:18:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9fe189a399c8497bb103dc79495444a4',uuid=4f1d73b0-4c94-47f4-87e0-1546057dbcc6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8e18e2a6-ee7e-4be2-8ffc-9b1c0c19c14f", "address": "fa:16:3e:be:c4:32", "network": {"id": "a7e97163-1481-4c1e-a7f0-8337451faa28", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-75224014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0061e3132e644211b0b252d75eca3cda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e18e2a6-ee", "ovs_interfaceid": "8e18e2a6-ee7e-4be2-8ffc-9b1c0c19c14f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 16:18:03 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-e876c1cb-0943-4f4a-93a8-e06407ad7916 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Converting VIF {"id": "8e18e2a6-ee7e-4be2-8ffc-9b1c0c19c14f", "address": "fa:16:3e:be:c4:32", "network": {"id": "a7e97163-1481-4c1e-a7f0-8337451faa28", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-75224014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0061e3132e644211b0b252d75eca3cda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e18e2a6-ee", "ovs_interfaceid": "8e18e2a6-ee7e-4be2-8ffc-9b1c0c19c14f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 16:18:03 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-e876c1cb-0943-4f4a-93a8-e06407ad7916 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:c4:32,bridge_name='br-int',has_traffic_filtering=True,id=8e18e2a6-ee7e-4be2-8ffc-9b1c0c19c14f,network=Network(a7e97163-1481-4c1e-a7f0-8337451faa28),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e18e2a6-ee') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 16:18:03 user nova-compute[75176]: DEBUG os_vif [None req-e876c1cb-0943-4f4a-93a8-e06407ad7916 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:c4:32,bridge_name='br-int',has_traffic_filtering=True,id=8e18e2a6-ee7e-4be2-8ffc-9b1c0c19c14f,network=Network(a7e97163-1481-4c1e-a7f0-8337451faa28),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e18e2a6-ee') {{(pid=75176) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 16:18:03 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:18:03 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 16:18:03 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 16:18:03 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:18:03 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '27a5686c-2756-56cc-939d-2fd286fefb12', '_type': 'linux-noop'}}, row=False) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 16:18:03 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:18:03 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 16:18:03 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:18:03 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8e18e2a6-ee, may_exist=True, interface_attrs={}) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 16:18:03 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8e18e2a6-ee, col_values=(('qos', UUID('825f66f9-09d1-4f10-8628-2be606f10dda')),), if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 16:18:03 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8e18e2a6-ee, col_values=(('external_ids', {'iface-id': '8e18e2a6-ee7e-4be2-8ffc-9b1c0c19c14f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:be:c4:32', 'vm-uuid': '4f1d73b0-4c94-47f4-87e0-1546057dbcc6'}),), if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 16:18:03 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:18:03 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 16:18:03 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:18:03 user nova-compute[75176]: INFO os_vif [None req-e876c1cb-0943-4f4a-93a8-e06407ad7916 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:c4:32,bridge_name='br-int',has_traffic_filtering=True,id=8e18e2a6-ee7e-4be2-8ffc-9b1c0c19c14f,network=Network(a7e97163-1481-4c1e-a7f0-8337451faa28),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e18e2a6-ee')
Nov 28 16:18:03 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-e876c1cb-0943-4f4a-93a8-e06407ad7916 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] No BDM found with device name vda, not building metadata. {{(pid=75176) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 16:18:03 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-e876c1cb-0943-4f4a-93a8-e06407ad7916 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] No VIF found with MAC fa:16:3e:be:c4:32, not building metadata {{(pid=75176) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 16:18:03 user nova-compute[75176]: DEBUG nova.network.neutron [req-ee2da912-2d8d-4408-87cc-944342f8b547 req-042394e2-c8db-4d68-84fc-09f0c28c3a64 service nova] [instance: 4f1d73b0-4c94-47f4-87e0-1546057dbcc6] Updated VIF entry in instance network info cache for port 8e18e2a6-ee7e-4be2-8ffc-9b1c0c19c14f. {{(pid=75176) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 16:18:03 user nova-compute[75176]: DEBUG nova.network.neutron [req-ee2da912-2d8d-4408-87cc-944342f8b547 req-042394e2-c8db-4d68-84fc-09f0c28c3a64 service nova] [instance: 4f1d73b0-4c94-47f4-87e0-1546057dbcc6] Updating instance_info_cache with network_info: [{"id": "8e18e2a6-ee7e-4be2-8ffc-9b1c0c19c14f", "address": "fa:16:3e:be:c4:32", "network": {"id": "a7e97163-1481-4c1e-a7f0-8337451faa28", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-75224014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0061e3132e644211b0b252d75eca3cda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e18e2a6-ee", "ovs_interfaceid": "8e18e2a6-ee7e-4be2-8ffc-9b1c0c19c14f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 16:18:03 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-ee2da912-2d8d-4408-87cc-944342f8b547 req-042394e2-c8db-4d68-84fc-09f0c28c3a64 service nova] Releasing lock "refresh_cache-4f1d73b0-4c94-47f4-87e0-1546057dbcc6" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 16:18:04 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:18:04 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:18:04 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:18:04 user nova-compute[75176]: DEBUG nova.compute.manager [req-3284b927-3655-454a-b872-4d4591e1b295 req-edb49d80-bd7e-48d9-a154-d4cd417785e0 service nova] [instance: 4f1d73b0-4c94-47f4-87e0-1546057dbcc6] Received event network-vif-plugged-8e18e2a6-ee7e-4be2-8ffc-9b1c0c19c14f {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 16:18:04 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-3284b927-3655-454a-b872-4d4591e1b295 req-edb49d80-bd7e-48d9-a154-d4cd417785e0 service nova] Acquiring lock "4f1d73b0-4c94-47f4-87e0-1546057dbcc6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:18:04 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-3284b927-3655-454a-b872-4d4591e1b295 req-edb49d80-bd7e-48d9-a154-d4cd417785e0 service nova] Lock "4f1d73b0-4c94-47f4-87e0-1546057dbcc6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:18:04 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-3284b927-3655-454a-b872-4d4591e1b295 req-edb49d80-bd7e-48d9-a154-d4cd417785e0 service nova] Lock "4f1d73b0-4c94-47f4-87e0-1546057dbcc6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:18:04 user nova-compute[75176]: DEBUG nova.compute.manager [req-3284b927-3655-454a-b872-4d4591e1b295 req-edb49d80-bd7e-48d9-a154-d4cd417785e0 service nova] [instance: 4f1d73b0-4c94-47f4-87e0-1546057dbcc6] No waiting events found dispatching network-vif-plugged-8e18e2a6-ee7e-4be2-8ffc-9b1c0c19c14f {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 16:18:04 user nova-compute[75176]: WARNING nova.compute.manager [req-3284b927-3655-454a-b872-4d4591e1b295 req-edb49d80-bd7e-48d9-a154-d4cd417785e0 service nova] [instance: 4f1d73b0-4c94-47f4-87e0-1546057dbcc6] Received unexpected event network-vif-plugged-8e18e2a6-ee7e-4be2-8ffc-9b1c0c19c14f for instance with vm_state building and task_state spawning.
Nov 28 16:18:05 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:18:05 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:18:05 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:18:06 user nova-compute[75176]: DEBUG nova.compute.manager [req-8c33b7d7-0564-473c-9b40-d64e84c20e81 req-e57f6dd4-35ca-4c30-abf8-a0c0945c96b9 service nova] [instance: 4f1d73b0-4c94-47f4-87e0-1546057dbcc6] Received event network-vif-plugged-8e18e2a6-ee7e-4be2-8ffc-9b1c0c19c14f {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 16:18:06 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-8c33b7d7-0564-473c-9b40-d64e84c20e81 req-e57f6dd4-35ca-4c30-abf8-a0c0945c96b9 service nova] Acquiring lock "4f1d73b0-4c94-47f4-87e0-1546057dbcc6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:18:06 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-8c33b7d7-0564-473c-9b40-d64e84c20e81 req-e57f6dd4-35ca-4c30-abf8-a0c0945c96b9 service nova] Lock "4f1d73b0-4c94-47f4-87e0-1546057dbcc6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:18:06 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-8c33b7d7-0564-473c-9b40-d64e84c20e81 req-e57f6dd4-35ca-4c30-abf8-a0c0945c96b9 service nova] Lock "4f1d73b0-4c94-47f4-87e0-1546057dbcc6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:18:06 user nova-compute[75176]: DEBUG nova.compute.manager [req-8c33b7d7-0564-473c-9b40-d64e84c20e81 req-e57f6dd4-35ca-4c30-abf8-a0c0945c96b9 service nova] [instance: 4f1d73b0-4c94-47f4-87e0-1546057dbcc6] No waiting events found dispatching network-vif-plugged-8e18e2a6-ee7e-4be2-8ffc-9b1c0c19c14f {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 16:18:06 user nova-compute[75176]: WARNING nova.compute.manager [req-8c33b7d7-0564-473c-9b40-d64e84c20e81 req-e57f6dd4-35ca-4c30-abf8-a0c0945c96b9 service nova] [instance: 4f1d73b0-4c94-47f4-87e0-1546057dbcc6] Received unexpected event network-vif-plugged-8e18e2a6-ee7e-4be2-8ffc-9b1c0c19c14f for instance with vm_state building and task_state spawning.
Nov 28 16:18:07 user nova-compute[75176]: DEBUG nova.compute.manager [None req-e876c1cb-0943-4f4a-93a8-e06407ad7916 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] [instance: 4f1d73b0-4c94-47f4-87e0-1546057dbcc6] Instance event wait completed in 0 seconds for  {{(pid=75176) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 16:18:07 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-e876c1cb-0943-4f4a-93a8-e06407ad7916 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] [instance: 4f1d73b0-4c94-47f4-87e0-1546057dbcc6] Guest created on hypervisor {{(pid=75176) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 16:18:07 user nova-compute[75176]: INFO nova.virt.libvirt.driver [-] [instance: 4f1d73b0-4c94-47f4-87e0-1546057dbcc6] Instance spawned successfully.
Nov 28 16:18:07 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-e876c1cb-0943-4f4a-93a8-e06407ad7916 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] [instance: 4f1d73b0-4c94-47f4-87e0-1546057dbcc6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 16:18:07 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-e876c1cb-0943-4f4a-93a8-e06407ad7916 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] [instance: 4f1d73b0-4c94-47f4-87e0-1546057dbcc6] Found default for hw_cdrom_bus of ide {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 16:18:07 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-e876c1cb-0943-4f4a-93a8-e06407ad7916 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] [instance: 4f1d73b0-4c94-47f4-87e0-1546057dbcc6] Found default for hw_disk_bus of virtio {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 16:18:07 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-e876c1cb-0943-4f4a-93a8-e06407ad7916 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] [instance: 4f1d73b0-4c94-47f4-87e0-1546057dbcc6] Found default for hw_input_bus of None {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 16:18:07 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-e876c1cb-0943-4f4a-93a8-e06407ad7916 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] [instance: 4f1d73b0-4c94-47f4-87e0-1546057dbcc6] Found default for hw_pointer_model of None {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 16:18:07 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-e876c1cb-0943-4f4a-93a8-e06407ad7916 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] [instance: 4f1d73b0-4c94-47f4-87e0-1546057dbcc6] Found default for hw_video_model of virtio {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 16:18:07 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-e876c1cb-0943-4f4a-93a8-e06407ad7916 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] [instance: 4f1d73b0-4c94-47f4-87e0-1546057dbcc6] Found default for hw_vif_model of virtio {{(pid=75176) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 16:18:07 user nova-compute[75176]: INFO nova.compute.manager [None req-e876c1cb-0943-4f4a-93a8-e06407ad7916 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] [instance: 4f1d73b0-4c94-47f4-87e0-1546057dbcc6] Took 7.00 seconds to spawn the instance on the hypervisor.
Nov 28 16:18:07 user nova-compute[75176]: DEBUG nova.compute.manager [None req-e876c1cb-0943-4f4a-93a8-e06407ad7916 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] [instance: 4f1d73b0-4c94-47f4-87e0-1546057dbcc6] Checking state {{(pid=75176) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 16:18:07 user nova-compute[75176]: INFO nova.compute.manager [None req-e876c1cb-0943-4f4a-93a8-e06407ad7916 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] [instance: 4f1d73b0-4c94-47f4-87e0-1546057dbcc6] Took 7.98 seconds to build instance.
Nov 28 16:18:07 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-e876c1cb-0943-4f4a-93a8-e06407ad7916 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Lock "4f1d73b0-4c94-47f4-87e0-1546057dbcc6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.082s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:18:08 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:18:10 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:18:13 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:18:15 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:18:15 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:18:18 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:18:18 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:18:19 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:18:22 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:18:22 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75176) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 16:18:23 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 16:18:23 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:18:23 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75176) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 16:18:23 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75176) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 16:18:23 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75176) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 16:18:23 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:18:25 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:18:25 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:18:26 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:18:27 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:18:27 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Starting heal instance info cache {{(pid=75176) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 16:18:27 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Rebuilding the list of instances to heal {{(pid=75176) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 16:18:27 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquiring lock "refresh_cache-4f1d73b0-4c94-47f4-87e0-1546057dbcc6" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 16:18:27 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquired lock "refresh_cache-4f1d73b0-4c94-47f4-87e0-1546057dbcc6" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 16:18:27 user nova-compute[75176]: DEBUG nova.network.neutron [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] [instance: 4f1d73b0-4c94-47f4-87e0-1546057dbcc6] Forcefully refreshing network info cache for instance {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 16:18:27 user nova-compute[75176]: DEBUG nova.objects.instance [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lazy-loading 'info_cache' on Instance uuid 4f1d73b0-4c94-47f4-87e0-1546057dbcc6 {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 16:18:28 user nova-compute[75176]: DEBUG nova.network.neutron [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] [instance: 4f1d73b0-4c94-47f4-87e0-1546057dbcc6] Updating instance_info_cache with network_info: [{"id": "8e18e2a6-ee7e-4be2-8ffc-9b1c0c19c14f", "address": "fa:16:3e:be:c4:32", "network": {"id": "a7e97163-1481-4c1e-a7f0-8337451faa28", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-75224014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0061e3132e644211b0b252d75eca3cda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e18e2a6-ee", "ovs_interfaceid": "8e18e2a6-ee7e-4be2-8ffc-9b1c0c19c14f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 16:18:28 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Releasing lock "refresh_cache-4f1d73b0-4c94-47f4-87e0-1546057dbcc6" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 16:18:28 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] [instance: 4f1d73b0-4c94-47f4-87e0-1546057dbcc6] Updated the network info_cache for instance {{(pid=75176) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 16:18:28 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:18:30 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:18:32 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:18:33 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:18:33 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:18:33 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:18:33 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:18:33 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:18:33 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Auditing locally available compute resources for user (node: user) {{(pid=75176) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 16:18:33 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f1d73b0-4c94-47f4-87e0-1546057dbcc6/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:18:33 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f1d73b0-4c94-47f4-87e0-1546057dbcc6/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:18:33 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f1d73b0-4c94-47f4-87e0-1546057dbcc6/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:18:34 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f1d73b0-4c94-47f4-87e0-1546057dbcc6/disk --force-share --output=json" returned: 0 in 0.255s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:18:34 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 16:18:34 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 16:18:34 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Hypervisor/Node resource view: name=user free_ram=8934MB free_disk=25.027957916259766GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75176) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 16:18:34 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:18:34 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:18:34 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance 4f1d73b0-4c94-47f4-87e0-1546057dbcc6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 16:18:34 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75176) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 16:18:34 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75176) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 16:18:34 user nova-compute[75176]: DEBUG nova.compute.provider_tree [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Inventory has not changed in ProviderTree for provider: b37848d8-f401-4155-a029-b0ffa09ff85b {{(pid=75176) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 16:18:34 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Inventory has not changed for provider b37848d8-f401-4155-a029-b0ffa09ff85b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75176) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 16:18:34 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Compute_service record updated for user:user {{(pid=75176) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 16:18:34 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.211s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:18:35 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:18:38 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:18:40 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:18:43 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:18:48 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 16:18:53 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 16:18:58 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 16:19:03 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 16:19:08 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:19:13 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:19:18 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:19:18 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:19:19 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:19:19 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:19:23 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 16:19:24 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:19:24 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75176) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 16:19:25 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:19:27 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:19:27 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Starting heal instance info cache {{(pid=75176) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 16:19:27 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Rebuilding the list of instances to heal {{(pid=75176) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 16:19:28 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquiring lock "refresh_cache-4f1d73b0-4c94-47f4-87e0-1546057dbcc6" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 16:19:28 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquired lock "refresh_cache-4f1d73b0-4c94-47f4-87e0-1546057dbcc6" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 16:19:28 user nova-compute[75176]: DEBUG nova.network.neutron [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] [instance: 4f1d73b0-4c94-47f4-87e0-1546057dbcc6] Forcefully refreshing network info cache for instance {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 16:19:28 user nova-compute[75176]: DEBUG nova.objects.instance [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lazy-loading 'info_cache' on Instance uuid 4f1d73b0-4c94-47f4-87e0-1546057dbcc6 {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 16:19:28 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 16:19:28 user nova-compute[75176]: DEBUG nova.network.neutron [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] [instance: 4f1d73b0-4c94-47f4-87e0-1546057dbcc6] Updating instance_info_cache with network_info: [{"id": "8e18e2a6-ee7e-4be2-8ffc-9b1c0c19c14f", "address": "fa:16:3e:be:c4:32", "network": {"id": "a7e97163-1481-4c1e-a7f0-8337451faa28", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-75224014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0061e3132e644211b0b252d75eca3cda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e18e2a6-ee", "ovs_interfaceid": "8e18e2a6-ee7e-4be2-8ffc-9b1c0c19c14f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 16:19:28 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Releasing lock "refresh_cache-4f1d73b0-4c94-47f4-87e0-1546057dbcc6" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 16:19:28 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] [instance: 4f1d73b0-4c94-47f4-87e0-1546057dbcc6] Updated the network info_cache for instance {{(pid=75176) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 16:19:28 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:19:33 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:19:33 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:19:33 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:19:33 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:19:33 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:19:33 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:19:33 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Auditing locally available compute resources for user (node: user) {{(pid=75176) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 16:19:33 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f1d73b0-4c94-47f4-87e0-1546057dbcc6/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:19:33 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f1d73b0-4c94-47f4-87e0-1546057dbcc6/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:19:33 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f1d73b0-4c94-47f4-87e0-1546057dbcc6/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:19:34 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f1d73b0-4c94-47f4-87e0-1546057dbcc6/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:19:34 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 16:19:34 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 16:19:34 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Hypervisor/Node resource view: name=user free_ram=9054MB free_disk=25.025524139404297GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75176) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 16:19:34 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:19:34 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:19:34 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance 4f1d73b0-4c94-47f4-87e0-1546057dbcc6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 16:19:34 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75176) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 16:19:34 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75176) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 16:19:34 user nova-compute[75176]: DEBUG nova.compute.provider_tree [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Inventory has not changed in ProviderTree for provider: b37848d8-f401-4155-a029-b0ffa09ff85b {{(pid=75176) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 16:19:34 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Inventory has not changed for provider b37848d8-f401-4155-a029-b0ffa09ff85b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75176) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 16:19:34 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Compute_service record updated for user:user {{(pid=75176) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 16:19:34 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.181s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:19:38 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:19:43 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:19:45 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:19:48 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:19:50 user nova-compute[75176]: DEBUG nova.compute.manager [req-fbf2bbb1-0b7f-4197-866a-2c77062efed1 req-145c3378-8ed6-4e17-b879-ade0c4629492 service nova] [instance: 4f1d73b0-4c94-47f4-87e0-1546057dbcc6] Received event network-changed-8e18e2a6-ee7e-4be2-8ffc-9b1c0c19c14f {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 16:19:50 user nova-compute[75176]: DEBUG nova.compute.manager [req-fbf2bbb1-0b7f-4197-866a-2c77062efed1 req-145c3378-8ed6-4e17-b879-ade0c4629492 service nova] [instance: 4f1d73b0-4c94-47f4-87e0-1546057dbcc6] Refreshing instance network info cache due to event network-changed-8e18e2a6-ee7e-4be2-8ffc-9b1c0c19c14f. {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 16:19:50 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-fbf2bbb1-0b7f-4197-866a-2c77062efed1 req-145c3378-8ed6-4e17-b879-ade0c4629492 service nova] Acquiring lock "refresh_cache-4f1d73b0-4c94-47f4-87e0-1546057dbcc6" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 16:19:50 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-fbf2bbb1-0b7f-4197-866a-2c77062efed1 req-145c3378-8ed6-4e17-b879-ade0c4629492 service nova] Acquired lock "refresh_cache-4f1d73b0-4c94-47f4-87e0-1546057dbcc6" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 16:19:50 user nova-compute[75176]: DEBUG nova.network.neutron [req-fbf2bbb1-0b7f-4197-866a-2c77062efed1 req-145c3378-8ed6-4e17-b879-ade0c4629492 service nova] [instance: 4f1d73b0-4c94-47f4-87e0-1546057dbcc6] Refreshing network info cache for port 8e18e2a6-ee7e-4be2-8ffc-9b1c0c19c14f {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 16:19:50 user nova-compute[75176]: DEBUG nova.network.neutron [req-fbf2bbb1-0b7f-4197-866a-2c77062efed1 req-145c3378-8ed6-4e17-b879-ade0c4629492 service nova] [instance: 4f1d73b0-4c94-47f4-87e0-1546057dbcc6] Updated VIF entry in instance network info cache for port 8e18e2a6-ee7e-4be2-8ffc-9b1c0c19c14f. {{(pid=75176) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 16:19:50 user nova-compute[75176]: DEBUG nova.network.neutron [req-fbf2bbb1-0b7f-4197-866a-2c77062efed1 req-145c3378-8ed6-4e17-b879-ade0c4629492 service nova] [instance: 4f1d73b0-4c94-47f4-87e0-1546057dbcc6] Updating instance_info_cache with network_info: [{"id": "8e18e2a6-ee7e-4be2-8ffc-9b1c0c19c14f", "address": "fa:16:3e:be:c4:32", "network": {"id": "a7e97163-1481-4c1e-a7f0-8337451faa28", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-75224014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0061e3132e644211b0b252d75eca3cda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e18e2a6-ee", "ovs_interfaceid": "8e18e2a6-ee7e-4be2-8ffc-9b1c0c19c14f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 16:19:50 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-fbf2bbb1-0b7f-4197-866a-2c77062efed1 req-145c3378-8ed6-4e17-b879-ade0c4629492 service nova] Releasing lock "refresh_cache-4f1d73b0-4c94-47f4-87e0-1546057dbcc6" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 16:19:53 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 16:19:53 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:19:53 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75176) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 16:19:53 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75176) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 16:19:53 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75176) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 16:19:53 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:19:54 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-c2c03603-dc44-4908-88ff-70d686851b75 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Acquiring lock "4f1d73b0-4c94-47f4-87e0-1546057dbcc6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:19:54 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-c2c03603-dc44-4908-88ff-70d686851b75 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Lock "4f1d73b0-4c94-47f4-87e0-1546057dbcc6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:19:54 user nova-compute[75176]: DEBUG nova.objects.instance [None req-c2c03603-dc44-4908-88ff-70d686851b75 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Lazy-loading 'flavor' on Instance uuid 4f1d73b0-4c94-47f4-87e0-1546057dbcc6 {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 16:19:54 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-c2c03603-dc44-4908-88ff-70d686851b75 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Lock "4f1d73b0-4c94-47f4-87e0-1546057dbcc6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:19:54 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-c2c03603-dc44-4908-88ff-70d686851b75 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Acquiring lock "4f1d73b0-4c94-47f4-87e0-1546057dbcc6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:19:54 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-c2c03603-dc44-4908-88ff-70d686851b75 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Lock "4f1d73b0-4c94-47f4-87e0-1546057dbcc6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:19:54 user nova-compute[75176]: INFO nova.compute.manager [None req-c2c03603-dc44-4908-88ff-70d686851b75 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] [instance: 4f1d73b0-4c94-47f4-87e0-1546057dbcc6] Attaching volume acc0d4a8-07ad-4813-b235-3abcc0ab70c1 to /dev/vdb
Nov 28 16:19:54 user nova-compute[75176]: DEBUG os_brick.utils [None req-c2c03603-dc44-4908-88ff-70d686851b75 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 16:19:54 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:19:54 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:19:54 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec3924c8-d5fa-4d7b-9735-abe1b352afad]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:edc924a949b2\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:19:54 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:19:54 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:19:54 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[7894d0a4-6bf4-47d9-a250-7092c557377f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:19:54 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:19:54 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:19:54 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[be61c173-2af0-4f1b-9fd4-13a747c3d1f0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:19:54 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[889883ce-f83c-4834-84e7-15f4d16e4271]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:19:54 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-c2c03603-dc44-4908-88ff-70d686851b75 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Running cmd (subprocess): nvme version {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:19:54 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-c2c03603-dc44-4908-88ff-70d686851b75 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] 'nvme version' failed. Not Retrying. {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 16:19:54 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c2c03603-dc44-4908-88ff-70d686851b75 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] nvme not present on system {{(pid=75176) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 16:19:54 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:19:54 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 16:19:54 user nova-compute[75176]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 16:19:54 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce46e219-d3b9-4c3b-944d-cf612e6a41fe]: (4, '') {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:19:54 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.lightos [None req-c2c03603-dc44-4908-88ff-70d686851b75 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75176) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 16:19:54 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.lightos [None req-c2c03603-dc44-4908-88ff-70d686851b75 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75176) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 16:19:54 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.lightos [None req-c2c03603-dc44-4908-88ff-70d686851b75 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] LIGHTOS: no hostnqn found. {{(pid=75176) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 16:19:54 user nova-compute[75176]: DEBUG os_brick.utils [None req-c2c03603-dc44-4908-88ff-70d686851b75 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:edc924a949b2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 16:19:54 user nova-compute[75176]: DEBUG nova.virt.block_device [None req-c2c03603-dc44-4908-88ff-70d686851b75 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] [instance: 4f1d73b0-4c94-47f4-87e0-1546057dbcc6] Updating existing volume attachment record: 17193579-2bef-4dd4-ad4a-70f7291e5149 {{(pid=75176) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 16:19:55 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:19:58 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:20:00 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:20:01 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c2c03603-dc44-4908-88ff-70d686851b75 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] [instance: 4f1d73b0-4c94-47f4-87e0-1546057dbcc6] Calling os-brick to attach iSCSI Volume {{(pid=75176) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 16:20:01 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2c03603-dc44-4908-88ff-70d686851b75 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c1b8a00>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:acc0d4a8-07ad-4813-b235-3abcc0ab70c1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oFMEcskf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 16:20:01 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-c2c03603-dc44-4908-88ff-70d686851b75 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 16:20:01 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-c2c03603-dc44-4908-88ff-70d686851b75 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 16:20:01 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-c2c03603-dc44-4908-88ff-70d686851b75 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 16:20:01 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-c2c03603-dc44-4908-88ff-70d686851b75 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 16:20:01 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-c2c03603-dc44-4908-88ff-70d686851b75 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:acc0d4a8-07ad-4813-b235-3abcc0ab70c1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 16:20:01 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-c2c03603-dc44-4908-88ff-70d686851b75 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:acc0d4a8-07ad-4813-b235-3abcc0ab70c1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 16:20:01 user nova-compute[75176]: INFO os_brick.initiator.connectors.iscsi [None req-c2c03603-dc44-4908-88ff-70d686851b75 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 16:20:01 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acc0d4a8-07ad-4813-b235-3abcc0ab70c1 -p 172.16.0.220:3260 {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:20:01 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acc0d4a8-07ad-4813-b235-3abcc0ab70c1 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:20:01 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[30f68c6e-4a1a-488a-93de-1dc1aeaf533c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:20:01 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2c03603-dc44-4908-88ff-70d686851b75 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 16:20:01 user nova-compute[75176]:  {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 16:20:01 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acc0d4a8-07ad-4813-b235-3abcc0ab70c1 -p 172.16.0.220:3260 --interface default --op new {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:20:01 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acc0d4a8-07ad-4813-b235-3abcc0ab70c1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:20:01 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5188b78-a8aa-40a5-9494-eb9b29a1b04a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:acc0d4a8-07ad-4813-b235-3abcc0ab70c1] added\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:20:01 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2c03603-dc44-4908-88ff-70d686851b75 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:acc0d4a8-07ad-4813-b235-3abcc0ab70c1] added
Nov 28 16:20:01 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 16:20:01 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acc0d4a8-07ad-4813-b235-3abcc0ab70c1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:20:01 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acc0d4a8-07ad-4813-b235-3abcc0ab70c1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:20:01 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[84058427-6266-4247-b7f8-fd703dbe08b8]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:20:01 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2c03603-dc44-4908-88ff-70d686851b75 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 16:20:01 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acc0d4a8-07ad-4813-b235-3abcc0ab70c1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:20:01 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acc0d4a8-07ad-4813-b235-3abcc0ab70c1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:20:01 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[15b1c3b7-fd8d-4851-bb5c-888d5a12f516]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:20:01 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2c03603-dc44-4908-88ff-70d686851b75 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 16:20:01 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acc0d4a8-07ad-4813-b235-3abcc0ab70c1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oFMEcskf {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:20:01 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acc0d4a8-07ad-4813-b235-3abcc0ab70c1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oFMEcskf" returned: 0 in 0.017s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:20:01 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cea62a8-31fc-4a4d-ad09-d879ad4b81b1]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:20:01 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2c03603-dc44-4908-88ff-70d686851b75 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oFMEcskf'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 16:20:01 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acc0d4a8-07ad-4813-b235-3abcc0ab70c1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:20:01 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acc0d4a8-07ad-4813-b235-3abcc0ab70c1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:20:01 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[42f217b9-48ee-4a69-8692-b711a2d2e9d9]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:20:01 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2c03603-dc44-4908-88ff-70d686851b75 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 16:20:01 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:20:01 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:20:01 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b17c7f9-f290-4794-a534-d9fd9bdf7f6c]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:20:01 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2c03603-dc44-4908-88ff-70d686851b75 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 28 16:20:01 user nova-compute[75176]:  {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 16:20:01 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2c03603-dc44-4908-88ff-70d686851b75 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 28 16:20:01 user nova-compute[75176]:  {{(pid=75176) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 16:20:01 user nova-compute[75176]: WARNING os_brick.initiator.connectors.iscsi [None req-c2c03603-dc44-4908-88ff-70d686851b75 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 28 16:20:01 user nova-compute[75176]: 
Nov 28 16:20:01 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acc0d4a8-07ad-4813-b235-3abcc0ab70c1 -p 172.16.0.220:3260 --login {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:20:01 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acc0d4a8-07ad-4813-b235-3abcc0ab70c1 -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:20:01 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[e168c629-8e25-4850-b07c-1afb09347ea5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:acc0d4a8-07ad-4813-b235-3abcc0ab70c1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:acc0d4a8-07ad-4813-b235-3abcc0ab70c1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:20:01 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2c03603-dc44-4908-88ff-70d686851b75 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:acc0d4a8-07ad-4813-b235-3abcc0ab70c1, portal: 172.16.0.220,3260]
Nov 28 16:20:01 user nova-compute[75176]: Login to [iface: default, target: iqn.2010-10.org.openstack:acc0d4a8-07ad-4813-b235-3abcc0ab70c1, portal: 172.16.0.220,3260] successful.
Nov 28 16:20:01 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 16:20:01 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acc0d4a8-07ad-4813-b235-3abcc0ab70c1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:20:01 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acc0d4a8-07ad-4813-b235-3abcc0ab70c1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:20:01 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[1225a382-aea2-46ed-84a1-a2803ebad00b]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:20:01 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2c03603-dc44-4908-88ff-70d686851b75 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 16:20:01 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:20:01 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:20:01 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0e31545-6520-4a70-aafe-6870192c8f40]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acc0d4a8-07ad-4813-b235-3abcc0ab70c1 (non-flash)\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:20:01 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2c03603-dc44-4908-88ff-70d686851b75 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acc0d4a8-07ad-4813-b235-3abcc0ab70c1 (non-flash)
Nov 28 16:20:01 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 16:20:01 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2c03603-dc44-4908-88ff-70d686851b75 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acc0d4a8-07ad-4813-b235-3abcc0ab70c1 (non-flash)
Nov 28 16:20:01 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 16:20:01 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-c2c03603-dc44-4908-88ff-70d686851b75 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:acc0d4a8-07ad-4813-b235-3abcc0ab70c1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.238s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 16:20:01 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2c03603-dc44-4908-88ff-70d686851b75 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Connected to 172.16.0.220:3260 {{(pid=75176) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 16:20:01 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-c2c03603-dc44-4908-88ff-70d686851b75 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] HCTL ('33', '-', '-', 0) found on session 67 with lun 0 {{(pid=75176) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 16:20:01 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-c2c03603-dc44-4908-88ff-70d686851b75 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75176) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 16:20:01 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:20:01 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:20:01 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba24fd13-cc06-4532-8b0a-9c8086c331ad]: (4, ('- - 0', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:20:01 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-c2c03603-dc44-4908-88ff-70d686851b75 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Searching for a device in session 67 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75176) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 16:20:01 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2c03603-dc44-4908-88ff-70d686851b75 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:acc0d4a8-07ad-4813-b235-3abcc0ab70c1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oFMEcskf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75176) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 16:20:02 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-c2c03603-dc44-4908-88ff-70d686851b75 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.268s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 16:20:02 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2c03603-dc44-4908-88ff-70d686851b75 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] <== connect_volume: return (1270ms) {'type': 'block', 'scsi_wwn': '23466633863303139', 'path': '/dev/sdb'} {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 16:20:02 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c2c03603-dc44-4908-88ff-70d686851b75 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] [instance: 4f1d73b0-4c94-47f4-87e0-1546057dbcc6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23466633863303139', 'path': '/dev/sdb'} {{(pid=75176) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 16:20:02 user nova-compute[75176]: DEBUG nova.objects.instance [None req-c2c03603-dc44-4908-88ff-70d686851b75 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Lazy-loading 'flavor' on Instance uuid 4f1d73b0-4c94-47f4-87e0-1546057dbcc6 {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 16:20:02 user nova-compute[75176]: DEBUG nova.virt.libvirt.guest [None req-c2c03603-dc44-4908-88ff-70d686851b75 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 16:20:02 user nova-compute[75176]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 16:20:02 user nova-compute[75176]:   <source dev="/dev/sdb"/>
Nov 28 16:20:02 user nova-compute[75176]:   <target dev="vdb" bus="virtio"/>
Nov 28 16:20:02 user nova-compute[75176]:   <serial>acc0d4a8-07ad-4813-b235-3abcc0ab70c1</serial>
Nov 28 16:20:02 user nova-compute[75176]: </disk>
Nov 28 16:20:02 user nova-compute[75176]:  {{(pid=75176) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 16:20:02 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-c2c03603-dc44-4908-88ff-70d686851b75 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] No BDM found with device name vda, not building metadata. {{(pid=75176) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 16:20:02 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-c2c03603-dc44-4908-88ff-70d686851b75 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75176) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 16:20:02 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-c2c03603-dc44-4908-88ff-70d686851b75 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] No VIF found with MAC fa:16:3e:be:c4:32, not building metadata {{(pid=75176) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 16:20:02 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-c2c03603-dc44-4908-88ff-70d686851b75 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Lock "4f1d73b0-4c94-47f4-87e0-1546057dbcc6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.580s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:20:03 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:20:05 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:20:08 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:20:10 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:20:13 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:20:15 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:20:17 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-1be4a5e9-9bee-472e-a234-5cbb56b2d501 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Acquiring lock "4f1d73b0-4c94-47f4-87e0-1546057dbcc6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:20:17 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-1be4a5e9-9bee-472e-a234-5cbb56b2d501 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Lock "4f1d73b0-4c94-47f4-87e0-1546057dbcc6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:20:17 user nova-compute[75176]: INFO nova.compute.manager [None req-1be4a5e9-9bee-472e-a234-5cbb56b2d501 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] [instance: 4f1d73b0-4c94-47f4-87e0-1546057dbcc6] Detaching volume acc0d4a8-07ad-4813-b235-3abcc0ab70c1
Nov 28 16:20:17 user nova-compute[75176]: INFO nova.virt.block_device [None req-1be4a5e9-9bee-472e-a234-5cbb56b2d501 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] [instance: 4f1d73b0-4c94-47f4-87e0-1546057dbcc6] Attempting to driver detach volume acc0d4a8-07ad-4813-b235-3abcc0ab70c1 from mountpoint /dev/vdb
Nov 28 16:20:17 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-1be4a5e9-9bee-472e-a234-5cbb56b2d501 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Attempting to detach device vdb from instance 4f1d73b0-4c94-47f4-87e0-1546057dbcc6 from the persistent domain config. {{(pid=75176) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 16:20:17 user nova-compute[75176]: DEBUG nova.virt.libvirt.guest [None req-1be4a5e9-9bee-472e-a234-5cbb56b2d501 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 16:20:17 user nova-compute[75176]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 16:20:17 user nova-compute[75176]:   <source dev="/dev/sdb"/>
Nov 28 16:20:17 user nova-compute[75176]:   <target dev="vdb" bus="virtio"/>
Nov 28 16:20:17 user nova-compute[75176]:   <serial>acc0d4a8-07ad-4813-b235-3abcc0ab70c1</serial>
Nov 28 16:20:17 user nova-compute[75176]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 16:20:17 user nova-compute[75176]: </disk>
Nov 28 16:20:17 user nova-compute[75176]:  {{(pid=75176) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 16:20:17 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-1be4a5e9-9bee-472e-a234-5cbb56b2d501 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Successfully detached device vdb from instance 4f1d73b0-4c94-47f4-87e0-1546057dbcc6 from the persistent domain config.
Nov 28 16:20:17 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-1be4a5e9-9bee-472e-a234-5cbb56b2d501 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4f1d73b0-4c94-47f4-87e0-1546057dbcc6 from the live domain config. {{(pid=75176) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 16:20:17 user nova-compute[75176]: DEBUG nova.virt.libvirt.guest [None req-1be4a5e9-9bee-472e-a234-5cbb56b2d501 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 16:20:17 user nova-compute[75176]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 16:20:17 user nova-compute[75176]:   <source dev="/dev/sdb"/>
Nov 28 16:20:17 user nova-compute[75176]:   <target dev="vdb" bus="virtio"/>
Nov 28 16:20:17 user nova-compute[75176]:   <serial>acc0d4a8-07ad-4813-b235-3abcc0ab70c1</serial>
Nov 28 16:20:17 user nova-compute[75176]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 16:20:17 user nova-compute[75176]: </disk>
Nov 28 16:20:17 user nova-compute[75176]:  {{(pid=75176) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 16:20:17 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-1be4a5e9-9bee-472e-a234-5cbb56b2d501 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4f1d73b0-4c94-47f4-87e0-1546057dbcc6 {{(pid=75176) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 16:20:18 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:20:19 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:20:19 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:20:19 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:20:23 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:20:25 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:20:26 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:20:26 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:20:26 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75176) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 16:20:28 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:20:28 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:20:28 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Starting heal instance info cache {{(pid=75176) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 16:20:28 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Rebuilding the list of instances to heal {{(pid=75176) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 16:20:28 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquiring lock "refresh_cache-4f1d73b0-4c94-47f4-87e0-1546057dbcc6" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 16:20:28 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquired lock "refresh_cache-4f1d73b0-4c94-47f4-87e0-1546057dbcc6" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 16:20:28 user nova-compute[75176]: DEBUG nova.network.neutron [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] [instance: 4f1d73b0-4c94-47f4-87e0-1546057dbcc6] Forcefully refreshing network info cache for instance {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 16:20:28 user nova-compute[75176]: DEBUG nova.objects.instance [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lazy-loading 'info_cache' on Instance uuid 4f1d73b0-4c94-47f4-87e0-1546057dbcc6 {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 16:20:29 user nova-compute[75176]: DEBUG nova.network.neutron [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] [instance: 4f1d73b0-4c94-47f4-87e0-1546057dbcc6] Updating instance_info_cache with network_info: [{"id": "8e18e2a6-ee7e-4be2-8ffc-9b1c0c19c14f", "address": "fa:16:3e:be:c4:32", "network": {"id": "a7e97163-1481-4c1e-a7f0-8337451faa28", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-75224014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0061e3132e644211b0b252d75eca3cda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e18e2a6-ee", "ovs_interfaceid": "8e18e2a6-ee7e-4be2-8ffc-9b1c0c19c14f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 16:20:29 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Releasing lock "refresh_cache-4f1d73b0-4c94-47f4-87e0-1546057dbcc6" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 16:20:29 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] [instance: 4f1d73b0-4c94-47f4-87e0-1546057dbcc6] Updated the network info_cache for instance {{(pid=75176) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 16:20:29 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:20:33 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:20:33 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:20:33 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Cleaning up deleted instances {{(pid=75176) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 28 16:20:33 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] There are 0 instances to clean {{(pid=75176) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 28 16:20:34 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:20:35 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:20:35 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:20:35 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:20:35 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:20:35 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Auditing locally available compute resources for user (node: user) {{(pid=75176) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 16:20:35 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f1d73b0-4c94-47f4-87e0-1546057dbcc6/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:20:35 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f1d73b0-4c94-47f4-87e0-1546057dbcc6/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:20:35 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f1d73b0-4c94-47f4-87e0-1546057dbcc6/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:20:36 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f1d73b0-4c94-47f4-87e0-1546057dbcc6/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:20:36 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 16:20:36 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 16:20:36 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Hypervisor/Node resource view: name=user free_ram=9042MB free_disk=25.02428436279297GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75176) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 16:20:36 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:20:36 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:20:36 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance 4f1d73b0-4c94-47f4-87e0-1546057dbcc6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 16:20:36 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75176) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 16:20:36 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75176) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 16:20:36 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Refreshing inventories for resource provider b37848d8-f401-4155-a029-b0ffa09ff85b {{(pid=75176) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 28 16:20:36 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Updating ProviderTree inventory for provider b37848d8-f401-4155-a029-b0ffa09ff85b from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75176) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 28 16:20:36 user nova-compute[75176]: DEBUG nova.compute.provider_tree [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Updating inventory in ProviderTree for provider b37848d8-f401-4155-a029-b0ffa09ff85b with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75176) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 28 16:20:36 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Refreshing aggregate associations for resource provider b37848d8-f401-4155-a029-b0ffa09ff85b, aggregates: None {{(pid=75176) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 28 16:20:36 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Refreshing trait associations for resource provider b37848d8-f401-4155-a029-b0ffa09ff85b, traits: COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_RESCUE_BFV,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NODE,HW_CPU_X86_SSSE3,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE42,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE2,COMPUTE_ACCELERATORS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VIRTIO {{(pid=75176) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 28 16:20:36 user nova-compute[75176]: DEBUG nova.compute.provider_tree [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Inventory has not changed in ProviderTree for provider: b37848d8-f401-4155-a029-b0ffa09ff85b {{(pid=75176) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 16:20:36 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Inventory has not changed for provider b37848d8-f401-4155-a029-b0ffa09ff85b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75176) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 16:20:36 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Compute_service record updated for user:user {{(pid=75176) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 16:20:36 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.403s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:20:37 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-1be4a5e9-9bee-472e-a234-5cbb56b2d501 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 4f1d73b0-4c94-47f4-87e0-1546057dbcc6 is timed out.
Nov 28 16:20:37 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-1be4a5e9-9bee-472e-a234-5cbb56b2d501 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Successfully detached device vdb from instance 4f1d73b0-4c94-47f4-87e0-1546057dbcc6 from the live domain config.
Nov 28 16:20:37 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1be4a5e9-9bee-472e-a234-5cbb56b2d501 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] [instance: 4f1d73b0-4c94-47f4-87e0-1546057dbcc6] calling os-brick to detach iSCSI Volume {{(pid=75176) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 16:20:37 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-1be4a5e9-9bee-472e-a234-5cbb56b2d501 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c1b8a00>, {'target_iqn': 'iqn.2010-10.org.openstack:acc0d4a8-07ad-4813-b235-3abcc0ab70c1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oFMEcskf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 16:20:37 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-1be4a5e9-9bee-472e-a234-5cbb56b2d501 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 16:20:37 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-1be4a5e9-9bee-472e-a234-5cbb56b2d501 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 16:20:37 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-1be4a5e9-9bee-472e-a234-5cbb56b2d501 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 16:20:37 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:20:37 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:20:37 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2046075-7057-4dfe-9b3a-be9b058d48e4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:acc0d4a8-07ad-4813-b235-3abcc0ab70c1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:20:37 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-1be4a5e9-9bee-472e-a234-5cbb56b2d501 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 16:20:37 user nova-compute[75176]: No targets found.
Nov 28 16:20:37 user nova-compute[75176]: iSNS:
Nov 28 16:20:37 user nova-compute[75176]: No targets found.
Nov 28 16:20:37 user nova-compute[75176]: STATIC:
Nov 28 16:20:37 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:acc0d4a8-07ad-4813-b235-3abcc0ab70c1
Nov 28 16:20:37 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 16:20:37 user nova-compute[75176]:                 Iface Name: default
Nov 28 16:20:37 user nova-compute[75176]: FIRMWARE:
Nov 28 16:20:37 user nova-compute[75176]: No targets found.
Nov 28 16:20:37 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 16:20:37 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-1be4a5e9-9bee-472e-a234-5cbb56b2d501 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 16:20:37 user nova-compute[75176]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 16:20:37 user nova-compute[75176]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75176) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 16:20:37 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-1be4a5e9-9bee-472e-a234-5cbb56b2d501 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:acc0d4a8-07ad-4813-b235-3abcc0ab70c1', 0)] {{(pid=75176) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 16:20:37 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:20:37 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:20:37 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c27b392-d8f3-4eeb-841c-f1fa92401410]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:acc0d4a8-07ad-4813-b235-3abcc0ab70c1\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:20:37 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:20:37 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:20:37 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4b94684-9605-4105-bed3-13b80784d7e8]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acc0d4a8-07ad-4813-b235-3abcc0ab70c1 (non-flash)\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:20:37 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-1be4a5e9-9bee-472e-a234-5cbb56b2d501 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acc0d4a8-07ad-4813-b235-3abcc0ab70c1 (non-flash)
Nov 28 16:20:37 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 16:20:37 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-1be4a5e9-9bee-472e-a234-5cbb56b2d501 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acc0d4a8-07ad-4813-b235-3abcc0ab70c1 (non-flash)
Nov 28 16:20:37 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 16:20:37 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-1be4a5e9-9bee-472e-a234-5cbb56b2d501 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f464417e5f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:acc0d4a8-07ad-4813-b235-3abcc0ab70c1'): ({'sdb'}, set())}) {{(pid=75176) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 16:20:37 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-1be4a5e9-9bee-472e-a234-5cbb56b2d501 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Removing single pathed devices sdb {{(pid=75176) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 16:20:37 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:20:37 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:20:37 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[349d3644-34df-4bd7-b95f-bcdd1155ab73]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:20:37 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:20:37 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:20:37 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[67dbc3c2-7b95-437e-b889-739b26f1daeb]: (4, ('ok\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:20:37 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-1be4a5e9-9bee-472e-a234-5cbb56b2d501 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Flushing IO for device /dev/sdb {{(pid=75176) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 16:20:37 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:20:37 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:20:37 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc407a72-38bc-4902-a30b-93eef16dea59]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:20:37 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-1be4a5e9-9bee-472e-a234-5cbb56b2d501 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75176) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 16:20:37 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:20:37 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:20:37 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c5f8a9e-9cef-48c7-b289-ddeb3eef3555]: (4, ('1', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:20:37 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-1be4a5e9-9bee-472e-a234-5cbb56b2d501 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75176) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 16:20:37 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-1be4a5e9-9bee-472e-a234-5cbb56b2d501 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] SCSI volumes sdb have been removed. {{(pid=75176) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 16:20:37 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-1be4a5e9-9bee-472e-a234-5cbb56b2d501 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:acc0d4a8-07ad-4813-b235-3abcc0ab70c1')] {{(pid=75176) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 16:20:37 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acc0d4a8-07ad-4813-b235-3abcc0ab70c1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:20:37 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acc0d4a8-07ad-4813-b235-3abcc0ab70c1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:20:37 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb3b32c3-b990-416f-9bf1-6722847ceb33]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:20:37 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-1be4a5e9-9bee-472e-a234-5cbb56b2d501 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 16:20:37 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acc0d4a8-07ad-4813-b235-3abcc0ab70c1 -p 172.16.0.220:3260 --logout {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:20:37 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acc0d4a8-07ad-4813-b235-3abcc0ab70c1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:20:37 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[1669e6a7-a4e4-48bf-81bb-d45fb053b746]: (4, ('Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:acc0d4a8-07ad-4813-b235-3abcc0ab70c1, portal: 172.16.0.220,3260]\nLogout of [sid: 67, target: iqn.2010-10.org.openstack:acc0d4a8-07ad-4813-b235-3abcc0ab70c1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:20:37 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-1be4a5e9-9bee-472e-a234-5cbb56b2d501 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:acc0d4a8-07ad-4813-b235-3abcc0ab70c1, portal: 172.16.0.220,3260]
Nov 28 16:20:37 user nova-compute[75176]: Logout of [sid: 67, target: iqn.2010-10.org.openstack:acc0d4a8-07ad-4813-b235-3abcc0ab70c1, portal: 172.16.0.220,3260] successful.
Nov 28 16:20:37 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 16:20:37 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acc0d4a8-07ad-4813-b235-3abcc0ab70c1 -p 172.16.0.220:3260 --op delete {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:20:37 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acc0d4a8-07ad-4813-b235-3abcc0ab70c1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:20:37 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf53a0bb-4fc1-42a5-882a-ad83aaa46125]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:20:37 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-1be4a5e9-9bee-472e-a234-5cbb56b2d501 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 16:20:37 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-1be4a5e9-9bee-472e-a234-5cbb56b2d501 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.320s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 16:20:37 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-1be4a5e9-9bee-472e-a234-5cbb56b2d501 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] <== disconnect_volume: return (322ms) None {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 16:20:37 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1be4a5e9-9bee-472e-a234-5cbb56b2d501 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] [instance: 4f1d73b0-4c94-47f4-87e0-1546057dbcc6] Disconnected iSCSI Volume {{(pid=75176) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 16:20:38 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 16:20:38 user nova-compute[75176]: DEBUG nova.objects.instance [None req-1be4a5e9-9bee-472e-a234-5cbb56b2d501 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Lazy-loading 'flavor' on Instance uuid 4f1d73b0-4c94-47f4-87e0-1546057dbcc6 {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 16:20:38 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-1be4a5e9-9bee-472e-a234-5cbb56b2d501 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Lock "4f1d73b0-4c94-47f4-87e0-1546057dbcc6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.665s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:20:41 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:20:41 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75176) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 28 16:20:43 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:20:48 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:20:53 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:20:58 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:21:01 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:21:03 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:21:08 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:21:10 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-37125828-f240-468f-8e02-ff314dd7ff34 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Acquiring lock "4f1d73b0-4c94-47f4-87e0-1546057dbcc6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:21:10 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-37125828-f240-468f-8e02-ff314dd7ff34 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Lock "4f1d73b0-4c94-47f4-87e0-1546057dbcc6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:21:10 user nova-compute[75176]: DEBUG nova.objects.instance [None req-37125828-f240-468f-8e02-ff314dd7ff34 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Lazy-loading 'flavor' on Instance uuid 4f1d73b0-4c94-47f4-87e0-1546057dbcc6 {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 16:21:10 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:21:10 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-37125828-f240-468f-8e02-ff314dd7ff34 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Lock "4f1d73b0-4c94-47f4-87e0-1546057dbcc6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:21:10 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-37125828-f240-468f-8e02-ff314dd7ff34 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Acquiring lock "4f1d73b0-4c94-47f4-87e0-1546057dbcc6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:21:10 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-37125828-f240-468f-8e02-ff314dd7ff34 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Lock "4f1d73b0-4c94-47f4-87e0-1546057dbcc6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:21:10 user nova-compute[75176]: INFO nova.compute.manager [None req-37125828-f240-468f-8e02-ff314dd7ff34 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] [instance: 4f1d73b0-4c94-47f4-87e0-1546057dbcc6] Attaching volume e914c07b-f5af-4ecc-9ee6-66bd3213147b to /dev/vdb
Nov 28 16:21:10 user nova-compute[75176]: DEBUG os_brick.utils [None req-37125828-f240-468f-8e02-ff314dd7ff34 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 16:21:10 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:21:10 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:21:10 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[53ac2385-72cf-4650-96bc-23b14ae290cd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:edc924a949b2\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:21:10 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:21:10 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:21:10 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0c2dbd3-e273-47ea-81f9-4e6d4eb7009f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:21:10 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:21:10 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:21:10 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[d89b6236-3fab-4874-b455-42ab5491bf7c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:21:10 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[42c59eef-b691-406d-bc6a-cf74cbcd7803]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:21:10 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-37125828-f240-468f-8e02-ff314dd7ff34 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Running cmd (subprocess): nvme version {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:21:10 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-37125828-f240-468f-8e02-ff314dd7ff34 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] 'nvme version' failed. Not Retrying. {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 16:21:10 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.nvmeof [None req-37125828-f240-468f-8e02-ff314dd7ff34 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] nvme not present on system {{(pid=75176) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 16:21:10 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:21:10 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 16:21:10 user nova-compute[75176]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 16:21:10 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[84cafc3a-a338-49a0-a519-8e5e529b7036]: (4, '') {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:21:10 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.lightos [None req-37125828-f240-468f-8e02-ff314dd7ff34 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75176) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 16:21:10 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.lightos [None req-37125828-f240-468f-8e02-ff314dd7ff34 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75176) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 16:21:10 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.lightos [None req-37125828-f240-468f-8e02-ff314dd7ff34 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] LIGHTOS: no hostnqn found. {{(pid=75176) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 16:21:10 user nova-compute[75176]: DEBUG os_brick.utils [None req-37125828-f240-468f-8e02-ff314dd7ff34 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:edc924a949b2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 16:21:10 user nova-compute[75176]: DEBUG nova.virt.block_device [None req-37125828-f240-468f-8e02-ff314dd7ff34 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] [instance: 4f1d73b0-4c94-47f4-87e0-1546057dbcc6] Updating existing volume attachment record: 259a37f4-a488-4ab8-aeb8-13e4fd6ab1bc {{(pid=75176) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 16:21:13 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:21:17 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-37125828-f240-468f-8e02-ff314dd7ff34 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] [instance: 4f1d73b0-4c94-47f4-87e0-1546057dbcc6] Calling os-brick to attach iSCSI Volume {{(pid=75176) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 16:21:17 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-37125828-f240-468f-8e02-ff314dd7ff34 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c1b8a00>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e914c07b-f5af-4ecc-9ee6-66bd3213147b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DeibtNgA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 16:21:17 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-37125828-f240-468f-8e02-ff314dd7ff34 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 16:21:17 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-37125828-f240-468f-8e02-ff314dd7ff34 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 16:21:17 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-37125828-f240-468f-8e02-ff314dd7ff34 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 16:21:17 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-37125828-f240-468f-8e02-ff314dd7ff34 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 16:21:17 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-37125828-f240-468f-8e02-ff314dd7ff34 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e914c07b-f5af-4ecc-9ee6-66bd3213147b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 16:21:17 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-37125828-f240-468f-8e02-ff314dd7ff34 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e914c07b-f5af-4ecc-9ee6-66bd3213147b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 16:21:17 user nova-compute[75176]: INFO os_brick.initiator.connectors.iscsi [None req-37125828-f240-468f-8e02-ff314dd7ff34 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 16:21:17 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e914c07b-f5af-4ecc-9ee6-66bd3213147b -p 172.16.0.220:3260 {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:21:17 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e914c07b-f5af-4ecc-9ee6-66bd3213147b -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:21:17 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[160354e6-dfe8-4b6d-af67-dcea5343d974]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:21:17 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-37125828-f240-468f-8e02-ff314dd7ff34 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 16:21:17 user nova-compute[75176]:  {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 16:21:17 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e914c07b-f5af-4ecc-9ee6-66bd3213147b -p 172.16.0.220:3260 --interface default --op new {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:21:17 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e914c07b-f5af-4ecc-9ee6-66bd3213147b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:21:17 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b597130-7305-4759-98a1-644f64d843e6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e914c07b-f5af-4ecc-9ee6-66bd3213147b] added\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:21:17 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-37125828-f240-468f-8e02-ff314dd7ff34 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e914c07b-f5af-4ecc-9ee6-66bd3213147b] added
Nov 28 16:21:17 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 16:21:17 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e914c07b-f5af-4ecc-9ee6-66bd3213147b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:21:17 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e914c07b-f5af-4ecc-9ee6-66bd3213147b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:21:17 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ee35bcd-5021-429c-b93c-8a1337b900b7]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:21:17 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-37125828-f240-468f-8e02-ff314dd7ff34 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 16:21:17 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e914c07b-f5af-4ecc-9ee6-66bd3213147b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:21:17 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e914c07b-f5af-4ecc-9ee6-66bd3213147b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:21:17 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[710d4b14-6912-44c5-9b7c-3376efe220f8]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:21:17 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-37125828-f240-468f-8e02-ff314dd7ff34 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 16:21:17 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e914c07b-f5af-4ecc-9ee6-66bd3213147b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DeibtNgA {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:21:17 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e914c07b-f5af-4ecc-9ee6-66bd3213147b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DeibtNgA" returned: 0 in 0.017s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:21:17 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[2171a9fa-1ff3-4514-b102-fabbfa3b9b7f]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:21:17 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-37125828-f240-468f-8e02-ff314dd7ff34 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DeibtNgA'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 16:21:17 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e914c07b-f5af-4ecc-9ee6-66bd3213147b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:21:17 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e914c07b-f5af-4ecc-9ee6-66bd3213147b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:21:17 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[d77a6a93-2c19-4ed1-af3c-0e4c3caf863f]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:21:17 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-37125828-f240-468f-8e02-ff314dd7ff34 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 16:21:17 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:21:17 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:21:17 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[3450db94-036c-4a0e-ad61-7c9e4ea31cf1]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:21:17 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-37125828-f240-468f-8e02-ff314dd7ff34 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 28 16:21:17 user nova-compute[75176]:  {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 16:21:17 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-37125828-f240-468f-8e02-ff314dd7ff34 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 28 16:21:17 user nova-compute[75176]:  {{(pid=75176) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 16:21:17 user nova-compute[75176]: WARNING os_brick.initiator.connectors.iscsi [None req-37125828-f240-468f-8e02-ff314dd7ff34 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 28 16:21:17 user nova-compute[75176]: 
Nov 28 16:21:17 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e914c07b-f5af-4ecc-9ee6-66bd3213147b -p 172.16.0.220:3260 --login {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:21:17 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e914c07b-f5af-4ecc-9ee6-66bd3213147b -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:21:17 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[38a7be31-80b5-4068-a4a4-e200b7f22a20]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e914c07b-f5af-4ecc-9ee6-66bd3213147b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e914c07b-f5af-4ecc-9ee6-66bd3213147b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:21:17 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-37125828-f240-468f-8e02-ff314dd7ff34 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e914c07b-f5af-4ecc-9ee6-66bd3213147b, portal: 172.16.0.220,3260]
Nov 28 16:21:17 user nova-compute[75176]: Login to [iface: default, target: iqn.2010-10.org.openstack:e914c07b-f5af-4ecc-9ee6-66bd3213147b, portal: 172.16.0.220,3260] successful.
Nov 28 16:21:17 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 16:21:17 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e914c07b-f5af-4ecc-9ee6-66bd3213147b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:21:17 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e914c07b-f5af-4ecc-9ee6-66bd3213147b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:21:17 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[28514ffb-392d-4935-9b46-47d85f207c21]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:21:17 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-37125828-f240-468f-8e02-ff314dd7ff34 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 16:21:17 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:21:17 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:21:17 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b3bff53-dca6-4887-8791-2944ee0df2d9]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e914c07b-f5af-4ecc-9ee6-66bd3213147b (non-flash)\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:21:17 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-37125828-f240-468f-8e02-ff314dd7ff34 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e914c07b-f5af-4ecc-9ee6-66bd3213147b (non-flash)
Nov 28 16:21:17 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 16:21:17 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-37125828-f240-468f-8e02-ff314dd7ff34 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e914c07b-f5af-4ecc-9ee6-66bd3213147b (non-flash)
Nov 28 16:21:17 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 16:21:17 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-37125828-f240-468f-8e02-ff314dd7ff34 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e914c07b-f5af-4ecc-9ee6-66bd3213147b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.246s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 16:21:17 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-37125828-f240-468f-8e02-ff314dd7ff34 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Connected to 172.16.0.220:3260 {{(pid=75176) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 16:21:17 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-37125828-f240-468f-8e02-ff314dd7ff34 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] HCTL ('33', '-', '-', 0) found on session 68 with lun 0 {{(pid=75176) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 16:21:17 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-37125828-f240-468f-8e02-ff314dd7ff34 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75176) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 16:21:17 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:21:17 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:21:17 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fa40151-b361-4e3f-9638-02c2fab02e7c]: (4, ('- - 0', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:21:17 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-37125828-f240-468f-8e02-ff314dd7ff34 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Searching for a device in session 68 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75176) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 16:21:17 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-37125828-f240-468f-8e02-ff314dd7ff34 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:e914c07b-f5af-4ecc-9ee6-66bd3213147b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DeibtNgA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75176) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 16:21:18 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:21:18 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-37125828-f240-468f-8e02-ff314dd7ff34 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.274s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 16:21:18 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-37125828-f240-468f-8e02-ff314dd7ff34 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] <== connect_volume: return (1275ms) {'type': 'block', 'scsi_wwn': '26466343532653963', 'path': '/dev/sdb'} {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 16:21:18 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-37125828-f240-468f-8e02-ff314dd7ff34 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] [instance: 4f1d73b0-4c94-47f4-87e0-1546057dbcc6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26466343532653963', 'path': '/dev/sdb'} {{(pid=75176) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 16:21:18 user nova-compute[75176]: DEBUG nova.objects.instance [None req-37125828-f240-468f-8e02-ff314dd7ff34 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Lazy-loading 'flavor' on Instance uuid 4f1d73b0-4c94-47f4-87e0-1546057dbcc6 {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 16:21:18 user nova-compute[75176]: DEBUG nova.virt.libvirt.guest [None req-37125828-f240-468f-8e02-ff314dd7ff34 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 16:21:18 user nova-compute[75176]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 16:21:18 user nova-compute[75176]:   <source dev="/dev/sdb"/>
Nov 28 16:21:18 user nova-compute[75176]:   <target dev="vdb" bus="virtio"/>
Nov 28 16:21:18 user nova-compute[75176]:   <serial>e914c07b-f5af-4ecc-9ee6-66bd3213147b</serial>
Nov 28 16:21:18 user nova-compute[75176]: </disk>
Nov 28 16:21:18 user nova-compute[75176]:  {{(pid=75176) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 16:21:18 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-37125828-f240-468f-8e02-ff314dd7ff34 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] No BDM found with device name vda, not building metadata. {{(pid=75176) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 16:21:18 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-37125828-f240-468f-8e02-ff314dd7ff34 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75176) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 16:21:18 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-37125828-f240-468f-8e02-ff314dd7ff34 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] No VIF found with MAC fa:16:3e:be:c4:32, not building metadata {{(pid=75176) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 16:21:18 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-37125828-f240-468f-8e02-ff314dd7ff34 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Lock "4f1d73b0-4c94-47f4-87e0-1546057dbcc6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.588s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:21:19 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:21:20 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:21:20 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:21:21 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:21:21 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-e41023b9-9ca8-43cc-9d23-c9fb36283fe8 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Acquiring lock "4f1d73b0-4c94-47f4-87e0-1546057dbcc6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:21:21 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-e41023b9-9ca8-43cc-9d23-c9fb36283fe8 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Lock "4f1d73b0-4c94-47f4-87e0-1546057dbcc6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:21:21 user nova-compute[75176]: INFO nova.compute.manager [None req-e41023b9-9ca8-43cc-9d23-c9fb36283fe8 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] [instance: 4f1d73b0-4c94-47f4-87e0-1546057dbcc6] Detaching volume e914c07b-f5af-4ecc-9ee6-66bd3213147b
Nov 28 16:21:21 user nova-compute[75176]: INFO nova.virt.block_device [None req-e41023b9-9ca8-43cc-9d23-c9fb36283fe8 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] [instance: 4f1d73b0-4c94-47f4-87e0-1546057dbcc6] Attempting to driver detach volume e914c07b-f5af-4ecc-9ee6-66bd3213147b from mountpoint /dev/vdb
Nov 28 16:21:21 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-e41023b9-9ca8-43cc-9d23-c9fb36283fe8 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Attempting to detach device vdb from instance 4f1d73b0-4c94-47f4-87e0-1546057dbcc6 from the persistent domain config. {{(pid=75176) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 16:21:21 user nova-compute[75176]: DEBUG nova.virt.libvirt.guest [None req-e41023b9-9ca8-43cc-9d23-c9fb36283fe8 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 16:21:21 user nova-compute[75176]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 16:21:21 user nova-compute[75176]:   <source dev="/dev/sdb"/>
Nov 28 16:21:21 user nova-compute[75176]:   <target dev="vdb" bus="virtio"/>
Nov 28 16:21:21 user nova-compute[75176]:   <serial>e914c07b-f5af-4ecc-9ee6-66bd3213147b</serial>
Nov 28 16:21:21 user nova-compute[75176]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 16:21:21 user nova-compute[75176]: </disk>
Nov 28 16:21:21 user nova-compute[75176]:  {{(pid=75176) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 16:21:21 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-e41023b9-9ca8-43cc-9d23-c9fb36283fe8 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Successfully detached device vdb from instance 4f1d73b0-4c94-47f4-87e0-1546057dbcc6 from the persistent domain config.
Nov 28 16:21:21 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-e41023b9-9ca8-43cc-9d23-c9fb36283fe8 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4f1d73b0-4c94-47f4-87e0-1546057dbcc6 from the live domain config. {{(pid=75176) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 16:21:21 user nova-compute[75176]: DEBUG nova.virt.libvirt.guest [None req-e41023b9-9ca8-43cc-9d23-c9fb36283fe8 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 16:21:21 user nova-compute[75176]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 16:21:21 user nova-compute[75176]:   <source dev="/dev/sdb"/>
Nov 28 16:21:21 user nova-compute[75176]:   <target dev="vdb" bus="virtio"/>
Nov 28 16:21:21 user nova-compute[75176]:   <serial>e914c07b-f5af-4ecc-9ee6-66bd3213147b</serial>
Nov 28 16:21:21 user nova-compute[75176]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 16:21:21 user nova-compute[75176]: </disk>
Nov 28 16:21:21 user nova-compute[75176]:  {{(pid=75176) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 16:21:22 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-e41023b9-9ca8-43cc-9d23-c9fb36283fe8 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4f1d73b0-4c94-47f4-87e0-1546057dbcc6 {{(pid=75176) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 16:21:23 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:21:25 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:21:27 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:21:27 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:21:27 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75176) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 16:21:28 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:21:28 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:21:30 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:21:30 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Starting heal instance info cache {{(pid=75176) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 16:21:30 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Rebuilding the list of instances to heal {{(pid=75176) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 16:21:30 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquiring lock "refresh_cache-4f1d73b0-4c94-47f4-87e0-1546057dbcc6" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 16:21:30 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquired lock "refresh_cache-4f1d73b0-4c94-47f4-87e0-1546057dbcc6" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 16:21:30 user nova-compute[75176]: DEBUG nova.network.neutron [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] [instance: 4f1d73b0-4c94-47f4-87e0-1546057dbcc6] Forcefully refreshing network info cache for instance {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 16:21:30 user nova-compute[75176]: DEBUG nova.objects.instance [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lazy-loading 'info_cache' on Instance uuid 4f1d73b0-4c94-47f4-87e0-1546057dbcc6 {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 16:21:31 user nova-compute[75176]: DEBUG nova.network.neutron [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] [instance: 4f1d73b0-4c94-47f4-87e0-1546057dbcc6] Updating instance_info_cache with network_info: [{"id": "8e18e2a6-ee7e-4be2-8ffc-9b1c0c19c14f", "address": "fa:16:3e:be:c4:32", "network": {"id": "a7e97163-1481-4c1e-a7f0-8337451faa28", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-75224014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0061e3132e644211b0b252d75eca3cda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e18e2a6-ee", "ovs_interfaceid": "8e18e2a6-ee7e-4be2-8ffc-9b1c0c19c14f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 16:21:31 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Releasing lock "refresh_cache-4f1d73b0-4c94-47f4-87e0-1546057dbcc6" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 16:21:31 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] [instance: 4f1d73b0-4c94-47f4-87e0-1546057dbcc6] Updated the network info_cache for instance {{(pid=75176) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 16:21:33 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:21:35 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:21:37 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:21:37 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:21:37 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:21:37 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:21:37 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Auditing locally available compute resources for user (node: user) {{(pid=75176) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 16:21:37 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f1d73b0-4c94-47f4-87e0-1546057dbcc6/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:21:37 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f1d73b0-4c94-47f4-87e0-1546057dbcc6/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:21:37 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f1d73b0-4c94-47f4-87e0-1546057dbcc6/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:21:38 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f1d73b0-4c94-47f4-87e0-1546057dbcc6/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:21:38 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:21:38 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 16:21:38 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 16:21:38 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Hypervisor/Node resource view: name=user free_ram=9041MB free_disk=25.023273468017578GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75176) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 16:21:38 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:21:38 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:21:38 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance 4f1d73b0-4c94-47f4-87e0-1546057dbcc6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 16:21:38 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75176) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 16:21:38 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75176) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 16:21:38 user nova-compute[75176]: DEBUG nova.compute.provider_tree [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Inventory has not changed in ProviderTree for provider: b37848d8-f401-4155-a029-b0ffa09ff85b {{(pid=75176) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 16:21:38 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Inventory has not changed for provider b37848d8-f401-4155-a029-b0ffa09ff85b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75176) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 16:21:38 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Compute_service record updated for user:user {{(pid=75176) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 16:21:38 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.196s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:21:42 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-e41023b9-9ca8-43cc-9d23-c9fb36283fe8 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 4f1d73b0-4c94-47f4-87e0-1546057dbcc6 is timed out.
Nov 28 16:21:42 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-e41023b9-9ca8-43cc-9d23-c9fb36283fe8 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Successfully detached device vdb from instance 4f1d73b0-4c94-47f4-87e0-1546057dbcc6 from the live domain config.
Nov 28 16:21:42 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e41023b9-9ca8-43cc-9d23-c9fb36283fe8 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] [instance: 4f1d73b0-4c94-47f4-87e0-1546057dbcc6] calling os-brick to detach iSCSI Volume {{(pid=75176) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 16:21:42 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-e41023b9-9ca8-43cc-9d23-c9fb36283fe8 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c1b8a00>, {'target_iqn': 'iqn.2010-10.org.openstack:e914c07b-f5af-4ecc-9ee6-66bd3213147b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DeibtNgA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 16:21:42 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-e41023b9-9ca8-43cc-9d23-c9fb36283fe8 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 16:21:42 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-e41023b9-9ca8-43cc-9d23-c9fb36283fe8 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 16:21:42 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-e41023b9-9ca8-43cc-9d23-c9fb36283fe8 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 16:21:42 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:21:42 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:21:42 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d1698e4-e8ed-4f5d-b8e9-1bc5d8b57a65]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e914c07b-f5af-4ecc-9ee6-66bd3213147b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:21:42 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-e41023b9-9ca8-43cc-9d23-c9fb36283fe8 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 16:21:42 user nova-compute[75176]: No targets found.
Nov 28 16:21:42 user nova-compute[75176]: iSNS:
Nov 28 16:21:42 user nova-compute[75176]: No targets found.
Nov 28 16:21:42 user nova-compute[75176]: STATIC:
Nov 28 16:21:42 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:e914c07b-f5af-4ecc-9ee6-66bd3213147b
Nov 28 16:21:42 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 16:21:42 user nova-compute[75176]:                 Iface Name: default
Nov 28 16:21:42 user nova-compute[75176]: FIRMWARE:
Nov 28 16:21:42 user nova-compute[75176]: No targets found.
Nov 28 16:21:42 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 16:21:42 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-e41023b9-9ca8-43cc-9d23-c9fb36283fe8 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 16:21:42 user nova-compute[75176]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 16:21:42 user nova-compute[75176]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75176) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 16:21:42 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-e41023b9-9ca8-43cc-9d23-c9fb36283fe8 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e914c07b-f5af-4ecc-9ee6-66bd3213147b', 0)] {{(pid=75176) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 16:21:42 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:21:42 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:21:42 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[56b6dea7-c6fe-4374-bf67-6479e3a3a64d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e914c07b-f5af-4ecc-9ee6-66bd3213147b\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:21:42 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:21:42 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:21:42 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee105503-eaad-4503-ad8a-ac019c395eeb]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e914c07b-f5af-4ecc-9ee6-66bd3213147b (non-flash)\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:21:42 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-e41023b9-9ca8-43cc-9d23-c9fb36283fe8 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e914c07b-f5af-4ecc-9ee6-66bd3213147b (non-flash)
Nov 28 16:21:42 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 16:21:42 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-e41023b9-9ca8-43cc-9d23-c9fb36283fe8 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e914c07b-f5af-4ecc-9ee6-66bd3213147b (non-flash)
Nov 28 16:21:42 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 16:21:42 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-e41023b9-9ca8-43cc-9d23-c9fb36283fe8 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f464c6ea680>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e914c07b-f5af-4ecc-9ee6-66bd3213147b'): ({'sdb'}, set())}) {{(pid=75176) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 16:21:42 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-e41023b9-9ca8-43cc-9d23-c9fb36283fe8 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Removing single pathed devices sdb {{(pid=75176) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 16:21:42 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:21:42 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:21:42 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef1c2470-6c5c-42b5-a583-81e4f47756ac]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:21:42 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:21:42 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:21:42 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[e19264ac-871e-4f56-8b3d-5ae8b899da7a]: (4, ('ok\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:21:42 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-e41023b9-9ca8-43cc-9d23-c9fb36283fe8 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Flushing IO for device /dev/sdb {{(pid=75176) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 16:21:42 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:21:42 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:21:42 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[9634ad0f-bafa-43bc-b1f0-97e6ac830153]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:21:42 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-e41023b9-9ca8-43cc-9d23-c9fb36283fe8 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75176) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 16:21:42 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:21:42 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.051s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:21:42 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[22b2fc30-7f43-4596-9bc5-8a90e427a84a]: (4, ('1', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:21:42 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-e41023b9-9ca8-43cc-9d23-c9fb36283fe8 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75176) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 16:21:42 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-e41023b9-9ca8-43cc-9d23-c9fb36283fe8 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] SCSI volumes sdb have been removed. {{(pid=75176) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 16:21:42 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-e41023b9-9ca8-43cc-9d23-c9fb36283fe8 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e914c07b-f5af-4ecc-9ee6-66bd3213147b')] {{(pid=75176) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 16:21:42 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e914c07b-f5af-4ecc-9ee6-66bd3213147b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:21:42 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e914c07b-f5af-4ecc-9ee6-66bd3213147b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:21:42 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac04610b-82b9-443b-9805-52252f665a45]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:21:42 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-e41023b9-9ca8-43cc-9d23-c9fb36283fe8 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 16:21:42 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e914c07b-f5af-4ecc-9ee6-66bd3213147b -p 172.16.0.220:3260 --logout {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:21:42 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e914c07b-f5af-4ecc-9ee6-66bd3213147b -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:21:42 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a066acc-78f7-430e-84a3-6d1b9384de77]: (4, ('Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:e914c07b-f5af-4ecc-9ee6-66bd3213147b, portal: 172.16.0.220,3260]\nLogout of [sid: 68, target: iqn.2010-10.org.openstack:e914c07b-f5af-4ecc-9ee6-66bd3213147b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:21:42 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-e41023b9-9ca8-43cc-9d23-c9fb36283fe8 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:e914c07b-f5af-4ecc-9ee6-66bd3213147b, portal: 172.16.0.220,3260]
Nov 28 16:21:42 user nova-compute[75176]: Logout of [sid: 68, target: iqn.2010-10.org.openstack:e914c07b-f5af-4ecc-9ee6-66bd3213147b, portal: 172.16.0.220,3260] successful.
Nov 28 16:21:42 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 16:21:42 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e914c07b-f5af-4ecc-9ee6-66bd3213147b -p 172.16.0.220:3260 --op delete {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:21:42 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e914c07b-f5af-4ecc-9ee6-66bd3213147b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:21:42 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e30c97b-c69a-4756-8b7c-54914eacabe8]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:21:42 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-e41023b9-9ca8-43cc-9d23-c9fb36283fe8 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 16:21:42 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-e41023b9-9ca8-43cc-9d23-c9fb36283fe8 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.295s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 16:21:42 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-e41023b9-9ca8-43cc-9d23-c9fb36283fe8 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] <== disconnect_volume: return (296ms) None {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 16:21:42 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e41023b9-9ca8-43cc-9d23-c9fb36283fe8 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] [instance: 4f1d73b0-4c94-47f4-87e0-1546057dbcc6] Disconnected iSCSI Volume {{(pid=75176) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 16:21:43 user nova-compute[75176]: DEBUG nova.objects.instance [None req-e41023b9-9ca8-43cc-9d23-c9fb36283fe8 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Lazy-loading 'flavor' on Instance uuid 4f1d73b0-4c94-47f4-87e0-1546057dbcc6 {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 16:21:43 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-e41023b9-9ca8-43cc-9d23-c9fb36283fe8 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Lock "4f1d73b0-4c94-47f4-87e0-1546057dbcc6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.611s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:21:43 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 16:21:45 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:21:48 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 16:21:48 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:21:48 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75176) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 16:21:48 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75176) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 16:21:48 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75176) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 16:21:48 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:21:53 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:21:58 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:22:03 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:22:08 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:22:13 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:22:14 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7dbeec73-f348-41dd-84a0-df78e754f8de tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Acquiring lock "4f1d73b0-4c94-47f4-87e0-1546057dbcc6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:22:14 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7dbeec73-f348-41dd-84a0-df78e754f8de tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Lock "4f1d73b0-4c94-47f4-87e0-1546057dbcc6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:22:14 user nova-compute[75176]: DEBUG nova.objects.instance [None req-7dbeec73-f348-41dd-84a0-df78e754f8de tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Lazy-loading 'flavor' on Instance uuid 4f1d73b0-4c94-47f4-87e0-1546057dbcc6 {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 16:22:14 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7dbeec73-f348-41dd-84a0-df78e754f8de tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Lock "4f1d73b0-4c94-47f4-87e0-1546057dbcc6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:22:15 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7dbeec73-f348-41dd-84a0-df78e754f8de tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Acquiring lock "4f1d73b0-4c94-47f4-87e0-1546057dbcc6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:22:15 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7dbeec73-f348-41dd-84a0-df78e754f8de tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Lock "4f1d73b0-4c94-47f4-87e0-1546057dbcc6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:22:15 user nova-compute[75176]: INFO nova.compute.manager [None req-7dbeec73-f348-41dd-84a0-df78e754f8de tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] [instance: 4f1d73b0-4c94-47f4-87e0-1546057dbcc6] Attaching volume 5899a74c-fe20-449c-931e-6c303a675a1a to /dev/vdb
Nov 28 16:22:15 user nova-compute[75176]: DEBUG os_brick.utils [None req-7dbeec73-f348-41dd-84a0-df78e754f8de tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 16:22:15 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:22:15 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:22:15 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8b52060-1490-47ee-9635-27212afe48ee]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:edc924a949b2\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:22:15 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:22:15 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:22:15 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[7778dbf8-b5a2-4513-9425-113aa64dc68b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:22:15 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:22:15 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:22:15 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[717203cb-b66c-4ffc-8c08-e12e155ece95]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:22:15 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[632a31c5-18a7-44e3-beb9-f154941f19a8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:22:15 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7dbeec73-f348-41dd-84a0-df78e754f8de tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Running cmd (subprocess): nvme version {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:22:15 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7dbeec73-f348-41dd-84a0-df78e754f8de tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] 'nvme version' failed. Not Retrying. {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 16:22:15 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:22:15 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7dbeec73-f348-41dd-84a0-df78e754f8de tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] nvme not present on system {{(pid=75176) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 16:22:15 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:22:15 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 16:22:15 user nova-compute[75176]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 16:22:15 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7c5f641-077a-4175-a02a-1d620ee7dd70]: (4, '') {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:22:15 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.lightos [None req-7dbeec73-f348-41dd-84a0-df78e754f8de tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75176) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 16:22:15 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.lightos [None req-7dbeec73-f348-41dd-84a0-df78e754f8de tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75176) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 16:22:15 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.lightos [None req-7dbeec73-f348-41dd-84a0-df78e754f8de tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] LIGHTOS: no hostnqn found. {{(pid=75176) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 16:22:15 user nova-compute[75176]: DEBUG os_brick.utils [None req-7dbeec73-f348-41dd-84a0-df78e754f8de tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:edc924a949b2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 16:22:15 user nova-compute[75176]: DEBUG nova.virt.block_device [None req-7dbeec73-f348-41dd-84a0-df78e754f8de tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] [instance: 4f1d73b0-4c94-47f4-87e0-1546057dbcc6] Updating existing volume attachment record: 13fce9a5-9f7d-40ae-a336-1844fe1a04ac {{(pid=75176) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 16:22:18 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:22:21 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:22:21 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:22:21 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7dbeec73-f348-41dd-84a0-df78e754f8de tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] [instance: 4f1d73b0-4c94-47f4-87e0-1546057dbcc6] Calling os-brick to attach iSCSI Volume {{(pid=75176) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 16:22:21 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dbeec73-f348-41dd-84a0-df78e754f8de tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c1b8a00>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5899a74c-fe20-449c-931e-6c303a675a1a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MTUsmDJi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 16:22:21 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-7dbeec73-f348-41dd-84a0-df78e754f8de tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 16:22:21 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-7dbeec73-f348-41dd-84a0-df78e754f8de tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 16:22:21 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-7dbeec73-f348-41dd-84a0-df78e754f8de tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 16:22:21 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-7dbeec73-f348-41dd-84a0-df78e754f8de tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 16:22:21 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-7dbeec73-f348-41dd-84a0-df78e754f8de tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5899a74c-fe20-449c-931e-6c303a675a1a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 16:22:21 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-7dbeec73-f348-41dd-84a0-df78e754f8de tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5899a74c-fe20-449c-931e-6c303a675a1a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 16:22:21 user nova-compute[75176]: INFO os_brick.initiator.connectors.iscsi [None req-7dbeec73-f348-41dd-84a0-df78e754f8de tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 16:22:21 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5899a74c-fe20-449c-931e-6c303a675a1a -p 172.16.0.220:3260 {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:22:21 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5899a74c-fe20-449c-931e-6c303a675a1a -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:22:21 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[81cc766a-e3b7-4066-9fe8-71c474c0d86e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:22:21 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dbeec73-f348-41dd-84a0-df78e754f8de tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 16:22:21 user nova-compute[75176]:  {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 16:22:21 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5899a74c-fe20-449c-931e-6c303a675a1a -p 172.16.0.220:3260 --interface default --op new {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:22:21 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5899a74c-fe20-449c-931e-6c303a675a1a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:22:21 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[d337e90f-14c6-4f25-9bd8-faacf5399644]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5899a74c-fe20-449c-931e-6c303a675a1a] added\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:22:21 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dbeec73-f348-41dd-84a0-df78e754f8de tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5899a74c-fe20-449c-931e-6c303a675a1a] added
Nov 28 16:22:21 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 16:22:21 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5899a74c-fe20-449c-931e-6c303a675a1a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:22:21 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5899a74c-fe20-449c-931e-6c303a675a1a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:22:21 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[ece1a65f-949a-42d9-a138-cac2ed15ad8f]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:22:21 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dbeec73-f348-41dd-84a0-df78e754f8de tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 16:22:21 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5899a74c-fe20-449c-931e-6c303a675a1a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:22:21 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5899a74c-fe20-449c-931e-6c303a675a1a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:22:21 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[bad2f3d6-da84-47d5-af66-1e4c14562c85]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:22:21 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dbeec73-f348-41dd-84a0-df78e754f8de tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 16:22:21 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5899a74c-fe20-449c-931e-6c303a675a1a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MTUsmDJi {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:22:21 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5899a74c-fe20-449c-931e-6c303a675a1a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MTUsmDJi" returned: 0 in 0.016s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:22:21 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d5b1feb-1bad-47e5-9ccc-899f2beeac6b]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:22:21 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dbeec73-f348-41dd-84a0-df78e754f8de tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MTUsmDJi'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 16:22:21 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5899a74c-fe20-449c-931e-6c303a675a1a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:22:21 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5899a74c-fe20-449c-931e-6c303a675a1a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:22:21 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[56394b60-3e83-4f5f-bd50-c663dc8af377]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:22:21 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dbeec73-f348-41dd-84a0-df78e754f8de tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 16:22:21 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:22:21 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:22:21 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3530570-c1ab-4343-bab2-d535db5313d0]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:22:21 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dbeec73-f348-41dd-84a0-df78e754f8de tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 28 16:22:21 user nova-compute[75176]:  {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 16:22:21 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dbeec73-f348-41dd-84a0-df78e754f8de tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 28 16:22:21 user nova-compute[75176]:  {{(pid=75176) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 16:22:21 user nova-compute[75176]: WARNING os_brick.initiator.connectors.iscsi [None req-7dbeec73-f348-41dd-84a0-df78e754f8de tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 28 16:22:21 user nova-compute[75176]: 
Nov 28 16:22:21 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5899a74c-fe20-449c-931e-6c303a675a1a -p 172.16.0.220:3260 --login {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:22:21 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5899a74c-fe20-449c-931e-6c303a675a1a -p 172.16.0.220:3260 --login" returned: 0 in 0.041s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:22:21 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[30ccba31-6149-4717-82fb-c2efdef1a4e9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5899a74c-fe20-449c-931e-6c303a675a1a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5899a74c-fe20-449c-931e-6c303a675a1a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:22:21 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dbeec73-f348-41dd-84a0-df78e754f8de tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5899a74c-fe20-449c-931e-6c303a675a1a, portal: 172.16.0.220,3260]
Nov 28 16:22:21 user nova-compute[75176]: Login to [iface: default, target: iqn.2010-10.org.openstack:5899a74c-fe20-449c-931e-6c303a675a1a, portal: 172.16.0.220,3260] successful.
Nov 28 16:22:21 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 16:22:21 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5899a74c-fe20-449c-931e-6c303a675a1a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:22:22 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5899a74c-fe20-449c-931e-6c303a675a1a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:22:22 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[a69a7a57-c1de-49f9-8032-fffb787fe882]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:22:22 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dbeec73-f348-41dd-84a0-df78e754f8de tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 16:22:22 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:22:22 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:22:22 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4ba5034-369f-4a3f-9418-3a54fb2db0a8]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5899a74c-fe20-449c-931e-6c303a675a1a (non-flash)\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:22:22 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dbeec73-f348-41dd-84a0-df78e754f8de tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5899a74c-fe20-449c-931e-6c303a675a1a (non-flash)
Nov 28 16:22:22 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 16:22:22 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dbeec73-f348-41dd-84a0-df78e754f8de tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5899a74c-fe20-449c-931e-6c303a675a1a (non-flash)
Nov 28 16:22:22 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 16:22:22 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-7dbeec73-f348-41dd-84a0-df78e754f8de tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5899a74c-fe20-449c-931e-6c303a675a1a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.236s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 16:22:22 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dbeec73-f348-41dd-84a0-df78e754f8de tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Connected to 172.16.0.220:3260 {{(pid=75176) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 16:22:22 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-7dbeec73-f348-41dd-84a0-df78e754f8de tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] HCTL ('33', '-', '-', 0) found on session 69 with lun 0 {{(pid=75176) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 16:22:22 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-7dbeec73-f348-41dd-84a0-df78e754f8de tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75176) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 16:22:22 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:22:22 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:22:22 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[f57c23d0-5a62-4608-93c9-df5fdf18b72f]: (4, ('- - 0', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:22:22 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-7dbeec73-f348-41dd-84a0-df78e754f8de tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Searching for a device in session 69 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75176) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 16:22:22 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dbeec73-f348-41dd-84a0-df78e754f8de tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:5899a74c-fe20-449c-931e-6c303a675a1a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MTUsmDJi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75176) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 16:22:22 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:22:23 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-7dbeec73-f348-41dd-84a0-df78e754f8de tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.264s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 16:22:23 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dbeec73-f348-41dd-84a0-df78e754f8de tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] <== connect_volume: return (1266ms) {'type': 'block', 'scsi_wwn': '23533323133353238', 'path': '/dev/sdb'} {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 16:22:23 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7dbeec73-f348-41dd-84a0-df78e754f8de tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] [instance: 4f1d73b0-4c94-47f4-87e0-1546057dbcc6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23533323133353238', 'path': '/dev/sdb'} {{(pid=75176) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 16:22:23 user nova-compute[75176]: DEBUG nova.objects.instance [None req-7dbeec73-f348-41dd-84a0-df78e754f8de tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Lazy-loading 'flavor' on Instance uuid 4f1d73b0-4c94-47f4-87e0-1546057dbcc6 {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 16:22:23 user nova-compute[75176]: DEBUG nova.virt.libvirt.guest [None req-7dbeec73-f348-41dd-84a0-df78e754f8de tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 16:22:23 user nova-compute[75176]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 16:22:23 user nova-compute[75176]:   <source dev="/dev/sdb"/>
Nov 28 16:22:23 user nova-compute[75176]:   <target dev="vdb" bus="virtio"/>
Nov 28 16:22:23 user nova-compute[75176]:   <serial>5899a74c-fe20-449c-931e-6c303a675a1a</serial>
Nov 28 16:22:23 user nova-compute[75176]: </disk>
Nov 28 16:22:23 user nova-compute[75176]:  {{(pid=75176) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 16:22:23 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:22:23 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-7dbeec73-f348-41dd-84a0-df78e754f8de tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] No BDM found with device name vda, not building metadata. {{(pid=75176) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 16:22:23 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-7dbeec73-f348-41dd-84a0-df78e754f8de tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75176) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 16:22:23 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-7dbeec73-f348-41dd-84a0-df78e754f8de tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] No VIF found with MAC fa:16:3e:be:c4:32, not building metadata {{(pid=75176) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 16:22:23 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7dbeec73-f348-41dd-84a0-df78e754f8de tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Lock "4f1d73b0-4c94-47f4-87e0-1546057dbcc6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.591s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:22:25 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:22:26 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-e3f48244-3730-4ed1-a13d-c087b8ba07e1 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Acquiring lock "4f1d73b0-4c94-47f4-87e0-1546057dbcc6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:22:26 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-e3f48244-3730-4ed1-a13d-c087b8ba07e1 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Lock "4f1d73b0-4c94-47f4-87e0-1546057dbcc6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:22:26 user nova-compute[75176]: INFO nova.compute.manager [None req-e3f48244-3730-4ed1-a13d-c087b8ba07e1 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] [instance: 4f1d73b0-4c94-47f4-87e0-1546057dbcc6] Detaching volume 5899a74c-fe20-449c-931e-6c303a675a1a
Nov 28 16:22:26 user nova-compute[75176]: INFO nova.virt.block_device [None req-e3f48244-3730-4ed1-a13d-c087b8ba07e1 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] [instance: 4f1d73b0-4c94-47f4-87e0-1546057dbcc6] Attempting to driver detach volume 5899a74c-fe20-449c-931e-6c303a675a1a from mountpoint /dev/vdb
Nov 28 16:22:26 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-e3f48244-3730-4ed1-a13d-c087b8ba07e1 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Attempting to detach device vdb from instance 4f1d73b0-4c94-47f4-87e0-1546057dbcc6 from the persistent domain config. {{(pid=75176) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 16:22:26 user nova-compute[75176]: DEBUG nova.virt.libvirt.guest [None req-e3f48244-3730-4ed1-a13d-c087b8ba07e1 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 16:22:26 user nova-compute[75176]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 16:22:26 user nova-compute[75176]:   <source dev="/dev/sdb"/>
Nov 28 16:22:26 user nova-compute[75176]:   <target dev="vdb" bus="virtio"/>
Nov 28 16:22:26 user nova-compute[75176]:   <serial>5899a74c-fe20-449c-931e-6c303a675a1a</serial>
Nov 28 16:22:26 user nova-compute[75176]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 16:22:26 user nova-compute[75176]: </disk>
Nov 28 16:22:26 user nova-compute[75176]:  {{(pid=75176) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 16:22:26 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-e3f48244-3730-4ed1-a13d-c087b8ba07e1 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Successfully detached device vdb from instance 4f1d73b0-4c94-47f4-87e0-1546057dbcc6 from the persistent domain config.
Nov 28 16:22:26 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-e3f48244-3730-4ed1-a13d-c087b8ba07e1 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4f1d73b0-4c94-47f4-87e0-1546057dbcc6 from the live domain config. {{(pid=75176) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 16:22:26 user nova-compute[75176]: DEBUG nova.virt.libvirt.guest [None req-e3f48244-3730-4ed1-a13d-c087b8ba07e1 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 16:22:26 user nova-compute[75176]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 16:22:26 user nova-compute[75176]:   <source dev="/dev/sdb"/>
Nov 28 16:22:26 user nova-compute[75176]:   <target dev="vdb" bus="virtio"/>
Nov 28 16:22:26 user nova-compute[75176]:   <serial>5899a74c-fe20-449c-931e-6c303a675a1a</serial>
Nov 28 16:22:26 user nova-compute[75176]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 16:22:26 user nova-compute[75176]: </disk>
Nov 28 16:22:26 user nova-compute[75176]:  {{(pid=75176) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 16:22:27 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-e3f48244-3730-4ed1-a13d-c087b8ba07e1 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4f1d73b0-4c94-47f4-87e0-1546057dbcc6 {{(pid=75176) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 16:22:27 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:22:27 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:22:27 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75176) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 16:22:28 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:22:30 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:22:30 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:22:31 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:22:31 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Starting heal instance info cache {{(pid=75176) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 16:22:31 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Rebuilding the list of instances to heal {{(pid=75176) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 16:22:31 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquiring lock "refresh_cache-4f1d73b0-4c94-47f4-87e0-1546057dbcc6" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 16:22:31 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquired lock "refresh_cache-4f1d73b0-4c94-47f4-87e0-1546057dbcc6" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 16:22:31 user nova-compute[75176]: DEBUG nova.network.neutron [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] [instance: 4f1d73b0-4c94-47f4-87e0-1546057dbcc6] Forcefully refreshing network info cache for instance {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 16:22:31 user nova-compute[75176]: DEBUG nova.objects.instance [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lazy-loading 'info_cache' on Instance uuid 4f1d73b0-4c94-47f4-87e0-1546057dbcc6 {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 16:22:32 user nova-compute[75176]: DEBUG nova.network.neutron [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] [instance: 4f1d73b0-4c94-47f4-87e0-1546057dbcc6] Updating instance_info_cache with network_info: [{"id": "8e18e2a6-ee7e-4be2-8ffc-9b1c0c19c14f", "address": "fa:16:3e:be:c4:32", "network": {"id": "a7e97163-1481-4c1e-a7f0-8337451faa28", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-75224014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0061e3132e644211b0b252d75eca3cda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e18e2a6-ee", "ovs_interfaceid": "8e18e2a6-ee7e-4be2-8ffc-9b1c0c19c14f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 16:22:32 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Releasing lock "refresh_cache-4f1d73b0-4c94-47f4-87e0-1546057dbcc6" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 16:22:32 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] [instance: 4f1d73b0-4c94-47f4-87e0-1546057dbcc6] Updated the network info_cache for instance {{(pid=75176) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 16:22:33 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:22:35 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:22:38 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 16:22:38 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:22:38 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75176) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 16:22:38 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75176) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 16:22:38 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75176) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 16:22:38 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:22:38 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:22:38 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:22:38 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:22:38 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:22:38 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Auditing locally available compute resources for user (node: user) {{(pid=75176) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 16:22:38 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f1d73b0-4c94-47f4-87e0-1546057dbcc6/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:22:38 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f1d73b0-4c94-47f4-87e0-1546057dbcc6/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:22:38 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f1d73b0-4c94-47f4-87e0-1546057dbcc6/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:22:39 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f1d73b0-4c94-47f4-87e0-1546057dbcc6/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:22:39 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 16:22:39 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 16:22:39 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Hypervisor/Node resource view: name=user free_ram=9047MB free_disk=25.022293090820312GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75176) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 16:22:39 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:22:39 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:22:39 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance 4f1d73b0-4c94-47f4-87e0-1546057dbcc6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 16:22:39 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75176) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 16:22:39 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75176) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 16:22:39 user nova-compute[75176]: DEBUG nova.compute.provider_tree [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Inventory has not changed in ProviderTree for provider: b37848d8-f401-4155-a029-b0ffa09ff85b {{(pid=75176) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 16:22:39 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Inventory has not changed for provider b37848d8-f401-4155-a029-b0ffa09ff85b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75176) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 16:22:39 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Compute_service record updated for user:user {{(pid=75176) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 16:22:39 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.165s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:22:43 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 16:22:47 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-e3f48244-3730-4ed1-a13d-c087b8ba07e1 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 4f1d73b0-4c94-47f4-87e0-1546057dbcc6 is timed out.
Nov 28 16:22:47 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-e3f48244-3730-4ed1-a13d-c087b8ba07e1 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Successfully detached device vdb from instance 4f1d73b0-4c94-47f4-87e0-1546057dbcc6 from the live domain config.
Nov 28 16:22:47 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e3f48244-3730-4ed1-a13d-c087b8ba07e1 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] [instance: 4f1d73b0-4c94-47f4-87e0-1546057dbcc6] calling os-brick to detach iSCSI Volume {{(pid=75176) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 16:22:47 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3f48244-3730-4ed1-a13d-c087b8ba07e1 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c1b8a00>, {'target_iqn': 'iqn.2010-10.org.openstack:5899a74c-fe20-449c-931e-6c303a675a1a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MTUsmDJi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 16:22:47 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-e3f48244-3730-4ed1-a13d-c087b8ba07e1 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 16:22:47 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-e3f48244-3730-4ed1-a13d-c087b8ba07e1 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 16:22:47 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-e3f48244-3730-4ed1-a13d-c087b8ba07e1 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 16:22:47 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:22:47 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:22:47 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7ba0ed4-39a7-4c88-a21c-551ae3290d83]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5899a74c-fe20-449c-931e-6c303a675a1a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:22:47 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3f48244-3730-4ed1-a13d-c087b8ba07e1 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 16:22:47 user nova-compute[75176]: No targets found.
Nov 28 16:22:47 user nova-compute[75176]: iSNS:
Nov 28 16:22:47 user nova-compute[75176]: No targets found.
Nov 28 16:22:47 user nova-compute[75176]: STATIC:
Nov 28 16:22:47 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:5899a74c-fe20-449c-931e-6c303a675a1a
Nov 28 16:22:47 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 16:22:47 user nova-compute[75176]:                 Iface Name: default
Nov 28 16:22:47 user nova-compute[75176]: FIRMWARE:
Nov 28 16:22:47 user nova-compute[75176]: No targets found.
Nov 28 16:22:47 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 16:22:47 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3f48244-3730-4ed1-a13d-c087b8ba07e1 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 16:22:47 user nova-compute[75176]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 16:22:47 user nova-compute[75176]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75176) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 16:22:47 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3f48244-3730-4ed1-a13d-c087b8ba07e1 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5899a74c-fe20-449c-931e-6c303a675a1a', 0)] {{(pid=75176) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 16:22:47 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:22:47 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:22:47 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fe1c234-d3d1-413c-ade1-9c866c551cad]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5899a74c-fe20-449c-931e-6c303a675a1a\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:22:47 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:22:47 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:22:47 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa1e4d71-ac9b-4ff5-91c3-f63946325e4d]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5899a74c-fe20-449c-931e-6c303a675a1a (non-flash)\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:22:47 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3f48244-3730-4ed1-a13d-c087b8ba07e1 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5899a74c-fe20-449c-931e-6c303a675a1a (non-flash)
Nov 28 16:22:47 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 16:22:47 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3f48244-3730-4ed1-a13d-c087b8ba07e1 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5899a74c-fe20-449c-931e-6c303a675a1a (non-flash)
Nov 28 16:22:47 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 16:22:47 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3f48244-3730-4ed1-a13d-c087b8ba07e1 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f462c6aedd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5899a74c-fe20-449c-931e-6c303a675a1a'): ({'sdb'}, set())}) {{(pid=75176) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 16:22:47 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-e3f48244-3730-4ed1-a13d-c087b8ba07e1 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Removing single pathed devices sdb {{(pid=75176) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 16:22:47 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:22:47 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:22:47 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[54d8e68a-2555-4eba-bb98-75c8c3db9bb1]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:22:47 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:22:47 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:22:47 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a2cd2a0-73af-4a8b-91f3-2386ff16f8e6]: (4, ('ok\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:22:47 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-e3f48244-3730-4ed1-a13d-c087b8ba07e1 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Flushing IO for device /dev/sdb {{(pid=75176) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 16:22:47 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:22:47 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:22:47 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[664d6dc8-347d-45ac-9e39-dbaa00b94dae]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:22:47 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-e3f48244-3730-4ed1-a13d-c087b8ba07e1 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75176) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 16:22:47 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:22:47 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.053s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:22:47 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[e496b5dc-6228-45ec-806f-5bfcec9af417]: (4, ('1', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:22:47 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-e3f48244-3730-4ed1-a13d-c087b8ba07e1 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75176) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 16:22:47 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-e3f48244-3730-4ed1-a13d-c087b8ba07e1 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] SCSI volumes sdb have been removed. {{(pid=75176) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 16:22:47 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3f48244-3730-4ed1-a13d-c087b8ba07e1 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5899a74c-fe20-449c-931e-6c303a675a1a')] {{(pid=75176) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 16:22:47 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5899a74c-fe20-449c-931e-6c303a675a1a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:22:47 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5899a74c-fe20-449c-931e-6c303a675a1a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:22:47 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2253c63-4767-41ca-b4be-96359e362dfd]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:22:47 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3f48244-3730-4ed1-a13d-c087b8ba07e1 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 16:22:47 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5899a74c-fe20-449c-931e-6c303a675a1a -p 172.16.0.220:3260 --logout {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:22:47 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5899a74c-fe20-449c-931e-6c303a675a1a -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:22:47 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[b00aea87-0406-4420-8656-7c852b9e58e8]: (4, ('Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:5899a74c-fe20-449c-931e-6c303a675a1a, portal: 172.16.0.220,3260]\nLogout of [sid: 69, target: iqn.2010-10.org.openstack:5899a74c-fe20-449c-931e-6c303a675a1a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:22:47 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3f48244-3730-4ed1-a13d-c087b8ba07e1 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:5899a74c-fe20-449c-931e-6c303a675a1a, portal: 172.16.0.220,3260]
Nov 28 16:22:47 user nova-compute[75176]: Logout of [sid: 69, target: iqn.2010-10.org.openstack:5899a74c-fe20-449c-931e-6c303a675a1a, portal: 172.16.0.220,3260] successful.
Nov 28 16:22:47 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 16:22:47 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5899a74c-fe20-449c-931e-6c303a675a1a -p 172.16.0.220:3260 --op delete {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:22:47 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5899a74c-fe20-449c-931e-6c303a675a1a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:22:47 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[a18d0247-f127-4d56-b5b9-1e37adc5fb75]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:22:47 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3f48244-3730-4ed1-a13d-c087b8ba07e1 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 16:22:47 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-e3f48244-3730-4ed1-a13d-c087b8ba07e1 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.296s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 16:22:47 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3f48244-3730-4ed1-a13d-c087b8ba07e1 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] <== disconnect_volume: return (298ms) None {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 16:22:47 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e3f48244-3730-4ed1-a13d-c087b8ba07e1 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] [instance: 4f1d73b0-4c94-47f4-87e0-1546057dbcc6] Disconnected iSCSI Volume {{(pid=75176) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 16:22:48 user nova-compute[75176]: DEBUG nova.objects.instance [None req-e3f48244-3730-4ed1-a13d-c087b8ba07e1 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Lazy-loading 'flavor' on Instance uuid 4f1d73b0-4c94-47f4-87e0-1546057dbcc6 {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 16:22:48 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:22:48 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-e3f48244-3730-4ed1-a13d-c087b8ba07e1 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Lock "4f1d73b0-4c94-47f4-87e0-1546057dbcc6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.756s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:22:53 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:22:58 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:23:03 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:23:08 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:23:13 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:23:18 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:23:19 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-54ba1ddc-592b-4325-90e0-b4847cef4df9 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Acquiring lock "4f1d73b0-4c94-47f4-87e0-1546057dbcc6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:23:19 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-54ba1ddc-592b-4325-90e0-b4847cef4df9 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Lock "4f1d73b0-4c94-47f4-87e0-1546057dbcc6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:23:19 user nova-compute[75176]: DEBUG nova.objects.instance [None req-54ba1ddc-592b-4325-90e0-b4847cef4df9 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Lazy-loading 'flavor' on Instance uuid 4f1d73b0-4c94-47f4-87e0-1546057dbcc6 {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 16:23:20 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-54ba1ddc-592b-4325-90e0-b4847cef4df9 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Lock "4f1d73b0-4c94-47f4-87e0-1546057dbcc6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:23:20 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-54ba1ddc-592b-4325-90e0-b4847cef4df9 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Acquiring lock "4f1d73b0-4c94-47f4-87e0-1546057dbcc6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:23:20 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-54ba1ddc-592b-4325-90e0-b4847cef4df9 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Lock "4f1d73b0-4c94-47f4-87e0-1546057dbcc6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:23:20 user nova-compute[75176]: INFO nova.compute.manager [None req-54ba1ddc-592b-4325-90e0-b4847cef4df9 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] [instance: 4f1d73b0-4c94-47f4-87e0-1546057dbcc6] Attaching volume 1e15cf28-6712-4317-b24c-660813481d54 to /dev/vdb
Nov 28 16:23:20 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:23:20 user nova-compute[75176]: DEBUG os_brick.utils [None req-54ba1ddc-592b-4325-90e0-b4847cef4df9 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 16:23:20 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:23:20 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:23:20 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6ce8a5d-eeab-4440-a30b-27d2dfbe14f2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:edc924a949b2\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:23:20 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:23:20 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:23:20 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc1a14cc-f4a6-48ac-88ce-2da74343019a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:23:20 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:23:20 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:23:20 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[bec829c6-6526-4350-b08a-18c753e61b5f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:23:20 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fae310a-5684-4433-b142-e57f064384b8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:23:20 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-54ba1ddc-592b-4325-90e0-b4847cef4df9 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Running cmd (subprocess): nvme version {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:23:20 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-54ba1ddc-592b-4325-90e0-b4847cef4df9 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] 'nvme version' failed. Not Retrying. {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 16:23:20 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.nvmeof [None req-54ba1ddc-592b-4325-90e0-b4847cef4df9 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] nvme not present on system {{(pid=75176) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 16:23:20 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:23:20 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 16:23:20 user nova-compute[75176]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 16:23:20 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[14fbc551-a5cd-4a82-baad-8e06e06e0677]: (4, '') {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:23:20 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.lightos [None req-54ba1ddc-592b-4325-90e0-b4847cef4df9 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75176) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 16:23:20 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.lightos [None req-54ba1ddc-592b-4325-90e0-b4847cef4df9 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75176) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 16:23:20 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.lightos [None req-54ba1ddc-592b-4325-90e0-b4847cef4df9 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] LIGHTOS: no hostnqn found. {{(pid=75176) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 16:23:20 user nova-compute[75176]: DEBUG os_brick.utils [None req-54ba1ddc-592b-4325-90e0-b4847cef4df9 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:edc924a949b2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 16:23:20 user nova-compute[75176]: DEBUG nova.virt.block_device [None req-54ba1ddc-592b-4325-90e0-b4847cef4df9 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] [instance: 4f1d73b0-4c94-47f4-87e0-1546057dbcc6] Updating existing volume attachment record: 190f525d-376c-4843-903a-94dc8b2cdacc {{(pid=75176) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 16:23:23 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:23:23 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:23:23 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:23:24 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:23:25 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:23:26 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-54ba1ddc-592b-4325-90e0-b4847cef4df9 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] [instance: 4f1d73b0-4c94-47f4-87e0-1546057dbcc6] Calling os-brick to attach iSCSI Volume {{(pid=75176) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 16:23:26 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-54ba1ddc-592b-4325-90e0-b4847cef4df9 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c1b8a00>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1e15cf28-6712-4317-b24c-660813481d54', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IyWrEMxp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 16:23:26 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-54ba1ddc-592b-4325-90e0-b4847cef4df9 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 16:23:26 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-54ba1ddc-592b-4325-90e0-b4847cef4df9 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 16:23:26 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-54ba1ddc-592b-4325-90e0-b4847cef4df9 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 16:23:26 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-54ba1ddc-592b-4325-90e0-b4847cef4df9 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 16:23:26 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-54ba1ddc-592b-4325-90e0-b4847cef4df9 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1e15cf28-6712-4317-b24c-660813481d54" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 16:23:26 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-54ba1ddc-592b-4325-90e0-b4847cef4df9 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1e15cf28-6712-4317-b24c-660813481d54" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 16:23:26 user nova-compute[75176]: INFO os_brick.initiator.connectors.iscsi [None req-54ba1ddc-592b-4325-90e0-b4847cef4df9 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 16:23:26 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e15cf28-6712-4317-b24c-660813481d54 -p 172.16.0.220:3260 {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:23:26 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e15cf28-6712-4317-b24c-660813481d54 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:23:26 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[edbaeee4-f0a3-4002-9852-9ce5287f5a9e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:23:26 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-54ba1ddc-592b-4325-90e0-b4847cef4df9 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 16:23:26 user nova-compute[75176]:  {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 16:23:26 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e15cf28-6712-4317-b24c-660813481d54 -p 172.16.0.220:3260 --interface default --op new {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:23:26 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e15cf28-6712-4317-b24c-660813481d54 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:23:26 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[67013316-e57c-47ab-81cc-4cd595e8230a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1e15cf28-6712-4317-b24c-660813481d54] added\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:23:26 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-54ba1ddc-592b-4325-90e0-b4847cef4df9 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1e15cf28-6712-4317-b24c-660813481d54] added
Nov 28 16:23:26 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 16:23:26 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e15cf28-6712-4317-b24c-660813481d54 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:23:26 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e15cf28-6712-4317-b24c-660813481d54 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:23:26 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[13eb102c-a27e-4d83-bcbb-d751c6966dc6]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:23:26 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-54ba1ddc-592b-4325-90e0-b4847cef4df9 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 16:23:26 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e15cf28-6712-4317-b24c-660813481d54 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:23:26 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e15cf28-6712-4317-b24c-660813481d54 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:23:26 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d4efd4c-17d3-4108-bd2b-f53ceb1eb885]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:23:26 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-54ba1ddc-592b-4325-90e0-b4847cef4df9 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 16:23:26 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e15cf28-6712-4317-b24c-660813481d54 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IyWrEMxp {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:23:27 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e15cf28-6712-4317-b24c-660813481d54 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IyWrEMxp" returned: 0 in 0.031s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:23:27 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a2067f5-f885-458f-a69d-09883ba09e2a]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:23:27 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-54ba1ddc-592b-4325-90e0-b4847cef4df9 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IyWrEMxp'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 16:23:27 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e15cf28-6712-4317-b24c-660813481d54 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:23:27 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e15cf28-6712-4317-b24c-660813481d54 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:23:27 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef5b79db-653b-48b1-995f-bea9ea44c53b]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:23:27 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-54ba1ddc-592b-4325-90e0-b4847cef4df9 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 16:23:27 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:23:27 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:23:27 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[c51eb54d-b903-435f-a6b9-c02a1757515f]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:23:27 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-54ba1ddc-592b-4325-90e0-b4847cef4df9 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 28 16:23:27 user nova-compute[75176]:  {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 16:23:27 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-54ba1ddc-592b-4325-90e0-b4847cef4df9 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 28 16:23:27 user nova-compute[75176]:  {{(pid=75176) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 16:23:27 user nova-compute[75176]: WARNING os_brick.initiator.connectors.iscsi [None req-54ba1ddc-592b-4325-90e0-b4847cef4df9 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 28 16:23:27 user nova-compute[75176]: 
Nov 28 16:23:27 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e15cf28-6712-4317-b24c-660813481d54 -p 172.16.0.220:3260 --login {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:23:27 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e15cf28-6712-4317-b24c-660813481d54 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:23:27 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb179c45-3550-4977-be5d-a20cb14611bb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1e15cf28-6712-4317-b24c-660813481d54, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1e15cf28-6712-4317-b24c-660813481d54, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:23:27 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-54ba1ddc-592b-4325-90e0-b4847cef4df9 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1e15cf28-6712-4317-b24c-660813481d54, portal: 172.16.0.220,3260]
Nov 28 16:23:27 user nova-compute[75176]: Login to [iface: default, target: iqn.2010-10.org.openstack:1e15cf28-6712-4317-b24c-660813481d54, portal: 172.16.0.220,3260] successful.
Nov 28 16:23:27 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 16:23:27 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e15cf28-6712-4317-b24c-660813481d54 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:23:27 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e15cf28-6712-4317-b24c-660813481d54 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:23:27 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a181367-a820-4fd7-9002-8f45e1eeb8fb]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:23:27 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-54ba1ddc-592b-4325-90e0-b4847cef4df9 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 16:23:27 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:23:27 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:23:27 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[7810ecce-e7de-478f-ac80-912533040134]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e15cf28-6712-4317-b24c-660813481d54 (non-flash)\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:23:27 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-54ba1ddc-592b-4325-90e0-b4847cef4df9 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e15cf28-6712-4317-b24c-660813481d54 (non-flash)
Nov 28 16:23:27 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 16:23:27 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-54ba1ddc-592b-4325-90e0-b4847cef4df9 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e15cf28-6712-4317-b24c-660813481d54 (non-flash)
Nov 28 16:23:27 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 16:23:27 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-54ba1ddc-592b-4325-90e0-b4847cef4df9 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1e15cf28-6712-4317-b24c-660813481d54" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.281s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 16:23:27 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-54ba1ddc-592b-4325-90e0-b4847cef4df9 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Connected to 172.16.0.220:3260 {{(pid=75176) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 16:23:27 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-54ba1ddc-592b-4325-90e0-b4847cef4df9 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] HCTL ('33', '-', '-', 0) found on session 70 with lun 0 {{(pid=75176) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 16:23:27 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-54ba1ddc-592b-4325-90e0-b4847cef4df9 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75176) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 16:23:27 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:23:27 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:23:27 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[de4a249e-7f35-496d-acf4-7b3c69852335]: (4, ('- - 0', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:23:27 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-54ba1ddc-592b-4325-90e0-b4847cef4df9 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Searching for a device in session 70 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75176) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 16:23:27 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-54ba1ddc-592b-4325-90e0-b4847cef4df9 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:1e15cf28-6712-4317-b24c-660813481d54', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IyWrEMxp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75176) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 16:23:28 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-54ba1ddc-592b-4325-90e0-b4847cef4df9 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.315s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 16:23:28 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-54ba1ddc-592b-4325-90e0-b4847cef4df9 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] <== connect_volume: return (1316ms) {'type': 'block', 'scsi_wwn': '23631656633336438', 'path': '/dev/sdb'} {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 16:23:28 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-54ba1ddc-592b-4325-90e0-b4847cef4df9 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] [instance: 4f1d73b0-4c94-47f4-87e0-1546057dbcc6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23631656633336438', 'path': '/dev/sdb'} {{(pid=75176) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 16:23:28 user nova-compute[75176]: DEBUG nova.objects.instance [None req-54ba1ddc-592b-4325-90e0-b4847cef4df9 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Lazy-loading 'flavor' on Instance uuid 4f1d73b0-4c94-47f4-87e0-1546057dbcc6 {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 16:23:28 user nova-compute[75176]: DEBUG nova.virt.libvirt.guest [None req-54ba1ddc-592b-4325-90e0-b4847cef4df9 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 16:23:28 user nova-compute[75176]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 16:23:28 user nova-compute[75176]:   <source dev="/dev/sdb"/>
Nov 28 16:23:28 user nova-compute[75176]:   <target dev="vdb" bus="virtio"/>
Nov 28 16:23:28 user nova-compute[75176]:   <serial>1e15cf28-6712-4317-b24c-660813481d54</serial>
Nov 28 16:23:28 user nova-compute[75176]: </disk>
Nov 28 16:23:28 user nova-compute[75176]:  {{(pid=75176) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 16:23:28 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:23:28 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-54ba1ddc-592b-4325-90e0-b4847cef4df9 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] No BDM found with device name vda, not building metadata. {{(pid=75176) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 16:23:28 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-54ba1ddc-592b-4325-90e0-b4847cef4df9 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75176) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 16:23:28 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-54ba1ddc-592b-4325-90e0-b4847cef4df9 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] No VIF found with MAC fa:16:3e:be:c4:32, not building metadata {{(pid=75176) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 16:23:28 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:23:28 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:23:28 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75176) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 16:23:28 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-54ba1ddc-592b-4325-90e0-b4847cef4df9 tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Lock "4f1d73b0-4c94-47f4-87e0-1546057dbcc6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.621s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:23:30 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:23:30 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-eb26689b-1b99-4dcd-8343-e77825d22bbb tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Acquiring lock "4f1d73b0-4c94-47f4-87e0-1546057dbcc6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:23:30 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-eb26689b-1b99-4dcd-8343-e77825d22bbb tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Lock "4f1d73b0-4c94-47f4-87e0-1546057dbcc6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:23:30 user nova-compute[75176]: INFO nova.compute.manager [None req-eb26689b-1b99-4dcd-8343-e77825d22bbb tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] [instance: 4f1d73b0-4c94-47f4-87e0-1546057dbcc6] Detaching volume 1e15cf28-6712-4317-b24c-660813481d54
Nov 28 16:23:31 user nova-compute[75176]: INFO nova.virt.block_device [None req-eb26689b-1b99-4dcd-8343-e77825d22bbb tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] [instance: 4f1d73b0-4c94-47f4-87e0-1546057dbcc6] Attempting to driver detach volume 1e15cf28-6712-4317-b24c-660813481d54 from mountpoint /dev/vdb
Nov 28 16:23:31 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-eb26689b-1b99-4dcd-8343-e77825d22bbb tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Attempting to detach device vdb from instance 4f1d73b0-4c94-47f4-87e0-1546057dbcc6 from the persistent domain config. {{(pid=75176) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 16:23:31 user nova-compute[75176]: DEBUG nova.virt.libvirt.guest [None req-eb26689b-1b99-4dcd-8343-e77825d22bbb tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 16:23:31 user nova-compute[75176]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 16:23:31 user nova-compute[75176]:   <source dev="/dev/sdb"/>
Nov 28 16:23:31 user nova-compute[75176]:   <target dev="vdb" bus="virtio"/>
Nov 28 16:23:31 user nova-compute[75176]:   <serial>1e15cf28-6712-4317-b24c-660813481d54</serial>
Nov 28 16:23:31 user nova-compute[75176]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 16:23:31 user nova-compute[75176]: </disk>
Nov 28 16:23:31 user nova-compute[75176]:  {{(pid=75176) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 16:23:31 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-eb26689b-1b99-4dcd-8343-e77825d22bbb tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Successfully detached device vdb from instance 4f1d73b0-4c94-47f4-87e0-1546057dbcc6 from the persistent domain config.
Nov 28 16:23:31 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-eb26689b-1b99-4dcd-8343-e77825d22bbb tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4f1d73b0-4c94-47f4-87e0-1546057dbcc6 from the live domain config. {{(pid=75176) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 16:23:31 user nova-compute[75176]: DEBUG nova.virt.libvirt.guest [None req-eb26689b-1b99-4dcd-8343-e77825d22bbb tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 16:23:31 user nova-compute[75176]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 16:23:31 user nova-compute[75176]:   <source dev="/dev/sdb"/>
Nov 28 16:23:31 user nova-compute[75176]:   <target dev="vdb" bus="virtio"/>
Nov 28 16:23:31 user nova-compute[75176]:   <serial>1e15cf28-6712-4317-b24c-660813481d54</serial>
Nov 28 16:23:31 user nova-compute[75176]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 16:23:31 user nova-compute[75176]: </disk>
Nov 28 16:23:31 user nova-compute[75176]:  {{(pid=75176) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 16:23:31 user nova-compute[75176]: DEBUG nova.virt.libvirt.driver [None req-eb26689b-1b99-4dcd-8343-e77825d22bbb tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4f1d73b0-4c94-47f4-87e0-1546057dbcc6 {{(pid=75176) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 16:23:31 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:23:33 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:23:33 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:23:33 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Starting heal instance info cache {{(pid=75176) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 16:23:33 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Rebuilding the list of instances to heal {{(pid=75176) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 16:23:33 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquiring lock "refresh_cache-4f1d73b0-4c94-47f4-87e0-1546057dbcc6" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 16:23:33 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquired lock "refresh_cache-4f1d73b0-4c94-47f4-87e0-1546057dbcc6" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 16:23:33 user nova-compute[75176]: DEBUG nova.network.neutron [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] [instance: 4f1d73b0-4c94-47f4-87e0-1546057dbcc6] Forcefully refreshing network info cache for instance {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 16:23:33 user nova-compute[75176]: DEBUG nova.objects.instance [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lazy-loading 'info_cache' on Instance uuid 4f1d73b0-4c94-47f4-87e0-1546057dbcc6 {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 16:23:34 user nova-compute[75176]: DEBUG nova.network.neutron [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] [instance: 4f1d73b0-4c94-47f4-87e0-1546057dbcc6] Updating instance_info_cache with network_info: [{"id": "8e18e2a6-ee7e-4be2-8ffc-9b1c0c19c14f", "address": "fa:16:3e:be:c4:32", "network": {"id": "a7e97163-1481-4c1e-a7f0-8337451faa28", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-75224014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0061e3132e644211b0b252d75eca3cda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e18e2a6-ee", "ovs_interfaceid": "8e18e2a6-ee7e-4be2-8ffc-9b1c0c19c14f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 16:23:34 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Releasing lock "refresh_cache-4f1d73b0-4c94-47f4-87e0-1546057dbcc6" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 16:23:34 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] [instance: 4f1d73b0-4c94-47f4-87e0-1546057dbcc6] Updated the network info_cache for instance {{(pid=75176) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 16:23:35 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:23:35 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:23:38 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:23:40 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:23:40 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:23:40 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:23:40 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:23:40 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Auditing locally available compute resources for user (node: user) {{(pid=75176) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 16:23:40 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f1d73b0-4c94-47f4-87e0-1546057dbcc6/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:23:40 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f1d73b0-4c94-47f4-87e0-1546057dbcc6/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:23:40 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f1d73b0-4c94-47f4-87e0-1546057dbcc6/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:23:41 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f1d73b0-4c94-47f4-87e0-1546057dbcc6/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:23:41 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 16:23:41 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 16:23:41 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Hypervisor/Node resource view: name=user free_ram=9030MB free_disk=25.02130889892578GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75176) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 16:23:41 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:23:41 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:23:41 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance 4f1d73b0-4c94-47f4-87e0-1546057dbcc6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 16:23:41 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75176) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 16:23:41 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75176) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 16:23:41 user nova-compute[75176]: DEBUG nova.compute.provider_tree [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Inventory has not changed in ProviderTree for provider: b37848d8-f401-4155-a029-b0ffa09ff85b {{(pid=75176) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 16:23:41 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Inventory has not changed for provider b37848d8-f401-4155-a029-b0ffa09ff85b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75176) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 16:23:41 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Compute_service record updated for user:user {{(pid=75176) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 16:23:41 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.176s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:23:43 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:23:47 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:23:48 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 16:23:51 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-eb26689b-1b99-4dcd-8343-e77825d22bbb tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 4f1d73b0-4c94-47f4-87e0-1546057dbcc6 is timed out.
Nov 28 16:23:51 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-eb26689b-1b99-4dcd-8343-e77825d22bbb tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Successfully detached device vdb from instance 4f1d73b0-4c94-47f4-87e0-1546057dbcc6 from the live domain config.
Nov 28 16:23:51 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eb26689b-1b99-4dcd-8343-e77825d22bbb tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] [instance: 4f1d73b0-4c94-47f4-87e0-1546057dbcc6] calling os-brick to detach iSCSI Volume {{(pid=75176) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 16:23:51 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb26689b-1b99-4dcd-8343-e77825d22bbb tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f464c1b8a00>, {'target_iqn': 'iqn.2010-10.org.openstack:1e15cf28-6712-4317-b24c-660813481d54', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IyWrEMxp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 16:23:51 user nova-compute[75176]: WARNING os_brick.initiator.connectors.base [None req-eb26689b-1b99-4dcd-8343-e77825d22bbb tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 16:23:51 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-eb26689b-1b99-4dcd-8343-e77825d22bbb tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 16:23:51 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-eb26689b-1b99-4dcd-8343-e77825d22bbb tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 16:23:51 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:23:51 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:23:51 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[037f9b18-4eed-4992-ba71-ebcc634b8eb4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1e15cf28-6712-4317-b24c-660813481d54\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:23:51 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb26689b-1b99-4dcd-8343-e77825d22bbb tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 16:23:51 user nova-compute[75176]: No targets found.
Nov 28 16:23:51 user nova-compute[75176]: iSNS:
Nov 28 16:23:51 user nova-compute[75176]: No targets found.
Nov 28 16:23:51 user nova-compute[75176]: STATIC:
Nov 28 16:23:51 user nova-compute[75176]: Target: iqn.2010-10.org.openstack:1e15cf28-6712-4317-b24c-660813481d54
Nov 28 16:23:51 user nova-compute[75176]:         Portal: 172.16.0.220:3260,-1
Nov 28 16:23:51 user nova-compute[75176]:                 Iface Name: default
Nov 28 16:23:51 user nova-compute[75176]: FIRMWARE:
Nov 28 16:23:51 user nova-compute[75176]: No targets found.
Nov 28 16:23:51 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 16:23:51 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb26689b-1b99-4dcd-8343-e77825d22bbb tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 16:23:51 user nova-compute[75176]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 16:23:51 user nova-compute[75176]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75176) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 16:23:51 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb26689b-1b99-4dcd-8343-e77825d22bbb tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1e15cf28-6712-4317-b24c-660813481d54', 0)] {{(pid=75176) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 16:23:51 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:23:51 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:23:51 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[709d751f-4ded-474d-96c3-44439fa86409]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1e15cf28-6712-4317-b24c-660813481d54\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:23:51 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:23:51 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:23:51 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f560115-f199-4f02-94a0-f7f852683c36]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e15cf28-6712-4317-b24c-660813481d54 (non-flash)\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:23:51 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb26689b-1b99-4dcd-8343-e77825d22bbb tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e15cf28-6712-4317-b24c-660813481d54 (non-flash)
Nov 28 16:23:51 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 16:23:51 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb26689b-1b99-4dcd-8343-e77825d22bbb tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e15cf28-6712-4317-b24c-660813481d54 (non-flash)
Nov 28 16:23:51 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 16:23:51 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb26689b-1b99-4dcd-8343-e77825d22bbb tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f464c3a2c20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1e15cf28-6712-4317-b24c-660813481d54'): ({'sdb'}, set())}) {{(pid=75176) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 16:23:51 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-eb26689b-1b99-4dcd-8343-e77825d22bbb tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Removing single pathed devices sdb {{(pid=75176) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 16:23:51 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:23:51 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:23:51 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[b50140e4-78b2-4cff-a114-13e0a74b3458]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:23:51 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:23:51 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:23:51 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[282a3b51-b1ed-428b-988b-c186842fd811]: (4, ('ok\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:23:51 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-eb26689b-1b99-4dcd-8343-e77825d22bbb tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Flushing IO for device /dev/sdb {{(pid=75176) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 16:23:51 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:23:51 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:23:51 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[10700f45-1064-401a-b382-25ed1a147e1a]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:23:51 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-eb26689b-1b99-4dcd-8343-e77825d22bbb tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75176) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 16:23:51 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:23:51 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.055s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:23:51 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4b3691c-ee63-4e20-aea5-fa40c70678bc]: (4, ('1', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:23:51 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-eb26689b-1b99-4dcd-8343-e77825d22bbb tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75176) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 16:23:51 user nova-compute[75176]: DEBUG os_brick.initiator.linuxscsi [None req-eb26689b-1b99-4dcd-8343-e77825d22bbb tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] SCSI volumes sdb have been removed. {{(pid=75176) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 16:23:51 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb26689b-1b99-4dcd-8343-e77825d22bbb tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1e15cf28-6712-4317-b24c-660813481d54')] {{(pid=75176) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 16:23:51 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e15cf28-6712-4317-b24c-660813481d54 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:23:51 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e15cf28-6712-4317-b24c-660813481d54 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:23:51 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a61fb7d-55cd-4554-851d-e09c447e712d]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:23:51 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb26689b-1b99-4dcd-8343-e77825d22bbb tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 16:23:51 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e15cf28-6712-4317-b24c-660813481d54 -p 172.16.0.220:3260 --logout {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:23:51 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e15cf28-6712-4317-b24c-660813481d54 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:23:51 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[6986d9e6-0050-4a90-98bf-6237e18e4484]: (4, ('Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:1e15cf28-6712-4317-b24c-660813481d54, portal: 172.16.0.220,3260]\nLogout of [sid: 70, target: iqn.2010-10.org.openstack:1e15cf28-6712-4317-b24c-660813481d54, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:23:51 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb26689b-1b99-4dcd-8343-e77825d22bbb tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:1e15cf28-6712-4317-b24c-660813481d54, portal: 172.16.0.220,3260]
Nov 28 16:23:51 user nova-compute[75176]: Logout of [sid: 70, target: iqn.2010-10.org.openstack:1e15cf28-6712-4317-b24c-660813481d54, portal: 172.16.0.220,3260] successful.
Nov 28 16:23:51 user nova-compute[75176]:  stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 16:23:51 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e15cf28-6712-4317-b24c-660813481d54 -p 172.16.0.220:3260 --op delete {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:23:51 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e15cf28-6712-4317-b24c-660813481d54 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85736) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:23:51 user nova-compute[75176]: DEBUG oslo.privsep.daemon [-] privsep: reply[01927890-7857-4d27-a443-64a499dd66e6]: (4, ('', '')) {{(pid=85736) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 16:23:51 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb26689b-1b99-4dcd-8343-e77825d22bbb tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75176) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 16:23:51 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.base [None req-eb26689b-1b99-4dcd-8343-e77825d22bbb tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.315s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 16:23:51 user nova-compute[75176]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb26689b-1b99-4dcd-8343-e77825d22bbb tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] <== disconnect_volume: return (317ms) None {{(pid=75176) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 16:23:51 user nova-compute[75176]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eb26689b-1b99-4dcd-8343-e77825d22bbb tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] [instance: 4f1d73b0-4c94-47f4-87e0-1546057dbcc6] Disconnected iSCSI Volume {{(pid=75176) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 16:23:52 user nova-compute[75176]: DEBUG nova.objects.instance [None req-eb26689b-1b99-4dcd-8343-e77825d22bbb tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Lazy-loading 'flavor' on Instance uuid 4f1d73b0-4c94-47f4-87e0-1546057dbcc6 {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 16:23:52 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-eb26689b-1b99-4dcd-8343-e77825d22bbb tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Lock "4f1d73b0-4c94-47f4-87e0-1546057dbcc6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.850s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:23:53 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:23:58 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:24:03 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:24:08 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:24:13 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:24:18 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:24:23 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:24:23 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:24:24 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:24:26 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:24:28 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:24:30 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:24:30 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:24:30 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75176) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 16:24:33 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:24:33 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:24:33 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Starting heal instance info cache {{(pid=75176) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 16:24:33 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Rebuilding the list of instances to heal {{(pid=75176) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 16:24:33 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquiring lock "refresh_cache-4f1d73b0-4c94-47f4-87e0-1546057dbcc6" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 16:24:33 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquired lock "refresh_cache-4f1d73b0-4c94-47f4-87e0-1546057dbcc6" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 16:24:33 user nova-compute[75176]: DEBUG nova.network.neutron [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] [instance: 4f1d73b0-4c94-47f4-87e0-1546057dbcc6] Forcefully refreshing network info cache for instance {{(pid=75176) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 16:24:33 user nova-compute[75176]: DEBUG nova.objects.instance [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lazy-loading 'info_cache' on Instance uuid 4f1d73b0-4c94-47f4-87e0-1546057dbcc6 {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 16:24:34 user nova-compute[75176]: DEBUG nova.network.neutron [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] [instance: 4f1d73b0-4c94-47f4-87e0-1546057dbcc6] Updating instance_info_cache with network_info: [{"id": "8e18e2a6-ee7e-4be2-8ffc-9b1c0c19c14f", "address": "fa:16:3e:be:c4:32", "network": {"id": "a7e97163-1481-4c1e-a7f0-8337451faa28", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-75224014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0061e3132e644211b0b252d75eca3cda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e18e2a6-ee", "ovs_interfaceid": "8e18e2a6-ee7e-4be2-8ffc-9b1c0c19c14f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 16:24:34 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Releasing lock "refresh_cache-4f1d73b0-4c94-47f4-87e0-1546057dbcc6" {{(pid=75176) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 16:24:34 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] [instance: 4f1d73b0-4c94-47f4-87e0-1546057dbcc6] Updated the network info_cache for instance {{(pid=75176) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 16:24:34 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:24:37 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:24:38 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:24:42 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:24:42 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:24:42 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:24:42 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:24:42 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Auditing locally available compute resources for user (node: user) {{(pid=75176) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 16:24:42 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f1d73b0-4c94-47f4-87e0-1546057dbcc6/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:24:42 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f1d73b0-4c94-47f4-87e0-1546057dbcc6/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:24:42 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f1d73b0-4c94-47f4-87e0-1546057dbcc6/disk --force-share --output=json {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 16:24:43 user nova-compute[75176]: DEBUG oslo_concurrency.processutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f1d73b0-4c94-47f4-87e0-1546057dbcc6/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75176) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 16:24:43 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 16:24:43 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 16:24:43 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Hypervisor/Node resource view: name=user free_ram=9036MB free_disk=25.02039337158203GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75176) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 16:24:43 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:24:43 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:24:43 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:24:43 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Instance 4f1d73b0-4c94-47f4-87e0-1546057dbcc6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75176) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 16:24:43 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75176) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 16:24:43 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75176) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 16:24:43 user nova-compute[75176]: DEBUG nova.compute.provider_tree [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Inventory has not changed in ProviderTree for provider: b37848d8-f401-4155-a029-b0ffa09ff85b {{(pid=75176) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 16:24:43 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Inventory has not changed for provider b37848d8-f401-4155-a029-b0ffa09ff85b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75176) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 16:24:43 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Compute_service record updated for user:user {{(pid=75176) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 16:24:43 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.194s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:24:44 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-602889e8-7d5d-437a-a66b-24275e158aff tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Acquiring lock "4f1d73b0-4c94-47f4-87e0-1546057dbcc6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:24:44 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-602889e8-7d5d-437a-a66b-24275e158aff tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Lock "4f1d73b0-4c94-47f4-87e0-1546057dbcc6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:24:44 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-602889e8-7d5d-437a-a66b-24275e158aff tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Acquiring lock "4f1d73b0-4c94-47f4-87e0-1546057dbcc6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:24:44 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-602889e8-7d5d-437a-a66b-24275e158aff tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Lock "4f1d73b0-4c94-47f4-87e0-1546057dbcc6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:24:44 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-602889e8-7d5d-437a-a66b-24275e158aff tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Lock "4f1d73b0-4c94-47f4-87e0-1546057dbcc6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:24:44 user nova-compute[75176]: INFO nova.compute.manager [None req-602889e8-7d5d-437a-a66b-24275e158aff tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] [instance: 4f1d73b0-4c94-47f4-87e0-1546057dbcc6] Terminating instance
Nov 28 16:24:44 user nova-compute[75176]: DEBUG nova.compute.manager [None req-602889e8-7d5d-437a-a66b-24275e158aff tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] [instance: 4f1d73b0-4c94-47f4-87e0-1546057dbcc6] Start destroying the instance on the hypervisor. {{(pid=75176) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 16:24:44 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:24:44 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:24:44 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:24:44 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:24:45 user nova-compute[75176]: INFO nova.virt.libvirt.driver [-] [instance: 4f1d73b0-4c94-47f4-87e0-1546057dbcc6] Instance destroyed successfully.
Nov 28 16:24:45 user nova-compute[75176]: DEBUG nova.objects.instance [None req-602889e8-7d5d-437a-a66b-24275e158aff tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Lazy-loading 'resources' on Instance uuid 4f1d73b0-4c94-47f4-87e0-1546057dbcc6 {{(pid=75176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 16:24:45 user nova-compute[75176]: DEBUG nova.virt.libvirt.vif [None req-602889e8-7d5d-437a-a66b-24275e158aff tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T16:17:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1339573268',display_name='tempest-SnapshotDataIntegrityTests-server-1339573268',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1339573268',id=53,image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMzzLzTSk0Cc5meX1dIbW+y9p1qp4f4l8VNGcCuHp/NhVw+DKI5Z6ODe5hOV0ijx+y0NxoTd4H/KowKErZ9rwm0urBBVgo0DUaIA1rL/wuORowHZEpeAGAdwnobJ2ijYrQ==',key_name='tempest-keypair-484651644',keypairs=<?>,launch_index=0,launched_at=2023-11-28T16:18:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0061e3132e644211b0b252d75eca3cda',ramdisk_id='',reservation_id='r-s7p71i5n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1f41819e-c93f-4dc7-b253-37a27bbbbc74',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-317674187',owner_user_name='tempest-SnapshotDataIntegrityTests-317674187-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T16:18:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9fe189a399c8497bb103dc79495444a4',uuid=4f1d73b0-4c94-47f4-87e0-1546057dbcc6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8e18e2a6-ee7e-4be2-8ffc-9b1c0c19c14f", "address": "fa:16:3e:be:c4:32", "network": {"id": "a7e97163-1481-4c1e-a7f0-8337451faa28", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-75224014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0061e3132e644211b0b252d75eca3cda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e18e2a6-ee", "ovs_interfaceid": "8e18e2a6-ee7e-4be2-8ffc-9b1c0c19c14f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 16:24:45 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-602889e8-7d5d-437a-a66b-24275e158aff tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Converting VIF {"id": "8e18e2a6-ee7e-4be2-8ffc-9b1c0c19c14f", "address": "fa:16:3e:be:c4:32", "network": {"id": "a7e97163-1481-4c1e-a7f0-8337451faa28", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-75224014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0061e3132e644211b0b252d75eca3cda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e18e2a6-ee", "ovs_interfaceid": "8e18e2a6-ee7e-4be2-8ffc-9b1c0c19c14f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 16:24:45 user nova-compute[75176]: DEBUG nova.network.os_vif_util [None req-602889e8-7d5d-437a-a66b-24275e158aff tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:be:c4:32,bridge_name='br-int',has_traffic_filtering=True,id=8e18e2a6-ee7e-4be2-8ffc-9b1c0c19c14f,network=Network(a7e97163-1481-4c1e-a7f0-8337451faa28),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e18e2a6-ee') {{(pid=75176) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 16:24:45 user nova-compute[75176]: DEBUG os_vif [None req-602889e8-7d5d-437a-a66b-24275e158aff tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:be:c4:32,bridge_name='br-int',has_traffic_filtering=True,id=8e18e2a6-ee7e-4be2-8ffc-9b1c0c19c14f,network=Network(a7e97163-1481-4c1e-a7f0-8337451faa28),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e18e2a6-ee') {{(pid=75176) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 16:24:45 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:24:45 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8e18e2a6-ee, bridge=br-int, if_exists=True) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 16:24:45 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:24:45 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 16:24:45 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:24:45 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=825f66f9-09d1-4f10-8628-2be606f10dda) {{(pid=75176) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 16:24:45 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:24:45 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 16:24:45 user nova-compute[75176]: INFO os_vif [None req-602889e8-7d5d-437a-a66b-24275e158aff tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:be:c4:32,bridge_name='br-int',has_traffic_filtering=True,id=8e18e2a6-ee7e-4be2-8ffc-9b1c0c19c14f,network=Network(a7e97163-1481-4c1e-a7f0-8337451faa28),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e18e2a6-ee')
Nov 28 16:24:45 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-602889e8-7d5d-437a-a66b-24275e158aff tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] [instance: 4f1d73b0-4c94-47f4-87e0-1546057dbcc6] Deleting instance files /opt/stack/data/nova/instances/4f1d73b0-4c94-47f4-87e0-1546057dbcc6_del
Nov 28 16:24:45 user nova-compute[75176]: INFO nova.virt.libvirt.driver [None req-602889e8-7d5d-437a-a66b-24275e158aff tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] [instance: 4f1d73b0-4c94-47f4-87e0-1546057dbcc6] Deletion of /opt/stack/data/nova/instances/4f1d73b0-4c94-47f4-87e0-1546057dbcc6_del complete
Nov 28 16:24:45 user nova-compute[75176]: DEBUG nova.compute.manager [req-0776b919-c9a6-4e80-b322-a010e0f4b865 req-46344b2b-27f9-42d6-bf52-3ffd1b08785e service nova] [instance: 4f1d73b0-4c94-47f4-87e0-1546057dbcc6] Received event network-vif-unplugged-8e18e2a6-ee7e-4be2-8ffc-9b1c0c19c14f {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 16:24:45 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-0776b919-c9a6-4e80-b322-a010e0f4b865 req-46344b2b-27f9-42d6-bf52-3ffd1b08785e service nova] Acquiring lock "4f1d73b0-4c94-47f4-87e0-1546057dbcc6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:24:45 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-0776b919-c9a6-4e80-b322-a010e0f4b865 req-46344b2b-27f9-42d6-bf52-3ffd1b08785e service nova] Lock "4f1d73b0-4c94-47f4-87e0-1546057dbcc6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:24:45 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-0776b919-c9a6-4e80-b322-a010e0f4b865 req-46344b2b-27f9-42d6-bf52-3ffd1b08785e service nova] Lock "4f1d73b0-4c94-47f4-87e0-1546057dbcc6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:24:45 user nova-compute[75176]: DEBUG nova.compute.manager [req-0776b919-c9a6-4e80-b322-a010e0f4b865 req-46344b2b-27f9-42d6-bf52-3ffd1b08785e service nova] [instance: 4f1d73b0-4c94-47f4-87e0-1546057dbcc6] No waiting events found dispatching network-vif-unplugged-8e18e2a6-ee7e-4be2-8ffc-9b1c0c19c14f {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 16:24:45 user nova-compute[75176]: DEBUG nova.compute.manager [req-0776b919-c9a6-4e80-b322-a010e0f4b865 req-46344b2b-27f9-42d6-bf52-3ffd1b08785e service nova] [instance: 4f1d73b0-4c94-47f4-87e0-1546057dbcc6] Received event network-vif-unplugged-8e18e2a6-ee7e-4be2-8ffc-9b1c0c19c14f for instance with task_state deleting. {{(pid=75176) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 16:24:45 user nova-compute[75176]: INFO nova.compute.manager [None req-602889e8-7d5d-437a-a66b-24275e158aff tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] [instance: 4f1d73b0-4c94-47f4-87e0-1546057dbcc6] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 28 16:24:45 user nova-compute[75176]: DEBUG oslo.service.loopingcall [None req-602889e8-7d5d-437a-a66b-24275e158aff tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75176) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 16:24:45 user nova-compute[75176]: DEBUG nova.compute.manager [-] [instance: 4f1d73b0-4c94-47f4-87e0-1546057dbcc6] Deallocating network for instance {{(pid=75176) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 16:24:45 user nova-compute[75176]: DEBUG nova.network.neutron [-] [instance: 4f1d73b0-4c94-47f4-87e0-1546057dbcc6] deallocate_for_instance() {{(pid=75176) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 16:24:45 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:24:46 user nova-compute[75176]: DEBUG nova.network.neutron [-] [instance: 4f1d73b0-4c94-47f4-87e0-1546057dbcc6] Updating instance_info_cache with network_info: [] {{(pid=75176) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 16:24:46 user nova-compute[75176]: INFO nova.compute.manager [-] [instance: 4f1d73b0-4c94-47f4-87e0-1546057dbcc6] Took 1.00 seconds to deallocate network for instance.
Nov 28 16:24:46 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-602889e8-7d5d-437a-a66b-24275e158aff tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:24:46 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-602889e8-7d5d-437a-a66b-24275e158aff tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:24:46 user nova-compute[75176]: DEBUG nova.compute.provider_tree [None req-602889e8-7d5d-437a-a66b-24275e158aff tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Inventory has not changed in ProviderTree for provider: b37848d8-f401-4155-a029-b0ffa09ff85b {{(pid=75176) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 16:24:46 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-602889e8-7d5d-437a-a66b-24275e158aff tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Inventory has not changed for provider b37848d8-f401-4155-a029-b0ffa09ff85b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75176) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 16:24:46 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-602889e8-7d5d-437a-a66b-24275e158aff tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.162s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:24:46 user nova-compute[75176]: INFO nova.scheduler.client.report [None req-602889e8-7d5d-437a-a66b-24275e158aff tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Deleted allocations for instance 4f1d73b0-4c94-47f4-87e0-1546057dbcc6
Nov 28 16:24:46 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-602889e8-7d5d-437a-a66b-24275e158aff tempest-SnapshotDataIntegrityTests-317674187 tempest-SnapshotDataIntegrityTests-317674187-project-member] Lock "4f1d73b0-4c94-47f4-87e0-1546057dbcc6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.314s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:24:47 user nova-compute[75176]: DEBUG nova.compute.manager [req-7779b523-af0a-4501-a28d-002d41c72cdf req-80b03ef1-fff6-4194-8b31-2effab5a8a64 service nova] [instance: 4f1d73b0-4c94-47f4-87e0-1546057dbcc6] Received event network-vif-plugged-8e18e2a6-ee7e-4be2-8ffc-9b1c0c19c14f {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 16:24:47 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-7779b523-af0a-4501-a28d-002d41c72cdf req-80b03ef1-fff6-4194-8b31-2effab5a8a64 service nova] Acquiring lock "4f1d73b0-4c94-47f4-87e0-1546057dbcc6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:24:47 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-7779b523-af0a-4501-a28d-002d41c72cdf req-80b03ef1-fff6-4194-8b31-2effab5a8a64 service nova] Lock "4f1d73b0-4c94-47f4-87e0-1546057dbcc6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:24:47 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [req-7779b523-af0a-4501-a28d-002d41c72cdf req-80b03ef1-fff6-4194-8b31-2effab5a8a64 service nova] Lock "4f1d73b0-4c94-47f4-87e0-1546057dbcc6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:24:47 user nova-compute[75176]: DEBUG nova.compute.manager [req-7779b523-af0a-4501-a28d-002d41c72cdf req-80b03ef1-fff6-4194-8b31-2effab5a8a64 service nova] [instance: 4f1d73b0-4c94-47f4-87e0-1546057dbcc6] No waiting events found dispatching network-vif-plugged-8e18e2a6-ee7e-4be2-8ffc-9b1c0c19c14f {{(pid=75176) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 16:24:47 user nova-compute[75176]: WARNING nova.compute.manager [req-7779b523-af0a-4501-a28d-002d41c72cdf req-80b03ef1-fff6-4194-8b31-2effab5a8a64 service nova] [instance: 4f1d73b0-4c94-47f4-87e0-1546057dbcc6] Received unexpected event network-vif-plugged-8e18e2a6-ee7e-4be2-8ffc-9b1c0c19c14f for instance with vm_state deleted and task_state None.
Nov 28 16:24:47 user nova-compute[75176]: DEBUG nova.compute.manager [req-7779b523-af0a-4501-a28d-002d41c72cdf req-80b03ef1-fff6-4194-8b31-2effab5a8a64 service nova] [instance: 4f1d73b0-4c94-47f4-87e0-1546057dbcc6] Received event network-vif-deleted-8e18e2a6-ee7e-4be2-8ffc-9b1c0c19c14f {{(pid=75176) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 16:24:50 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:24:55 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 16:25:00 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:25:05 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 16:25:10 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:25:15 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:25:20 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 16:25:25 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 16:25:25 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:25:26 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:25:27 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:25:30 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:25:31 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:25:31 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:25:31 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75176) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 16:25:34 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:25:34 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Starting heal instance info cache {{(pid=75176) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 16:25:34 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Rebuilding the list of instances to heal {{(pid=75176) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 16:25:34 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Didn't find any instances for network info cache update. {{(pid=75176) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 28 16:25:34 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:25:35 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 16:25:35 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:25:35 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:25:35 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Cleaning up deleted instances {{(pid=75176) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 28 16:25:35 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] There are 0 instances to clean {{(pid=75176) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 28 16:25:37 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:25:38 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:25:40 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:25:40 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:25:43 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:25:43 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:25:43 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:25:43 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:25:43 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Auditing locally available compute resources for user (node: user) {{(pid=75176) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 16:25:44 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 16:25:44 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 16:25:44 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Hypervisor/Node resource view: name=user free_ram=9306MB free_disk=25.047256469726562GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75176) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 16:25:44 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:25:44 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:25:44 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75176) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 16:25:44 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75176) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 16:25:44 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Refreshing inventories for resource provider b37848d8-f401-4155-a029-b0ffa09ff85b {{(pid=75176) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 28 16:25:44 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Updating ProviderTree inventory for provider b37848d8-f401-4155-a029-b0ffa09ff85b from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75176) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 28 16:25:44 user nova-compute[75176]: DEBUG nova.compute.provider_tree [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Updating inventory in ProviderTree for provider b37848d8-f401-4155-a029-b0ffa09ff85b with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75176) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 28 16:25:44 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Refreshing aggregate associations for resource provider b37848d8-f401-4155-a029-b0ffa09ff85b, aggregates: None {{(pid=75176) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 28 16:25:44 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Refreshing trait associations for resource provider b37848d8-f401-4155-a029-b0ffa09ff85b, traits: COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_RESCUE_BFV,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NODE,HW_CPU_X86_SSSE3,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE42,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE2,COMPUTE_ACCELERATORS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VIRTIO {{(pid=75176) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 28 16:25:44 user nova-compute[75176]: DEBUG nova.compute.provider_tree [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Inventory has not changed in ProviderTree for provider: b37848d8-f401-4155-a029-b0ffa09ff85b {{(pid=75176) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 16:25:44 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Inventory has not changed for provider b37848d8-f401-4155-a029-b0ffa09ff85b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75176) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 16:25:44 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Compute_service record updated for user:user {{(pid=75176) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 16:25:44 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.422s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:25:45 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:25:47 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:25:50 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:25:55 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:25:55 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:25:55 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75176) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 28 16:26:00 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:26:01 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:26:05 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:26:10 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 16:26:15 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:26:16 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:26:20 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:26:24 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:26:25 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 16:26:26 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:26:28 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:26:30 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 16:26:30 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:26:30 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75176) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 16:26:30 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75176) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 16:26:30 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75176) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 16:26:30 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 16:26:32 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:26:32 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75176) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 16:26:33 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:26:34 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:26:34 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Starting heal instance info cache {{(pid=75176) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 16:26:34 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Rebuilding the list of instances to heal {{(pid=75176) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 16:26:34 user nova-compute[75176]: DEBUG nova.compute.manager [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Didn't find any instances for network info cache update. {{(pid=75176) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 28 16:26:35 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 16:26:35 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:26:35 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75176) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 16:26:35 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75176) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 16:26:35 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75176) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 16:26:35 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 16:26:36 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:26:39 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:26:40 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 16:26:40 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:26:40 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75176) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 16:26:40 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75176) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 16:26:40 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75176) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 16:26:40 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 16:26:44 user nova-compute[75176]: DEBUG oslo_service.periodic_task [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75176) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 16:26:44 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:26:44 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:26:44 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:26:44 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Auditing locally available compute resources for user (node: user) {{(pid=75176) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 16:26:45 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 16:26:45 user nova-compute[75176]: WARNING nova.virt.libvirt.driver [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 16:26:45 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Hypervisor/Node resource view: name=user free_ram=9324MB free_disk=25.039791107177734GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75176) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 16:26:45 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 16:26:45 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 16:26:45 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75176) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 16:26:45 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75176) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 16:26:45 user nova-compute[75176]: DEBUG nova.compute.provider_tree [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Inventory has not changed in ProviderTree for provider: b37848d8-f401-4155-a029-b0ffa09ff85b {{(pid=75176) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 16:26:45 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 16:26:45 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:26:45 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75176) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 16:26:45 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75176) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 16:26:45 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75176) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 16:26:45 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 16:26:45 user nova-compute[75176]: DEBUG nova.scheduler.client.report [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Inventory has not changed for provider b37848d8-f401-4155-a029-b0ffa09ff85b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75176) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 16:26:45 user nova-compute[75176]: DEBUG nova.compute.resource_tracker [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Compute_service record updated for user:user {{(pid=75176) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 16:26:45 user nova-compute[75176]: DEBUG oslo_concurrency.lockutils [None req-7d990b73-e97f-4aa5-b477-8d9104098d78 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.120s {{(pid=75176) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 16:26:50 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:26:55 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 16:26:55 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 16:26:55 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75176) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 16:26:55 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75176) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 16:26:55 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75176) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 16:26:55 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 16:27:00 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 16:27:05 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 16:27:10 user nova-compute[75176]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75176) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}